2024-06-13T01:47:46.956 INFO:root:teuthology version: 0.0.1.dev316+gc1b06c2 2024-06-13T01:47:46.957 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752594 --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/dbench}} --name teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752594/orig.config.yaml 2024-06-13T01:47:47.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-13T01:47:47.107 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752594 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/dbench}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7752594' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 1373963c202323287783ccb099bbae1ec8f14a5d owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 8815 sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba sleep_before_teardown: 0 subset: 250/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1373963c202323287783ccb099bbae1ec8f14a5d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPbo6MYJJEW5GVQGrw/wDUKU/FGPHmzru6+BZrCQHD+KFEkqFwEsCbcxqgfgWOTkJevI5LioYCm/R1K//lsG6vs= smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDvyrZzwrAWTtDRsjb/mdNaPk272GBXzDYWAbC61xcePxGKmWUZyc0vQXj67/yLK7qh1CwVU4RJCtF5lyLRpaco= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRc9sZRWwS8DAfaWie6KX4f600tJKgZLOnRQrIgsg3OmSNXbS9GvUF/C2q9icDrshT+z1RnMyW0cyuCxXeD+D4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: c1b06c2b5d3a02a3583265a115f09e052855bcf2 timestamp: 2024-06-12_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-13T01:47:47.107 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa; will attempt to use it 2024-06-13T01:47:47.108 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks 2024-06-13T01:47:47.108 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-13T01:47:47.109 INFO:teuthology.task.internal:Checking packages... 2024-06-13T01:47:47.127 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d89accfe3201286f000e065a1faea2a88c7a6ba' 2024-06-13T01:47:47.127 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-13T01:47:47.128 INFO:teuthology.packaging:ref: None 2024-06-13T01:47:47.128 INFO:teuthology.packaging:tag: None 2024-06-13T01:47:47.128 INFO:teuthology.packaging:branch: squid 2024-06-13T01:47:47.128 INFO:teuthology.packaging:sha1: 3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T01:47:47.128 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-06-13T01:47:47.522 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2998.g1373963c 2024-06-13T01:47:47.524 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-13T01:47:47.533 INFO:teuthology.task.internal:no buildpackages task found 2024-06-13T01:47:47.534 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-13T01:47:47.595 INFO:teuthology.task.internal:Saving configuration 2024-06-13T01:47:47.615 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-13T01:47:47.624 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-13T01:47:47.647 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752594', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-13 01:42:53.795130', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPbo6MYJJEW5GVQGrw/wDUKU/FGPHmzru6+BZrCQHD+KFEkqFwEsCbcxqgfgWOTkJevI5LioYCm/R1K//lsG6vs='} 2024-06-13T01:47:47.667 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752594', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-13 01:42:53.796911', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDvyrZzwrAWTtDRsjb/mdNaPk272GBXzDYWAbC61xcePxGKmWUZyc0vQXj67/yLK7qh1CwVU4RJCtF5lyLRpaco='} 2024-06-13T01:47:47.690 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752594', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-13 01:42:53.797950', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIRc9sZRWwS8DAfaWie6KX4f600tJKgZLOnRQrIgsg3OmSNXbS9GvUF/C2q9icDrshT+z1RnMyW0cyuCxXeD+D4='} 2024-06-13T01:47:47.690 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-13T01:47:47.697 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-06-13T01:47:47.698 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-06-13T01:47:47.698 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-06-13T01:47:47.698 INFO:teuthology.run_tasks:Running task console_log... 2024-06-13T01:47:47.800 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7a45fb3be0>, signals=[15]) 2024-06-13T01:47:47.801 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-13T01:47:47.815 INFO:teuthology.task.internal:Opening connections... 2024-06-13T01:47:47.815 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T01:47:47.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T01:47:47.901 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-06-13T01:47:47.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T01:47:47.973 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-06-13T01:47:47.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T01:47:48.044 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-13T01:47:48.050 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-06-13T01:47:48.069 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-06-13T01:47:48.069 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-06-13T01:47:48.126 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-06-13T01:47:48.127 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-06-13T01:47:48.127 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-06-13T01:47:48.127 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-06-13T01:47:48.127 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-06-13T01:47:48.127 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-06-13T01:47:48.127 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-13T01:47:48.127 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-06-13T01:47:48.127 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-06-13T01:47:48.127 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-13T01:47:48.127 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-06-13T01:47:48.127 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-13T01:47:48.128 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-13T01:47:48.128 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-13T01:47:48.128 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-06-13T01:47:48.150 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-06-13T01:47:48.168 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-06-13T01:47:48.168 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-06-13T01:47:48.224 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-06-13T01:47:48.224 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-06-13T01:47:48.224 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-06-13T01:47:48.224 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-06-13T01:47:48.225 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-06-13T01:47:48.225 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-06-13T01:47:48.225 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-13T01:47:48.225 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-06-13T01:47:48.225 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-06-13T01:47:48.225 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-13T01:47:48.225 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-06-13T01:47:48.225 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-13T01:47:48.225 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-13T01:47:48.225 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-13T01:47:48.225 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-06-13T01:47:48.250 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-06-13T01:47:48.268 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-06-13T01:47:48.268 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-06-13T01:47:48.325 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-06-13T01:47:48.325 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-06-13T01:47:48.325 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-06-13T01:47:48.325 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-06-13T01:47:48.326 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-06-13T01:47:48.326 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-06-13T01:47:48.326 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-13T01:47:48.326 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-06-13T01:47:48.326 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-06-13T01:47:48.326 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-13T01:47:48.326 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-06-13T01:47:48.326 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-13T01:47:48.326 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-13T01:47:48.326 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-13T01:47:48.326 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-06-13T01:47:48.350 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-13T01:47:48.360 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-13T01:47:48.397 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-13T01:47:48.397 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-06-13T01:47:48.400 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-06-13T01:47:48.402 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-06-13T01:47:48.418 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-13T01:47:48.429 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-13T01:47:48.429 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-06-13T01:47:48.457 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-06-13T01:47:48.459 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-06-13T01:47:48.575 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-13T01:47:48.633 INFO:teuthology.run_tasks:Running task kernel... 2024-06-13T01:47:48.649 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-06-13T01:47:48.649 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-06-13T01:47:48.649 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-06-13T01:47:48.649 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-13T01:47:48.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T01:47:48.667 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-06-13T01:47:49.063 DEBUG:teuthology.task.kernel:sha1 for client.0 is ff88c41504f3e4c4268de18904a6f347f1b3f2d6 2024-06-13T01:47:49.063 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "ff88c41504f3e4c4268de18904a6f347f1b3f2d6"... 2024-06-13T01:47:49.063 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-06-13T01:47:49.081 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-437.el9.x86_64 2024-06-13T01:47:49.082 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs ff88c41504f3e4c4268de18904a6f347f1b3f2d6 2024-06-13T01:47:49.082 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-06-13T01:47:49.082 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum upgrade -y linux-firmware 2024-06-13T01:47:51.568 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.1 MB 00:00 2024-06-13T01:47:56.878 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 20 MB 00:04 2024-06-13T01:48:01.544 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.3 MB 00:00 2024-06-13T01:48:03.945 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 17 kB 00:01 2024-06-13T01:48:04.989 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-06-13T01:48:10.444 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-06-13T01:48:12.667 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-06-13T01:48:12.673 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-06-13T01:48:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-06-13T01:48:12.673 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-06-13T01:48:12.673 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-06-13T01:48:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: linux-firmware noarch 20240603-144.el9 baseos 380 M 2024-06-13T01:48:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T01:48:12.673 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-06-13T01:48:12.674 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-06-13T01:48:12.674 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 1 Package 2024-06-13T01:48:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T01:48:12.674 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 380 M 2024-06-13T01:48:12.674 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-06-13T01:48:12.754 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] linux-firmware-20240603-144.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/linux-firmware-20240603-144.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-13T01:48:25.803 INFO:teuthology.orchestra.run.smithi002.stdout:linux-firmware-20240603-144.el9.noarch.rpm 29 MB/s | 380 MB 00:13 2024-06-13T01:48:25.804 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-06-13T01:48:25.805 INFO:teuthology.orchestra.run.smithi002.stdout:Total 29 MB/s | 380 MB 00:13 2024-06-13T01:48:29.009 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-06-13T01:48:29.084 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-06-13T01:48:29.084 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-06-13T01:48:32.461 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-06-13T01:48:32.462 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-06-13T01:48:41.555 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-06-13T01:48:42.382 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : linux-firmware-20240603-144.el9.noarch 1/2 2024-06-13T01:48:42.462 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-06-13T01:48:42.964 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-06-13T01:48:42.964 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : linux-firmware-20240603-144.el9.noarch 1/2 2024-06-13T01:48:43.724 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-06-13T01:48:43.724 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T01:48:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-06-13T01:48:43.725 INFO:teuthology.orchestra.run.smithi002.stdout: linux-firmware-20240603-144.el9.noarch 2024-06-13T01:48:43.725 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T01:48:43.725 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-06-13T01:48:44.030 INFO:teuthology.task.kernel:Downloading kernel ff88c41504f3e4c4268de18904a6f347f1b3f2d6 on client.0... 2024-06-13T01:48:44.031 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ff88c41504f3e4c4268de18904a6f347f1b3f2d6 2024-06-13T01:48:44.247 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/ff88c41504f3e4c4268de18904a6f347f1b3f2d6/centos/9/flavors/default/x86_64/ 2024-06-13T01:48:44.248 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_gff88c41504f3-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/ff88c41504f3e4c4268de18904a6f347f1b3f2d6/centos/9/flavors/default/x86_64/ --input-file=- 2024-06-13T01:48:44.250 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi002.front.sepia.ceph.com to complete... 2024-06-13T01:49:05.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13 01:49:05 URL:https://3.chacra.ceph.com/r/kernel/testing/ff88c41504f3e4c4268de18904a6f347f1b3f2d6/centos/9/flavors/default/x86_64/kernel-6.9.0_gff88c41504f3-1.x86_64.rpm [356881057/356881057] -> "/tmp/kernel.x86_64.rpm" [1] 2024-06-13T01:49:05.967 INFO:teuthology.orchestra.run.smithi002.stderr:FINISHED --2024-06-13 01:49:05-- 2024-06-13T01:49:05.967 INFO:teuthology.orchestra.run.smithi002.stderr:Total wall clock time: 22s 2024-06-13T01:49:05.967 INFO:teuthology.orchestra.run.smithi002.stderr:Downloaded: 1 files, 340M in 21s (15.9 MB/s) 2024-06-13T01:49:05.971 INFO:teuthology.task.kernel:Installing kernel ff88c41504f3e4c4268de18904a6f347f1b3f2d6 on client.0... 2024-06-13T01:49:05.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-06-13T01:49:08.119 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying... ######################################## 2024-06-13T01:49:08.172 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing... ######################################## 2024-06-13T01:49:08.225 INFO:teuthology.orchestra.run.smithi002.stdout:Updating / installing... 2024-06-13T01:49:16.497 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-6.9.0_gff88c41504f3-1 ######################################## 2024-06-13T01:49:56.517 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-06-13T01:49:56.517 DEBUG:teuthology.orchestra.run.smithi002:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-06-13T01:49:56.610 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/System.map-6.9.0-gff88c41504f3 2024-06-13T01:49:56.611 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/config-6.9.0-gff88c41504f3 2024-06-13T01:49:56.611 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/vmlinuz-6.9.0-gff88c41504f3 2024-06-13T01:49:56.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/System.map 2024-06-13T01:49:56.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/config 2024-06-13T01:49:56.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel 2024-06-13T01:49:56.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch 2024-06-13T01:49:56.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86 2024-06-13T01:49:56.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto 2024-06-13T01:49:56.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-06-13T01:49:56.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-06-13T01:49:56.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-06-13T01:49:56.611 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-06-13T01:49:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-06-13T01:49:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-06-13T01:49:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-06-13T01:49:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/crc32c-intel.ko 2024-06-13T01:49:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-06-13T01:49:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-06-13T01:49:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-06-13T01:49:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-06-13T01:49:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/serpent-avx2.ko 2024-06-13T01:49:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-06-13T01:49:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-06-13T01:49:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-06-13T01:49:56.612 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-06-13T01:49:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-06-13T01:49:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-06-13T01:49:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-06-13T01:49:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kernel 2024-06-13T01:49:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kernel/cpu 2024-06-13T01:49:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kernel/cpu/mce 2024-06-13T01:49:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-06-13T01:49:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kvm 2024-06-13T01:49:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kvm/kvm-amd.ko 2024-06-13T01:49:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kvm/kvm-intel.ko 2024-06-13T01:49:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/arch/x86/kvm/kvm.ko 2024-06-13T01:49:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto 2024-06-13T01:49:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/ansi_cprng.ko 2024-06-13T01:49:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/anubis.ko 2024-06-13T01:49:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/arc4.ko 2024-06-13T01:49:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/async_tx 2024-06-13T01:49:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/async_tx/async_memcpy.ko 2024-06-13T01:49:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/async_tx/async_pq.ko 2024-06-13T01:49:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/async_tx/async_raid6_recov.ko 2024-06-13T01:49:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/async_tx/async_tx.ko 2024-06-13T01:49:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/async_tx/async_xor.ko 2024-06-13T01:49:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/async_tx/raid6test.ko 2024-06-13T01:49:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/authenc.ko 2024-06-13T01:49:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/authencesn.ko 2024-06-13T01:49:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/blake2b_generic.ko 2024-06-13T01:49:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/blowfish_common.ko 2024-06-13T01:49:56.614 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/blowfish_generic.ko 2024-06-13T01:49:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/camellia_generic.ko 2024-06-13T01:49:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/cast5_generic.ko 2024-06-13T01:49:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/cast6_generic.ko 2024-06-13T01:49:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/cast_common.ko 2024-06-13T01:49:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/ccm.ko 2024-06-13T01:49:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/cmac.ko 2024-06-13T01:49:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/crc32_generic.ko 2024-06-13T01:49:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/crypto_engine.ko 2024-06-13T01:49:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/crypto_user.ko 2024-06-13T01:49:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/cts.ko 2024-06-13T01:49:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/des_generic.ko 2024-06-13T01:49:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/dh_generic.ko 2024-06-13T01:49:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/echainiv.ko 2024-06-13T01:49:56.615 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/essiv.ko 2024-06-13T01:49:56.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/fcrypt.ko 2024-06-13T01:49:56.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/khazad.ko 2024-06-13T01:49:56.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/lz4.ko 2024-06-13T01:49:56.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/lz4hc.ko 2024-06-13T01:49:56.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/md4.ko 2024-06-13T01:49:56.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/michael_mic.ko 2024-06-13T01:49:56.616 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/pcbc.ko 2024-06-13T01:49:56.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/pcrypt.ko 2024-06-13T01:49:56.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/rmd160.ko 2024-06-13T01:49:56.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/seed.ko 2024-06-13T01:49:56.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/serpent_generic.ko 2024-06-13T01:49:56.617 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/tcrypt.ko 2024-06-13T01:49:56.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/tea.ko 2024-06-13T01:49:56.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/twofish_common.ko 2024-06-13T01:49:56.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/twofish_generic.ko 2024-06-13T01:49:56.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/vmac.ko 2024-06-13T01:49:56.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/wp512.ko 2024-06-13T01:49:56.618 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/xcbc.ko 2024-06-13T01:49:56.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/xor.ko 2024-06-13T01:49:56.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/crypto/xxhash_generic.ko 2024-06-13T01:49:56.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers 2024-06-13T01:49:56.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi 2024-06-13T01:49:56.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi/acpi_ipmi.ko 2024-06-13T01:49:56.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi/acpi_pad.ko 2024-06-13T01:49:56.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi/ec_sys.ko 2024-06-13T01:49:56.619 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi/platform_profile.ko 2024-06-13T01:49:56.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi/sbs.ko 2024-06-13T01:49:56.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi/sbshc.ko 2024-06-13T01:49:56.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/acpi/video.ko 2024-06-13T01:49:56.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata 2024-06-13T01:49:56.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/acard-ahci.ko 2024-06-13T01:49:56.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/ahci_platform.ko 2024-06-13T01:49:56.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/ata_generic.ko 2024-06-13T01:49:56.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/libahci_platform.ko 2024-06-13T01:49:56.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_acpi.ko 2024-06-13T01:49:56.620 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_ali.ko 2024-06-13T01:49:56.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_amd.ko 2024-06-13T01:49:56.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_artop.ko 2024-06-13T01:49:56.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_atiixp.ko 2024-06-13T01:49:56.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_atp867x.ko 2024-06-13T01:49:56.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_cmd640.ko 2024-06-13T01:49:56.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_cmd64x.ko 2024-06-13T01:49:56.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_cypress.ko 2024-06-13T01:49:56.621 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_efar.ko 2024-06-13T01:49:56.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_hpt366.ko 2024-06-13T01:49:56.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_hpt37x.ko 2024-06-13T01:49:56.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_hpt3x2n.ko 2024-06-13T01:49:56.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_hpt3x3.ko 2024-06-13T01:49:56.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_it8213.ko 2024-06-13T01:49:56.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_it821x.ko 2024-06-13T01:49:56.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_jmicron.ko 2024-06-13T01:49:56.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_marvell.ko 2024-06-13T01:49:56.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_mpiix.ko 2024-06-13T01:49:56.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_netcell.ko 2024-06-13T01:49:56.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_ninja32.ko 2024-06-13T01:49:56.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_ns87410.ko 2024-06-13T01:49:56.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_ns87415.ko 2024-06-13T01:49:56.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_oldpiix.ko 2024-06-13T01:49:56.622 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_opti.ko 2024-06-13T01:49:56.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_optidma.ko 2024-06-13T01:49:56.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_pcmcia.ko 2024-06-13T01:49:56.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_pdc2027x.ko 2024-06-13T01:49:56.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-06-13T01:49:56.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_piccolo.ko 2024-06-13T01:49:56.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_rdc.ko 2024-06-13T01:49:56.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_sch.ko 2024-06-13T01:49:56.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_serverworks.ko 2024-06-13T01:49:56.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_sil680.ko 2024-06-13T01:49:56.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_sis.ko 2024-06-13T01:49:56.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_sl82c105.ko 2024-06-13T01:49:56.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_triflex.ko 2024-06-13T01:49:56.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pata_via.ko 2024-06-13T01:49:56.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/pdc_adma.ko 2024-06-13T01:49:56.623 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_inic162x.ko 2024-06-13T01:49:56.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_mv.ko 2024-06-13T01:49:56.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_nv.ko 2024-06-13T01:49:56.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_promise.ko 2024-06-13T01:49:56.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_qstor.ko 2024-06-13T01:49:56.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_sil.ko 2024-06-13T01:49:56.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_sil24.ko 2024-06-13T01:49:56.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_sis.ko 2024-06-13T01:49:56.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_svw.ko 2024-06-13T01:49:56.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_sx4.ko 2024-06-13T01:49:56.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_uli.ko 2024-06-13T01:49:56.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_via.ko 2024-06-13T01:49:56.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ata/sata_vsc.ko 2024-06-13T01:49:56.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/auxdisplay 2024-06-13T01:49:56.624 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/auxdisplay/ks0108.ko 2024-06-13T01:49:56.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/base 2024-06-13T01:49:56.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/base/regmap 2024-06-13T01:49:56.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/base/regmap/regmap-i2c.ko 2024-06-13T01:49:56.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/base/regmap/regmap-mmio.ko 2024-06-13T01:49:56.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/bcma 2024-06-13T01:49:56.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/bcma/bcma.ko 2024-06-13T01:49:56.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block 2024-06-13T01:49:56.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/aoe 2024-06-13T01:49:56.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/aoe/aoe.ko 2024-06-13T01:49:56.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/brd.ko 2024-06-13T01:49:56.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/drbd 2024-06-13T01:49:56.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/drbd/drbd.ko 2024-06-13T01:49:56.625 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/floppy.ko 2024-06-13T01:49:56.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/loop.ko 2024-06-13T01:49:56.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/mtip32xx 2024-06-13T01:49:56.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-06-13T01:49:56.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/nbd.ko 2024-06-13T01:49:56.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/null_blk 2024-06-13T01:49:56.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/null_blk/null_blk.ko 2024-06-13T01:49:56.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/pktcdvd.ko 2024-06-13T01:49:56.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/rbd.ko 2024-06-13T01:49:56.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/virtio_blk.ko 2024-06-13T01:49:56.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/xen-blkback 2024-06-13T01:49:56.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-06-13T01:49:56.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/xen-blkfront.ko 2024-06-13T01:49:56.626 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/zram 2024-06-13T01:49:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/block/zram/zram.ko 2024-06-13T01:49:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char 2024-06-13T01:49:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/hangcheck-timer.ko 2024-06-13T01:49:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/hw_random 2024-06-13T01:49:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/hw_random/amd-rng.ko 2024-06-13T01:49:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/hw_random/intel-rng.ko 2024-06-13T01:49:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-06-13T01:49:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/hw_random/via-rng.ko 2024-06-13T01:49:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/hw_random/virtio-rng.ko 2024-06-13T01:49:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ipmi 2024-06-13T01:49:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-06-13T01:49:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-06-13T01:49:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-06-13T01:49:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ipmi/ipmi_si.ko 2024-06-13T01:49:56.627 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-06-13T01:49:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-06-13T01:49:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/lp.ko 2024-06-13T01:49:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/mwave 2024-06-13T01:49:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/mwave/mwave.ko 2024-06-13T01:49:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/ppdev.ko 2024-06-13T01:49:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tlclk.ko 2024-06-13T01:49:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tpm 2024-06-13T01:49:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tpm/tpm.ko 2024-06-13T01:49:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tpm/tpm_atmel.ko 2024-06-13T01:49:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tpm/tpm_infineon.ko 2024-06-13T01:49:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tpm/tpm_nsc.ko 2024-06-13T01:49:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tpm/tpm_tis.ko 2024-06-13T01:49:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-06-13T01:49:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/uv_mmtimer.ko 2024-06-13T01:49:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/char/virtio_console.ko 2024-06-13T01:49:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/cpufreq 2024-06-13T01:49:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-06-13T01:49:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-06-13T01:49:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/cpufreq/p4-clockmod.ko 2024-06-13T01:49:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-06-13T01:49:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/cpufreq/powernow-k8.ko 2024-06-13T01:49:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/cpufreq/speedstep-lib.ko 2024-06-13T01:49:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto 2024-06-13T01:49:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/ccp 2024-06-13T01:49:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-06-13T01:49:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/ccp/ccp.ko 2024-06-13T01:49:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/intel 2024-06-13T01:49:56.629 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/intel/qat 2024-06-13T01:49:56.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/intel/qat/qat_common 2024-06-13T01:49:56.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-06-13T01:49:56.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-06-13T01:49:56.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-06-13T01:49:56.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/padlock-aes.ko 2024-06-13T01:49:56.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/padlock-sha.ko 2024-06-13T01:49:56.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/virtio 2024-06-13T01:49:56.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-06-13T01:49:56.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/dca 2024-06-13T01:49:56.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/dca/dca.ko 2024-06-13T01:49:56.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/devfreq 2024-06-13T01:49:56.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-06-13T01:49:56.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/dma 2024-06-13T01:49:56.630 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/dma/dw 2024-06-13T01:49:56.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/dma/dw/dw_dmac.ko 2024-06-13T01:49:56.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/dma/ioat 2024-06-13T01:49:56.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/dma/ioat/ioatdma.ko 2024-06-13T01:49:56.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac 2024-06-13T01:49:56.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/amd64_edac.ko 2024-06-13T01:49:56.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/e752x_edac.ko 2024-06-13T01:49:56.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/edac_mce_amd.ko 2024-06-13T01:49:56.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/i3000_edac.ko 2024-06-13T01:49:56.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/i3200_edac.ko 2024-06-13T01:49:56.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/i5100_edac.ko 2024-06-13T01:49:56.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/i5400_edac.ko 2024-06-13T01:49:56.631 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/i7300_edac.ko 2024-06-13T01:49:56.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/i7core_edac.ko 2024-06-13T01:49:56.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/i82975x_edac.ko 2024-06-13T01:49:56.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/ie31200_edac.ko 2024-06-13T01:49:56.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/sb_edac.ko 2024-06-13T01:49:56.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/edac/x38_edac.ko 2024-06-13T01:49:56.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/firmware 2024-06-13T01:49:56.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/firmware/edd.ko 2024-06-13T01:49:56.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/firmware/iscsi_ibft.ko 2024-06-13T01:49:56.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/gpio 2024-06-13T01:49:56.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/gpio/gpio-ich.ko 2024-06-13T01:49:56.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/gpio/gpio-viperboard.ko 2024-06-13T01:49:56.632 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-appleir.ko 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-aureal.ko 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-axff.ko 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-dr.ko 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-elecom.ko 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-elo.ko 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-emsff.ko 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-gaff.ko 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-gt683r.ko 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-gyration.ko 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-holtek-kbd.ko 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-holtek-mouse.ko 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-holtekff.ko 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-hyperv.ko 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-icade.ko 2024-06-13T01:49:56.633 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-keytouch.ko 2024-06-13T01:49:56.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-kye.ko 2024-06-13T01:49:56.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-lcpower.ko 2024-06-13T01:49:56.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-led.ko 2024-06-13T01:49:56.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-lenovo.ko 2024-06-13T01:49:56.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-logitech-dj.ko 2024-06-13T01:49:56.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-06-13T01:49:56.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-multitouch.ko 2024-06-13T01:49:56.634 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-ortek.ko 2024-06-13T01:49:56.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-penmount.ko 2024-06-13T01:49:56.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-petalynx.ko 2024-06-13T01:49:56.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-picolcd.ko 2024-06-13T01:49:56.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-pl.ko 2024-06-13T01:49:56.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-plantronics.ko 2024-06-13T01:49:56.635 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-primax.ko 2024-06-13T01:49:56.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-rmi.ko 2024-06-13T01:49:56.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-arvo.ko 2024-06-13T01:49:56.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-common.ko 2024-06-13T01:49:56.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-isku.ko 2024-06-13T01:49:56.636 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-kone.ko 2024-06-13T01:49:56.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-06-13T01:49:56.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-konepure.ko 2024-06-13T01:49:56.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-06-13T01:49:56.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-lua.ko 2024-06-13T01:49:56.637 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-pyra.ko 2024-06-13T01:49:56.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-ryos.ko 2024-06-13T01:49:56.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat-savu.ko 2024-06-13T01:49:56.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-roccat.ko 2024-06-13T01:49:56.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-saitek.ko 2024-06-13T01:49:56.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-samsung.ko 2024-06-13T01:49:56.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-sensor-hub.ko 2024-06-13T01:49:56.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-sjoy.ko 2024-06-13T01:49:56.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-sony.ko 2024-06-13T01:49:56.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-speedlink.ko 2024-06-13T01:49:56.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-steelseries.ko 2024-06-13T01:49:56.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-sunplus.ko 2024-06-13T01:49:56.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-thrustmaster.ko 2024-06-13T01:49:56.638 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-tivo.ko 2024-06-13T01:49:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-tmff.ko 2024-06-13T01:49:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-topseed.ko 2024-06-13T01:49:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-twinhan.ko 2024-06-13T01:49:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-uclogic.ko 2024-06-13T01:49:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-waltop.ko 2024-06-13T01:49:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-wiimote.ko 2024-06-13T01:49:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-xinmo.ko 2024-06-13T01:49:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-zpff.ko 2024-06-13T01:49:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/hid-zydacron.ko 2024-06-13T01:49:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/uhid.ko 2024-06-13T01:49:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hid/wacom.ko 2024-06-13T01:49:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hv 2024-06-13T01:49:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hv/hv_balloon.ko 2024-06-13T01:49:56.639 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hv/hv_utils.ko 2024-06-13T01:49:56.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hv/hv_vmbus.ko 2024-06-13T01:49:56.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon 2024-06-13T01:49:56.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/abituguru.ko 2024-06-13T01:49:56.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/abituguru3.ko 2024-06-13T01:49:56.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/acpi_power_meter.ko 2024-06-13T01:49:56.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ad7414.ko 2024-06-13T01:49:56.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ad7418.ko 2024-06-13T01:49:56.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adc128d818.ko 2024-06-13T01:49:56.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adm1025.ko 2024-06-13T01:49:56.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adm1026.ko 2024-06-13T01:49:56.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adm1029.ko 2024-06-13T01:49:56.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adm1031.ko 2024-06-13T01:49:56.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adm9240.ko 2024-06-13T01:49:56.640 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ads7828.ko 2024-06-13T01:49:56.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adt7410.ko 2024-06-13T01:49:56.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adt7411.ko 2024-06-13T01:49:56.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adt7462.ko 2024-06-13T01:49:56.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adt7470.ko 2024-06-13T01:49:56.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adt7475.ko 2024-06-13T01:49:56.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/adt7x10.ko 2024-06-13T01:49:56.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/amc6821.ko 2024-06-13T01:49:56.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/applesmc.ko 2024-06-13T01:49:56.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/asb100.ko 2024-06-13T01:49:56.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/asc7621.ko 2024-06-13T01:49:56.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/asus_atk0110.ko 2024-06-13T01:49:56.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/atxp1.ko 2024-06-13T01:49:56.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/coretemp.ko 2024-06-13T01:49:56.641 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-06-13T01:49:56.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/dme1737.ko 2024-06-13T01:49:56.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ds1621.ko 2024-06-13T01:49:56.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ds620.ko 2024-06-13T01:49:56.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/emc1403.ko 2024-06-13T01:49:56.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/emc6w201.ko 2024-06-13T01:49:56.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/f71805f.ko 2024-06-13T01:49:56.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/f71882fg.ko 2024-06-13T01:49:56.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/f75375s.ko 2024-06-13T01:49:56.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/fam15h_power.ko 2024-06-13T01:49:56.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/fschmd.ko 2024-06-13T01:49:56.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/g760a.ko 2024-06-13T01:49:56.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/g762.ko 2024-06-13T01:49:56.642 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/gl518sm.ko 2024-06-13T01:49:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/gl520sm.ko 2024-06-13T01:49:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/hwmon-vid.ko 2024-06-13T01:49:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/i5500_temp.ko 2024-06-13T01:49:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/i5k_amb.ko 2024-06-13T01:49:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ibmaem.ko 2024-06-13T01:49:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ibmpex.ko 2024-06-13T01:49:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ina209.ko 2024-06-13T01:49:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ina2xx.ko 2024-06-13T01:49:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/it87.ko 2024-06-13T01:49:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/k10temp.ko 2024-06-13T01:49:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/k8temp.ko 2024-06-13T01:49:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lineage-pem.ko 2024-06-13T01:49:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm63.ko 2024-06-13T01:49:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm73.ko 2024-06-13T01:49:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm75.ko 2024-06-13T01:49:56.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm77.ko 2024-06-13T01:49:56.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm78.ko 2024-06-13T01:49:56.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm80.ko 2024-06-13T01:49:56.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm83.ko 2024-06-13T01:49:56.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm85.ko 2024-06-13T01:49:56.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm87.ko 2024-06-13T01:49:56.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm90.ko 2024-06-13T01:49:56.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm92.ko 2024-06-13T01:49:56.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm93.ko 2024-06-13T01:49:56.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm95234.ko 2024-06-13T01:49:56.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm95241.ko 2024-06-13T01:49:56.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/lm95245.ko 2024-06-13T01:49:56.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ltc2945.ko 2024-06-13T01:49:56.644 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ltc4151.ko 2024-06-13T01:49:56.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ltc4215.ko 2024-06-13T01:49:56.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ltc4222.ko 2024-06-13T01:49:56.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ltc4245.ko 2024-06-13T01:49:56.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ltc4260.ko 2024-06-13T01:49:56.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/ltc4261.ko 2024-06-13T01:49:56.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/max16065.ko 2024-06-13T01:49:56.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/max1619.ko 2024-06-13T01:49:56.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/max1668.ko 2024-06-13T01:49:56.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/max197.ko 2024-06-13T01:49:56.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/max6639.ko 2024-06-13T01:49:56.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/max6650.ko 2024-06-13T01:49:56.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/max6697.ko 2024-06-13T01:49:56.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/mcp3021.ko 2024-06-13T01:49:56.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/nct6683.ko 2024-06-13T01:49:56.645 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/nct6775-core.ko 2024-06-13T01:49:56.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/nct6775.ko 2024-06-13T01:49:56.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/nct7802.ko 2024-06-13T01:49:56.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pc87360.ko 2024-06-13T01:49:56.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pc87427.ko 2024-06-13T01:49:56.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pcf8591.ko 2024-06-13T01:49:56.646 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus 2024-06-13T01:49:56.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-06-13T01:49:56.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-06-13T01:49:56.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-06-13T01:49:56.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/max16064.ko 2024-06-13T01:49:56.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/max34440.ko 2024-06-13T01:49:56.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/max8688.ko 2024-06-13T01:49:56.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-06-13T01:49:56.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-06-13T01:49:56.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-06-13T01:49:56.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-06-13T01:49:56.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-06-13T01:49:56.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-06-13T01:49:56.647 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/powr1220.ko 2024-06-13T01:49:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/sch5627.ko 2024-06-13T01:49:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/sch5636.ko 2024-06-13T01:49:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/sch56xx-common.ko 2024-06-13T01:49:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/sht15.ko 2024-06-13T01:49:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/sht21.ko 2024-06-13T01:49:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/shtc1.ko 2024-06-13T01:49:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/sis5595.ko 2024-06-13T01:49:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/smsc47b397.ko 2024-06-13T01:49:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/smsc47m1.ko 2024-06-13T01:49:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/smsc47m192.ko 2024-06-13T01:49:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/thmc50.ko 2024-06-13T01:49:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/tmp102.ko 2024-06-13T01:49:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/tmp103.ko 2024-06-13T01:49:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/tmp401.ko 2024-06-13T01:49:56.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/tmp421.ko 2024-06-13T01:49:56.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/via-cputemp.ko 2024-06-13T01:49:56.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/via686a.ko 2024-06-13T01:49:56.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/vt1211.ko 2024-06-13T01:49:56.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/vt8231.ko 2024-06-13T01:49:56.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83627ehf.ko 2024-06-13T01:49:56.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83627hf.ko 2024-06-13T01:49:56.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83781d.ko 2024-06-13T01:49:56.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83791d.ko 2024-06-13T01:49:56.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83792d.ko 2024-06-13T01:49:56.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83793.ko 2024-06-13T01:49:56.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83795.ko 2024-06-13T01:49:56.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83l785ts.ko 2024-06-13T01:49:56.649 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/hwmon/w83l786ng.ko 2024-06-13T01:49:56.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c 2024-06-13T01:49:56.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/algos 2024-06-13T01:49:56.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-06-13T01:49:56.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-06-13T01:49:56.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses 2024-06-13T01:49:56.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-06-13T01:49:56.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-06-13T01:49:56.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-06-13T01:49:56.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-06-13T01:49:56.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-06-13T01:49:56.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-06-13T01:49:56.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-06-13T01:49:56.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-06-13T01:49:56.650 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-i801.ko 2024-06-13T01:49:56.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-isch.ko 2024-06-13T01:49:56.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-06-13T01:49:56.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-06-13T01:49:56.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-06-13T01:49:56.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-parport.ko 2024-06-13T01:49:56.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-06-13T01:49:56.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-06-13T01:49:56.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-06-13T01:49:56.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-06-13T01:49:56.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-06-13T01:49:56.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-06-13T01:49:56.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-via.ko 2024-06-13T01:49:56.651 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-06-13T01:49:56.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-06-13T01:49:56.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/i2c-dev.ko 2024-06-13T01:49:56.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/i2c-mux.ko 2024-06-13T01:49:56.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-06-13T01:49:56.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/i2c-smbus.ko 2024-06-13T01:49:56.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/i2c/i2c-stub.ko 2024-06-13T01:49:56.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband 2024-06-13T01:49:56.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core 2024-06-13T01:49:56.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core/ib_cm.ko 2024-06-13T01:49:56.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core/ib_core.ko 2024-06-13T01:49:56.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core/ib_umad.ko 2024-06-13T01:49:56.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-06-13T01:49:56.652 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core/iw_cm.ko 2024-06-13T01:49:56.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core/rdma_cm.ko 2024-06-13T01:49:56.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-06-13T01:49:56.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw 2024-06-13T01:49:56.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/cxgb4 2024-06-13T01:49:56.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-06-13T01:49:56.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/mlx4 2024-06-13T01:49:56.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-06-13T01:49:56.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/mlx5 2024-06-13T01:49:56.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-06-13T01:49:56.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/mthca 2024-06-13T01:49:56.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-06-13T01:49:56.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp 2024-06-13T01:49:56.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/ipoib 2024-06-13T01:49:56.653 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-06-13T01:49:56.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/iser 2024-06-13T01:49:56.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-06-13T01:49:56.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/isert 2024-06-13T01:49:56.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-06-13T01:49:56.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/srp 2024-06-13T01:49:56.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-06-13T01:49:56.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/srpt 2024-06-13T01:49:56.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-06-13T01:49:56.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input 2024-06-13T01:49:56.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/gameport 2024-06-13T01:49:56.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-06-13T01:49:56.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/gameport/fm801-gp.ko 2024-06-13T01:49:56.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/gameport/gameport.ko 2024-06-13T01:49:56.654 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/joydev.ko 2024-06-13T01:49:56.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/keyboard 2024-06-13T01:49:56.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/keyboard/gpio_keys.ko 2024-06-13T01:49:56.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse 2024-06-13T01:49:56.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/appletouch.ko 2024-06-13T01:49:56.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/bcm5974.ko 2024-06-13T01:49:56.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/cyapatp.ko 2024-06-13T01:49:56.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/elan_i2c.ko 2024-06-13T01:49:56.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/sermouse.ko 2024-06-13T01:49:56.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-06-13T01:49:56.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/synaptics_usb.ko 2024-06-13T01:49:56.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/mouse/vsxxxaa.ko 2024-06-13T01:49:56.655 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/rmi4 2024-06-13T01:49:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/rmi4/rmi_core.ko 2024-06-13T01:49:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/serio 2024-06-13T01:49:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/serio/altera_ps2.ko 2024-06-13T01:49:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/serio/arc_ps2.ko 2024-06-13T01:49:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-06-13T01:49:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/serio/serio_raw.ko 2024-06-13T01:49:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/input/sparse-keymap.ko 2024-06-13T01:49:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds 2024-06-13T01:49:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/leds-blinkm.ko 2024-06-13T01:49:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/leds-lm3530.ko 2024-06-13T01:49:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/leds-lp3944.ko 2024-06-13T01:49:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/leds-ss4200.ko 2024-06-13T01:49:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger 2024-06-13T01:49:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-06-13T01:49:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-06-13T01:49:56.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-06-13T01:49:56.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-06-13T01:49:56.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-06-13T01:49:56.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-06-13T01:49:56.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-06-13T01:49:56.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-06-13T01:49:56.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-06-13T01:49:56.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md 2024-06-13T01:49:56.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/bcache 2024-06-13T01:49:56.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/bcache/bcache.ko 2024-06-13T01:49:56.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-bio-prison.ko 2024-06-13T01:49:56.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-cache-smq.ko 2024-06-13T01:49:56.657 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-cache.ko 2024-06-13T01:49:56.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-crypt.ko 2024-06-13T01:49:56.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-delay.ko 2024-06-13T01:49:56.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-flakey.ko 2024-06-13T01:49:56.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-log-userspace.ko 2024-06-13T01:49:56.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-multipath.ko 2024-06-13T01:49:56.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-queue-length.ko 2024-06-13T01:49:56.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-raid.ko 2024-06-13T01:49:56.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-round-robin.ko 2024-06-13T01:49:56.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-service-time.ko 2024-06-13T01:49:56.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-switch.ko 2024-06-13T01:49:56.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-thin-pool.ko 2024-06-13T01:49:56.658 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/dm-verity.ko 2024-06-13T01:49:56.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/persistent-data 2024-06-13T01:49:56.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-06-13T01:49:56.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/raid0.ko 2024-06-13T01:49:56.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/raid1.ko 2024-06-13T01:49:56.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/raid10.ko 2024-06-13T01:49:56.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/md/raid456.ko 2024-06-13T01:49:56.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message 2024-06-13T01:49:56.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion 2024-06-13T01:49:56.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion/mptbase.ko 2024-06-13T01:49:56.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion/mptctl.ko 2024-06-13T01:49:56.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion/mptfc.ko 2024-06-13T01:49:56.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion/mptlan.ko 2024-06-13T01:49:56.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion/mptsas.ko 2024-06-13T01:49:56.659 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion/mptscsih.ko 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/message/fusion/mptspi.ko 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd/lpc_ich.ko 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd/lpc_sch.ko 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd/mfd-core.ko 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd/sm501.ko 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd/viperboard.ko 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd/vx855.ko 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/mfd/wl1273-core.ko 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/altera-stapl 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/apds9802als.ko 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/apds990x.ko 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/bh1770glc.ko 2024-06-13T01:49:56.660 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/cb710 2024-06-13T01:49:56.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/cb710/cb710.ko 2024-06-13T01:49:56.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/eeprom 2024-06-13T01:49:56.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/eeprom/at24.ko 2024-06-13T01:49:56.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-06-13T01:49:56.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/eeprom/max6875.ko 2024-06-13T01:49:56.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/enclosure.ko 2024-06-13T01:49:56.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/hpilo.ko 2024-06-13T01:49:56.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/isl29003.ko 2024-06-13T01:49:56.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/isl29020.ko 2024-06-13T01:49:56.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/lis3lv02d 2024-06-13T01:49:56.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-06-13T01:49:56.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-06-13T01:49:56.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/mei 2024-06-13T01:49:56.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/mei/mei-me.ko 2024-06-13T01:49:56.661 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/mei/mei-txe.ko 2024-06-13T01:49:56.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/mei/mei.ko 2024-06-13T01:49:56.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/sgi-gru 2024-06-13T01:49:56.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/sgi-gru/gru.ko 2024-06-13T01:49:56.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/sgi-xp 2024-06-13T01:49:56.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/sgi-xp/xp.ko 2024-06-13T01:49:56.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/sgi-xp/xpc.ko 2024-06-13T01:49:56.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-06-13T01:49:56.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/tifm_7xx1.ko 2024-06-13T01:49:56.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/tifm_core.ko 2024-06-13T01:49:56.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/tsl2550.ko 2024-06-13T01:49:56.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/vmw_balloon.ko 2024-06-13T01:49:56.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/vmw_vmci 2024-06-13T01:49:56.662 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-06-13T01:49:56.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net 2024-06-13T01:49:56.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/bonding 2024-06-13T01:49:56.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/bonding/bonding.ko 2024-06-13T01:49:56.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dsa 2024-06-13T01:49:56.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dsa/b53 2024-06-13T01:49:56.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dsa/b53/b53_common.ko 2024-06-13T01:49:56.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dsa/bcm-sf2.ko 2024-06-13T01:49:56.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dsa/mv88e6060.ko 2024-06-13T01:49:56.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dsa/mv88e6xxx 2024-06-13T01:49:56.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-06-13T01:49:56.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/dummy.ko 2024-06-13T01:49:56.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/eql.ko 2024-06-13T01:49:56.663 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet 2024-06-13T01:49:56.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/3com 2024-06-13T01:49:56.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-06-13T01:49:56.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-06-13T01:49:56.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-06-13T01:49:56.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-06-13T01:49:56.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/8390 2024-06-13T01:49:56.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/8390/8390.ko 2024-06-13T01:49:56.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-06-13T01:49:56.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-06-13T01:49:56.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-06-13T01:49:56.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/adaptec 2024-06-13T01:49:56.664 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/agere 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/agere/et131x.ko 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/alteon 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/altera 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/amd 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/alx 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/atl1c 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-06-13T01:49:56.665 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/atl1e 2024-06-13T01:49:56.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-06-13T01:49:56.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/atlx 2024-06-13T01:49:56.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-06-13T01:49:56.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-06-13T01:49:56.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom 2024-06-13T01:49:56.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-06-13T01:49:56.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-06-13T01:49:56.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-06-13T01:49:56.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-06-13T01:49:56.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-06-13T01:49:56.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/genet 2024-06-13T01:49:56.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-06-13T01:49:56.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-06-13T01:49:56.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/brocade 2024-06-13T01:49:56.666 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/brocade/bna 2024-06-13T01:49:56.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-06-13T01:49:56.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio 2024-06-13T01:49:56.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb 2024-06-13T01:49:56.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-06-13T01:49:56.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-06-13T01:49:56.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-06-13T01:49:56.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-06-13T01:49:56.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-06-13T01:49:56.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-06-13T01:49:56.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-06-13T01:49:56.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-06-13T01:49:56.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-06-13T01:49:56.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/cisco 2024-06-13T01:49:56.667 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/cisco/enic 2024-06-13T01:49:56.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-06-13T01:49:56.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec 2024-06-13T01:49:56.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec/tulip 2024-06-13T01:49:56.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-06-13T01:49:56.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-06-13T01:49:56.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-06-13T01:49:56.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-06-13T01:49:56.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-06-13T01:49:56.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-06-13T01:49:56.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dlink 2024-06-13T01:49:56.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-06-13T01:49:56.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-06-13T01:49:56.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/dnet.ko 2024-06-13T01:49:56.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/emulex 2024-06-13T01:49:56.668 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/emulex/benet 2024-06-13T01:49:56.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-06-13T01:49:56.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/ethoc.ko 2024-06-13T01:49:56.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/fealnx.ko 2024-06-13T01:49:56.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel 2024-06-13T01:49:56.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/e100.ko 2024-06-13T01:49:56.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/e1000 2024-06-13T01:49:56.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-06-13T01:49:56.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/e1000e 2024-06-13T01:49:56.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-06-13T01:49:56.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/fm10k 2024-06-13T01:49:56.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-06-13T01:49:56.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/i40e 2024-06-13T01:49:56.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-06-13T01:49:56.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/iavf 2024-06-13T01:49:56.669 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-06-13T01:49:56.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/igb 2024-06-13T01:49:56.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-06-13T01:49:56.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/igbvf 2024-06-13T01:49:56.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-06-13T01:49:56.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/ixgbe 2024-06-13T01:49:56.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-06-13T01:49:56.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/ixgbevf 2024-06-13T01:49:56.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-06-13T01:49:56.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/jme.ko 2024-06-13T01:49:56.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/marvell 2024-06-13T01:49:56.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-06-13T01:49:56.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/marvell/skge.ko 2024-06-13T01:49:56.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-06-13T01:49:56.670 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/mellanox 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/mellanox/mlx4 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/mellanox/mlx5 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/micrel 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/myricom 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/myricom/myri10ge 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/natsemi 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/neterion 2024-06-13T01:49:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-06-13T01:49:56.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/nvidia 2024-06-13T01:49:56.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-06-13T01:49:56.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/packetengines 2024-06-13T01:49:56.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-06-13T01:49:56.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-06-13T01:49:56.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/qlogic 2024-06-13T01:49:56.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/qlogic/netxen 2024-06-13T01:49:56.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-06-13T01:49:56.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-06-13T01:49:56.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-06-13T01:49:56.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-06-13T01:49:56.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/rdc 2024-06-13T01:49:56.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-06-13T01:49:56.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/realtek 2024-06-13T01:49:56.672 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-06-13T01:49:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-06-13T01:49:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/realtek/atp.ko 2024-06-13T01:49:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-06-13T01:49:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/rocker 2024-06-13T01:49:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-06-13T01:49:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sfc 2024-06-13T01:49:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-06-13T01:49:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/silan 2024-06-13T01:49:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-06-13T01:49:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sis 2024-06-13T01:49:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sis/sis190.ko 2024-06-13T01:49:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sis/sis900.ko 2024-06-13T01:49:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/smsc 2024-06-13T01:49:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-06-13T01:49:56.673 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-06-13T01:49:56.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-06-13T01:49:56.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-06-13T01:49:56.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/stmicro 2024-06-13T01:49:56.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/stmicro/stmmac 2024-06-13T01:49:56.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-06-13T01:49:56.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-06-13T01:49:56.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sun 2024-06-13T01:49:56.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sun/cassini.ko 2024-06-13T01:49:56.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sun/niu.ko 2024-06-13T01:49:56.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sun/sungem.ko 2024-06-13T01:49:56.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-06-13T01:49:56.674 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/tehuti 2024-06-13T01:49:56.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-06-13T01:49:56.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/ti 2024-06-13T01:49:56.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/ti/tlan.ko 2024-06-13T01:49:56.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/via 2024-06-13T01:49:56.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-06-13T01:49:56.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-06-13T01:49:56.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/wiznet 2024-06-13T01:49:56.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-06-13T01:49:56.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-06-13T01:49:56.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/xircom 2024-06-13T01:49:56.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-06-13T01:49:56.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/geneve.ko 2024-06-13T01:49:56.675 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/hyperv 2024-06-13T01:49:56.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-06-13T01:49:56.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ieee802154 2024-06-13T01:49:56.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ieee802154/fakelb.ko 2024-06-13T01:49:56.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ifb.ko 2024-06-13T01:49:56.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ipvlan 2024-06-13T01:49:56.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ipvlan/ipvlan.ko 2024-06-13T01:49:56.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/macvlan.ko 2024-06-13T01:49:56.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/macvtap.ko 2024-06-13T01:49:56.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/mdio 2024-06-13T01:49:56.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/mdio.ko 2024-06-13T01:49:56.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-06-13T01:49:56.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-06-13T01:49:56.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/mdio/mdio-regmap.ko 2024-06-13T01:49:56.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/mii.ko 2024-06-13T01:49:56.676 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/net_failover.ko 2024-06-13T01:49:56.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/netconsole.ko 2024-06-13T01:49:56.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/nlmon.ko 2024-06-13T01:49:56.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/pcs 2024-06-13T01:49:56.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/pcs/pcs-lynx.ko 2024-06-13T01:49:56.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-06-13T01:49:56.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy 2024-06-13T01:49:56.677 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/amd.ko 2024-06-13T01:49:56.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-06-13T01:49:56.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-06-13T01:49:56.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/bcm7xxx.ko 2024-06-13T01:49:56.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/bcm87xx.ko 2024-06-13T01:49:56.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/broadcom.ko 2024-06-13T01:49:56.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/cicada.ko 2024-06-13T01:49:56.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/davicom.ko 2024-06-13T01:49:56.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/dp83640.ko 2024-06-13T01:49:56.678 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/et1011c.ko 2024-06-13T01:49:56.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/icplus.ko 2024-06-13T01:49:56.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/lxt.ko 2024-06-13T01:49:56.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/marvell.ko 2024-06-13T01:49:56.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/micrel.ko 2024-06-13T01:49:56.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/national.ko 2024-06-13T01:49:56.679 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/phylink.ko 2024-06-13T01:49:56.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/qsemi.ko 2024-06-13T01:49:56.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/realtek.ko 2024-06-13T01:49:56.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/smsc.ko 2024-06-13T01:49:56.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/ste10Xp.ko 2024-06-13T01:49:56.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/phy/vitesse.ko 2024-06-13T01:49:56.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp 2024-06-13T01:49:56.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/bsd_comp.ko 2024-06-13T01:49:56.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/ppp_async.ko 2024-06-13T01:49:56.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/ppp_deflate.ko 2024-06-13T01:49:56.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/ppp_generic.ko 2024-06-13T01:49:56.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/ppp_mppe.ko 2024-06-13T01:49:56.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/ppp_synctty.ko 2024-06-13T01:49:56.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/pppoe.ko 2024-06-13T01:49:56.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/pppox.ko 2024-06-13T01:49:56.680 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/ppp/pptp.ko 2024-06-13T01:49:56.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/slip 2024-06-13T01:49:56.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/slip/slhc.ko 2024-06-13T01:49:56.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/slip/slip.ko 2024-06-13T01:49:56.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/sungem_phy.ko 2024-06-13T01:49:56.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/tap.ko 2024-06-13T01:49:56.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/team 2024-06-13T01:49:56.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/team/team.ko 2024-06-13T01:49:56.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/team/team_mode_activebackup.ko 2024-06-13T01:49:56.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/team/team_mode_broadcast.ko 2024-06-13T01:49:56.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-06-13T01:49:56.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/team/team_mode_random.ko 2024-06-13T01:49:56.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-06-13T01:49:56.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/tun.ko 2024-06-13T01:49:56.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/veth.ko 2024-06-13T01:49:56.681 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/virtio_net.ko 2024-06-13T01:49:56.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/vmxnet3 2024-06-13T01:49:56.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-06-13T01:49:56.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/vxlan 2024-06-13T01:49:56.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/vxlan/vxlan.ko 2024-06-13T01:49:56.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/xen-netback 2024-06-13T01:49:56.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/xen-netback/xen-netback.ko 2024-06-13T01:49:56.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/net/xen-netfront.ko 2024-06-13T01:49:56.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ntb 2024-06-13T01:49:56.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ntb/ntb.ko 2024-06-13T01:49:56.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/nvme 2024-06-13T01:49:56.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/nvme/host 2024-06-13T01:49:56.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/nvme/host/nvme-core.ko 2024-06-13T01:49:56.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/nvme/host/nvme.ko 2024-06-13T01:49:56.682 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/parport 2024-06-13T01:49:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/parport/parport.ko 2024-06-13T01:49:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/parport/parport_cs.ko 2024-06-13T01:49:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/parport/parport_pc.ko 2024-06-13T01:49:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/parport/parport_serial.ko 2024-06-13T01:49:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pci 2024-06-13T01:49:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pci/hotplug 2024-06-13T01:49:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-06-13T01:49:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pci/pcie 2024-06-13T01:49:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pci/pcie/aer_inject.ko 2024-06-13T01:49:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pci/xen-pcifront.ko 2024-06-13T01:49:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pcmcia 2024-06-13T01:49:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pcmcia/i82092.ko 2024-06-13T01:49:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pcmcia/pd6729.ko 2024-06-13T01:49:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pcmcia/yenta_socket.ko 2024-06-13T01:49:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pinctrl 2024-06-13T01:49:56.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pinctrl/intel 2024-06-13T01:49:56.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-06-13T01:49:56.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform 2024-06-13T01:49:56.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86 2024-06-13T01:49:56.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/acer-wmi.ko 2024-06-13T01:49:56.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/acerhdf.ko 2024-06-13T01:49:56.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/apple-gmux.ko 2024-06-13T01:49:56.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/asus-laptop.ko 2024-06-13T01:49:56.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-06-13T01:49:56.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/asus-wmi.ko 2024-06-13T01:49:56.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/classmate-laptop.ko 2024-06-13T01:49:56.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-06-13T01:49:56.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-06-13T01:49:56.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-06-13T01:49:56.684 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-06-13T01:49:56.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/hdaps.ko 2024-06-13T01:49:56.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/intel 2024-06-13T01:49:56.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-06-13T01:49:56.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/intel_ips.ko 2024-06-13T01:49:56.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/msi-wmi.ko 2024-06-13T01:49:56.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/mxm-wmi.ko 2024-06-13T01:49:56.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-06-13T01:49:56.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/samsung-laptop.ko 2024-06-13T01:49:56.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/samsung-q10.ko 2024-06-13T01:49:56.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/topstar-laptop.ko 2024-06-13T01:49:56.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-06-13T01:49:56.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/toshiba_haps.ko 2024-06-13T01:49:56.685 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/wmi-bmof.ko 2024-06-13T01:49:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/platform/x86/wmi.ko 2024-06-13T01:49:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/powercap 2024-06-13T01:49:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/powercap/intel_rapl_common.ko 2024-06-13T01:49:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/powercap/intel_rapl_msr.ko 2024-06-13T01:49:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pps 2024-06-13T01:49:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pps/clients 2024-06-13T01:49:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pps/clients/pps-gpio.ko 2024-06-13T01:49:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pps/clients/pps-ldisc.ko 2024-06-13T01:49:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pps/clients/pps_parport.ko 2024-06-13T01:49:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/pps/pps_core.ko 2024-06-13T01:49:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ptp 2024-06-13T01:49:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ptp/ptp.ko 2024-06-13T01:49:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ptp/ptp_kvm.ko 2024-06-13T01:49:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ras 2024-06-13T01:49:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ras/amd 2024-06-13T01:49:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ras/amd/atl 2024-06-13T01:49:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-06-13T01:49:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ras/amd/fmpm.ko 2024-06-13T01:49:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc 2024-06-13T01:49:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-bq32k.ko 2024-06-13T01:49:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds1286.ko 2024-06-13T01:49:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds1307.ko 2024-06-13T01:49:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds1374.ko 2024-06-13T01:49:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds1511.ko 2024-06-13T01:49:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds1553.ko 2024-06-13T01:49:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds1672.ko 2024-06-13T01:49:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds1742.ko 2024-06-13T01:49:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds2404.ko 2024-06-13T01:49:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-ds3232.ko 2024-06-13T01:49:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-em3027.ko 2024-06-13T01:49:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-fm3130.ko 2024-06-13T01:49:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-isl12022.ko 2024-06-13T01:49:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-isl1208.ko 2024-06-13T01:49:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-m41t80.ko 2024-06-13T01:49:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-m48t35.ko 2024-06-13T01:49:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-m48t59.ko 2024-06-13T01:49:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-max6900.ko 2024-06-13T01:49:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-msm6242.ko 2024-06-13T01:49:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-pcf2127.ko 2024-06-13T01:49:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-pcf85063.ko 2024-06-13T01:49:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-pcf8523.ko 2024-06-13T01:49:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-pcf8563.ko 2024-06-13T01:49:56.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-pcf8583.ko 2024-06-13T01:49:56.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-rp5c01.ko 2024-06-13T01:49:56.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-rs5c372.ko 2024-06-13T01:49:56.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-06-13T01:49:56.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-rx8025.ko 2024-06-13T01:49:56.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-rx8581.ko 2024-06-13T01:49:56.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-06-13T01:49:56.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/rtc/rtc-x1205.ko 2024-06-13T01:49:56.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi 2024-06-13T01:49:56.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/3w-9xxx.ko 2024-06-13T01:49:56.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/3w-sas.ko 2024-06-13T01:49:56.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/3w-xxxx.ko 2024-06-13T01:49:56.689 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/BusLogic.ko 2024-06-13T01:49:56.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/a100u2w.ko 2024-06-13T01:49:56.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/aacraid 2024-06-13T01:49:56.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/aacraid/aacraid.ko 2024-06-13T01:49:56.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/advansys.ko 2024-06-13T01:49:56.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/aic7xxx 2024-06-13T01:49:56.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-06-13T01:49:56.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-06-13T01:49:56.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/am53c974.ko 2024-06-13T01:49:56.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/arcmsr 2024-06-13T01:49:56.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-06-13T01:49:56.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/atp870u.ko 2024-06-13T01:49:56.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/be2iscsi 2024-06-13T01:49:56.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-06-13T01:49:56.690 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/bfa 2024-06-13T01:49:56.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/bfa/bfa.ko 2024-06-13T01:49:56.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/bnx2fc 2024-06-13T01:49:56.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-06-13T01:49:56.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/bnx2i 2024-06-13T01:49:56.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-06-13T01:49:56.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/ch.ko 2024-06-13T01:49:56.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/csiostor 2024-06-13T01:49:56.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/csiostor/csiostor.ko 2024-06-13T01:49:56.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/cxgbi 2024-06-13T01:49:56.691 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/cxgbi/cxgb3i 2024-06-13T01:49:56.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-06-13T01:49:56.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/cxgbi/cxgb4i 2024-06-13T01:49:56.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-06-13T01:49:56.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-06-13T01:49:56.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/dc395x.ko 2024-06-13T01:49:56.692 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/device_handler 2024-06-13T01:49:56.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-06-13T01:49:56.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-06-13T01:49:56.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-06-13T01:49:56.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-06-13T01:49:56.693 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/dmx3191d.ko 2024-06-13T01:49:56.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/esas2r 2024-06-13T01:49:56.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/esas2r/esas2r.ko 2024-06-13T01:49:56.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/esp_scsi.ko 2024-06-13T01:49:56.694 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/fcoe 2024-06-13T01:49:56.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/fcoe/fcoe.ko 2024-06-13T01:49:56.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-06-13T01:49:56.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/fnic 2024-06-13T01:49:56.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/fnic/fnic.ko 2024-06-13T01:49:56.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/hpsa.ko 2024-06-13T01:49:56.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/hptiop.ko 2024-06-13T01:49:56.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/hv_storvsc.ko 2024-06-13T01:49:56.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/initio.ko 2024-06-13T01:49:56.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/ipr.ko 2024-06-13T01:49:56.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/ips.ko 2024-06-13T01:49:56.695 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/isci 2024-06-13T01:49:56.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/isci/isci.ko 2024-06-13T01:49:56.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-06-13T01:49:56.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/iscsi_tcp.ko 2024-06-13T01:49:56.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/libfc 2024-06-13T01:49:56.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/libfc/libfc.ko 2024-06-13T01:49:56.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/libiscsi.ko 2024-06-13T01:49:56.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/libiscsi_tcp.ko 2024-06-13T01:49:56.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/libsas 2024-06-13T01:49:56.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/libsas/libsas.ko 2024-06-13T01:49:56.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/lpfc 2024-06-13T01:49:56.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/lpfc/lpfc.ko 2024-06-13T01:49:56.696 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/megaraid 2024-06-13T01:49:56.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/megaraid.ko 2024-06-13T01:49:56.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-06-13T01:49:56.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-06-13T01:49:56.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-06-13T01:49:56.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/mpt3sas 2024-06-13T01:49:56.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-06-13T01:49:56.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/mvsas 2024-06-13T01:49:56.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/mvsas/mvsas.ko 2024-06-13T01:49:56.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/mvumi.ko 2024-06-13T01:49:56.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/pm8001 2024-06-13T01:49:56.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-06-13T01:49:56.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/pmcraid.ko 2024-06-13T01:49:56.697 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/qla1280.ko 2024-06-13T01:49:56.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/qla2xxx 2024-06-13T01:49:56.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-06-13T01:49:56.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-06-13T01:49:56.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/qla4xxx 2024-06-13T01:49:56.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-06-13T01:49:56.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/raid_class.ko 2024-06-13T01:49:56.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/scsi_debug.ko 2024-06-13T01:49:56.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/scsi_transport_fc.ko 2024-06-13T01:49:56.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-06-13T01:49:56.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/scsi_transport_sas.ko 2024-06-13T01:49:56.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/scsi_transport_spi.ko 2024-06-13T01:49:56.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/scsi_transport_srp.ko 2024-06-13T01:49:56.698 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/ses.ko 2024-06-13T01:49:56.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/st.ko 2024-06-13T01:49:56.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/stex.ko 2024-06-13T01:49:56.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/sym53c8xx_2 2024-06-13T01:49:56.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-06-13T01:49:56.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/virtio_scsi.ko 2024-06-13T01:49:56.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/vmw_pvscsi.ko 2024-06-13T01:49:56.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/scsi/wd719x.ko 2024-06-13T01:49:56.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ssb 2024-06-13T01:49:56.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ssb/ssb.ko 2024-06-13T01:49:56.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target 2024-06-13T01:49:56.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/iscsi 2024-06-13T01:49:56.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-06-13T01:49:56.699 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/loopback 2024-06-13T01:49:56.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/loopback/tcm_loop.ko 2024-06-13T01:49:56.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/target_core_file.ko 2024-06-13T01:49:56.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/target_core_iblock.ko 2024-06-13T01:49:56.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/target_core_mod.ko 2024-06-13T01:49:56.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/target_core_pscsi.ko 2024-06-13T01:49:56.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/target_core_user.ko 2024-06-13T01:49:56.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/tcm_fc 2024-06-13T01:49:56.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-06-13T01:49:56.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal 2024-06-13T01:49:56.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel 2024-06-13T01:49:56.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal 2024-06-13T01:49:56.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-06-13T01:49:56.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-06-13T01:49:56.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-06-13T01:49:56.700 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-06-13T01:49:56.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-06-13T01:49:56.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-06-13T01:49:56.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-06-13T01:49:56.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-06-13T01:49:56.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-06-13T01:49:56.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-06-13T01:49:56.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-06-13T01:49:56.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-06-13T01:49:56.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-06-13T01:49:56.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-06-13T01:49:56.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-06-13T01:49:56.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-06-13T01:49:56.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-06-13T01:49:56.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-06-13T01:49:56.701 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty 2024-06-13T01:49:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/ipwireless 2024-06-13T01:49:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-06-13T01:49:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/n_gsm.ko 2024-06-13T01:49:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/n_hdlc.ko 2024-06-13T01:49:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/nozomi.ko 2024-06-13T01:49:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/serial 2024-06-13T01:49:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/serial/8250 2024-06-13T01:49:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-06-13T01:49:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/serial/arc_uart.ko 2024-06-13T01:49:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/serial/jsm 2024-06-13T01:49:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/tty/serial/jsm/jsm.ko 2024-06-13T01:49:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ufs 2024-06-13T01:49:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ufs/core 2024-06-13T01:49:56.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ufs/core/ufshcd-core.ko 2024-06-13T01:49:56.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ufs/host 2024-06-13T01:49:56.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-06-13T01:49:56.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/uio 2024-06-13T01:49:56.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/uio/uio.ko 2024-06-13T01:49:56.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/uio/uio_aec.ko 2024-06-13T01:49:56.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/uio/uio_cif.ko 2024-06-13T01:49:56.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/uio/uio_pci_generic.ko 2024-06-13T01:49:56.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/uio/uio_sercos3.ko 2024-06-13T01:49:56.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb 2024-06-13T01:49:56.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/class 2024-06-13T01:49:56.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/class/cdc-acm.ko 2024-06-13T01:49:56.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/class/cdc-wdm.ko 2024-06-13T01:49:56.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/class/usblp.ko 2024-06-13T01:49:56.703 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/class/usbtmc.ko 2024-06-13T01:49:56.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/host 2024-06-13T01:49:56.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/host/sl811-hcd.ko 2024-06-13T01:49:56.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/image 2024-06-13T01:49:56.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/image/mdc800.ko 2024-06-13T01:49:56.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/image/microtek.ko 2024-06-13T01:49:56.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc 2024-06-13T01:49:56.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/adutux.ko 2024-06-13T01:49:56.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/appledisplay.ko 2024-06-13T01:49:56.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/emi26.ko 2024-06-13T01:49:56.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/emi62.ko 2024-06-13T01:49:56.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/ezusb.ko 2024-06-13T01:49:56.704 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/idmouse.ko 2024-06-13T01:49:56.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/iowarrior.ko 2024-06-13T01:49:56.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/isight_firmware.ko 2024-06-13T01:49:56.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/ldusb.ko 2024-06-13T01:49:56.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/legousbtower.ko 2024-06-13T01:49:56.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/sisusbvga 2024-06-13T01:49:56.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-06-13T01:49:56.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/trancevibrator.ko 2024-06-13T01:49:56.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/usb3503.ko 2024-06-13T01:49:56.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/usblcd.ko 2024-06-13T01:49:56.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/usbsevseg.ko 2024-06-13T01:49:56.705 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/uss720.ko 2024-06-13T01:49:56.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/misc/yurex.ko 2024-06-13T01:49:56.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/phy 2024-06-13T01:49:56.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/phy/phy-generic.ko 2024-06-13T01:49:56.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial 2024-06-13T01:49:56.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/aircable.ko 2024-06-13T01:49:56.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ark3116.ko 2024-06-13T01:49:56.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/belkin_sa.ko 2024-06-13T01:49:56.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ch341.ko 2024-06-13T01:49:56.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/cp210x.ko 2024-06-13T01:49:56.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/cyberjack.ko 2024-06-13T01:49:56.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/cypress_m8.ko 2024-06-13T01:49:56.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/digi_acceleport.ko 2024-06-13T01:49:56.706 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/empeg.ko 2024-06-13T01:49:56.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ftdi_sio.ko 2024-06-13T01:49:56.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/garmin_gps.ko 2024-06-13T01:49:56.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/io_edgeport.ko 2024-06-13T01:49:56.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/io_ti.ko 2024-06-13T01:49:56.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ipaq.ko 2024-06-13T01:49:56.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ipw.ko 2024-06-13T01:49:56.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ir-usb.ko 2024-06-13T01:49:56.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-06-13T01:49:56.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/keyspan.ko 2024-06-13T01:49:56.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/keyspan_pda.ko 2024-06-13T01:49:56.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/kl5kusb105.ko 2024-06-13T01:49:56.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/kobil_sct.ko 2024-06-13T01:49:56.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/mct_u232.ko 2024-06-13T01:49:56.707 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/mos7720.ko 2024-06-13T01:49:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/mos7840.ko 2024-06-13T01:49:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/navman.ko 2024-06-13T01:49:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/omninet.ko 2024-06-13T01:49:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/opticon.ko 2024-06-13T01:49:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/option.ko 2024-06-13T01:49:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/oti6858.ko 2024-06-13T01:49:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/pl2303.ko 2024-06-13T01:49:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/qcaux.ko 2024-06-13T01:49:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/qcserial.ko 2024-06-13T01:49:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/quatech2.ko 2024-06-13T01:49:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/safe_serial.ko 2024-06-13T01:49:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/sierra.ko 2024-06-13T01:49:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/spcp8x5.ko 2024-06-13T01:49:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ssu100.ko 2024-06-13T01:49:56.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/symbolserial.ko 2024-06-13T01:49:56.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-06-13T01:49:56.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-06-13T01:49:56.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/usb_debug.ko 2024-06-13T01:49:56.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/usb_wwan.ko 2024-06-13T01:49:56.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/visor.ko 2024-06-13T01:49:56.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/whiteheat.ko 2024-06-13T01:49:56.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/serial/xsens_mt.ko 2024-06-13T01:49:56.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage 2024-06-13T01:49:56.709 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/uas.ko 2024-06-13T01:49:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-alauda.ko 2024-06-13T01:49:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-cypress.ko 2024-06-13T01:49:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-datafab.ko 2024-06-13T01:49:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-06-13T01:49:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-freecom.ko 2024-06-13T01:49:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-isd200.ko 2024-06-13T01:49:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-06-13T01:49:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-karma.ko 2024-06-13T01:49:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-onetouch.ko 2024-06-13T01:49:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-realtek.ko 2024-06-13T01:49:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-sddr09.ko 2024-06-13T01:49:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-sddr55.ko 2024-06-13T01:49:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/ums-usbat.ko 2024-06-13T01:49:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/storage/usb-storage.ko 2024-06-13T01:49:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/usbip 2024-06-13T01:49:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/usbip/usbip-core.ko 2024-06-13T01:49:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/usbip/usbip-host.ko 2024-06-13T01:49:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-06-13T01:49:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vfio 2024-06-13T01:49:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vfio/pci 2024-06-13T01:49:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-06-13T01:49:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vfio/pci/vfio-pci.ko 2024-06-13T01:49:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vfio/vfio.ko 2024-06-13T01:49:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-06-13T01:49:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vhost 2024-06-13T01:49:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vhost/vhost.ko 2024-06-13T01:49:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vhost/vhost_iotlb.ko 2024-06-13T01:49:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vhost/vhost_net.ko 2024-06-13T01:49:56.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/vhost/vhost_scsi.ko 2024-06-13T01:49:56.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/video 2024-06-13T01:49:56.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/video/backlight 2024-06-13T01:49:56.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/video/backlight/apple_bl.ko 2024-06-13T01:49:56.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/video/backlight/lcd.ko 2024-06-13T01:49:56.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/video/backlight/platform_lcd.ko 2024-06-13T01:49:56.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio 2024-06-13T01:49:56.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio/virtio.ko 2024-06-13T01:49:56.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio/virtio_balloon.ko 2024-06-13T01:49:56.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio/virtio_mmio.ko 2024-06-13T01:49:56.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio/virtio_pci.ko 2024-06-13T01:49:56.712 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-06-13T01:49:56.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-06-13T01:49:56.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/virtio/virtio_ring.ko 2024-06-13T01:49:56.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1 2024-06-13T01:49:56.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/masters 2024-06-13T01:49:56.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/masters/ds2482.ko 2024-06-13T01:49:56.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/masters/ds2490.ko 2024-06-13T01:49:56.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves 2024-06-13T01:49:56.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-06-13T01:49:56.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-06-13T01:49:56.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-06-13T01:49:56.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-06-13T01:49:56.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-06-13T01:49:56.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-06-13T01:49:56.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-06-13T01:49:56.713 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-06-13T01:49:56.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-06-13T01:49:56.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_smem.ko 2024-06-13T01:49:56.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/slaves/w1_therm.ko 2024-06-13T01:49:56.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/w1/wire.ko 2024-06-13T01:49:56.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog 2024-06-13T01:49:56.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/alim1535_wdt.ko 2024-06-13T01:49:56.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/alim7101_wdt.ko 2024-06-13T01:49:56.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/f71808e_wdt.ko 2024-06-13T01:49:56.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/hpwdt.ko 2024-06-13T01:49:56.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/i6300esb.ko 2024-06-13T01:49:56.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-06-13T01:49:56.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/iTCO_wdt.ko 2024-06-13T01:49:56.714 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/ib700wdt.ko 2024-06-13T01:49:56.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/ibmasr.ko 2024-06-13T01:49:56.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-06-13T01:49:56.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/it8712f_wdt.ko 2024-06-13T01:49:56.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/it87_wdt.ko 2024-06-13T01:49:56.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/machzwd.ko 2024-06-13T01:49:56.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/nv_tco.ko 2024-06-13T01:49:56.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/pcwd_pci.ko 2024-06-13T01:49:56.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/pcwd_usb.ko 2024-06-13T01:49:56.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-06-13T01:49:56.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/sch311x_wdt.ko 2024-06-13T01:49:56.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/softdog.ko 2024-06-13T01:49:56.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/sp5100_tco.ko 2024-06-13T01:49:56.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/via_wdt.ko 2024-06-13T01:49:56.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-06-13T01:49:56.715 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/w83877f_wdt.ko 2024-06-13T01:49:56.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/w83977f_wdt.ko 2024-06-13T01:49:56.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/wdt_pci.ko 2024-06-13T01:49:56.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/watchdog/xen_wdt.ko 2024-06-13T01:49:56.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen 2024-06-13T01:49:56.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xen-acpi-processor.ko 2024-06-13T01:49:56.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xen-evtchn.ko 2024-06-13T01:49:56.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xen-gntalloc.ko 2024-06-13T01:49:56.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xen-gntdev.ko 2024-06-13T01:49:56.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xen-pciback 2024-06-13T01:49:56.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-06-13T01:49:56.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xen-privcmd.ko 2024-06-13T01:49:56.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xenfs 2024-06-13T01:49:56.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/drivers/xen/xenfs/xenfs.ko 2024-06-13T01:49:56.716 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs 2024-06-13T01:49:56.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/9p 2024-06-13T01:49:56.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/9p/9p.ko 2024-06-13T01:49:56.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/affs 2024-06-13T01:49:56.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/affs/affs.ko 2024-06-13T01:49:56.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/befs 2024-06-13T01:49:56.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/befs/befs.ko 2024-06-13T01:49:56.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/binfmt_misc.ko 2024-06-13T01:49:56.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/btrfs 2024-06-13T01:49:56.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/btrfs/btrfs.ko 2024-06-13T01:49:56.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/cachefiles 2024-06-13T01:49:56.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/cachefiles/cachefiles.ko 2024-06-13T01:49:56.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ceph 2024-06-13T01:49:56.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ceph/ceph.ko 2024-06-13T01:49:56.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/coda 2024-06-13T01:49:56.717 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/coda/coda.ko 2024-06-13T01:49:56.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/cramfs 2024-06-13T01:49:56.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/cramfs/cramfs.ko 2024-06-13T01:49:56.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/dlm 2024-06-13T01:49:56.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/dlm/dlm.ko 2024-06-13T01:49:56.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ecryptfs 2024-06-13T01:49:56.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ecryptfs/ecryptfs.ko 2024-06-13T01:49:56.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/f2fs 2024-06-13T01:49:56.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/f2fs/f2fs.ko 2024-06-13T01:49:56.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/fat 2024-06-13T01:49:56.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/fat/fat.ko 2024-06-13T01:49:56.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/fat/msdos.ko 2024-06-13T01:49:56.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/fat/vfat.ko 2024-06-13T01:49:56.718 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/fuse 2024-06-13T01:49:56.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/fuse/cuse.ko 2024-06-13T01:49:56.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/fuse/fuse.ko 2024-06-13T01:49:56.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/gfs2 2024-06-13T01:49:56.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/gfs2/gfs2.ko 2024-06-13T01:49:56.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/hfs 2024-06-13T01:49:56.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/hfs/hfs.ko 2024-06-13T01:49:56.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/hfsplus 2024-06-13T01:49:56.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/hfsplus/hfsplus.ko 2024-06-13T01:49:56.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/isofs 2024-06-13T01:49:56.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/isofs/isofs.ko 2024-06-13T01:49:56.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/jfs 2024-06-13T01:49:56.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/jfs/jfs.ko 2024-06-13T01:49:56.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/lockd 2024-06-13T01:49:56.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/lockd/lockd.ko 2024-06-13T01:49:56.719 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/minix 2024-06-13T01:49:56.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/minix/minix.ko 2024-06-13T01:49:56.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/netfs 2024-06-13T01:49:56.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/netfs/netfs.ko 2024-06-13T01:49:56.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs 2024-06-13T01:49:56.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/blocklayout 2024-06-13T01:49:56.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-06-13T01:49:56.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/filelayout 2024-06-13T01:49:56.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-06-13T01:49:56.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/flexfilelayout 2024-06-13T01:49:56.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-06-13T01:49:56.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/nfs.ko 2024-06-13T01:49:56.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/nfsv3.ko 2024-06-13T01:49:56.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs/nfsv4.ko 2024-06-13T01:49:56.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs_common 2024-06-13T01:49:56.720 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs_common/grace.ko 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfs_common/nfs_acl.ko 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfsd 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nfsd/nfsd.ko 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nilfs2 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nilfs2/nilfs2.ko 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-celtic.ko 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-centeuro.ko 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-croatian.ko 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-cyrillic.ko 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-gaelic.ko 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-greek.ko 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-iceland.ko 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-inuit.ko 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-roman.ko 2024-06-13T01:49:56.721 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-romanian.ko 2024-06-13T01:49:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/mac-turkish.ko 2024-06-13T01:49:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp1250.ko 2024-06-13T01:49:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp1251.ko 2024-06-13T01:49:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp1255.ko 2024-06-13T01:49:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp737.ko 2024-06-13T01:49:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp775.ko 2024-06-13T01:49:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp850.ko 2024-06-13T01:49:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp852.ko 2024-06-13T01:49:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp855.ko 2024-06-13T01:49:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp857.ko 2024-06-13T01:49:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp860.ko 2024-06-13T01:49:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp861.ko 2024-06-13T01:49:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp862.ko 2024-06-13T01:49:56.722 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp863.ko 2024-06-13T01:49:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp864.ko 2024-06-13T01:49:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp865.ko 2024-06-13T01:49:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp866.ko 2024-06-13T01:49:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp869.ko 2024-06-13T01:49:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp874.ko 2024-06-13T01:49:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp932.ko 2024-06-13T01:49:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp936.ko 2024-06-13T01:49:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp949.ko 2024-06-13T01:49:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_cp950.ko 2024-06-13T01:49:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_euc-jp.ko 2024-06-13T01:49:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-1.ko 2024-06-13T01:49:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-13.ko 2024-06-13T01:49:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-14.ko 2024-06-13T01:49:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-15.ko 2024-06-13T01:49:56.723 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-2.ko 2024-06-13T01:49:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-3.ko 2024-06-13T01:49:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-4.ko 2024-06-13T01:49:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-5.ko 2024-06-13T01:49:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-6.ko 2024-06-13T01:49:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-7.ko 2024-06-13T01:49:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_iso8859-9.ko 2024-06-13T01:49:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_koi8-r.ko 2024-06-13T01:49:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_koi8-ru.ko 2024-06-13T01:49:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_koi8-u.ko 2024-06-13T01:49:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_ucs2_utils.ko 2024-06-13T01:49:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/nls/nls_utf8.ko 2024-06-13T01:49:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2 2024-06-13T01:49:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/cluster 2024-06-13T01:49:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-06-13T01:49:56.724 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/dlm 2024-06-13T01:49:56.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-06-13T01:49:56.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/dlmfs 2024-06-13T01:49:56.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-06-13T01:49:56.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/ocfs2.ko 2024-06-13T01:49:56.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-06-13T01:49:56.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-06-13T01:49:56.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-06-13T01:49:56.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/overlayfs 2024-06-13T01:49:56.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/overlayfs/overlay.ko 2024-06-13T01:49:56.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/pstore 2024-06-13T01:49:56.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/pstore/ramoops.ko 2024-06-13T01:49:56.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/reiserfs 2024-06-13T01:49:56.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/reiserfs/reiserfs.ko 2024-06-13T01:49:56.725 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/romfs 2024-06-13T01:49:56.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/romfs/romfs.ko 2024-06-13T01:49:56.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/smb 2024-06-13T01:49:56.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/smb/client 2024-06-13T01:49:56.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/smb/client/cifs.ko 2024-06-13T01:49:56.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/smb/common 2024-06-13T01:49:56.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/smb/common/cifs_arc4.ko 2024-06-13T01:49:56.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/smb/common/cifs_md4.ko 2024-06-13T01:49:56.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/squashfs 2024-06-13T01:49:56.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/squashfs/squashfs.ko 2024-06-13T01:49:56.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/sysv 2024-06-13T01:49:56.726 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/sysv/sysv.ko 2024-06-13T01:49:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/udf 2024-06-13T01:49:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/udf/udf.ko 2024-06-13T01:49:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ufs 2024-06-13T01:49:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/ufs/ufs.ko 2024-06-13T01:49:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/xfs 2024-06-13T01:49:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/fs/xfs/xfs.ko 2024-06-13T01:49:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/kernel 2024-06-13T01:49:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/kernel/rcu 2024-06-13T01:49:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/kernel/rcu/rcutorture.ko 2024-06-13T01:49:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/kernel/torture.ko 2024-06-13T01:49:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/kernel/trace 2024-06-13T01:49:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-06-13T01:49:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib 2024-06-13T01:49:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/asn1_encoder.ko 2024-06-13T01:49:56.727 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/crc-itu-t.ko 2024-06-13T01:49:56.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/crc8.ko 2024-06-13T01:49:56.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/crypto 2024-06-13T01:49:56.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/crypto/libarc4.ko 2024-06-13T01:49:56.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/crypto/libdes.ko 2024-06-13T01:49:56.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/libcrc32c.ko 2024-06-13T01:49:56.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/lru_cache.ko 2024-06-13T01:49:56.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/lz4 2024-06-13T01:49:56.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/lz4/lz4_compress.ko 2024-06-13T01:49:56.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/lz4/lz4hc_compress.ko 2024-06-13T01:49:56.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/math 2024-06-13T01:49:56.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/math/cordic.ko 2024-06-13T01:49:56.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/raid6 2024-06-13T01:49:56.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/raid6/raid6_pq.ko 2024-06-13T01:49:56.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/reed_solomon 2024-06-13T01:49:56.728 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/reed_solomon/reed_solomon.ko 2024-06-13T01:49:56.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/ts_bm.ko 2024-06-13T01:49:56.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/ts_fsm.ko 2024-06-13T01:49:56.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/ts_kmp.ko 2024-06-13T01:49:56.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/zstd 2024-06-13T01:49:56.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/lib/zstd/zstd_compress.ko 2024-06-13T01:49:56.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/mm 2024-06-13T01:49:56.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/mm/hwpoison-inject.ko 2024-06-13T01:49:56.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net 2024-06-13T01:49:56.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan 2024-06-13T01:49:56.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/6lowpan.ko 2024-06-13T01:49:56.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/nhc_dest.ko 2024-06-13T01:49:56.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/nhc_fragment.ko 2024-06-13T01:49:56.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/nhc_hop.ko 2024-06-13T01:49:56.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/nhc_ipv6.ko 2024-06-13T01:49:56.729 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/nhc_mobility.ko 2024-06-13T01:49:56.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/nhc_routing.ko 2024-06-13T01:49:56.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/6lowpan/nhc_udp.ko 2024-06-13T01:49:56.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/802 2024-06-13T01:49:56.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/802/garp.ko 2024-06-13T01:49:56.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/802/mrp.ko 2024-06-13T01:49:56.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/802/p8022.ko 2024-06-13T01:49:56.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/802/psnap.ko 2024-06-13T01:49:56.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/802/stp.ko 2024-06-13T01:49:56.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/8021q 2024-06-13T01:49:56.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/8021q/8021q.ko 2024-06-13T01:49:56.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/9p 2024-06-13T01:49:56.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/9p/9pnet.ko 2024-06-13T01:49:56.730 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/9p/9pnet_fd.ko 2024-06-13T01:49:56.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/9p/9pnet_rdma.ko 2024-06-13T01:49:56.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/9p/9pnet_virtio.ko 2024-06-13T01:49:56.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/batman-adv 2024-06-13T01:49:56.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/batman-adv/batman-adv.ko 2024-06-13T01:49:56.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge 2024-06-13T01:49:56.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/br_netfilter.ko 2024-06-13T01:49:56.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/bridge.ko 2024-06-13T01:49:56.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter 2024-06-13T01:49:56.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-06-13T01:49:56.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_among.ko 2024-06-13T01:49:56.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_arp.ko 2024-06-13T01:49:56.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-06-13T01:49:56.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-06-13T01:49:56.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_ip.ko 2024-06-13T01:49:56.731 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-06-13T01:49:56.732 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_limit.ko 2024-06-13T01:49:56.732 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_log.ko 2024-06-13T01:49:56.732 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_mark.ko 2024-06-13T01:49:56.732 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-06-13T01:49:56.732 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-06-13T01:49:56.732 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-06-13T01:49:56.732 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-06-13T01:49:56.732 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_snat.ko 2024-06-13T01:49:56.732 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_stp.ko 2024-06-13T01:49:56.732 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-06-13T01:49:56.732 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-06-13T01:49:56.733 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-06-13T01:49:56.733 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-06-13T01:49:56.733 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/ebtables.ko 2024-06-13T01:49:56.733 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-06-13T01:49:56.733 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-06-13T01:49:56.733 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-06-13T01:49:56.733 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ceph 2024-06-13T01:49:56.733 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ceph/libceph.ko 2024-06-13T01:49:56.733 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/core 2024-06-13T01:49:56.733 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/core/failover.ko 2024-06-13T01:49:56.733 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/core/pktgen.ko 2024-06-13T01:49:56.733 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dccp 2024-06-13T01:49:56.733 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dccp/dccp.ko 2024-06-13T01:49:56.733 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dccp/dccp_diag.ko 2024-06-13T01:49:56.733 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dccp/dccp_ipv4.ko 2024-06-13T01:49:56.734 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dccp/dccp_ipv6.ko 2024-06-13T01:49:56.734 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dns_resolver 2024-06-13T01:49:56.734 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dns_resolver/dns_resolver.ko 2024-06-13T01:49:56.734 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dsa 2024-06-13T01:49:56.734 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dsa/dsa_core.ko 2024-06-13T01:49:56.734 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dsa/tag_brcm.ko 2024-06-13T01:49:56.734 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dsa/tag_dsa.ko 2024-06-13T01:49:56.735 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dsa/tag_none.ko 2024-06-13T01:49:56.735 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/dsa/tag_trailer.ko 2024-06-13T01:49:56.735 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ieee802154 2024-06-13T01:49:56.735 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ieee802154/6lowpan 2024-06-13T01:49:56.735 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-06-13T01:49:56.735 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ieee802154/ieee802154.ko 2024-06-13T01:49:56.735 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ieee802154/ieee802154_socket.ko 2024-06-13T01:49:56.735 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4 2024-06-13T01:49:56.735 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/ah4.ko 2024-06-13T01:49:56.735 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/esp4.ko 2024-06-13T01:49:56.735 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/fou.ko 2024-06-13T01:49:56.736 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/gre.ko 2024-06-13T01:49:56.736 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/inet_diag.ko 2024-06-13T01:49:56.736 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/ip_gre.ko 2024-06-13T01:49:56.736 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/ip_tunnel.ko 2024-06-13T01:49:56.736 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/ip_vti.ko 2024-06-13T01:49:56.736 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/ipcomp.ko 2024-06-13T01:49:56.736 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/ipip.ko 2024-06-13T01:49:56.737 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter 2024-06-13T01:49:56.737 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/arp_tables.ko 2024-06-13T01:49:56.737 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-06-13T01:49:56.737 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-06-13T01:49:56.737 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-06-13T01:49:56.737 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-06-13T01:49:56.737 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-06-13T01:49:56.737 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-06-13T01:49:56.737 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-06-13T01:49:56.737 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-06-13T01:49:56.737 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-06-13T01:49:56.737 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/iptable_security.ko 2024-06-13T01:49:56.737 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-06-13T01:49:56.737 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-06-13T01:49:56.737 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-06-13T01:49:56.738 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-06-13T01:49:56.738 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-06-13T01:49:56.738 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-06-13T01:49:56.738 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-06-13T01:49:56.738 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-06-13T01:49:56.738 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-06-13T01:49:56.738 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-06-13T01:49:56.738 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_bic.ko 2024-06-13T01:49:56.738 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_dctcp.ko 2024-06-13T01:49:56.738 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_diag.ko 2024-06-13T01:49:56.738 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_highspeed.ko 2024-06-13T01:49:56.738 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_htcp.ko 2024-06-13T01:49:56.738 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_hybla.ko 2024-06-13T01:49:56.739 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_illinois.ko 2024-06-13T01:49:56.739 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_lp.ko 2024-06-13T01:49:56.739 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_scalable.ko 2024-06-13T01:49:56.739 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_vegas.ko 2024-06-13T01:49:56.739 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_veno.ko 2024-06-13T01:49:56.739 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_westwood.ko 2024-06-13T01:49:56.739 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tcp_yeah.ko 2024-06-13T01:49:56.739 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/tunnel4.ko 2024-06-13T01:49:56.739 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/udp_diag.ko 2024-06-13T01:49:56.739 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/udp_tunnel.ko 2024-06-13T01:49:56.739 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv4/xfrm4_tunnel.ko 2024-06-13T01:49:56.739 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6 2024-06-13T01:49:56.739 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/ah6.ko 2024-06-13T01:49:56.739 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/esp6.ko 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/fou6.ko 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/ip6_tunnel.ko 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/ip6_vti.ko 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/ipcomp6.ko 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-06-13T01:49:56.740 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-06-13T01:49:56.741 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-06-13T01:49:56.741 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-06-13T01:49:56.741 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-06-13T01:49:56.741 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-06-13T01:49:56.741 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-06-13T01:49:56.741 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-06-13T01:49:56.741 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-06-13T01:49:56.741 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-06-13T01:49:56.741 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-06-13T01:49:56.741 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-06-13T01:49:56.741 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-06-13T01:49:56.741 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-06-13T01:49:56.741 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-06-13T01:49:56.741 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-06-13T01:49:56.741 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/sit.ko 2024-06-13T01:49:56.742 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/tunnel6.ko 2024-06-13T01:49:56.742 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/ipv6/xfrm6_tunnel.ko 2024-06-13T01:49:56.742 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/key 2024-06-13T01:49:56.742 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/key/af_key.ko 2024-06-13T01:49:56.742 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp 2024-06-13T01:49:56.742 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp/l2tp_core.ko 2024-06-13T01:49:56.742 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp/l2tp_debugfs.ko 2024-06-13T01:49:56.742 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp/l2tp_eth.ko 2024-06-13T01:49:56.742 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp/l2tp_ip.ko 2024-06-13T01:49:56.742 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp/l2tp_ip6.ko 2024-06-13T01:49:56.742 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp/l2tp_netlink.ko 2024-06-13T01:49:56.742 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/l2tp/l2tp_ppp.ko 2024-06-13T01:49:56.742 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/llc 2024-06-13T01:49:56.742 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/llc/llc.ko 2024-06-13T01:49:56.743 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/mac802154 2024-06-13T01:49:56.743 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/mac802154/mac802154.ko 2024-06-13T01:49:56.743 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/mpls 2024-06-13T01:49:56.743 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/mpls/mpls_gso.ko 2024-06-13T01:49:56.743 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter 2024-06-13T01:49:56.743 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset 2024-06-13T01:49:56.743 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set.ko 2024-06-13T01:49:56.743 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-06-13T01:49:56.743 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-06-13T01:49:56.743 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-06-13T01:49:56.743 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-06-13T01:49:56.743 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-06-13T01:49:56.743 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-06-13T01:49:56.743 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-06-13T01:49:56.743 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-06-13T01:49:56.744 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-06-13T01:49:56.744 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-06-13T01:49:56.744 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-06-13T01:49:56.744 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-06-13T01:49:56.744 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-06-13T01:49:56.744 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-06-13T01:49:56.744 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-06-13T01:49:56.744 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs 2024-06-13T01:49:56.744 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs.ko 2024-06-13T01:49:56.744 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-06-13T01:49:56.744 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-06-13T01:49:56.744 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-06-13T01:49:56.744 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-06-13T01:49:56.744 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-06-13T01:49:56.744 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conncount.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_h323.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_irc.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-06-13T01:49:56.745 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-06-13T01:49:56.746 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-06-13T01:49:56.746 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_sane.ko 2024-06-13T01:49:56.746 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_sip.ko 2024-06-13T01:49:56.746 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-06-13T01:49:56.746 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-06-13T01:49:56.746 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_dup_netdev.ko 2024-06-13T01:49:56.746 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_flow_table.ko 2024-06-13T01:49:56.746 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_flow_table_inet.ko 2024-06-13T01:49:56.746 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_log_syslog.ko 2024-06-13T01:49:56.746 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_nat.ko 2024-06-13T01:49:56.746 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_nat_amanda.ko 2024-06-13T01:49:56.746 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_nat_ftp.ko 2024-06-13T01:49:56.746 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_nat_irc.ko 2024-06-13T01:49:56.747 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_nat_sip.ko 2024-06-13T01:49:56.747 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_nat_tftp.ko 2024-06-13T01:49:56.747 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_synproxy_core.ko 2024-06-13T01:49:56.747 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nf_tables.ko 2024-06-13T01:49:56.747 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nfnetlink.ko 2024-06-13T01:49:56.747 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nfnetlink_acct.ko 2024-06-13T01:49:56.747 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nfnetlink_log.ko 2024-06-13T01:49:56.747 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nfnetlink_osf.ko 2024-06-13T01:49:56.747 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nfnetlink_queue.ko 2024-06-13T01:49:56.747 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_chain_nat.ko 2024-06-13T01:49:56.747 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_compat.ko 2024-06-13T01:49:56.747 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_ct.ko 2024-06-13T01:49:56.748 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_dup_netdev.ko 2024-06-13T01:49:56.748 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_fib.ko 2024-06-13T01:49:56.748 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_fwd_netdev.ko 2024-06-13T01:49:56.748 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_hash.ko 2024-06-13T01:49:56.748 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_limit.ko 2024-06-13T01:49:56.748 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_log.ko 2024-06-13T01:49:56.748 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_masq.ko 2024-06-13T01:49:56.748 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_nat.ko 2024-06-13T01:49:56.748 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_numgen.ko 2024-06-13T01:49:56.749 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_queue.ko 2024-06-13T01:49:56.749 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_quota.ko 2024-06-13T01:49:56.749 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_redir.ko 2024-06-13T01:49:56.749 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_reject.ko 2024-06-13T01:49:56.749 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_reject_inet.ko 2024-06-13T01:49:56.749 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_socket.ko 2024-06-13T01:49:56.749 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/nft_tunnel.ko 2024-06-13T01:49:56.749 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_AUDIT.ko 2024-06-13T01:49:56.749 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_CHECKSUM.ko 2024-06-13T01:49:56.749 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_CLASSIFY.ko 2024-06-13T01:49:56.749 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-06-13T01:49:56.749 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_CT.ko 2024-06-13T01:49:56.749 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_DSCP.ko 2024-06-13T01:49:56.750 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_HL.ko 2024-06-13T01:49:56.750 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_HMARK.ko 2024-06-13T01:49:56.750 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_IDLETIMER.ko 2024-06-13T01:49:56.750 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_LED.ko 2024-06-13T01:49:56.750 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_LOG.ko 2024-06-13T01:49:56.750 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_MASQUERADE.ko 2024-06-13T01:49:56.750 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_NETMAP.ko 2024-06-13T01:49:56.750 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_NFLOG.ko 2024-06-13T01:49:56.750 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_NFQUEUE.ko 2024-06-13T01:49:56.750 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_RATEEST.ko 2024-06-13T01:49:56.750 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_REDIRECT.ko 2024-06-13T01:49:56.750 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_SECMARK.ko 2024-06-13T01:49:56.750 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_TCPMSS.ko 2024-06-13T01:49:56.750 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-06-13T01:49:56.750 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_TEE.ko 2024-06-13T01:49:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_TPROXY.ko 2024-06-13T01:49:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_TRACE.ko 2024-06-13T01:49:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_addrtype.ko 2024-06-13T01:49:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_bpf.ko 2024-06-13T01:49:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_cgroup.ko 2024-06-13T01:49:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_cluster.ko 2024-06-13T01:49:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_comment.ko 2024-06-13T01:49:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_connbytes.ko 2024-06-13T01:49:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_connlabel.ko 2024-06-13T01:49:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_connlimit.ko 2024-06-13T01:49:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_connmark.ko 2024-06-13T01:49:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_conntrack.ko 2024-06-13T01:49:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_cpu.ko 2024-06-13T01:49:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_dccp.ko 2024-06-13T01:49:56.751 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_devgroup.ko 2024-06-13T01:49:56.752 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_dscp.ko 2024-06-13T01:49:56.752 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_ecn.ko 2024-06-13T01:49:56.752 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_esp.ko 2024-06-13T01:49:56.752 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_hashlimit.ko 2024-06-13T01:49:56.752 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_helper.ko 2024-06-13T01:49:56.752 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_hl.ko 2024-06-13T01:49:56.752 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_ipcomp.ko 2024-06-13T01:49:56.752 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_iprange.ko 2024-06-13T01:49:56.752 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_ipvs.ko 2024-06-13T01:49:56.752 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_l2tp.ko 2024-06-13T01:49:56.752 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_length.ko 2024-06-13T01:49:56.752 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_limit.ko 2024-06-13T01:49:56.752 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_mac.ko 2024-06-13T01:49:56.753 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_mark.ko 2024-06-13T01:49:56.753 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_multiport.ko 2024-06-13T01:49:56.753 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_nat.ko 2024-06-13T01:49:56.753 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_nfacct.ko 2024-06-13T01:49:56.753 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_osf.ko 2024-06-13T01:49:56.753 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_owner.ko 2024-06-13T01:49:56.753 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_physdev.ko 2024-06-13T01:49:56.753 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_pkttype.ko 2024-06-13T01:49:56.753 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_policy.ko 2024-06-13T01:49:56.753 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_quota.ko 2024-06-13T01:49:56.753 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_rateest.ko 2024-06-13T01:49:56.753 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_realm.ko 2024-06-13T01:49:56.753 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_recent.ko 2024-06-13T01:49:56.753 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_sctp.ko 2024-06-13T01:49:56.754 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_set.ko 2024-06-13T01:49:56.754 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_socket.ko 2024-06-13T01:49:56.754 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_state.ko 2024-06-13T01:49:56.754 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_statistic.ko 2024-06-13T01:49:56.754 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_string.ko 2024-06-13T01:49:56.754 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_tcpmss.ko 2024-06-13T01:49:56.754 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_time.ko 2024-06-13T01:49:56.754 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netfilter/xt_u32.ko 2024-06-13T01:49:56.754 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netlink 2024-06-13T01:49:56.754 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/netlink/netlink_diag.ko 2024-06-13T01:49:56.754 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/nsh 2024-06-13T01:49:56.754 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/nsh/nsh.ko 2024-06-13T01:49:56.754 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/openvswitch 2024-06-13T01:49:56.754 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/openvswitch/openvswitch.ko 2024-06-13T01:49:56.755 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/openvswitch/vport-geneve.ko 2024-06-13T01:49:56.755 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/openvswitch/vport-gre.ko 2024-06-13T01:49:56.755 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/openvswitch/vport-vxlan.ko 2024-06-13T01:49:56.755 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/packet 2024-06-13T01:49:56.755 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/packet/af_packet_diag.ko 2024-06-13T01:49:56.755 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/rds 2024-06-13T01:49:56.755 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/rds/rds.ko 2024-06-13T01:49:56.755 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/rds/rds_rdma.ko 2024-06-13T01:49:56.755 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/rds/rds_tcp.ko 2024-06-13T01:49:56.755 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched 2024-06-13T01:49:56.755 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_csum.ko 2024-06-13T01:49:56.755 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_gact.ko 2024-06-13T01:49:56.756 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_mirred.ko 2024-06-13T01:49:56.756 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_nat.ko 2024-06-13T01:49:56.756 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_pedit.ko 2024-06-13T01:49:56.756 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_police.ko 2024-06-13T01:49:56.756 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_simple.ko 2024-06-13T01:49:56.756 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_skbedit.ko 2024-06-13T01:49:56.757 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/act_vlan.ko 2024-06-13T01:49:56.757 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/cls_basic.ko 2024-06-13T01:49:56.757 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/cls_bpf.ko 2024-06-13T01:49:56.757 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/cls_flow.ko 2024-06-13T01:49:56.757 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/cls_fw.ko 2024-06-13T01:49:56.758 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/cls_route.ko 2024-06-13T01:49:56.758 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/cls_u32.ko 2024-06-13T01:49:56.758 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/em_cmp.ko 2024-06-13T01:49:56.758 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/em_ipset.ko 2024-06-13T01:49:56.758 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/em_meta.ko 2024-06-13T01:49:56.758 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/em_nbyte.ko 2024-06-13T01:49:56.758 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/em_text.ko 2024-06-13T01:49:56.759 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/em_u32.ko 2024-06-13T01:49:56.759 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_choke.ko 2024-06-13T01:49:56.759 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_codel.ko 2024-06-13T01:49:56.759 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_drr.ko 2024-06-13T01:49:56.759 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_fq.ko 2024-06-13T01:49:56.759 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_gred.ko 2024-06-13T01:49:56.760 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_hfsc.ko 2024-06-13T01:49:56.760 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_hhf.ko 2024-06-13T01:49:56.760 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_htb.ko 2024-06-13T01:49:56.760 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_ingress.ko 2024-06-13T01:49:56.760 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_mqprio.ko 2024-06-13T01:49:56.760 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_mqprio_lib.ko 2024-06-13T01:49:56.761 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_multiq.ko 2024-06-13T01:49:56.761 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_netem.ko 2024-06-13T01:49:56.761 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_pie.ko 2024-06-13T01:49:56.761 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_plug.ko 2024-06-13T01:49:56.761 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_prio.ko 2024-06-13T01:49:56.761 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_qfq.ko 2024-06-13T01:49:56.761 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_red.ko 2024-06-13T01:49:56.762 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_sfb.ko 2024-06-13T01:49:56.762 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_sfq.ko 2024-06-13T01:49:56.762 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_tbf.ko 2024-06-13T01:49:56.762 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sched/sch_teql.ko 2024-06-13T01:49:56.762 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sctp 2024-06-13T01:49:56.762 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sctp/sctp.ko 2024-06-13T01:49:56.762 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sctp/sctp_diag.ko 2024-06-13T01:49:56.762 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sunrpc 2024-06-13T01:49:56.762 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sunrpc/auth_gss 2024-06-13T01:49:56.762 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-06-13T01:49:56.762 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-06-13T01:49:56.762 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sunrpc/sunrpc.ko 2024-06-13T01:49:56.762 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sunrpc/xprtrdma 2024-06-13T01:49:56.762 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-06-13T01:49:56.763 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/tipc 2024-06-13T01:49:56.763 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/tipc/tipc.ko 2024-06-13T01:49:56.763 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/tipc/tipc_diag.ko 2024-06-13T01:49:56.763 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/unix 2024-06-13T01:49:56.763 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/unix/unix_diag.ko 2024-06-13T01:49:56.763 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/vmw_vsock 2024-06-13T01:49:56.763 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-06-13T01:49:56.763 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-06-13T01:49:56.763 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/vmw_vsock/vsock.ko 2024-06-13T01:49:56.763 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/vmw_vsock/vsock_diag.ko 2024-06-13T01:49:56.763 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/vmw_vsock/vsock_loopback.ko 2024-06-13T01:49:56.763 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/xfrm 2024-06-13T01:49:56.763 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/net/xfrm/xfrm_ipcomp.ko 2024-06-13T01:49:56.763 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/security 2024-06-13T01:49:56.764 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/security/keys 2024-06-13T01:49:56.764 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/security/keys/encrypted-keys 2024-06-13T01:49:56.764 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-06-13T01:49:56.764 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/security/keys/trusted-keys 2024-06-13T01:49:56.764 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/kernel/security/keys/trusted-keys/trusted.ko 2024-06-13T01:49:56.764 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.alias 2024-06-13T01:49:56.764 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.alias.bin 2024-06-13T01:49:56.764 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.builtin 2024-06-13T01:49:56.764 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.builtin.alias.bin 2024-06-13T01:49:56.764 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.builtin.bin 2024-06-13T01:49:56.764 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.builtin.modinfo 2024-06-13T01:49:56.764 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.dep 2024-06-13T01:49:56.764 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.dep.bin 2024-06-13T01:49:56.764 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.devname 2024-06-13T01:49:56.765 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.order 2024-06-13T01:49:56.765 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.softdep 2024-06-13T01:49:56.765 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.symbols 2024-06-13T01:49:56.765 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/modules.symbols.bin 2024-06-13T01:49:56.765 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.9.0-gff88c41504f3/vmlinuz 2024-06-13T01:49:56.768 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gff88c41504f3 2024-06-13T01:49:56.768 DEBUG:teuthology.orchestra.run.smithi002:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-06-13T01:49:56.794 INFO:teuthology.orchestra.run.smithi002.stdout:postinstall scriptlet (using /bin/sh): 2024-06-13T01:49:56.794 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-06-13T01:49:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: /usr/bin/kernel-install add 6.9.0-gff88c41504f3 /lib/modules/6.9.0-gff88c41504f3/vmlinuz 2024-06-13T01:49:56.794 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-06-13T01:49:56.794 INFO:teuthology.orchestra.run.smithi002.stdout:for file in vmlinuz System.map config; do 2024-06-13T01:49:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: if ! cmp --silent "/lib/modules/6.9.0-gff88c41504f3/${file}" "/boot/${file}-6.9.0-gff88c41504f3"; then 2024-06-13T01:49:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: cp "/lib/modules/6.9.0-gff88c41504f3/${file}" "/boot/${file}-6.9.0-gff88c41504f3" 2024-06-13T01:49:56.794 INFO:teuthology.orchestra.run.smithi002.stdout: fi 2024-06-13T01:49:56.794 INFO:teuthology.orchestra.run.smithi002.stdout:done 2024-06-13T01:49:56.795 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -d "/lib/modules/6.9.0-gff88c41504f3/dtb" ] && \ 2024-06-13T01:49:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: ! diff -rq "/lib/modules/6.9.0-gff88c41504f3/dtb" "/boot/dtb-6.9.0-gff88c41504f3" >/dev/null 2>&1; then 2024-06-13T01:49:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: rm -rf "/boot/dtb-6.9.0-gff88c41504f3" 2024-06-13T01:49:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: cp -r "/lib/modules/6.9.0-gff88c41504f3/dtb" "/boot/dtb-6.9.0-gff88c41504f3" 2024-06-13T01:49:56.795 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-06-13T01:49:56.795 INFO:teuthology.orchestra.run.smithi002.stdout:if [ ! -e "/lib/modules/6.9.0-gff88c41504f3/modules.dep" ]; then 2024-06-13T01:49:56.795 INFO:teuthology.orchestra.run.smithi002.stdout: /usr/sbin/depmod 6.9.0-gff88c41504f3 2024-06-13T01:49:56.795 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-06-13T01:49:56.795 INFO:teuthology.orchestra.run.smithi002.stdout:preuninstall scriptlet (using /bin/sh): 2024-06-13T01:49:56.795 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-06-13T01:49:56.795 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-install remove 6.9.0-gff88c41504f3 2024-06-13T01:49:56.795 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-06-13T01:49:56.796 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-06-13T01:49:56.871 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-06-13T01:49:56.871 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-06-13T01:49:56.871 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-06-13T01:49:56.871 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 68.el9 2024-06-13T01:49:56.871 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-06-13T01:49:56.871 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-13T01:49:56.871 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-06-13T01:49:56.871 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8264254 2024-06-13T01:49:56.871 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-06-13T01:49:56.871 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-13T01:49:56.871 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-13T01:49:56.871 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-13T01:49:56.871 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-13T01:49:56.872 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-06-13T01:49:56.872 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-06-13T01:49:56.872 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-13T01:49:56.872 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-06-13T01:49:56.872 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-06-13T01:49:56.872 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T01:49:56.872 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-13T01:49:56.872 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-13T01:49:56.872 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-13T01:49:56.872 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-06-13T01:49:56.872 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T01:49:56.872 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-06-13T01:49:56.873 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-13T01:49:56.873 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 6.9.0-gff88c41504f3 2024-06-13T01:49:56.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-13T01:49:57.430 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-06-13T01:49:58.850 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-13T01:49:58.919 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-06-13T01:49:58.921 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-06-13T01:49:58.937 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.ZxQnOat9Rb 2024-06-13T01:49:58.937 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ZxQnOat9Rb 2024-06-13T01:49:59.013 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.ZxQnOat9Rb 2024-06-13T01:49:59.149 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.ZxQnOat9Rb is 6KB 2024-06-13T01:49:59.198 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.ZxQnOat9Rb 2024-06-13T01:49:59.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-06-13T01:49:59.276 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-13T01:49:59.276 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-13T01:49:59.276 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-13T01:49:59.276 INFO:teuthology.orchestra.run.smithi002.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gff88c41504f3.conf 2024-06-13T01:49:59.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gff88c41504f3 2024-06-13T01:49:59.426 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-06-13T01:50:29.428 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-06-13T01:50:29.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-06-13T01:50:29.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T01:50:47.838 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-06-13T01:50:56.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-06-13T01:50:56.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T01:51:56.842 DEBUG:teuthology.orchestra.remote:timed out 2024-06-13T01:52:08.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-06-13T01:52:08.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T01:52:09.255 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-06-13T01:52:09.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-06-13T01:52:09.882 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-gff88c41504f3"... 2024-06-13T01:52:09.882 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-06-13T01:52:09.938 INFO:teuthology.orchestra.run.smithi002.stdout:6.9.0-gff88c41504f3 2024-06-13T01:52:09.938 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gff88c41504f3 vs 6.9.0-gff88c41504f3 2024-06-13T01:52:09.939 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-13T01:52:09.939 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-13T01:52:10.940 DEBUG:teuthology.parallel:result is None 2024-06-13T01:52:10.940 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-13T01:52:10.948 INFO:teuthology.task.internal:Creating test directory... 2024-06-13T01:52:10.948 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-13T01:52:10.955 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-13T01:52:10.958 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-13T01:52:11.005 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-13T01:52:11.012 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-13T01:52:11.039 INFO:teuthology.task.internal:Creating archive directory... 2024-06-13T01:52:11.040 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-13T01:52:11.047 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-13T01:52:11.049 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-13T01:52:11.117 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-13T01:52:11.124 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-13T01:52:11.124 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-13T01:52:11.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T01:52:11.140 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-13T01:52:11.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T01:52:11.157 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-13T01:52:11.164 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-13T01:52:11.183 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-13T01:52:11.217 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T01:52:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T01:52:11.251 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T01:52:11.270 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T01:52:11.290 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T01:52:11.341 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-13T01:52:11.346 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-13T01:52:11.354 INFO:teuthology.task.internal:Configuring sudo... 2024-06-13T01:52:11.354 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-13T01:52:11.359 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-13T01:52:11.362 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-13T01:52:11.444 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-13T01:52:11.453 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-13T01:52:11.453 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-13T01:52:11.461 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-13T01:52:11.464 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-13T01:52:11.512 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T01:52:11.594 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T01:52:11.687 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T01:52:11.771 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T01:52:11.863 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T01:52:11.863 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-13T01:52:11.948 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T01:52:12.005 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T01:52:12.057 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T01:52:12.095 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T01:52:12.140 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-06-13T01:52:12.140 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-13T01:52:12.205 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T01:52:12.247 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-13T01:52:12.301 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T01:52:12.384 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-13T01:52:12.425 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-06-13T01:52:12.425 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-13T01:52:12.490 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-06-13T01:52:12.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-06-13T01:52:12.500 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-06-13T01:52:12.531 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-13T01:52:12.573 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-13T01:52:12.603 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-13T01:52:13.074 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-13T01:52:13.082 INFO:teuthology.task.internal:Starting timer... 2024-06-13T01:52:13.082 INFO:teuthology.run_tasks:Running task pcp... 2024-06-13T01:52:13.126 INFO:teuthology.run_tasks:Running task selinux... 2024-06-13T01:52:13.166 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-06-13T01:52:13.167 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-06-13T01:52:13.297 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-06-13T01:52:13.302 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2024-06-13T01:52:13.370 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2024-06-13T01:52:13.372 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2024-06-13T01:52:13.424 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2024-06-13T01:52:13.426 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-13T01:52:13.426 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-06-13T01:52:13.486 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-06-13T01:52:13.487 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2024-06-13T01:52:13.525 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2024-06-13T01:52:13.525 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2024-06-13T01:52:13.547 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2024-06-13T01:52:13.547 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2024-06-13T01:52:13.548 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-13T01:52:13.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T01:52:13.634 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-13T01:52:13.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T01:52:13.661 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-13T01:52:13.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T01:52:13.689 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-13T01:52:13.689 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-06-13T01:52:13.768 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2024-06-13T01:52:13.795 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2024-06-13T01:52:13.819 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-13T01:52:13.829 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-06-13T01:52:13.832 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-06-13T01:52:13.939 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-13T01:52:13.950 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-13T01:52:13.951 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi084.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-13T02:00:00.349 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-06-13T02:00:00.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-06-13T02:00:00.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T02:00:00.462 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-06-13T02:00:00.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-06-13T02:00:00.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-06-13T02:00:00.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T02:00:00.673 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-06-13T02:00:00.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-06-13T02:00:00.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-06-13T02:00:00.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-13T02:00:00.833 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-06-13T02:00:00.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-06-13T02:00:00.911 INFO:teuthology.run_tasks:Running task clock... 2024-06-13T02:00:00.954 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-13T02:00:00.954 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-13T02:00:00.954 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-13T02:00:00.962 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-13T02:00:00.962 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-13T02:00:00.965 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-13T02:00:00.965 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-13T02:00:00.994 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-13T02:00:00.996 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-13T02:00:01.009 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-13T02:00:01.011 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-13T02:00:01.034 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2024-06-13T02:00:01.035 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2024-06-13T02:00:01.045 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2024-06-13T02:00:01.046 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2024-06-13T02:00:01.055 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-13T02:00:01.059 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-13T02:00:01.059 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-13T02:00:01.073 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-13T02:00:01.073 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-13T02:00:01.102 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-13T02:00:01.131 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-06-13T02:00:01.133 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-06-13T02:00:01.134 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-13T02:00:01.134 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-06-13T02:00:01.134 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T02:00:01.134 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T02:00:01.134 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T02:00:01.134 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T02:00:01.135 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-13T02:00:01.136 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-06-13T02:00:01.136 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T02:00:01.136 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T02:00:01.136 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T02:00:01.136 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T02:00:01.179 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-06-13T02:00:01.214 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-06-13T02:00:01.259 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-13T02:00:01.303 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-13T02:00:01.450 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-06-13T02:00:01.460 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-13T02:00:01.461 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-06-13T02:00:01.461 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T02:00:01.461 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T02:00:01.461 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T02:00:01.461 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T02:00:01.463 INFO:teuthology.run_tasks:Running task install... 2024-06-13T02:00:01.472 DEBUG:teuthology.task.install:project ceph 2024-06-13T02:00:01.472 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'}} 2024-06-13T02:00:01.472 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba'} 2024-06-13T02:00:01.472 INFO:teuthology.task.install:Using flavor: default 2024-06-13T02:00:01.477 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-13T02:00:01.477 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-06-13T02:00:01.478 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-13T02:00:01.478 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T02:00:01.480 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-13T02:00:01.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T02:00:01.481 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'tag': None, 'wait_for_package': False} 2024-06-13T02:00:01.481 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T02:00:01.638 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-13T02:00:01.638 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-13T02:00:01.641 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-13T02:00:01.641 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-13T02:00:01.644 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/ 2024-06-13T02:00:01.644 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2946.g3d89accf 2024-06-13T02:00:01.753 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-13T02:00:01.753 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:00:01.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-13T02:00:01.808 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-13T02:00:01.809 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-06-13T02:00:01.809 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-13T02:00:01.816 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-13T02:00:01.817 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-06-13T02:00:01.817 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-13T02:00:01.837 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-13T02:00:01.837 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-13T02:00:01.842 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-13T02:00:01.842 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-13T02:00:01.851 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-13T02:00:01.851 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d89accfe3201286f000e065a1faea2a88c7a6ba/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-13T02:00:01.905 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-13T02:00:01.909 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-13T02:00:01.982 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-13T02:00:01.983 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-13T02:00:01.987 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-13T02:00:02.047 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2024-06-13T02:00:02.048 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2024-06-13T02:00:02.049 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2024-06-13T02:00:02.050 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2024-06-13T02:00:02.105 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-13T02:00:02.187 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-06-13T02:00:02.192 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-06-13T02:00:02.272 INFO:teuthology.orchestra.run.smithi175.stdout:45 files removed 2024-06-13T02:00:02.279 INFO:teuthology.orchestra.run.smithi084.stdout:45 files removed 2024-06-13T02:00:02.298 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-13T02:00:02.307 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-13T02:00:02.525 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-06-13T02:00:02.564 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-13T02:00:02.917 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 238 kB/s | 83 kB 00:00 2024-06-13T02:00:03.034 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 176 kB/s | 83 kB 00:00 2024-06-13T02:00:03.301 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-06-13T02:00:03.401 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 36 kB/s | 11 kB 00:00 2024-06-13T02:00:03.500 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 172 kB/s | 83 kB 00:00 2024-06-13T02:00:03.718 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-06-13T02:00:03.844 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2024-06-13T02:00:04.058 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 25 kB/s | 11 kB 00:00 2024-06-13T02:00:04.634 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2024-06-13T02:00:05.512 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.1 MB 00:00 2024-06-13T02:00:05.946 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.1 MB 00:02 2024-06-13T02:00:06.921 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.1 MB 00:03 2024-06-13T02:00:09.707 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 6.7 MB/s | 20 MB 00:02 2024-06-13T02:00:11.580 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-06-13T02:00:14.848 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 6.1 MB/s | 6.3 MB 00:01 2024-06-13T02:00:16.789 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 17 kB 00:00 2024-06-13T02:00:18.121 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.3 MB 00:02 2024-06-13T02:00:18.701 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-06-13T02:00:19.996 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 17 kB 00:00 2024-06-13T02:00:21.649 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-06-13T02:00:24.862 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:16 2024-06-13T02:00:25.178 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-06-13T02:00:26.913 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-06-13T02:00:27.798 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T02:00:27.799 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T02:00:27.815 INFO:teuthology.orchestra.run.smithi002.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-13T02:00:27.816 INFO:teuthology.orchestra.run.smithi002.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-13T02:00:27.817 INFO:teuthology.orchestra.run.smithi002.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-13T02:00:27.818 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-13T02:00:27.820 INFO:teuthology.orchestra.run.smithi002.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-13T02:00:27.823 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-13T02:00:27.824 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-13T02:00:27.898 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-06-13T02:00:27.921 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-06-13T02:00:27.922 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-06-13T02:00:27.922 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-06-13T02:00:27.922 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-06-13T02:00:27.922 INFO:teuthology.orchestra.run.smithi002.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-13T02:00:27.922 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-13T02:00:27.922 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-13T02:00:27.922 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-13T02:00:27.922 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-13T02:00:27.922 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-13T02:00:27.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-13T02:00:27.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-13T02:00:27.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-13T02:00:27.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-13T02:00:27.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-13T02:00:27.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-13T02:00:27.923 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-13T02:00:27.923 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-13T02:00:27.923 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-13T02:00:27.923 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-13T02:00:27.923 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-13T02:00:27.924 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-13T02:00:27.924 INFO:teuthology.orchestra.run.smithi002.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-13T02:00:27.924 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-13T02:00:27.924 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-13T02:00:27.924 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-13T02:00:27.924 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-13T02:00:27.924 INFO:teuthology.orchestra.run.smithi002.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-13T02:00:27.924 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-13T02:00:27.924 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel x86_64 1:3.2.2-1.el9 appstream 4.4 M 2024-06-13T02:00:27.924 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-13T02:00:27.924 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-13T02:00:27.924 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-13T02:00:27.925 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-13T02:00:27.925 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-13T02:00:27.925 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-13T02:00:27.925 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-13T02:00:27.925 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-13T02:00:27.925 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T02:00:27.925 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-13T02:00:27.925 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel x86_64 6.4.0-1.el9 appstream 95 k 2024-06-13T02:00:27.925 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-06-13T02:00:27.925 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-13T02:00:27.925 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-13T02:00:27.926 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-13T02:00:27.926 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-13T02:00:27.926 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-13T02:00:27.926 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-13T02:00:27.926 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-13T02:00:27.926 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-13T02:00:27.926 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T02:00:27.926 INFO:teuthology.orchestra.run.smithi002.stdout: openssl x86_64 1:3.2.2-1.el9 baseos 1.4 M 2024-06-13T02:00:27.926 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs x86_64 1:3.2.2-1.el9 baseos 2.4 M 2024-06-13T02:00:27.926 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs x86_64 6.4.0-1.el9 baseos 1.1 M 2024-06-13T02:00:27.926 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-06-13T02:00:27.926 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-13T02:00:27.927 INFO:teuthology.orchestra.run.smithi002.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-13T02:00:27.927 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-13T02:00:27.927 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-13T02:00:27.927 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-13T02:00:27.927 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-13T02:00:27.927 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-13T02:00:27.927 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-13T02:00:27.927 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-13T02:00:27.927 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-13T02:00:27.927 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-13T02:00:27.927 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-13T02:00:27.927 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-13T02:00:27.927 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-13T02:00:27.928 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-13T02:00:27.928 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-13T02:00:27.928 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-13T02:00:27.928 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-13T02:00:27.928 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-13T02:00:27.928 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-13T02:00:27.928 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-13T02:00:27.928 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-13T02:00:27.928 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-13T02:00:27.928 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-13T02:00:27.928 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-13T02:00:27.928 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-13T02:00:27.928 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-13T02:00:27.929 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-13T02:00:27.929 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-13T02:00:27.929 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-13T02:00:27.929 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-13T02:00:27.929 INFO:teuthology.orchestra.run.smithi002.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-13T02:00:27.929 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-13T02:00:27.929 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-13T02:00:27.929 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-13T02:00:27.929 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-13T02:00:27.929 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-13T02:00:27.929 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-13T02:00:27.929 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-13T02:00:27.930 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-13T02:00:27.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-13T02:00:27.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-13T02:00:27.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-13T02:00:27.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-13T02:00:27.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-13T02:00:27.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-13T02:00:27.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-13T02:00:27.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-13T02:00:27.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-13T02:00:27.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-13T02:00:27.930 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-13T02:00:27.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-13T02:00:27.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-13T02:00:27.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-13T02:00:27.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-13T02:00:27.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.29.0-2.el9 epel 205 k 2024-06-13T02:00:27.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-13T02:00:27.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-13T02:00:27.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-13T02:00:27.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-13T02:00:27.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-13T02:00:27.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-13T02:00:27.931 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-13T02:00:27.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-13T02:00:27.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-13T02:00:27.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-13T02:00:27.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-13T02:00:27.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-13T02:00:27.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-13T02:00:27.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-13T02:00:27.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-13T02:00:27.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-13T02:00:27.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-13T02:00:27.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-13T02:00:27.932 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-13T02:00:27.933 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-13T02:00:27.933 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-13T02:00:27.933 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-13T02:00:27.933 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-13T02:00:27.933 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-13T02:00:27.933 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-13T02:00:27.933 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-13T02:00:27.933 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-13T02:00:27.933 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-13T02:00:27.933 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-13T02:00:27.933 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-13T02:00:27.933 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-13T02:00:27.933 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-13T02:00:27.934 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-13T02:00:27.934 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-13T02:00:27.934 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-13T02:00:27.934 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-13T02:00:27.934 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-13T02:00:27.934 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-13T02:00:27.934 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-13T02:00:27.934 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-13T02:00:27.934 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-13T02:00:27.934 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-13T02:00:27.934 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-13T02:00:27.934 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-13T02:00:27.935 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-13T02:00:27.935 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-13T02:00:27.935 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-13T02:00:27.935 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-13T02:00:27.935 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-13T02:00:27.935 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-06-13T02:00:27.935 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-13T02:00:27.935 INFO:teuthology.orchestra.run.smithi002.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-13T02:00:27.935 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-13T02:00:27.935 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-13T02:00:27.935 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-06-13T02:00:27.935 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-13T02:00:27.936 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:00:27.936 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-06-13T02:00:27.936 INFO:teuthology.orchestra.run.smithi002.stdout:======================================================================================= 2024-06-13T02:00:27.936 INFO:teuthology.orchestra.run.smithi002.stdout:Install 148 Packages 2024-06-13T02:00:27.936 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 12 Packages 2024-06-13T02:00:27.936 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:00:27.936 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 226 M 2024-06-13T02:00:27.936 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-06-13T02:00:29.246 INFO:teuthology.orchestra.run.smithi002.stdout:(1/160): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 11 kB/s | 6.6 kB 00:00 2024-06-13T02:00:29.250 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T02:00:29.251 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T02:00:29.262 INFO:teuthology.orchestra.run.smithi084.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-13T02:00:29.263 INFO:teuthology.orchestra.run.smithi084.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-13T02:00:29.264 INFO:teuthology.orchestra.run.smithi084.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-13T02:00:29.265 INFO:teuthology.orchestra.run.smithi084.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-13T02:00:29.266 INFO:teuthology.orchestra.run.smithi084.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-13T02:00:29.269 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-13T02:00:29.269 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-13T02:00:29.333 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-06-13T02:00:29.358 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-06-13T02:00:29.358 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-06-13T02:00:29.358 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-06-13T02:00:29.358 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-06-13T02:00:29.358 INFO:teuthology.orchestra.run.smithi084.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-13T02:00:29.358 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-13T02:00:29.358 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-13T02:00:29.358 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-13T02:00:29.358 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-13T02:00:29.358 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-13T02:00:29.359 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-13T02:00:29.359 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-13T02:00:29.359 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-13T02:00:29.359 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-13T02:00:29.359 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-13T02:00:29.359 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-13T02:00:29.359 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-13T02:00:29.359 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-13T02:00:29.359 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-13T02:00:29.360 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-13T02:00:29.360 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-13T02:00:29.360 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-13T02:00:29.360 INFO:teuthology.orchestra.run.smithi084.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-13T02:00:29.360 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-13T02:00:29.360 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-13T02:00:29.360 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-13T02:00:29.360 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-13T02:00:29.360 INFO:teuthology.orchestra.run.smithi084.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-13T02:00:29.360 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-13T02:00:29.360 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel x86_64 1:3.2.2-1.el9 appstream 4.4 M 2024-06-13T02:00:29.361 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-13T02:00:29.361 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-13T02:00:29.361 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-13T02:00:29.361 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-13T02:00:29.361 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-13T02:00:29.361 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-13T02:00:29.361 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-13T02:00:29.361 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-13T02:00:29.361 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T02:00:29.361 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-13T02:00:29.361 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel x86_64 6.4.0-1.el9 appstream 95 k 2024-06-13T02:00:29.361 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2024-06-13T02:00:29.361 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-13T02:00:29.361 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-13T02:00:29.362 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-13T02:00:29.362 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-13T02:00:29.362 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-13T02:00:29.362 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-13T02:00:29.362 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-13T02:00:29.362 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-13T02:00:29.362 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T02:00:29.362 INFO:teuthology.orchestra.run.smithi084.stdout: openssl x86_64 1:3.2.2-1.el9 baseos 1.4 M 2024-06-13T02:00:29.362 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs x86_64 1:3.2.2-1.el9 baseos 2.4 M 2024-06-13T02:00:29.362 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs x86_64 6.4.0-1.el9 baseos 1.1 M 2024-06-13T02:00:29.362 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-06-13T02:00:29.362 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-13T02:00:29.363 INFO:teuthology.orchestra.run.smithi084.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-13T02:00:29.363 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-13T02:00:29.363 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-13T02:00:29.363 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-13T02:00:29.363 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-13T02:00:29.363 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-13T02:00:29.363 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-13T02:00:29.363 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-13T02:00:29.363 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-13T02:00:29.363 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-13T02:00:29.363 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-13T02:00:29.363 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-13T02:00:29.363 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-13T02:00:29.363 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-13T02:00:29.364 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-13T02:00:29.364 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-13T02:00:29.364 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-13T02:00:29.364 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-13T02:00:29.364 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-13T02:00:29.364 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-13T02:00:29.364 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-13T02:00:29.364 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-13T02:00:29.364 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-13T02:00:29.364 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-13T02:00:29.364 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-13T02:00:29.364 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-13T02:00:29.364 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-13T02:00:29.364 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-13T02:00:29.365 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-13T02:00:29.365 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-13T02:00:29.365 INFO:teuthology.orchestra.run.smithi084.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-13T02:00:29.365 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-13T02:00:29.365 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-13T02:00:29.365 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-13T02:00:29.365 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-13T02:00:29.365 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-13T02:00:29.365 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-13T02:00:29.365 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-13T02:00:29.365 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-13T02:00:29.365 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-13T02:00:29.365 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-13T02:00:29.365 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-13T02:00:29.365 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-13T02:00:29.366 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-13T02:00:29.366 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-13T02:00:29.366 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-13T02:00:29.366 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-13T02:00:29.366 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-13T02:00:29.366 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-13T02:00:29.366 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-13T02:00:29.366 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-13T02:00:29.366 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-13T02:00:29.366 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-13T02:00:29.366 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-13T02:00:29.366 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:2.29.0-2.el9 epel 205 k 2024-06-13T02:00:29.366 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-13T02:00:29.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-13T02:00:29.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-13T02:00:29.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-13T02:00:29.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-13T02:00:29.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-13T02:00:29.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-13T02:00:29.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-13T02:00:29.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-13T02:00:29.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-13T02:00:29.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-13T02:00:29.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-13T02:00:29.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-13T02:00:29.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-13T02:00:29.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-13T02:00:29.367 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-13T02:00:29.368 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-13T02:00:29.368 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-13T02:00:29.368 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-13T02:00:29.368 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-13T02:00:29.368 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-13T02:00:29.368 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-13T02:00:29.368 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-13T02:00:29.368 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-13T02:00:29.368 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-13T02:00:29.368 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-13T02:00:29.368 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-13T02:00:29.368 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-13T02:00:29.368 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-13T02:00:29.368 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-13T02:00:29.368 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-13T02:00:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-13T02:00:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-13T02:00:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-13T02:00:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-13T02:00:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-13T02:00:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-13T02:00:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-13T02:00:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-13T02:00:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-13T02:00:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-13T02:00:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-13T02:00:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-13T02:00:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-13T02:00:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-13T02:00:29.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-13T02:00:29.370 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-13T02:00:29.370 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-13T02:00:29.370 INFO:teuthology.orchestra.run.smithi084.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-13T02:00:29.370 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-06-13T02:00:29.370 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-13T02:00:29.370 INFO:teuthology.orchestra.run.smithi084.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-13T02:00:29.370 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-13T02:00:29.370 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-13T02:00:29.370 INFO:teuthology.orchestra.run.smithi084.stdout:Installing weak dependencies: 2024-06-13T02:00:29.370 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-13T02:00:29.370 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-06-13T02:00:29.370 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-06-13T02:00:29.370 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-06-13T02:00:29.370 INFO:teuthology.orchestra.run.smithi084.stdout:Install 148 Packages 2024-06-13T02:00:29.370 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 12 Packages 2024-06-13T02:00:29.371 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-06-13T02:00:29.371 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 226 M 2024-06-13T02:00:29.371 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-06-13T02:00:30.136 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.3 MB 00:01 2024-06-13T02:00:30.246 INFO:teuthology.orchestra.run.smithi002.stdout:(2/160): ceph-base-19.0.0-2946.g3d89accf.el9.x8 3.4 MB/s | 5.4 MB 00:01 2024-06-13T02:00:30.255 INFO:teuthology.orchestra.run.smithi084.stdout:(1/160): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-06-13T02:00:30.338 INFO:teuthology.orchestra.run.smithi002.stdout:(3/160): ceph-immutable-object-cache-19.0.0-294 1.6 MB/s | 145 kB 00:00 2024-06-13T02:00:30.704 INFO:teuthology.orchestra.run.smithi002.stdout:(4/160): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 610 kB/s | 890 kB 00:01 2024-06-13T02:00:31.013 INFO:teuthology.orchestra.run.smithi084.stdout:(2/160): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 1.1 MB/s | 890 kB 00:00 2024-06-13T02:00:31.088 INFO:teuthology.orchestra.run.smithi002.stdout:(5/160): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 3.2 MB/s | 2.4 MB 00:00 2024-06-13T02:00:31.138 INFO:teuthology.orchestra.run.smithi084.stdout:(3/160): ceph-immutable-object-cache-19.0.0-294 1.1 MB/s | 145 kB 00:00 2024-06-13T02:00:31.994 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 17 kB 00:00 2024-06-13T02:00:32.355 INFO:teuthology.orchestra.run.smithi002.stdout:(6/160): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 3.7 MB/s | 4.7 MB 00:01 2024-06-13T02:00:32.497 INFO:teuthology.orchestra.run.smithi084.stdout:(4/160): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 1.7 MB/s | 2.4 MB 00:01 2024-06-13T02:00:32.539 INFO:teuthology.orchestra.run.smithi002.stdout:(7/160): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 834 kB/s | 1.5 MB 00:01 2024-06-13T02:00:32.631 INFO:teuthology.orchestra.run.smithi084.stdout:(5/160): ceph-base-19.0.0-2946.g3d89accf.el9.x8 2.0 MB/s | 5.4 MB 00:02 2024-06-13T02:00:32.856 INFO:teuthology.orchestra.run.smithi084.stdout:(6/160): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 4.2 MB/s | 1.5 MB 00:00 2024-06-13T02:00:33.672 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-06-13T02:00:33.689 INFO:teuthology.orchestra.run.smithi084.stdout:(7/160): ceph-common-19.0.0-2946.g3d89accf.el9. 5.7 MB/s | 21 MB 00:03 2024-06-13T02:00:33.798 INFO:teuthology.orchestra.run.smithi084.stdout:(8/160): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 4.0 MB/s | 4.7 MB 00:01 2024-06-13T02:00:33.856 INFO:teuthology.orchestra.run.smithi084.stdout:(9/160): ceph-selinux-19.0.0-2946.g3d89accf.el9 434 kB/s | 25 kB 00:00 2024-06-13T02:00:34.790 INFO:teuthology.orchestra.run.smithi084.stdout:(10/160): ceph-radosgw-19.0.0-2946.g3d89accf.el 9.3 MB/s | 10 MB 00:01 2024-06-13T02:00:34.840 INFO:teuthology.orchestra.run.smithi084.stdout:(11/160): cephfs-mirror-19.0.0-2946.g3d89accf.e 4.3 MB/s | 221 kB 00:00 2024-06-13T02:00:34.890 INFO:teuthology.orchestra.run.smithi084.stdout:(12/160): cephfs-shell-19.0.0-2946.g3d89accf.el 542 kB/s | 27 kB 00:00 2024-06-13T02:00:34.922 INFO:teuthology.orchestra.run.smithi002.stdout:(8/160): ceph-osd-19.0.0-2946.g3d89accf.el9.x86 6.5 MB/s | 17 MB 00:02 2024-06-13T02:00:34.941 INFO:teuthology.orchestra.run.smithi084.stdout:(13/160): libcephfs-devel-19.0.0-2946.g3d89accf 633 kB/s | 32 kB 00:00 2024-06-13T02:00:34.972 INFO:teuthology.orchestra.run.smithi002.stdout:(9/160): ceph-selinux-19.0.0-2946.g3d89accf.el9 517 kB/s | 25 kB 00:00 2024-06-13T02:00:35.050 INFO:teuthology.orchestra.run.smithi084.stdout:(14/160): libcephfs2-19.0.0-2946.g3d89accf.el9. 6.8 MB/s | 747 kB 00:00 2024-06-13T02:00:35.108 INFO:teuthology.orchestra.run.smithi084.stdout:(15/160): libcephsqlite-19.0.0-2946.g3d89accf.e 2.7 MB/s | 163 kB 00:00 2024-06-13T02:00:35.167 INFO:teuthology.orchestra.run.smithi084.stdout:(16/160): librados-devel-19.0.0-2946.g3d89accf. 2.1 MB/s | 127 kB 00:00 2024-06-13T02:00:35.267 INFO:teuthology.orchestra.run.smithi084.stdout:(17/160): libradosstriper1-19.0.0-2946.g3d89acc 4.9 MB/s | 501 kB 00:00 2024-06-13T02:00:35.859 INFO:teuthology.orchestra.run.smithi084.stdout:(18/160): librgw2-19.0.0-2946.g3d89accf.el9.x86 9.0 MB/s | 5.3 MB 00:00 2024-06-13T02:00:35.909 INFO:teuthology.orchestra.run.smithi084.stdout:(19/160): python3-ceph-argparse-19.0.0-2946.g3d 909 kB/s | 45 kB 00:00 2024-06-13T02:00:35.968 INFO:teuthology.orchestra.run.smithi084.stdout:(20/160): python3-ceph-common-19.0.0-2946.g3d89 2.3 MB/s | 135 kB 00:00 2024-06-13T02:00:36.018 INFO:teuthology.orchestra.run.smithi084.stdout:(21/160): python3-cephfs-19.0.0-2946.g3d89accf. 3.2 MB/s | 162 kB 00:00 2024-06-13T02:00:36.185 INFO:teuthology.orchestra.run.smithi084.stdout:(22/160): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 5.0 MB/s | 17 MB 00:03 2024-06-13T02:00:36.210 INFO:teuthology.orchestra.run.smithi084.stdout:(23/160): python3-rados-19.0.0-2946.g3d89accf.e 1.6 MB/s | 321 kB 00:00 2024-06-13T02:00:36.269 INFO:teuthology.orchestra.run.smithi084.stdout:(24/160): python3-rbd-19.0.0-2946.g3d89accf.el9 3.5 MB/s | 300 kB 00:00 2024-06-13T02:00:36.294 INFO:teuthology.orchestra.run.smithi084.stdout:(25/160): python3-rgw-19.0.0-2946.g3d89accf.el9 1.2 MB/s | 99 kB 00:00 2024-06-13T02:00:36.320 INFO:teuthology.orchestra.run.smithi084.stdout:(26/160): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.7 MB/s | 85 kB 00:00 2024-06-13T02:00:36.387 INFO:teuthology.orchestra.run.smithi084.stdout:(27/160): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 2.5 MB/s | 171 kB 00:00 2024-06-13T02:00:36.445 INFO:teuthology.orchestra.run.smithi084.stdout:(28/160): ceph-grafana-dashboards-19.0.0-2946.g 543 kB/s | 32 kB 00:00 2024-06-13T02:00:36.521 INFO:teuthology.orchestra.run.smithi084.stdout:(29/160): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 1.9 MB/s | 142 kB 00:00 2024-06-13T02:00:36.646 INFO:teuthology.orchestra.run.smithi084.stdout:(30/160): rbd-mirror-19.0.0-2946.g3d89accf.el9. 8.8 MB/s | 3.1 MB 00:00 2024-06-13T02:00:37.313 INFO:teuthology.orchestra.run.smithi084.stdout:(31/160): ceph-mgr-dashboard-19.0.0-2946.g3d89a 4.4 MB/s | 3.5 MB 00:00 2024-06-13T02:00:37.488 INFO:teuthology.orchestra.run.smithi084.stdout:(32/160): ceph-mgr-diskprediction-local-19.0.0- 8.8 MB/s | 7.4 MB 00:00 2024-06-13T02:00:37.513 INFO:teuthology.orchestra.run.smithi084.stdout:(33/160): ceph-mgr-modules-core-19.0.0-2946.g3d 1.2 MB/s | 249 kB 00:00 2024-06-13T02:00:37.530 INFO:teuthology.orchestra.run.smithi084.stdout:(34/160): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 1.2 MB/s | 49 kB 00:00 2024-06-13T02:00:37.572 INFO:teuthology.orchestra.run.smithi084.stdout:(35/160): ceph-prometheus-alerts-19.0.0-2946.g3 282 kB/s | 16 kB 00:00 2024-06-13T02:00:37.622 INFO:teuthology.orchestra.run.smithi084.stdout:(36/160): ceph-volume-19.0.0-2946.g3d89accf.el9 2.8 MB/s | 264 kB 00:00 2024-06-13T02:00:37.689 INFO:teuthology.orchestra.run.smithi084.stdout:(37/160): cephadm-19.0.0-2946.g3d89accf.el9.noa 6.4 MB/s | 763 kB 00:00 2024-06-13T02:00:37.715 INFO:teuthology.orchestra.run.smithi084.stdout:(38/160): cephfs-top-19.0.0-2946.g3d89accf.el9. 199 kB/s | 18 kB 00:00 2024-06-13T02:00:37.773 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:37.781 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:37.848 INFO:teuthology.orchestra.run.smithi002.stdout:(10/160): ceph-radosgw-19.0.0-2946.g3d89accf.el 1.9 MB/s | 10 MB 00:05 2024-06-13T02:00:37.965 INFO:teuthology.orchestra.run.smithi084.stdout:(39/160): fuse-2.9.9-15.el9.x86_64.rpm 292 kB/s | 80 kB 00:00 2024-06-13T02:00:37.967 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:37.972 INFO:teuthology.orchestra.run.smithi002.stdout:(11/160): cephfs-mirror-19.0.0-2946.g3d89accf.e 1.8 MB/s | 221 kB 00:00 2024-06-13T02:00:38.039 INFO:teuthology.orchestra.run.smithi002.stdout:(12/160): cephfs-shell-19.0.0-2946.g3d89accf.el 410 kB/s | 27 kB 00:00 2024-06-13T02:00:38.115 INFO:teuthology.orchestra.run.smithi002.stdout:(13/160): libcephfs-devel-19.0.0-2946.g3d89accf 428 kB/s | 32 kB 00:00 2024-06-13T02:00:38.132 INFO:teuthology.orchestra.run.smithi084.stdout:(40/160): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-06-13T02:00:38.199 INFO:teuthology.orchestra.run.smithi084.stdout:(41/160): libgfortran-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 803 kB 00:00 2024-06-13T02:00:38.225 INFO:teuthology.orchestra.run.smithi084.stdout:(42/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-06-13T02:00:38.283 INFO:teuthology.orchestra.run.smithi084.stdout:(43/160): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-06-13T02:00:38.333 INFO:teuthology.orchestra.run.smithi084.stdout:(44/160): python3-pycparser-2.20-6.el9.noarch.r 2.7 MB/s | 135 kB 00:00 2024-06-13T02:00:38.401 INFO:teuthology.orchestra.run.smithi084.stdout:(45/160): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-06-13T02:00:38.422 INFO:teuthology.orchestra.run.smithi002.stdout:(14/160): libcephfs2-19.0.0-2946.g3d89accf.el9. 2.4 MB/s | 747 kB 00:00 2024-06-13T02:00:38.467 INFO:teuthology.orchestra.run.smithi084.stdout:(46/160): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-06-13T02:00:38.468 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-13T02:00:38.534 INFO:teuthology.orchestra.run.smithi084.stdout:(47/160): python3-cryptography-36.0.1-4.el9.x86 3.7 MB/s | 1.2 MB 00:00 2024-06-13T02:00:38.535 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:38.549 INFO:teuthology.orchestra.run.smithi002.stdout:(15/160): libcephsqlite-19.0.0-2946.g3d89accf.e 1.3 MB/s | 163 kB 00:00 2024-06-13T02:00:38.632 INFO:teuthology.orchestra.run.smithi002.stdout:(16/160): librados-devel-19.0.0-2946.g3d89accf. 1.5 MB/s | 127 kB 00:00 2024-06-13T02:00:38.850 INFO:teuthology.orchestra.run.smithi002.stdout:(17/160): libradosstriper1-19.0.0-2946.g3d89acc 2.3 MB/s | 501 kB 00:00 2024-06-13T02:00:39.186 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 6.2 kB/s | 1.7 kB 00:00 2024-06-13T02:00:39.560 INFO:teuthology.orchestra.run.smithi084.stdout:(48/160): automake-1.16.2-8.el9.noarch.rpm 631 kB/s | 689 kB 00:01 2024-06-13T02:00:39.562 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:39.685 INFO:teuthology.orchestra.run.smithi084.stdout:(49/160): bison-3.7.4-5.el9.x86_64.rpm 820 kB/s | 943 kB 00:01 2024-06-13T02:00:40.283 INFO:teuthology.orchestra.run.smithi002.stdout:(18/160): ceph-test-19.0.0-2946.g3d89accf.el9.x 9.1 MB/s | 48 MB 00:05 2024-06-13T02:00:40.333 INFO:teuthology.orchestra.run.smithi002.stdout:(19/160): python3-ceph-argparse-19.0.0-2946.g3d 928 kB/s | 45 kB 00:00 2024-06-13T02:00:40.335 INFO:teuthology.orchestra.run.smithi084.stdout:(50/160): elfutils-libelf-devel-0.191-4.el9.x86 33 kB/s | 22 kB 00:00 2024-06-13T02:00:40.408 INFO:teuthology.orchestra.run.smithi002.stdout:(20/160): python3-ceph-common-19.0.0-2946.g3d89 1.8 MB/s | 135 kB 00:00 2024-06-13T02:00:40.419 INFO:teuthology.orchestra.run.smithi084.stdout:(51/160): boost-program-options-1.75.0-8.el9.x8 124 kB/s | 107 kB 00:00 2024-06-13T02:00:40.459 INFO:teuthology.orchestra.run.smithi002.stdout:(21/160): python3-cephfs-19.0.0-2946.g3d89accf. 3.2 MB/s | 162 kB 00:00 2024-06-13T02:00:40.534 INFO:teuthology.orchestra.run.smithi002.stdout:(22/160): python3-rados-19.0.0-2946.g3d89accf.e 4.2 MB/s | 321 kB 00:00 2024-06-13T02:00:40.610 INFO:teuthology.orchestra.run.smithi002.stdout:(23/160): python3-rbd-19.0.0-2946.g3d89accf.el9 4.0 MB/s | 300 kB 00:00 2024-06-13T02:00:40.726 INFO:teuthology.orchestra.run.smithi002.stdout:(24/160): librgw2-19.0.0-2946.g3d89accf.el9.x86 2.8 MB/s | 5.3 MB 00:01 2024-06-13T02:00:40.760 INFO:teuthology.orchestra.run.smithi002.stdout:(25/160): python3-rgw-19.0.0-2946.g3d89accf.el9 665 kB/s | 99 kB 00:00 2024-06-13T02:00:41.019 INFO:teuthology.orchestra.run.smithi002.stdout:(26/160): ceph-common-19.0.0-2946.g3d89accf.el9 1.7 MB/s | 21 MB 00:12 2024-06-13T02:00:41.044 INFO:teuthology.orchestra.run.smithi002.stdout:(27/160): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 269 kB/s | 85 kB 00:00 2024-06-13T02:00:41.094 INFO:teuthology.orchestra.run.smithi084.stdout:(52/160): ceph-test-19.0.0-2946.g3d89accf.el9.x 6.7 MB/s | 48 MB 00:07 2024-06-13T02:00:41.111 INFO:teuthology.orchestra.run.smithi002.stdout:(28/160): ceph-grafana-dashboards-19.0.0-2946.g 478 kB/s | 32 kB 00:00 2024-06-13T02:00:41.136 INFO:teuthology.orchestra.run.smithi002.stdout:(29/160): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 1.4 MB/s | 171 kB 00:00 2024-06-13T02:00:41.236 INFO:teuthology.orchestra.run.smithi002.stdout:(30/160): rbd-mirror-19.0.0-2946.g3d89accf.el9. 6.5 MB/s | 3.1 MB 00:00 2024-06-13T02:00:41.270 INFO:teuthology.orchestra.run.smithi002.stdout:(31/160): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 899 kB/s | 142 kB 00:00 2024-06-13T02:00:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:(32/160): ceph-mgr-modules-core-19.0.0-2946.g3d 1.7 MB/s | 249 kB 00:00 2024-06-13T02:00:41.476 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T02:00:41.476 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-13T02:00:41.487 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-13T02:00:41.488 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-13T02:00:41.488 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-13T02:00:41.490 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-13T02:00:41.491 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-13T02:00:41.493 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-13T02:00:41.494 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-13T02:00:41.495 INFO:teuthology.orchestra.run.smithi002.stdout:(33/160): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 600 kB/s | 49 kB 00:00 2024-06-13T02:00:41.556 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-06-13T02:00:41.569 INFO:teuthology.orchestra.run.smithi084.stdout:(53/160): flexiblas-3.0.4-8.el9.x86_64.rpm 28 kB/s | 33 kB 00:01 2024-06-13T02:00:41.571 INFO:teuthology.orchestra.run.smithi002.stdout:(34/160): ceph-prometheus-alerts-19.0.0-2946.g3 222 kB/s | 16 kB 00:00 2024-06-13T02:00:41.575 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-06-13T02:00:41.575 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-06-13T02:00:41.575 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-06-13T02:00:41.575 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-06-13T02:00:41.575 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-13T02:00:41.575 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 6.6 k 2024-06-13T02:00:41.576 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.4 M 2024-06-13T02:00:41.576 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 890 k 2024-06-13T02:00:41.576 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 145 k 2024-06-13T02:00:41.576 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 1.5 M 2024-06-13T02:00:41.576 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 142 k 2024-06-13T02:00:41.576 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 3.5 M 2024-06-13T02:00:41.576 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 7.4 M 2024-06-13T02:00:41.576 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 49 k 2024-06-13T02:00:41.576 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 10 M 2024-06-13T02:00:41.576 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 48 M 2024-06-13T02:00:41.576 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 264 k 2024-06-13T02:00:41.576 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 763 k 2024-06-13T02:00:41.576 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 221 k 2024-06-13T02:00:41.577 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 27 k 2024-06-13T02:00:41.577 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 18 k 2024-06-13T02:00:41.577 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-13T02:00:41.577 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-13T02:00:41.577 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-13T02:00:41.577 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 32 k 2024-06-13T02:00:41.577 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 747 k 2024-06-13T02:00:41.577 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 127 k 2024-06-13T02:00:41.577 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-13T02:00:41.577 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-13T02:00:41.577 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:3.2.2-1.el9 appstream 4.4 M 2024-06-13T02:00:41.577 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-13T02:00:41.577 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-13T02:00:41.577 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-13T02:00:41.577 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 162 k 2024-06-13T02:00:41.578 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 321 k 2024-06-13T02:00:41.578 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 300 k 2024-06-13T02:00:41.578 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 99 k 2024-06-13T02:00:41.578 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 85 k 2024-06-13T02:00:41.578 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T02:00:41.578 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 171 k 2024-06-13T02:00:41.578 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 6.4.0-1.el9 appstream 95 k 2024-06-13T02:00:41.578 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2024-06-13T02:00:41.578 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-13T02:00:41.578 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-13T02:00:41.578 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-13T02:00:41.578 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-13T02:00:41.578 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-13T02:00:41.579 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-13T02:00:41.579 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-13T02:00:41.579 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.4 M 2024-06-13T02:00:41.579 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 3.1 M 2024-06-13T02:00:41.579 INFO:teuthology.orchestra.run.smithi175.stdout: openssl x86_64 1:3.2.2-1.el9 baseos 1.4 M 2024-06-13T02:00:41.579 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs x86_64 1:3.2.2-1.el9 baseos 2.4 M 2024-06-13T02:00:41.579 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs x86_64 6.4.0-1.el9 baseos 1.1 M 2024-06-13T02:00:41.579 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-06-13T02:00:41.579 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-13T02:00:41.579 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-13T02:00:41.579 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-13T02:00:41.579 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 21 M 2024-06-13T02:00:41.579 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 32 k 2024-06-13T02:00:41.580 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 2.4 M 2024-06-13T02:00:41.580 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 249 k 2024-06-13T02:00:41.580 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 4.7 M 2024-06-13T02:00:41.580 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 17 M 2024-06-13T02:00:41.580 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2946.g3d89accf.el9 ceph-noarch 16 k 2024-06-13T02:00:41.580 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 25 k 2024-06-13T02:00:41.580 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-13T02:00:41.580 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-13T02:00:41.580 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-13T02:00:41.580 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-13T02:00:41.580 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-13T02:00:41.580 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-13T02:00:41.580 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-13T02:00:41.580 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-13T02:00:41.581 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 163 k 2024-06-13T02:00:41.581 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-13T02:00:41.581 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-13T02:00:41.581 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-13T02:00:41.581 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-13T02:00:41.581 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-13T02:00:41.581 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 501 k 2024-06-13T02:00:41.581 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-13T02:00:41.581 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 5.3 M 2024-06-13T02:00:41.581 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-13T02:00:41.581 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-13T02:00:41.581 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-13T02:00:41.581 INFO:teuthology.orchestra.run.smithi175.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-13T02:00:41.581 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-13T02:00:41.582 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-13T02:00:41.582 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-13T02:00:41.582 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-13T02:00:41.582 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-13T02:00:41.582 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-13T02:00:41.582 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-13T02:00:41.582 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-13T02:00:41.582 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-13T02:00:41.582 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-13T02:00:41.582 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-13T02:00:41.582 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-13T02:00:41.582 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-13T02:00:41.583 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 45 k 2024-06-13T02:00:41.583 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:19.0.0-2946.g3d89accf.el9 ceph 135 k 2024-06-13T02:00:41.583 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-13T02:00:41.583 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-13T02:00:41.583 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-13T02:00:41.583 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-13T02:00:41.583 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-13T02:00:41.583 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-13T02:00:41.583 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-13T02:00:41.583 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-13T02:00:41.583 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.29.0-2.el9 epel 205 k 2024-06-13T02:00:41.583 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-13T02:00:41.583 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-13T02:00:41.583 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-13T02:00:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-13T02:00:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-13T02:00:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-13T02:00:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-13T02:00:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-13T02:00:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-13T02:00:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-13T02:00:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-13T02:00:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-13T02:00:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-13T02:00:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-13T02:00:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-13T02:00:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-13T02:00:41.585 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-13T02:00:41.585 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-13T02:00:41.585 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-13T02:00:41.585 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-13T02:00:41.585 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-13T02:00:41.585 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-13T02:00:41.585 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-13T02:00:41.585 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-13T02:00:41.585 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-13T02:00:41.585 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-13T02:00:41.585 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-13T02:00:41.585 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-13T02:00:41.585 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-13T02:00:41.585 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-13T02:00:41.585 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-13T02:00:41.586 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-13T02:00:41.586 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-13T02:00:41.586 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-13T02:00:41.586 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-13T02:00:41.586 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-13T02:00:41.586 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-13T02:00:41.586 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-13T02:00:41.586 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-13T02:00:41.586 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-13T02:00:41.586 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-13T02:00:41.586 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-13T02:00:41.586 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-13T02:00:41.586 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-13T02:00:41.587 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-13T02:00:41.587 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-13T02:00:41.587 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-13T02:00:41.587 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-13T02:00:41.587 INFO:teuthology.orchestra.run.smithi175.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-13T02:00:41.587 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-06-13T02:00:41.587 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-13T02:00:41.587 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-13T02:00:41.587 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-13T02:00:41.587 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-13T02:00:41.587 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2024-06-13T02:00:41.587 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-13T02:00:41.587 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:00:41.587 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-06-13T02:00:41.588 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-06-13T02:00:41.588 INFO:teuthology.orchestra.run.smithi175.stdout:Install 148 Packages 2024-06-13T02:00:41.588 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 12 Packages 2024-06-13T02:00:41.588 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:00:41.588 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 226 M 2024-06-13T02:00:41.588 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-06-13T02:00:41.704 INFO:teuthology.orchestra.run.smithi002.stdout:(35/160): ceph-volume-19.0.0-2946.g3d89accf.el9 2.0 MB/s | 264 kB 00:00 2024-06-13T02:00:41.711 INFO:teuthology.orchestra.run.smithi084.stdout:(54/160): flex-2.6.4-9.el9.x86_64.rpm 228 kB/s | 313 kB 00:01 2024-06-13T02:00:41.896 INFO:teuthology.orchestra.run.smithi002.stdout:(36/160): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-06-13T02:00:42.005 INFO:teuthology.orchestra.run.smithi002.stdout:(37/160): ceph-mgr-dashboard-19.0.0-2946.g3d89a 4.0 MB/s | 3.5 MB 00:00 2024-06-13T02:00:42.030 INFO:teuthology.orchestra.run.smithi002.stdout:(38/160): cephfs-top-19.0.0-2946.g3d89accf.el9. 137 kB/s | 18 kB 00:00 2024-06-13T02:00:42.153 INFO:teuthology.orchestra.run.smithi084.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 31 kB/s | 18 kB 00:00 2024-06-13T02:00:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:(39/160): cephadm-19.0.0-2946.g3d89accf.el9.noa 1.5 MB/s | 763 kB 00:00 2024-06-13T02:00:42.202 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:42.204 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:42.278 INFO:teuthology.orchestra.run.smithi084.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 20 kB/s | 11 kB 00:00 2024-06-13T02:00:42.347 INFO:teuthology.orchestra.run.smithi002.stdout:(40/160): fuse-2.9.9-15.el9.x86_64.rpm 235 kB/s | 80 kB 00:00 2024-06-13T02:00:42.362 INFO:teuthology.orchestra.run.smithi084.stdout:(57/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.4 MB/s | 3.0 MB 00:01 2024-06-13T02:00:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:(41/160): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-06-13T02:00:42.448 INFO:teuthology.orchestra.run.smithi002.stdout:(42/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-06-13T02:00:42.498 INFO:teuthology.orchestra.run.smithi002.stdout:(43/160): libgfortran-11.4.1-3.el9.x86_64.rpm 1.7 MB/s | 803 kB 00:00 2024-06-13T02:00:42.532 INFO:teuthology.orchestra.run.smithi002.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-06-13T02:00:42.565 INFO:teuthology.orchestra.run.smithi002.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-06-13T02:00:42.599 INFO:teuthology.orchestra.run.smithi002.stdout:(46/160): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-06-13T02:00:42.602 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-13T02:00:42.649 INFO:teuthology.orchestra.run.smithi002.stdout:(47/160): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-06-13T02:00:42.653 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:42.700 INFO:teuthology.orchestra.run.smithi002.stdout:(48/160): python3-cryptography-36.0.1-4.el9.x86 3.9 MB/s | 1.2 MB 00:00 2024-06-13T02:00:42.704 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:(49/160): boost-program-options-1.75.0-8.el9.x8 586 kB/s | 107 kB 00:00 2024-06-13T02:00:42.917 INFO:teuthology.orchestra.run.smithi002.stdout:(50/160): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-06-13T02:00:42.942 INFO:teuthology.orchestra.run.smithi002.stdout:(51/160): elfutils-libelf-devel-0.191-4.el9.x86 375 kB/s | 22 kB 00:00 2024-06-13T02:00:42.953 INFO:teuthology.orchestra.run.smithi175.stdout:(1/160): ceph-19.0.0-2946.g3d89accf.el9.x86_64. 12 kB/s | 6.6 kB 00:00 2024-06-13T02:00:42.984 INFO:teuthology.orchestra.run.smithi002.stdout:(52/160): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-06-13T02:00:43.001 INFO:teuthology.orchestra.run.smithi002.stdout:(53/160): flexiblas-3.0.4-8.el9.x86_64.rpm 564 kB/s | 33 kB 00:00 2024-06-13T02:00:43.028 INFO:teuthology.orchestra.run.smithi084.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 60 kB/s | 45 kB 00:00 2024-06-13T02:00:43.035 INFO:teuthology.orchestra.run.smithi002.stdout:(54/160): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-06-13T02:00:43.051 INFO:teuthology.orchestra.run.smithi002.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 367 kB/s | 18 kB 00:00 2024-06-13T02:00:43.085 INFO:teuthology.orchestra.run.smithi002.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 226 kB/s | 11 kB 00:00 2024-06-13T02:00:43.112 INFO:teuthology.orchestra.run.smithi084.stdout:(59/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 167 kB/s | 160 kB 00:00 2024-06-13T02:00:43.119 INFO:teuthology.orchestra.run.smithi002.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-06-13T02:00:43.136 INFO:teuthology.orchestra.run.smithi002.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 914 kB/s | 45 kB 00:00 2024-06-13T02:00:43.228 INFO:teuthology.orchestra.run.smithi002.stdout:(59/160): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-06-13T02:00:43.261 INFO:teuthology.orchestra.run.smithi002.stdout:(60/160): libtool-2.4.6-45.el9.x86_64.rpm 4.6 MB/s | 582 kB 00:00 2024-06-13T02:00:43.287 INFO:teuthology.orchestra.run.smithi002.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 439 kB/s | 25 kB 00:00 2024-06-13T02:00:43.320 INFO:teuthology.orchestra.run.smithi002.stdout:(62/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 822 kB/s | 47 kB 00:00 2024-06-13T02:00:43.354 INFO:teuthology.orchestra.run.smithi175.stdout:(2/160): ceph-base-19.0.0-2946.g3d89accf.el9.x8 5.7 MB/s | 5.4 MB 00:00 2024-06-13T02:00:43.354 INFO:teuthology.orchestra.run.smithi002.stdout:(63/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-06-13T02:00:43.421 INFO:teuthology.orchestra.run.smithi175.stdout:(3/160): ceph-immutable-object-cache-19.0.0-294 2.1 MB/s | 145 kB 00:00 2024-06-13T02:00:43.429 INFO:teuthology.orchestra.run.smithi002.stdout:(64/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.7 MB/s | 3.0 MB 00:00 2024-06-13T02:00:43.446 INFO:teuthology.orchestra.run.smithi084.stdout:(60/160): librdkafka-1.6.1-102.el9.x86_64.rpm 611 kB/s | 662 kB 00:01 2024-06-13T02:00:43.455 INFO:teuthology.orchestra.run.smithi002.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 353 kB/s | 35 kB 00:00 2024-06-13T02:00:43.480 INFO:teuthology.orchestra.run.smithi002.stdout:(66/160): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-06-13T02:00:43.655 INFO:teuthology.orchestra.run.smithi002.stdout:(67/160): postgresql-13.14-1.el9.x86_64.rpm 9.1 MB/s | 1.6 MB 00:00 2024-06-13T02:00:43.671 INFO:teuthology.orchestra.run.smithi175.stdout:(4/160): ceph-mds-19.0.0-2946.g3d89accf.el9.x86 9.5 MB/s | 2.4 MB 00:00 2024-06-13T02:00:43.796 INFO:teuthology.orchestra.run.smithi084.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 37 kB/s | 25 kB 00:00 2024-06-13T02:00:43.805 INFO:teuthology.orchestra.run.smithi002.stdout:(68/160): postgresql-contrib-13.14-1.el9.x86_64 6.0 MB/s | 911 kB 00:00 2024-06-13T02:00:43.872 INFO:teuthology.orchestra.run.smithi002.stdout:(69/160): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-06-13T02:00:43.888 INFO:teuthology.orchestra.run.smithi175.stdout:(5/160): ceph-mgr-19.0.0-2946.g3d89accf.el9.x86 6.9 MB/s | 1.5 MB 00:00 2024-06-13T02:00:43.973 INFO:teuthology.orchestra.run.smithi002.stdout:(70/160): openssl-devel-3.2.2-1.el9.x86_64.rpm 8.6 MB/s | 4.4 MB 00:00 2024-06-13T02:00:44.046 INFO:teuthology.orchestra.run.smithi084.stdout:(62/160): libtool-2.4.6-45.el9.x86_64.rpm 573 kB/s | 582 kB 00:01 2024-06-13T02:00:44.081 INFO:teuthology.orchestra.run.smithi002.stdout:(71/160): openblas-openmp-0.3.21-2.el9.x86_64.r 7.3 MB/s | 4.7 MB 00:00 2024-06-13T02:00:44.154 INFO:teuthology.orchestra.run.smithi084.stdout:(63/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 67 kB/s | 47 kB 00:00 2024-06-13T02:00:44.156 INFO:teuthology.orchestra.run.smithi002.stdout:(72/160): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-06-13T02:00:44.182 INFO:teuthology.orchestra.run.smithi002.stdout:(73/160): python3-attrs-20.3.0-7.el9.noarch.rpm 880 kB/s | 87 kB 00:00 2024-06-13T02:00:44.188 INFO:teuthology.orchestra.run.smithi175.stdout:(6/160): ceph-common-19.0.0-2946.g3d89accf.el9. 12 MB/s | 21 MB 00:01 2024-06-13T02:00:44.241 INFO:teuthology.orchestra.run.smithi002.stdout:(74/160): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-06-13T02:00:44.263 INFO:teuthology.orchestra.run.smithi175.stdout:(7/160): ceph-fuse-19.0.0-2946.g3d89accf.el9.x8 679 kB/s | 890 kB 00:01 2024-06-13T02:00:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:(75/160): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-06-13T02:00:44.375 INFO:teuthology.orchestra.run.smithi002.stdout:(76/160): python3-jinja2-2.11.3-6.el9.noarch.rp 3.7 MB/s | 248 kB 00:00 2024-06-13T02:00:44.433 INFO:teuthology.orchestra.run.smithi002.stdout:(77/160): python3-jsonpatch-1.21-16.el9.noarch. 446 kB/s | 26 kB 00:00 2024-06-13T02:00:44.492 INFO:teuthology.orchestra.run.smithi002.stdout:(78/160): python3-jsonpointer-2.0-4.el9.noarch. 333 kB/s | 19 kB 00:00 2024-06-13T02:00:44.600 INFO:teuthology.orchestra.run.smithi002.stdout:(79/160): postgresql-server-13.14-1.el9.x86_64. 7.9 MB/s | 5.8 MB 00:00 2024-06-13T02:00:44.634 INFO:teuthology.orchestra.run.smithi002.stdout:(80/160): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-06-13T02:00:44.659 INFO:teuthology.orchestra.run.smithi002.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 603 kB/s | 35 kB 00:00 2024-06-13T02:00:44.726 INFO:teuthology.orchestra.run.smithi002.stdout:(82/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-06-13T02:00:44.746 INFO:teuthology.orchestra.run.smithi084.stdout:(64/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 308 kB/s | 292 kB 00:00 2024-06-13T02:00:44.830 INFO:teuthology.orchestra.run.smithi084.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 52 kB/s | 35 kB 00:00 2024-06-13T02:00:44.843 INFO:teuthology.orchestra.run.smithi002.stdout:(83/160): python3-babel-2.9.1-2.el9.noarch.rpm 8.7 MB/s | 6.0 MB 00:00 2024-06-13T02:00:44.877 INFO:teuthology.orchestra.run.smithi002.stdout:(84/160): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-06-13T02:00:44.888 INFO:teuthology.orchestra.run.smithi175.stdout:(8/160): ceph-mon-19.0.0-2946.g3d89accf.el9.x86 4.7 MB/s | 4.7 MB 00:01 2024-06-13T02:00:44.902 INFO:teuthology.orchestra.run.smithi002.stdout:(85/160): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-06-13T02:00:44.947 INFO:teuthology.orchestra.run.smithi175.stdout:(9/160): ceph-selinux-19.0.0-2946.g3d89accf.el9 432 kB/s | 25 kB 00:00 2024-06-13T02:00:44.964 INFO:teuthology.orchestra.run.smithi084.stdout:(66/160): lua-5.4.4-4.el9.x86_64.rpm 212 kB/s | 188 kB 00:00 2024-06-13T02:00:44.969 INFO:teuthology.orchestra.run.smithi002.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 463 kB/s | 42 kB 00:00 2024-06-13T02:00:45.003 INFO:teuthology.orchestra.run.smithi002.stdout:(87/160): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-06-13T02:00:45.036 INFO:teuthology.orchestra.run.smithi002.stdout:(88/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-06-13T02:00:45.078 INFO:teuthology.orchestra.run.smithi002.stdout:(89/160): python3-pyasn1-modules-0.4.8-6.el9.no 3.7 MB/s | 279 kB 00:00 2024-06-13T02:00:45.095 INFO:teuthology.orchestra.run.smithi002.stdout:(90/160): python3-pytz-2021.1-5.el9.noarch.rpm 880 kB/s | 51 kB 00:00 2024-06-13T02:00:45.114 INFO:teuthology.orchestra.run.smithi175.stdout:(10/160): ceph-osd-19.0.0-2946.g3d89accf.el9.x8 18 MB/s | 17 MB 00:00 2024-06-13T02:00:45.129 INFO:teuthology.orchestra.run.smithi002.stdout:(91/160): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-06-13T02:00:45.172 INFO:teuthology.orchestra.run.smithi175.stdout:(11/160): cephfs-mirror-19.0.0-2946.g3d89accf.e 3.7 MB/s | 221 kB 00:00 2024-06-13T02:00:45.179 INFO:teuthology.orchestra.run.smithi002.stdout:(92/160): python3-toml-0.10.2-6.el9.noarch.rpm 848 kB/s | 42 kB 00:00 2024-06-13T02:00:45.214 INFO:teuthology.orchestra.run.smithi175.stdout:(12/160): cephfs-shell-19.0.0-2946.g3d89accf.el 651 kB/s | 27 kB 00:00 2024-06-13T02:00:45.229 INFO:teuthology.orchestra.run.smithi002.stdout:(93/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 900 kB/s | 44 kB 00:00 2024-06-13T02:00:45.248 INFO:teuthology.orchestra.run.smithi175.stdout:(13/160): libcephfs-devel-19.0.0-2946.g3d89accf 948 kB/s | 32 kB 00:00 2024-06-13T02:00:45.315 INFO:teuthology.orchestra.run.smithi175.stdout:(14/160): libcephfs2-19.0.0-2946.g3d89accf.el9. 11 MB/s | 747 kB 00:00 2024-06-13T02:00:45.330 INFO:teuthology.orchestra.run.smithi002.stdout:(94/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.3 MB/s | 5.1 MB 00:00 2024-06-13T02:00:45.363 INFO:teuthology.orchestra.run.smithi002.stdout:(95/160): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-06-13T02:00:45.365 INFO:teuthology.orchestra.run.smithi175.stdout:(15/160): libcephsqlite-19.0.0-2946.g3d89accf.e 3.2 MB/s | 163 kB 00:00 2024-06-13T02:00:45.389 INFO:teuthology.orchestra.run.smithi002.stdout:(96/160): qatlib-service-24.02.0-1.el9.x86_64.r 622 kB/s | 36 kB 00:00 2024-06-13T02:00:45.422 INFO:teuthology.orchestra.run.smithi002.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 822 kB/s | 47 kB 00:00 2024-06-13T02:00:45.423 INFO:teuthology.orchestra.run.smithi175.stdout:(16/160): librados-devel-19.0.0-2946.g3d89accf. 2.1 MB/s | 127 kB 00:00 2024-06-13T02:00:45.464 INFO:teuthology.orchestra.run.smithi002.stdout:(98/160): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-06-13T02:00:45.489 INFO:teuthology.orchestra.run.smithi002.stdout:(99/160): uuid-1.6.2-55.el9.x86_64.rpm 876 kB/s | 58 kB 00:00 2024-06-13T02:00:45.499 INFO:teuthology.orchestra.run.smithi175.stdout:(17/160): libradosstriper1-19.0.0-2946.g3d89acc 6.5 MB/s | 501 kB 00:00 2024-06-13T02:00:45.523 INFO:teuthology.orchestra.run.smithi002.stdout:(100/160): xfsprogs-devel-6.4.0-1.el9.x86_64.rp 1.6 MB/s | 95 kB 00:00 2024-06-13T02:00:45.548 INFO:teuthology.orchestra.run.smithi002.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-06-13T02:00:45.552 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:45.582 INFO:teuthology.orchestra.run.smithi002.stdout:(102/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 777 kB/s | 45 kB 00:00 2024-06-13T02:00:45.584 INFO:teuthology.orchestra.run.smithi002.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:45.616 INFO:teuthology.orchestra.run.smithi002.stdout:(103/160): lua-devel-5.4.4-4.el9.x86_64.rpm 335 kB/s | 22 kB 00:00 2024-06-13T02:00:45.683 INFO:teuthology.orchestra.run.smithi002.stdout:(104/160): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-06-13T02:00:45.741 INFO:teuthology.orchestra.run.smithi002.stdout:(105/160): gperftools-libs-2.9.1-2.el9.x86_64.r 5.3 MB/s | 309 kB 00:00 2024-06-13T02:00:45.783 INFO:teuthology.orchestra.run.smithi002.stdout:(106/160): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-06-13T02:00:45.809 INFO:teuthology.orchestra.run.smithi002.stdout:(107/160): grpc-data-1.46.7-10.el9.noarch.rpm 294 kB/s | 19 kB 00:00 2024-06-13T02:00:45.842 INFO:teuthology.orchestra.run.smithi002.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 803 kB/s | 26 kB 00:00 2024-06-13T02:00:45.849 INFO:teuthology.orchestra.run.smithi175.stdout:(18/160): librgw2-19.0.0-2946.g3d89accf.el9.x86 15 MB/s | 5.3 MB 00:00 2024-06-13T02:00:45.876 INFO:teuthology.orchestra.run.smithi002.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-06-13T02:00:45.899 INFO:teuthology.orchestra.run.smithi175.stdout:(19/160): python3-ceph-argparse-19.0.0-2946.g3d 908 kB/s | 45 kB 00:00 2024-06-13T02:00:45.901 INFO:teuthology.orchestra.run.smithi002.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-06-13T02:00:45.943 INFO:teuthology.orchestra.run.smithi002.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-06-13T02:00:45.958 INFO:teuthology.orchestra.run.smithi175.stdout:(20/160): python3-ceph-common-19.0.0-2946.g3d89 2.3 MB/s | 135 kB 00:00 2024-06-13T02:00:46.017 INFO:teuthology.orchestra.run.smithi175.stdout:(21/160): python3-cephfs-19.0.0-2946.g3d89accf. 2.7 MB/s | 162 kB 00:00 2024-06-13T02:00:46.052 INFO:teuthology.orchestra.run.smithi002.stdout:(112/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 839 kB 00:00 2024-06-13T02:00:46.083 INFO:teuthology.orchestra.run.smithi175.stdout:(22/160): python3-rados-19.0.0-2946.g3d89accf.e 4.7 MB/s | 321 kB 00:00 2024-06-13T02:00:46.135 INFO:teuthology.orchestra.run.smithi002.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 6.5 MB/s | 548 kB 00:00 2024-06-13T02:00:46.150 INFO:teuthology.orchestra.run.smithi175.stdout:(23/160): python3-rbd-19.0.0-2946.g3d89accf.el9 4.4 MB/s | 300 kB 00:00 2024-06-13T02:00:46.169 INFO:teuthology.orchestra.run.smithi002.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-06-13T02:00:46.203 INFO:teuthology.orchestra.run.smithi002.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 991 kB/s | 32 kB 00:00 2024-06-13T02:00:46.209 INFO:teuthology.orchestra.run.smithi175.stdout:(24/160): python3-rgw-19.0.0-2946.g3d89accf.el9 1.7 MB/s | 99 kB 00:00 2024-06-13T02:00:46.228 INFO:teuthology.orchestra.run.smithi002.stdout:(116/160): python3-certifi-2021.10.8-2.el9.noar 621 kB/s | 15 kB 00:00 2024-06-13T02:00:46.268 INFO:teuthology.orchestra.run.smithi175.stdout:(25/160): rbd-fuse-19.0.0-2946.g3d89accf.el9.x8 1.4 MB/s | 85 kB 00:00 2024-06-13T02:00:46.270 INFO:teuthology.orchestra.run.smithi002.stdout:(117/160): python3-cheroot-8.6.0-4.el9.noarch.r 4.1 MB/s | 172 kB 00:00 2024-06-13T02:00:46.320 INFO:teuthology.orchestra.run.smithi002.stdout:(118/160): python3-cherrypy-18.6.1-2.el9.noarch 7.1 MB/s | 358 kB 00:00 2024-06-13T02:00:46.370 INFO:teuthology.orchestra.run.smithi002.stdout:(119/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 6.0 MB/s | 303 kB 00:00 2024-06-13T02:00:46.372 INFO:teuthology.orchestra.run.smithi084.stdout:(67/160): openblas-openmp-0.3.21-2.el9.x86_64.r 2.9 MB/s | 4.7 MB 00:01 2024-06-13T02:00:46.421 INFO:teuthology.orchestra.run.smithi002.stdout:(120/160): python3-google-auth-2.29.0-2.el9.noa 4.0 MB/s | 205 kB 00:00 2024-06-13T02:00:46.422 INFO:teuthology.orchestra.run.smithi084.stdout:(68/160): postgresql-13.14-1.el9.x86_64.rpm 1.1 MB/s | 1.6 MB 00:01 2024-06-13T02:00:46.490 INFO:teuthology.orchestra.run.smithi084.stdout:(69/160): openssl-devel-3.2.2-1.el9.x86_64.rpm 2.7 MB/s | 4.4 MB 00:01 2024-06-13T02:00:46.509 INFO:teuthology.orchestra.run.smithi175.stdout:(26/160): rbd-mirror-19.0.0-2946.g3d89accf.el9. 13 MB/s | 3.1 MB 00:00 2024-06-13T02:00:46.521 INFO:teuthology.orchestra.run.smithi002.stdout:(121/160): libarrow-9.0.0-11.el9.x86_64.rpm 6.0 MB/s | 4.4 MB 00:00 2024-06-13T02:00:46.563 INFO:teuthology.orchestra.run.smithi002.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 3.5 MB/s | 144 kB 00:00 2024-06-13T02:00:46.568 INFO:teuthology.orchestra.run.smithi175.stdout:(27/160): rbd-nbd-19.0.0-2946.g3d89accf.el9.x86 2.9 MB/s | 171 kB 00:00 2024-06-13T02:00:46.588 INFO:teuthology.orchestra.run.smithi002.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 445 kB/s | 11 kB 00:00 2024-06-13T02:00:46.614 INFO:teuthology.orchestra.run.smithi002.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 733 kB/s | 18 kB 00:00 2024-06-13T02:00:46.627 INFO:teuthology.orchestra.run.smithi175.stdout:(28/160): ceph-grafana-dashboards-19.0.0-2946.g 544 kB/s | 32 kB 00:00 2024-06-13T02:00:46.647 INFO:teuthology.orchestra.run.smithi002.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 714 kB/s | 23 kB 00:00 2024-06-13T02:00:46.673 INFO:teuthology.orchestra.run.smithi002.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 807 kB/s | 19 kB 00:00 2024-06-13T02:00:46.686 INFO:teuthology.orchestra.run.smithi175.stdout:(29/160): ceph-mgr-cephadm-19.0.0-2946.g3d89acc 2.4 MB/s | 142 kB 00:00 2024-06-13T02:00:46.698 INFO:teuthology.orchestra.run.smithi002.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 814 kB/s | 20 kB 00:00 2024-06-13T02:00:46.840 INFO:teuthology.orchestra.run.smithi002.stdout:(128/160): python3-grpcio-1.46.7-10.el9.x86_64. 4.9 MB/s | 2.0 MB 00:00 2024-06-13T02:00:46.873 INFO:teuthology.orchestra.run.smithi002.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-06-13T02:00:46.986 INFO:teuthology.orchestra.run.smithi175.stdout:(30/160): ceph-mgr-dashboard-19.0.0-2946.g3d89a 12 MB/s | 3.5 MB 00:00 2024-06-13T02:00:47.016 INFO:teuthology.orchestra.run.smithi002.stdout:(130/160): python3-kubernetes-26.1.0-2.el9.noar 3.2 MB/s | 1.0 MB 00:00 2024-06-13T02:00:47.049 INFO:teuthology.orchestra.run.smithi002.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 1.8 MB/s | 58 kB 00:00 2024-06-13T02:00:47.075 INFO:teuthology.orchestra.run.smithi002.stdout:(132/160): python3-more-itertools-8.12.0-2.el9. 394 kB/s | 79 kB 00:00 2024-06-13T02:00:47.094 INFO:teuthology.orchestra.run.smithi175.stdout:(31/160): ceph-radosgw-19.0.0-2946.g3d89accf.el 3.6 MB/s | 10 MB 00:02 2024-06-13T02:00:47.128 INFO:teuthology.orchestra.run.smithi002.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 317 kB/s | 16 kB 00:00 2024-06-13T02:00:47.167 INFO:teuthology.orchestra.run.smithi002.stdout:(134/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.3 MB/s | 90 kB 00:00 2024-06-13T02:00:47.200 INFO:teuthology.orchestra.run.smithi002.stdout:(135/160): python3-pyperclip-1.8.2-2.el9.noarch 872 kB/s | 28 kB 00:00 2024-06-13T02:00:47.211 INFO:teuthology.orchestra.run.smithi175.stdout:(32/160): ceph-mgr-modules-core-19.0.0-2946.g3d 2.1 MB/s | 249 kB 00:00 2024-06-13T02:00:47.234 INFO:teuthology.orchestra.run.smithi002.stdout:(136/160): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-06-13T02:00:47.259 INFO:teuthology.orchestra.run.smithi002.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 532 kB/s | 31 kB 00:00 2024-06-13T02:00:47.293 INFO:teuthology.orchestra.run.smithi002.stdout:(138/160): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2024-06-13T02:00:47.327 INFO:teuthology.orchestra.run.smithi002.stdout:(139/160): python3-tempora-5.0.0-2.el9.noarch.r 1.1 MB/s | 36 kB 00:00 2024-06-13T02:00:47.328 INFO:teuthology.orchestra.run.smithi175.stdout:(33/160): ceph-mgr-rook-19.0.0-2946.g3d89accf.e 423 kB/s | 49 kB 00:00 2024-06-13T02:00:47.340 INFO:teuthology.orchestra.run.smithi084.stdout:(70/160): postgresql-private-libs-13.14-1.el9.x 145 kB/s | 133 kB 00:00 2024-06-13T02:00:47.352 INFO:teuthology.orchestra.run.smithi002.stdout:(140/160): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-06-13T02:00:47.377 INFO:teuthology.orchestra.run.smithi002.stdout:(141/160): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-06-13T02:00:47.411 INFO:teuthology.orchestra.run.smithi002.stdout:(142/160): python3-websocket-client-1.2.3-2.el9 2.7 MB/s | 90 kB 00:00 2024-06-13T02:00:47.444 INFO:teuthology.orchestra.run.smithi002.stdout:(143/160): python3-webob-1.8.7-6.el9.noarch.rpm 2.5 MB/s | 230 kB 00:00 2024-06-13T02:00:47.445 INFO:teuthology.orchestra.run.smithi175.stdout:(34/160): ceph-mgr-diskprediction-local-19.0.0- 16 MB/s | 7.4 MB 00:00 2024-06-13T02:00:47.470 INFO:teuthology.orchestra.run.smithi002.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 822 kB/s | 20 kB 00:00 2024-06-13T02:00:47.470 INFO:teuthology.orchestra.run.smithi175.stdout:(35/160): ceph-prometheus-alerts-19.0.0-2946.g3 116 kB/s | 16 kB 00:00 2024-06-13T02:00:47.512 INFO:teuthology.orchestra.run.smithi002.stdout:(145/160): re2-20211101-3.el9.x86_64.rpm 4.6 MB/s | 192 kB 00:00 2024-06-13T02:00:47.512 INFO:teuthology.orchestra.run.smithi175.stdout:(36/160): ceph-volume-19.0.0-2946.g3d89accf.el9 3.9 MB/s | 264 kB 00:00 2024-06-13T02:00:47.545 INFO:teuthology.orchestra.run.smithi002.stdout:(146/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-06-13T02:00:47.548 INFO:teuthology.orchestra.run.smithi084.stdout:(71/160): postgresql-contrib-13.14-1.el9.x86_64 775 kB/s | 911 kB 00:01 2024-06-13T02:00:47.571 INFO:teuthology.orchestra.run.smithi175.stdout:(37/160): cephfs-top-19.0.0-2946.g3d89accf.el9. 313 kB/s | 18 kB 00:00 2024-06-13T02:00:47.596 INFO:teuthology.orchestra.run.smithi175.stdout:(38/160): cephadm-19.0.0-2946.g3d89accf.el9.noa 5.9 MB/s | 763 kB 00:00 2024-06-13T02:00:47.653 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:47.659 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:47.771 INFO:teuthology.orchestra.run.smithi002.stdout:(147/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.1 MB/s | 16 MB 00:02 2024-06-13T02:00:47.838 INFO:teuthology.orchestra.run.smithi175.stdout:(39/160): fuse-2.9.9-15.el9.x86_64.rpm 301 kB/s | 80 kB 00:00 2024-06-13T02:00:47.840 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:47.846 INFO:teuthology.orchestra.run.smithi002.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 4.7 MB/s | 1.6 MB 00:00 2024-06-13T02:00:47.964 INFO:teuthology.orchestra.run.smithi175.stdout:(40/160): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-06-13T02:00:47.982 INFO:teuthology.orchestra.run.smithi084.stdout:(72/160): postgresql-server-13.14-1.el9.x86_64. 3.9 MB/s | 5.8 MB 00:01 2024-06-13T02:00:47.989 INFO:teuthology.orchestra.run.smithi175.stdout:(41/160): libgfortran-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 803 kB 00:00 2024-06-13T02:00:48.056 INFO:teuthology.orchestra.run.smithi175.stdout:(42/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-06-13T02:00:48.138 INFO:teuthology.orchestra.run.smithi002.stdout:(149/160): NetworkManager-1.47.91-1.el9.x86_64. 7.9 MB/s | 2.3 MB 00:00 2024-06-13T02:00:48.139 INFO:teuthology.orchestra.run.smithi175.stdout:(43/160): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-06-13T02:00:48.206 INFO:teuthology.orchestra.run.smithi175.stdout:(44/160): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-06-13T02:00:48.238 INFO:teuthology.orchestra.run.smithi002.stdout:(150/160): NetworkManager-libnm-1.47.91-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-06-13T02:00:48.256 INFO:teuthology.orchestra.run.smithi175.stdout:(45/160): python3-cryptography-36.0.1-4.el9.x86 4.6 MB/s | 1.2 MB 00:00 2024-06-13T02:00:48.282 INFO:teuthology.orchestra.run.smithi175.stdout:(46/160): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-06-13T02:00:48.284 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-13T02:00:48.313 INFO:teuthology.orchestra.run.smithi002.stdout:(151/160): librbd1-19.0.0-2946.g3d89accf.el9.x8 5.8 MB/s | 3.1 MB 00:00 2024-06-13T02:00:48.339 INFO:teuthology.orchestra.run.smithi002.stdout:(152/160): NetworkManager-team-1.47.91-1.el9.x8 416 kB/s | 41 kB 00:00 2024-06-13T02:00:48.374 INFO:teuthology.orchestra.run.smithi175.stdout:(47/160): python3-urllib3-1.26.5-5.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-06-13T02:00:48.375 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:48.390 INFO:teuthology.orchestra.run.smithi002.stdout:(153/160): elfutils-debuginfod-client-0.191-4.e 746 kB/s | 37 kB 00:00 2024-06-13T02:00:48.440 INFO:teuthology.orchestra.run.smithi084.stdout:(73/160): python3-attrs-20.3.0-7.el9.noarch.rpm 98 kB/s | 87 kB 00:00 2024-06-13T02:00:48.448 INFO:teuthology.orchestra.run.smithi002.stdout:(154/160): elfutils-libelf-0.191-4.el9.x86_64.r 3.5 MB/s | 207 kB 00:00 2024-06-13T02:00:48.474 INFO:teuthology.orchestra.run.smithi175.stdout:(48/160): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-06-13T02:00:48.475 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:48.482 INFO:teuthology.orchestra.run.smithi084.stdout:(74/160): protobuf-3.14.0-13.el9.x86_64.rpm 905 kB/s | 1.0 MB 00:01 2024-06-13T02:00:48.506 INFO:teuthology.orchestra.run.smithi002.stdout:(155/160): elfutils-libs-0.191-4.el9.x86_64.rpm 4.4 MB/s | 260 kB 00:00 2024-06-13T02:00:48.516 INFO:teuthology.orchestra.run.smithi175.stdout:(49/160): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-06-13T02:00:48.540 INFO:teuthology.orchestra.run.smithi002.stdout:(156/160): NetworkManager-tui-1.47.91-1.el9.x86 1.1 MB/s | 248 kB 00:00 2024-06-13T02:00:48.607 INFO:teuthology.orchestra.run.smithi002.stdout:(157/160): openssl-3.2.2-1.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-06-13T02:00:48.690 INFO:teuthology.orchestra.run.smithi002.stdout:(158/160): librados2-19.0.0-2946.g3d89accf.el9. 3.0 MB/s | 3.4 MB 00:01 2024-06-13T02:00:48.766 INFO:teuthology.orchestra.run.smithi002.stdout:(159/160): xfsprogs-6.4.0-1.el9.x86_64.rpm 6.9 MB/s | 1.1 MB 00:00 2024-06-13T02:00:48.841 INFO:teuthology.orchestra.run.smithi002.stdout:(160/160): openssl-libs-3.2.2-1.el9.x86_64.rpm 8.0 MB/s | 2.4 MB 00:00 2024-06-13T02:00:48.852 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-06-13T02:00:48.853 INFO:teuthology.orchestra.run.smithi002.stdout:Total 11 MB/s | 226 MB 00:20 2024-06-13T02:00:48.950 INFO:teuthology.orchestra.run.smithi175.stdout:(50/160): ceph-test-19.0.0-2946.g3d89accf.el9.x 12 MB/s | 48 MB 00:04 2024-06-13T02:00:48.975 INFO:teuthology.orchestra.run.smithi175.stdout:(51/160): elfutils-libelf-devel-0.191-4.el9.x86 47 kB/s | 22 kB 00:00 2024-06-13T02:00:49.009 INFO:teuthology.orchestra.run.smithi175.stdout:(52/160): bison-3.7.4-5.el9.x86_64.rpm 1.5 MB/s | 943 kB 00:00 2024-06-13T02:00:49.034 INFO:teuthology.orchestra.run.smithi175.stdout:(53/160): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-06-13T02:00:49.084 INFO:teuthology.orchestra.run.smithi175.stdout:(54/160): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-06-13T02:00:49.143 INFO:teuthology.orchestra.run.smithi175.stdout:(55/160): libaio-devel-0.3.111-13.el9.x86_64.rp 192 kB/s | 11 kB 00:00 2024-06-13T02:00:49.168 INFO:teuthology.orchestra.run.smithi175.stdout:(56/160): flex-2.6.4-9.el9.x86_64.rpm 1.4 MB/s | 313 kB 00:00 2024-06-13T02:00:49.201 INFO:teuthology.orchestra.run.smithi175.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-06-13T02:00:49.216 INFO:teuthology.orchestra.run.smithi084.stdout:(75/160): python3-colorama-0.4.6-3.el9.noarch.r 79 kB/s | 61 kB 00:00 2024-06-13T02:00:49.235 INFO:teuthology.orchestra.run.smithi175.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 675 kB/s | 45 kB 00:00 2024-06-13T02:00:49.327 INFO:teuthology.orchestra.run.smithi175.stdout:(59/160): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-06-13T02:00:49.361 INFO:teuthology.orchestra.run.smithi175.stdout:(60/160): libtool-2.4.6-45.el9.x86_64.rpm 4.5 MB/s | 582 kB 00:00 2024-06-13T02:00:49.386 INFO:teuthology.orchestra.run.smithi175.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 433 kB/s | 25 kB 00:00 2024-06-13T02:00:49.411 INFO:teuthology.orchestra.run.smithi175.stdout:(62/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-06-13T02:00:49.445 INFO:teuthology.orchestra.run.smithi175.stdout:(63/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-06-13T02:00:49.470 INFO:teuthology.orchestra.run.smithi175.stdout:(64/160): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-06-13T02:00:49.483 INFO:teuthology.orchestra.run.smithi084.stdout:(76/160): python3-babel-2.9.1-2.el9.noarch.rpm 4.0 MB/s | 6.0 MB 00:01 2024-06-13T02:00:49.496 INFO:teuthology.orchestra.run.smithi175.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 702 kB/s | 35 kB 00:00 2024-06-13T02:00:49.508 INFO:teuthology.orchestra.run.smithi084.stdout:(77/160): python3-devel-3.9.18-3.el9.x86_64.rpm 238 kB/s | 244 kB 00:01 2024-06-13T02:00:49.713 INFO:teuthology.orchestra.run.smithi175.stdout:(66/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.2 MB/s | 3.0 MB 00:00 2024-06-13T02:00:50.191 INFO:teuthology.orchestra.run.smithi084.stdout:(78/160): python3-jsonpointer-2.0-4.el9.noarch. 29 kB/s | 19 kB 00:00 2024-06-13T02:00:50.217 INFO:teuthology.orchestra.run.smithi084.stdout:(79/160): python3-jsonpatch-1.21-16.el9.noarch. 35 kB/s | 26 kB 00:00 2024-06-13T02:00:50.258 INFO:teuthology.orchestra.run.smithi084.stdout:(80/160): python3-jinja2-2.11.3-6.el9.noarch.rp 238 kB/s | 248 kB 00:01 2024-06-13T02:00:50.513 INFO:teuthology.orchestra.run.smithi175.stdout:(67/160): postgresql-13.14-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-06-13T02:00:50.930 INFO:teuthology.orchestra.run.smithi175.stdout:(68/160): openssl-devel-3.2.2-1.el9.x86_64.rpm 3.1 MB/s | 4.4 MB 00:01 2024-06-13T02:00:50.997 INFO:teuthology.orchestra.run.smithi175.stdout:(69/160): openblas-openmp-0.3.21-2.el9.x86_64.r 3.1 MB/s | 4.7 MB 00:01 2024-06-13T02:00:51.000 INFO:teuthology.orchestra.run.smithi084.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 44 kB/s | 35 kB 00:00 2024-06-13T02:00:51.030 INFO:teuthology.orchestra.run.smithi175.stdout:(70/160): postgresql-contrib-13.14-1.el9.x86_64 1.7 MB/s | 911 kB 00:00 2024-06-13T02:00:51.097 INFO:teuthology.orchestra.run.smithi175.stdout:(71/160): postgresql-private-libs-13.14-1.el9.x 798 kB/s | 133 kB 00:00 2024-06-13T02:00:51.222 INFO:teuthology.orchestra.run.smithi175.stdout:(72/160): python3-attrs-20.3.0-7.el9.noarch.rpm 701 kB/s | 87 kB 00:00 2024-06-13T02:00:51.226 INFO:teuthology.orchestra.run.smithi084.stdout:(82/160): python3-mako-1.1.4-6.el9.noarch.rpm 167 kB/s | 172 kB 00:01 2024-06-13T02:00:51.548 INFO:teuthology.orchestra.run.smithi175.stdout:(73/160): protobuf-3.14.0-13.el9.x86_64.rpm 2.0 MB/s | 1.0 MB 00:00 2024-06-13T02:00:51.623 INFO:teuthology.orchestra.run.smithi175.stdout:(74/160): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-06-13T02:00:51.640 INFO:teuthology.orchestra.run.smithi175.stdout:(75/160): python3-colorama-0.4.6-3.el9.noarch.r 668 kB/s | 61 kB 00:00 2024-06-13T02:00:51.681 INFO:teuthology.orchestra.run.smithi175.stdout:(76/160): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-06-13T02:00:51.707 INFO:teuthology.orchestra.run.smithi175.stdout:(77/160): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-06-13T02:00:51.732 INFO:teuthology.orchestra.run.smithi175.stdout:(78/160): python3-jsonpatch-1.21-16.el9.noarch. 509 kB/s | 26 kB 00:00 2024-06-13T02:00:51.766 INFO:teuthology.orchestra.run.smithi175.stdout:(79/160): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-06-13T02:00:51.799 INFO:teuthology.orchestra.run.smithi175.stdout:(80/160): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-06-13T02:00:51.825 INFO:teuthology.orchestra.run.smithi175.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 592 kB/s | 35 kB 00:00 2024-06-13T02:00:52.093 INFO:teuthology.orchestra.run.smithi084.stdout:(83/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.8 MB/s | 5.1 MB 00:01 2024-06-13T02:00:52.117 INFO:teuthology.orchestra.run.smithi175.stdout:(82/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-06-13T02:00:52.143 INFO:teuthology.orchestra.run.smithi084.stdout:(84/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 219 kB/s | 250 kB 00:01 2024-06-13T02:00:52.143 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-06-13T02:00:52.159 INFO:teuthology.orchestra.run.smithi175.stdout:(83/160): python3-oauthlib-3.1.1-5.el9.noarch.r 5.2 MB/s | 222 kB 00:00 2024-06-13T02:00:52.201 INFO:teuthology.orchestra.run.smithi175.stdout:(84/160): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-06-13T02:00:52.234 INFO:teuthology.orchestra.run.smithi175.stdout:(85/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 612 kB/s | 250 kB 00:00 2024-06-13T02:00:52.259 INFO:teuthology.orchestra.run.smithi175.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-06-13T02:00:52.293 INFO:teuthology.orchestra.run.smithi175.stdout:(87/160): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-06-13T02:00:52.319 INFO:teuthology.orchestra.run.smithi175.stdout:(88/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-06-13T02:00:52.352 INFO:teuthology.orchestra.run.smithi175.stdout:(89/160): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-06-13T02:00:52.376 INFO:teuthology.orchestra.run.smithi084.stdout:(85/160): python3-oauthlib-3.1.1-5.el9.noarch.r 193 kB/s | 222 kB 00:01 2024-06-13T02:00:52.377 INFO:teuthology.orchestra.run.smithi175.stdout:(90/160): python3-pytz-2021.1-5.el9.noarch.rpm 870 kB/s | 51 kB 00:00 2024-06-13T02:00:52.403 INFO:teuthology.orchestra.run.smithi175.stdout:(91/160): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-06-13T02:00:52.453 INFO:teuthology.orchestra.run.smithi175.stdout:(92/160): python3-toml-0.10.2-6.el9.noarch.rpm 838 kB/s | 42 kB 00:00 2024-06-13T02:00:52.453 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-06-13T02:00:52.454 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-06-13T02:00:52.512 INFO:teuthology.orchestra.run.smithi175.stdout:(93/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 758 kB/s | 44 kB 00:00 2024-06-13T02:00:52.570 INFO:teuthology.orchestra.run.smithi175.stdout:(94/160): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-06-13T02:00:52.629 INFO:teuthology.orchestra.run.smithi175.stdout:(95/160): qatlib-service-24.02.0-1.el9.x86_64.r 616 kB/s | 36 kB 00:00 2024-06-13T02:00:52.687 INFO:teuthology.orchestra.run.smithi175.stdout:(96/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 814 kB/s | 47 kB 00:00 2024-06-13T02:00:52.754 INFO:teuthology.orchestra.run.smithi175.stdout:(97/160): socat-1.7.4.1-6.el9.x86_64.rpm 4.5 MB/s | 304 kB 00:00 2024-06-13T02:00:52.813 INFO:teuthology.orchestra.run.smithi175.stdout:(98/160): uuid-1.6.2-55.el9.x86_64.rpm 989 kB/s | 58 kB 00:00 2024-06-13T02:00:52.863 INFO:teuthology.orchestra.run.smithi175.stdout:(99/160): xfsprogs-devel-6.4.0-1.el9.x86_64.rpm 1.9 MB/s | 95 kB 00:00 2024-06-13T02:00:52.922 INFO:teuthology.orchestra.run.smithi175.stdout:(100/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-06-13T02:00:52.943 INFO:teuthology.orchestra.run.smithi084.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 53 kB/s | 42 kB 00:00 2024-06-13T02:00:52.980 INFO:teuthology.orchestra.run.smithi175.stdout:(101/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-06-13T02:00:52.982 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:52.993 INFO:teuthology.orchestra.run.smithi084.stdout:(87/160): python3-packaging-20.9-5.el9.noarch.r 86 kB/s | 77 kB 00:00 2024-06-13T02:00:53.156 INFO:teuthology.orchestra.run.smithi175.stdout:(102/160): lua-devel-5.4.4-4.el9.x86_64.rpm 127 kB/s | 22 kB 00:00 2024-06-13T02:00:53.158 INFO:teuthology.orchestra.run.smithi175.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:53.315 INFO:teuthology.orchestra.run.smithi175.stdout:(103/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-06-13T02:00:53.365 INFO:teuthology.orchestra.run.smithi175.stdout:(104/160): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-06-13T02:00:53.398 INFO:teuthology.orchestra.run.smithi175.stdout:(105/160): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-06-13T02:00:53.444 INFO:teuthology.orchestra.run.smithi175.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 432 kB/s | 19 kB 00:00 2024-06-13T02:00:53.499 INFO:teuthology.orchestra.run.smithi175.stdout:(107/160): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-06-13T02:00:53.527 INFO:teuthology.orchestra.run.smithi084.stdout:(88/160): python3-protobuf-3.14.0-13.el9.noarch 240 kB/s | 269 kB 00:01 2024-06-13T02:00:53.566 INFO:teuthology.orchestra.run.smithi175.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 395 kB/s | 26 kB 00:00 2024-06-13T02:00:53.591 INFO:teuthology.orchestra.run.smithi175.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-06-13T02:00:53.625 INFO:teuthology.orchestra.run.smithi175.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-06-13T02:00:53.658 INFO:teuthology.orchestra.run.smithi175.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-06-13T02:00:53.725 INFO:teuthology.orchestra.run.smithi175.stdout:(112/160): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-06-13T02:00:53.776 INFO:teuthology.orchestra.run.smithi175.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-06-13T02:00:53.793 INFO:teuthology.orchestra.run.smithi175.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-06-13T02:00:53.826 INFO:teuthology.orchestra.run.smithi175.stdout:(115/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-06-13T02:00:53.852 INFO:teuthology.orchestra.run.smithi175.stdout:(116/160): python3-cachetools-4.2.4-1.el9.noarc 547 kB/s | 32 kB 00:00 2024-06-13T02:00:53.877 INFO:teuthology.orchestra.run.smithi175.stdout:(117/160): python3-certifi-2021.10.8-2.el9.noar 296 kB/s | 15 kB 00:00 2024-06-13T02:00:53.894 INFO:teuthology.orchestra.run.smithi084.stdout:(89/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 167 kB/s | 159 kB 00:00 2024-06-13T02:00:53.911 INFO:teuthology.orchestra.run.smithi175.stdout:(118/160): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-06-13T02:00:53.953 INFO:teuthology.orchestra.run.smithi175.stdout:(119/160): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-06-13T02:00:53.978 INFO:teuthology.orchestra.run.smithi175.stdout:(120/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-06-13T02:00:54.011 INFO:teuthology.orchestra.run.smithi175.stdout:(121/160): python3-google-auth-2.29.0-2.el9.noa 3.4 MB/s | 205 kB 00:00 2024-06-13T02:00:54.045 INFO:teuthology.orchestra.run.smithi175.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-06-13T02:00:54.069 INFO:teuthology.orchestra.run.smithi084.stdout:(90/160): python3-pyasn1-modules-0.4.8-6.el9.no 259 kB/s | 279 kB 00:01 2024-06-13T02:00:54.070 INFO:teuthology.orchestra.run.smithi175.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-06-13T02:00:54.095 INFO:teuthology.orchestra.run.smithi175.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-06-13T02:00:54.121 INFO:teuthology.orchestra.run.smithi175.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-06-13T02:00:54.146 INFO:teuthology.orchestra.run.smithi175.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-06-13T02:00:54.171 INFO:teuthology.orchestra.run.smithi175.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 790 kB/s | 20 kB 00:00 2024-06-13T02:00:54.221 INFO:teuthology.orchestra.run.smithi175.stdout:(128/160): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-06-13T02:00:54.255 INFO:teuthology.orchestra.run.smithi175.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-06-13T02:00:54.289 INFO:teuthology.orchestra.run.smithi175.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-06-13T02:00:54.322 INFO:teuthology.orchestra.run.smithi175.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-06-13T02:00:54.352 INFO:teuthology.orchestra.run.smithi084.stdout:(91/160): python3-pytz-2021.1-5.el9.noarch.rpm 62 kB/s | 51 kB 00:00 2024-06-13T02:00:54.364 INFO:teuthology.orchestra.run.smithi175.stdout:(132/160): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-06-13T02:00:54.389 INFO:teuthology.orchestra.run.smithi175.stdout:(133/160): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-06-13T02:00:54.415 INFO:teuthology.orchestra.run.smithi175.stdout:(134/160): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-06-13T02:00:54.440 INFO:teuthology.orchestra.run.smithi175.stdout:(135/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-06-13T02:00:54.465 INFO:teuthology.orchestra.run.smithi175.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-06-13T02:00:54.491 INFO:teuthology.orchestra.run.smithi175.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-06-13T02:00:54.516 INFO:teuthology.orchestra.run.smithi175.stdout:(138/160): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-06-13T02:00:54.541 INFO:teuthology.orchestra.run.smithi175.stdout:(139/160): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-06-13T02:00:54.567 INFO:teuthology.orchestra.run.smithi175.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-06-13T02:00:54.592 INFO:teuthology.orchestra.run.smithi175.stdout:(141/160): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-06-13T02:00:54.617 INFO:teuthology.orchestra.run.smithi175.stdout:(142/160): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-06-13T02:00:54.642 INFO:teuthology.orchestra.run.smithi175.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-06-13T02:00:54.676 INFO:teuthology.orchestra.run.smithi175.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 601 kB/s | 20 kB 00:00 2024-06-13T02:00:54.701 INFO:teuthology.orchestra.run.smithi175.stdout:(145/160): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-06-13T02:00:54.726 INFO:teuthology.orchestra.run.smithi175.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-06-13T02:00:54.753 INFO:teuthology.orchestra.run.smithi084.stdout:(92/160): python3-requests-oauthlib-1.3.0-12.el 62 kB/s | 54 kB 00:00 2024-06-13T02:00:54.902 INFO:teuthology.orchestra.run.smithi175.stdout:(147/160): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-06-13T02:00:55.077 INFO:teuthology.orchestra.run.smithi175.stdout:(148/160): postgresql-server-13.14-1.el9.x86_64 1.4 MB/s | 5.8 MB 00:04 2024-06-13T02:00:55.161 INFO:teuthology.orchestra.run.smithi084.stdout:(93/160): python3-toml-0.10.2-6.el9.noarch.rpm 51 kB/s | 42 kB 00:00 2024-06-13T02:00:55.248 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-06-13T02:00:55.249 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-06-13T02:00:55.570 INFO:teuthology.orchestra.run.smithi084.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 54 kB/s | 44 kB 00:00 2024-06-13T02:00:55.802 INFO:teuthology.orchestra.run.smithi175.stdout:(149/160): NetworkManager-1.47.91-1.el9.x86_64. 3.2 MB/s | 2.3 MB 00:00 2024-06-13T02:00:56.036 INFO:teuthology.orchestra.run.smithi175.stdout:(150/160): NetworkManager-libnm-1.47.91-1.el9.x 7.7 MB/s | 1.8 MB 00:00 2024-06-13T02:00:56.086 INFO:teuthology.orchestra.run.smithi175.stdout:(151/160): librbd1-19.0.0-2946.g3d89accf.el9.x8 2.6 MB/s | 3.1 MB 00:01 2024-06-13T02:00:56.103 INFO:teuthology.orchestra.run.smithi175.stdout:(152/160): NetworkManager-team-1.47.91-1.el9.x8 619 kB/s | 41 kB 00:00 2024-06-13T02:00:56.162 INFO:teuthology.orchestra.run.smithi175.stdout:(153/160): elfutils-debuginfod-client-0.191-4.e 631 kB/s | 37 kB 00:00 2024-06-13T02:00:56.203 INFO:teuthology.orchestra.run.smithi084.stdout:(95/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.6 MB/s | 16 MB 00:02 2024-06-13T02:00:56.229 INFO:teuthology.orchestra.run.smithi175.stdout:(154/160): elfutils-libelf-0.191-4.el9.x86_64.r 3.0 MB/s | 207 kB 00:00 2024-06-13T02:00:56.245 INFO:teuthology.orchestra.run.smithi084.stdout:(96/160): qatlib-24.02.0-1.el9.x86_64.rpm 204 kB/s | 221 kB 00:01 2024-06-13T02:00:56.295 INFO:teuthology.orchestra.run.smithi175.stdout:(155/160): elfutils-libs-0.191-4.el9.x86_64.rpm 3.8 MB/s | 260 kB 00:00 2024-06-13T02:00:56.346 INFO:teuthology.orchestra.run.smithi175.stdout:(156/160): librados2-19.0.0-2946.g3d89accf.el9. 2.1 MB/s | 3.4 MB 00:01 2024-06-13T02:00:56.388 INFO:teuthology.orchestra.run.smithi175.stdout:(157/160): openssl-3.2.2-1.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-06-13T02:00:56.413 INFO:teuthology.orchestra.run.smithi175.stdout:(158/160): NetworkManager-tui-1.47.91-1.el9.x86 760 kB/s | 248 kB 00:00 2024-06-13T02:00:56.471 INFO:teuthology.orchestra.run.smithi084.stdout:(97/160): qatlib-service-24.02.0-1.el9.x86_64.r 40 kB/s | 36 kB 00:00 2024-06-13T02:00:56.480 INFO:teuthology.orchestra.run.smithi175.stdout:(159/160): xfsprogs-6.4.0-1.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-06-13T02:00:56.954 INFO:teuthology.orchestra.run.smithi084.stdout:(98/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 63 kB/s | 47 kB 00:00 2024-06-13T02:00:57.197 INFO:teuthology.orchestra.run.smithi175.stdout:(160/160): openssl-libs-3.2.2-1.el9.x86_64.rpm 2.8 MB/s | 2.4 MB 00:00 2024-06-13T02:00:57.203 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-06-13T02:00:57.203 INFO:teuthology.orchestra.run.smithi175.stdout:Total 14 MB/s | 226 MB 00:15 2024-06-13T02:00:57.238 INFO:teuthology.orchestra.run.smithi084.stdout:(99/160): socat-1.7.4.1-6.el9.x86_64.rpm 307 kB/s | 304 kB 00:00 2024-06-13T02:00:57.288 INFO:teuthology.orchestra.run.smithi084.stdout:(100/160): uuid-1.6.2-55.el9.x86_64.rpm 71 kB/s | 58 kB 00:00 2024-06-13T02:00:57.838 INFO:teuthology.orchestra.run.smithi084.stdout:(101/160): xfsprogs-devel-6.4.0-1.el9.x86_64.rp 107 kB/s | 95 kB 00:00 2024-06-13T02:00:57.877 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:57.972 INFO:teuthology.orchestra.run.smithi084.stdout:(102/160): lua-devel-5.4.4-4.el9.x86_64.rpm 168 kB/s | 22 kB 00:00 2024-06-13T02:00:57.975 INFO:teuthology.orchestra.run.smithi084.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-13T02:00:58.022 INFO:teuthology.orchestra.run.smithi084.stdout:(103/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 61 kB/s | 45 kB 00:00 2024-06-13T02:00:58.064 INFO:teuthology.orchestra.run.smithi084.stdout:(104/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 80 kB/s | 64 kB 00:00 2024-06-13T02:00:58.097 INFO:teuthology.orchestra.run.smithi084.stdout:(105/160): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-06-13T02:00:58.148 INFO:teuthology.orchestra.run.smithi084.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 844 kB/s | 19 kB 00:00 2024-06-13T02:00:58.190 INFO:teuthology.orchestra.run.smithi084.stdout:(107/160): gperftools-libs-2.9.1-2.el9.x86_64.r 2.4 MB/s | 309 kB 00:00 2024-06-13T02:00:58.215 INFO:teuthology.orchestra.run.smithi084.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-06-13T02:00:58.248 INFO:teuthology.orchestra.run.smithi084.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-06-13T02:00:58.282 INFO:teuthology.orchestra.run.smithi084.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-06-13T02:00:58.308 INFO:teuthology.orchestra.run.smithi084.stdout:(111/160): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-06-13T02:00:58.333 INFO:teuthology.orchestra.run.smithi084.stdout:(112/160): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-06-13T02:00:58.425 INFO:teuthology.orchestra.run.smithi084.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 8.3 MB/s | 548 kB 00:00 2024-06-13T02:00:58.455 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-06-13T02:00:58.458 INFO:teuthology.orchestra.run.smithi084.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-06-13T02:00:58.492 INFO:teuthology.orchestra.run.smithi084.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 965 kB/s | 32 kB 00:00 2024-06-13T02:00:58.634 INFO:teuthology.orchestra.run.smithi084.stdout:(116/160): libarrow-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-06-13T02:00:58.649 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-06-13T02:00:58.649 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-06-13T02:00:58.809 INFO:teuthology.orchestra.run.smithi084.stdout:(117/160): python3-certifi-2021.10.8-2.el9.noar 47 kB/s | 15 kB 00:00 2024-06-13T02:00:58.843 INFO:teuthology.orchestra.run.smithi084.stdout:(118/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.5 MB/s | 839 kB 00:00 2024-06-13T02:00:58.868 INFO:teuthology.orchestra.run.smithi084.stdout:(119/160): python3-cheroot-8.6.0-4.el9.noarch.r 735 kB/s | 172 kB 00:00 2024-06-13T02:00:58.893 INFO:teuthology.orchestra.run.smithi084.stdout:(120/160): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-06-13T02:00:58.919 INFO:teuthology.orchestra.run.smithi084.stdout:(121/160): python3-google-auth-2.29.0-2.el9.noa 4.0 MB/s | 205 kB 00:00 2024-06-13T02:00:58.944 INFO:teuthology.orchestra.run.smithi084.stdout:(122/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.9 MB/s | 303 kB 00:00 2024-06-13T02:00:58.961 INFO:teuthology.orchestra.run.smithi084.stdout:(123/160): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-06-13T02:00:58.995 INFO:teuthology.orchestra.run.smithi084.stdout:(124/160): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-06-13T02:00:59.020 INFO:teuthology.orchestra.run.smithi084.stdout:(125/160): python3-jaraco-classes-3.2.1-5.el9.n 301 kB/s | 18 kB 00:00 2024-06-13T02:00:59.045 INFO:teuthology.orchestra.run.smithi084.stdout:(126/160): python3-jaraco-collections-3.0.0-8.e 464 kB/s | 23 kB 00:00 2024-06-13T02:00:59.071 INFO:teuthology.orchestra.run.smithi084.stdout:(127/160): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-06-13T02:00:59.096 INFO:teuthology.orchestra.run.smithi084.stdout:(128/160): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-06-13T02:00:59.130 INFO:teuthology.orchestra.run.smithi084.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-06-13T02:00:59.163 INFO:teuthology.orchestra.run.smithi084.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-06-13T02:00:59.189 INFO:teuthology.orchestra.run.smithi084.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-06-13T02:00:59.222 INFO:teuthology.orchestra.run.smithi084.stdout:(132/160): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-06-13T02:00:59.248 INFO:teuthology.orchestra.run.smithi084.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-06-13T02:00:59.273 INFO:teuthology.orchestra.run.smithi084.stdout:(134/160): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-06-13T02:00:59.298 INFO:teuthology.orchestra.run.smithi084.stdout:(135/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-06-13T02:00:59.323 INFO:teuthology.orchestra.run.smithi084.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-06-13T02:00:59.349 INFO:teuthology.orchestra.run.smithi084.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-06-13T02:00:59.374 INFO:teuthology.orchestra.run.smithi084.stdout:(138/160): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-06-13T02:00:59.416 INFO:teuthology.orchestra.run.smithi084.stdout:(139/160): python3-grpcio-1.46.7-10.el9.x86_64. 3.9 MB/s | 2.0 MB 00:00 2024-06-13T02:00:59.433 INFO:teuthology.orchestra.run.smithi084.stdout:(140/160): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-06-13T02:00:59.450 INFO:teuthology.orchestra.run.smithi084.stdout:(141/160): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-06-13T02:00:59.467 INFO:teuthology.orchestra.run.smithi084.stdout:(142/160): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-06-13T02:00:59.492 INFO:teuthology.orchestra.run.smithi084.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-06-13T02:00:59.517 INFO:teuthology.orchestra.run.smithi084.stdout:(144/160): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-06-13T02:00:59.534 INFO:teuthology.orchestra.run.smithi084.stdout:(145/160): python3-zc-lockfile-2.0-10.el9.noarc 478 kB/s | 20 kB 00:00 2024-06-13T02:00:59.560 INFO:teuthology.orchestra.run.smithi084.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 4.5 MB/s | 192 kB 00:00 2024-06-13T02:00:59.593 INFO:teuthology.orchestra.run.smithi084.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-06-13T02:00:59.652 INFO:teuthology.orchestra.run.smithi084.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-06-13T02:01:00.227 INFO:teuthology.orchestra.run.smithi084.stdout:(149/160): librbd1-19.0.0-2946.g3d89accf.el9.x8 4.9 MB/s | 3.1 MB 00:00 2024-06-13T02:01:00.269 INFO:teuthology.orchestra.run.smithi084.stdout:(150/160): NetworkManager-1.47.91-1.el9.x86_64. 3.7 MB/s | 2.3 MB 00:00 2024-06-13T02:01:00.419 INFO:teuthology.orchestra.run.smithi084.stdout:(151/160): librados2-19.0.0-2946.g3d89accf.el9. 3.9 MB/s | 3.4 MB 00:00 2024-06-13T02:01:00.445 INFO:teuthology.orchestra.run.smithi084.stdout:(152/160): NetworkManager-team-1.47.91-1.el9.x8 236 kB/s | 41 kB 00:00 2024-06-13T02:01:00.472 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-06-13T02:01:00.472 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-06-13T02:01:00.570 INFO:teuthology.orchestra.run.smithi084.stdout:(153/160): elfutils-debuginfod-client-0.191-4.e 293 kB/s | 37 kB 00:00 2024-06-13T02:01:00.595 INFO:teuthology.orchestra.run.smithi084.stdout:(154/160): NetworkManager-tui-1.47.91-1.el9.x86 1.4 MB/s | 248 kB 00:00 2024-06-13T02:01:00.629 INFO:teuthology.orchestra.run.smithi084.stdout:(155/160): elfutils-libelf-0.191-4.el9.x86_64.r 3.5 MB/s | 207 kB 00:00 2024-06-13T02:01:00.754 INFO:teuthology.orchestra.run.smithi084.stdout:(156/160): elfutils-libs-0.191-4.el9.x86_64.rpm 1.6 MB/s | 260 kB 00:00 2024-06-13T02:01:00.830 INFO:teuthology.orchestra.run.smithi084.stdout:(157/160): openssl-3.2.2-1.el9.x86_64.rpm 6.8 MB/s | 1.4 MB 00:00 2024-06-13T02:01:00.913 INFO:teuthology.orchestra.run.smithi084.stdout:(158/160): xfsprogs-6.4.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-06-13T02:01:01.038 INFO:teuthology.orchestra.run.smithi084.stdout:(159/160): openssl-libs-3.2.2-1.el9.x86_64.rpm 8.4 MB/s | 2.4 MB 00:00 2024-06-13T02:01:01.222 INFO:teuthology.orchestra.run.smithi084.stdout:(160/160): NetworkManager-libnm-1.47.91-1.el9.x 1.8 MB/s | 1.8 MB 00:00 2024-06-13T02:01:01.229 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-06-13T02:01:01.229 INFO:teuthology.orchestra.run.smithi084.stdout:Total 7.1 MB/s | 226 MB 00:31 2024-06-13T02:01:02.060 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-06-13T02:01:02.290 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-libs-1:3.2.2-1.el9.x86_64 1/172 2024-06-13T02:01:02.359 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-06-13T02:01:02.434 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-06-13T02:01:02.451 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-06-13T02:01:02.492 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-06-13T02:01:02.524 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-06-13T02:01:02.613 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-06-13T02:01:02.625 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-06-13T02:01:02.625 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-06-13T02:01:03.046 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-06-13T02:01:03.134 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T02:01:03.326 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T02:01:03.457 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T02:01:03.609 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T02:01:03.635 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T02:01:03.710 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-06-13T02:01:04.026 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-06-13T02:01:04.099 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-06-13T02:01:04.131 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T02:01:04.320 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T02:01:04.349 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T02:01:04.442 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-06-13T02:01:04.442 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-06-13T02:01:04.445 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T02:01:04.475 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T02:01:04.546 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T02:01:04.842 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T02:01:05.026 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T02:01:05.381 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : xfsprogs-6.4.0-1.el9.x86_64 18/172 2024-06-13T02:01:05.549 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T02:01:05.655 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T02:01:05.856 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T02:01:05.969 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T02:01:06.324 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T02:01:06.521 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-06-13T02:01:06.647 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-06-13T02:01:06.719 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/172 2024-06-13T02:01:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-06-13T02:01:06.778 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/172 2024-06-13T02:01:06.834 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-libs-1:3.2.2-1.el9.x86_64 1/172 2024-06-13T02:01:06.872 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-06-13T02:01:06.890 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/172 2024-06-13T02:01:06.925 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-06-13T02:01:06.939 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/172 2024-06-13T02:01:06.960 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-06-13T02:01:06.985 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-06-13T02:01:07.005 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-06-13T02:01:07.028 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-06-13T02:01:07.055 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-06-13T02:01:07.091 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-06-13T02:01:07.215 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-06-13T02:01:07.297 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/172 2024-06-13T02:01:07.335 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-06-13T02:01:07.350 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-06-13T02:01:07.394 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-06-13T02:01:07.453 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T02:01:07.524 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-06-13T02:01:07.563 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 35/172 2024-06-13T02:01:07.574 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T02:01:07.595 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T02:01:07.618 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 36/172 2024-06-13T02:01:07.653 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 37/172 2024-06-13T02:01:07.679 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T02:01:07.708 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T02:01:07.741 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-06-13T02:01:07.777 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-06-13T02:01:07.840 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-06-13T02:01:07.923 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-06-13T02:01:07.956 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-06-13T02:01:07.972 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-06-13T02:01:08.001 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T02:01:08.104 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T02:01:08.127 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T02:01:08.139 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-06-13T02:01:08.189 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T02:01:08.210 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-06-13T02:01:08.211 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T02:01:08.235 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T02:01:08.386 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T02:01:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T02:01:08.671 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : xfsprogs-6.4.0-1.el9.x86_64 18/172 2024-06-13T02:01:08.843 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T02:01:08.904 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T02:01:08.921 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-06-13T02:01:09.008 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T02:01:09.028 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-06-13T02:01:09.067 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-06-13T02:01:09.071 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T02:01:09.107 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-06-13T02:01:09.163 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-06-13T02:01:09.209 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 48/172 2024-06-13T02:01:09.268 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T02:01:09.301 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-06-13T02:01:09.378 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-06-13T02:01:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-06-13T02:01:09.518 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/172 2024-06-13T02:01:09.540 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-06-13T02:01:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/172 2024-06-13T02:01:09.612 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-1:3.2.2-1.el9.x86_64 51/172 2024-06-13T02:01:09.618 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/172 2024-06-13T02:01:09.653 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/172 2024-06-13T02:01:09.693 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-06-13T02:01:09.696 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-06-13T02:01:09.728 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-06-13T02:01:09.756 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-06-13T02:01:09.806 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 53/172 2024-06-13T02:01:09.825 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-06-13T02:01:09.845 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 54/172 2024-06-13T02:01:09.878 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/172 2024-06-13T02:01:09.885 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 55/172 2024-06-13T02:01:09.909 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-06-13T02:01:09.953 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-06-13T02:01:09.954 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 56/172 2024-06-13T02:01:10.001 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 57/172 2024-06-13T02:01:10.029 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-06-13T02:01:10.063 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 35/172 2024-06-13T02:01:10.064 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 58/172 2024-06-13T02:01:10.106 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 36/172 2024-06-13T02:01:10.133 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/172 2024-06-13T02:01:10.135 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 37/172 2024-06-13T02:01:10.205 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-06-13T02:01:10.252 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-06-13T02:01:10.327 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-06-13T02:01:10.346 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/172 2024-06-13T02:01:10.403 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/172 2024-06-13T02:01:10.451 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/172 2024-06-13T02:01:10.592 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/172 2024-06-13T02:01:10.635 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.29.0-2.el9.noarch 64/172 2024-06-13T02:01:10.645 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-06-13T02:01:10.686 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/172 2024-06-13T02:01:10.696 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-06-13T02:01:10.734 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/172 2024-06-13T02:01:10.735 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-06-13T02:01:10.767 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/172 2024-06-13T02:01:10.800 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-libs-1:3.2.2-1.el9.x86_64 1/172 2024-06-13T02:01:10.838 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-06-13T02:01:10.892 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-06-13T02:01:10.926 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-06-13T02:01:10.951 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-06-13T02:01:10.985 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/172 2024-06-13T02:01:10.993 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-06-13T02:01:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/172 2024-06-13T02:01:11.226 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-06-13T02:01:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/172 2024-06-13T02:01:11.296 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/172 2024-06-13T02:01:11.309 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-06-13T02:01:11.325 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-06-13T02:01:11.337 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-06-13T02:01:11.348 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/172 2024-06-13T02:01:11.382 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-06-13T02:01:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/172 2024-06-13T02:01:11.430 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T02:01:11.433 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-06-13T02:01:11.477 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 48/172 2024-06-13T02:01:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/172 2024-06-13T02:01:11.519 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-06-13T02:01:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/172 2024-06-13T02:01:11.534 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T02:01:11.564 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T02:01:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/172 2024-06-13T02:01:11.639 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T02:01:11.663 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-06-13T02:01:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/172 2024-06-13T02:01:11.668 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T02:01:11.701 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-06-13T02:01:11.731 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-1:3.2.2-1.el9.x86_64 51/172 2024-06-13T02:01:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/172 2024-06-13T02:01:11.786 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-06-13T02:01:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/172 2024-06-13T02:01:11.859 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 53/172 2024-06-13T02:01:11.874 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-06-13T02:01:11.890 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 54/172 2024-06-13T02:01:11.924 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-06-13T02:01:11.926 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 55/172 2024-06-13T02:01:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/172 2024-06-13T02:01:11.953 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T02:01:11.974 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 56/172 2024-06-13T02:01:12.009 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 57/172 2024-06-13T02:01:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/172 2024-06-13T02:01:12.052 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 58/172 2024-06-13T02:01:12.055 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T02:01:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/172 2024-06-13T02:01:12.079 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T02:01:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/172 2024-06-13T02:01:12.125 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 15/172 2024-06-13T02:01:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/172 2024-06-13T02:01:12.147 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T02:01:12.172 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-06-13T02:01:12.232 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/172 2024-06-13T02:01:12.272 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/172 2024-06-13T02:01:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/172 2024-06-13T02:01:12.350 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/172 2024-06-13T02:01:12.354 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T02:01:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T02:01:12.442 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/172 2024-06-13T02:01:12.459 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-06-13T02:01:12.480 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.29.0-2.el9.noarch 64/172 2024-06-13T02:01:12.520 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/172 2024-06-13T02:01:12.545 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/172 2024-06-13T02:01:12.570 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/172 2024-06-13T02:01:12.619 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : xfsprogs-6.4.0-1.el9.x86_64 18/172 2024-06-13T02:01:12.644 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/172 2024-06-13T02:01:12.772 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/172 2024-06-13T02:01:12.780 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T02:01:12.803 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/172 2024-06-13T02:01:12.831 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/172 2024-06-13T02:01:12.840 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 19/172 2024-06-13T02:01:12.865 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/172 2024-06-13T02:01:12.904 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/172 2024-06-13T02:01:12.931 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T02:01:12.936 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/172 2024-06-13T02:01:12.965 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/172 2024-06-13T02:01:12.974 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T02:01:13.001 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/172 2024-06-13T02:01:13.026 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/172 2024-06-13T02:01:13.067 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/172 2024-06-13T02:01:13.102 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/172 2024-06-13T02:01:13.169 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 20/172 2024-06-13T02:01:13.188 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/172 2024-06-13T02:01:13.232 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/172 2024-06-13T02:01:13.263 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/172 2024-06-13T02:01:13.279 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-06-13T02:01:13.310 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/172 2024-06-13T02:01:13.366 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-06-13T02:01:13.401 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-06-13T02:01:13.405 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/172 2024-06-13T02:01:13.409 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/172 2024-06-13T02:01:13.431 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/172 2024-06-13T02:01:13.450 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-06-13T02:01:13.465 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T02:01:13.483 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-06-13T02:01:13.496 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/172 2024-06-13T02:01:13.531 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/172 2024-06-13T02:01:13.574 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-06-13T02:01:13.605 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-06-13T02:01:13.606 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-06-13T02:01:13.635 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-06-13T02:01:13.660 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-06-13T02:01:13.702 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-06-13T02:01:13.721 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-06-13T02:01:13.756 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/172 2024-06-13T02:01:13.787 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-06-13T02:01:13.823 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-06-13T02:01:13.833 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-06-13T02:01:13.877 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-06-13T02:01:13.890 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-06-13T02:01:13.937 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 35/172 2024-06-13T02:01:14.120 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 36/172 2024-06-13T02:01:14.122 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-06-13T02:01:14.157 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-06-13T02:01:14.180 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-06-13T02:01:14.229 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-06-13T02:01:14.239 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 37/172 2024-06-13T02:01:14.263 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-06-13T02:01:14.266 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-06-13T02:01:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-06-13T02:01:14.418 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-06-13T02:01:14.434 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-06-13T02:01:14.463 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-06-13T02:01:14.479 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-06-13T02:01:14.542 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-06-13T02:01:14.552 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-06-13T02:01:14.583 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-06-13T02:01:14.685 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-06-13T02:01:14.739 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-06-13T02:01:14.759 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-06-13T02:01:14.788 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-06-13T02:01:14.866 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-06-13T02:01:15.148 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-06-13T02:01:15.260 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-06-13T02:01:15.293 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-06-13T02:01:15.343 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-06-13T02:01:15.372 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-06-13T02:01:15.408 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-06-13T02:01:15.450 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-06-13T02:01:15.479 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 48/172 2024-06-13T02:01:15.515 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-06-13T02:01:15.520 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/172 2024-06-13T02:01:15.628 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-06-13T02:01:15.676 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-06-13T02:01:15.741 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-1:3.2.2-1.el9.x86_64 51/172 2024-06-13T02:01:15.794 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-06-13T02:01:15.859 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 53/172 2024-06-13T02:01:15.891 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 54/172 2024-06-13T02:01:15.927 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 55/172 2024-06-13T02:01:15.974 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 56/172 2024-06-13T02:01:16.010 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 57/172 2024-06-13T02:01:16.053 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 58/172 2024-06-13T02:01:16.103 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/172 2024-06-13T02:01:16.239 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/172 2024-06-13T02:01:16.281 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/172 2024-06-13T02:01:16.322 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/172 2024-06-13T02:01:16.416 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/172 2024-06-13T02:01:16.447 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:2.29.0-2.el9.noarch 64/172 2024-06-13T02:01:16.487 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/172 2024-06-13T02:01:16.513 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/172 2024-06-13T02:01:16.537 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/172 2024-06-13T02:01:16.611 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/172 2024-06-13T02:01:16.738 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/172 2024-06-13T02:01:16.770 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/172 2024-06-13T02:01:16.797 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/172 2024-06-13T02:01:16.832 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/172 2024-06-13T02:01:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-06-13T02:01:16.871 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/172 2024-06-13T02:01:16.903 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/172 2024-06-13T02:01:16.926 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-06-13T02:01:16.932 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/172 2024-06-13T02:01:16.954 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-06-13T02:01:16.967 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/172 2024-06-13T02:01:16.967 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-06-13T02:01:16.996 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-06-13T02:01:17.000 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/172 2024-06-13T02:01:17.034 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/172 2024-06-13T02:01:17.062 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-06-13T02:01:17.068 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/172 2024-06-13T02:01:17.098 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-06-13T02:01:17.133 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-06-13T02:01:17.155 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/172 2024-06-13T02:01:17.198 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/172 2024-06-13T02:01:17.230 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/172 2024-06-13T02:01:17.277 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/172 2024-06-13T02:01:17.307 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-06-13T02:01:17.350 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T02:01:17.374 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-packaging-20.9-5.el9.noarch 84/172 2024-06-13T02:01:17.422 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T02:01:17.441 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T02:01:17.472 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 105/172 2024-06-13T02:01:17.508 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-06-13T02:01:17.520 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-06-13T02:01:17.590 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T02:01:17.736 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T02:01:17.774 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 105/172 2024-06-13T02:01:17.834 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-06-13T02:01:17.972 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-06-13T02:01:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T02:01:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T02:01:18.105 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 109/172 2024-06-13T02:01:18.136 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-06-13T02:01:18.178 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-06-13T02:01:18.212 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-06-13T02:01:18.311 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-06-13T02:01:18.367 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-06-13T02:01:18.411 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-06-13T02:01:18.432 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-06-13T02:01:18.499 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-06-13T02:01:18.531 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-06-13T02:01:18.578 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T02:01:18.706 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-06-13T02:01:18.707 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T02:01:18.737 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-06-13T02:01:18.738 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 109/172 2024-06-13T02:01:18.814 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-06-13T02:01:19.457 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-06-13T02:01:19.576 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-06-13T02:01:20.308 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T02:01:20.351 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T02:01:20.796 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-06-13T02:01:20.883 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-06-13T02:01:20.890 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T02:01:20.911 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-06-13T02:01:20.930 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T02:01:20.944 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-06-13T02:01:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T02:01:21.025 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-13T02:01:21.025 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-13T02:01:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:01:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T02:01:21.257 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-06-13T02:01:21.290 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T02:01:21.381 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 104/172 2024-06-13T02:01:21.412 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 105/172 2024-06-13T02:01:21.447 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-06-13T02:01:21.456 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T02:01:21.492 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T02:01:21.919 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-06-13T02:01:21.951 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T02:01:22.023 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 108/172 2024-06-13T02:01:22.053 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 109/172 2024-06-13T02:01:22.171 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T02:01:22.220 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T02:01:22.406 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T02:01:22.406 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-13T02:01:22.407 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-13T02:01:22.407 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:01:22.438 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T02:01:24.337 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T02:01:24.383 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T02:01:24.921 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 110/172 2024-06-13T02:01:24.961 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T02:01:25.051 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 111/172 2024-06-13T02:01:25.052 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-13T02:01:25.052 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-13T02:01:25.052 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-06-13T02:01:25.079 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T02:01:32.575 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T02:01:32.576 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2024-06-13T02:01:32.576 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2024-06-13T02:01:32.576 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2024-06-13T02:01:32.576 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2024-06-13T02:01:32.576 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2024-06-13T02:01:32.576 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2024-06-13T02:01:32.576 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2024-06-13T02:01:32.576 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:01:32.742 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T02:01:32.758 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T02:01:32.759 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:32.759 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-13T02:01:32.759 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:01:34.245 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T02:01:34.271 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T02:01:34.271 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:34.271 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-13T02:01:34.272 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T02:01:34.272 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T02:01:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:01:34.504 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T02:01:34.527 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T02:01:34.527 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:34.527 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-13T02:01:34.527 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T02:01:34.527 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T02:01:34.527 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:01:34.980 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T02:01:35.003 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T02:01:35.003 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:35.003 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-13T02:01:35.003 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T02:01:35.003 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T02:01:35.003 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:01:35.126 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-06-13T02:01:35.183 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-06-13T02:01:35.238 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-06-13T02:01:35.425 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-06-13T02:01:35.472 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-06-13T02:01:35.551 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-06-13T02:01:35.638 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-06-13T02:01:35.661 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T02:01:35.661 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-06-13T02:01:35.661 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-06-13T02:01:35.661 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-06-13T02:01:35.661 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-06-13T02:01:35.661 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-06-13T02:01:35.661 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-06-13T02:01:35.661 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-06-13T02:01:35.661 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:01:35.777 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-06-13T02:01:35.822 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-06-13T02:01:35.854 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-06-13T02:01:35.886 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T02:01:35.890 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-15.el9.x86_64 127/172 2024-06-13T02:01:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T02:01:35.931 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:35.931 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-13T02:01:35.931 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:01:36.368 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T02:01:36.405 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T02:01:36.436 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 129/172 2024-06-13T02:01:36.507 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 130/172 2024-06-13T02:01:36.536 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T02:01:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 112/172 2024-06-13T02:01:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2024-06-13T02:01:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2024-06-13T02:01:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2024-06-13T02:01:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2024-06-13T02:01:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2024-06-13T02:01:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /root 2024-06-13T02:01:36.709 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2024-06-13T02:01:36.709 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-06-13T02:01:36.881 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T02:01:36.897 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 113/172 2024-06-13T02:01:36.897 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:36.897 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-13T02:01:36.897 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-06-13T02:01:37.570 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T02:01:37.613 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T02:01:37.620 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T02:01:37.727 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T02:01:37.727 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:37.728 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-13T02:01:37.728 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T02:01:37.728 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T02:01:37.728 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:01:37.987 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T02:01:38.086 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T02:01:38.086 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:38.087 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-13T02:01:38.087 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T02:01:38.087 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T02:01:38.087 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:01:38.410 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T02:01:38.436 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 114/172 2024-06-13T02:01:38.436 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:38.436 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-13T02:01:38.436 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T02:01:38.436 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-13T02:01:38.436 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-06-13T02:01:38.581 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T02:01:38.604 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T02:01:38.613 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T02:01:38.669 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T02:01:38.692 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 115/172 2024-06-13T02:01:38.692 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:38.692 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-13T02:01:38.692 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T02:01:38.692 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-13T02:01:38.692 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-06-13T02:01:38.704 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T02:01:38.704 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:38.704 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-13T02:01:38.704 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T02:01:38.704 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T02:01:38.704 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:01:38.715 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T02:01:38.848 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-06-13T02:01:38.878 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 134/172 2024-06-13T02:01:38.912 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-06-13T02:01:38.915 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T02:01:38.939 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T02:01:38.939 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:38.939 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-13T02:01:38.939 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T02:01:38.939 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T02:01:38.939 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:01:38.983 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T02:01:38.989 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-06-13T02:01:38.994 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T02:01:39.092 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 137/172 2024-06-13T02:01:39.136 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T02:01:39.148 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 138/172 2024-06-13T02:01:39.159 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 116/172 2024-06-13T02:01:39.159 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:39.159 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-13T02:01:39.159 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T02:01:39.159 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-13T02:01:39.159 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-06-13T02:01:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-06-13T02:01:39.266 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-06-13T02:01:39.315 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-06-13T02:01:39.320 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-06-13T02:01:39.370 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-06-13T02:01:39.420 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-06-13T02:01:39.540 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-06-13T02:01:39.556 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-06-13T02:01:39.603 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-06-13T02:01:39.681 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-06-13T02:01:39.724 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-06-13T02:01:39.769 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-06-13T02:01:39.775 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-06-13T02:01:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-06-13T02:01:39.873 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-15.el9.x86_64 127/172 2024-06-13T02:01:39.916 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-06-13T02:01:39.953 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-06-13T02:01:39.985 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-06-13T02:01:40.013 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.9-15.el9.x86_64 127/172 2024-06-13T02:01:40.050 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-45.el9.x86_64 139/172 2024-06-13T02:01:40.077 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T02:01:40.100 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T02:01:40.100 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:40.100 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-13T02:01:40.100 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T02:01:40.101 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T02:01:40.101 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:01:40.144 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T02:01:40.166 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T02:01:40.166 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:40.167 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-13T02:01:40.167 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:01:40.212 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T02:01:40.234 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T02:01:40.235 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:40.235 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-13T02:01:40.235 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T02:01:40.235 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T02:01:40.235 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:01:40.432 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T02:01:40.461 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T02:01:40.463 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T02:01:40.493 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 129/172 2024-06-13T02:01:40.498 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 128/172 2024-06-13T02:01:40.545 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T02:01:40.552 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 129/172 2024-06-13T02:01:40.554 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 130/172 2024-06-13T02:01:40.568 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T02:01:40.569 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:40.569 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-13T02:01:40.569 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T02:01:40.569 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T02:01:40.569 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:01:40.584 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T02:01:40.667 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 130/172 2024-06-13T02:01:40.709 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T02:01:41.613 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T02:01:41.644 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T02:01:42.076 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 131/172 2024-06-13T02:01:42.125 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T02:01:42.610 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T02:01:42.636 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T02:01:42.736 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T02:01:42.907 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 134/172 2024-06-13T02:01:42.938 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T02:01:42.960 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T02:01:42.961 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:42.961 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-13T02:01:42.961 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T02:01:42.961 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T02:01:42.961 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-06-13T02:01:43.005 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T02:01:43.016 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T02:01:43.113 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 137/172 2024-06-13T02:01:43.161 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 138/172 2024-06-13T02:01:43.298 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 132/172 2024-06-13T02:01:43.325 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T02:01:43.480 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 133/172 2024-06-13T02:01:43.665 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 134/172 2024-06-13T02:01:43.710 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T02:01:43.796 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 135/172 2024-06-13T02:01:43.797 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:43.797 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-13T02:01:43.797 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T02:01:43.797 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-13T02:01:43.797 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:01:43.861 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T02:01:43.902 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 136/172 2024-06-13T02:01:44.039 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 137/172 2024-06-13T02:01:44.059 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libtool-2.4.6-45.el9.x86_64 139/172 2024-06-13T02:01:44.090 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T02:01:44.105 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 138/172 2024-06-13T02:01:44.113 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T02:01:44.113 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:44.113 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-13T02:01:44.113 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T02:01:44.113 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T02:01:44.114 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-06-13T02:01:44.158 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T02:01:44.179 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T02:01:44.180 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:44.180 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-13T02:01:44.180 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-06-13T02:01:44.225 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T02:01:44.248 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T02:01:44.248 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:44.248 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-13T02:01:44.248 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T02:01:44.248 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T02:01:44.248 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-06-13T02:01:44.550 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T02:01:44.573 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T02:01:44.573 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:44.573 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-13T02:01:44.573 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T02:01:44.573 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T02:01:44.573 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-06-13T02:01:45.107 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 144/172 2024-06-13T02:01:45.146 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtool-2.4.6-45.el9.x86_64 139/172 2024-06-13T02:01:45.147 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 145/172 2024-06-13T02:01:45.180 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T02:01:45.189 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 146/172 2024-06-13T02:01:45.221 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-6.4.0-1.el9.x86_64 147/172 2024-06-13T02:01:45.248 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-06-13T02:01:45.260 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 140/172 2024-06-13T02:01:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-13T02:01:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T02:01:45.260 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-13T02:01:45.260 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:01:45.331 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T02:01:45.433 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 141/172 2024-06-13T02:01:45.433 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:45.433 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-13T02:01:45.433 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:01:45.434 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T02:01:45.486 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-06-13T02:01:45.515 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T02:01:45.518 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 151/172 2024-06-13T02:01:45.567 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-06-13T02:01:45.597 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T02:01:45.626 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 142/172 2024-06-13T02:01:45.626 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:45.626 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-13T02:01:45.626 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T02:01:45.627 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-13T02:01:45.627 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:01:45.643 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 154/172 2024-06-13T02:01:46.032 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T02:01:46.132 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 143/172 2024-06-13T02:01:46.133 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-13T02:01:46.133 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-13T02:01:46.133 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T02:01:46.133 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-13T02:01:46.133 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:01:46.221 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T02:01:46.265 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T02:01:46.286 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T02:01:47.123 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 156/172 2024-06-13T02:01:47.203 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:3.2.2-1.el9.x86_64 157/172 2024-06-13T02:01:47.244 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-06-13T02:01:47.325 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-06-13T02:01:47.365 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-06-13T02:01:47.389 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-06-13T02:01:47.415 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T02:01:47.441 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-06-13T02:01:47.441 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T02:01:47.526 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T02:01:47.559 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-06-13T02:01:47.559 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T02:01:47.643 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T02:01:47.668 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-06-13T02:01:47.673 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T02:01:47.674 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T02:01:47.862 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T02:01:47.862 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T02:01:47.937 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T02:01:47.969 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T02:01:47.995 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-06-13T02:01:48.059 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T02:01:49.078 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 144/172 2024-06-13T02:01:49.120 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 145/172 2024-06-13T02:01:49.160 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 146/172 2024-06-13T02:01:49.192 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xfsprogs-devel-6.4.0-1.el9.x86_64 147/172 2024-06-13T02:01:49.220 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-06-13T02:01:49.401 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T02:01:49.457 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-06-13T02:01:49.489 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 151/172 2024-06-13T02:01:49.522 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-06-13T02:01:49.551 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T02:01:49.597 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 154/172 2024-06-13T02:01:50.174 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T02:01:50.212 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T02:01:50.232 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T02:01:51.053 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 156/172 2024-06-13T02:01:51.141 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openssl-devel-1:3.2.2-1.el9.x86_64 157/172 2024-06-13T02:01:51.181 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-06-13T02:01:51.262 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-06-13T02:01:51.310 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-06-13T02:01:51.312 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 144/172 2024-06-13T02:01:51.344 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-06-13T02:01:51.356 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 145/172 2024-06-13T02:01:51.369 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T02:01:51.396 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-06-13T02:01:51.396 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T02:01:51.411 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 146/172 2024-06-13T02:01:51.463 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T02:01:51.470 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xfsprogs-devel-6.4.0-1.el9.x86_64 147/172 2024-06-13T02:01:51.496 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-06-13T02:01:51.496 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T02:01:51.508 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-06-13T02:01:51.580 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T02:01:51.606 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-06-13T02:01:51.611 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T02:01:51.611 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T02:01:51.790 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T02:01:51.791 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T02:01:51.803 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T02:01:51.867 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-06-13T02:01:51.890 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T02:01:51.903 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 151/172 2024-06-13T02:01:51.915 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T02:01:51.941 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-06-13T02:01:51.949 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-06-13T02:01:52.002 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T02:01:52.004 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T02:01:52.050 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 154/172 2024-06-13T02:01:53.027 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T02:01:53.078 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T02:01:53.149 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-06-13T02:01:53.473 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T02:01:53.473 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/172 2024-06-13T02:01:53.473 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/172 2024-06-13T02:01:53.473 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/172 2024-06-13T02:01:53.473 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/172 2024-06-13T02:01:53.473 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/172 2024-06-13T02:01:53.473 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/172 2024-06-13T02:01:53.473 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/172 2024-06-13T02:01:53.473 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T02:01:53.474 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T02:01:53.474 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T02:01:53.474 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/172 2024-06-13T02:01:53.474 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/172 2024-06-13T02:01:53.474 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/172 2024-06-13T02:01:53.474 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T02:01:53.474 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/172 2024-06-13T02:01:53.475 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/172 2024-06-13T02:01:53.475 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/172 2024-06-13T02:01:53.475 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/172 2024-06-13T02:01:53.475 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/172 2024-06-13T02:01:53.475 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/172 2024-06-13T02:01:53.475 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/172 2024-06-13T02:01:53.475 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/172 2024-06-13T02:01:53.475 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/172 2024-06-13T02:01:53.475 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/172 2024-06-13T02:01:53.475 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/172 2024-06-13T02:01:53.476 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/172 2024-06-13T02:01:53.476 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/172 2024-06-13T02:01:53.476 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/172 2024-06-13T02:01:53.476 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/172 2024-06-13T02:01:53.476 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/172 2024-06-13T02:01:53.476 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/172 2024-06-13T02:01:53.476 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/172 2024-06-13T02:01:53.476 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/172 2024-06-13T02:01:53.476 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/172 2024-06-13T02:01:53.476 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/172 2024-06-13T02:01:53.476 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/172 2024-06-13T02:01:53.476 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/172 2024-06-13T02:01:53.476 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/172 2024-06-13T02:01:53.477 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/172 2024-06-13T02:01:53.477 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/172 2024-06-13T02:01:53.477 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-06-13T02:01:53.477 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-06-13T02:01:53.477 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-06-13T02:01:53.477 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-06-13T02:01:53.477 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-06-13T02:01:53.477 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-06-13T02:01:53.477 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-06-13T02:01:53.477 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/172 2024-06-13T02:01:53.477 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-06-13T02:01:53.477 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-06-13T02:01:53.478 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-06-13T02:01:53.478 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-06-13T02:01:53.478 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-06-13T02:01:53.478 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-06-13T02:01:53.478 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-06-13T02:01:53.478 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-06-13T02:01:53.478 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-06-13T02:01:53.478 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-06-13T02:01:53.478 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-06-13T02:01:53.478 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-06-13T02:01:53.478 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/172 2024-06-13T02:01:53.478 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-06-13T02:01:53.479 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-06-13T02:01:53.479 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-06-13T02:01:53.479 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-06-13T02:01:53.479 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-06-13T02:01:53.479 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-06-13T02:01:53.479 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:3.2.2-1.el9.x86_64 68/172 2024-06-13T02:01:53.479 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-06-13T02:01:53.479 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-06-13T02:01:53.479 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-06-13T02:01:53.479 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-06-13T02:01:53.479 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-06-13T02:01:53.479 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-06-13T02:01:53.479 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-06-13T02:01:53.479 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-06-13T02:01:53.480 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-06-13T02:01:53.480 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-06-13T02:01:53.480 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-06-13T02:01:53.480 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-06-13T02:01:53.480 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-06-13T02:01:53.480 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-06-13T02:01:53.480 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-06-13T02:01:53.480 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-06-13T02:01:53.480 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T02:01:53.480 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-06-13T02:01:53.480 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-06-13T02:01:53.480 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-06-13T02:01:53.481 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-06-13T02:01:53.481 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-06-13T02:01:53.481 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-06-13T02:01:53.481 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-06-13T02:01:53.481 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-06-13T02:01:53.481 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-06-13T02:01:53.481 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-06-13T02:01:53.481 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-06-13T02:01:53.481 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-06-13T02:01:53.481 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-06-13T02:01:53.481 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-06-13T02:01:53.481 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-06-13T02:01:53.481 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-6.4.0-1.el9.x86_64 101/172 2024-06-13T02:01:53.482 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-06-13T02:01:53.482 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-06-13T02:01:53.482 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-06-13T02:01:53.482 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-06-13T02:01:53.482 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-06-13T02:01:53.482 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-06-13T02:01:53.482 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-06-13T02:01:53.482 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-06-13T02:01:53.482 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-06-13T02:01:53.482 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-06-13T02:01:53.482 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-06-13T02:01:53.482 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-06-13T02:01:53.482 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-06-13T02:01:53.483 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-06-13T02:01:53.483 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-06-13T02:01:53.483 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-06-13T02:01:53.483 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/172 2024-06-13T02:01:53.483 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-06-13T02:01:53.483 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-06-13T02:01:53.483 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-06-13T02:01:53.483 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.29.0-2.el9.noarch 122/172 2024-06-13T02:01:53.483 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-06-13T02:01:53.483 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-06-13T02:01:53.483 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-06-13T02:01:53.483 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-06-13T02:01:53.483 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-06-13T02:01:53.484 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-06-13T02:01:53.484 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-06-13T02:01:53.484 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-06-13T02:01:53.484 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-06-13T02:01:53.484 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-06-13T02:01:53.484 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-06-13T02:01:53.484 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-06-13T02:01:53.484 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-06-13T02:01:53.484 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-06-13T02:01:53.485 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-06-13T02:01:53.485 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-06-13T02:01:53.485 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-06-13T02:01:53.485 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-06-13T02:01:53.485 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-06-13T02:01:53.485 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-06-13T02:01:53.485 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-06-13T02:01:53.485 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-06-13T02:01:53.485 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-06-13T02:01:53.485 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-06-13T02:01:53.485 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-06-13T02:01:53.485 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-06-13T02:01:53.486 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T02:01:53.486 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-06-13T02:01:53.486 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/172 2024-06-13T02:01:53.486 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-06-13T02:01:53.486 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T02:01:53.486 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-06-13T02:01:53.486 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/172 2024-06-13T02:01:53.486 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-06-13T02:01:53.486 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/172 2024-06-13T02:01:53.486 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-06-13T02:01:53.486 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/172 2024-06-13T02:01:53.487 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-06-13T02:01:53.487 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-06-13T02:01:53.487 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T02:01:53.487 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-06-13T02:01:53.487 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-06-13T02:01:53.487 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-06-13T02:01:53.487 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-06-13T02:01:53.487 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.2.2-1.el9.x86_64 167/172 2024-06-13T02:01:53.487 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-06-13T02:01:53.487 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.2.2-1.el9.x86_64 169/172 2024-06-13T02:01:53.487 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T02:01:53.487 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-6.4.0-1.el9.x86_64 171/172 2024-06-13T02:01:54.749 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 156/172 2024-06-13T02:01:54.862 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openssl-devel-1:3.2.2-1.el9.x86_64 157/172 2024-06-13T02:01:54.922 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-06-13T02:01:55.062 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-06-13T02:01:55.113 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-06-13T02:01:55.147 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-06-13T02:01:55.181 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T02:01:55.222 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-06-13T02:01:55.223 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T02:01:55.356 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-06-13T02:01:55.527 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-06-13T02:01:55.527 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T02:01:55.672 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-06-13T02:01:55.711 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-06-13T02:01:55.745 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T02:01:55.746 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T02:01:56.082 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-06-13T02:01:56.083 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T02:01:56.197 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T02:01:56.197 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:01:56.197 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2024-06-13T02:01:56.197 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-13T02:01:56.197 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-13T02:01:56.197 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-13T02:01:56.198 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-13T02:01:56.198 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-13T02:01:56.198 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-13T02:01:56.198 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-13T02:01:56.198 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.198 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.198 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-1:3.2.2-1.el9.x86_64 2024-06-13T02:01:56.198 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs-1:3.2.2-1.el9.x86_64 2024-06-13T02:01:56.198 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-6.4.0-1.el9.x86_64 2024-06-13T02:01:56.198 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-06-13T02:01:56.198 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-13T02:01:56.198 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.2-8.el9.noarch 2024-06-13T02:01:56.198 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.7.4-5.el9.x86_64 2024-06-13T02:01:56.199 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-13T02:01:56.199 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.199 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.199 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.199 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.199 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:01:56.199 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.199 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.199 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.199 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:01:56.199 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:01:56.199 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:01:56.199 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:01:56.200 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:01:56.200 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.200 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.200 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:01:56.200 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.200 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.200 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.200 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:01:56.200 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:01:56.200 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.200 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.200 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:01:56.200 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-13T02:01:56.200 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.4-9.el9.x86_64 2024-06-13T02:01:56.201 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-13T02:01:56.201 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-13T02:01:56.201 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-13T02:01:56.201 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-13T02:01:56.201 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-13T02:01:56.201 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-13T02:01:56.201 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-13T02:01:56.201 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-13T02:01:56.201 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-13T02:01:56.201 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.201 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.201 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.201 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-13T02:01:56.201 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-13T02:01:56.202 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-13T02:01:56.202 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-13T02:01:56.202 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-13T02:01:56.202 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.202 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.202 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-13T02:01:56.202 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.202 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-13T02:01:56.202 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-13T02:01:56.202 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-13T02:01:56.202 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-13T02:01:56.202 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-13T02:01:56.202 INFO:teuthology.orchestra.run.smithi175.stdout: lua-5.4.4-4.el9.x86_64 2024-06-13T02:01:56.202 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-13T02:01:56.203 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-13T02:01:56.203 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-13T02:01:56.203 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-13T02:01:56.203 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:3.2.2-1.el9.x86_64 2024-06-13T02:01:56.203 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-13T02:01:56.203 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-13.14-1.el9.x86_64 2024-06-13T02:01:56.203 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-13T02:01:56.203 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-13T02:01:56.203 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-13T02:01:56.203 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-13T02:01:56.203 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-13T02:01:56.203 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-13T02:01:56.203 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-13T02:01:56.203 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-13T02:01:56.204 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-13T02:01:56.204 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-13T02:01:56.204 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.204 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.204 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.204 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-13T02:01:56.204 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-13T02:01:56.204 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-13T02:01:56.204 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-13T02:01:56.204 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-13T02:01:56.204 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-13T02:01:56.204 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-13T02:01:56.204 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-13T02:01:56.204 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.29.0-2.el9.noarch 2024-06-13T02:01:56.204 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-13T02:01:56.205 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-13T02:01:56.205 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-13T02:01:56.205 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-13T02:01:56.205 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-13T02:01:56.205 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-13T02:01:56.205 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-13T02:01:56.205 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-13T02:01:56.205 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-13T02:01:56.205 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-13T02:01:56.205 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-13T02:01:56.205 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-13T02:01:56.205 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-13T02:01:56.205 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-13T02:01:56.205 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-13T02:01:56.206 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-13T02:01:56.206 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-13T02:01:56.206 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-13T02:01:56.206 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-13T02:01:56.206 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-13T02:01:56.206 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-13T02:01:56.206 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2024-06-13T02:01:56.206 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-13T02:01:56.206 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-13T02:01:56.206 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-13T02:01:56.206 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-13T02:01:56.206 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-13T02:01:56.206 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-13T02:01:56.206 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-13T02:01:56.207 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-13T02:01:56.207 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-13T02:01:56.207 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.207 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.207 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-13T02:01:56.207 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-13T02:01:56.207 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-13T02:01:56.207 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.207 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-13T02:01:56.207 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-13T02:01:56.207 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-13T02:01:56.207 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-13T02:01:56.207 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-13T02:01:56.208 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-13T02:01:56.208 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-13T02:01:56.208 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-13T02:01:56.208 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-13T02:01:56.208 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-13T02:01:56.208 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-13T02:01:56.208 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-13T02:01:56.208 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-13T02:01:56.208 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-13T02:01:56.208 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-13T02:01:56.208 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.208 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.208 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:01:56.208 INFO:teuthology.orchestra.run.smithi175.stdout: re2-1:20211101-3.el9.x86_64 2024-06-13T02:01:56.209 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-6.el9.x86_64 2024-06-13T02:01:56.209 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-13T02:01:56.209 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-13T02:01:56.209 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-6.4.0-1.el9.x86_64 2024-06-13T02:01:56.209 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-13T02:01:56.209 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-13T02:01:56.209 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:01:56.209 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-06-13T02:01:56.261 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-06-13T02:01:56.305 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T02:01:56.348 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-06-13T02:01:56.488 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T02:01:56.730 DEBUG:teuthology.parallel:result is None 2024-06-13T02:01:56.777 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T02:01:56.778 INFO:teuthology.orchestra.run.smithi002.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-06-13T02:01:56.778 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:01:57.462 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T02:01:57.462 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/172 2024-06-13T02:01:57.462 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/172 2024-06-13T02:01:57.462 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/172 2024-06-13T02:01:57.462 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/172 2024-06-13T02:01:57.462 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/172 2024-06-13T02:01:57.462 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/172 2024-06-13T02:01:57.462 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/172 2024-06-13T02:01:57.462 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T02:01:57.463 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T02:01:57.463 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T02:01:57.463 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/172 2024-06-13T02:01:57.463 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/172 2024-06-13T02:01:57.463 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/172 2024-06-13T02:01:57.463 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T02:01:57.463 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/172 2024-06-13T02:01:57.463 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/172 2024-06-13T02:01:57.463 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/172 2024-06-13T02:01:57.463 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/172 2024-06-13T02:01:57.463 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/172 2024-06-13T02:01:57.463 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/172 2024-06-13T02:01:57.463 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/172 2024-06-13T02:01:57.463 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/172 2024-06-13T02:01:57.464 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/172 2024-06-13T02:01:57.464 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/172 2024-06-13T02:01:57.464 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/172 2024-06-13T02:01:57.464 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/172 2024-06-13T02:01:57.464 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/172 2024-06-13T02:01:57.464 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/172 2024-06-13T02:01:57.464 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/172 2024-06-13T02:01:57.464 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/172 2024-06-13T02:01:57.464 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/172 2024-06-13T02:01:57.464 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/172 2024-06-13T02:01:57.464 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/172 2024-06-13T02:01:57.464 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/172 2024-06-13T02:01:57.464 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/172 2024-06-13T02:01:57.464 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/172 2024-06-13T02:01:57.465 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/172 2024-06-13T02:01:57.465 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/172 2024-06-13T02:01:57.465 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/172 2024-06-13T02:01:57.465 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/172 2024-06-13T02:01:57.465 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-06-13T02:01:57.465 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-06-13T02:01:57.465 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-06-13T02:01:57.465 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-06-13T02:01:57.465 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-06-13T02:01:57.465 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-06-13T02:01:57.466 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-06-13T02:01:57.466 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/172 2024-06-13T02:01:57.466 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-06-13T02:01:57.466 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-06-13T02:01:57.466 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-06-13T02:01:57.466 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-06-13T02:01:57.466 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-06-13T02:01:57.466 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-06-13T02:01:57.466 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-06-13T02:01:57.466 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-06-13T02:01:57.467 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-06-13T02:01:57.467 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-06-13T02:01:57.467 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-06-13T02:01:57.467 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-06-13T02:01:57.467 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/172 2024-06-13T02:01:57.467 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-06-13T02:01:57.467 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-06-13T02:01:57.467 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-06-13T02:01:57.467 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-06-13T02:01:57.467 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-06-13T02:01:57.467 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-06-13T02:01:57.467 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-devel-1:3.2.2-1.el9.x86_64 68/172 2024-06-13T02:01:57.467 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-06-13T02:01:57.468 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-06-13T02:01:57.468 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-06-13T02:01:57.468 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-06-13T02:01:57.468 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-06-13T02:01:57.468 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-06-13T02:01:57.468 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-06-13T02:01:57.468 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-06-13T02:01:57.468 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-06-13T02:01:57.468 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-06-13T02:01:57.468 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-06-13T02:01:57.468 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-06-13T02:01:57.468 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-06-13T02:01:57.469 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-06-13T02:01:57.469 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-06-13T02:01:57.469 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-06-13T02:01:57.469 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T02:01:57.469 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-06-13T02:01:57.469 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-06-13T02:01:57.469 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-06-13T02:01:57.469 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-06-13T02:01:57.469 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-06-13T02:01:57.469 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-06-13T02:01:57.469 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-06-13T02:01:57.469 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-06-13T02:01:57.470 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-06-13T02:01:57.470 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-06-13T02:01:57.470 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-06-13T02:01:57.470 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-06-13T02:01:57.470 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-06-13T02:01:57.470 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-06-13T02:01:57.470 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-06-13T02:01:57.470 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-devel-6.4.0-1.el9.x86_64 101/172 2024-06-13T02:01:57.470 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-06-13T02:01:57.470 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-06-13T02:01:57.471 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-06-13T02:01:57.471 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-06-13T02:01:57.471 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-06-13T02:01:57.471 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-06-13T02:01:57.471 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-06-13T02:01:57.471 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-06-13T02:01:57.471 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-06-13T02:01:57.471 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-06-13T02:01:57.471 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-06-13T02:01:57.471 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-06-13T02:01:57.471 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-06-13T02:01:57.471 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-06-13T02:01:57.472 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-06-13T02:01:57.472 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-06-13T02:01:57.472 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/172 2024-06-13T02:01:57.472 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-06-13T02:01:57.472 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-06-13T02:01:57.472 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-06-13T02:01:57.472 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:2.29.0-2.el9.noarch 122/172 2024-06-13T02:01:57.472 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-06-13T02:01:57.472 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-06-13T02:01:57.472 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-06-13T02:01:57.472 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-06-13T02:01:57.472 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-06-13T02:01:57.472 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-06-13T02:01:57.473 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-06-13T02:01:57.473 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-06-13T02:01:57.473 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-06-13T02:01:57.473 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-06-13T02:01:57.473 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-06-13T02:01:57.473 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-06-13T02:01:57.473 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-06-13T02:01:57.473 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-06-13T02:01:57.473 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-06-13T02:01:57.473 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-06-13T02:01:57.473 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-06-13T02:01:57.473 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-06-13T02:01:57.473 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-06-13T02:01:57.474 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-06-13T02:01:57.474 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-06-13T02:01:57.474 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-06-13T02:01:57.474 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-06-13T02:01:57.474 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-06-13T02:01:57.474 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-06-13T02:01:57.474 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-06-13T02:01:57.474 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T02:01:57.474 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-06-13T02:01:57.474 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/172 2024-06-13T02:01:57.474 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-06-13T02:01:57.474 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T02:01:57.474 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-06-13T02:01:57.474 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/172 2024-06-13T02:01:57.475 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-06-13T02:01:57.475 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/172 2024-06-13T02:01:57.475 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-06-13T02:01:57.475 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/172 2024-06-13T02:01:57.475 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-06-13T02:01:57.475 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-06-13T02:01:57.475 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T02:01:57.475 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-06-13T02:01:57.475 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-06-13T02:01:57.475 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-06-13T02:01:57.475 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-06-13T02:01:57.475 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.2.2-1.el9.x86_64 167/172 2024-06-13T02:01:57.475 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-06-13T02:01:57.476 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.2.2-1.el9.x86_64 169/172 2024-06-13T02:01:57.476 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T02:01:57.476 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-6.4.0-1.el9.x86_64 171/172 2024-06-13T02:02:00.206 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T02:02:00.206 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-06-13T02:02:00.206 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2024-06-13T02:02:00.206 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-13T02:02:00.206 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-13T02:02:00.206 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-13T02:02:00.206 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-13T02:02:00.206 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-13T02:02:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-13T02:02:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-13T02:02:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-1:3.2.2-1.el9.x86_64 2024-06-13T02:02:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs-1:3.2.2-1.el9.x86_64 2024-06-13T02:02:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-6.4.0-1.el9.x86_64 2024-06-13T02:02:00.207 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-06-13T02:02:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-13T02:02:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: automake-1.16.2-8.el9.noarch 2024-06-13T02:02:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: bison-3.7.4-5.el9.x86_64 2024-06-13T02:02:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-13T02:02:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.208 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.208 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.208 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:00.208 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.208 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.208 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.208 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:00.208 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:00.208 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:00.208 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:00.208 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:00.208 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.208 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-13T02:02:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: flex-2.6.4-9.el9.x86_64 2024-06-13T02:02:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-13T02:02:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-13T02:02:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-13T02:02:00.210 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-13T02:02:00.210 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-13T02:02:00.210 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-13T02:02:00.210 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-13T02:02:00.210 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-13T02:02:00.210 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-13T02:02:00.210 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.210 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.210 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.210 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-13T02:02:00.210 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-13T02:02:00.210 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-13T02:02:00.210 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-13T02:02:00.211 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-13T02:02:00.211 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.211 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.211 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-13T02:02:00.211 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.211 INFO:teuthology.orchestra.run.smithi084.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-13T02:02:00.211 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-13T02:02:00.211 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-13T02:02:00.211 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-13T02:02:00.211 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-13T02:02:00.211 INFO:teuthology.orchestra.run.smithi084.stdout: lua-5.4.4-4.el9.x86_64 2024-06-13T02:02:00.211 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-13T02:02:00.211 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-13T02:02:00.211 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-13T02:02:00.211 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-13T02:02:00.212 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel-1:3.2.2-1.el9.x86_64 2024-06-13T02:02:00.212 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-13T02:02:00.212 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-13.14-1.el9.x86_64 2024-06-13T02:02:00.212 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-13T02:02:00.212 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-13T02:02:00.212 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-13T02:02:00.212 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-13T02:02:00.212 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-13T02:02:00.212 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-13T02:02:00.212 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-13T02:02:00.212 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-13T02:02:00.212 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-13T02:02:00.212 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-13T02:02:00.212 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.213 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.213 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.213 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-13T02:02:00.213 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-13T02:02:00.213 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-13T02:02:00.213 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-13T02:02:00.213 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-13T02:02:00.213 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-13T02:02:00.213 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-13T02:02:00.213 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-13T02:02:00.213 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:2.29.0-2.el9.noarch 2024-06-13T02:02:00.213 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-13T02:02:00.214 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-13T02:02:00.214 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-13T02:02:00.214 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-13T02:02:00.214 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-13T02:02:00.214 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-13T02:02:00.214 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-13T02:02:00.214 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-13T02:02:00.214 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-13T02:02:00.214 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-13T02:02:00.214 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-13T02:02:00.214 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-13T02:02:00.214 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-13T02:02:00.215 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-13T02:02:00.215 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-13T02:02:00.215 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-13T02:02:00.215 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-13T02:02:00.215 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-13T02:02:00.215 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-13T02:02:00.215 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-13T02:02:00.215 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-13T02:02:00.215 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply-3.11-14.el9.noarch 2024-06-13T02:02:00.215 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-13T02:02:00.215 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-13T02:02:00.215 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-13T02:02:00.215 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-13T02:02:00.215 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-13T02:02:00.216 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-13T02:02:00.216 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-13T02:02:00.216 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-13T02:02:00.216 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-13T02:02:00.216 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.216 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.216 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-13T02:02:00.216 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-13T02:02:00.216 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-13T02:02:00.216 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.216 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-13T02:02:00.216 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-13T02:02:00.216 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-13T02:02:00.216 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-13T02:02:00.216 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-13T02:02:00.217 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-13T02:02:00.217 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-13T02:02:00.217 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-13T02:02:00.217 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-13T02:02:00.217 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-13T02:02:00.217 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-13T02:02:00.217 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-13T02:02:00.217 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-13T02:02:00.217 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-13T02:02:00.217 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-13T02:02:00.217 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.217 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.217 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:00.217 INFO:teuthology.orchestra.run.smithi084.stdout: re2-1:20211101-3.el9.x86_64 2024-06-13T02:02:00.218 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-6.el9.x86_64 2024-06-13T02:02:00.218 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-13T02:02:00.218 INFO:teuthology.orchestra.run.smithi084.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-13T02:02:00.218 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel-6.4.0-1.el9.x86_64 2024-06-13T02:02:00.218 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-13T02:02:00.218 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-13T02:02:00.218 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-06-13T02:02:00.218 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-06-13T02:02:00.637 DEBUG:teuthology.parallel:result is None 2024-06-13T02:02:02.430 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 1/172 2024-06-13T02:02:02.430 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2/172 2024-06-13T02:02:02.430 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 3/172 2024-06-13T02:02:02.430 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 4/172 2024-06-13T02:02:02.430 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2946.g3d89a 5/172 2024-06-13T02:02:02.431 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 6/172 2024-06-13T02:02:02.431 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 7/172 2024-06-13T02:02:02.431 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 8/172 2024-06-13T02:02:02.431 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 9/172 2024-06-13T02:02:02.431 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 10/172 2024-06-13T02:02:02.431 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 11/172 2024-06-13T02:02:02.431 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 12/172 2024-06-13T02:02:02.431 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 13/172 2024-06-13T02:02:02.431 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 14/172 2024-06-13T02:02:02.431 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_ 15/172 2024-06-13T02:02:02.431 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 16/172 2024-06-13T02:02:02.431 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 17/172 2024-06-13T02:02:02.431 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_6 18/172 2024-06-13T02:02:02.432 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86 19/172 2024-06-13T02:02:02.432 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 20/172 2024-06-13T02:02:02.432 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el 21/172 2024-06-13T02:02:02.432 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:19.0.0-2946.g3d89accf.el9. 22/172 2024-06-13T02:02:02.432 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_6 23/172 2024-06-13T02:02:02.432 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 24/172 2024-06-13T02:02:02.432 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 25/172 2024-06-13T02:02:02.432 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 26/172 2024-06-13T02:02:02.432 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 27/172 2024-06-13T02:02:02.445 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 28/172 2024-06-13T02:02:02.445 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 29/172 2024-06-13T02:02:02.445 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf. 30/172 2024-06-13T02:02:02.445 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noa 31/172 2024-06-13T02:02:02.445 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.n 32/172 2024-06-13T02:02:02.445 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d8 33/172 2024-06-13T02:02:02.445 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el 34/172 2024-06-13T02:02:02.445 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 35/172 2024-06-13T02:02:02.445 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.e 36/172 2024-06-13T02:02:02.445 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 37/172 2024-06-13T02:02:02.445 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 38/172 2024-06-13T02:02:02.445 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 39/172 2024-06-13T02:02:02.446 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/172 2024-06-13T02:02:02.446 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-06-13T02:02:02.446 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-06-13T02:02:02.446 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-06-13T02:02:02.446 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-06-13T02:02:02.446 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-06-13T02:02:02.446 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-06-13T02:02:02.446 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-06-13T02:02:02.446 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/172 2024-06-13T02:02:02.446 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-06-13T02:02:02.446 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-06-13T02:02:02.446 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-06-13T02:02:02.446 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-06-13T02:02:02.447 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-06-13T02:02:02.447 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-06-13T02:02:02.447 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-06-13T02:02:02.447 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-06-13T02:02:02.447 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-06-13T02:02:02.447 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-06-13T02:02:02.447 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-06-13T02:02:02.447 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-06-13T02:02:02.447 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/172 2024-06-13T02:02:02.447 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-06-13T02:02:02.447 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-06-13T02:02:02.447 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-06-13T02:02:02.448 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-06-13T02:02:02.448 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-06-13T02:02:02.448 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-06-13T02:02:02.448 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-devel-1:3.2.2-1.el9.x86_64 68/172 2024-06-13T02:02:02.448 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-06-13T02:02:02.448 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-06-13T02:02:02.448 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-06-13T02:02:02.448 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-06-13T02:02:02.448 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-06-13T02:02:02.448 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-06-13T02:02:02.448 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-06-13T02:02:02.448 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-06-13T02:02:02.448 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-06-13T02:02:02.449 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-06-13T02:02:02.449 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-06-13T02:02:02.449 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-06-13T02:02:02.449 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-06-13T02:02:02.449 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-06-13T02:02:02.449 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-06-13T02:02:02.449 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-06-13T02:02:02.449 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-06-13T02:02:02.449 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-06-13T02:02:02.449 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-06-13T02:02:02.449 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-06-13T02:02:02.449 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-06-13T02:02:02.449 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-06-13T02:02:02.450 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-06-13T02:02:02.450 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-06-13T02:02:02.450 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-06-13T02:02:02.450 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-06-13T02:02:02.450 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-06-13T02:02:02.450 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-06-13T02:02:02.450 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-06-13T02:02:02.450 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-06-13T02:02:02.450 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-06-13T02:02:02.450 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-06-13T02:02:02.450 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-devel-6.4.0-1.el9.x86_64 101/172 2024-06-13T02:02:02.450 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-06-13T02:02:02.450 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-06-13T02:02:02.451 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-06-13T02:02:02.451 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-06-13T02:02:02.451 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-06-13T02:02:02.451 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-06-13T02:02:02.451 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-06-13T02:02:02.451 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-06-13T02:02:02.451 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-06-13T02:02:02.451 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-06-13T02:02:02.451 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-06-13T02:02:02.451 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-06-13T02:02:02.451 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-06-13T02:02:02.451 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-06-13T02:02:02.451 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-06-13T02:02:02.452 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-06-13T02:02:02.452 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/172 2024-06-13T02:02:02.452 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-06-13T02:02:02.452 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-06-13T02:02:02.452 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-06-13T02:02:02.452 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.29.0-2.el9.noarch 122/172 2024-06-13T02:02:02.452 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-06-13T02:02:02.452 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-06-13T02:02:02.452 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-06-13T02:02:02.452 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-06-13T02:02:02.452 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-06-13T02:02:02.452 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-06-13T02:02:02.452 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-06-13T02:02:02.453 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-06-13T02:02:02.453 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-06-13T02:02:02.453 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-06-13T02:02:02.453 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-06-13T02:02:02.453 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-06-13T02:02:02.453 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-06-13T02:02:02.453 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-06-13T02:02:02.453 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-06-13T02:02:02.453 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-06-13T02:02:02.453 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-06-13T02:02:02.453 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-06-13T02:02:02.453 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-06-13T02:02:02.453 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-06-13T02:02:02.454 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-06-13T02:02:02.454 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-06-13T02:02:02.454 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-06-13T02:02:02.454 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-06-13T02:02:02.454 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-06-13T02:02:02.454 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-06-13T02:02:02.454 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 149/172 2024-06-13T02:02:02.454 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-06-13T02:02:02.454 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 151/172 2024-06-13T02:02:02.454 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-06-13T02:02:02.454 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/172 2024-06-13T02:02:02.454 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-06-13T02:02:02.454 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/172 2024-06-13T02:02:02.455 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-06-13T02:02:02.455 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/172 2024-06-13T02:02:02.455 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-06-13T02:02:02.455 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/172 2024-06-13T02:02:02.455 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-06-13T02:02:02.455 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-06-13T02:02:02.455 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-06-13T02:02:02.455 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-06-13T02:02:02.455 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-06-13T02:02:02.455 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-06-13T02:02:02.455 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-06-13T02:02:02.455 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-1.el9.x86_64 167/172 2024-06-13T02:02:02.455 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-06-13T02:02:02.456 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-1.el9.x86_64 169/172 2024-06-13T02:02:02.456 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-06-13T02:02:02.456 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-6.4.0-1.el9.x86_64 171/172 2024-06-13T02:02:04.739 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-06-13T02:02:04.739 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:02:04.739 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-06-13T02:02:04.740 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-13T02:02:04.740 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-13T02:02:04.740 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-13T02:02:04.740 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-13T02:02:04.740 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-13T02:02:04.740 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-13T02:02:04.740 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-13T02:02:04.740 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.740 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.740 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-1:3.2.2-1.el9.x86_64 2024-06-13T02:02:04.740 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs-1:3.2.2-1.el9.x86_64 2024-06-13T02:02:04.740 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-6.4.0-1.el9.x86_64 2024-06-13T02:02:04.740 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-06-13T02:02:04.741 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-13T02:02:04.741 INFO:teuthology.orchestra.run.smithi002.stdout: automake-1.16.2-8.el9.noarch 2024-06-13T02:02:04.741 INFO:teuthology.orchestra.run.smithi002.stdout: bison-3.7.4-5.el9.x86_64 2024-06-13T02:02:04.741 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-13T02:02:04.741 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.741 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.741 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.741 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.741 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:04.741 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.741 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.741 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.741 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:04.742 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:04.742 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:04.742 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:04.742 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:04.742 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.742 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.742 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:04.742 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.742 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.742 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.742 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:04.742 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:04.742 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.743 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.743 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top-2:19.0.0-2946.g3d89accf.el9.noarch 2024-06-13T02:02:04.743 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-13T02:02:04.743 INFO:teuthology.orchestra.run.smithi002.stdout: flex-2.6.4-9.el9.x86_64 2024-06-13T02:02:04.743 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-13T02:02:04.743 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-13T02:02:04.743 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-13T02:02:04.743 INFO:teuthology.orchestra.run.smithi002.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-13T02:02:04.743 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-13T02:02:04.743 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-13T02:02:04.743 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-13T02:02:04.743 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-13T02:02:04.743 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-13T02:02:04.743 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.744 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.744 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.744 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-13T02:02:04.744 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-13T02:02:04.744 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-13T02:02:04.744 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-13T02:02:04.744 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-13T02:02:04.744 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.744 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.744 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-13T02:02:04.744 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.744 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-13T02:02:04.744 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-13T02:02:04.744 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-13T02:02:04.745 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-13T02:02:04.745 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-13T02:02:04.745 INFO:teuthology.orchestra.run.smithi002.stdout: lua-5.4.4-4.el9.x86_64 2024-06-13T02:02:04.745 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-13T02:02:04.745 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-13T02:02:04.745 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-13T02:02:04.745 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-13T02:02:04.745 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel-1:3.2.2-1.el9.x86_64 2024-06-13T02:02:04.745 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-13T02:02:04.745 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-13.14-1.el9.x86_64 2024-06-13T02:02:04.745 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-13T02:02:04.745 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-13T02:02:04.745 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-13T02:02:04.745 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-13T02:02:04.745 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-13T02:02:04.746 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-13T02:02:04.746 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-13T02:02:04.746 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-13T02:02:04.746 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-13T02:02:04.746 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-13T02:02:04.746 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.746 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.746 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.746 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-13T02:02:04.746 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-13T02:02:04.746 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-13T02:02:04.746 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-13T02:02:04.746 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-13T02:02:04.747 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-13T02:02:04.747 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-13T02:02:04.747 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-13T02:02:04.747 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.29.0-2.el9.noarch 2024-06-13T02:02:04.747 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-13T02:02:04.747 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-13T02:02:04.747 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-13T02:02:04.747 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-13T02:02:04.747 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-13T02:02:04.747 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-13T02:02:04.747 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-13T02:02:04.747 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-13T02:02:04.747 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-13T02:02:04.747 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-13T02:02:04.748 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-13T02:02:04.748 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-13T02:02:04.748 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-13T02:02:04.748 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-13T02:02:04.748 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-13T02:02:04.748 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-13T02:02:04.748 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-13T02:02:04.748 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-13T02:02:04.748 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-13T02:02:04.748 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-13T02:02:04.748 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-13T02:02:04.748 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-06-13T02:02:04.748 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-13T02:02:04.748 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-13T02:02:04.749 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-13T02:02:04.749 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-13T02:02:04.749 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-13T02:02:04.749 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-13T02:02:04.749 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-13T02:02:04.749 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-13T02:02:04.749 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-13T02:02:04.749 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.749 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.749 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-13T02:02:04.749 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-13T02:02:04.749 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-13T02:02:04.749 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.750 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-13T02:02:04.750 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-13T02:02:04.750 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-13T02:02:04.750 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-13T02:02:04.750 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-13T02:02:04.750 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-13T02:02:04.750 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-13T02:02:04.750 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-13T02:02:04.750 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-13T02:02:04.750 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-13T02:02:04.750 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-13T02:02:04.750 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-13T02:02:04.750 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-13T02:02:04.750 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-13T02:02:04.751 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-13T02:02:04.751 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.751 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.751 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:19.0.0-2946.g3d89accf.el9.x86_64 2024-06-13T02:02:04.751 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-3.el9.x86_64 2024-06-13T02:02:04.751 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 2024-06-13T02:02:04.751 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-13T02:02:04.751 INFO:teuthology.orchestra.run.smithi002.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-13T02:02:04.751 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel-6.4.0-1.el9.x86_64 2024-06-13T02:02:04.751 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-13T02:02:04.752 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-13T02:02:04.752 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:02:04.752 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-06-13T02:02:05.351 DEBUG:teuthology.parallel:result is None 2024-06-13T02:02:05.352 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T02:02:05.499 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-13T02:02:05.561 INFO:teuthology.orchestra.run.smithi002.stdout:19.0.0-2946.g3d89accf.el9 2024-06-13T02:02:05.562 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-13T02:02:05.562 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-13T02:02:05.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T02:02:05.777 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-13T02:02:05.802 INFO:teuthology.orchestra.run.smithi084.stdout:19.0.0-2946.g3d89accf.el9 2024-06-13T02:02:05.802 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-13T02:02:05.802 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-13T02:02:05.804 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T02:02:05.944 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-13T02:02:05.969 INFO:teuthology.orchestra.run.smithi175.stdout:19.0.0-2946.g3d89accf.el9 2024-06-13T02:02:05.969 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2946.g3d89accf.el9 2024-06-13T02:02:05.970 INFO:teuthology.task.install:The correct ceph version 19.0.0-2946.g3d89accf is installed. 2024-06-13T02:02:05.971 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-13T02:02:05.971 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:02:05.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-13T02:02:06.046 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-06-13T02:02:06.046 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-13T02:02:06.078 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-06-13T02:02:06.078 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-13T02:02:06.107 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-13T02:02:06.108 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:02:06.108 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-06-13T02:02:06.175 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-13T02:02:06.283 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-06-13T02:02:06.284 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-06-13T02:02:06.312 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-13T02:02:06.379 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-06-13T02:02:06.380 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-06-13T02:02:06.407 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-13T02:02:06.474 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-13T02:02:06.474 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:02:06.474 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-13T02:02:06.546 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-13T02:02:06.650 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-06-13T02:02:06.650 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-13T02:02:06.674 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-13T02:02:06.738 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-06-13T02:02:06.738 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-13T02:02:06.762 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-13T02:02:06.827 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-13T02:02:06.827 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:02:06.828 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-06-13T02:02:06.894 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-13T02:02:06.992 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-06-13T02:02:06.992 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-06-13T02:02:07.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-13T02:02:07.079 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-06-13T02:02:07.079 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-06-13T02:02:07.103 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-13T02:02:07.167 INFO:teuthology.run_tasks:Running task cephadm... 2024-06-13T02:02:07.252 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'subvols': {'create': 2}} 2024-06-13T02:02:07.252 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T02:02:07.252 INFO:tasks.cephadm:Cluster fsid is efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:02:07.253 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-06-13T02:02:07.253 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.2', 'mon.b': '172.21.15.84', 'mon.c': '172.21.15.175'} 2024-06-13T02:02:07.253 INFO:tasks.cephadm:First mon is mon.a on smithi002 2024-06-13T02:02:07.253 INFO:tasks.cephadm:First mgr is x 2024-06-13T02:02:07.253 INFO:tasks.cephadm:Normalizing hostnames... 2024-06-13T02:02:07.253 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname $(hostname -s) 2024-06-13T02:02:07.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname $(hostname -s) 2024-06-13T02:02:07.343 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname $(hostname -s) 2024-06-13T02:02:07.366 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-06-13T02:02:07.367 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T02:02:07.511 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '3d89accfe3201286f000e065a1faea2a88c7a6ba', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/55273/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2946-g3d89accf', 'node_name': '172.21.2.14+braggi14', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2946.g3d89accf'}, 'url': 'https://3.chacra.ceph.com/r/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-30 17:04:17.570799', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-06-13T02:02:07.655 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 3d89accfe3201286f000e065a1faea2a88c7a6ba from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T02:02:07.656 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm 2024-06-13T02:02:07.656 DEBUG:teuthology.orchestra.run.smithi002:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-13T02:02:08.109 INFO:teuthology.orchestra.run.smithi002.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 13 02:02 /home/ubuntu/cephtest/cephadm 2024-06-13T02:02:08.110 DEBUG:teuthology.orchestra.run.smithi084:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-13T02:02:08.523 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 13 02:02 /home/ubuntu/cephtest/cephadm 2024-06-13T02:02:08.523 DEBUG:teuthology.orchestra.run.smithi175:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/3d89accfe3201286f000e065a1faea2a88c7a6ba/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-13T02:02:08.903 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r--. 1 ubuntu ubuntu 781907 Jun 13 02:02 /home/ubuntu/cephtest/cephadm 2024-06-13T02:02:08.904 DEBUG:teuthology.orchestra.run.smithi002:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-13T02:02:08.952 DEBUG:teuthology.orchestra.run.smithi084:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-13T02:02:08.971 DEBUG:teuthology.orchestra.run.smithi175:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-13T02:02:09.004 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba on all hosts... 2024-06-13T02:02:09.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-13T02:02:09.009 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-13T02:02:09.013 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba pull 2024-06-13T02:02:09.869 INFO:teuthology.orchestra.run.smithi084.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-13T02:02:09.919 INFO:teuthology.orchestra.run.smithi175.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-13T02:02:10.533 INFO:teuthology.orchestra.run.smithi002.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-13T02:02:51.625 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T02:02:51.625 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-13T02:02:51.625 INFO:teuthology.orchestra.run.smithi002.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-13T02:02:51.625 INFO:teuthology.orchestra.run.smithi002.stdout: "repo_digests": [ 2024-06-13T02:02:51.626 INFO:teuthology.orchestra.run.smithi002.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-13T02:02:51.626 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T02:02:51.626 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T02:02:55.174 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-06-13T02:02:55.175 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-13T02:02:55.175 INFO:teuthology.orchestra.run.smithi084.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-13T02:02:55.175 INFO:teuthology.orchestra.run.smithi084.stdout: "repo_digests": [ 2024-06-13T02:02:55.175 INFO:teuthology.orchestra.run.smithi084.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-13T02:02:55.175 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-06-13T02:02:55.175 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-06-13T02:02:55.721 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-06-13T02:02:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-13T02:02:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: "image_id": "b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1", 2024-06-13T02:02:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: "repo_digests": [ 2024-06-13T02:02:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9" 2024-06-13T02:02:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-06-13T02:02:55.721 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-06-13T02:02:55.745 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph 2024-06-13T02:02:55.846 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph 2024-06-13T02:02:55.878 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph 2024-06-13T02:02:55.905 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /etc/ceph 2024-06-13T02:02:55.999 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /etc/ceph 2024-06-13T02:02:56.027 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /etc/ceph 2024-06-13T02:02:56.051 INFO:tasks.cephadm:Writing seed config... 2024-06-13T02:02:56.052 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-06-13T02:02:56.052 INFO:tasks.cephadm: override: [client] debug client = 20 2024-06-13T02:02:56.052 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-06-13T02:02:56.052 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-06-13T02:02:56.053 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-06-13T02:02:56.053 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-06-13T02:02:56.053 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-06-13T02:02:56.053 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-06-13T02:02:56.053 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-06-13T02:02:56.053 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-06-13T02:02:56.053 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-06-13T02:02:56.053 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-06-13T02:02:56.053 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-06-13T02:02:56.053 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-06-13T02:02:56.053 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-06-13T02:02:56.053 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-06-13T02:02:56.053 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-06-13T02:02:56.054 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-06-13T02:02:56.054 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-06-13T02:02:56.054 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-06-13T02:02:56.054 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-06-13T02:02:56.054 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-06-13T02:02:56.054 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-06-13T02:02:56.054 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-06-13T02:02:56.054 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-06-13T02:02:56.054 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-06-13T02:02:56.054 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-06-13T02:02:56.054 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-06-13T02:02:56.054 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-06-13T02:02:56.055 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-06-13T02:02:56.055 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-06-13T02:02:56.055 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-06-13T02:02:56.055 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-06-13T02:02:56.055 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-06-13T02:02:56.055 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-06-13T02:02:56.055 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-06-13T02:02:56.055 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-06-13T02:02:56.055 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-06-13T02:02:56.055 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-06-13T02:02:56.055 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-06-13T02:02:56.055 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-06-13T02:02:56.055 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-06-13T02:02:56.056 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-06-13T02:02:56.056 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-06-13T02:02:56.056 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-06-13T02:02:56.056 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-06-13T02:02:56.056 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:02:56.057 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-06-13T02:02:56.115 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = efed8ab4-2928-11ef-bc9c-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-06-13T02:02:56.116 DEBUG:teuthology.orchestra.run.smithi002:mon.a> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mon.a.service 2024-06-13T02:02:56.121 DEBUG:teuthology.orchestra.run.smithi002:mgr.x> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.x.service 2024-06-13T02:02:56.166 INFO:tasks.cephadm:Bootstrapping... 2024-06-13T02:02:56.166 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba -v bootstrap --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.2 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-06-13T02:02:56.444 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-06-13T02:02:56.444 INFO:teuthology.orchestra.run.smithi002.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba', '-v', 'bootstrap', '--fsid', 'efed8ab4-2928-11ef-bc9c-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.2', '--skip-admin-label'] 2024-06-13T02:02:56.444 INFO:teuthology.orchestra.run.smithi002.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-06-13T02:02:56.444 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying podman|docker is present... 2024-06-13T02:02:56.507 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.1.0 2024-06-13T02:02:56.508 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying lvm2 is present... 2024-06-13T02:02:56.508 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying time synchronization is in place... 2024-06-13T02:02:56.524 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-13T02:02:56.524 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-13T02:02:56.538 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-13T02:02:56.538 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-06-13T02:02:56.554 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-06-13T02:02:56.570 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-06-13T02:02:56.570 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-06-13T02:02:56.570 INFO:teuthology.orchestra.run.smithi002.stdout:Repeating the final host check... 2024-06-13T02:02:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout 5.1.0 2024-06-13T02:02:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:podman (/bin/podman) version 5.1.0 is present 2024-06-13T02:02:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl is present 2024-06-13T02:02:56.628 INFO:teuthology.orchestra.run.smithi002.stdout:lvcreate is present 2024-06-13T02:02:56.642 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-13T02:02:56.642 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-13T02:02:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-13T02:02:56.656 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-06-13T02:02:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout enabled 2024-06-13T02:02:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout active 2024-06-13T02:02:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:Unit chronyd.service is enabled and running 2024-06-13T02:02:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:Host looks OK 2024-06-13T02:02:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:Cluster fsid: efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:02:56.686 INFO:teuthology.orchestra.run.smithi002.stdout:Acquiring lock 140152516556160 on /run/cephadm/efed8ab4-2928-11ef-bc9c-c7b262605968.lock 2024-06-13T02:02:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:Lock 140152516556160 acquired on /run/cephadm/efed8ab4-2928-11ef-bc9c-c7b262605968.lock 2024-06-13T02:02:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 3300 ... 2024-06-13T02:02:56.687 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying IP 172.21.15.2 port 6789 ... 2024-06-13T02:02:56.688 INFO:teuthology.orchestra.run.smithi002.stdout:Base mon IP(s) is [172.21.15.2:3300, 172.21.15.2:6789], mon addrv is [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-06-13T02:02:56.696 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.2 metric 100 2024-06-13T02:02:56.696 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.2 metric 100 2024-06-13T02:02:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-06-13T02:02:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-06-13T02:02:56.702 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-06-13T02:02:56.708 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-06-13T02:02:56.709 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-06-13T02:02:56.709 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-13T02:02:56.709 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-06-13T02:02:56.709 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-06-13T02:02:56.709 INFO:teuthology.orchestra.run.smithi002.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-13T02:02:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-06-13T02:02:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:Mon IP `172.21.15.2` is in CIDR network `172.21.0.0/20` 2024-06-13T02:02:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-06-13T02:02:56.711 INFO:teuthology.orchestra.run.smithi002.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-06-13T02:02:56.712 INFO:teuthology.orchestra.run.smithi002.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-13T02:03:05.532 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stdout b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 2024-06-13T02:03:05.532 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba... 2024-06-13T02:03:05.532 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Getting image source signatures 2024-06-13T02:03:05.532 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:53b2d4191269e9d20972bfa652565296fad6514cf6a3d99f19db644875f67876 2024-06-13T02:03:05.532 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying blob sha256:3ca969c7b6d79946c6f10490fffc00028babe7df67f50ed53c7bc209325e0612 2024-06-13T02:03:05.532 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Copying config sha256:b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 2024-06-13T02:03:05.532 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/podman: stderr Writing manifest to image destination 2024-06-13T02:03:06.728 INFO:teuthology.orchestra.run.smithi002.stdout:ceph: stdout ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-13T02:03:06.729 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph version: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc) 2024-06-13T02:03:06.729 INFO:teuthology.orchestra.run.smithi002.stdout:Extracting ceph user uid/gid from container image... 2024-06-13T02:03:07.847 INFO:teuthology.orchestra.run.smithi002.stdout:stat: stdout 167 167 2024-06-13T02:03:07.847 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial keys... 2024-06-13T02:03:08.935 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQBcU2pmWdNPEhAAoyezDJnfZwq3jimkcxqSww== 2024-06-13T02:03:10.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQBdU2pmylYtGBAAOiipyEz9XeNxtJI0iwuwhg== 2024-06-13T02:03:11.779 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph-authtool: stdout AQBeU2pmkYGRLBAA6RLhUCUcYkTwELcps56BIA== 2024-06-13T02:03:11.780 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial monmap... 2024-06-13T02:03:12.932 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-13T02:03:12.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-06-13T02:03:12.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:03:12.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-13T02:03:12.933 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool for a [v2:172.21.15.2:3300,v1:172.21.15.2:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-13T02:03:12.933 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = quincy 2024-06-13T02:03:12.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: set fsid to efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:03:12.933 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-13T02:03:12.933 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:03:12.934 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mon... 2024-06-13T02:03:13.982 INFO:teuthology.orchestra.run.smithi002.stdout:create mon.a on 2024-06-13T02:03:14.381 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-06-13T02:03:14.629 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-06-13T02:03:14.919 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-efed8ab4-2928-11ef-bc9c-c7b262605968.target → /etc/systemd/system/ceph-efed8ab4-2928-11ef-bc9c-c7b262605968.target. 2024-06-13T02:03:14.919 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-efed8ab4-2928-11ef-bc9c-c7b262605968.target → /etc/systemd/system/ceph-efed8ab4-2928-11ef-bc9c-c7b262605968.target. 2024-06-13T02:03:15.321 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mon.a 2024-06-13T02:03:15.322 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mon.a.service: Unit ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mon.a.service not loaded. 2024-06-13T02:03:15.633 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-efed8ab4-2928-11ef-bc9c-c7b262605968.target.wants/ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mon.a.service → /etc/systemd/system/ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@.service. 2024-06-13T02:03:16.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:16 smithi002 podman[31561]: 2024-06-13 02:03:16.06802976 +0000 UTC m=+0.133608255 container create a8c6c59b04f4c6fbea66cfa562b1bb190c85b197aba7450e5980a07d10aa93d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T02:03:16.324 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:16 smithi002 podman[31561]: 2024-06-13 02:03:16.321556776 +0000 UTC m=+0.387135321 container init a8c6c59b04f4c6fbea66cfa562b1bb190c85b197aba7450e5980a07d10aa93d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=) 2024-06-13T02:03:16.446 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-13T02:03:16.446 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-06-13T02:03:16.465 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-13T02:03:16.465 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-06-13T02:03:16.466 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-06-13T02:03:16.466 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-06-13T02:03:16.467 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon to start... 2024-06-13T02:03:16.467 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mon... 2024-06-13T02:03:16.614 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:16 smithi002 podman[31561]: 2024-06-13 02:03:16.333393885 +0000 UTC m=+0.398972390 container start a8c6c59b04f4c6fbea66cfa562b1bb190c85b197aba7450e5980a07d10aa93d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T02:03:16.614 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:16 smithi002 bash[31561]: a8c6c59b04f4c6fbea66cfa562b1bb190c85b197aba7450e5980a07d10aa93d4 2024-06-13T02:03:16.614 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:16 smithi002 ceph-mon[31580]: mkfs efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:03:16.615 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:16 smithi002 ceph-mon[31580]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-13T02:03:16.615 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:16 smithi002 systemd[1]: Started Ceph mon.a for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:03:17.811 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:17 smithi002 ceph-mon[31580]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-13T02:03:17.812 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:17 smithi002 ceph-mon[31580]: monmap epoch 1 2024-06-13T02:03:17.812 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:17 smithi002 ceph-mon[31580]: fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:03:17.812 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:17 smithi002 ceph-mon[31580]: last_changed 2024-06-13T02:03:12.349818+0000 2024-06-13T02:03:17.812 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:17 smithi002 ceph-mon[31580]: created 2024-06-13T02:03:12.349818+0000 2024-06-13T02:03:17.812 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:17 smithi002 ceph-mon[31580]: min_mon_release 19 (squid) 2024-06-13T02:03:17.812 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:17 smithi002 ceph-mon[31580]: election_strategy: 1 2024-06-13T02:03:17.812 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:17 smithi002 ceph-mon[31580]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T02:03:17.812 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:17 smithi002 ceph-mon[31580]: fsmap 2024-06-13T02:03:17.812 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:17 smithi002 ceph-mon[31580]: osdmap e1: 0 total, 0 up, 0 in 2024-06-13T02:03:17.812 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:17 smithi002 ceph-mon[31580]: mgrmap e1: no daemons active 2024-06-13T02:03:17.812 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:17 smithi002 ceph-mon[31580]: from='client.? 172.21.15.2:0/1508277949' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-06-13T02:03:17.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout cluster: 2024-06-13T02:03:17.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout id: efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:03:17.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-06-13T02:03:17.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T02:03:17.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout services: 2024-06-13T02:03:17.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.83618s) 2024-06-13T02:03:17.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-06-13T02:03:17.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-06-13T02:03:17.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T02:03:17.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout data: 2024-06-13T02:03:17.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-06-13T02:03:17.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-06-13T02:03:17.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-06-13T02:03:17.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout pgs: 2024-06-13T02:03:17.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T02:03:17.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.153+0000 7f20e5400700 1 Processor -- start 2024-06-13T02:03:17.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.153+0000 7f20e5400700 1 -- start start 2024-06-13T02:03:17.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.153+0000 7f20e5400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20e0106b90 0x7f20e0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:17.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.153+0000 7f20e5400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f20e0107580 con 0x7f20e0106b90 2024-06-13T02:03:17.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.154+0000 7f20dfe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20e0106b90 0x7f20e0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:17.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.154+0000 7f20dfe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20e0106b90 0x7f20e0106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49850/0 (socket says 172.21.15.2:49850) 2024-06-13T02:03:17.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.154+0000 7f20dfe00700 1 -- 172.21.15.2:0/2409099167 learned_addr learned my addr 172.21.15.2:0/2409099167 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:17.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.155+0000 7f20dfe00700 1 -- 172.21.15.2:0/2409099167 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e0107d90 con 0x7f20e0106b90 2024-06-13T02:03:17.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.155+0000 7f20dfe00700 1 --2- 172.21.15.2:0/2409099167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20e0106b90 0x7f20e0106fb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f20d00098a0 tx=0x7f20d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1d8563fbcd890e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:17.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.155+0000 7f20df400700 1 -- 172.21.15.2:0/2409099167 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20d0004160 con 0x7f20e0106b90 2024-06-13T02:03:17.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.155+0000 7f20df400700 1 -- 172.21.15.2:0/2409099167 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d0004300 con 0x7f20e0106b90 2024-06-13T02:03:17.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.155+0000 7f20df400700 1 -- 172.21.15.2:0/2409099167 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20d00036a0 con 0x7f20e0106b90 2024-06-13T02:03:17.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.156+0000 7f20e5400700 1 -- 172.21.15.2:0/2409099167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20e0106b90 msgr2=0x7f20e0106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:17.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.156+0000 7f20e5400700 1 --2- 172.21.15.2:0/2409099167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20e0106b90 0x7f20e0106fb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f20d00098a0 tx=0x7f20d0009bb0 comp rx=0 tx=0).stop 2024-06-13T02:03:17.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.156+0000 7f20e5400700 1 -- 172.21.15.2:0/2409099167 shutdown_connections 2024-06-13T02:03:17.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.156+0000 7f20e5400700 1 --2- 172.21.15.2:0/2409099167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20e0106b90 0x7f20e0106fb0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:17.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.156+0000 7f20e5400700 1 -- 172.21.15.2:0/2409099167 >> 172.21.15.2:0/2409099167 conn(0x7f20e0102130 msgr2=0x7f20e0104570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:17.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.156+0000 7f20e5400700 1 -- 172.21.15.2:0/2409099167 shutdown_connections 2024-06-13T02:03:17.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.156+0000 7f20e5400700 1 -- 172.21.15.2:0/2409099167 wait complete. 2024-06-13T02:03:17.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.157+0000 7f20e5400700 1 Processor -- start 2024-06-13T02:03:17.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.158+0000 7f20e5400700 1 -- start start 2024-06-13T02:03:17.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.158+0000 7f20e5400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20e0106b90 0x7f20e019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:17.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.158+0000 7f20e5400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f20e01082c0 con 0x7f20e0106b90 2024-06-13T02:03:17.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.158+0000 7f20dfe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20e0106b90 0x7f20e019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:17.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.158+0000 7f20dfe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20e0106b90 0x7f20e019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49856/0 (socket says 172.21.15.2:49856) 2024-06-13T02:03:17.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.158+0000 7f20dfe00700 1 -- 172.21.15.2:0/1508277949 learned_addr learned my addr 172.21.15.2:0/1508277949 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:17.833 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.159+0000 7f20dfe00700 1 -- 172.21.15.2:0/1508277949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e019dbe0 con 0x7f20e0106b90 2024-06-13T02:03:17.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.159+0000 7f20dfe00700 1 --2- 172.21.15.2:0/1508277949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20e0106b90 0x7f20e019d6a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f20d0000c00 tx=0x7f20d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:17.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.159+0000 7f20dd600700 1 -- 172.21.15.2:0/1508277949 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20d0003db0 con 0x7f20e0106b90 2024-06-13T02:03:17.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.159+0000 7f20dd600700 1 -- 172.21.15.2:0/1508277949 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d0011630 con 0x7f20e0106b90 2024-06-13T02:03:17.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.159+0000 7f20dd600700 1 -- 172.21.15.2:0/1508277949 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20d0011950 con 0x7f20e0106b90 2024-06-13T02:03:17.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.159+0000 7f20e5400700 1 -- 172.21.15.2:0/1508277949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e019de70 con 0x7f20e0106b90 2024-06-13T02:03:17.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.159+0000 7f20e5400700 1 -- 172.21.15.2:0/1508277949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e01a0b60 con 0x7f20e0106b90 2024-06-13T02:03:17.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.160+0000 7f20dd600700 1 -- 172.21.15.2:0/1508277949 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f20d001a460 con 0x7f20e0106b90 2024-06-13T02:03:17.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.160+0000 7f20dd600700 1 -- 172.21.15.2:0/1508277949 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f20d001b780 con 0x7f20e0106b90 2024-06-13T02:03:17.835 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.161+0000 7f20e5400700 1 -- 172.21.15.2:0/1508277949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e00695a0 con 0x7f20e0106b90 2024-06-13T02:03:17.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.164+0000 7f20dd600700 1 -- 172.21.15.2:0/1508277949 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f20d001b980 con 0x7f20e0106b90 2024-06-13T02:03:17.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.245+0000 7f20e5400700 1 -- 172.21.15.2:0/1508277949 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f20e002def0 con 0x7f20e0106b90 2024-06-13T02:03:17.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.245+0000 7f20dd600700 1 -- 172.21.15.2:0/1508277949 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+316 (secure 0 0 0) 0x7f20d001bb60 con 0x7f20e0106b90 2024-06-13T02:03:17.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.246+0000 7f20e5400700 1 -- 172.21.15.2:0/1508277949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20e0106b90 msgr2=0x7f20e019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:17.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.246+0000 7f20e5400700 1 --2- 172.21.15.2:0/1508277949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20e0106b90 0x7f20e019d6a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f20d0000c00 tx=0x7f20d0004750 comp rx=0 tx=0).stop 2024-06-13T02:03:17.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.247+0000 7f20e5400700 1 -- 172.21.15.2:0/1508277949 shutdown_connections 2024-06-13T02:03:17.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.247+0000 7f20e5400700 1 --2- 172.21.15.2:0/1508277949 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20e0106b90 0x7f20e019d6a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:17.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.247+0000 7f20e5400700 1 -- 172.21.15.2:0/1508277949 >> 172.21.15.2:0/1508277949 conn(0x7f20e0102130 msgr2=0x7f20e01942e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:17.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.247+0000 7f20e5400700 1 -- 172.21.15.2:0/1508277949 shutdown_connections 2024-06-13T02:03:17.836 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:17.247+0000 7f20e5400700 1 -- 172.21.15.2:0/1508277949 wait complete. 2024-06-13T02:03:17.836 INFO:teuthology.orchestra.run.smithi002.stdout:mon is available 2024-06-13T02:03:17.837 INFO:teuthology.orchestra.run.smithi002.stdout:Assimilating anything we can from ceph.conf... 2024-06-13T02:03:18.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:18 smithi002 ceph-mon[31580]: from='client.? 172.21.15.2:0/358559641' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-13T02:03:18.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:18 smithi002 ceph-mon[31580]: from='client.? 172.21.15.2:0/358559641' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-06-13T02:03:19.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T02:03:19.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-06-13T02:03:19.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:03:19.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.2:3300,v1:172.21.15.2:6789] 2024-06-13T02:03:19.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-13T02:03:19.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-13T02:03:19.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-13T02:03:19.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-13T02:03:19.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T02:03:19.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-13T02:03:19.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-13T02:03:19.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T02:03:19.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-06-13T02:03:19.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-13T02:03:19.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-13T02:03:19.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-13T02:03:19.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-13T02:03:19.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-13T02:03:19.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.472+0000 7f09bc000700 1 Processor -- start 2024-06-13T02:03:19.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.473+0000 7f09bc000700 1 -- start start 2024-06-13T02:03:19.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.473+0000 7f09bc000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09b410a090 0x7f09b410a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:19.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.473+0000 7f09bc000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f09b410aa80 con 0x7f09b410a090 2024-06-13T02:03:19.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.474+0000 7f09b9600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09b410a090 0x7f09b410a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:19.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.474+0000 7f09b9600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09b410a090 0x7f09b410a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49872/0 (socket says 172.21.15.2:49872) 2024-06-13T02:03:19.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.474+0000 7f09b9600700 1 -- 172.21.15.2:0/3206208283 learned_addr learned my addr 172.21.15.2:0/3206208283 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:19.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.475+0000 7f09b9600700 1 -- 172.21.15.2:0/3206208283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b410b260 con 0x7f09b410a090 2024-06-13T02:03:19.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.475+0000 7f09b9600700 1 --2- 172.21.15.2:0/3206208283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09b410a090 0x7f09b410a4b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f09a80098a0 tx=0x7f09a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c8746895870dd server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:19.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.475+0000 7f09b3e00700 1 -- 172.21.15.2:0/3206208283 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09a8004160 con 0x7f09b410a090 2024-06-13T02:03:19.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.475+0000 7f09b3e00700 1 -- 172.21.15.2:0/3206208283 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a8004300 con 0x7f09b410a090 2024-06-13T02:03:19.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.475+0000 7f09b3e00700 1 -- 172.21.15.2:0/3206208283 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09a80036a0 con 0x7f09b410a090 2024-06-13T02:03:19.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.476+0000 7f09bc000700 1 -- 172.21.15.2:0/3206208283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09b410a090 msgr2=0x7f09b410a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:19.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.476+0000 7f09bc000700 1 --2- 172.21.15.2:0/3206208283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09b410a090 0x7f09b410a4b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f09a80098a0 tx=0x7f09a8009bb0 comp rx=0 tx=0).stop 2024-06-13T02:03:19.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.476+0000 7f09bc000700 1 -- 172.21.15.2:0/3206208283 shutdown_connections 2024-06-13T02:03:19.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.476+0000 7f09bc000700 1 --2- 172.21.15.2:0/3206208283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09b410a090 0x7f09b410a4b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:19.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.476+0000 7f09bc000700 1 -- 172.21.15.2:0/3206208283 >> 172.21.15.2:0/3206208283 conn(0x7f09b407d440 msgr2=0x7f09b407d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:19.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.476+0000 7f09bc000700 1 -- 172.21.15.2:0/3206208283 shutdown_connections 2024-06-13T02:03:19.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.476+0000 7f09bc000700 1 -- 172.21.15.2:0/3206208283 wait complete. 2024-06-13T02:03:19.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.477+0000 7f09bc000700 1 Processor -- start 2024-06-13T02:03:19.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.477+0000 7f09bc000700 1 -- start start 2024-06-13T02:03:19.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.478+0000 7f09bc000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09b410a090 0x7f09b419d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:19.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.478+0000 7f09bc000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f09b410b790 con 0x7f09b410a090 2024-06-13T02:03:19.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.478+0000 7f09b9600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09b410a090 0x7f09b419d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:19.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.478+0000 7f09b9600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09b410a090 0x7f09b419d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49880/0 (socket says 172.21.15.2:49880) 2024-06-13T02:03:19.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.478+0000 7f09b9600700 1 -- 172.21.15.2:0/358559641 learned_addr learned my addr 172.21.15.2:0/358559641 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:19.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.478+0000 7f09b9600700 1 -- 172.21.15.2:0/358559641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b419dd00 con 0x7f09b410a090 2024-06-13T02:03:19.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.479+0000 7f09b9600700 1 --2- 172.21.15.2:0/358559641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09b410a090 0x7f09b419d7c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f09a8000c00 tx=0x7f09a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:19.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.479+0000 7f09b2000700 1 -- 172.21.15.2:0/358559641 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09a8003db0 con 0x7f09b410a090 2024-06-13T02:03:19.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.479+0000 7f09b2000700 1 -- 172.21.15.2:0/358559641 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a8011630 con 0x7f09b410a090 2024-06-13T02:03:19.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.479+0000 7f09b2000700 1 -- 172.21.15.2:0/358559641 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09a8011950 con 0x7f09b410a090 2024-06-13T02:03:19.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.479+0000 7f09bc000700 1 -- 172.21.15.2:0/358559641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b419df90 con 0x7f09b410a090 2024-06-13T02:03:19.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.479+0000 7f09bc000700 1 -- 172.21.15.2:0/358559641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b41a0c80 con 0x7f09b410a090 2024-06-13T02:03:19.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.480+0000 7f09b2000700 1 -- 172.21.15.2:0/358559641 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f09a801a460 con 0x7f09b410a090 2024-06-13T02:03:19.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.480+0000 7f09b2000700 1 -- 172.21.15.2:0/358559641 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f09a801b780 con 0x7f09b410a090 2024-06-13T02:03:19.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.481+0000 7f09bc000700 1 -- 172.21.15.2:0/358559641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09b4063af0 con 0x7f09b410a090 2024-06-13T02:03:19.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.484+0000 7f09b2000700 1 -- 172.21.15.2:0/358559641 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f09a8031020 con 0x7f09b410a090 2024-06-13T02:03:19.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.561+0000 7f09bc000700 1 -- 172.21.15.2:0/358559641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f09b402dfa0 con 0x7f09b410a090 2024-06-13T02:03:19.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.571+0000 7f09b2000700 1 -- 172.21.15.2:0/358559641 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+427 (secure 0 0 0) 0x7f09a801b980 con 0x7f09b410a090 2024-06-13T02:03:19.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.572+0000 7f09bc000700 1 -- 172.21.15.2:0/358559641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09b410a090 msgr2=0x7f09b419d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:19.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.572+0000 7f09bc000700 1 --2- 172.21.15.2:0/358559641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09b410a090 0x7f09b419d7c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f09a8000c00 tx=0x7f09a8004750 comp rx=0 tx=0).stop 2024-06-13T02:03:19.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.573+0000 7f09bc000700 1 -- 172.21.15.2:0/358559641 shutdown_connections 2024-06-13T02:03:19.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.573+0000 7f09bc000700 1 --2- 172.21.15.2:0/358559641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f09b410a090 0x7f09b419d7c0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:19.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.573+0000 7f09bc000700 1 -- 172.21.15.2:0/358559641 >> 172.21.15.2:0/358559641 conn(0x7f09b407d440 msgr2=0x7f09b41943c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:19.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.573+0000 7f09bc000700 1 -- 172.21.15.2:0/358559641 shutdown_connections 2024-06-13T02:03:19.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:18.574+0000 7f09bc000700 1 -- 172.21.15.2:0/358559641 wait complete. 2024-06-13T02:03:19.205 INFO:teuthology.orchestra.run.smithi002.stdout:Generating new minimal ceph.conf... 2024-06-13T02:03:20.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:20 smithi002 ceph-mon[31580]: from='client.? 172.21.15.2:0/1108470702' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:03:20.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.862+0000 7f39cf800700 1 Processor -- start 2024-06-13T02:03:20.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.862+0000 7f39cf800700 1 -- start start 2024-06-13T02:03:20.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.863+0000 7f39cf800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c807de60 0x7f39c807c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:20.635 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.863+0000 7f39cf800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39c807c8e0 con 0x7f39c807de60 2024-06-13T02:03:20.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.864+0000 7f39cce00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c807de60 0x7f39c807c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:20.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.864+0000 7f39cce00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c807de60 0x7f39c807c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49890/0 (socket says 172.21.15.2:49890) 2024-06-13T02:03:20.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.864+0000 7f39cce00700 1 -- 172.21.15.2:0/2062193688 learned_addr learned my addr 172.21.15.2:0/2062193688 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:20.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.864+0000 7f39cce00700 1 -- 172.21.15.2:0/2062193688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c807ca60 con 0x7f39c807de60 2024-06-13T02:03:20.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.865+0000 7f39cce00700 1 --2- 172.21.15.2:0/2062193688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c807de60 0x7f39c807c310 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0098a0 tx=0x7f39bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554b0c3e0ef6a21 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:20.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.865+0000 7f39c7400700 1 -- 172.21.15.2:0/2062193688 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39bc004160 con 0x7f39c807de60 2024-06-13T02:03:20.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.865+0000 7f39c7400700 1 -- 172.21.15.2:0/2062193688 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39bc004300 con 0x7f39c807de60 2024-06-13T02:03:20.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.865+0000 7f39c7400700 1 -- 172.21.15.2:0/2062193688 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39bc011b50 con 0x7f39c807de60 2024-06-13T02:03:20.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.866+0000 7f39cf800700 1 -- 172.21.15.2:0/2062193688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c807de60 msgr2=0x7f39c807c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:20.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.866+0000 7f39cf800700 1 --2- 172.21.15.2:0/2062193688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c807de60 0x7f39c807c310 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0098a0 tx=0x7f39bc009bb0 comp rx=0 tx=0).stop 2024-06-13T02:03:20.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.866+0000 7f39cf800700 1 -- 172.21.15.2:0/2062193688 shutdown_connections 2024-06-13T02:03:20.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.866+0000 7f39cf800700 1 --2- 172.21.15.2:0/2062193688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c807de60 0x7f39c807c310 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:20.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.866+0000 7f39cf800700 1 -- 172.21.15.2:0/2062193688 >> 172.21.15.2:0/2062193688 conn(0x7f39c8103430 msgr2=0x7f39c8105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:20.636 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.866+0000 7f39cf800700 1 -- 172.21.15.2:0/2062193688 shutdown_connections 2024-06-13T02:03:20.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.866+0000 7f39cf800700 1 -- 172.21.15.2:0/2062193688 wait complete. 2024-06-13T02:03:20.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.867+0000 7f39cf800700 1 Processor -- start 2024-06-13T02:03:20.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.867+0000 7f39cf800700 1 -- start start 2024-06-13T02:03:20.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.868+0000 7f39cf800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c807de60 0x7f39c819e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:20.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.868+0000 7f39cf800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39c810e460 con 0x7f39c807de60 2024-06-13T02:03:20.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.868+0000 7f39cce00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c807de60 0x7f39c819e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:20.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.868+0000 7f39cce00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c807de60 0x7f39c819e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49894/0 (socket says 172.21.15.2:49894) 2024-06-13T02:03:20.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.868+0000 7f39cce00700 1 -- 172.21.15.2:0/1108470702 learned_addr learned my addr 172.21.15.2:0/1108470702 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:20.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.868+0000 7f39cce00700 1 -- 172.21.15.2:0/1108470702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c819e540 con 0x7f39c807de60 2024-06-13T02:03:20.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.869+0000 7f39cce00700 1 --2- 172.21.15.2:0/1108470702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c807de60 0x7f39c819e000 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f39bc011b60 tx=0x7f39bc011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:20.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.869+0000 7f39c5600700 1 -- 172.21.15.2:0/1108470702 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39bc003b20 con 0x7f39c807de60 2024-06-13T02:03:20.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.869+0000 7f39c5600700 1 -- 172.21.15.2:0/1108470702 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39bc003cc0 con 0x7f39c807de60 2024-06-13T02:03:20.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.869+0000 7f39c5600700 1 -- 172.21.15.2:0/1108470702 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39bc024840 con 0x7f39c807de60 2024-06-13T02:03:20.637 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.869+0000 7f39cf800700 1 -- 172.21.15.2:0/1108470702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c819e7d0 con 0x7f39c807de60 2024-06-13T02:03:20.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.869+0000 7f39cf800700 1 -- 172.21.15.2:0/1108470702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c81a14c0 con 0x7f39c807de60 2024-06-13T02:03:20.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.869+0000 7f39c5600700 1 -- 172.21.15.2:0/1108470702 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f39bc022020 con 0x7f39c807de60 2024-06-13T02:03:20.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.870+0000 7f39c5600700 1 -- 172.21.15.2:0/1108470702 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f39bc011e00 con 0x7f39c807de60 2024-06-13T02:03:20.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.871+0000 7f39cf800700 1 -- 172.21.15.2:0/1108470702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c8063af0 con 0x7f39c807de60 2024-06-13T02:03:20.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.873+0000 7f39c5600700 1 -- 172.21.15.2:0/1108470702 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f39bc043dd0 con 0x7f39c807de60 2024-06-13T02:03:20.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.951+0000 7f39cf800700 1 -- 172.21.15.2:0/1108470702 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f39c81a1690 con 0x7f39c807de60 2024-06-13T02:03:20.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.952+0000 7f39c5600700 1 -- 172.21.15.2:0/1108470702 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7f39bc032020 con 0x7f39c807de60 2024-06-13T02:03:20.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.954+0000 7f39cf800700 1 -- 172.21.15.2:0/1108470702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c807de60 msgr2=0x7f39c819e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:20.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.954+0000 7f39cf800700 1 --2- 172.21.15.2:0/1108470702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c807de60 0x7f39c819e000 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f39bc011b60 tx=0x7f39bc011c40 comp rx=0 tx=0).stop 2024-06-13T02:03:20.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.954+0000 7f39cf800700 1 -- 172.21.15.2:0/1108470702 shutdown_connections 2024-06-13T02:03:20.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.954+0000 7f39cf800700 1 --2- 172.21.15.2:0/1108470702 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c807de60 0x7f39c819e000 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:20.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.954+0000 7f39cf800700 1 -- 172.21.15.2:0/1108470702 >> 172.21.15.2:0/1108470702 conn(0x7f39c8103430 msgr2=0x7f39c8103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:20.638 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.954+0000 7f39cf800700 1 -- 172.21.15.2:0/1108470702 shutdown_connections 2024-06-13T02:03:20.639 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:19.954+0000 7f39cf800700 1 -- 172.21.15.2:0/1108470702 wait complete. 2024-06-13T02:03:20.639 INFO:teuthology.orchestra.run.smithi002.stdout:Restarting the monitor... 2024-06-13T02:03:20.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:20 smithi002 systemd[1]: Stopping Ceph mon.a for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:03:21.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:21 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a[31576]: 2024-06-13T02:03:21.290+0000 7fb179000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:03:21.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:21 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a[31576]: 2024-06-13T02:03:21.290+0000 7fb179000700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-06-13T02:03:21.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:21 smithi002 podman[31825]: 2024-06-13 02:03:21.474401318 +0000 UTC m=+0.498443905 container died a8c6c59b04f4c6fbea66cfa562b1bb190c85b197aba7450e5980a07d10aa93d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-3d89acc) 2024-06-13T02:03:22.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:21 smithi002 podman[31825]: 2024-06-13 02:03:21.857958866 +0000 UTC m=+0.882001469 container cleanup a8c6c59b04f4c6fbea66cfa562b1bb190c85b197aba7450e5980a07d10aa93d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-3d89acc, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2) 2024-06-13T02:03:22.109 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:21 smithi002 bash[31825]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a 2024-06-13T02:03:22.372 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:22 smithi002 podman[31842]: 2024-06-13 02:03:22.108594905 +0000 UTC m=+0.617317310 container remove a8c6c59b04f4c6fbea66cfa562b1bb190c85b197aba7450e5980a07d10aa93d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-06-13T02:03:22.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:22 smithi002 systemd[1]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mon.a.service: Deactivated successfully. 2024-06-13T02:03:22.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:22 smithi002 systemd[1]: Stopped Ceph mon.a for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:03:22.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:22 smithi002 systemd[1]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mon.a.service: Consumed 1.807s CPU time. 2024-06-13T02:03:22.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:22 smithi002 systemd[1]: Starting Ceph mon.a for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:03:22.998 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:22 smithi002 podman[31940]: 2024-06-13 02:03:22.645870541 +0000 UTC m=+0.032006930 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T02:03:22.998 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:22 smithi002 podman[31940]: 2024-06-13 02:03:22.760246633 +0000 UTC m=+0.146383040 container create 9c465d8cf57b7bbc6dffeeb70e4a90352b1ac268e9f1d1cd9e419cc16852016e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2) 2024-06-13T02:03:22.998 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:22 smithi002 podman[31940]: 2024-06-13 02:03:22.996960842 +0000 UTC m=+0.383097340 container init 9c465d8cf57b7bbc6dffeeb70e4a90352b1ac268e9f1d1cd9e419cc16852016e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS) 2024-06-13T02:03:23.105 INFO:teuthology.orchestra.run.smithi002.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-06-13T02:03:23.253 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 podman[31940]: 2024-06-13 02:03:23.008172478 +0000 UTC m=+0.394308876 container start 9c465d8cf57b7bbc6dffeeb70e4a90352b1ac268e9f1d1cd9e419cc16852016e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T02:03:23.253 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: set uid:gid to 167:167 (ceph:ceph) 2024-06-13T02:03:23.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc), process ceph-mon, pid 2 2024-06-13T02:03:23.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: pidfile_write: ignore empty --pid-file 2024-06-13T02:03:23.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: load: jerasure load: lrc 2024-06-13T02:03:23.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: RocksDB version: 7.9.2 2024-06-13T02:03:23.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Git sha 0 2024-06-13T02:03:23.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Compile date 2024-05-30 15:42:47 2024-06-13T02:03:23.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: DB SUMMARY 2024-06-13T02:03:23.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: DB Session ID: 5DTN4BACGB130GSBRRSI 2024-06-13T02:03:23.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: CURRENT file: CURRENT 2024-06-13T02:03:23.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: IDENTITY file: IDENTITY 2024-06-13T02:03:23.254 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-06-13T02:03:23.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-06-13T02:03:23.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104710 ; 2024-06-13T02:03:23.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.error_if_exists: 0 2024-06-13T02:03:23.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.create_if_missing: 0 2024-06-13T02:03:23.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.paranoid_checks: 1 2024-06-13T02:03:23.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-13T02:03:23.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-13T02:03:23.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-13T02:03:23.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.env: 0x55aaf9431c60 2024-06-13T02:03:23.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.fs: PosixFileSystem 2024-06-13T02:03:23.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.info_log: 0x55aafbea3b60 2024-06-13T02:03:23.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_file_opening_threads: 16 2024-06-13T02:03:23.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.statistics: (nil) 2024-06-13T02:03:23.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.use_fsync: 0 2024-06-13T02:03:23.256 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_log_file_size: 0 2024-06-13T02:03:23.256 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-13T02:03:23.256 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-13T02:03:23.256 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.keep_log_file_num: 1000 2024-06-13T02:03:23.256 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.recycle_log_file_num: 0 2024-06-13T02:03:23.256 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.allow_fallocate: 1 2024-06-13T02:03:23.257 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.allow_mmap_reads: 0 2024-06-13T02:03:23.257 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.allow_mmap_writes: 0 2024-06-13T02:03:23.257 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.use_direct_reads: 0 2024-06-13T02:03:23.257 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-13T02:03:23.257 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.create_missing_column_families: 0 2024-06-13T02:03:23.257 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.db_log_dir: 2024-06-13T02:03:23.257 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.wal_dir: 2024-06-13T02:03:23.257 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-13T02:03:23.257 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-13T02:03:23.257 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-13T02:03:23.257 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-13T02:03:23.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-13T02:03:23.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-13T02:03:23.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.advise_random_on_open: 1 2024-06-13T02:03:23.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.db_write_buffer_size: 0 2024-06-13T02:03:23.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.write_buffer_manager: 0x55aafbe741e0 2024-06-13T02:03:23.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-13T02:03:23.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-13T02:03:23.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-13T02:03:23.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.rate_limiter: (nil) 2024-06-13T02:03:23.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-13T02:03:23.258 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.wal_recovery_mode: 2 2024-06-13T02:03:23.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.enable_thread_tracking: 0 2024-06-13T02:03:23.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.enable_pipelined_write: 0 2024-06-13T02:03:23.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.unordered_write: 0 2024-06-13T02:03:23.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-13T02:03:23.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-13T02:03:23.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-13T02:03:23.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-13T02:03:23.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.row_cache: None 2024-06-13T02:03:23.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.wal_filter: None 2024-06-13T02:03:23.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-13T02:03:23.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.allow_ingest_behind: 0 2024-06-13T02:03:23.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.two_write_queues: 0 2024-06-13T02:03:23.259 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.manual_wal_flush: 0 2024-06-13T02:03:23.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.wal_compression: 0 2024-06-13T02:03:23.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.atomic_flush: 0 2024-06-13T02:03:23.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-13T02:03:23.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-13T02:03:23.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-13T02:03:23.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.log_readahead_size: 0 2024-06-13T02:03:23.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-13T02:03:23.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.best_efforts_recovery: 0 2024-06-13T02:03:23.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-13T02:03:23.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-13T02:03:23.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.allow_data_in_errors: 0 2024-06-13T02:03:23.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.db_host_id: __hostname__ 2024-06-13T02:03:23.260 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-13T02:03:23.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_background_jobs: 2 2024-06-13T02:03:23.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_background_compactions: -1 2024-06-13T02:03:23.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_subcompactions: 1 2024-06-13T02:03:23.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-13T02:03:23.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-13T02:03:23.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-13T02:03:23.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_total_wal_size: 0 2024-06-13T02:03:23.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-13T02:03:23.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-13T02:03:23.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-13T02:03:23.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-13T02:03:23.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_open_files: -1 2024-06-13T02:03:23.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.bytes_per_sync: 0 2024-06-13T02:03:23.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-13T02:03:23.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-13T02:03:23.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compaction_readahead_size: 0 2024-06-13T02:03:23.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_background_flushes: -1 2024-06-13T02:03:23.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Compression algorithms supported: 2024-06-13T02:03:23.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-13T02:03:23.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: kZSTD supported: 0 2024-06-13T02:03:23.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: kXpressCompression supported: 0 2024-06-13T02:03:23.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: kLZ4HCCompression supported: 1 2024-06-13T02:03:23.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: kZlibCompression supported: 1 2024-06-13T02:03:23.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: kSnappyCompression supported: 1 2024-06-13T02:03:23.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: kLZ4Compression supported: 1 2024-06-13T02:03:23.262 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: kBZip2Compression supported: 0 2024-06-13T02:03:23.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-13T02:03:23.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-13T02:03:23.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-06-13T02:03:23.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-13T02:03:23.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-13T02:03:23.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.merge_operator: 2024-06-13T02:03:23.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compaction_filter: None 2024-06-13T02:03:23.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compaction_filter_factory: None 2024-06-13T02:03:23.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.sst_partitioner_factory: None 2024-06-13T02:03:23.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-13T02:03:23.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-13T02:03:23.263 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55aafbea3c80) 2024-06-13T02:03:23.263 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks: 1 2024-06-13T02:03:23.264 INFO:journalctl@ceph.mon.a.smithi002.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-13T02:03:23.264 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-13T02:03:23.264 INFO:journalctl@ceph.mon.a.smithi002.stdout: pin_top_level_index_and_filter: 1 2024-06-13T02:03:23.264 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_type: 0 2024-06-13T02:03:23.264 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_index_type: 0 2024-06-13T02:03:23.264 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_shortening: 1 2024-06-13T02:03:23.264 INFO:journalctl@ceph.mon.a.smithi002.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-13T02:03:23.264 INFO:journalctl@ceph.mon.a.smithi002.stdout: checksum: 4 2024-06-13T02:03:23.264 INFO:journalctl@ceph.mon.a.smithi002.stdout: no_block_cache: 0 2024-06-13T02:03:23.264 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache: 0x55aafbea5090 2024-06-13T02:03:23.264 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_name: BinnedLRUCache 2024-06-13T02:03:23.264 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_options: 2024-06-13T02:03:23.264 INFO:journalctl@ceph.mon.a.smithi002.stdout: capacity : 536870912 2024-06-13T02:03:23.264 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_shard_bits : 4 2024-06-13T02:03:23.265 INFO:journalctl@ceph.mon.a.smithi002.stdout: strict_capacity_limit : 0 2024-06-13T02:03:23.265 INFO:journalctl@ceph.mon.a.smithi002.stdout: high_pri_pool_ratio: 0.000 2024-06-13T02:03:23.265 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_cache_compressed: (nil) 2024-06-13T02:03:23.265 INFO:journalctl@ceph.mon.a.smithi002.stdout: persistent_cache: (nil) 2024-06-13T02:03:23.265 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size: 4096 2024-06-13T02:03:23.265 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_size_deviation: 10 2024-06-13T02:03:23.265 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_restart_interval: 16 2024-06-13T02:03:23.265 INFO:journalctl@ceph.mon.a.smithi002.stdout: index_block_restart_interval: 1 2024-06-13T02:03:23.265 INFO:journalctl@ceph.mon.a.smithi002.stdout: metadata_block_size: 4096 2024-06-13T02:03:23.265 INFO:journalctl@ceph.mon.a.smithi002.stdout: partition_filters: 0 2024-06-13T02:03:23.265 INFO:journalctl@ceph.mon.a.smithi002.stdout: use_delta_encoding: 1 2024-06-13T02:03:23.265 INFO:journalctl@ceph.mon.a.smithi002.stdout: filter_policy: bloomfilter 2024-06-13T02:03:23.265 INFO:journalctl@ceph.mon.a.smithi002.stdout: whole_key_filtering: 1 2024-06-13T02:03:23.266 INFO:journalctl@ceph.mon.a.smithi002.stdout: verify_compression: 0 2024-06-13T02:03:23.266 INFO:journalctl@ceph.mon.a.smithi002.stdout: read_amp_bytes_per_bit: 0 2024-06-13T02:03:23.266 INFO:journalctl@ceph.mon.a.smithi002.stdout: format_version: 5 2024-06-13T02:03:23.266 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_index_compression: 1 2024-06-13T02:03:23.266 INFO:journalctl@ceph.mon.a.smithi002.stdout: block_align: 0 2024-06-13T02:03:23.266 INFO:journalctl@ceph.mon.a.smithi002.stdout: max_auto_readahead_size: 262144 2024-06-13T02:03:23.266 INFO:journalctl@ceph.mon.a.smithi002.stdout: prepopulate_block_cache: 0 2024-06-13T02:03:23.266 INFO:journalctl@ceph.mon.a.smithi002.stdout: initial_auto_readahead_size: 8192 2024-06-13T02:03:23.266 INFO:journalctl@ceph.mon.a.smithi002.stdout: num_file_reads_for_auto_readahead: 2 2024-06-13T02:03:23.266 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.write_buffer_size: 33554432 2024-06-13T02:03:23.266 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_write_buffer_number: 2 2024-06-13T02:03:23.266 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compression: NoCompression 2024-06-13T02:03:23.267 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.bottommost_compression: Disabled 2024-06-13T02:03:23.267 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.prefix_extractor: nullptr 2024-06-13T02:03:23.267 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-13T02:03:23.267 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.num_levels: 7 2024-06-13T02:03:23.267 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-13T02:03:23.268 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-13T02:03:23.268 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-13T02:03:23.268 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-13T02:03:23.268 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-13T02:03:23.268 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-13T02:03:23.268 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-13T02:03:23.268 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-13T02:03:23.268 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-13T02:03:23.268 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-13T02:03:23.268 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-13T02:03:23.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-13T02:03:23.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-13T02:03:23.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compression_opts.level: 32767 2024-06-13T02:03:23.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compression_opts.strategy: 0 2024-06-13T02:03:23.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-13T02:03:23.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-13T02:03:23.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-13T02:03:23.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-13T02:03:23.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compression_opts.enabled: false 2024-06-13T02:03:23.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-13T02:03:23.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-13T02:03:23.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-13T02:03:23.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-13T02:03:23.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.target_file_size_base: 67108864 2024-06-13T02:03:23.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-13T02:03:23.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-13T02:03:23.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-13T02:03:23.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-13T02:03:23.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-13T02:03:23.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-13T02:03:23.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-13T02:03:23.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-13T02:03:23.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-13T02:03:23.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-13T02:03:23.270 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-13T02:03:23.271 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-13T02:03:23.271 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-13T02:03:23.271 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-13T02:03:23.271 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.arena_block_size: 1048576 2024-06-13T02:03:23.271 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-13T02:03:23.271 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-13T02:03:23.271 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.disable_auto_compactions: 0 2024-06-13T02:03:23.271 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-13T02:03:23.271 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-13T02:03:23.271 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-13T02:03:23.271 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-13T02:03:23.271 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-13T02:03:23.271 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-13T02:03:23.272 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-13T02:03:23.272 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-13T02:03:23.272 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-13T02:03:23.272 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-13T02:03:23.272 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.table_properties_collectors: 2024-06-13T02:03:23.272 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.inplace_update_support: 0 2024-06-13T02:03:23.272 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-13T02:03:23.272 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-13T02:03:23.272 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-13T02:03:23.272 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-13T02:03:23.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.bloom_locality: 0 2024-06-13T02:03:23.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.max_successive_merges: 0 2024-06-13T02:03:23.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-13T02:03:23.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.paranoid_file_checks: 0 2024-06-13T02:03:23.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.force_consistency_checks: 1 2024-06-13T02:03:23.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.report_bg_io_stats: 0 2024-06-13T02:03:23.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.ttl: 2592000 2024-06-13T02:03:23.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-13T02:03:23.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-13T02:03:23.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-13T02:03:23.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.enable_blob_files: false 2024-06-13T02:03:23.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.min_blob_size: 0 2024-06-13T02:03:23.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.blob_file_size: 268435456 2024-06-13T02:03:23.273 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-13T02:03:23.274 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-13T02:03:23.274 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-13T02:03:23.274 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-13T02:03:23.274 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-13T02:03:23.274 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.blob_file_starting_level: 0 2024-06-13T02:03:23.274 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-13T02:03:23.274 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-06-13T02:03:23.274 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-06-13T02:03:23.274 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0fdd5ed9-4a03-40cf-bfe0-4dfd84ac3e0f 2024-06-13T02:03:23.274 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718244203069008, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-06-13T02:03:23.274 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-06-13T02:03:23.274 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718244203071288, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99829, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 97739, "index_size": 308, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14175, "raw_average_key_size": 49, "raw_value_size": 90040, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1718244203, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0fdd5ed9-4a03-40cf-bfe0-4dfd84ac3e0f", "db_session_id": "5DTN4BACGB130GSBRRSI", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-06-13T02:03:23.275 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718244203071464, "job": 1, "event": "recovery_finished"} 2024-06-13T02:03:23.275 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-06-13T02:03:23.275 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-13T02:03:23.275 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55aafbf94000 2024-06-13T02:03:23.275 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: DB pointer 0x55aafbf7e000 2024-06-13T02:03:23.275 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-13T02:03:23.275 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-13T02:03:23.275 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** DB Stats ** 2024-06-13T02:03:23.275 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-13T02:03:23.275 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-13T02:03:23.275 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-13T02:03:23.275 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-13T02:03:23.276 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-13T02:03:23.276 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-13T02:03:23.276 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-13T02:03:23.276 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-06-13T02:03:23.276 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-06-13T02:03:23.276 INFO:journalctl@ceph.mon.a.smithi002.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-13T02:03:23.276 INFO:journalctl@ceph.mon.a.smithi002.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-13T02:03:23.276 INFO:journalctl@ceph.mon.a.smithi002.stdout: L0 2/0 99.32 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 62.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-13T02:03:23.276 INFO:journalctl@ceph.mon.a.smithi002.stdout: Sum 2/0 99.32 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 62.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-13T02:03:23.276 INFO:journalctl@ceph.mon.a.smithi002.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 62.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-13T02:03:23.276 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-06-13T02:03:23.276 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** Compaction Stats [default] ** 2024-06-13T02:03:23.276 INFO:journalctl@ceph.mon.a.smithi002.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-13T02:03:23.277 INFO:journalctl@ceph.mon.a.smithi002.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-13T02:03:23.277 INFO:journalctl@ceph.mon.a.smithi002.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 62.1 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-06-13T02:03:23.277 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-06-13T02:03:23.277 INFO:journalctl@ceph.mon.a.smithi002.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-13T02:03:23.277 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-06-13T02:03:23.277 INFO:journalctl@ceph.mon.a.smithi002.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-13T02:03:23.277 INFO:journalctl@ceph.mon.a.smithi002.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-13T02:03:23.277 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-13T02:03:23.277 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-13T02:03:23.277 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-13T02:03:23.277 INFO:journalctl@ceph.mon.a.smithi002.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-13T02:03:23.277 INFO:journalctl@ceph.mon.a.smithi002.stdout: Cumulative compaction: 0.00 GB write, 13.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-13T02:03:23.277 INFO:journalctl@ceph.mon.a.smithi002.stdout: Interval compaction: 0.00 GB write, 13.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-13T02:03:23.278 INFO:journalctl@ceph.mon.a.smithi002.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-13T02:03:23.278 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache BinnedLRUCache@0x55aafbea5090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.2e-05 secs_since: 0 2024-06-13T02:03:23.278 INFO:journalctl@ceph.mon.a.smithi002.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-06-13T02:03:23.278 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-06-13T02:03:23.278 INFO:journalctl@ceph.mon.a.smithi002.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-13T02:03:23.278 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: starting mon.a rank 0 at public addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] at bind addrs [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:03:23.278 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: mon.a@-1(???) e1 preinit fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:03:23.278 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: mon.a@-1(???).mds e1 new map 2024-06-13T02:03:23.278 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: mon.a@-1(???).mds e1 print_map 2024-06-13T02:03:23.278 INFO:journalctl@ceph.mon.a.smithi002.stdout: e1 2024-06-13T02:03:23.278 INFO:journalctl@ceph.mon.a.smithi002.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-13T02:03:23.278 INFO:journalctl@ceph.mon.a.smithi002.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-13T02:03:23.279 INFO:journalctl@ceph.mon.a.smithi002.stdout: legacy client fscid: -1 2024-06-13T02:03:23.279 INFO:journalctl@ceph.mon.a.smithi002.stdout: 2024-06-13T02:03:23.279 INFO:journalctl@ceph.mon.a.smithi002.stdout: No filesystems configured 2024-06-13T02:03:23.279 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-13T02:03:23.279 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T02:03:23.279 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T02:03:23.279 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T02:03:23.279 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-06-13T02:03:23.279 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 bash[31940]: 9c465d8cf57b7bbc6dffeeb70e4a90352b1ac268e9f1d1cd9e419cc16852016e 2024-06-13T02:03:23.279 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 systemd[1]: Started Ceph mon.a for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:03:23.279 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-13T02:03:23.279 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: monmap epoch 1 2024-06-13T02:03:23.279 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:03:23.280 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: last_changed 2024-06-13T02:03:12.349818+0000 2024-06-13T02:03:23.280 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: created 2024-06-13T02:03:12.349818+0000 2024-06-13T02:03:23.280 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: min_mon_release 19 (squid) 2024-06-13T02:03:23.280 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: election_strategy: 1 2024-06-13T02:03:23.280 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T02:03:23.280 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: fsmap 2024-06-13T02:03:23.280 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: osdmap e1: 0 total, 0 up, 0 in 2024-06-13T02:03:23.280 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:23 smithi002 ceph-mon[31960]: mgrmap e1: no daemons active 2024-06-13T02:03:24.598 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.828+0000 7ffa3d400700 1 Processor -- start 2024-06-13T02:03:24.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.828+0000 7ffa3d400700 1 -- start start 2024-06-13T02:03:24.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.829+0000 7ffa3d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa38106770 0x7ffa38106b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:24.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.829+0000 7ffa3d400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3807bdb0 con 0x7ffa38106770 2024-06-13T02:03:24.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.829+0000 7ffa36800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa38106770 0x7ffa38106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:24.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.830+0000 7ffa36800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa38106770 0x7ffa38106b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39252/0 (socket says 172.21.15.2:39252) 2024-06-13T02:03:24.604 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.830+0000 7ffa36800700 1 -- 172.21.15.2:0/240317501 learned_addr learned my addr 172.21.15.2:0/240317501 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:24.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.830+0000 7ffa36800700 1 -- 172.21.15.2:0/240317501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa381070d0 con 0x7ffa38106770 2024-06-13T02:03:24.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.831+0000 7ffa36800700 1 --2- 172.21.15.2:0/240317501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa38106770 0x7ffa38106b90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ffa280098a0 tx=0x7ffa28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36efee9ca87712b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:24.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.831+0000 7ffa35400700 1 -- 172.21.15.2:0/240317501 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa28004160 con 0x7ffa38106770 2024-06-13T02:03:24.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.831+0000 7ffa35400700 1 -- 172.21.15.2:0/240317501 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa28004300 con 0x7ffa38106770 2024-06-13T02:03:24.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.831+0000 7ffa35400700 1 -- 172.21.15.2:0/240317501 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa28011b50 con 0x7ffa38106770 2024-06-13T02:03:24.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.832+0000 7ffa3d400700 1 -- 172.21.15.2:0/240317501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa38106770 msgr2=0x7ffa38106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:24.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.832+0000 7ffa3d400700 1 --2- 172.21.15.2:0/240317501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa38106770 0x7ffa38106b90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ffa280098a0 tx=0x7ffa28009bb0 comp rx=0 tx=0).stop 2024-06-13T02:03:24.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.832+0000 7ffa3d400700 1 -- 172.21.15.2:0/240317501 shutdown_connections 2024-06-13T02:03:24.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.832+0000 7ffa3d400700 1 --2- 172.21.15.2:0/240317501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa38106770 0x7ffa38106b90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:24.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.832+0000 7ffa3d400700 1 -- 172.21.15.2:0/240317501 >> 172.21.15.2:0/240317501 conn(0x7ffa38102390 msgr2=0x7ffa381047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:24.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.832+0000 7ffa3d400700 1 -- 172.21.15.2:0/240317501 shutdown_connections 2024-06-13T02:03:24.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.832+0000 7ffa3d400700 1 -- 172.21.15.2:0/240317501 wait complete. 2024-06-13T02:03:24.605 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.833+0000 7ffa3d400700 1 Processor -- start 2024-06-13T02:03:24.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.833+0000 7ffa3d400700 1 -- start start 2024-06-13T02:03:24.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.834+0000 7ffa3d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa3819e200 0x7ffa3819e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:24.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.834+0000 7ffa3d400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa38107fe0 con 0x7ffa3819e200 2024-06-13T02:03:24.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.834+0000 7ffa36800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa3819e200 0x7ffa3819e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:24.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.834+0000 7ffa36800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa3819e200 0x7ffa3819e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39258/0 (socket says 172.21.15.2:39258) 2024-06-13T02:03:24.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.834+0000 7ffa36800700 1 -- 172.21.15.2:0/4186177994 learned_addr learned my addr 172.21.15.2:0/4186177994 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:24.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.835+0000 7ffa36800700 1 -- 172.21.15.2:0/4186177994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3819eb60 con 0x7ffa3819e200 2024-06-13T02:03:24.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.835+0000 7ffa36800700 1 --2- 172.21.15.2:0/4186177994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa3819e200 0x7ffa3819e620 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ffa28011850 tx=0x7ffa28011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:24.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.835+0000 7ffa2f400700 1 -- 172.21.15.2:0/4186177994 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa280036a0 con 0x7ffa3819e200 2024-06-13T02:03:24.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.835+0000 7ffa2f400700 1 -- 172.21.15.2:0/4186177994 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa2801b440 con 0x7ffa3819e200 2024-06-13T02:03:24.606 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.835+0000 7ffa3d400700 1 -- 172.21.15.2:0/4186177994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa3819edf0 con 0x7ffa3819e200 2024-06-13T02:03:24.607 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.835+0000 7ffa2f400700 1 -- 172.21.15.2:0/4186177994 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa2801a460 con 0x7ffa3819e200 2024-06-13T02:03:24.607 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.835+0000 7ffa3d400700 1 -- 172.21.15.2:0/4186177994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa381a18d0 con 0x7ffa3819e200 2024-06-13T02:03:24.607 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.836+0000 7ffa2f400700 1 -- 172.21.15.2:0/4186177994 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffa2801aa60 con 0x7ffa3819e200 2024-06-13T02:03:24.607 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.836+0000 7ffa2f400700 1 -- 172.21.15.2:0/4186177994 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ffa28024770 con 0x7ffa3819e200 2024-06-13T02:03:24.607 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.837+0000 7ffa3d400700 1 -- 172.21.15.2:0/4186177994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa38063af0 con 0x7ffa3819e200 2024-06-13T02:03:24.607 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.840+0000 7ffa2f400700 1 -- 172.21.15.2:0/4186177994 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ffa28043dd0 con 0x7ffa3819e200 2024-06-13T02:03:24.607 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.917+0000 7ffa3d400700 1 -- 172.21.15.2:0/4186177994 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7ffa3802dfb0 con 0x7ffa3819e200 2024-06-13T02:03:24.607 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.921+0000 7ffa2f400700 1 -- 172.21.15.2:0/4186177994 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7ffa28032030 con 0x7ffa3819e200 2024-06-13T02:03:24.607 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.922+0000 7ffa3d400700 1 -- 172.21.15.2:0/4186177994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa3819e200 msgr2=0x7ffa3819e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:24.607 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.922+0000 7ffa3d400700 1 --2- 172.21.15.2:0/4186177994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa3819e200 0x7ffa3819e620 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ffa28011850 tx=0x7ffa28011c10 comp rx=0 tx=0).stop 2024-06-13T02:03:24.607 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.922+0000 7ffa3d400700 1 -- 172.21.15.2:0/4186177994 shutdown_connections 2024-06-13T02:03:24.607 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.922+0000 7ffa3d400700 1 --2- 172.21.15.2:0/4186177994 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa3819e200 0x7ffa3819e620 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:24.607 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.922+0000 7ffa3d400700 1 -- 172.21.15.2:0/4186177994 >> 172.21.15.2:0/4186177994 conn(0x7ffa38102390 msgr2=0x7ffa38194d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:24.608 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.923+0000 7ffa3d400700 1 -- 172.21.15.2:0/4186177994 shutdown_connections 2024-06-13T02:03:24.608 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:23.923+0000 7ffa3d400700 1 -- 172.21.15.2:0/4186177994 wait complete. 2024-06-13T02:03:24.608 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote config to /etc/ceph/ceph.conf 2024-06-13T02:03:24.626 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-06-13T02:03:24.626 INFO:teuthology.orchestra.run.smithi002.stdout:Creating mgr... 2024-06-13T02:03:24.628 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:9283 ... 2024-06-13T02:03:24.629 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying port 0.0.0.0:8765 ... 2024-06-13T02:03:25.035 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.x 2024-06-13T02:03:25.035 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Failed to reset failed state of unit ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.x.service: Unit ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.x.service not loaded. 2024-06-13T02:03:25.302 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-efed8ab4-2928-11ef-bc9c-c7b262605968.target.wants/ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@.service. 2024-06-13T02:03:25.334 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:24 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/4186177994' entity='client.admin' 2024-06-13T02:03:25.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:25 smithi002 systemd[1]: Starting Ceph mgr.x for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:03:25.959 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:25 smithi002 podman[32175]: 2024-06-13 02:03:25.610263033 +0000 UTC m=+0.039060436 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba 2024-06-13T02:03:25.959 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:25 smithi002 podman[32175]: 2024-06-13 02:03:25.728415526 +0000 UTC m=+0.157212949 container create f6a6440147350dcb7a51c51f582f73a4298c2e224bce2fc89ee798fb4bf034ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-3d89acc, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-06-13T02:03:25.959 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:25 smithi002 podman[32175]: 2024-06-13 02:03:25.956969612 +0000 UTC m=+0.385767042 container init f6a6440147350dcb7a51c51f582f73a4298c2e224bce2fc89ee798fb4bf034ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, ceph=True, maintainer=Guillaume Abrioux ) 2024-06-13T02:03:26.097 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-13T02:03:26.097 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-06-13T02:03:26.113 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-13T02:03:26.113 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-06-13T02:03:26.114 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-06-13T02:03:26.114 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to enable service . firewalld.service is not available 2024-06-13T02:03:26.134 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-13T02:03:26.135 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-06-13T02:03:26.154 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-13T02:03:26.154 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-06-13T02:03:26.154 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-06-13T02:03:26.154 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-06-13T02:03:26.154 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr to start... 2024-06-13T02:03:26.154 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr... 2024-06-13T02:03:26.229 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:25 smithi002 podman[32175]: 2024-06-13 02:03:25.966903567 +0000 UTC m=+0.395700997 container start f6a6440147350dcb7a51c51f582f73a4298c2e224bce2fc89ee798fb4bf034ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_CLEAN=True, RELEASE=squid-3d89acc, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-06-13T02:03:26.229 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:26 smithi002 bash[32175]: f6a6440147350dcb7a51c51f582f73a4298c2e224bce2fc89ee798fb4bf034ef 2024-06-13T02:03:26.229 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:26 smithi002 systemd[1]: Started Ceph mgr.x for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:03:26.484 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:26 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:26.228+0000 7fb9e4ddc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T02:03:26.771 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:26 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:26.508+0000 7fb9e4ddc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:03:26.771 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:26 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:26.646+0000 7fb9e4ddc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T02:03:27.077 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:26 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2506187189' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-13T02:03:27.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:27 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:27.076+0000 7fb9e4ddc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T02:03:27.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:27 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:27.196+0000 7fb9e4ddc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T02:03:27.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T02:03:27.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T02:03:27.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "efed8ab4-2928-11ef-bc9c-c7b262605968", 2024-06-13T02:03:27.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-06-13T02:03:27.556 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-13T02:03:27.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-13T02:03:27.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-13T02:03:27.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:27.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-13T02:03:27.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-13T02:03:27.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-06-13T02:03:27.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T02:03:27.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-13T02:03:27.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-06-13T02:03:27.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T02:03:27.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-06-13T02:03:27.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-13T02:03:27.557 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:27.558 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-13T02:03:27.558 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-13T02:03:27.558 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:27.558 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-13T02:03:27.558 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:27.558 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-13T02:03:27.558 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-13T02:03:27.558 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-13T02:03:27.558 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-13T02:03:27.559 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-13T02:03:27.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-13T02:03:27.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:27.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-13T02:03:27.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-13T02:03:27.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-13T02:03:27.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-13T02:03:27.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-13T02:03:27.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-13T02:03:27.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-13T02:03:27.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-13T02:03:27.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-13T02:03:27.560 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:27.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-13T02:03:27.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:27.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-13T02:03:27.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-13T02:03:27.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:27.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-13T02:03:27.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-13T02:03:27.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-13T02:03:27.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-13T02:03:27.561 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-13T02:03:27.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-13T02:03:27.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-06-13T02:03:27.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T02:03:27.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T02:03:27.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:27.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-13T02:03:27.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:27.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-06-13T02:03:16.412700+0000", 2024-06-13T02:03:27.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T02:03:27.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:27.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-13T02:03:27.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T02:03:27.562 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.769+0000 7f51e2600700 1 Processor -- start 2024-06-13T02:03:27.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.770+0000 7f51e2600700 1 -- start start 2024-06-13T02:03:27.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.770+0000 7f51e2600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc07de20 0x7f51dc07c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:27.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.770+0000 7f51e2600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f51dc07c8a0 con 0x7f51dc07de20 2024-06-13T02:03:27.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.771+0000 7f51db400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc07de20 0x7f51dc07c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:27.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.771+0000 7f51db400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc07de20 0x7f51dc07c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39298/0 (socket says 172.21.15.2:39298) 2024-06-13T02:03:27.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.771+0000 7f51db400700 1 -- 172.21.15.2:0/2630754071 learned_addr learned my addr 172.21.15.2:0/2630754071 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:27.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.771+0000 7f51db400700 1 -- 172.21.15.2:0/2630754071 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51dc07ca20 con 0x7f51dc07de20 2024-06-13T02:03:27.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.772+0000 7f51db400700 1 --2- 172.21.15.2:0/2630754071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc07de20 0x7f51dc07c2d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0098a0 tx=0x7f51cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bdd27c019598f4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:27.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.772+0000 7f51da000700 1 -- 172.21.15.2:0/2630754071 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51cc004160 con 0x7f51dc07de20 2024-06-13T02:03:27.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.772+0000 7f51da000700 1 -- 172.21.15.2:0/2630754071 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51cc004300 con 0x7f51dc07de20 2024-06-13T02:03:27.563 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.772+0000 7f51da000700 1 -- 172.21.15.2:0/2630754071 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51cc011b50 con 0x7f51dc07de20 2024-06-13T02:03:27.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.773+0000 7f51e2600700 1 -- 172.21.15.2:0/2630754071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc07de20 msgr2=0x7f51dc07c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:27.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.773+0000 7f51e2600700 1 --2- 172.21.15.2:0/2630754071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc07de20 0x7f51dc07c2d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0098a0 tx=0x7f51cc009bb0 comp rx=0 tx=0).stop 2024-06-13T02:03:27.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.773+0000 7f51e2600700 1 -- 172.21.15.2:0/2630754071 shutdown_connections 2024-06-13T02:03:27.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.773+0000 7f51e2600700 1 --2- 172.21.15.2:0/2630754071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc07de20 0x7f51dc07c2d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:27.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.773+0000 7f51e2600700 1 -- 172.21.15.2:0/2630754071 >> 172.21.15.2:0/2630754071 conn(0x7f51dc103430 msgr2=0x7f51dc105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:27.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.773+0000 7f51e2600700 1 -- 172.21.15.2:0/2630754071 shutdown_connections 2024-06-13T02:03:27.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.773+0000 7f51e2600700 1 -- 172.21.15.2:0/2630754071 wait complete. 2024-06-13T02:03:27.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.774+0000 7f51e2600700 1 Processor -- start 2024-06-13T02:03:27.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.775+0000 7f51e2600700 1 -- start start 2024-06-13T02:03:27.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.775+0000 7f51e2600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc07de20 0x7f51dc19e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:27.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.775+0000 7f51e2600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f51dc10e440 con 0x7f51dc07de20 2024-06-13T02:03:27.564 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.775+0000 7f51db400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc07de20 0x7f51dc19e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:27.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.775+0000 7f51db400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc07de20 0x7f51dc19e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39306/0 (socket says 172.21.15.2:39306) 2024-06-13T02:03:27.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.775+0000 7f51db400700 1 -- 172.21.15.2:0/2506187189 learned_addr learned my addr 172.21.15.2:0/2506187189 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:27.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.776+0000 7f51db400700 1 -- 172.21.15.2:0/2506187189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51dc19e540 con 0x7f51dc07de20 2024-06-13T02:03:27.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.776+0000 7f51db400700 1 --2- 172.21.15.2:0/2506187189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc07de20 0x7f51dc19e000 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f51cc011b60 tx=0x7f51cc011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:27.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.776+0000 7f51d3e00700 1 -- 172.21.15.2:0/2506187189 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51cc003b20 con 0x7f51dc07de20 2024-06-13T02:03:27.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.776+0000 7f51d3e00700 1 -- 172.21.15.2:0/2506187189 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51cc003cc0 con 0x7f51dc07de20 2024-06-13T02:03:27.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.776+0000 7f51e2600700 1 -- 172.21.15.2:0/2506187189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51dc19e7d0 con 0x7f51dc07de20 2024-06-13T02:03:27.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.776+0000 7f51d3e00700 1 -- 172.21.15.2:0/2506187189 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51cc024840 con 0x7f51dc07de20 2024-06-13T02:03:27.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.776+0000 7f51e2600700 1 -- 172.21.15.2:0/2506187189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51dc1a14c0 con 0x7f51dc07de20 2024-06-13T02:03:27.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.777+0000 7f51d3e00700 1 -- 172.21.15.2:0/2506187189 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f51cc022020 con 0x7f51dc07de20 2024-06-13T02:03:27.565 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.777+0000 7f51d3e00700 1 -- 172.21.15.2:0/2506187189 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f51cc011e00 con 0x7f51dc07de20 2024-06-13T02:03:27.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.778+0000 7f51e2600700 1 -- 172.21.15.2:0/2506187189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51dc063af0 con 0x7f51dc07de20 2024-06-13T02:03:27.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.780+0000 7f51d3e00700 1 -- 172.21.15.2:0/2506187189 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f51cc043dd0 con 0x7f51dc07de20 2024-06-13T02:03:27.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.861+0000 7f51e2600700 1 -- 172.21.15.2:0/2506187189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f51dc1a1690 con 0x7f51dc07de20 2024-06-13T02:03:27.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.861+0000 7f51d3e00700 1 -- 172.21.15.2:0/2506187189 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f51cc032020 con 0x7f51dc07de20 2024-06-13T02:03:27.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.863+0000 7f51e2600700 1 -- 172.21.15.2:0/2506187189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc07de20 msgr2=0x7f51dc19e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:27.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.863+0000 7f51e2600700 1 --2- 172.21.15.2:0/2506187189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc07de20 0x7f51dc19e000 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f51cc011b60 tx=0x7f51cc011c40 comp rx=0 tx=0).stop 2024-06-13T02:03:27.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.863+0000 7f51e2600700 1 -- 172.21.15.2:0/2506187189 shutdown_connections 2024-06-13T02:03:27.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.863+0000 7f51e2600700 1 --2- 172.21.15.2:0/2506187189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f51dc07de20 0x7f51dc19e000 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:27.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.863+0000 7f51e2600700 1 -- 172.21.15.2:0/2506187189 >> 172.21.15.2:0/2506187189 conn(0x7f51dc103430 msgr2=0x7f51dc104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:27.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.863+0000 7f51e2600700 1 -- 172.21.15.2:0/2506187189 shutdown_connections 2024-06-13T02:03:27.566 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:26.863+0000 7f51e2600700 1 -- 172.21.15.2:0/2506187189 wait complete. 2024-06-13T02:03:27.566 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (1/15)... 2024-06-13T02:03:29.130 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:28 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:28.848+0000 7fb9e4ddc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T02:03:29.131 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:29 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:29.081+0000 7fb9e4ddc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T02:03:29.631 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:29 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:29.301+0000 7fb9e4ddc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T02:03:29.967 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:29 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:29.694+0000 7fb9e4ddc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T02:03:29.967 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:29 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:29.824+0000 7fb9e4ddc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T02:03:30.216 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:30 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:30.090+0000 7fb9e4ddc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T02:03:30.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:30 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/4036882192' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-13T02:03:30.630 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:30 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:30.357+0000 7fb9e4ddc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:03:30.949 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T02:03:30.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T02:03:30.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "efed8ab4-2928-11ef-bc9c-c7b262605968", 2024-06-13T02:03:30.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-06-13T02:03:30.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-13T02:03:30.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-13T02:03:30.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-13T02:03:30.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:30.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-13T02:03:30.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-13T02:03:30.950 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-06-13T02:03:30.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T02:03:30.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-13T02:03:30.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-06-13T02:03:30.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T02:03:30.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-06-13T02:03:30.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-13T02:03:30.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:30.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-13T02:03:30.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-13T02:03:30.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:30.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-13T02:03:30.951 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:30.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-13T02:03:30.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-13T02:03:30.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-13T02:03:30.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-13T02:03:30.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-13T02:03:30.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-13T02:03:30.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:30.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-13T02:03:30.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-13T02:03:30.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-13T02:03:30.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-13T02:03:30.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-13T02:03:30.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-13T02:03:30.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-13T02:03:30.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-13T02:03:30.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-13T02:03:30.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:30.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-13T02:03:30.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:30.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-13T02:03:30.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-13T02:03:30.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:30.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-13T02:03:30.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-13T02:03:30.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-13T02:03:30.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-13T02:03:30.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-13T02:03:30.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-13T02:03:30.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-06-13T02:03:30.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T02:03:30.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T02:03:30.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:30.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-13T02:03:30.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:30.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-06-13T02:03:16.412700+0000", 2024-06-13T02:03:30.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T02:03:30.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:30.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-13T02:03:30.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T02:03:30.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.123+0000 7f4243000700 1 Processor -- start 2024-06-13T02:03:30.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.123+0000 7f4243000700 1 -- start start 2024-06-13T02:03:30.959 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.124+0000 7f4243000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f423c107e90 0x7f423c1082b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:30.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.124+0000 7f4243000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f423c1087f0 con 0x7f423c107e90 2024-06-13T02:03:30.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.124+0000 7f423be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f423c107e90 0x7f423c1082b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:30.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.124+0000 7f423be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f423c107e90 0x7f423c1082b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39312/0 (socket says 172.21.15.2:39312) 2024-06-13T02:03:30.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.124+0000 7f423be00700 1 -- 172.21.15.2:0/2573953898 learned_addr learned my addr 172.21.15.2:0/2573953898 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:30.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.125+0000 7f423be00700 1 -- 172.21.15.2:0/2573953898 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423c108fa0 con 0x7f423c107e90 2024-06-13T02:03:30.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.125+0000 7f423be00700 1 --2- 172.21.15.2:0/2573953898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f423c107e90 0x7f423c1082b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f422c0098a0 tx=0x7f422c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b640eedbe918f8d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:30.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.125+0000 7f423aa00700 1 -- 172.21.15.2:0/2573953898 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f422c004160 con 0x7f423c107e90 2024-06-13T02:03:30.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.125+0000 7f423aa00700 1 -- 172.21.15.2:0/2573953898 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f422c004300 con 0x7f423c107e90 2024-06-13T02:03:30.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.125+0000 7f423aa00700 1 -- 172.21.15.2:0/2573953898 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f422c011b50 con 0x7f423c107e90 2024-06-13T02:03:30.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.126+0000 7f4243000700 1 -- 172.21.15.2:0/2573953898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f423c107e90 msgr2=0x7f423c1082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:30.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.126+0000 7f4243000700 1 --2- 172.21.15.2:0/2573953898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f423c107e90 0x7f423c1082b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f422c0098a0 tx=0x7f422c009bb0 comp rx=0 tx=0).stop 2024-06-13T02:03:30.960 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.126+0000 7f4243000700 1 -- 172.21.15.2:0/2573953898 shutdown_connections 2024-06-13T02:03:30.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.126+0000 7f4243000700 1 --2- 172.21.15.2:0/2573953898 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f423c107e90 0x7f423c1082b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:30.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.126+0000 7f4243000700 1 -- 172.21.15.2:0/2573953898 >> 172.21.15.2:0/2573953898 conn(0x7f423c103430 msgr2=0x7f423c105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:30.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.126+0000 7f4243000700 1 -- 172.21.15.2:0/2573953898 shutdown_connections 2024-06-13T02:03:30.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.126+0000 7f4243000700 1 -- 172.21.15.2:0/2573953898 wait complete. 2024-06-13T02:03:30.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.127+0000 7f4243000700 1 Processor -- start 2024-06-13T02:03:30.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.128+0000 7f4243000700 1 -- start start 2024-06-13T02:03:30.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.128+0000 7f4243000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f423c107e90 0x7f423c19e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:30.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.128+0000 7f4243000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f423c10c3e0 con 0x7f423c107e90 2024-06-13T02:03:30.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.128+0000 7f423be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f423c107e90 0x7f423c19e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:30.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.128+0000 7f423be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f423c107e90 0x7f423c19e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39324/0 (socket says 172.21.15.2:39324) 2024-06-13T02:03:30.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.128+0000 7f423be00700 1 -- 172.21.15.2:0/4036882192 learned_addr learned my addr 172.21.15.2:0/4036882192 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:30.961 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.129+0000 7f423be00700 1 -- 172.21.15.2:0/4036882192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423c19e550 con 0x7f423c107e90 2024-06-13T02:03:30.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.129+0000 7f423be00700 1 --2- 172.21.15.2:0/4036882192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f423c107e90 0x7f423c19e010 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f422c011b60 tx=0x7f422c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:30.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.129+0000 7f4238c00700 1 -- 172.21.15.2:0/4036882192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f422c003b20 con 0x7f423c107e90 2024-06-13T02:03:30.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.129+0000 7f4238c00700 1 -- 172.21.15.2:0/4036882192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f422c003cc0 con 0x7f423c107e90 2024-06-13T02:03:30.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.129+0000 7f4238c00700 1 -- 172.21.15.2:0/4036882192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f422c024840 con 0x7f423c107e90 2024-06-13T02:03:30.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.129+0000 7f4243000700 1 -- 172.21.15.2:0/4036882192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f423c19e7e0 con 0x7f423c107e90 2024-06-13T02:03:30.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.130+0000 7f4243000700 1 -- 172.21.15.2:0/4036882192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f423c1a14d0 con 0x7f423c107e90 2024-06-13T02:03:30.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.130+0000 7f4238c00700 1 -- 172.21.15.2:0/4036882192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f422c022020 con 0x7f423c107e90 2024-06-13T02:03:30.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.130+0000 7f4238c00700 1 -- 172.21.15.2:0/4036882192 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f422c011e00 con 0x7f423c107e90 2024-06-13T02:03:30.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.131+0000 7f4243000700 1 -- 172.21.15.2:0/4036882192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f423c063af0 con 0x7f423c107e90 2024-06-13T02:03:30.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.133+0000 7f4238c00700 1 -- 172.21.15.2:0/4036882192 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f422c01a430 con 0x7f423c107e90 2024-06-13T02:03:30.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.213+0000 7f4243000700 1 -- 172.21.15.2:0/4036882192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f423c1a1a10 con 0x7f423c107e90 2024-06-13T02:03:30.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.214+0000 7f4238c00700 1 -- 172.21.15.2:0/4036882192 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f422c01a610 con 0x7f423c107e90 2024-06-13T02:03:30.962 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.215+0000 7f4243000700 1 -- 172.21.15.2:0/4036882192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f423c107e90 msgr2=0x7f423c19e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:30.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.215+0000 7f4243000700 1 --2- 172.21.15.2:0/4036882192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f423c107e90 0x7f423c19e010 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f422c011b60 tx=0x7f422c011c40 comp rx=0 tx=0).stop 2024-06-13T02:03:30.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.215+0000 7f4243000700 1 -- 172.21.15.2:0/4036882192 shutdown_connections 2024-06-13T02:03:30.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.215+0000 7f4243000700 1 --2- 172.21.15.2:0/4036882192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f423c107e90 0x7f423c19e010 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:30.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.215+0000 7f4243000700 1 -- 172.21.15.2:0/4036882192 >> 172.21.15.2:0/4036882192 conn(0x7f423c103430 msgr2=0x7f423c103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:30.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.215+0000 7f4243000700 1 -- 172.21.15.2:0/4036882192 shutdown_connections 2024-06-13T02:03:30.963 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:30.215+0000 7f4243000700 1 -- 172.21.15.2:0/4036882192 wait complete. 2024-06-13T02:03:30.963 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (2/15)... 2024-06-13T02:03:31.630 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:31 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:31.181+0000 7fb9e4ddc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T02:03:32.087 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:31 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:31.748+0000 7fb9e4ddc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T02:03:32.087 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:31 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:31.880+0000 7fb9e4ddc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T02:03:32.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:32 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:32.171+0000 7fb9e4ddc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T02:03:33.112 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:32 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:32.843+0000 7fb9e4ddc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T02:03:33.112 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:32 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:32.969+0000 7fb9e4ddc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T02:03:33.364 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:33 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:33.309+0000 7fb9e4ddc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T02:03:33.614 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:33 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:33.499+0000 7fb9e4ddc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T02:03:33.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:33 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1073359951' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-13T02:03:33.880 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:33 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:33.639+0000 7fb9e4ddc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T02:03:33.881 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:33 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:33.798+0000 7fb9e4ddc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T02:03:34.267 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:34 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:34.177+0000 7fb9e4ddc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T02:03:34.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T02:03:34.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T02:03:34.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "efed8ab4-2928-11ef-bc9c-c7b262605968", 2024-06-13T02:03:34.276 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-06-13T02:03:34.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-13T02:03:34.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-13T02:03:34.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-13T02:03:34.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:34.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-13T02:03:34.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-13T02:03:34.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-06-13T02:03:34.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T02:03:34.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-13T02:03:34.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-06-13T02:03:34.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T02:03:34.277 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-06-13T02:03:34.278 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-13T02:03:34.278 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:34.278 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-13T02:03:34.278 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-13T02:03:34.278 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:34.278 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-13T02:03:34.278 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:34.278 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-13T02:03:34.278 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-13T02:03:34.278 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-13T02:03:34.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-13T02:03:34.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-13T02:03:34.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-13T02:03:34.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:34.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-13T02:03:34.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-13T02:03:34.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-13T02:03:34.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-13T02:03:34.286 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-13T02:03:34.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-13T02:03:34.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-13T02:03:34.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-13T02:03:34.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-13T02:03:34.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:34.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-13T02:03:34.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:34.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-13T02:03:34.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-13T02:03:34.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:34.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-13T02:03:34.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-13T02:03:34.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-13T02:03:34.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-13T02:03:34.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-13T02:03:34.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-13T02:03:34.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-06-13T02:03:34.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T02:03:34.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T02:03:34.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:34.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-13T02:03:34.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:34.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-06-13T02:03:16.412700+0000", 2024-06-13T02:03:34.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T02:03:34.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:34.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-13T02:03:34.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T02:03:34.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.517+0000 7ffa31e00700 1 Processor -- start 2024-06-13T02:03:34.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.517+0000 7ffa31e00700 1 -- start start 2024-06-13T02:03:34.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.518+0000 7ffa31e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa2c106750 0x7ffa2c106b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:34.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.518+0000 7ffa31e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2c07bdd0 con 0x7ffa2c106750 2024-06-13T02:03:34.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.518+0000 7ffa2aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa2c106750 0x7ffa2c106b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:34.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.518+0000 7ffa2aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa2c106750 0x7ffa2c106b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48754/0 (socket says 172.21.15.2:48754) 2024-06-13T02:03:34.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.518+0000 7ffa2aa00700 1 -- 172.21.15.2:0/1962626881 learned_addr learned my addr 172.21.15.2:0/1962626881 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:34.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.519+0000 7ffa2aa00700 1 -- 172.21.15.2:0/1962626881 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2c1070b0 con 0x7ffa2c106750 2024-06-13T02:03:34.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.519+0000 7ffa2aa00700 1 --2- 172.21.15.2:0/1962626881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa2c106750 0x7ffa2c106b70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0098a0 tx=0x7ffa1c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0266a07535fe2ab server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:34.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.519+0000 7ffa29600700 1 -- 172.21.15.2:0/1962626881 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c004160 con 0x7ffa2c106750 2024-06-13T02:03:34.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.519+0000 7ffa29600700 1 -- 172.21.15.2:0/1962626881 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa1c004300 con 0x7ffa2c106750 2024-06-13T02:03:34.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.519+0000 7ffa29600700 1 -- 172.21.15.2:0/1962626881 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c011b50 con 0x7ffa2c106750 2024-06-13T02:03:34.289 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.520+0000 7ffa31e00700 1 -- 172.21.15.2:0/1962626881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa2c106750 msgr2=0x7ffa2c106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:34.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.520+0000 7ffa31e00700 1 --2- 172.21.15.2:0/1962626881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa2c106750 0x7ffa2c106b70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0098a0 tx=0x7ffa1c009bb0 comp rx=0 tx=0).stop 2024-06-13T02:03:34.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.520+0000 7ffa31e00700 1 -- 172.21.15.2:0/1962626881 shutdown_connections 2024-06-13T02:03:34.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.520+0000 7ffa31e00700 1 --2- 172.21.15.2:0/1962626881 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa2c106750 0x7ffa2c106b70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:34.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.520+0000 7ffa31e00700 1 -- 172.21.15.2:0/1962626881 >> 172.21.15.2:0/1962626881 conn(0x7ffa2c102390 msgr2=0x7ffa2c1047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:34.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.520+0000 7ffa31e00700 1 -- 172.21.15.2:0/1962626881 shutdown_connections 2024-06-13T02:03:34.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.521+0000 7ffa31e00700 1 -- 172.21.15.2:0/1962626881 wait complete. 2024-06-13T02:03:34.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.522+0000 7ffa31e00700 1 Processor -- start 2024-06-13T02:03:34.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.522+0000 7ffa31e00700 1 -- start start 2024-06-13T02:03:34.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.522+0000 7ffa31e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa2c106750 0x7ffa2c19e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:34.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.522+0000 7ffa31e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2c108140 con 0x7ffa2c106750 2024-06-13T02:03:34.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.523+0000 7ffa2aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa2c106750 0x7ffa2c19e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:34.290 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.523+0000 7ffa2aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa2c106750 0x7ffa2c19e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48762/0 (socket says 172.21.15.2:48762) 2024-06-13T02:03:34.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.523+0000 7ffa2aa00700 1 -- 172.21.15.2:0/1073359951 learned_addr learned my addr 172.21.15.2:0/1073359951 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:34.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.523+0000 7ffa2aa00700 1 -- 172.21.15.2:0/1073359951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2c19e560 con 0x7ffa2c106750 2024-06-13T02:03:34.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.523+0000 7ffa2aa00700 1 --2- 172.21.15.2:0/1073359951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa2c106750 0x7ffa2c19e020 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c011b60 tx=0x7ffa1c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:34.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.524+0000 7ffa30a00700 1 -- 172.21.15.2:0/1073359951 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c003b20 con 0x7ffa2c106750 2024-06-13T02:03:34.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.524+0000 7ffa30a00700 1 -- 172.21.15.2:0/1073359951 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa1c003cc0 con 0x7ffa2c106750 2024-06-13T02:03:34.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.524+0000 7ffa31e00700 1 -- 172.21.15.2:0/1073359951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa2c19e7f0 con 0x7ffa2c106750 2024-06-13T02:03:34.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.524+0000 7ffa30a00700 1 -- 172.21.15.2:0/1073359951 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c024840 con 0x7ffa2c106750 2024-06-13T02:03:34.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.524+0000 7ffa31e00700 1 -- 172.21.15.2:0/1073359951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa2c1a14e0 con 0x7ffa2c106750 2024-06-13T02:03:34.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.524+0000 7ffa30a00700 1 -- 172.21.15.2:0/1073359951 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffa1c022020 con 0x7ffa2c106750 2024-06-13T02:03:34.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.524+0000 7ffa30a00700 1 -- 172.21.15.2:0/1073359951 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ffa1c011e00 con 0x7ffa2c106750 2024-06-13T02:03:34.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.525+0000 7ffa31e00700 1 -- 172.21.15.2:0/1073359951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa2c063af0 con 0x7ffa2c106750 2024-06-13T02:03:34.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.528+0000 7ffa30a00700 1 -- 172.21.15.2:0/1073359951 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ffa1c043dd0 con 0x7ffa2c106750 2024-06-13T02:03:34.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.607+0000 7ffa31e00700 1 -- 172.21.15.2:0/1073359951 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ffa2c02dea0 con 0x7ffa2c106750 2024-06-13T02:03:34.291 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.608+0000 7ffa30a00700 1 -- 172.21.15.2:0/1073359951 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7ffa1c032020 con 0x7ffa2c106750 2024-06-13T02:03:34.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.610+0000 7ffa31e00700 1 -- 172.21.15.2:0/1073359951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa2c106750 msgr2=0x7ffa2c19e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:34.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.610+0000 7ffa31e00700 1 --2- 172.21.15.2:0/1073359951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa2c106750 0x7ffa2c19e020 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c011b60 tx=0x7ffa1c011c40 comp rx=0 tx=0).stop 2024-06-13T02:03:34.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.610+0000 7ffa31e00700 1 -- 172.21.15.2:0/1073359951 shutdown_connections 2024-06-13T02:03:34.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.610+0000 7ffa31e00700 1 --2- 172.21.15.2:0/1073359951 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa2c106750 0x7ffa2c19e020 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:34.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.610+0000 7ffa31e00700 1 -- 172.21.15.2:0/1073359951 >> 172.21.15.2:0/1073359951 conn(0x7ffa2c102390 msgr2=0x7ffa2c194c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:34.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.610+0000 7ffa31e00700 1 -- 172.21.15.2:0/1073359951 shutdown_connections 2024-06-13T02:03:34.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:33.610+0000 7ffa31e00700 1 -- 172.21.15.2:0/1073359951 wait complete. 2024-06-13T02:03:34.292 INFO:teuthology.orchestra.run.smithi002.stdout:mgr not available, waiting (3/15)... 2024-06-13T02:03:35.268 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:34 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:34.969+0000 7fb9e4ddc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T02:03:35.630 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:35.266+0000 7fb9e4ddc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T02:03:35.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-mon[31960]: Activating manager daemon x 2024-06-13T02:03:35.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-mon[31960]: mgrmap e2: x(active, starting, since 0.0121977s) 2024-06-13T02:03:35.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-mon[31960]: from='mgr.14100 172.21.15.2:0/3250972560' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-13T02:03:35.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-mon[31960]: from='mgr.14100 172.21.15.2:0/3250972560' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-13T02:03:35.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-mon[31960]: from='mgr.14100 172.21.15.2:0/3250972560' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-13T02:03:35.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-mon[31960]: from='mgr.14100 172.21.15.2:0/3250972560' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-13T02:03:35.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-mon[31960]: from='mgr.14100 172.21.15.2:0/3250972560' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-13T02:03:35.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-mon[31960]: from='mgr.14100 172.21.15.2:0/3250972560' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-13T02:03:35.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-mon[31960]: from='mgr.14100 172.21.15.2:0/3250972560' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:03:35.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-mon[31960]: from='mgr.14100 172.21.15.2:0/3250972560' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-13T02:03:35.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-mon[31960]: Manager daemon x is now available 2024-06-13T02:03:35.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-mon[31960]: from='mgr.14100 172.21.15.2:0/3250972560' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T02:03:35.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-mon[31960]: from='mgr.14100 172.21.15.2:0/3250972560' entity='mgr.x' 2024-06-13T02:03:35.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-mon[31960]: from='mgr.14100 172.21.15.2:0/3250972560' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T02:03:35.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:35 smithi002 ceph-mon[31960]: from='mgr.14100 172.21.15.2:0/3250972560' entity='mgr.x' 2024-06-13T02:03:36.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:36 smithi002 ceph-mon[31960]: from='mgr.14100 172.21.15.2:0/3250972560' entity='mgr.x' 2024-06-13T02:03:36.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:36 smithi002 ceph-mon[31960]: mgrmap e3: x(active, since 1.0212s) 2024-06-13T02:03:37.588 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:37 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/530409942' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-13T02:03:38.189 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T02:03:38.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T02:03:38.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsid": "efed8ab4-2928-11ef-bc9c-c7b262605968", 2024-06-13T02:03:38.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "health": { 2024-06-13T02:03:38.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-13T02:03:38.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-13T02:03:38.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-13T02:03:38.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:38.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-13T02:03:38.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-13T02:03:38.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 0 2024-06-13T02:03:38.190 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T02:03:38.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-13T02:03:38.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "a" 2024-06-13T02:03:38.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T02:03:38.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-06-13T02:03:38.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-13T02:03:38.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:38.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-13T02:03:38.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-13T02:03:38.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:38.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-13T02:03:38.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:38.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-13T02:03:38.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-13T02:03:38.191 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-13T02:03:38.200 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-13T02:03:38.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-13T02:03:38.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-13T02:03:38.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:38.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-13T02:03:38.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-13T02:03:38.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-13T02:03:38.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-13T02:03:38.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-13T02:03:38.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-13T02:03:38.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-13T02:03:38.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-13T02:03:38.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-13T02:03:38.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:38.201 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-13T02:03:38.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:38.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-13T02:03:38.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-13T02:03:38.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:38.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-13T02:03:38.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-13T02:03:38.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-13T02:03:38.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-13T02:03:38.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-13T02:03:38.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-13T02:03:38.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "restful" 2024-06-13T02:03:38.202 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ], 2024-06-13T02:03:38.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T02:03:38.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:38.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-13T02:03:38.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-13T02:03:38.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "modified": "2024-06-13T02:03:16.412700+0000", 2024-06-13T02:03:38.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-13T02:03:38.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout }, 2024-06-13T02:03:38.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-13T02:03:38.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T02:03:38.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.920+0000 7f0f8dc00700 1 Processor -- start 2024-06-13T02:03:38.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.920+0000 7f0f8dc00700 1 -- start start 2024-06-13T02:03:38.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.921+0000 7f0f8dc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8807de00 0x7f0f8807c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:38.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.921+0000 7f0f8dc00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8807c7f0 con 0x7f0f8807de00 2024-06-13T02:03:38.203 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.921+0000 7f0f86a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8807de00 0x7f0f8807c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:38.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.921+0000 7f0f86a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8807de00 0x7f0f8807c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48842/0 (socket says 172.21.15.2:48842) 2024-06-13T02:03:38.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.921+0000 7f0f86a00700 1 -- 172.21.15.2:0/3716960781 learned_addr learned my addr 172.21.15.2:0/3716960781 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:38.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.922+0000 7f0f86a00700 1 -- 172.21.15.2:0/3716960781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8807c970 con 0x7f0f8807de00 2024-06-13T02:03:38.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.922+0000 7f0f86a00700 1 --2- 172.21.15.2:0/3716960781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8807de00 0x7f0f8807c2b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009e80 tx=0x7f0f7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87e5139f817f9cb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:38.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.922+0000 7f0f86000700 1 -- 172.21.15.2:0/3716960781 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f78017070 con 0x7f0f8807de00 2024-06-13T02:03:38.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.922+0000 7f0f86000700 1 -- 172.21.15.2:0/3716960781 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f7800b8c0 con 0x7f0f8807de00 2024-06-13T02:03:38.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.922+0000 7f0f86000700 1 -- 172.21.15.2:0/3716960781 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f780045c0 con 0x7f0f8807de00 2024-06-13T02:03:38.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.923+0000 7f0f8dc00700 1 -- 172.21.15.2:0/3716960781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8807de00 msgr2=0x7f0f8807c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:38.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.923+0000 7f0f8dc00700 1 --2- 172.21.15.2:0/3716960781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8807de00 0x7f0f8807c2b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0f78009e80 tx=0x7f0f7800b330 comp rx=0 tx=0).stop 2024-06-13T02:03:38.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.923+0000 7f0f8dc00700 1 -- 172.21.15.2:0/3716960781 shutdown_connections 2024-06-13T02:03:38.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.923+0000 7f0f8dc00700 1 --2- 172.21.15.2:0/3716960781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8807de00 0x7f0f8807c2b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:38.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.923+0000 7f0f8dc00700 1 -- 172.21.15.2:0/3716960781 >> 172.21.15.2:0/3716960781 conn(0x7f0f88103430 msgr2=0x7f0f88105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:38.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.923+0000 7f0f8dc00700 1 -- 172.21.15.2:0/3716960781 shutdown_connections 2024-06-13T02:03:38.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.923+0000 7f0f8dc00700 1 -- 172.21.15.2:0/3716960781 wait complete. 2024-06-13T02:03:38.204 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.924+0000 7f0f8dc00700 1 Processor -- start 2024-06-13T02:03:38.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.924+0000 7f0f8dc00700 1 -- start start 2024-06-13T02:03:38.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.925+0000 7f0f8dc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8807de00 0x7f0f8819dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:38.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.925+0000 7f0f8dc00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8810e460 con 0x7f0f8807de00 2024-06-13T02:03:38.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.925+0000 7f0f86a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8807de00 0x7f0f8819dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:38.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.925+0000 7f0f86a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8807de00 0x7f0f8819dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48852/0 (socket says 172.21.15.2:48852) 2024-06-13T02:03:38.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.925+0000 7f0f86a00700 1 -- 172.21.15.2:0/530409942 learned_addr learned my addr 172.21.15.2:0/530409942 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:38.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.925+0000 7f0f86a00700 1 -- 172.21.15.2:0/530409942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8819e4f0 con 0x7f0f8807de00 2024-06-13T02:03:38.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.926+0000 7f0f86a00700 1 --2- 172.21.15.2:0/530409942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8807de00 0x7f0f8819dfb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0f780072a0 tx=0x7f0f7800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:38.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.926+0000 7f0f7fe00700 1 -- 172.21.15.2:0/530409942 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f78020020 con 0x7f0f8807de00 2024-06-13T02:03:38.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.926+0000 7f0f7fe00700 1 -- 172.21.15.2:0/530409942 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f78003b50 con 0x7f0f8807de00 2024-06-13T02:03:38.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.926+0000 7f0f7fe00700 1 -- 172.21.15.2:0/530409942 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f78017040 con 0x7f0f8807de00 2024-06-13T02:03:38.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.926+0000 7f0f8dc00700 1 -- 172.21.15.2:0/530409942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f8819e780 con 0x7f0f8807de00 2024-06-13T02:03:38.205 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.926+0000 7f0f8dc00700 1 -- 172.21.15.2:0/530409942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f881a1470 con 0x7f0f8807de00 2024-06-13T02:03:38.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.927+0000 7f0f7fe00700 1 -- 172.21.15.2:0/530409942 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f0f78023020 con 0x7f0f8807de00 2024-06-13T02:03:38.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.928+0000 7f0f8dc00700 1 -- 172.21.15.2:0/530409942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f88063af0 con 0x7f0f8807de00 2024-06-13T02:03:38.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.928+0000 7f0f7fe00700 1 --2- 172.21.15.2:0/530409942 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f0f68038ef0 0x7f0f6803b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:38.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.928+0000 7f0f7fe00700 1 -- 172.21.15.2:0/530409942 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0f7800f050 con 0x7f0f8807de00 2024-06-13T02:03:38.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.928+0000 7f0f76000700 1 --2- 172.21.15.2:0/530409942 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f0f68038ef0 0x7f0f6803b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:38.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.929+0000 7f0f76000700 1 --2- 172.21.15.2:0/530409942 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f0f68038ef0 0x7f0f6803b3b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0f70006fd0 tx=0x7f0f70006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:38.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:36.935+0000 7f0f7fe00700 1 -- 172.21.15.2:0/530409942 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0f7802a020 con 0x7f0f8807de00 2024-06-13T02:03:38.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:37.246+0000 7f0f8dc00700 1 -- 172.21.15.2:0/530409942 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0f881a1b60 con 0x7f0f8807de00 2024-06-13T02:03:38.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:37.247+0000 7f0f7fe00700 1 -- 172.21.15.2:0/530409942 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f0f7802c300 con 0x7f0f8807de00 2024-06-13T02:03:38.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:37.251+0000 7f0f8dc00700 1 -- 172.21.15.2:0/530409942 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f0f68038ef0 msgr2=0x7f0f6803b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:38.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:37.251+0000 7f0f8dc00700 1 --2- 172.21.15.2:0/530409942 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f0f68038ef0 0x7f0f6803b3b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0f70006fd0 tx=0x7f0f70006e40 comp rx=0 tx=0).stop 2024-06-13T02:03:38.206 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:37.251+0000 7f0f8dc00700 1 -- 172.21.15.2:0/530409942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8807de00 msgr2=0x7f0f8819dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:38.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:37.251+0000 7f0f8dc00700 1 --2- 172.21.15.2:0/530409942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8807de00 0x7f0f8819dfb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0f780072a0 tx=0x7f0f7800bd50 comp rx=0 tx=0).stop 2024-06-13T02:03:38.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:37.252+0000 7f0f8dc00700 1 -- 172.21.15.2:0/530409942 shutdown_connections 2024-06-13T02:03:38.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:37.252+0000 7f0f8dc00700 1 --2- 172.21.15.2:0/530409942 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f0f68038ef0 0x7f0f6803b3b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:38.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:37.252+0000 7f0f8dc00700 1 --2- 172.21.15.2:0/530409942 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f8807de00 0x7f0f8819dfb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:38.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:37.252+0000 7f0f8dc00700 1 -- 172.21.15.2:0/530409942 >> 172.21.15.2:0/530409942 conn(0x7f0f88103430 msgr2=0x7f0f88103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:38.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:37.252+0000 7f0f8dc00700 1 -- 172.21.15.2:0/530409942 shutdown_connections 2024-06-13T02:03:38.207 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:37.252+0000 7f0f8dc00700 1 -- 172.21.15.2:0/530409942 wait complete. 2024-06-13T02:03:38.207 INFO:teuthology.orchestra.run.smithi002.stdout:mgr is available 2024-06-13T02:03:38.476 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:38 smithi002 ceph-mon[31960]: mgrmap e4: x(active, since 2s) 2024-06-13T02:03:39.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:39 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1062571400' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-13T02:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T02:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [global] 2024-06-13T02:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout fsid = efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-13T02:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-13T02:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-13T02:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-13T02:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T02:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-13T02:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-13T02:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 2024-06-13T02:03:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout [osd] 2024-06-13T02:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-13T02:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-13T02:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-13T02:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-13T02:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-13T02:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.793+0000 7fa1b0600700 1 Processor -- start 2024-06-13T02:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.793+0000 7fa1b0600700 1 -- start start 2024-06-13T02:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.793+0000 7fa1b0600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a8107e90 0x7fa1a81082b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.793+0000 7fa1b0600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a81087f0 con 0x7fa1a8107e90 2024-06-13T02:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.794+0000 7fa1adc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a8107e90 0x7fa1a81082b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.794+0000 7fa1adc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a8107e90 0x7fa1a81082b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48860/0 (socket says 172.21.15.2:48860) 2024-06-13T02:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.794+0000 7fa1adc00700 1 -- 172.21.15.2:0/2691657327 learned_addr learned my addr 172.21.15.2:0/2691657327 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:39.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.794+0000 7fa1adc00700 1 -- 172.21.15.2:0/2691657327 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a8108fa0 con 0x7fa1a8107e90 2024-06-13T02:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.795+0000 7fa1adc00700 1 --2- 172.21.15.2:0/2691657327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a8107e90 0x7fa1a81082b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0098a0 tx=0x7fa19c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ce77d1cd023ed server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.795+0000 7fa1a7e00700 1 -- 172.21.15.2:0/2691657327 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa19c004160 con 0x7fa1a8107e90 2024-06-13T02:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.795+0000 7fa1a7e00700 1 -- 172.21.15.2:0/2691657327 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa19c004300 con 0x7fa1a8107e90 2024-06-13T02:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.795+0000 7fa1a7e00700 1 -- 172.21.15.2:0/2691657327 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa19c011b50 con 0x7fa1a8107e90 2024-06-13T02:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.796+0000 7fa1b0600700 1 -- 172.21.15.2:0/2691657327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a8107e90 msgr2=0x7fa1a81082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.796+0000 7fa1b0600700 1 --2- 172.21.15.2:0/2691657327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a8107e90 0x7fa1a81082b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa19c0098a0 tx=0x7fa19c009bb0 comp rx=0 tx=0).stop 2024-06-13T02:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.796+0000 7fa1b0600700 1 -- 172.21.15.2:0/2691657327 shutdown_connections 2024-06-13T02:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.796+0000 7fa1b0600700 1 --2- 172.21.15.2:0/2691657327 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a8107e90 0x7fa1a81082b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.796+0000 7fa1b0600700 1 -- 172.21.15.2:0/2691657327 >> 172.21.15.2:0/2691657327 conn(0x7fa1a8103430 msgr2=0x7fa1a8105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.796+0000 7fa1b0600700 1 -- 172.21.15.2:0/2691657327 shutdown_connections 2024-06-13T02:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.796+0000 7fa1b0600700 1 -- 172.21.15.2:0/2691657327 wait complete. 2024-06-13T02:03:39.782 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.797+0000 7fa1b0600700 1 Processor -- start 2024-06-13T02:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.797+0000 7fa1b0600700 1 -- start start 2024-06-13T02:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.798+0000 7fa1b0600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a8107e90 0x7fa1a819be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.798+0000 7fa1b0600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a810c3e0 con 0x7fa1a8107e90 2024-06-13T02:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.798+0000 7fa1adc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a8107e90 0x7fa1a819be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.798+0000 7fa1adc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a8107e90 0x7fa1a819be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48874/0 (socket says 172.21.15.2:48874) 2024-06-13T02:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.798+0000 7fa1adc00700 1 -- 172.21.15.2:0/1062571400 learned_addr learned my addr 172.21.15.2:0/1062571400 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.798+0000 7fa1adc00700 1 -- 172.21.15.2:0/1062571400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a819c340 con 0x7fa1a8107e90 2024-06-13T02:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.799+0000 7fa1adc00700 1 --2- 172.21.15.2:0/1062571400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a8107e90 0x7fa1a819be00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa19c011b60 tx=0x7fa19c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.799+0000 7fa1a6000700 1 -- 172.21.15.2:0/1062571400 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa19c003b20 con 0x7fa1a8107e90 2024-06-13T02:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.799+0000 7fa1a6000700 1 -- 172.21.15.2:0/1062571400 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa19c003cc0 con 0x7fa1a8107e90 2024-06-13T02:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.799+0000 7fa1b0600700 1 -- 172.21.15.2:0/1062571400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a819c5d0 con 0x7fa1a8107e90 2024-06-13T02:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.799+0000 7fa1a6000700 1 -- 172.21.15.2:0/1062571400 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa19c024840 con 0x7fa1a8107e90 2024-06-13T02:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.799+0000 7fa1b0600700 1 -- 172.21.15.2:0/1062571400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a819f2c0 con 0x7fa1a8107e90 2024-06-13T02:03:39.783 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.800+0000 7fa1a6000700 1 -- 172.21.15.2:0/1062571400 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fa19c022020 con 0x7fa1a8107e90 2024-06-13T02:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.800+0000 7fa1b0600700 1 -- 172.21.15.2:0/1062571400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1a8063af0 con 0x7fa1a8107e90 2024-06-13T02:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.801+0000 7fa1a6000700 1 --2- 172.21.15.2:0/1062571400 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7fa190039050 0x7fa19003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.801+0000 7fa1a6000700 1 -- 172.21.15.2:0/1062571400 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa19c011e00 con 0x7fa1a8107e90 2024-06-13T02:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.801+0000 7fa1ad200700 1 --2- 172.21.15.2:0/1062571400 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7fa190039050 0x7fa19003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.802+0000 7fa1ad200700 1 --2- 172.21.15.2:0/1062571400 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7fa190039050 0x7fa19003b510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa194006fd0 tx=0x7fa194006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:38.807+0000 7fa1a6000700 1 -- 172.21.15.2:0/1062571400 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa19c00b3e0 con 0x7fa1a8107e90 2024-06-13T02:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:39.033+0000 7fa1b0600700 1 -- 172.21.15.2:0/1062571400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fa1a819f490 con 0x7fa1a8107e90 2024-06-13T02:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:39.035+0000 7fa1a6000700 1 -- 172.21.15.2:0/1062571400 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+373 (secure 0 0 0) 0x7fa1a819f490 con 0x7fa1a8107e90 2024-06-13T02:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:39.038+0000 7fa1b0600700 1 -- 172.21.15.2:0/1062571400 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7fa190039050 msgr2=0x7fa19003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:39.038+0000 7fa1b0600700 1 --2- 172.21.15.2:0/1062571400 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7fa190039050 0x7fa19003b510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa194006fd0 tx=0x7fa194006e40 comp rx=0 tx=0).stop 2024-06-13T02:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:39.038+0000 7fa1b0600700 1 -- 172.21.15.2:0/1062571400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a8107e90 msgr2=0x7fa1a819be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:39.038+0000 7fa1b0600700 1 --2- 172.21.15.2:0/1062571400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a8107e90 0x7fa1a819be00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa19c011b60 tx=0x7fa19c011c40 comp rx=0 tx=0).stop 2024-06-13T02:03:39.784 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:39.038+0000 7fa1b0600700 1 -- 172.21.15.2:0/1062571400 shutdown_connections 2024-06-13T02:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:39.038+0000 7fa1b0600700 1 --2- 172.21.15.2:0/1062571400 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7fa190039050 0x7fa19003b510 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:39.038+0000 7fa1b0600700 1 --2- 172.21.15.2:0/1062571400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1a8107e90 0x7fa1a819be00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:39.038+0000 7fa1b0600700 1 -- 172.21.15.2:0/1062571400 >> 172.21.15.2:0/1062571400 conn(0x7fa1a8103430 msgr2=0x7fa1a8103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:39.038+0000 7fa1b0600700 1 -- 172.21.15.2:0/1062571400 shutdown_connections 2024-06-13T02:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:39.038+0000 7fa1b0600700 1 -- 172.21.15.2:0/1062571400 wait complete. 2024-06-13T02:03:39.785 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling cephadm module... 2024-06-13T02:03:41.010 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:40 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1429601128' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-06-13T02:03:41.011 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:40 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: ignoring --setuser ceph since I am not root 2024-06-13T02:03:41.011 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:40 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: ignoring --setgroup ceph since I am not root 2024-06-13T02:03:41.301 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:41.049+0000 7f38f2c1c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T02:03:41.301 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:41.298+0000 7f38f2c1c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:03:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.412+0000 7f9096200700 1 Processor -- start 2024-06-13T02:03:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.413+0000 7f9096200700 1 -- start start 2024-06-13T02:03:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.413+0000 7f9096200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090107cb0 0x7f90901080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.413+0000 7f9096200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f90901086a0 con 0x7f9090107cb0 2024-06-13T02:03:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.414+0000 7f9094e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090107cb0 0x7f90901080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.414+0000 7f9094e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090107cb0 0x7f90901080d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48890/0 (socket says 172.21.15.2:48890) 2024-06-13T02:03:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.414+0000 7f9094e00700 1 -- 172.21.15.2:0/1549532113 learned_addr learned my addr 172.21.15.2:0/1549532113 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.414+0000 7f9094e00700 1 -- 172.21.15.2:0/1549532113 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9090108eb0 con 0x7f9090107cb0 2024-06-13T02:03:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.414+0000 7f9094e00700 1 --2- 172.21.15.2:0/1549532113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090107cb0 0x7f90901080d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9084009e80 tx=0x7f908400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ee8c0dc8a1b953 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.415+0000 7f908f400700 1 -- 172.21.15.2:0/1549532113 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9084017070 con 0x7f9090107cb0 2024-06-13T02:03:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.415+0000 7f908f400700 1 -- 172.21.15.2:0/1549532113 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f908400b8c0 con 0x7f9090107cb0 2024-06-13T02:03:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.415+0000 7f908f400700 1 -- 172.21.15.2:0/1549532113 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90840045c0 con 0x7f9090107cb0 2024-06-13T02:03:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.416+0000 7f9096200700 1 -- 172.21.15.2:0/1549532113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090107cb0 msgr2=0x7f90901080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.416+0000 7f9096200700 1 --2- 172.21.15.2:0/1549532113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090107cb0 0x7f90901080d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9084009e80 tx=0x7f908400b330 comp rx=0 tx=0).stop 2024-06-13T02:03:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.416+0000 7f9096200700 1 -- 172.21.15.2:0/1549532113 shutdown_connections 2024-06-13T02:03:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.416+0000 7f9096200700 1 --2- 172.21.15.2:0/1549532113 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090107cb0 0x7f90901080d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.416+0000 7f9096200700 1 -- 172.21.15.2:0/1549532113 >> 172.21.15.2:0/1549532113 conn(0x7f9090103290 msgr2=0x7f90901056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.416+0000 7f9096200700 1 -- 172.21.15.2:0/1549532113 shutdown_connections 2024-06-13T02:03:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.416+0000 7f9096200700 1 -- 172.21.15.2:0/1549532113 wait complete. 2024-06-13T02:03:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.417+0000 7f9096200700 1 Processor -- start 2024-06-13T02:03:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.417+0000 7f9096200700 1 -- start start 2024-06-13T02:03:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.417+0000 7f9096200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090107cb0 0x7f909007e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.417+0000 7f9096200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f909010c260 con 0x7f9090107cb0 2024-06-13T02:03:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.418+0000 7f9094e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090107cb0 0x7f909007e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.418+0000 7f9094e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090107cb0 0x7f909007e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48904/0 (socket says 172.21.15.2:48904) 2024-06-13T02:03:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.418+0000 7f9094e00700 1 -- 172.21.15.2:0/1429601128 learned_addr learned my addr 172.21.15.2:0/1429601128 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.418+0000 7f9094e00700 1 -- 172.21.15.2:0/1429601128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909007e910 con 0x7f9090107cb0 2024-06-13T02:03:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.419+0000 7f9094e00700 1 --2- 172.21.15.2:0/1429601128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090107cb0 0x7f909007e3d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9084004210 tx=0x7f908400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.419+0000 7f908d600700 1 -- 172.21.15.2:0/1429601128 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9084020020 con 0x7f9090107cb0 2024-06-13T02:03:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.419+0000 7f908d600700 1 -- 172.21.15.2:0/1429601128 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9084003b50 con 0x7f9090107cb0 2024-06-13T02:03:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.419+0000 7f908d600700 1 -- 172.21.15.2:0/1429601128 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9084017040 con 0x7f9090107cb0 2024-06-13T02:03:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.419+0000 7f9096200700 1 -- 172.21.15.2:0/1429601128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909007cb00 con 0x7f9090107cb0 2024-06-13T02:03:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.419+0000 7f9096200700 1 -- 172.21.15.2:0/1429601128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f909007d040 con 0x7f9090107cb0 2024-06-13T02:03:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.420+0000 7f9096200700 1 -- 172.21.15.2:0/1429601128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90900695a0 con 0x7f9090107cb0 2024-06-13T02:03:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.421+0000 7f908d600700 1 -- 172.21.15.2:0/1429601128 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f9084023020 con 0x7f9090107cb0 2024-06-13T02:03:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.421+0000 7f908d600700 1 --2- 172.21.15.2:0/1429601128 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f9078039050 0x7f907803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.421+0000 7f908d600700 1 -- 172.21.15.2:0/1429601128 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f908400f050 con 0x7f9090107cb0 2024-06-13T02:03:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.421+0000 7f908fe00700 1 --2- 172.21.15.2:0/1429601128 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f9078039050 0x7f907803b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.422+0000 7f908fe00700 1 --2- 172.21.15.2:0/1429601128 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f9078039050 0x7f907803b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f907c006fd0 tx=0x7f907c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.426+0000 7f908d600700 1 -- 172.21.15.2:0/1429601128 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f908402a020 con 0x7f9090107cb0 2024-06-13T02:03:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.713+0000 7f9096200700 1 -- 172.21.15.2:0/1429601128 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f909007d830 con 0x7f9090107cb0 2024-06-13T02:03:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.767+0000 7f908d600700 1 -- 172.21.15.2:0/1429601128 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f908402a200 con 0x7f9090107cb0 2024-06-13T02:03:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.769+0000 7f908d600700 1 -- 172.21.15.2:0/1429601128 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f9084012950 con 0x7f9090107cb0 2024-06-13T02:03:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.771+0000 7f9096200700 1 -- 172.21.15.2:0/1429601128 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f9078039050 msgr2=0x7f907803b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.771+0000 7f9096200700 1 --2- 172.21.15.2:0/1429601128 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f9078039050 0x7f907803b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f907c006fd0 tx=0x7f907c006e40 comp rx=0 tx=0).stop 2024-06-13T02:03:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.771+0000 7f9096200700 1 -- 172.21.15.2:0/1429601128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090107cb0 msgr2=0x7f909007e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.771+0000 7f9096200700 1 --2- 172.21.15.2:0/1429601128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090107cb0 0x7f909007e3d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9084004210 tx=0x7f908400bd50 comp rx=0 tx=0).stop 2024-06-13T02:03:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.771+0000 7f9096200700 1 -- 172.21.15.2:0/1429601128 shutdown_connections 2024-06-13T02:03:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.771+0000 7f9096200700 1 --2- 172.21.15.2:0/1429601128 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f9078039050 0x7f907803b510 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.771+0000 7f9096200700 1 --2- 172.21.15.2:0/1429601128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9090107cb0 0x7f909007e3d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.771+0000 7f9096200700 1 -- 172.21.15.2:0/1429601128 >> 172.21.15.2:0/1429601128 conn(0x7f9090103290 msgr2=0x7f9090103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.773+0000 7f9096200700 1 -- 172.21.15.2:0/1429601128 shutdown_connections 2024-06-13T02:03:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:40.773+0000 7f9096200700 1 -- 172.21.15.2:0/1429601128 wait complete. 2024-06-13T02:03:41.630 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:41.437+0000 7f38f2c1c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T02:03:41.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:41 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1429601128' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-06-13T02:03:41.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:41 smithi002 ceph-mon[31960]: mgrmap e5: x(active, since 5s) 2024-06-13T02:03:41.972 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:41.863+0000 7f38f2c1c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T02:03:42.275 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:41.983+0000 7f38f2c1c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T02:03:42.865 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:42 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/807132570' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-13T02:03:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T02:03:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-06-13T02:03:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-13T02:03:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-13T02:03:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-13T02:03:42.874 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T02:03:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.970+0000 7f0447e00700 1 Processor -- start 2024-06-13T02:03:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.970+0000 7f0447e00700 1 -- start start 2024-06-13T02:03:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.971+0000 7f0447e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f044010a0d0 0x7f044010a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.971+0000 7f0447e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f044010aac0 con 0x7f044010a0d0 2024-06-13T02:03:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.972+0000 7f0445400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f044010a0d0 0x7f044010a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.972+0000 7f0445400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f044010a0d0 0x7f044010a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55618/0 (socket says 172.21.15.2:55618) 2024-06-13T02:03:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.972+0000 7f0445400700 1 -- 172.21.15.2:0/1125268244 learned_addr learned my addr 172.21.15.2:0/1125268244 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.972+0000 7f0445400700 1 -- 172.21.15.2:0/1125268244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044010b270 con 0x7f044010a0d0 2024-06-13T02:03:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.972+0000 7f0445400700 1 --2- 172.21.15.2:0/1125268244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f044010a0d0 0x7f044010a4f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f04340098a0 tx=0x7f0434009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9efa140bef31a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.973+0000 7f043fe00700 1 -- 172.21.15.2:0/1125268244 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0434004160 con 0x7f044010a0d0 2024-06-13T02:03:42.880 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.973+0000 7f043fe00700 1 -- 172.21.15.2:0/1125268244 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0434004300 con 0x7f044010a0d0 2024-06-13T02:03:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.973+0000 7f043fe00700 1 -- 172.21.15.2:0/1125268244 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0434011b50 con 0x7f044010a0d0 2024-06-13T02:03:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.973+0000 7f0447e00700 1 -- 172.21.15.2:0/1125268244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f044010a0d0 msgr2=0x7f044010a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.973+0000 7f0447e00700 1 --2- 172.21.15.2:0/1125268244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f044010a0d0 0x7f044010a4f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f04340098a0 tx=0x7f0434009bb0 comp rx=0 tx=0).stop 2024-06-13T02:03:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.974+0000 7f0447e00700 1 -- 172.21.15.2:0/1125268244 shutdown_connections 2024-06-13T02:03:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.974+0000 7f0447e00700 1 --2- 172.21.15.2:0/1125268244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f044010a0d0 0x7f044010a4f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.974+0000 7f0447e00700 1 -- 172.21.15.2:0/1125268244 >> 172.21.15.2:0/1125268244 conn(0x7f044007d520 msgr2=0x7f044007d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.974+0000 7f0447e00700 1 -- 172.21.15.2:0/1125268244 shutdown_connections 2024-06-13T02:03:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.974+0000 7f0447e00700 1 -- 172.21.15.2:0/1125268244 wait complete. 2024-06-13T02:03:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.975+0000 7f0447e00700 1 Processor -- start 2024-06-13T02:03:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.975+0000 7f0447e00700 1 -- start start 2024-06-13T02:03:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.975+0000 7f0447e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f044010a0d0 0x7f044019dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.975+0000 7f0447e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f044010e620 con 0x7f044010a0d0 2024-06-13T02:03:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.975+0000 7f0445400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f044010a0d0 0x7f044019dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:42.881 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.975+0000 7f0445400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f044010a0d0 0x7f044019dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55620/0 (socket says 172.21.15.2:55620) 2024-06-13T02:03:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.975+0000 7f0445400700 1 -- 172.21.15.2:0/807132570 learned_addr learned my addr 172.21.15.2:0/807132570 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.976+0000 7f0445400700 1 -- 172.21.15.2:0/807132570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044019e520 con 0x7f044010a0d0 2024-06-13T02:03:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.976+0000 7f0445400700 1 --2- 172.21.15.2:0/807132570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f044010a0d0 0x7f044019dfe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0434011b60 tx=0x7f0434011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.976+0000 7f043e000700 1 -- 172.21.15.2:0/807132570 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0434003b20 con 0x7f044010a0d0 2024-06-13T02:03:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.976+0000 7f043e000700 1 -- 172.21.15.2:0/807132570 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0434003cc0 con 0x7f044010a0d0 2024-06-13T02:03:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.976+0000 7f0447e00700 1 -- 172.21.15.2:0/807132570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044019e7b0 con 0x7f044010a0d0 2024-06-13T02:03:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.976+0000 7f043e000700 1 -- 172.21.15.2:0/807132570 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0434024840 con 0x7f044010a0d0 2024-06-13T02:03:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.977+0000 7f0447e00700 1 -- 172.21.15.2:0/807132570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04401a14a0 con 0x7f044010a0d0 2024-06-13T02:03:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.978+0000 7f0447e00700 1 -- 172.21.15.2:0/807132570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0440063af0 con 0x7f044010a0d0 2024-06-13T02:03:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.978+0000 7f043e000700 1 -- 172.21.15.2:0/807132570 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f0434022020 con 0x7f044010a0d0 2024-06-13T02:03:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.978+0000 7f043e000700 1 --2- 172.21.15.2:0/807132570 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f04280390a0 0x7f042803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.978+0000 7f043e000700 1 -- 172.21.15.2:0/807132570 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0434011e00 con 0x7f044010a0d0 2024-06-13T02:03:42.882 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.979+0000 7f0444a00700 1 -- 172.21.15.2:0/807132570 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f04280390a0 msgr2=0x7f042803b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2830681579 2024-06-13T02:03:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.979+0000 7f0444a00700 1 --2- 172.21.15.2:0/807132570 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f04280390a0 0x7f042803b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T02:03:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:41.984+0000 7f043e000700 1 -- 172.21.15.2:0/807132570 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f043400b3e0 con 0x7f044010a0d0 2024-06-13T02:03:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:42.180+0000 7f0444a00700 1 -- 172.21.15.2:0/807132570 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f04280390a0 msgr2=0x7f042803b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2830681579 2024-06-13T02:03:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:42.180+0000 7f0444a00700 1 --2- 172.21.15.2:0/807132570 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f04280390a0 0x7f042803b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T02:03:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:42.273+0000 7f0447e00700 1 -- 172.21.15.2:0/807132570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f04401a1670 con 0x7f044010a0d0 2024-06-13T02:03:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:42.274+0000 7f043e000700 1 -- 172.21.15.2:0/807132570 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f04401a1670 con 0x7f044010a0d0 2024-06-13T02:03:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:42.278+0000 7f0447e00700 1 -- 172.21.15.2:0/807132570 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f04280390a0 msgr2=0x7f042803b560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T02:03:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:42.278+0000 7f0447e00700 1 --2- 172.21.15.2:0/807132570 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f04280390a0 0x7f042803b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:42.278+0000 7f0447e00700 1 -- 172.21.15.2:0/807132570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f044010a0d0 msgr2=0x7f044019dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:42.278+0000 7f0447e00700 1 --2- 172.21.15.2:0/807132570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f044010a0d0 0x7f044019dfe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0434011b60 tx=0x7f0434011c40 comp rx=0 tx=0).stop 2024-06-13T02:03:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:42.278+0000 7f0447e00700 1 -- 172.21.15.2:0/807132570 shutdown_connections 2024-06-13T02:03:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:42.278+0000 7f0447e00700 1 --2- 172.21.15.2:0/807132570 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f04280390a0 0x7f042803b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:42.883 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:42.278+0000 7f0447e00700 1 --2- 172.21.15.2:0/807132570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f044010a0d0 0x7f044019dfe0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:42.278+0000 7f0447e00700 1 -- 172.21.15.2:0/807132570 >> 172.21.15.2:0/807132570 conn(0x7f044007d520 msgr2=0x7f0440107cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:42.279+0000 7f0447e00700 1 -- 172.21.15.2:0/807132570 shutdown_connections 2024-06-13T02:03:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:42.279+0000 7f0447e00700 1 -- 172.21.15.2:0/807132570 wait complete. 2024-06-13T02:03:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-06-13T02:03:42.884 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 5... 2024-06-13T02:03:43.880 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:43 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:43.646+0000 7f38f2c1c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T02:03:44.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:43 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:43.878+0000 7f38f2c1c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T02:03:44.381 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:44 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:44.102+0000 7f38f2c1c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T02:03:44.880 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:44 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:44.497+0000 7f38f2c1c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T02:03:44.880 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:44 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:44.623+0000 7f38f2c1c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T02:03:45.148 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:44 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:44.883+0000 7f38f2c1c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T02:03:46.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:45 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:45.146+0000 7f38f2c1c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:03:46.381 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:45 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:45.970+0000 7f38f2c1c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T02:03:46.880 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:46 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:46.545+0000 7f38f2c1c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T02:03:46.880 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:46 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:46.678+0000 7f38f2c1c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T02:03:47.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:46 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:46.951+0000 7f38f2c1c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T02:03:47.880 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:47 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:47.625+0000 7f38f2c1c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T02:03:47.880 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:47 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:47.753+0000 7f38f2c1c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T02:03:48.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:48 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:48.086+0000 7f38f2c1c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T02:03:48.381 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:48 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:48.272+0000 7f38f2c1c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T02:03:48.880 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:48 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:48.402+0000 7f38f2c1c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T02:03:48.881 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:48 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:48.561+0000 7f38f2c1c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T02:03:49.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:48 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:48.940+0000 7f38f2c1c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T02:03:50.072 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:49.742+0000 7f38f2c1c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T02:03:50.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:50 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:03:50.070+0000 7f38f2c1c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T02:03:50.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:50 smithi002 ceph-mon[31960]: Active manager daemon x restarted 2024-06-13T02:03:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:50 smithi002 ceph-mon[31960]: Activating manager daemon x 2024-06-13T02:03:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:50 smithi002 ceph-mon[31960]: osdmap e2: 0 total, 0 up, 0 in 2024-06-13T02:03:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:50 smithi002 ceph-mon[31960]: mgrmap e6: x(active, starting, since 0.0041854s) 2024-06-13T02:03:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:50 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:03:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:50 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-13T02:03:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:50 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-13T02:03:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:50 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-13T02:03:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:50 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-13T02:03:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:50 smithi002 ceph-mon[31960]: Manager daemon x is now available 2024-06-13T02:03:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:50 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' 2024-06-13T02:03:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:50 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' 2024-06-13T02:03:51.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:51 smithi002 ceph-mon[31960]: Found migration_current of "None". Setting to last migration. 2024-06-13T02:03:51.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:51 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:03:51.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:51 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:03:51.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:51 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T02:03:51.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:51 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T02:03:51.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:51 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' 2024-06-13T02:03:51.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:51 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' 2024-06-13T02:03:51.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:51 smithi002 ceph-mon[31960]: mgrmap e7: x(active, since 1.00911s) 2024-06-13T02:03:51.714 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T02:03:51.715 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-06-13T02:03:51.715 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-13T02:03:51.715 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T02:03:51.715 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.471+0000 7f9536e00700 1 Processor -- start 2024-06-13T02:03:51.715 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.471+0000 7f9536e00700 1 -- start start 2024-06-13T02:03:51.716 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.472+0000 7f9536e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9530107e50 0x7f9530108270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:51.716 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.472+0000 7f9536e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f95301087b0 con 0x7f9530107e50 2024-06-13T02:03:51.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.472+0000 7f952fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9530107e50 0x7f9530108270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:51.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.472+0000 7f952fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9530107e50 0x7f9530108270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55634/0 (socket says 172.21.15.2:55634) 2024-06-13T02:03:51.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.472+0000 7f952fe00700 1 -- 172.21.15.2:0/149305891 learned_addr learned my addr 172.21.15.2:0/149305891 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:51.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.473+0000 7f952fe00700 1 -- 172.21.15.2:0/149305891 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9530108fb0 con 0x7f9530107e50 2024-06-13T02:03:51.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.473+0000 7f952fe00700 1 --2- 172.21.15.2:0/149305891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9530107e50 0x7f9530108270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9520009e80 tx=0x7f952000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd23b3fa316ea93c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:51.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.473+0000 7f952ea00700 1 -- 172.21.15.2:0/149305891 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9520017070 con 0x7f9530107e50 2024-06-13T02:03:51.722 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.473+0000 7f952ea00700 1 -- 172.21.15.2:0/149305891 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f952000b8c0 con 0x7f9530107e50 2024-06-13T02:03:51.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.473+0000 7f952ea00700 1 -- 172.21.15.2:0/149305891 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95200045c0 con 0x7f9530107e50 2024-06-13T02:03:51.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.474+0000 7f9536e00700 1 -- 172.21.15.2:0/149305891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9530107e50 msgr2=0x7f9530108270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:51.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.474+0000 7f9536e00700 1 --2- 172.21.15.2:0/149305891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9530107e50 0x7f9530108270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9520009e80 tx=0x7f952000b330 comp rx=0 tx=0).stop 2024-06-13T02:03:51.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.474+0000 7f9536e00700 1 -- 172.21.15.2:0/149305891 shutdown_connections 2024-06-13T02:03:51.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.474+0000 7f9536e00700 1 --2- 172.21.15.2:0/149305891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9530107e50 0x7f9530108270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:51.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.474+0000 7f9536e00700 1 -- 172.21.15.2:0/149305891 >> 172.21.15.2:0/149305891 conn(0x7f95301033b0 msgr2=0x7f9530105830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:51.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.474+0000 7f9536e00700 1 -- 172.21.15.2:0/149305891 shutdown_connections 2024-06-13T02:03:51.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.474+0000 7f9536e00700 1 -- 172.21.15.2:0/149305891 wait complete. 2024-06-13T02:03:51.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.475+0000 7f9536e00700 1 Processor -- start 2024-06-13T02:03:51.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.475+0000 7f9536e00700 1 -- start start 2024-06-13T02:03:51.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.476+0000 7f9536e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9530107e50 0x7f953019e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:51.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.476+0000 7f9536e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f953010c3f0 con 0x7f9530107e50 2024-06-13T02:03:51.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.476+0000 7f952fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9530107e50 0x7f953019e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:51.723 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.476+0000 7f952fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9530107e50 0x7f953019e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55646/0 (socket says 172.21.15.2:55646) 2024-06-13T02:03:51.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.476+0000 7f952fe00700 1 -- 172.21.15.2:0/25550738 learned_addr learned my addr 172.21.15.2:0/25550738 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:51.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.476+0000 7f952fe00700 1 -- 172.21.15.2:0/25550738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953019e5a0 con 0x7f9530107e50 2024-06-13T02:03:51.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.477+0000 7f952fe00700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9530107e50 0x7f953019e060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9520009530 tx=0x7f952000bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:51.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.477+0000 7f952cc00700 1 -- 172.21.15.2:0/25550738 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9520020020 con 0x7f9530107e50 2024-06-13T02:03:51.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.477+0000 7f952cc00700 1 -- 172.21.15.2:0/25550738 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9520003b50 con 0x7f9530107e50 2024-06-13T02:03:51.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.477+0000 7f952cc00700 1 -- 172.21.15.2:0/25550738 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9520017040 con 0x7f9530107e50 2024-06-13T02:03:51.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.477+0000 7f9536e00700 1 -- 172.21.15.2:0/25550738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f953019e830 con 0x7f9530107e50 2024-06-13T02:03:51.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.477+0000 7f9536e00700 1 -- 172.21.15.2:0/25550738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95301a1520 con 0x7f9530107e50 2024-06-13T02:03:51.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.479+0000 7f952cc00700 1 -- 172.21.15.2:0/25550738 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f9520023020 con 0x7f9530107e50 2024-06-13T02:03:51.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.479+0000 7f952cc00700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 0x7f951403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:51.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.479+0000 7f952cc00700 1 -- 172.21.15.2:0/25550738 --> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f951403bc70 con 0x7f95140390a0 2024-06-13T02:03:51.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.479+0000 7f952cc00700 1 -- 172.21.15.2:0/25550738 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f952000f050 con 0x7f9530107e50 2024-06-13T02:03:51.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.479+0000 7f952f400700 1 -- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 msgr2=0x7f951403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2830681579 2024-06-13T02:03:51.724 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.479+0000 7f952f400700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 0x7f951403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T02:03:51.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.680+0000 7f952f400700 1 -- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 msgr2=0x7f951403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2830681579 2024-06-13T02:03:51.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:43.680+0000 7f952f400700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 0x7f951403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T02:03:51.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:44.081+0000 7f952f400700 1 -- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 msgr2=0x7f951403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2830681579 2024-06-13T02:03:51.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:44.081+0000 7f952f400700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 0x7f951403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-13T02:03:51.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:44.882+0000 7f952f400700 1 -- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 msgr2=0x7f951403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2830681579 2024-06-13T02:03:51.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:44.882+0000 7f952f400700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 0x7f951403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-13T02:03:51.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:46.484+0000 7f952f400700 1 -- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 msgr2=0x7f951403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2830681579 2024-06-13T02:03:51.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:46.484+0000 7f952f400700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 0x7f951403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-13T02:03:51.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:49.687+0000 7f952f400700 1 -- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 msgr2=0x7f951403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2830681579 2024-06-13T02:03:51.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:49.687+0000 7f952f400700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 0x7f951403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-06-13T02:03:51.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:50.075+0000 7f952cc00700 1 -- 172.21.15.2:0/25550738 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f9520012430 con 0x7f9530107e50 2024-06-13T02:03:51.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:50.076+0000 7f952cc00700 1 -- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 msgr2=0x7f951403b560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T02:03:51.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:50.076+0000 7f952cc00700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 0x7f951403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:51.725 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.079+0000 7f952cc00700 1 -- 172.21.15.2:0/25550738 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f952004e600 con 0x7f9530107e50 2024-06-13T02:03:51.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.080+0000 7f952cc00700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f951403ca20 0x7f951403ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:51.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.080+0000 7f952cc00700 1 -- 172.21.15.2:0/25550738 --> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9520046080 con 0x7f951403ca20 2024-06-13T02:03:51.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.081+0000 7f952f400700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f951403ca20 0x7f951403ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:51.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.086+0000 7f952f400700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f951403ca20 0x7f951403ee10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f951c003a10 tx=0x7f951c0092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:51.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.088+0000 7f952cc00700 1 -- 172.21.15.2:0/25550738 <== mgr.14120 v2:172.21.15.2:6800/3121279966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f9520046080 con 0x7f951403ca20 2024-06-13T02:03:51.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.097+0000 7f9536e00700 1 -- 172.21.15.2:0/25550738 --> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f95300695a0 con 0x7f951403ca20 2024-06-13T02:03:51.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.097+0000 7f952cc00700 1 -- 172.21.15.2:0/25550738 <== mgr.14120 v2:172.21.15.2:6800/3121279966 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f95300695a0 con 0x7f951403ca20 2024-06-13T02:03:51.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.098+0000 7f9536e00700 1 -- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f951403ca20 msgr2=0x7f951403ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:51.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.098+0000 7f9536e00700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f951403ca20 0x7f951403ee10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f951c003a10 tx=0x7f951c0092b0 comp rx=0 tx=0).stop 2024-06-13T02:03:51.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.098+0000 7f9536e00700 1 -- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9530107e50 msgr2=0x7f953019e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:51.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.098+0000 7f9536e00700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9530107e50 0x7f953019e060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9520009530 tx=0x7f952000bd50 comp rx=0 tx=0).stop 2024-06-13T02:03:51.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.098+0000 7f9536e00700 1 -- 172.21.15.2:0/25550738 shutdown_connections 2024-06-13T02:03:51.726 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.098+0000 7f9536e00700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f951403ca20 0x7f951403ee10 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:51.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.098+0000 7f9536e00700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9530107e50 0x7f953019e060 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:51.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.098+0000 7f9536e00700 1 --2- 172.21.15.2:0/25550738 >> [v2:172.21.15.2:6800/2830681579,v1:172.21.15.2:6801/2830681579] conn(0x7f95140390a0 0x7f951403b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:51.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.098+0000 7f9536e00700 1 -- 172.21.15.2:0/25550738 >> 172.21.15.2:0/25550738 conn(0x7f95301033b0 msgr2=0x7f9530103f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:51.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.098+0000 7f9536e00700 1 -- 172.21.15.2:0/25550738 shutdown_connections 2024-06-13T02:03:51.727 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:51.098+0000 7f9536e00700 1 -- 172.21.15.2:0/25550738 wait complete. 2024-06-13T02:03:51.727 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 5 is available 2024-06-13T02:03:51.727 INFO:teuthology.orchestra.run.smithi002.stdout:Setting orchestrator backend to cephadm... 2024-06-13T02:03:52.347 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:52 smithi002 ceph-mon[31960]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-13T02:03:52.347 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:52 smithi002 ceph-mon[31960]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-13T02:03:52.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:52 smithi002 ceph-mon[31960]: [13/Jun/2024:02:03:51] ENGINE Bus STARTING 2024-06-13T02:03:52.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:52 smithi002 ceph-mon[31960]: [13/Jun/2024:02:03:51] ENGINE Serving on https://172.21.15.2:7150 2024-06-13T02:03:52.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:52 smithi002 ceph-mon[31960]: [13/Jun/2024:02:03:51] ENGINE Serving on http://172.21.15.2:8765 2024-06-13T02:03:52.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:52 smithi002 ceph-mon[31960]: [13/Jun/2024:02:03:51] ENGINE Bus STARTED 2024-06-13T02:03:52.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:52 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:03:53.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:53 smithi002 ceph-mon[31960]: mgrmap e8: x(active, since 2s) 2024-06-13T02:03:53.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:53 smithi002 ceph-mon[31960]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:03:53.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:53 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' 2024-06-13T02:03:53.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:53 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:03:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.418+0000 7f55c1e00700 1 Processor -- start 2024-06-13T02:03:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.418+0000 7f55c1e00700 1 -- start start 2024-06-13T02:03:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.418+0000 7f55c1e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55bc10a120 0x7f55bc10a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.419+0000 7f55c1e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc10ab10 con 0x7f55bc10a120 2024-06-13T02:03:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.419+0000 7f55c0a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55bc10a120 0x7f55bc10a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.419+0000 7f55c0a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55bc10a120 0x7f55bc10a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57538/0 (socket says 172.21.15.2:57538) 2024-06-13T02:03:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.419+0000 7f55c0a00700 1 -- 172.21.15.2:0/796599580 learned_addr learned my addr 172.21.15.2:0/796599580 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.419+0000 7f55c0a00700 1 -- 172.21.15.2:0/796599580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc10afe0 con 0x7f55bc10a120 2024-06-13T02:03:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.420+0000 7f55c0a00700 1 --2- 172.21.15.2:0/796599580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55bc10a120 0x7f55bc10a540 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f55b00098a0 tx=0x7f55b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf741e170323fbb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.420+0000 7f55bb400700 1 -- 172.21.15.2:0/796599580 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b0004160 con 0x7f55bc10a120 2024-06-13T02:03:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.420+0000 7f55bb400700 1 -- 172.21.15.2:0/796599580 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55b0004300 con 0x7f55bc10a120 2024-06-13T02:03:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.420+0000 7f55bb400700 1 -- 172.21.15.2:0/796599580 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b0011b50 con 0x7f55bc10a120 2024-06-13T02:03:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.421+0000 7f55c1e00700 1 -- 172.21.15.2:0/796599580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55bc10a120 msgr2=0x7f55bc10a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.421+0000 7f55c1e00700 1 --2- 172.21.15.2:0/796599580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55bc10a120 0x7f55bc10a540 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f55b00098a0 tx=0x7f55b0009bb0 comp rx=0 tx=0).stop 2024-06-13T02:03:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.421+0000 7f55c1e00700 1 -- 172.21.15.2:0/796599580 shutdown_connections 2024-06-13T02:03:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.421+0000 7f55c1e00700 1 --2- 172.21.15.2:0/796599580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55bc10a120 0x7f55bc10a540 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.421+0000 7f55c1e00700 1 -- 172.21.15.2:0/796599580 >> 172.21.15.2:0/796599580 conn(0x7f55bc07d340 msgr2=0x7f55bc07d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.421+0000 7f55c1e00700 1 -- 172.21.15.2:0/796599580 shutdown_connections 2024-06-13T02:03:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.421+0000 7f55c1e00700 1 -- 172.21.15.2:0/796599580 wait complete. 2024-06-13T02:03:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.422+0000 7f55c1e00700 1 Processor -- start 2024-06-13T02:03:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.422+0000 7f55c1e00700 1 -- start start 2024-06-13T02:03:53.516 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.423+0000 7f55c1e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55bc10a120 0x7f55bc19dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.423+0000 7f55c1e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc10e2a0 con 0x7f55bc10a120 2024-06-13T02:03:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.423+0000 7f55c0a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55bc10a120 0x7f55bc19dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.423+0000 7f55c0a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55bc10a120 0x7f55bc19dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57550/0 (socket says 172.21.15.2:57550) 2024-06-13T02:03:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.423+0000 7f55c0a00700 1 -- 172.21.15.2:0/1784394906 learned_addr learned my addr 172.21.15.2:0/1784394906 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.423+0000 7f55c0a00700 1 -- 172.21.15.2:0/1784394906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc19e400 con 0x7f55bc10a120 2024-06-13T02:03:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.424+0000 7f55c0a00700 1 --2- 172.21.15.2:0/1784394906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55bc10a120 0x7f55bc19dec0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55b0011b60 tx=0x7f55b0011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.424+0000 7f55b9600700 1 -- 172.21.15.2:0/1784394906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b0003970 con 0x7f55bc10a120 2024-06-13T02:03:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.424+0000 7f55b9600700 1 -- 172.21.15.2:0/1784394906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f55b0003b10 con 0x7f55bc10a120 2024-06-13T02:03:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.424+0000 7f55b9600700 1 -- 172.21.15.2:0/1784394906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b0024610 con 0x7f55bc10a120 2024-06-13T02:03:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.424+0000 7f55c1e00700 1 -- 172.21.15.2:0/1784394906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55bc19e690 con 0x7f55bc10a120 2024-06-13T02:03:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.424+0000 7f55c1e00700 1 -- 172.21.15.2:0/1784394906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55bc1a1380 con 0x7f55bc10a120 2024-06-13T02:03:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.425+0000 7f55b9600700 1 -- 172.21.15.2:0/1784394906 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f55b001a430 con 0x7f55bc10a120 2024-06-13T02:03:53.517 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.425+0000 7f55c1e00700 1 -- 172.21.15.2:0/1784394906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55bc0695a0 con 0x7f55bc10a120 2024-06-13T02:03:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.426+0000 7f55b9600700 1 --2- 172.21.15.2:0/1784394906 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f55a40390a0 0x7f55a403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.426+0000 7f55b9600700 1 -- 172.21.15.2:0/1784394906 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f55b0011e00 con 0x7f55bc10a120 2024-06-13T02:03:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.426+0000 7f55bbe00700 1 --2- 172.21.15.2:0/1784394906 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f55a40390a0 0x7f55a403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.427+0000 7f55bbe00700 1 --2- 172.21.15.2:0/1784394906 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f55a40390a0 0x7f55a403b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f55a8006fd0 tx=0x7f55a8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.432+0000 7f55b9600700 1 -- 172.21.15.2:0/1784394906 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f55b0016260 con 0x7f55bc10a120 2024-06-13T02:03:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.679+0000 7f55c1e00700 1 -- 172.21.15.2:0/1784394906 --> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f55bc1084d0 con 0x7f55a40390a0 2024-06-13T02:03:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.692+0000 7f55b9600700 1 -- 172.21.15.2:0/1784394906 <== mgr.14120 v2:172.21.15.2:6800/3121279966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f55bc1084d0 con 0x7f55a40390a0 2024-06-13T02:03:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.694+0000 7f55c1e00700 1 -- 172.21.15.2:0/1784394906 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f55a40390a0 msgr2=0x7f55a403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.694+0000 7f55c1e00700 1 --2- 172.21.15.2:0/1784394906 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f55a40390a0 0x7f55a403b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f55a8006fd0 tx=0x7f55a8006e40 comp rx=0 tx=0).stop 2024-06-13T02:03:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.694+0000 7f55c1e00700 1 -- 172.21.15.2:0/1784394906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55bc10a120 msgr2=0x7f55bc19dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.694+0000 7f55c1e00700 1 --2- 172.21.15.2:0/1784394906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55bc10a120 0x7f55bc19dec0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55b0011b60 tx=0x7f55b0011c40 comp rx=0 tx=0).stop 2024-06-13T02:03:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.694+0000 7f55c1e00700 1 -- 172.21.15.2:0/1784394906 shutdown_connections 2024-06-13T02:03:53.519 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.694+0000 7f55c1e00700 1 --2- 172.21.15.2:0/1784394906 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f55a40390a0 0x7f55a403b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:53.519 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.694+0000 7f55c1e00700 1 --2- 172.21.15.2:0/1784394906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f55bc10a120 0x7f55bc19dec0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:53.519 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.694+0000 7f55c1e00700 1 -- 172.21.15.2:0/1784394906 >> 172.21.15.2:0/1784394906 conn(0x7f55bc07d340 msgr2=0x7f55bc107dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:53.519 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.695+0000 7f55c1e00700 1 -- 172.21.15.2:0/1784394906 shutdown_connections 2024-06-13T02:03:53.519 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:52.695+0000 7f55c1e00700 1 -- 172.21.15.2:0/1784394906 wait complete. 2024-06-13T02:03:55.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:54 smithi002 ceph-mon[31960]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:03:55.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout value unchanged 2024-06-13T02:03:55.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.105+0000 7f0839000700 1 Processor -- start 2024-06-13T02:03:55.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.105+0000 7f0839000700 1 -- start start 2024-06-13T02:03:55.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.105+0000 7f0839000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f083410a120 0x7f083410a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:55.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.105+0000 7f0839000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f083410ab10 con 0x7f083410a120 2024-06-13T02:03:55.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.106+0000 7f0831e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f083410a120 0x7f083410a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:55.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.106+0000 7f0831e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f083410a120 0x7f083410a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57558/0 (socket says 172.21.15.2:57558) 2024-06-13T02:03:55.180 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.106+0000 7f0831e00700 1 -- 172.21.15.2:0/3701296874 learned_addr learned my addr 172.21.15.2:0/3701296874 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:55.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.107+0000 7f0831e00700 1 -- 172.21.15.2:0/3701296874 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083410b260 con 0x7f083410a120 2024-06-13T02:03:55.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.107+0000 7f0831e00700 1 --2- 172.21.15.2:0/3701296874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f083410a120 0x7f083410a540 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f08240098a0 tx=0x7f0824009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c765d5693fa7c85f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:55.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.107+0000 7f0830a00700 1 -- 172.21.15.2:0/3701296874 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0824004160 con 0x7f083410a120 2024-06-13T02:03:55.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.107+0000 7f0830a00700 1 -- 172.21.15.2:0/3701296874 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0824004300 con 0x7f083410a120 2024-06-13T02:03:55.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.107+0000 7f0830a00700 1 -- 172.21.15.2:0/3701296874 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0824011b50 con 0x7f083410a120 2024-06-13T02:03:55.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.108+0000 7f0839000700 1 -- 172.21.15.2:0/3701296874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f083410a120 msgr2=0x7f083410a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:55.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.108+0000 7f0839000700 1 --2- 172.21.15.2:0/3701296874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f083410a120 0x7f083410a540 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f08240098a0 tx=0x7f0824009bb0 comp rx=0 tx=0).stop 2024-06-13T02:03:55.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.108+0000 7f0839000700 1 -- 172.21.15.2:0/3701296874 shutdown_connections 2024-06-13T02:03:55.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.108+0000 7f0839000700 1 --2- 172.21.15.2:0/3701296874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f083410a120 0x7f083410a540 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:55.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.108+0000 7f0839000700 1 -- 172.21.15.2:0/3701296874 >> 172.21.15.2:0/3701296874 conn(0x7f083407d410 msgr2=0x7f083407d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:55.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.108+0000 7f0839000700 1 -- 172.21.15.2:0/3701296874 shutdown_connections 2024-06-13T02:03:55.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.108+0000 7f0839000700 1 -- 172.21.15.2:0/3701296874 wait complete. 2024-06-13T02:03:55.181 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.109+0000 7f0839000700 1 Processor -- start 2024-06-13T02:03:55.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.109+0000 7f0839000700 1 -- start start 2024-06-13T02:03:55.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.110+0000 7f0839000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f083410a120 0x7f083419e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:55.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.110+0000 7f0839000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f083410e610 con 0x7f083410a120 2024-06-13T02:03:55.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.110+0000 7f0831e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f083410a120 0x7f083419e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:55.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.110+0000 7f0831e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f083410a120 0x7f083419e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57564/0 (socket says 172.21.15.2:57564) 2024-06-13T02:03:55.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.110+0000 7f0831e00700 1 -- 172.21.15.2:0/4237837198 learned_addr learned my addr 172.21.15.2:0/4237837198 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:55.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.110+0000 7f0831e00700 1 -- 172.21.15.2:0/4237837198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083419e5c0 con 0x7f083410a120 2024-06-13T02:03:55.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.111+0000 7f0831e00700 1 --2- 172.21.15.2:0/4237837198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f083410a120 0x7f083419e080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0824009fb0 tx=0x7f0824011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:55.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.111+0000 7f082aa00700 1 -- 172.21.15.2:0/4237837198 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08240038b0 con 0x7f083410a120 2024-06-13T02:03:55.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.111+0000 7f082aa00700 1 -- 172.21.15.2:0/4237837198 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0824011e50 con 0x7f083410a120 2024-06-13T02:03:55.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.111+0000 7f082aa00700 1 -- 172.21.15.2:0/4237837198 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0824019550 con 0x7f083410a120 2024-06-13T02:03:55.182 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.111+0000 7f0839000700 1 -- 172.21.15.2:0/4237837198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083419e850 con 0x7f083410a120 2024-06-13T02:03:55.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.111+0000 7f0839000700 1 -- 172.21.15.2:0/4237837198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08341a1540 con 0x7f083410a120 2024-06-13T02:03:55.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.112+0000 7f082aa00700 1 -- 172.21.15.2:0/4237837198 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f0824003a50 con 0x7f083410a120 2024-06-13T02:03:55.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.112+0000 7f0839000700 1 -- 172.21.15.2:0/4237837198 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08340695a0 con 0x7f083410a120 2024-06-13T02:03:55.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.113+0000 7f082aa00700 1 --2- 172.21.15.2:0/4237837198 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f0818039050 0x7f081803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:55.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.113+0000 7f082aa00700 1 -- 172.21.15.2:0/4237837198 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f082404d380 con 0x7f083410a120 2024-06-13T02:03:55.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.113+0000 7f0831400700 1 --2- 172.21.15.2:0/4237837198 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f0818039050 0x7f081803b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:55.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.114+0000 7f0831400700 1 --2- 172.21.15.2:0/4237837198 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f0818039050 0x7f081803b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0820006fd0 tx=0x7f0820006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:55.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.119+0000 7f082aa00700 1 -- 172.21.15.2:0/4237837198 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f082404ccd0 con 0x7f083410a120 2024-06-13T02:03:55.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.348+0000 7f0839000700 1 -- 172.21.15.2:0/4237837198 --> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f08341084d0 con 0x7f0818039050 2024-06-13T02:03:55.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.350+0000 7f082aa00700 1 -- 172.21.15.2:0/4237837198 <== mgr.14120 v2:172.21.15.2:6800/3121279966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f08341084d0 con 0x7f0818039050 2024-06-13T02:03:55.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.353+0000 7f0839000700 1 -- 172.21.15.2:0/4237837198 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f0818039050 msgr2=0x7f081803b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:55.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.353+0000 7f0839000700 1 --2- 172.21.15.2:0/4237837198 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f0818039050 0x7f081803b510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0820006fd0 tx=0x7f0820006e40 comp rx=0 tx=0).stop 2024-06-13T02:03:55.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.353+0000 7f0839000700 1 -- 172.21.15.2:0/4237837198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f083410a120 msgr2=0x7f083419e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:55.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.353+0000 7f0839000700 1 --2- 172.21.15.2:0/4237837198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f083410a120 0x7f083419e080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0824009fb0 tx=0x7f0824011bf0 comp rx=0 tx=0).stop 2024-06-13T02:03:55.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.353+0000 7f0839000700 1 -- 172.21.15.2:0/4237837198 shutdown_connections 2024-06-13T02:03:55.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.353+0000 7f0839000700 1 --2- 172.21.15.2:0/4237837198 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f0818039050 0x7f081803b510 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:55.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.353+0000 7f0839000700 1 --2- 172.21.15.2:0/4237837198 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f083410a120 0x7f083419e080 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:55.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.353+0000 7f0839000700 1 -- 172.21.15.2:0/4237837198 >> 172.21.15.2:0/4237837198 conn(0x7f083407d410 msgr2=0x7f0834107dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:55.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.353+0000 7f0839000700 1 -- 172.21.15.2:0/4237837198 shutdown_connections 2024-06-13T02:03:55.184 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:54.353+0000 7f0839000700 1 -- 172.21.15.2:0/4237837198 wait complete. 2024-06-13T02:03:55.184 INFO:teuthology.orchestra.run.smithi002.stdout:Generating ssh key... 2024-06-13T02:03:56.632 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: Generating public/private rsa key pair. 2024-06-13T02:03:56.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: Your identification has been saved in /tmp/tmpd8jh2gvr/key. 2024-06-13T02:03:56.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: Your public key has been saved in /tmp/tmpd8jh2gvr/key.pub. 2024-06-13T02:03:56.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: The key fingerprint is: 2024-06-13T02:03:56.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: SHA256:k2OXBd+GjV/nk/uWeC7L9yjYihDVArmk0JKZ0/PtQD8 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:03:56.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: The key's randomart image is: 2024-06-13T02:03:56.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: +---[RSA 3072]----+ 2024-06-13T02:03:56.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: | * .. . | 2024-06-13T02:03:56.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: | B + +. . o = | 2024-06-13T02:03:56.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: | + * +o . = + o| 2024-06-13T02:03:56.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: | . +.Eo o o oo| 2024-06-13T02:03:56.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: | .oS.o .o.| 2024-06-13T02:03:56.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: | o.+ o| 2024-06-13T02:03:56.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: | . o ...| 2024-06-13T02:03:56.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: | . .. +o =o| 2024-06-13T02:03:56.633 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: | . .. +Bo+| 2024-06-13T02:03:56.634 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:03:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: +----[SHA256]-----+ 2024-06-13T02:03:56.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.812+0000 7fa6af800700 1 Processor -- start 2024-06-13T02:03:56.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.812+0000 7fa6af800700 1 -- start start 2024-06-13T02:03:56.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.812+0000 7fa6af800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6a810a0d0 0x7fa6a810a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:56.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.812+0000 7fa6af800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a810aac0 con 0x7fa6a810a0d0 2024-06-13T02:03:56.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.813+0000 7fa6ace00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6a810a0d0 0x7fa6a810a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:56.952 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.813+0000 7fa6ace00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6a810a0d0 0x7fa6a810a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57578/0 (socket says 172.21.15.2:57578) 2024-06-13T02:03:56.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.813+0000 7fa6ace00700 1 -- 172.21.15.2:0/1753317828 learned_addr learned my addr 172.21.15.2:0/1753317828 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:56.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.813+0000 7fa6ace00700 1 -- 172.21.15.2:0/1753317828 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a810b2a0 con 0x7fa6a810a0d0 2024-06-13T02:03:56.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.814+0000 7fa6ace00700 1 --2- 172.21.15.2:0/1753317828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6a810a0d0 0x7fa6a810a4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0098a0 tx=0x7fa69c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf5d96b0d55fca8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:56.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.814+0000 7fa6a7400700 1 -- 172.21.15.2:0/1753317828 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa69c004160 con 0x7fa6a810a0d0 2024-06-13T02:03:56.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.814+0000 7fa6a7400700 1 -- 172.21.15.2:0/1753317828 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa69c004300 con 0x7fa6a810a0d0 2024-06-13T02:03:56.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.814+0000 7fa6a7400700 1 -- 172.21.15.2:0/1753317828 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa69c011b50 con 0x7fa6a810a0d0 2024-06-13T02:03:56.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.815+0000 7fa6af800700 1 -- 172.21.15.2:0/1753317828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6a810a0d0 msgr2=0x7fa6a810a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:56.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.815+0000 7fa6af800700 1 --2- 172.21.15.2:0/1753317828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6a810a0d0 0x7fa6a810a4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0098a0 tx=0x7fa69c009bb0 comp rx=0 tx=0).stop 2024-06-13T02:03:56.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.815+0000 7fa6af800700 1 -- 172.21.15.2:0/1753317828 shutdown_connections 2024-06-13T02:03:56.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.815+0000 7fa6af800700 1 --2- 172.21.15.2:0/1753317828 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6a810a0d0 0x7fa6a810a4f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:56.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.815+0000 7fa6af800700 1 -- 172.21.15.2:0/1753317828 >> 172.21.15.2:0/1753317828 conn(0x7fa6a807d4c0 msgr2=0x7fa6a807d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:56.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.815+0000 7fa6af800700 1 -- 172.21.15.2:0/1753317828 shutdown_connections 2024-06-13T02:03:56.953 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.815+0000 7fa6af800700 1 -- 172.21.15.2:0/1753317828 wait complete. 2024-06-13T02:03:56.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.817+0000 7fa6af800700 1 Processor -- start 2024-06-13T02:03:56.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.817+0000 7fa6af800700 1 -- start start 2024-06-13T02:03:56.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.817+0000 7fa6af800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6a810a0d0 0x7fa6a819e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:56.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.817+0000 7fa6af800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a810e650 con 0x7fa6a810a0d0 2024-06-13T02:03:56.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.818+0000 7fa6ace00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6a810a0d0 0x7fa6a819e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:56.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.818+0000 7fa6ace00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6a810a0d0 0x7fa6a819e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57590/0 (socket says 172.21.15.2:57590) 2024-06-13T02:03:56.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.818+0000 7fa6ace00700 1 -- 172.21.15.2:0/1675429442 learned_addr learned my addr 172.21.15.2:0/1675429442 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:56.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.818+0000 7fa6ace00700 1 -- 172.21.15.2:0/1675429442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a819e5c0 con 0x7fa6a810a0d0 2024-06-13T02:03:56.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.818+0000 7fa6ace00700 1 --2- 172.21.15.2:0/1675429442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6a810a0d0 0x7fa6a819e080 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa69c011b60 tx=0x7fa69c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:56.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.819+0000 7fa6a5600700 1 -- 172.21.15.2:0/1675429442 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa69c003970 con 0x7fa6a810a0d0 2024-06-13T02:03:56.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.819+0000 7fa6a5600700 1 -- 172.21.15.2:0/1675429442 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa69c003b10 con 0x7fa6a810a0d0 2024-06-13T02:03:56.954 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.819+0000 7fa6a5600700 1 -- 172.21.15.2:0/1675429442 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa69c024610 con 0x7fa6a810a0d0 2024-06-13T02:03:56.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.819+0000 7fa6af800700 1 -- 172.21.15.2:0/1675429442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a819e850 con 0x7fa6a810a0d0 2024-06-13T02:03:56.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.819+0000 7fa6af800700 1 -- 172.21.15.2:0/1675429442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a81a1540 con 0x7fa6a810a0d0 2024-06-13T02:03:56.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.820+0000 7fa6a5600700 1 -- 172.21.15.2:0/1675429442 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa69c01a9f0 con 0x7fa6a810a0d0 2024-06-13T02:03:56.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.820+0000 7fa6af800700 1 -- 172.21.15.2:0/1675429442 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a8063af0 con 0x7fa6a810a0d0 2024-06-13T02:03:56.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.821+0000 7fa6a5600700 1 --2- 172.21.15.2:0/1675429442 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fa6900390a0 0x7fa69003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:56.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.821+0000 7fa6a5600700 1 -- 172.21.15.2:0/1675429442 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa69c011e00 con 0x7fa6a810a0d0 2024-06-13T02:03:56.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.821+0000 7fa6a7e00700 1 --2- 172.21.15.2:0/1675429442 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fa6900390a0 0x7fa69003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:56.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.822+0000 7fa6a7e00700 1 --2- 172.21.15.2:0/1675429442 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fa6900390a0 0x7fa69003b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa698006fd0 tx=0x7fa698006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:56.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:55.826+0000 7fa6a5600700 1 -- 172.21.15.2:0/1675429442 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa69c016260 con 0x7fa6a810a0d0 2024-06-13T02:03:56.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:56.058+0000 7fa6af800700 1 -- 172.21.15.2:0/1675429442 --> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fa6a8108430 con 0x7fa6900390a0 2024-06-13T02:03:56.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:56.228+0000 7fa6a5600700 1 -- 172.21.15.2:0/1675429442 <== mgr.14120 v2:172.21.15.2:6800/3121279966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa6a8108430 con 0x7fa6900390a0 2024-06-13T02:03:56.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:56.231+0000 7fa6af800700 1 -- 172.21.15.2:0/1675429442 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fa6900390a0 msgr2=0x7fa69003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:56.955 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:56.231+0000 7fa6af800700 1 --2- 172.21.15.2:0/1675429442 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fa6900390a0 0x7fa69003b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa698006fd0 tx=0x7fa698006e40 comp rx=0 tx=0).stop 2024-06-13T02:03:56.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:56.231+0000 7fa6af800700 1 -- 172.21.15.2:0/1675429442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6a810a0d0 msgr2=0x7fa6a819e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:56.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:56.231+0000 7fa6af800700 1 --2- 172.21.15.2:0/1675429442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6a810a0d0 0x7fa6a819e080 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa69c011b60 tx=0x7fa69c011c40 comp rx=0 tx=0).stop 2024-06-13T02:03:56.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:56.231+0000 7fa6af800700 1 -- 172.21.15.2:0/1675429442 shutdown_connections 2024-06-13T02:03:56.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:56.231+0000 7fa6af800700 1 --2- 172.21.15.2:0/1675429442 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fa6900390a0 0x7fa69003b560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:56.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:56.231+0000 7fa6af800700 1 --2- 172.21.15.2:0/1675429442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa6a810a0d0 0x7fa6a819e080 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:56.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:56.231+0000 7fa6af800700 1 -- 172.21.15.2:0/1675429442 >> 172.21.15.2:0/1675429442 conn(0x7fa6a807d4c0 msgr2=0x7fa6a8107d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:56.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:56.231+0000 7fa6af800700 1 -- 172.21.15.2:0/1675429442 shutdown_connections 2024-06-13T02:03:56.956 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:56.232+0000 7fa6af800700 1 -- 172.21.15.2:0/1675429442 wait complete. 2024-06-13T02:03:57.536 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:57 smithi002 ceph-mon[31960]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:03:57.537 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:57 smithi002 ceph-mon[31960]: Generating ssh key... 2024-06-13T02:03:57.537 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:57 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' 2024-06-13T02:03:57.537 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:57 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' 2024-06-13T02:03:58.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:58 smithi002 ceph-mon[31960]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:03:58.451 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJV41UUUyVZ4/6tOIYVcCQ2Jzw6YxkdOK0XECte3iXKzyiIID3N5ZP5Tat9PkSuG5dpA7SKbDRUMGkLiGnS3+6bjMuppiqKlhaYeqnoacJhx7r23TeWmyavs6Zo9GAGw0BSw5oidQ63tkuR9uj+ihhpHosGDUCgqr3GnqR2LthQd4dEEocoQjDyMeyBv/SMTzGF7j5QNtWAWsoOvSU/7oADVmCajvoVjC4qdhiMkGou5FUxpD6poEkLyDk5ih3RRHPW/rGFECyvEqJYZHYP13x+USsDPpEixl5XjMZxUnFtCnJ33+dy3vCibuK0Bx6qoEfci4pYnBRI+GAbNW76OW0nUkTOGuieK+/BpUdaSXsGkuILBfA3Tfm+WOP2odSqRIIXCSZ9UaSH8rye6CIqnRzUwWqTAYVrrIBHBBLRDitnAvljUnynuMF+NpGS4FqLseARfmkwn2ob25woKDf93qv0OJ7oJQ1wqe2Q9zUieZ83HotiA8ikIvo7YlMhplwc4s= ceph-efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:03:58.451 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.534+0000 7efd6a600700 1 Processor -- start 2024-06-13T02:03:58.451 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.535+0000 7efd6a600700 1 -- start start 2024-06-13T02:03:58.451 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.535+0000 7efd6a600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd6410a0d0 0x7efd6410a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:58.451 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.535+0000 7efd6a600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efd6410aac0 con 0x7efd6410a0d0 2024-06-13T02:03:58.451 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.536+0000 7efd63400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd6410a0d0 0x7efd6410a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:58.451 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.536+0000 7efd63400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd6410a0d0 0x7efd6410a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57592/0 (socket says 172.21.15.2:57592) 2024-06-13T02:03:58.452 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.536+0000 7efd63400700 1 -- 172.21.15.2:0/4187158271 learned_addr learned my addr 172.21.15.2:0/4187158271 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:58.452 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.536+0000 7efd63400700 1 -- 172.21.15.2:0/4187158271 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd6410b2a0 con 0x7efd6410a0d0 2024-06-13T02:03:58.452 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.536+0000 7efd63400700 1 --2- 172.21.15.2:0/4187158271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd6410a0d0 0x7efd6410a4f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efd540098a0 tx=0x7efd54009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c0fad338231ee3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:58.452 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.537+0000 7efd62000700 1 -- 172.21.15.2:0/4187158271 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd54004160 con 0x7efd6410a0d0 2024-06-13T02:03:58.452 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.537+0000 7efd62000700 1 -- 172.21.15.2:0/4187158271 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efd54004300 con 0x7efd6410a0d0 2024-06-13T02:03:58.452 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.537+0000 7efd62000700 1 -- 172.21.15.2:0/4187158271 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd54011b50 con 0x7efd6410a0d0 2024-06-13T02:03:58.452 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.537+0000 7efd6a600700 1 -- 172.21.15.2:0/4187158271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd6410a0d0 msgr2=0x7efd6410a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:58.452 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.537+0000 7efd6a600700 1 --2- 172.21.15.2:0/4187158271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd6410a0d0 0x7efd6410a4f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efd540098a0 tx=0x7efd54009bb0 comp rx=0 tx=0).stop 2024-06-13T02:03:58.452 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.538+0000 7efd6a600700 1 -- 172.21.15.2:0/4187158271 shutdown_connections 2024-06-13T02:03:58.452 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.538+0000 7efd6a600700 1 --2- 172.21.15.2:0/4187158271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd6410a0d0 0x7efd6410a4f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:58.452 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.538+0000 7efd6a600700 1 -- 172.21.15.2:0/4187158271 >> 172.21.15.2:0/4187158271 conn(0x7efd6407d4c0 msgr2=0x7efd6407d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:58.456 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.538+0000 7efd6a600700 1 -- 172.21.15.2:0/4187158271 shutdown_connections 2024-06-13T02:03:58.456 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.538+0000 7efd6a600700 1 -- 172.21.15.2:0/4187158271 wait complete. 2024-06-13T02:03:58.456 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.539+0000 7efd6a600700 1 Processor -- start 2024-06-13T02:03:58.456 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.539+0000 7efd6a600700 1 -- start start 2024-06-13T02:03:58.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.539+0000 7efd6a600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd6410a0d0 0x7efd6419e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:58.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.539+0000 7efd6a600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efd6410e650 con 0x7efd6410a0d0 2024-06-13T02:03:58.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.540+0000 7efd63400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd6410a0d0 0x7efd6419e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:58.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.540+0000 7efd63400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd6410a0d0 0x7efd6419e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57602/0 (socket says 172.21.15.2:57602) 2024-06-13T02:03:58.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.540+0000 7efd63400700 1 -- 172.21.15.2:0/2949116513 learned_addr learned my addr 172.21.15.2:0/2949116513 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:03:58.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.540+0000 7efd63400700 1 -- 172.21.15.2:0/2949116513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd6419e5c0 con 0x7efd6410a0d0 2024-06-13T02:03:58.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.540+0000 7efd63400700 1 --2- 172.21.15.2:0/2949116513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd6410a0d0 0x7efd6419e080 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efd54011b60 tx=0x7efd54011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:58.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.541+0000 7efd5be00700 1 -- 172.21.15.2:0/2949116513 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd54003970 con 0x7efd6410a0d0 2024-06-13T02:03:58.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.541+0000 7efd5be00700 1 -- 172.21.15.2:0/2949116513 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efd54003b10 con 0x7efd6410a0d0 2024-06-13T02:03:58.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.541+0000 7efd6a600700 1 -- 172.21.15.2:0/2949116513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd6419e850 con 0x7efd6410a0d0 2024-06-13T02:03:58.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.541+0000 7efd5be00700 1 -- 172.21.15.2:0/2949116513 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd54024610 con 0x7efd6410a0d0 2024-06-13T02:03:58.457 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.541+0000 7efd6a600700 1 -- 172.21.15.2:0/2949116513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd641a1540 con 0x7efd6410a0d0 2024-06-13T02:03:58.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.542+0000 7efd5be00700 1 -- 172.21.15.2:0/2949116513 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7efd540248c0 con 0x7efd6410a0d0 2024-06-13T02:03:58.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.542+0000 7efd6a600700 1 -- 172.21.15.2:0/2949116513 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd64063af0 con 0x7efd6410a0d0 2024-06-13T02:03:58.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.542+0000 7efd5be00700 1 --2- 172.21.15.2:0/2949116513 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7efd480390a0 0x7efd4803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:03:58.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.543+0000 7efd5be00700 1 -- 172.21.15.2:0/2949116513 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efd54011e00 con 0x7efd6410a0d0 2024-06-13T02:03:58.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.543+0000 7efd62a00700 1 --2- 172.21.15.2:0/2949116513 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7efd480390a0 0x7efd4803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:03:58.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.544+0000 7efd62a00700 1 --2- 172.21.15.2:0/2949116513 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7efd480390a0 0x7efd4803b560 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efd50006fd0 tx=0x7efd50006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:03:58.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.548+0000 7efd5be00700 1 -- 172.21.15.2:0/2949116513 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efd5404ce60 con 0x7efd6410a0d0 2024-06-13T02:03:58.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.777+0000 7efd6a600700 1 -- 172.21.15.2:0/2949116513 --> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7efd64108430 con 0x7efd480390a0 2024-06-13T02:03:58.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.778+0000 7efd5be00700 1 -- 172.21.15.2:0/2949116513 <== mgr.14120 v2:172.21.15.2:6800/3121279966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7efd64108430 con 0x7efd480390a0 2024-06-13T02:03:58.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.782+0000 7efd6a600700 1 -- 172.21.15.2:0/2949116513 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7efd480390a0 msgr2=0x7efd4803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:58.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.782+0000 7efd6a600700 1 --2- 172.21.15.2:0/2949116513 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7efd480390a0 0x7efd4803b560 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efd50006fd0 tx=0x7efd50006e40 comp rx=0 tx=0).stop 2024-06-13T02:03:58.458 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.782+0000 7efd6a600700 1 -- 172.21.15.2:0/2949116513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd6410a0d0 msgr2=0x7efd6419e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:03:58.459 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.782+0000 7efd6a600700 1 --2- 172.21.15.2:0/2949116513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd6410a0d0 0x7efd6419e080 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efd54011b60 tx=0x7efd54011c40 comp rx=0 tx=0).stop 2024-06-13T02:03:58.459 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.782+0000 7efd6a600700 1 -- 172.21.15.2:0/2949116513 shutdown_connections 2024-06-13T02:03:58.459 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.782+0000 7efd6a600700 1 --2- 172.21.15.2:0/2949116513 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7efd480390a0 0x7efd4803b560 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:58.459 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.782+0000 7efd6a600700 1 --2- 172.21.15.2:0/2949116513 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efd6410a0d0 0x7efd6419e080 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:03:58.459 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.782+0000 7efd6a600700 1 -- 172.21.15.2:0/2949116513 >> 172.21.15.2:0/2949116513 conn(0x7efd6407d4c0 msgr2=0x7efd64107d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:03:58.459 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.782+0000 7efd6a600700 1 -- 172.21.15.2:0/2949116513 shutdown_connections 2024-06-13T02:03:58.459 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:57.782+0000 7efd6a600700 1 -- 172.21.15.2:0/2949116513 wait complete. 2024-06-13T02:03:58.459 INFO:teuthology.orchestra.run.smithi002.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-06-13T02:03:58.459 INFO:teuthology.orchestra.run.smithi002.stdout:Adding key to root@localhost authorized_keys... 2024-06-13T02:03:58.459 INFO:teuthology.orchestra.run.smithi002.stdout:Adding host smithi002... 2024-06-13T02:04:00.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:03:59 smithi002 ceph-mon[31960]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:04:01.302 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:00 smithi002 ceph-mon[31960]: Deploying cephadm binary to smithi002 2024-06-13T02:04:06.435 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Added host 'smithi002' with addr '172.21.15.2' 2024-06-13T02:04:06.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.027+0000 7f6e32600700 1 Processor -- start 2024-06-13T02:04:06.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.028+0000 7f6e32600700 1 -- start start 2024-06-13T02:04:06.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.028+0000 7f6e32600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c1088f0 0x7f6e2c10ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:06.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.028+0000 7f6e32600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c07c6c0 con 0x7f6e2c1088f0 2024-06-13T02:04:06.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.029+0000 7f6e2b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c1088f0 0x7f6e2c10ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:06.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.029+0000 7f6e2b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c1088f0 0x7f6e2c10ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57606/0 (socket says 172.21.15.2:57606) 2024-06-13T02:04:06.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.029+0000 7f6e2b400700 1 -- 172.21.15.2:0/721793635 learned_addr learned my addr 172.21.15.2:0/721793635 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:06.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.029+0000 7f6e2b400700 1 -- 172.21.15.2:0/721793635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2c10b220 con 0x7f6e2c1088f0 2024-06-13T02:04:06.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.030+0000 7f6e2b400700 1 --2- 172.21.15.2:0/721793635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c1088f0 0x7f6e2c10ace0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009e80 tx=0x7f6e1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94968611fa4dbef server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:06.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.030+0000 7f6e2a000700 1 -- 172.21.15.2:0/721793635 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c017070 con 0x7f6e2c1088f0 2024-06-13T02:04:06.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.030+0000 7f6e2a000700 1 -- 172.21.15.2:0/721793635 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e1c00b8c0 con 0x7f6e2c1088f0 2024-06-13T02:04:06.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.030+0000 7f6e2a000700 1 -- 172.21.15.2:0/721793635 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c0045c0 con 0x7f6e2c1088f0 2024-06-13T02:04:06.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.031+0000 7f6e32600700 1 -- 172.21.15.2:0/721793635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c1088f0 msgr2=0x7f6e2c10ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:06.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.031+0000 7f6e32600700 1 --2- 172.21.15.2:0/721793635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c1088f0 0x7f6e2c10ace0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009e80 tx=0x7f6e1c00b330 comp rx=0 tx=0).stop 2024-06-13T02:04:06.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.031+0000 7f6e32600700 1 -- 172.21.15.2:0/721793635 shutdown_connections 2024-06-13T02:04:06.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.031+0000 7f6e32600700 1 --2- 172.21.15.2:0/721793635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c1088f0 0x7f6e2c10ace0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:06.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.031+0000 7f6e32600700 1 -- 172.21.15.2:0/721793635 >> 172.21.15.2:0/721793635 conn(0x7f6e2c1023a0 msgr2=0x7f6e2c1047c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:06.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.031+0000 7f6e32600700 1 -- 172.21.15.2:0/721793635 shutdown_connections 2024-06-13T02:04:06.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.031+0000 7f6e32600700 1 -- 172.21.15.2:0/721793635 wait complete. 2024-06-13T02:04:06.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.032+0000 7f6e32600700 1 Processor -- start 2024-06-13T02:04:06.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.033+0000 7f6e32600700 1 -- start start 2024-06-13T02:04:06.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.033+0000 7f6e32600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c1088f0 0x7f6e2c19e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:06.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.033+0000 7f6e32600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2c10c240 con 0x7f6e2c1088f0 2024-06-13T02:04:06.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.033+0000 7f6e2b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c1088f0 0x7f6e2c19e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:06.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.033+0000 7f6e2b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c1088f0 0x7f6e2c19e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57622/0 (socket says 172.21.15.2:57622) 2024-06-13T02:04:06.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.033+0000 7f6e2b400700 1 -- 172.21.15.2:0/2908707777 learned_addr learned my addr 172.21.15.2:0/2908707777 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:06.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.034+0000 7f6e2b400700 1 -- 172.21.15.2:0/2908707777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2c19e570 con 0x7f6e2c1088f0 2024-06-13T02:04:06.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.034+0000 7f6e2b400700 1 --2- 172.21.15.2:0/2908707777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c1088f0 0x7f6e2c19e030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c004350 tx=0x7f6e1c00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:06.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.034+0000 7f6e23e00700 1 -- 172.21.15.2:0/2908707777 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c020020 con 0x7f6e2c1088f0 2024-06-13T02:04:06.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.034+0000 7f6e23e00700 1 -- 172.21.15.2:0/2908707777 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e1c003c10 con 0x7f6e2c1088f0 2024-06-13T02:04:06.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.034+0000 7f6e23e00700 1 -- 172.21.15.2:0/2908707777 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e1c017040 con 0x7f6e2c1088f0 2024-06-13T02:04:06.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.034+0000 7f6e32600700 1 -- 172.21.15.2:0/2908707777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e2c19e800 con 0x7f6e2c1088f0 2024-06-13T02:04:06.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.034+0000 7f6e32600700 1 -- 172.21.15.2:0/2908707777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e2c1a14f0 con 0x7f6e2c1088f0 2024-06-13T02:04:06.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.036+0000 7f6e23e00700 1 -- 172.21.15.2:0/2908707777 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6e1c023020 con 0x7f6e2c1088f0 2024-06-13T02:04:06.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.036+0000 7f6e32600700 1 -- 172.21.15.2:0/2908707777 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e2c063af0 con 0x7f6e2c1088f0 2024-06-13T02:04:06.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.036+0000 7f6e23e00700 1 --2- 172.21.15.2:0/2908707777 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f6e100390a0 0x7f6e1003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:06.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.036+0000 7f6e23e00700 1 -- 172.21.15.2:0/2908707777 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6e1c00f050 con 0x7f6e2c1088f0 2024-06-13T02:04:06.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.036+0000 7f6e2aa00700 1 --2- 172.21.15.2:0/2908707777 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f6e100390a0 0x7f6e1003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:06.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.037+0000 7f6e2aa00700 1 --2- 172.21.15.2:0/2908707777 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f6e100390a0 0x7f6e1003b560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6e18006fd0 tx=0x7f6e18006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:06.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.042+0000 7f6e23e00700 1 -- 172.21.15.2:0/2908707777 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6e1c02a020 con 0x7f6e2c1088f0 2024-06-13T02:04:06.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:03:59.277+0000 7f6e32600700 1 -- 172.21.15.2:0/2908707777 --> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi002", "addr": "172.21.15.2", "target": ["mon-mgr", ""]}) -- 0x7f6e2c1034e0 con 0x7f6e100390a0 2024-06-13T02:04:06.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:05.679+0000 7f6e23e00700 1 -- 172.21.15.2:0/2908707777 <== mgr.14120 v2:172.21.15.2:6800/3121279966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f6e2c1034e0 con 0x7f6e100390a0 2024-06-13T02:04:06.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:05.684+0000 7f6e32600700 1 -- 172.21.15.2:0/2908707777 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f6e100390a0 msgr2=0x7f6e1003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:06.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:05.684+0000 7f6e32600700 1 --2- 172.21.15.2:0/2908707777 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f6e100390a0 0x7f6e1003b560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6e18006fd0 tx=0x7f6e18006e40 comp rx=0 tx=0).stop 2024-06-13T02:04:06.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:05.684+0000 7f6e32600700 1 -- 172.21.15.2:0/2908707777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c1088f0 msgr2=0x7f6e2c19e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:06.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:05.684+0000 7f6e32600700 1 --2- 172.21.15.2:0/2908707777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c1088f0 0x7f6e2c19e030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c004350 tx=0x7f6e1c00bd50 comp rx=0 tx=0).stop 2024-06-13T02:04:06.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:05.685+0000 7f6e32600700 1 -- 172.21.15.2:0/2908707777 shutdown_connections 2024-06-13T02:04:06.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:05.685+0000 7f6e32600700 1 --2- 172.21.15.2:0/2908707777 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f6e100390a0 0x7f6e1003b560 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:06.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:05.685+0000 7f6e32600700 1 --2- 172.21.15.2:0/2908707777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e2c1088f0 0x7f6e2c19e030 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:06.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:05.685+0000 7f6e32600700 1 -- 172.21.15.2:0/2908707777 >> 172.21.15.2:0/2908707777 conn(0x7f6e2c1023a0 msgr2=0x7f6e2c102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:06.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:05.685+0000 7f6e32600700 1 -- 172.21.15.2:0/2908707777 shutdown_connections 2024-06-13T02:04:06.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:05.685+0000 7f6e32600700 1 -- 172.21.15.2:0/2908707777 wait complete. 2024-06-13T02:04:06.440 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mon service... 2024-06-13T02:04:07.020 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:06 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' 2024-06-13T02:04:07.021 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:06 smithi002 ceph-mon[31960]: Added host smithi002 2024-06-13T02:04:07.021 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:06 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:04:08.044 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-06-13T02:04:08.045 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.042+0000 7f1828a00700 1 Processor -- start 2024-06-13T02:04:08.045 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.043+0000 7f1828a00700 1 -- start start 2024-06-13T02:04:08.045 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.043+0000 7f1828a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1824081c90 0x7f18240820b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:08.045 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.043+0000 7f1828a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1824082680 con 0x7f1824081c90 2024-06-13T02:04:08.045 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.044+0000 7f1823400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1824081c90 0x7f18240820b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:08.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.044+0000 7f1823400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1824081c90 0x7f18240820b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47730/0 (socket says 172.21.15.2:47730) 2024-06-13T02:04:08.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.044+0000 7f1823400700 1 -- 172.21.15.2:0/13740526 learned_addr learned my addr 172.21.15.2:0/13740526 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:08.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.044+0000 7f1823400700 1 -- 172.21.15.2:0/13740526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182410f530 con 0x7f1824081c90 2024-06-13T02:04:08.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.044+0000 7f1823400700 1 --2- 172.21.15.2:0/13740526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1824081c90 0x7f18240820b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f18140098a0 tx=0x7f1814009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb0fc4a9046d402 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:08.046 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.045+0000 7f1822000700 1 -- 172.21.15.2:0/13740526 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1814004160 con 0x7f1824081c90 2024-06-13T02:04:08.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.045+0000 7f1822000700 1 -- 172.21.15.2:0/13740526 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1814004300 con 0x7f1824081c90 2024-06-13T02:04:08.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.045+0000 7f1822000700 1 -- 172.21.15.2:0/13740526 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1814011b50 con 0x7f1824081c90 2024-06-13T02:04:08.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.045+0000 7f1828a00700 1 -- 172.21.15.2:0/13740526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1824081c90 msgr2=0x7f18240820b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:08.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.045+0000 7f1828a00700 1 --2- 172.21.15.2:0/13740526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1824081c90 0x7f18240820b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f18140098a0 tx=0x7f1814009bb0 comp rx=0 tx=0).stop 2024-06-13T02:04:08.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.045+0000 7f1828a00700 1 -- 172.21.15.2:0/13740526 shutdown_connections 2024-06-13T02:04:08.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.045+0000 7f1828a00700 1 --2- 172.21.15.2:0/13740526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1824081c90 0x7f18240820b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:08.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.045+0000 7f1828a00700 1 -- 172.21.15.2:0/13740526 >> 172.21.15.2:0/13740526 conn(0x7f182407d2a0 msgr2=0x7f182407f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:08.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.046+0000 7f1828a00700 1 -- 172.21.15.2:0/13740526 shutdown_connections 2024-06-13T02:04:08.047 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.046+0000 7f1828a00700 1 -- 172.21.15.2:0/13740526 wait complete. 2024-06-13T02:04:08.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.047+0000 7f1828a00700 1 Processor -- start 2024-06-13T02:04:08.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.047+0000 7f1828a00700 1 -- start start 2024-06-13T02:04:08.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.047+0000 7f1828a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1824081c90 0x7f18241a22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:08.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.047+0000 7f1828a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f18241128e0 con 0x7f1824081c90 2024-06-13T02:04:08.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.048+0000 7f1823400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1824081c90 0x7f18241a22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:08.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.048+0000 7f1823400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1824081c90 0x7f18241a22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47746/0 (socket says 172.21.15.2:47746) 2024-06-13T02:04:08.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.048+0000 7f1823400700 1 -- 172.21.15.2:0/2140793649 learned_addr learned my addr 172.21.15.2:0/2140793649 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:08.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.048+0000 7f1823400700 1 -- 172.21.15.2:0/2140793649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18241a2820 con 0x7f1824081c90 2024-06-13T02:04:08.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.048+0000 7f1823400700 1 --2- 172.21.15.2:0/2140793649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1824081c90 0x7f18241a22e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1814011850 tx=0x7f1814011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:08.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.049+0000 7f181be00700 1 -- 172.21.15.2:0/2140793649 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1814003af0 con 0x7f1824081c90 2024-06-13T02:04:08.048 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.049+0000 7f181be00700 1 -- 172.21.15.2:0/2140793649 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1814020070 con 0x7f1824081c90 2024-06-13T02:04:08.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.049+0000 7f1828a00700 1 -- 172.21.15.2:0/2140793649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18241a2ab0 con 0x7f1824081c90 2024-06-13T02:04:08.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.049+0000 7f181be00700 1 -- 172.21.15.2:0/2140793649 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18140195a0 con 0x7f1824081c90 2024-06-13T02:04:08.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.049+0000 7f1828a00700 1 -- 172.21.15.2:0/2140793649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18241a57a0 con 0x7f1824081c90 2024-06-13T02:04:08.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.050+0000 7f181be00700 1 -- 172.21.15.2:0/2140793649 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f181401a430 con 0x7f1824081c90 2024-06-13T02:04:08.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.050+0000 7f1828a00700 1 -- 172.21.15.2:0/2140793649 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18240695a0 con 0x7f1824081c90 2024-06-13T02:04:08.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.051+0000 7f181be00700 1 --2- 172.21.15.2:0/2140793649 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f18080390a0 0x7f180803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:08.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.051+0000 7f181be00700 1 -- 172.21.15.2:0/2140793649 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1814011e00 con 0x7f1824081c90 2024-06-13T02:04:08.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.051+0000 7f1822a00700 1 --2- 172.21.15.2:0/2140793649 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f18080390a0 0x7f180803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:08.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.052+0000 7f1822a00700 1 --2- 172.21.15.2:0/2140793649 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f18080390a0 0x7f180803b560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1810006fd0 tx=0x7f1810006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:08.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.057+0000 7f181be00700 1 -- 172.21.15.2:0/2140793649 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f181400e260 con 0x7f1824081c90 2024-06-13T02:04:08.049 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.306+0000 7f1828a00700 1 -- 172.21.15.2:0/2140793649 --> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f182407e520 con 0x7f18080390a0 2024-06-13T02:04:08.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.313+0000 7f181be00700 1 -- 172.21.15.2:0/2140793649 <== mgr.14120 v2:172.21.15.2:6800/3121279966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f182407e520 con 0x7f18080390a0 2024-06-13T02:04:08.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.316+0000 7f1828a00700 1 -- 172.21.15.2:0/2140793649 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f18080390a0 msgr2=0x7f180803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:08.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.316+0000 7f1828a00700 1 --2- 172.21.15.2:0/2140793649 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f18080390a0 0x7f180803b560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1810006fd0 tx=0x7f1810006e40 comp rx=0 tx=0).stop 2024-06-13T02:04:08.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.316+0000 7f1828a00700 1 -- 172.21.15.2:0/2140793649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1824081c90 msgr2=0x7f18241a22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:08.050 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.316+0000 7f1828a00700 1 --2- 172.21.15.2:0/2140793649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1824081c90 0x7f18241a22e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1814011850 tx=0x7f1814011c10 comp rx=0 tx=0).stop 2024-06-13T02:04:08.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.316+0000 7f1828a00700 1 -- 172.21.15.2:0/2140793649 shutdown_connections 2024-06-13T02:04:08.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.316+0000 7f1828a00700 1 --2- 172.21.15.2:0/2140793649 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f18080390a0 0x7f180803b560 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:08.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.316+0000 7f1828a00700 1 --2- 172.21.15.2:0/2140793649 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1824081c90 0x7f18241a22e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:08.051 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.316+0000 7f1828a00700 1 -- 172.21.15.2:0/2140793649 >> 172.21.15.2:0/2140793649 conn(0x7f182407d2a0 msgr2=0x7f182407de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:08.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.316+0000 7f1828a00700 1 -- 172.21.15.2:0/2140793649 shutdown_connections 2024-06-13T02:04:08.052 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:07.317+0000 7f1828a00700 1 -- 172.21.15.2:0/2140793649 wait complete. 2024-06-13T02:04:08.052 INFO:teuthology.orchestra.run.smithi002.stdout:Deploying unmanaged mgr service... 2024-06-13T02:04:08.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:08 smithi002 ceph-mon[31960]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:04:08.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:08 smithi002 ceph-mon[31960]: Saving service mon spec with placement count:5 2024-06-13T02:04:08.611 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:08 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' 2024-06-13T02:04:10.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:09 smithi002 ceph-mon[31960]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:04:10.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:09 smithi002 ceph-mon[31960]: Saving service mgr spec with placement count:2 2024-06-13T02:04:10.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:09 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' 2024-06-13T02:04:10.000 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:09 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' 2024-06-13T02:04:10.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-06-13T02:04:10.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.679+0000 7fa948000700 1 Processor -- start 2024-06-13T02:04:10.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.679+0000 7fa948000700 1 -- start start 2024-06-13T02:04:10.287 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.679+0000 7fa948000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940107f30 0x7fa940108350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:10.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.679+0000 7fa948000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa940108890 con 0x7fa940107f30 2024-06-13T02:04:10.288 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.680+0000 7fa945600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940107f30 0x7fa940108350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:10.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.680+0000 7fa945600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940107f30 0x7fa940108350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47752/0 (socket says 172.21.15.2:47752) 2024-06-13T02:04:10.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.680+0000 7fa945600700 1 -- 172.21.15.2:0/937813331 learned_addr learned my addr 172.21.15.2:0/937813331 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:10.292 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.681+0000 7fa945600700 1 -- 172.21.15.2:0/937813331 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa940108ff0 con 0x7fa940107f30 2024-06-13T02:04:10.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.681+0000 7fa945600700 1 --2- 172.21.15.2:0/937813331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940107f30 0x7fa940108350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa934009e80 tx=0x7fa93400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3db55fada69634c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:10.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.681+0000 7fa93fe00700 1 -- 172.21.15.2:0/937813331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa934017070 con 0x7fa940107f30 2024-06-13T02:04:10.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.681+0000 7fa93fe00700 1 -- 172.21.15.2:0/937813331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa93400b8c0 con 0x7fa940107f30 2024-06-13T02:04:10.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.681+0000 7fa93fe00700 1 -- 172.21.15.2:0/937813331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9340045c0 con 0x7fa940107f30 2024-06-13T02:04:10.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.682+0000 7fa948000700 1 -- 172.21.15.2:0/937813331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940107f30 msgr2=0x7fa940108350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:10.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.682+0000 7fa948000700 1 --2- 172.21.15.2:0/937813331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940107f30 0x7fa940108350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa934009e80 tx=0x7fa93400b330 comp rx=0 tx=0).stop 2024-06-13T02:04:10.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.682+0000 7fa948000700 1 -- 172.21.15.2:0/937813331 shutdown_connections 2024-06-13T02:04:10.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.682+0000 7fa948000700 1 --2- 172.21.15.2:0/937813331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940107f30 0x7fa940108350 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:10.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.682+0000 7fa948000700 1 -- 172.21.15.2:0/937813331 >> 172.21.15.2:0/937813331 conn(0x7fa940103510 msgr2=0x7fa940105930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:10.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.682+0000 7fa948000700 1 -- 172.21.15.2:0/937813331 shutdown_connections 2024-06-13T02:04:10.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.682+0000 7fa948000700 1 -- 172.21.15.2:0/937813331 wait complete. 2024-06-13T02:04:10.293 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.683+0000 7fa948000700 1 Processor -- start 2024-06-13T02:04:10.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.684+0000 7fa948000700 1 -- start start 2024-06-13T02:04:10.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.684+0000 7fa948000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940107f30 0x7fa94019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:10.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.684+0000 7fa948000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa94010c430 con 0x7fa940107f30 2024-06-13T02:04:10.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.684+0000 7fa945600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940107f30 0x7fa94019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:10.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.684+0000 7fa945600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940107f30 0x7fa94019be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47760/0 (socket says 172.21.15.2:47760) 2024-06-13T02:04:10.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.684+0000 7fa945600700 1 -- 172.21.15.2:0/705672676 learned_addr learned my addr 172.21.15.2:0/705672676 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:10.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.685+0000 7fa945600700 1 -- 172.21.15.2:0/705672676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94019c350 con 0x7fa940107f30 2024-06-13T02:04:10.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.685+0000 7fa945600700 1 --2- 172.21.15.2:0/705672676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940107f30 0x7fa94019be10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa934009530 tx=0x7fa93400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:10.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.685+0000 7fa93e000700 1 -- 172.21.15.2:0/705672676 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa934020020 con 0x7fa940107f30 2024-06-13T02:04:10.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.685+0000 7fa93e000700 1 -- 172.21.15.2:0/705672676 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa934003b50 con 0x7fa940107f30 2024-06-13T02:04:10.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.685+0000 7fa948000700 1 -- 172.21.15.2:0/705672676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa94019c5e0 con 0x7fa940107f30 2024-06-13T02:04:10.294 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.685+0000 7fa93e000700 1 -- 172.21.15.2:0/705672676 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa934017040 con 0x7fa940107f30 2024-06-13T02:04:10.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.685+0000 7fa948000700 1 -- 172.21.15.2:0/705672676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa94019f2d0 con 0x7fa940107f30 2024-06-13T02:04:10.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.687+0000 7fa93e000700 1 -- 172.21.15.2:0/705672676 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa934023020 con 0x7fa940107f30 2024-06-13T02:04:10.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.687+0000 7fa948000700 1 -- 172.21.15.2:0/705672676 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa940063af0 con 0x7fa940107f30 2024-06-13T02:04:10.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.687+0000 7fa93e000700 1 --2- 172.21.15.2:0/705672676 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fa9280390a0 0x7fa92803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:10.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.687+0000 7fa93e000700 1 -- 172.21.15.2:0/705672676 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa93400f050 con 0x7fa940107f30 2024-06-13T02:04:10.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.687+0000 7fa944c00700 1 --2- 172.21.15.2:0/705672676 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fa9280390a0 0x7fa92803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:10.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.688+0000 7fa944c00700 1 --2- 172.21.15.2:0/705672676 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fa9280390a0 0x7fa92803b560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa92c006fd0 tx=0x7fa92c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:10.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.693+0000 7fa93e000700 1 -- 172.21.15.2:0/705672676 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa93402a020 con 0x7fa940107f30 2024-06-13T02:04:10.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.944+0000 7fa948000700 1 -- 172.21.15.2:0/705672676 --> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fa9401046c0 con 0x7fa9280390a0 2024-06-13T02:04:10.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.949+0000 7fa93e000700 1 -- 172.21.15.2:0/705672676 <== mgr.14120 v2:172.21.15.2:6800/3121279966 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa9401046c0 con 0x7fa9280390a0 2024-06-13T02:04:10.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.952+0000 7fa948000700 1 -- 172.21.15.2:0/705672676 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fa9280390a0 msgr2=0x7fa92803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:10.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.952+0000 7fa948000700 1 --2- 172.21.15.2:0/705672676 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fa9280390a0 0x7fa92803b560 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa92c006fd0 tx=0x7fa92c006e40 comp rx=0 tx=0).stop 2024-06-13T02:04:10.295 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.952+0000 7fa948000700 1 -- 172.21.15.2:0/705672676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940107f30 msgr2=0x7fa94019be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:10.296 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.952+0000 7fa948000700 1 --2- 172.21.15.2:0/705672676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940107f30 0x7fa94019be10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa934009530 tx=0x7fa93400bd50 comp rx=0 tx=0).stop 2024-06-13T02:04:10.296 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.952+0000 7fa948000700 1 -- 172.21.15.2:0/705672676 shutdown_connections 2024-06-13T02:04:10.296 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.952+0000 7fa948000700 1 --2- 172.21.15.2:0/705672676 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fa9280390a0 0x7fa92803b560 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:10.296 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.952+0000 7fa948000700 1 --2- 172.21.15.2:0/705672676 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa940107f30 0x7fa94019be10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:10.296 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.952+0000 7fa948000700 1 -- 172.21.15.2:0/705672676 >> 172.21.15.2:0/705672676 conn(0x7fa940103510 msgr2=0x7fa940103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:10.296 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.952+0000 7fa948000700 1 -- 172.21.15.2:0/705672676 shutdown_connections 2024-06-13T02:04:10.296 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:08.952+0000 7fa948000700 1 -- 172.21.15.2:0/705672676 wait complete. 2024-06-13T02:04:11.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:11 smithi002 ceph-mon[31960]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:04:11.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:11 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' 2024-06-13T02:04:11.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:11 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2480302698' entity='client.admin' 2024-06-13T02:04:11.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.892+0000 7fc80f600700 1 Processor -- start 2024-06-13T02:04:11.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.892+0000 7fc80f600700 1 -- start start 2024-06-13T02:04:11.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.892+0000 7fc80f600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc808107e90 0x7fc8081082b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:11.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.892+0000 7fc80f600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc8081087f0 con 0x7fc808107e90 2024-06-13T02:04:11.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.893+0000 7fc80cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc808107e90 0x7fc8081082b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:11.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.893+0000 7fc80cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc808107e90 0x7fc8081082b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47766/0 (socket says 172.21.15.2:47766) 2024-06-13T02:04:11.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.893+0000 7fc80cc00700 1 -- 172.21.15.2:0/3395871908 learned_addr learned my addr 172.21.15.2:0/3395871908 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:11.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.893+0000 7fc80cc00700 1 -- 172.21.15.2:0/3395871908 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc808108fa0 con 0x7fc808107e90 2024-06-13T02:04:11.847 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.894+0000 7fc80cc00700 1 --2- 172.21.15.2:0/3395871908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc808107e90 0x7fc8081082b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc0098a0 tx=0x7fc7fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb513f6a990a28e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:11.852 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.894+0000 7fc807400700 1 -- 172.21.15.2:0/3395871908 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7fc004160 con 0x7fc808107e90 2024-06-13T02:04:11.852 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.894+0000 7fc807400700 1 -- 172.21.15.2:0/3395871908 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7fc004300 con 0x7fc808107e90 2024-06-13T02:04:11.852 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.894+0000 7fc807400700 1 -- 172.21.15.2:0/3395871908 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7fc011b20 con 0x7fc808107e90 2024-06-13T02:04:11.852 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.895+0000 7fc80f600700 1 -- 172.21.15.2:0/3395871908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc808107e90 msgr2=0x7fc8081082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:11.852 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.895+0000 7fc80f600700 1 --2- 172.21.15.2:0/3395871908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc808107e90 0x7fc8081082b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc0098a0 tx=0x7fc7fc009bb0 comp rx=0 tx=0).stop 2024-06-13T02:04:11.852 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.895+0000 7fc80f600700 1 -- 172.21.15.2:0/3395871908 shutdown_connections 2024-06-13T02:04:11.852 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.895+0000 7fc80f600700 1 --2- 172.21.15.2:0/3395871908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc808107e90 0x7fc8081082b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:11.852 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.895+0000 7fc80f600700 1 -- 172.21.15.2:0/3395871908 >> 172.21.15.2:0/3395871908 conn(0x7fc808103430 msgr2=0x7fc808105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:11.852 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.895+0000 7fc80f600700 1 -- 172.21.15.2:0/3395871908 shutdown_connections 2024-06-13T02:04:11.852 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.895+0000 7fc80f600700 1 -- 172.21.15.2:0/3395871908 wait complete. 2024-06-13T02:04:11.852 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.896+0000 7fc80f600700 1 Processor -- start 2024-06-13T02:04:11.852 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.897+0000 7fc80f600700 1 -- start start 2024-06-13T02:04:11.853 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.897+0000 7fc80f600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc808107e90 0x7fc80819e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:11.853 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.897+0000 7fc80f600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc80810c3e0 con 0x7fc808107e90 2024-06-13T02:04:11.853 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.897+0000 7fc80cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc808107e90 0x7fc80819e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:11.853 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.897+0000 7fc80cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc808107e90 0x7fc80819e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47776/0 (socket says 172.21.15.2:47776) 2024-06-13T02:04:11.853 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.897+0000 7fc80cc00700 1 -- 172.21.15.2:0/2480302698 learned_addr learned my addr 172.21.15.2:0/2480302698 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:11.853 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.898+0000 7fc80cc00700 1 -- 172.21.15.2:0/2480302698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80819e560 con 0x7fc808107e90 2024-06-13T02:04:11.853 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.898+0000 7fc80cc00700 1 --2- 172.21.15.2:0/2480302698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc808107e90 0x7fc80819e020 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc0117e0 tx=0x7fc7fc011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:11.853 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.898+0000 7fc805600700 1 -- 172.21.15.2:0/2480302698 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7fc003ba0 con 0x7fc808107e90 2024-06-13T02:04:11.853 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.898+0000 7fc805600700 1 -- 172.21.15.2:0/2480302698 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7fc01a910 con 0x7fc808107e90 2024-06-13T02:04:11.853 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.898+0000 7fc80f600700 1 -- 172.21.15.2:0/2480302698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc80819e7f0 con 0x7fc808107e90 2024-06-13T02:04:11.853 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.898+0000 7fc805600700 1 -- 172.21.15.2:0/2480302698 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7fc0248f0 con 0x7fc808107e90 2024-06-13T02:04:11.853 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.898+0000 7fc80f600700 1 -- 172.21.15.2:0/2480302698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc80819ec50 con 0x7fc808107e90 2024-06-13T02:04:11.853 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.900+0000 7fc80f600700 1 -- 172.21.15.2:0/2480302698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc808063af0 con 0x7fc808107e90 2024-06-13T02:04:11.853 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.900+0000 7fc805600700 1 -- 172.21.15.2:0/2480302698 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fc7fc022020 con 0x7fc808107e90 2024-06-13T02:04:11.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.900+0000 7fc805600700 1 --2- 172.21.15.2:0/2480302698 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fc7f0039050 0x7fc7f003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:11.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.900+0000 7fc805600700 1 -- 172.21.15.2:0/2480302698 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc7fc04d970 con 0x7fc808107e90 2024-06-13T02:04:11.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.901+0000 7fc807e00700 1 --2- 172.21.15.2:0/2480302698 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fc7f0039050 0x7fc7f003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:11.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.901+0000 7fc807e00700 1 --2- 172.21.15.2:0/2480302698 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fc7f0039050 0x7fc7f003b510 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4006fd0 tx=0x7fc7f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:11.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:10.906+0000 7fc805600700 1 -- 172.21.15.2:0/2480302698 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc7fc02dc90 con 0x7fc808107e90 2024-06-13T02:04:11.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:11.137+0000 7fc80f600700 1 -- 172.21.15.2:0/2480302698 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fc8081a1490 con 0x7fc808107e90 2024-06-13T02:04:11.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:11.142+0000 7fc805600700 1 -- 172.21.15.2:0/2480302698 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fc7fc00b3e0 con 0x7fc808107e90 2024-06-13T02:04:11.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:11.146+0000 7fc80f600700 1 -- 172.21.15.2:0/2480302698 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fc7f0039050 msgr2=0x7fc7f003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:11.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:11.146+0000 7fc80f600700 1 --2- 172.21.15.2:0/2480302698 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fc7f0039050 0x7fc7f003b510 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4006fd0 tx=0x7fc7f4006e40 comp rx=0 tx=0).stop 2024-06-13T02:04:11.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:11.146+0000 7fc80f600700 1 -- 172.21.15.2:0/2480302698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc808107e90 msgr2=0x7fc80819e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:11.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:11.146+0000 7fc80f600700 1 --2- 172.21.15.2:0/2480302698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc808107e90 0x7fc80819e020 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc0117e0 tx=0x7fc7fc011ba0 comp rx=0 tx=0).stop 2024-06-13T02:04:11.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:11.146+0000 7fc80f600700 1 -- 172.21.15.2:0/2480302698 shutdown_connections 2024-06-13T02:04:11.854 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:11.146+0000 7fc80f600700 1 --2- 172.21.15.2:0/2480302698 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fc7f0039050 0x7fc7f003b510 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:11.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:11.146+0000 7fc80f600700 1 --2- 172.21.15.2:0/2480302698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc808107e90 0x7fc80819e020 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:11.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:11.146+0000 7fc80f600700 1 -- 172.21.15.2:0/2480302698 >> 172.21.15.2:0/2480302698 conn(0x7fc808103430 msgr2=0x7fc80807c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:11.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:11.147+0000 7fc80f600700 1 -- 172.21.15.2:0/2480302698 shutdown_connections 2024-06-13T02:04:11.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:11.147+0000 7fc80f600700 1 -- 172.21.15.2:0/2480302698 wait complete. 2024-06-13T02:04:13.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.523+0000 7f2d5b200700 1 Processor -- start 2024-06-13T02:04:13.821 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.523+0000 7f2d5b200700 1 -- start start 2024-06-13T02:04:13.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.524+0000 7f2d5b200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d54108950 0x7f2d5410ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:13.822 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.524+0000 7f2d5b200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5407bdb0 con 0x7f2d54108950 2024-06-13T02:04:13.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.524+0000 7f2d53e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d54108950 0x7f2d5410ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:13.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.525+0000 7f2d53e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d54108950 0x7f2d5410ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33066/0 (socket says 172.21.15.2:33066) 2024-06-13T02:04:13.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.525+0000 7f2d53e00700 1 -- 172.21.15.2:0/3333511857 learned_addr learned my addr 172.21.15.2:0/3333511857 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:13.823 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.525+0000 7f2d53e00700 1 -- 172.21.15.2:0/3333511857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5410b280 con 0x7f2d54108950 2024-06-13T02:04:13.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.526+0000 7f2d53e00700 1 --2- 172.21.15.2:0/3333511857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d54108950 0x7f2d5410ad40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2d440098a0 tx=0x7f2d44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a5d8508ba6290 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:13.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.526+0000 7f2d52a00700 1 -- 172.21.15.2:0/3333511857 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d44004160 con 0x7f2d54108950 2024-06-13T02:04:13.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.526+0000 7f2d52a00700 1 -- 172.21.15.2:0/3333511857 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d44004300 con 0x7f2d54108950 2024-06-13T02:04:13.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.526+0000 7f2d52a00700 1 -- 172.21.15.2:0/3333511857 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d44011b20 con 0x7f2d54108950 2024-06-13T02:04:13.824 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.527+0000 7f2d5b200700 1 -- 172.21.15.2:0/3333511857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d54108950 msgr2=0x7f2d5410ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:13.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.527+0000 7f2d5b200700 1 --2- 172.21.15.2:0/3333511857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d54108950 0x7f2d5410ad40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2d440098a0 tx=0x7f2d44009bb0 comp rx=0 tx=0).stop 2024-06-13T02:04:13.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.527+0000 7f2d5b200700 1 -- 172.21.15.2:0/3333511857 shutdown_connections 2024-06-13T02:04:13.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.527+0000 7f2d5b200700 1 --2- 172.21.15.2:0/3333511857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d54108950 0x7f2d5410ad40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:13.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.527+0000 7f2d5b200700 1 -- 172.21.15.2:0/3333511857 >> 172.21.15.2:0/3333511857 conn(0x7f2d54102360 msgr2=0x7f2d54104780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:13.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.527+0000 7f2d5b200700 1 -- 172.21.15.2:0/3333511857 shutdown_connections 2024-06-13T02:04:13.825 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.527+0000 7f2d5b200700 1 -- 172.21.15.2:0/3333511857 wait complete. 2024-06-13T02:04:13.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.529+0000 7f2d5b200700 1 Processor -- start 2024-06-13T02:04:13.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.529+0000 7f2d5b200700 1 -- start start 2024-06-13T02:04:13.826 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.529+0000 7f2d5b200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d54108950 0x7f2d5419dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:13.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.529+0000 7f2d5b200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5410c220 con 0x7f2d54108950 2024-06-13T02:04:13.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.530+0000 7f2d53e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d54108950 0x7f2d5419dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:13.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.530+0000 7f2d53e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d54108950 0x7f2d5419dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33082/0 (socket says 172.21.15.2:33082) 2024-06-13T02:04:13.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.530+0000 7f2d53e00700 1 -- 172.21.15.2:0/2610946269 learned_addr learned my addr 172.21.15.2:0/2610946269 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:13.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.530+0000 7f2d53e00700 1 -- 172.21.15.2:0/2610946269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5419e4f0 con 0x7f2d54108950 2024-06-13T02:04:13.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.531+0000 7f2d53e00700 1 --2- 172.21.15.2:0/2610946269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d54108950 0x7f2d5419dfb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2d440117e0 tx=0x7f2d44011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:13.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.531+0000 7f2d50c00700 1 -- 172.21.15.2:0/2610946269 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d44003ba0 con 0x7f2d54108950 2024-06-13T02:04:13.827 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.531+0000 7f2d50c00700 1 -- 172.21.15.2:0/2610946269 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d4401a910 con 0x7f2d54108950 2024-06-13T02:04:13.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.531+0000 7f2d5b200700 1 -- 172.21.15.2:0/2610946269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d5419e780 con 0x7f2d54108950 2024-06-13T02:04:13.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.531+0000 7f2d50c00700 1 -- 172.21.15.2:0/2610946269 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d440248f0 con 0x7f2d54108950 2024-06-13T02:04:13.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.531+0000 7f2d5b200700 1 -- 172.21.15.2:0/2610946269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d5419ebe0 con 0x7f2d54108950 2024-06-13T02:04:13.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.532+0000 7f2d5b200700 1 -- 172.21.15.2:0/2610946269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d54063af0 con 0x7f2d54108950 2024-06-13T02:04:13.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.533+0000 7f2d50c00700 1 -- 172.21.15.2:0/2610946269 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2d44022020 con 0x7f2d54108950 2024-06-13T02:04:13.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.533+0000 7f2d50c00700 1 --2- 172.21.15.2:0/2610946269 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f2d38039050 0x7f2d3803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:13.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.533+0000 7f2d50c00700 1 -- 172.21.15.2:0/2610946269 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2d4404dad0 con 0x7f2d54108950 2024-06-13T02:04:13.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.534+0000 7f2d53400700 1 --2- 172.21.15.2:0/2610946269 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f2d38039050 0x7f2d3803b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:13.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.534+0000 7f2d53400700 1 --2- 172.21.15.2:0/2610946269 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f2d38039050 0x7f2d3803b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2d40006fd0 tx=0x7f2d40006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:13.829 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.543+0000 7f2d50c00700 1 -- 172.21.15.2:0/2610946269 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2d4404d420 con 0x7f2d54108950 2024-06-13T02:04:13.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.775+0000 7f2d5b200700 1 -- 172.21.15.2:0/2610946269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f2d541a15b0 con 0x7f2d54108950 2024-06-13T02:04:13.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.778+0000 7f2d50c00700 1 -- 172.21.15.2:0/2610946269 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f2d4402d910 con 0x7f2d54108950 2024-06-13T02:04:13.830 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.782+0000 7f2d5b200700 1 -- 172.21.15.2:0/2610946269 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f2d38039050 msgr2=0x7f2d3803b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:13.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.782+0000 7f2d5b200700 1 --2- 172.21.15.2:0/2610946269 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f2d38039050 0x7f2d3803b510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2d40006fd0 tx=0x7f2d40006e40 comp rx=0 tx=0).stop 2024-06-13T02:04:13.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.782+0000 7f2d5b200700 1 -- 172.21.15.2:0/2610946269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d54108950 msgr2=0x7f2d5419dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:13.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.782+0000 7f2d5b200700 1 --2- 172.21.15.2:0/2610946269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d54108950 0x7f2d5419dfb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2d440117e0 tx=0x7f2d44011ba0 comp rx=0 tx=0).stop 2024-06-13T02:04:13.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.782+0000 7f2d5b200700 1 -- 172.21.15.2:0/2610946269 shutdown_connections 2024-06-13T02:04:13.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.782+0000 7f2d5b200700 1 --2- 172.21.15.2:0/2610946269 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f2d38039050 0x7f2d3803b510 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:13.831 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.782+0000 7f2d5b200700 1 --2- 172.21.15.2:0/2610946269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d54108950 0x7f2d5419dfb0 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2d440117e0 tx=0x7f2d44011ba0 comp rx=0 tx=0).stop 2024-06-13T02:04:13.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.782+0000 7f2d5b200700 1 -- 172.21.15.2:0/2610946269 >> 172.21.15.2:0/2610946269 conn(0x7f2d54102360 msgr2=0x7f2d54102d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:13.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.782+0000 7f2d5b200700 1 -- 172.21.15.2:0/2610946269 shutdown_connections 2024-06-13T02:04:13.832 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:12.782+0000 7f2d5b200700 1 -- 172.21.15.2:0/2610946269 wait complete. 2024-06-13T02:04:13.832 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling the dashboard module... 2024-06-13T02:04:14.110 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:13 smithi002 ceph-mon[31960]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:04:14.111 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:13 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2610946269' entity='client.admin' 2024-06-13T02:04:15.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:14 smithi002 ceph-mon[31960]: from='mgr.14120 172.21.15.2:0/2687420389' entity='mgr.x' 2024-06-13T02:04:15.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:14 smithi002 ceph-mon[31960]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:04:15.252 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:14 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3396106270' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-06-13T02:04:15.253 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:15 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: ignoring --setuser ceph since I am not root 2024-06-13T02:04:15.253 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:15 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: ignoring --setgroup ceph since I am not root 2024-06-13T02:04:15.253 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:15 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:15.251+0000 7f34b8c63200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T02:04:15.781 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.419+0000 7fd07b400700 1 Processor -- start 2024-06-13T02:04:15.781 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:15 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:15.517+0000 7f34b8c63200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:04:15.781 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:15 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:15.653+0000 7f34b8c63200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T02:04:15.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.420+0000 7fd07b400700 1 -- start start 2024-06-13T02:04:15.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.420+0000 7fd07b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd07407de50 0x7fd07407c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:15.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.420+0000 7fd07b400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd07407c880 con 0x7fd07407de50 2024-06-13T02:04:15.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.421+0000 7fd078a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd07407de50 0x7fd07407c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:15.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.421+0000 7fd078a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd07407de50 0x7fd07407c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33088/0 (socket says 172.21.15.2:33088) 2024-06-13T02:04:15.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.421+0000 7fd078a00700 1 -- 172.21.15.2:0/1885086169 learned_addr learned my addr 172.21.15.2:0/1885086169 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:15.787 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.421+0000 7fd078a00700 1 -- 172.21.15.2:0/1885086169 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07407ca00 con 0x7fd07407de50 2024-06-13T02:04:15.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.422+0000 7fd078a00700 1 --2- 172.21.15.2:0/1885086169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd07407de50 0x7fd07407c2b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd0680098a0 tx=0x7fd068009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14a565749af856f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:15.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.422+0000 7fd073400700 1 -- 172.21.15.2:0/1885086169 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd068004160 con 0x7fd07407de50 2024-06-13T02:04:15.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.422+0000 7fd073400700 1 -- 172.21.15.2:0/1885086169 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd068004300 con 0x7fd07407de50 2024-06-13T02:04:15.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.422+0000 7fd073400700 1 -- 172.21.15.2:0/1885086169 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd068011b20 con 0x7fd07407de50 2024-06-13T02:04:15.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.423+0000 7fd07b400700 1 -- 172.21.15.2:0/1885086169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd07407de50 msgr2=0x7fd07407c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:15.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.423+0000 7fd07b400700 1 --2- 172.21.15.2:0/1885086169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd07407de50 0x7fd07407c2b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd0680098a0 tx=0x7fd068009bb0 comp rx=0 tx=0).stop 2024-06-13T02:04:15.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.423+0000 7fd07b400700 1 -- 172.21.15.2:0/1885086169 shutdown_connections 2024-06-13T02:04:15.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.423+0000 7fd07b400700 1 --2- 172.21.15.2:0/1885086169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd07407de50 0x7fd07407c2b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:15.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.423+0000 7fd07b400700 1 -- 172.21.15.2:0/1885086169 >> 172.21.15.2:0/1885086169 conn(0x7fd0741033a0 msgr2=0x7fd074105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:15.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.423+0000 7fd07b400700 1 -- 172.21.15.2:0/1885086169 shutdown_connections 2024-06-13T02:04:15.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.423+0000 7fd07b400700 1 -- 172.21.15.2:0/1885086169 wait complete. 2024-06-13T02:04:15.788 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.424+0000 7fd07b400700 1 Processor -- start 2024-06-13T02:04:15.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.424+0000 7fd07b400700 1 -- start start 2024-06-13T02:04:15.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.425+0000 7fd07b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd07407de50 0x7fd07419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:15.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.425+0000 7fd07b400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd07410e4c0 con 0x7fd07407de50 2024-06-13T02:04:15.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.425+0000 7fd078a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd07407de50 0x7fd07419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:15.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.425+0000 7fd078a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd07407de50 0x7fd07419dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33100/0 (socket says 172.21.15.2:33100) 2024-06-13T02:04:15.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.425+0000 7fd078a00700 1 -- 172.21.15.2:0/3396106270 learned_addr learned my addr 172.21.15.2:0/3396106270 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:15.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.425+0000 7fd078a00700 1 -- 172.21.15.2:0/3396106270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07419e530 con 0x7fd07407de50 2024-06-13T02:04:15.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.426+0000 7fd078a00700 1 --2- 172.21.15.2:0/3396106270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd07407de50 0x7fd07419dff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd0680116a0 tx=0x7fd068011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:15.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.426+0000 7fd071600700 1 -- 172.21.15.2:0/3396106270 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd068003a40 con 0x7fd07407de50 2024-06-13T02:04:15.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.426+0000 7fd071600700 1 -- 172.21.15.2:0/3396106270 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd068003be0 con 0x7fd07407de50 2024-06-13T02:04:15.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.426+0000 7fd071600700 1 -- 172.21.15.2:0/3396106270 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd06801a750 con 0x7fd07407de50 2024-06-13T02:04:15.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.426+0000 7fd07b400700 1 -- 172.21.15.2:0/3396106270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd07419e7c0 con 0x7fd07407de50 2024-06-13T02:04:15.789 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.426+0000 7fd07b400700 1 -- 172.21.15.2:0/3396106270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd07419ec20 con 0x7fd07407de50 2024-06-13T02:04:15.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.427+0000 7fd07b400700 1 -- 172.21.15.2:0/3396106270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd074063af0 con 0x7fd07407de50 2024-06-13T02:04:15.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.428+0000 7fd071600700 1 -- 172.21.15.2:0/3396106270 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd068024aa0 con 0x7fd07407de50 2024-06-13T02:04:15.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.428+0000 7fd071600700 1 --2- 172.21.15.2:0/3396106270 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fd05c039000 0x7fd05c03b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:15.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.428+0000 7fd071600700 1 -- 172.21.15.2:0/3396106270 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd06804d820 con 0x7fd07407de50 2024-06-13T02:04:15.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.429+0000 7fd073e00700 1 --2- 172.21.15.2:0/3396106270 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fd05c039000 0x7fd05c03b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:15.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.429+0000 7fd073e00700 1 --2- 172.21.15.2:0/3396106270 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fd05c039000 0x7fd05c03b4c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd060006fd0 tx=0x7fd060006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:15.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.434+0000 7fd071600700 1 -- 172.21.15.2:0/3396106270 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd068011e20 con 0x7fd07407de50 2024-06-13T02:04:15.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.728+0000 7fd07b400700 1 -- 172.21.15.2:0/3396106270 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fd0741a1a00 con 0x7fd07407de50 2024-06-13T02:04:15.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.932+0000 7fd071600700 1 -- 172.21.15.2:0/3396106270 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fd06804d0f0 con 0x7fd07407de50 2024-06-13T02:04:15.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.935+0000 7fd07b400700 1 -- 172.21.15.2:0/3396106270 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fd05c039000 msgr2=0x7fd05c03b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:15.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.935+0000 7fd07b400700 1 --2- 172.21.15.2:0/3396106270 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fd05c039000 0x7fd05c03b4c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd060006fd0 tx=0x7fd060006e40 comp rx=0 tx=0).stop 2024-06-13T02:04:15.790 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.935+0000 7fd07b400700 1 -- 172.21.15.2:0/3396106270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd07407de50 msgr2=0x7fd07419dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:15.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.935+0000 7fd07b400700 1 --2- 172.21.15.2:0/3396106270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd07407de50 0x7fd07419dff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd0680116a0 tx=0x7fd068011ba0 comp rx=0 tx=0).stop 2024-06-13T02:04:15.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.936+0000 7fd07b400700 1 -- 172.21.15.2:0/3396106270 shutdown_connections 2024-06-13T02:04:15.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.936+0000 7fd07b400700 1 --2- 172.21.15.2:0/3396106270 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7fd05c039000 0x7fd05c03b4c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:15.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.936+0000 7fd07b400700 1 --2- 172.21.15.2:0/3396106270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd07407de50 0x7fd07419dff0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:15.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.936+0000 7fd07b400700 1 -- 172.21.15.2:0/3396106270 >> 172.21.15.2:0/3396106270 conn(0x7fd0741033a0 msgr2=0x7fd074103f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:15.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.936+0000 7fd07b400700 1 -- 172.21.15.2:0/3396106270 shutdown_connections 2024-06-13T02:04:15.791 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:14.936+0000 7fd07b400700 1 -- 172.21.15.2:0/3396106270 wait complete. 2024-06-13T02:04:16.067 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:15 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3396106270' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-06-13T02:04:16.068 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:15 smithi002 ceph-mon[31960]: mgrmap e9: x(active, since 24s) 2024-06-13T02:04:16.377 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:16 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:16.066+0000 7f34b8c63200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T02:04:16.378 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:16 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:16.188+0000 7f34b8c63200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T02:04:17.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:16 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3542658203' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-13T02:04:17.430 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T02:04:17.431 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-06-13T02:04:17.431 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-13T02:04:17.431 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-13T02:04:17.431 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-13T02:04:17.431 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T02:04:17.431 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.448+0000 7f0a32c00700 1 Processor -- start 2024-06-13T02:04:17.431 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.448+0000 7f0a32c00700 1 -- start start 2024-06-13T02:04:17.431 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.449+0000 7f0a32c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a2c108780 0x7f0a2c10ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:17.431 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.449+0000 7f0a32c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2c07be00 con 0x7f0a2c108780 2024-06-13T02:04:17.431 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.449+0000 7f0a31800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a2c108780 0x7f0a2c10ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:17.431 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.449+0000 7f0a31800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a2c108780 0x7f0a2c10ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33130/0 (socket says 172.21.15.2:33130) 2024-06-13T02:04:17.431 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.449+0000 7f0a31800700 1 -- 172.21.15.2:0/1191712313 learned_addr learned my addr 172.21.15.2:0/1191712313 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:17.432 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.450+0000 7f0a31800700 1 -- 172.21.15.2:0/1191712313 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2c10b0b0 con 0x7f0a2c108780 2024-06-13T02:04:17.432 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.450+0000 7f0a31800700 1 --2- 172.21.15.2:0/1191712313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a2c108780 0x7f0a2c10ab70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0a200098a0 tx=0x7f0a20009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1a81804fefe7c7 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:17.432 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.450+0000 7f0a2be00700 1 -- 172.21.15.2:0/1191712313 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a20004160 con 0x7f0a2c108780 2024-06-13T02:04:17.432 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.450+0000 7f0a2be00700 1 -- 172.21.15.2:0/1191712313 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a20004300 con 0x7f0a2c108780 2024-06-13T02:04:17.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.450+0000 7f0a2be00700 1 -- 172.21.15.2:0/1191712313 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a20011b20 con 0x7f0a2c108780 2024-06-13T02:04:17.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.451+0000 7f0a32c00700 1 -- 172.21.15.2:0/1191712313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a2c108780 msgr2=0x7f0a2c10ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:17.436 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.451+0000 7f0a32c00700 1 --2- 172.21.15.2:0/1191712313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a2c108780 0x7f0a2c10ab70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0a200098a0 tx=0x7f0a20009bb0 comp rx=0 tx=0).stop 2024-06-13T02:04:17.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.451+0000 7f0a32c00700 1 -- 172.21.15.2:0/1191712313 shutdown_connections 2024-06-13T02:04:17.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.451+0000 7f0a32c00700 1 --2- 172.21.15.2:0/1191712313 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a2c108780 0x7f0a2c10ab70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:17.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.451+0000 7f0a32c00700 1 -- 172.21.15.2:0/1191712313 >> 172.21.15.2:0/1191712313 conn(0x7f0a2c102130 msgr2=0x7f0a2c104570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:17.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.451+0000 7f0a32c00700 1 -- 172.21.15.2:0/1191712313 shutdown_connections 2024-06-13T02:04:17.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.451+0000 7f0a32c00700 1 -- 172.21.15.2:0/1191712313 wait complete. 2024-06-13T02:04:17.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.453+0000 7f0a32c00700 1 Processor -- start 2024-06-13T02:04:17.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.453+0000 7f0a32c00700 1 -- start start 2024-06-13T02:04:17.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.453+0000 7f0a32c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a2c108780 0x7f0a2c19def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:17.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.453+0000 7f0a32c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2c10c0b0 con 0x7f0a2c108780 2024-06-13T02:04:17.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.453+0000 7f0a31800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a2c108780 0x7f0a2c19def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:17.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.454+0000 7f0a31800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a2c108780 0x7f0a2c19def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33140/0 (socket says 172.21.15.2:33140) 2024-06-13T02:04:17.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.454+0000 7f0a31800700 1 -- 172.21.15.2:0/3542658203 learned_addr learned my addr 172.21.15.2:0/3542658203 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:17.437 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.454+0000 7f0a31800700 1 -- 172.21.15.2:0/3542658203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2c19e430 con 0x7f0a2c108780 2024-06-13T02:04:17.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.454+0000 7f0a31800700 1 --2- 172.21.15.2:0/3542658203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a2c108780 0x7f0a2c19def0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0a20011b60 tx=0x7f0a20011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:17.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.455+0000 7f0a2a000700 1 -- 172.21.15.2:0/3542658203 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a20003b60 con 0x7f0a2c108780 2024-06-13T02:04:17.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.455+0000 7f0a2a000700 1 -- 172.21.15.2:0/3542658203 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a2001a910 con 0x7f0a2c108780 2024-06-13T02:04:17.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.455+0000 7f0a32c00700 1 -- 172.21.15.2:0/3542658203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2c19e6c0 con 0x7f0a2c108780 2024-06-13T02:04:17.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.455+0000 7f0a2a000700 1 -- 172.21.15.2:0/3542658203 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a20024930 con 0x7f0a2c108780 2024-06-13T02:04:17.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.455+0000 7f0a32c00700 1 -- 172.21.15.2:0/3542658203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a2c19eb20 con 0x7f0a2c108780 2024-06-13T02:04:17.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.456+0000 7f0a32c00700 1 -- 172.21.15.2:0/3542658203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a2c0695a0 con 0x7f0a2c108780 2024-06-13T02:04:17.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.457+0000 7f0a2a000700 1 -- 172.21.15.2:0/3542658203 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f0a20022020 con 0x7f0a2c108780 2024-06-13T02:04:17.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.457+0000 7f0a2a000700 1 --2- 172.21.15.2:0/3542658203 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f0a140390a0 0x7f0a1403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:17.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.457+0000 7f0a2a000700 1 -- 172.21.15.2:0/3542658203 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0a2004d340 con 0x7f0a2c108780 2024-06-13T02:04:17.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.457+0000 7f0a30e00700 1 -- 172.21.15.2:0/3542658203 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f0a140390a0 msgr2=0x7f0a1403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3121279966 2024-06-13T02:04:17.438 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.457+0000 7f0a30e00700 1 --2- 172.21.15.2:0/3542658203 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f0a140390a0 0x7f0a1403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T02:04:17.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.463+0000 7f0a2a000700 1 -- 172.21.15.2:0/3542658203 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0a2000b3e0 con 0x7f0a2c108780 2024-06-13T02:04:17.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.658+0000 7f0a30e00700 1 -- 172.21.15.2:0/3542658203 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f0a140390a0 msgr2=0x7f0a1403b560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3121279966 2024-06-13T02:04:17.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.658+0000 7f0a30e00700 1 --2- 172.21.15.2:0/3542658203 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f0a140390a0 0x7f0a1403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T02:04:17.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.775+0000 7f0a32c00700 1 -- 172.21.15.2:0/3542658203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f0a2c1a1590 con 0x7f0a2c108780 2024-06-13T02:04:17.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.775+0000 7f0a2a000700 1 -- 172.21.15.2:0/3542658203 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f0a2002ddb0 con 0x7f0a2c108780 2024-06-13T02:04:17.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.780+0000 7f0a32c00700 1 -- 172.21.15.2:0/3542658203 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f0a140390a0 msgr2=0x7f0a1403b560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T02:04:17.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.780+0000 7f0a32c00700 1 --2- 172.21.15.2:0/3542658203 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f0a140390a0 0x7f0a1403b560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:17.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.780+0000 7f0a32c00700 1 -- 172.21.15.2:0/3542658203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a2c108780 msgr2=0x7f0a2c19def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:17.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.780+0000 7f0a32c00700 1 --2- 172.21.15.2:0/3542658203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a2c108780 0x7f0a2c19def0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0a20011b60 tx=0x7f0a20011c40 comp rx=0 tx=0).stop 2024-06-13T02:04:17.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.781+0000 7f0a32c00700 1 -- 172.21.15.2:0/3542658203 shutdown_connections 2024-06-13T02:04:17.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.781+0000 7f0a32c00700 1 --2- 172.21.15.2:0/3542658203 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f0a140390a0 0x7f0a1403b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:17.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.781+0000 7f0a32c00700 1 --2- 172.21.15.2:0/3542658203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a2c108780 0x7f0a2c19def0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:17.439 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.781+0000 7f0a32c00700 1 -- 172.21.15.2:0/3542658203 >> 172.21.15.2:0/3542658203 conn(0x7f0a2c102130 msgr2=0x7f0a2c102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:17.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.781+0000 7f0a32c00700 1 -- 172.21.15.2:0/3542658203 shutdown_connections 2024-06-13T02:04:17.440 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:16.781+0000 7f0a32c00700 1 -- 172.21.15.2:0/3542658203 wait complete. 2024-06-13T02:04:17.440 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for the mgr to restart... 2024-06-13T02:04:17.440 INFO:teuthology.orchestra.run.smithi002.stdout:Waiting for mgr epoch 9... 2024-06-13T02:04:18.009 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:17 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:17.849+0000 7f34b8c63200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T02:04:18.309 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:18 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:18.087+0000 7f34b8c63200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T02:04:18.630 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:18 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:18.309+0000 7f34b8c63200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T02:04:19.092 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:18 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:18.704+0000 7f34b8c63200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T02:04:19.092 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:18 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:18.831+0000 7f34b8c63200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T02:04:19.356 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:19 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:19.090+0000 7f34b8c63200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T02:04:19.630 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:19 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:19.354+0000 7f34b8c63200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:04:20.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:20 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:20.189+0000 7f34b8c63200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T02:04:21.130 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:20 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:20.780+0000 7f34b8c63200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T02:04:21.133 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:20 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:20.917+0000 7f34b8c63200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T02:04:21.630 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:21 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:21.197+0000 7f34b8c63200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T02:04:22.000 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:21 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:21.871+0000 7f34b8c63200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T02:04:22.000 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:22 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:21.998+0000 7f34b8c63200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T02:04:22.630 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:22 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:22.334+0000 7f34b8c63200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T02:04:22.630 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:22 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:22.521+0000 7f34b8c63200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T02:04:23.130 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:22 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:22.652+0000 7f34b8c63200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T02:04:23.130 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:22 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:22.811+0000 7f34b8c63200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T02:04:23.630 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:23 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:23.188+0000 7f34b8c63200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T02:04:24.278 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:23 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:23.975+0000 7f34b8c63200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T02:04:24.278 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:04:24 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:04:24.276+0000 7f34b8c63200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T02:04:24.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:24 smithi002 ceph-mon[31960]: Active manager daemon x restarted 2024-06-13T02:04:24.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:24 smithi002 ceph-mon[31960]: Activating manager daemon x 2024-06-13T02:04:24.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:24 smithi002 ceph-mon[31960]: osdmap e3: 0 total, 0 up, 0 in 2024-06-13T02:04:24.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:24 smithi002 ceph-mon[31960]: mgrmap e10: x(active, starting, since 0.00921698s) 2024-06-13T02:04:24.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:04:24.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-13T02:04:24.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-13T02:04:24.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-13T02:04:24.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-13T02:04:24.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:24 smithi002 ceph-mon[31960]: Manager daemon x is now available 2024-06-13T02:04:25.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:04:25.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T02:04:25.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T02:04:25.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:25 smithi002 ceph-mon[31960]: mgrmap e11: x(active, since 1.01698s) 2024-06-13T02:04:26.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout { 2024-06-13T02:04:26.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-06-13T02:04:26.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-13T02:04:26.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout } 2024-06-13T02:04:26.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.171+0000 7f8a99200700 1 Processor -- start 2024-06-13T02:04:26.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.171+0000 7f8a99200700 1 -- start start 2024-06-13T02:04:26.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.172+0000 7f8a99200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a94107e60 0x7f8a94108280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:26.023 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.172+0000 7f8a99200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941087c0 con 0x7f8a94107e60 2024-06-13T02:04:26.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.172+0000 7f8a91e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a94107e60 0x7f8a94108280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:26.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.172+0000 7f8a91e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a94107e60 0x7f8a94108280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33148/0 (socket says 172.21.15.2:33148) 2024-06-13T02:04:26.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.172+0000 7f8a91e00700 1 -- 172.21.15.2:0/423025704 learned_addr learned my addr 172.21.15.2:0/423025704 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:26.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.172+0000 7f8a91e00700 1 -- 172.21.15.2:0/423025704 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a94108f70 con 0x7f8a94107e60 2024-06-13T02:04:26.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.173+0000 7f8a91e00700 1 --2- 172.21.15.2:0/423025704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a94107e60 0x7f8a94108280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a840098a0 tx=0x7f8a84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd500f3ad0f2fb25 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:26.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.173+0000 7f8a90a00700 1 -- 172.21.15.2:0/423025704 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a84004160 con 0x7f8a94107e60 2024-06-13T02:04:26.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.173+0000 7f8a90a00700 1 -- 172.21.15.2:0/423025704 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a84004300 con 0x7f8a94107e60 2024-06-13T02:04:26.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.173+0000 7f8a90a00700 1 -- 172.21.15.2:0/423025704 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a84011b20 con 0x7f8a94107e60 2024-06-13T02:04:26.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.174+0000 7f8a99200700 1 -- 172.21.15.2:0/423025704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a94107e60 msgr2=0x7f8a94108280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:26.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.174+0000 7f8a99200700 1 --2- 172.21.15.2:0/423025704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a94107e60 0x7f8a94108280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a840098a0 tx=0x7f8a84009bb0 comp rx=0 tx=0).stop 2024-06-13T02:04:26.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.174+0000 7f8a99200700 1 -- 172.21.15.2:0/423025704 shutdown_connections 2024-06-13T02:04:26.024 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.174+0000 7f8a99200700 1 --2- 172.21.15.2:0/423025704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a94107e60 0x7f8a94108280 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:26.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.174+0000 7f8a99200700 1 -- 172.21.15.2:0/423025704 >> 172.21.15.2:0/423025704 conn(0x7f8a941033c0 msgr2=0x7f8a94105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:26.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.174+0000 7f8a99200700 1 -- 172.21.15.2:0/423025704 shutdown_connections 2024-06-13T02:04:26.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.174+0000 7f8a99200700 1 -- 172.21.15.2:0/423025704 wait complete. 2024-06-13T02:04:26.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.176+0000 7f8a99200700 1 Processor -- start 2024-06-13T02:04:26.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.176+0000 7f8a99200700 1 -- start start 2024-06-13T02:04:26.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.176+0000 7f8a99200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a94107e60 0x7f8a9407db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:26.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.176+0000 7f8a99200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a9410c3b0 con 0x7f8a94107e60 2024-06-13T02:04:26.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.177+0000 7f8a91e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a94107e60 0x7f8a9407db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:26.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.177+0000 7f8a91e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a94107e60 0x7f8a9407db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33156/0 (socket says 172.21.15.2:33156) 2024-06-13T02:04:26.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.177+0000 7f8a91e00700 1 -- 172.21.15.2:0/3317500533 learned_addr learned my addr 172.21.15.2:0/3317500533 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:26.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.177+0000 7f8a91e00700 1 -- 172.21.15.2:0/3317500533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9407e080 con 0x7f8a94107e60 2024-06-13T02:04:26.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.177+0000 7f8a91e00700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a94107e60 0x7f8a9407db40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a84011b60 tx=0x7f8a84011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:26.025 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.178+0000 7f8a8aa00700 1 -- 172.21.15.2:0/3317500533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a84003b60 con 0x7f8a94107e60 2024-06-13T02:04:26.026 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.178+0000 7f8a8aa00700 1 -- 172.21.15.2:0/3317500533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a8401a910 con 0x7f8a94107e60 2024-06-13T02:04:26.026 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.178+0000 7f8a8aa00700 1 -- 172.21.15.2:0/3317500533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a84024930 con 0x7f8a94107e60 2024-06-13T02:04:26.026 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.178+0000 7f8a99200700 1 -- 172.21.15.2:0/3317500533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9407c270 con 0x7f8a94107e60 2024-06-13T02:04:26.026 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.178+0000 7f8a99200700 1 -- 172.21.15.2:0/3317500533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9407c730 con 0x7f8a94107e60 2024-06-13T02:04:26.026 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.179+0000 7f8a8aa00700 1 -- 172.21.15.2:0/3317500533 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f8a84022020 con 0x7f8a94107e60 2024-06-13T02:04:26.026 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.180+0000 7f8a8aa00700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f8a78039100 0x7f8a7803b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:26.026 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.180+0000 7f8a8aa00700 1 -- 172.21.15.2:0/3317500533 --> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8a7803bcd0 con 0x7f8a78039100 2024-06-13T02:04:26.026 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.180+0000 7f8a8aa00700 1 -- 172.21.15.2:0/3317500533 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8a8404d330 con 0x7f8a94107e60 2024-06-13T02:04:26.026 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.180+0000 7f8a91400700 1 -- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f8a78039100 msgr2=0x7f8a7803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3121279966 2024-06-13T02:04:26.026 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.180+0000 7f8a91400700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f8a78039100 0x7f8a7803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T02:04:26.026 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.381+0000 7f8a91400700 1 -- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f8a78039100 msgr2=0x7f8a7803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3121279966 2024-06-13T02:04:26.026 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.381+0000 7f8a91400700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f8a78039100 0x7f8a7803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T02:04:26.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.781+0000 7f8a91400700 1 -- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f8a78039100 msgr2=0x7f8a7803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3121279966 2024-06-13T02:04:26.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:18.781+0000 7f8a91400700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f8a78039100 0x7f8a7803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-13T02:04:26.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:19.582+0000 7f8a91400700 1 -- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f8a78039100 msgr2=0x7f8a7803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3121279966 2024-06-13T02:04:26.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:19.582+0000 7f8a91400700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f8a78039100 0x7f8a7803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-13T02:04:26.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:21.184+0000 7f8a91400700 1 -- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f8a78039100 msgr2=0x7f8a7803b5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/3121279966 2024-06-13T02:04:26.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:21.184+0000 7f8a91400700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f8a78039100 0x7f8a7803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-13T02:04:26.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:24.286+0000 7f8a8aa00700 1 -- 172.21.15.2:0/3317500533 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f8a84024ad0 con 0x7f8a94107e60 2024-06-13T02:04:26.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:24.286+0000 7f8a8aa00700 1 -- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f8a78039100 msgr2=0x7f8a7803b5c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T02:04:26.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:24.286+0000 7f8a8aa00700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f8a78039100 0x7f8a7803b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:26.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.289+0000 7f8a8aa00700 1 -- 172.21.15.2:0/3317500533 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f8a8404f260 con 0x7f8a94107e60 2024-06-13T02:04:26.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.289+0000 7f8a8aa00700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f8a7803cbc0 0x7f8a7803efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:26.027 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.289+0000 7f8a8aa00700 1 -- 172.21.15.2:0/3317500533 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8a7803bcd0 con 0x7f8a7803cbc0 2024-06-13T02:04:26.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.293+0000 7f8a91400700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f8a7803cbc0 0x7f8a7803efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:26.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.297+0000 7f8a91400700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f8a7803cbc0 0x7f8a7803efb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8a80003a10 tx=0x7f8a80009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:26.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.299+0000 7f8a8aa00700 1 -- 172.21.15.2:0/3317500533 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f8a7803bcd0 con 0x7f8a7803cbc0 2024-06-13T02:04:26.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.310+0000 7f8a99200700 1 -- 172.21.15.2:0/3317500533 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f8a940695a0 con 0x7f8a7803cbc0 2024-06-13T02:04:26.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.311+0000 7f8a8aa00700 1 -- 172.21.15.2:0/3317500533 <== mgr.14152 v2:172.21.15.2:6800/2988831869 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f8a940695a0 con 0x7f8a7803cbc0 2024-06-13T02:04:26.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.311+0000 7f8a99200700 1 -- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f8a7803cbc0 msgr2=0x7f8a7803efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:26.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.311+0000 7f8a99200700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f8a7803cbc0 0x7f8a7803efb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8a80003a10 tx=0x7f8a80009270 comp rx=0 tx=0).stop 2024-06-13T02:04:26.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.311+0000 7f8a99200700 1 -- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a94107e60 msgr2=0x7f8a9407db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:26.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.311+0000 7f8a99200700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a94107e60 0x7f8a9407db40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a84011b60 tx=0x7f8a84011c40 comp rx=0 tx=0).stop 2024-06-13T02:04:26.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.312+0000 7f8a99200700 1 -- 172.21.15.2:0/3317500533 shutdown_connections 2024-06-13T02:04:26.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.312+0000 7f8a99200700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f8a7803cbc0 0x7f8a7803efb0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:26.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.312+0000 7f8a99200700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a94107e60 0x7f8a9407db40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:26.028 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.312+0000 7f8a99200700 1 --2- 172.21.15.2:0/3317500533 >> [v2:172.21.15.2:6800/3121279966,v1:172.21.15.2:6801/3121279966] conn(0x7f8a78039100 0x7f8a7803b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:26.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.312+0000 7f8a99200700 1 -- 172.21.15.2:0/3317500533 >> 172.21.15.2:0/3317500533 conn(0x7f8a941033c0 msgr2=0x7f8a94103ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:26.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.312+0000 7f8a99200700 1 -- 172.21.15.2:0/3317500533 shutdown_connections 2024-06-13T02:04:26.029 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:25.312+0000 7f8a99200700 1 -- 172.21.15.2:0/3317500533 wait complete. 2024-06-13T02:04:26.029 INFO:teuthology.orchestra.run.smithi002.stdout:mgr epoch 9 is available 2024-06-13T02:04:26.029 INFO:teuthology.orchestra.run.smithi002.stdout:Generating a dashboard self-signed certificate... 2024-06-13T02:04:26.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:26 smithi002 ceph-mon[31960]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-13T02:04:26.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:26 smithi002 ceph-mon[31960]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-13T02:04:27.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:27 smithi002 ceph-mon[31960]: [13/Jun/2024:02:04:26] ENGINE Bus STARTING 2024-06-13T02:04:27.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:27 smithi002 ceph-mon[31960]: [13/Jun/2024:02:04:26] ENGINE Serving on http://172.21.15.2:8765 2024-06-13T02:04:27.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:27 smithi002 ceph-mon[31960]: mgrmap e12: x(active, since 2s) 2024-06-13T02:04:27.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:27 smithi002 ceph-mon[31960]: [13/Jun/2024:02:04:26] ENGINE Serving on https://172.21.15.2:7150 2024-06-13T02:04:27.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:27 smithi002 ceph-mon[31960]: [13/Jun/2024:02:04:26] ENGINE Bus STARTED 2024-06-13T02:04:27.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:28.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-06-13T02:04:28.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.260+0000 7f67ab800700 1 Processor -- start 2024-06-13T02:04:28.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.260+0000 7f67ab800700 1 -- start start 2024-06-13T02:04:28.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.261+0000 7f67ab800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a4107ec0 0x7f67a41082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:28.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.261+0000 7f67ab800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67a4108820 con 0x7f67a4107ec0 2024-06-13T02:04:28.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.261+0000 7f67a8e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a4107ec0 0x7f67a41082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:28.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.261+0000 7f67a8e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a4107ec0 0x7f67a41082e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51756/0 (socket says 172.21.15.2:51756) 2024-06-13T02:04:28.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.261+0000 7f67a8e00700 1 -- 172.21.15.2:0/789380098 learned_addr learned my addr 172.21.15.2:0/789380098 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:28.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.262+0000 7f67a8e00700 1 -- 172.21.15.2:0/789380098 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a4108fd0 con 0x7f67a4107ec0 2024-06-13T02:04:28.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.262+0000 7f67a8e00700 1 --2- 172.21.15.2:0/789380098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a4107ec0 0x7f67a41082e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67980098a0 tx=0x7f6798009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628d7aebe2cdb7e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:28.424 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.263+0000 7f67a3400700 1 -- 172.21.15.2:0/789380098 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6798004160 con 0x7f67a4107ec0 2024-06-13T02:04:28.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.263+0000 7f67a3400700 1 -- 172.21.15.2:0/789380098 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6798004300 con 0x7f67a4107ec0 2024-06-13T02:04:28.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.263+0000 7f67a3400700 1 -- 172.21.15.2:0/789380098 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6798011b20 con 0x7f67a4107ec0 2024-06-13T02:04:28.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.264+0000 7f67ab800700 1 -- 172.21.15.2:0/789380098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a4107ec0 msgr2=0x7f67a41082e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:28.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.264+0000 7f67ab800700 1 --2- 172.21.15.2:0/789380098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a4107ec0 0x7f67a41082e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67980098a0 tx=0x7f6798009bb0 comp rx=0 tx=0).stop 2024-06-13T02:04:28.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.264+0000 7f67ab800700 1 -- 172.21.15.2:0/789380098 shutdown_connections 2024-06-13T02:04:28.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.264+0000 7f67ab800700 1 --2- 172.21.15.2:0/789380098 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a4107ec0 0x7f67a41082e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:28.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.264+0000 7f67ab800700 1 -- 172.21.15.2:0/789380098 >> 172.21.15.2:0/789380098 conn(0x7f67a41034c0 msgr2=0x7f67a41058e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:28.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.264+0000 7f67ab800700 1 -- 172.21.15.2:0/789380098 shutdown_connections 2024-06-13T02:04:28.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.264+0000 7f67ab800700 1 -- 172.21.15.2:0/789380098 wait complete. 2024-06-13T02:04:28.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.265+0000 7f67ab800700 1 Processor -- start 2024-06-13T02:04:28.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.266+0000 7f67ab800700 1 -- start start 2024-06-13T02:04:28.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.266+0000 7f67ab800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a4107ec0 0x7f67a407e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:28.425 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.266+0000 7f67ab800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67a410c410 con 0x7f67a4107ec0 2024-06-13T02:04:28.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.266+0000 7f67a8e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a4107ec0 0x7f67a407e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:28.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.266+0000 7f67a8e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a4107ec0 0x7f67a407e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51762/0 (socket says 172.21.15.2:51762) 2024-06-13T02:04:28.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.266+0000 7f67a8e00700 1 -- 172.21.15.2:0/2477408690 learned_addr learned my addr 172.21.15.2:0/2477408690 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:28.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.267+0000 7f67a8e00700 1 -- 172.21.15.2:0/2477408690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a407e8c0 con 0x7f67a4107ec0 2024-06-13T02:04:28.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.267+0000 7f67a8e00700 1 --2- 172.21.15.2:0/2477408690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a4107ec0 0x7f67a407e380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6798011b60 tx=0x7f6798011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:28.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.268+0000 7f67a1600700 1 -- 172.21.15.2:0/2477408690 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6798003b60 con 0x7f67a4107ec0 2024-06-13T02:04:28.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.268+0000 7f67a1600700 1 -- 172.21.15.2:0/2477408690 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f679801a910 con 0x7f67a4107ec0 2024-06-13T02:04:28.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.268+0000 7f67ab800700 1 -- 172.21.15.2:0/2477408690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a407cb00 con 0x7f67a4107ec0 2024-06-13T02:04:28.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.268+0000 7f67a1600700 1 -- 172.21.15.2:0/2477408690 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6798024930 con 0x7f67a4107ec0 2024-06-13T02:04:28.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.268+0000 7f67ab800700 1 -- 172.21.15.2:0/2477408690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a407cf60 con 0x7f67a4107ec0 2024-06-13T02:04:28.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.269+0000 7f67ab800700 1 -- 172.21.15.2:0/2477408690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a4063af0 con 0x7f67a4107ec0 2024-06-13T02:04:28.426 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.270+0000 7f67a1600700 1 -- 172.21.15.2:0/2477408690 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f6798022020 con 0x7f67a4107ec0 2024-06-13T02:04:28.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.270+0000 7f67a1600700 1 --2- 172.21.15.2:0/2477408690 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f678c039100 0x7f678c03b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:28.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.270+0000 7f67a1600700 1 -- 172.21.15.2:0/2477408690 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f679804d3b0 con 0x7f67a4107ec0 2024-06-13T02:04:28.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.271+0000 7f67a3e00700 1 --2- 172.21.15.2:0/2477408690 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f678c039100 0x7f678c03b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:28.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.272+0000 7f67a3e00700 1 --2- 172.21.15.2:0/2477408690 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f678c039100 0x7f678c03b5c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6790006fd0 tx=0x7f6790006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:28.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.279+0000 7f67a1600700 1 -- 172.21.15.2:0/2477408690 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f679800b3e0 con 0x7f67a4107ec0 2024-06-13T02:04:28.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.518+0000 7f67ab800700 1 -- 172.21.15.2:0/2477408690 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f67a407d730 con 0x7f678c039100 2024-06-13T02:04:28.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.734+0000 7f67a1600700 1 -- 172.21.15.2:0/2477408690 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f67a407d730 con 0x7f678c039100 2024-06-13T02:04:28.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.737+0000 7f67ab800700 1 -- 172.21.15.2:0/2477408690 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f678c039100 msgr2=0x7f678c03b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:28.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.738+0000 7f67ab800700 1 --2- 172.21.15.2:0/2477408690 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f678c039100 0x7f678c03b5c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6790006fd0 tx=0x7f6790006e40 comp rx=0 tx=0).stop 2024-06-13T02:04:28.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.738+0000 7f67ab800700 1 -- 172.21.15.2:0/2477408690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a4107ec0 msgr2=0x7f67a407e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:28.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.738+0000 7f67ab800700 1 --2- 172.21.15.2:0/2477408690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a4107ec0 0x7f67a407e380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6798011b60 tx=0x7f6798011c40 comp rx=0 tx=0).stop 2024-06-13T02:04:28.427 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.738+0000 7f67ab800700 1 -- 172.21.15.2:0/2477408690 shutdown_connections 2024-06-13T02:04:28.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.738+0000 7f67ab800700 1 --2- 172.21.15.2:0/2477408690 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f678c039100 0x7f678c03b5c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:28.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.738+0000 7f67ab800700 1 --2- 172.21.15.2:0/2477408690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67a4107ec0 0x7f67a407e380 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:28.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.738+0000 7f67ab800700 1 -- 172.21.15.2:0/2477408690 >> 172.21.15.2:0/2477408690 conn(0x7f67a41034c0 msgr2=0x7f67a4103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:28.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.738+0000 7f67ab800700 1 -- 172.21.15.2:0/2477408690 shutdown_connections 2024-06-13T02:04:28.428 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:27.738+0000 7f67ab800700 1 -- 172.21.15.2:0/2477408690 wait complete. 2024-06-13T02:04:28.428 INFO:teuthology.orchestra.run.smithi002.stdout:Creating initial admin user... 2024-06-13T02:04:29.036 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:28 smithi002 ceph-mon[31960]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:04:29.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:28 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:29.037 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:28 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:30.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$D2RmjXwVU0FEHCuZlORR0uBiiIwsqSIKQKOHFhxF5L3rEPCa95Hgu", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1718244269, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-06-13T02:04:30.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.035+0000 7f1b86e00700 1 Processor -- start 2024-06-13T02:04:30.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.035+0000 7f1b86e00700 1 -- start start 2024-06-13T02:04:30.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.035+0000 7f1b86e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b80107f30 0x7f1b80108350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:30.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.035+0000 7f1b86e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b80108890 con 0x7f1b80107f30 2024-06-13T02:04:30.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.036+0000 7f1b7fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b80107f30 0x7f1b80108350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:30.474 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.036+0000 7f1b7fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b80107f30 0x7f1b80108350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51768/0 (socket says 172.21.15.2:51768) 2024-06-13T02:04:30.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.036+0000 7f1b7fe00700 1 -- 172.21.15.2:0/3412146159 learned_addr learned my addr 172.21.15.2:0/3412146159 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:30.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.037+0000 7f1b7fe00700 1 -- 172.21.15.2:0/3412146159 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b80108ff0 con 0x7f1b80107f30 2024-06-13T02:04:30.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.037+0000 7f1b7fe00700 1 --2- 172.21.15.2:0/3412146159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b80107f30 0x7f1b80108350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009e80 tx=0x7f1b7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519164057a37145b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:30.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.038+0000 7f1b7f400700 1 -- 172.21.15.2:0/3412146159 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b70017070 con 0x7f1b80107f30 2024-06-13T02:04:30.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.038+0000 7f1b7f400700 1 -- 172.21.15.2:0/3412146159 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b7000b8c0 con 0x7f1b80107f30 2024-06-13T02:04:30.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.038+0000 7f1b7f400700 1 -- 172.21.15.2:0/3412146159 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b700045c0 con 0x7f1b80107f30 2024-06-13T02:04:30.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.038+0000 7f1b86e00700 1 -- 172.21.15.2:0/3412146159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b80107f30 msgr2=0x7f1b80108350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:30.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.038+0000 7f1b86e00700 1 --2- 172.21.15.2:0/3412146159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b80107f30 0x7f1b80108350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009e80 tx=0x7f1b7000b330 comp rx=0 tx=0).stop 2024-06-13T02:04:30.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.039+0000 7f1b86e00700 1 -- 172.21.15.2:0/3412146159 shutdown_connections 2024-06-13T02:04:30.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.039+0000 7f1b86e00700 1 --2- 172.21.15.2:0/3412146159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b80107f30 0x7f1b80108350 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:30.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.039+0000 7f1b86e00700 1 -- 172.21.15.2:0/3412146159 >> 172.21.15.2:0/3412146159 conn(0x7f1b80103510 msgr2=0x7f1b80105930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:30.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.039+0000 7f1b86e00700 1 -- 172.21.15.2:0/3412146159 shutdown_connections 2024-06-13T02:04:30.475 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.039+0000 7f1b86e00700 1 -- 172.21.15.2:0/3412146159 wait complete. 2024-06-13T02:04:30.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.040+0000 7f1b86e00700 1 Processor -- start 2024-06-13T02:04:30.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.040+0000 7f1b86e00700 1 -- start start 2024-06-13T02:04:30.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.040+0000 7f1b86e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b80107f30 0x7f1b8019e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:30.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.040+0000 7f1b86e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8007cac0 con 0x7f1b80107f30 2024-06-13T02:04:30.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.041+0000 7f1b7fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b80107f30 0x7f1b8019e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:30.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.041+0000 7f1b7fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b80107f30 0x7f1b8019e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51774/0 (socket says 172.21.15.2:51774) 2024-06-13T02:04:30.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.041+0000 7f1b7fe00700 1 -- 172.21.15.2:0/2830883788 learned_addr learned my addr 172.21.15.2:0/2830883788 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:30.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.041+0000 7f1b7fe00700 1 -- 172.21.15.2:0/2830883788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8019e560 con 0x7f1b80107f30 2024-06-13T02:04:30.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.042+0000 7f1b7fe00700 1 --2- 172.21.15.2:0/2830883788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b80107f30 0x7f1b8019e020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009530 tx=0x7f1b70003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:30.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.042+0000 7f1b7d600700 1 -- 172.21.15.2:0/2830883788 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b70020020 con 0x7f1b80107f30 2024-06-13T02:04:30.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.042+0000 7f1b7d600700 1 -- 172.21.15.2:0/2830883788 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b7000bba0 con 0x7f1b80107f30 2024-06-13T02:04:30.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.042+0000 7f1b7d600700 1 -- 172.21.15.2:0/2830883788 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b70017040 con 0x7f1b80107f30 2024-06-13T02:04:30.476 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.042+0000 7f1b86e00700 1 -- 172.21.15.2:0/2830883788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8019e7f0 con 0x7f1b80107f30 2024-06-13T02:04:30.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.042+0000 7f1b86e00700 1 -- 172.21.15.2:0/2830883788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b801a14e0 con 0x7f1b80107f30 2024-06-13T02:04:30.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.043+0000 7f1b86e00700 1 -- 172.21.15.2:0/2830883788 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b80063af0 con 0x7f1b80107f30 2024-06-13T02:04:30.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.044+0000 7f1b7d600700 1 -- 172.21.15.2:0/2830883788 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f1b70023020 con 0x7f1b80107f30 2024-06-13T02:04:30.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.044+0000 7f1b7d600700 1 --2- 172.21.15.2:0/2830883788 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1b64039100 0x7f1b6403b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:30.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.044+0000 7f1b7d600700 1 -- 172.21.15.2:0/2830883788 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1b7000f050 con 0x7f1b80107f30 2024-06-13T02:04:30.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.045+0000 7f1b77e00700 1 --2- 172.21.15.2:0/2830883788 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1b64039100 0x7f1b6403b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:30.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.045+0000 7f1b77e00700 1 --2- 172.21.15.2:0/2830883788 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1b64039100 0x7f1b6403b5c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1b68006fd0 tx=0x7f1b68006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:30.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.050+0000 7f1b7d600700 1 -- 172.21.15.2:0/2830883788 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1b7002a020 con 0x7f1b80107f30 2024-06-13T02:04:30.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.303+0000 7f1b86e00700 1 -- 172.21.15.2:0/2830883788 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f1b80197b80 con 0x7f1b64039100 2024-06-13T02:04:30.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.583+0000 7f1b7d600700 1 -- 172.21.15.2:0/2830883788 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f1b80197b80 con 0x7f1b64039100 2024-06-13T02:04:30.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.586+0000 7f1b86e00700 1 -- 172.21.15.2:0/2830883788 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1b64039100 msgr2=0x7f1b6403b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:30.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.586+0000 7f1b86e00700 1 --2- 172.21.15.2:0/2830883788 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1b64039100 0x7f1b6403b5c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1b68006fd0 tx=0x7f1b68006e40 comp rx=0 tx=0).stop 2024-06-13T02:04:30.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.586+0000 7f1b86e00700 1 -- 172.21.15.2:0/2830883788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b80107f30 msgr2=0x7f1b8019e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:30.477 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.586+0000 7f1b86e00700 1 --2- 172.21.15.2:0/2830883788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b80107f30 0x7f1b8019e020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009530 tx=0x7f1b70003d00 comp rx=0 tx=0).stop 2024-06-13T02:04:30.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.586+0000 7f1b86e00700 1 -- 172.21.15.2:0/2830883788 shutdown_connections 2024-06-13T02:04:30.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.586+0000 7f1b86e00700 1 --2- 172.21.15.2:0/2830883788 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1b64039100 0x7f1b6403b5c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:30.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.586+0000 7f1b86e00700 1 --2- 172.21.15.2:0/2830883788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1b80107f30 0x7f1b8019e020 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:30.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.586+0000 7f1b86e00700 1 -- 172.21.15.2:0/2830883788 >> 172.21.15.2:0/2830883788 conn(0x7f1b80103510 msgr2=0x7f1b80105900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:30.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.586+0000 7f1b86e00700 1 -- 172.21.15.2:0/2830883788 shutdown_connections 2024-06-13T02:04:30.478 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:29.586+0000 7f1b86e00700 1 -- 172.21.15.2:0/2830883788 wait complete. 2024-06-13T02:04:30.478 INFO:teuthology.orchestra.run.smithi002.stdout:Fetching dashboard port number... 2024-06-13T02:04:30.803 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:30 smithi002 ceph-mon[31960]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:04:30.804 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:30 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:30.804 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:30 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:31.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:31 smithi002 ceph-mon[31960]: mgrmap e13: x(active, since 6s) 2024-06-13T02:04:31.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:31 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1895364655' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-06-13T02:04:32.966 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stdout 8443 2024-06-13T02:04:32.966 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.088+0000 7fe10a600700 1 Processor -- start 2024-06-13T02:04:32.966 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.089+0000 7fe10a600700 1 -- start start 2024-06-13T02:04:32.968 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.089+0000 7fe10a600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe10407de60 0x7fe10407c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.089+0000 7fe10a600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe10407c8e0 con 0x7fe10407de60 2024-06-13T02:04:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.089+0000 7fe103400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe10407de60 0x7fe10407c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.089+0000 7fe103400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe10407de60 0x7fe10407c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51786/0 (socket says 172.21.15.2:51786) 2024-06-13T02:04:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.089+0000 7fe103400700 1 -- 172.21.15.2:0/391823723 learned_addr learned my addr 172.21.15.2:0/391823723 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.090+0000 7fe103400700 1 -- 172.21.15.2:0/391823723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10407ca60 con 0x7fe10407de60 2024-06-13T02:04:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.090+0000 7fe103400700 1 --2- 172.21.15.2:0/391823723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe10407de60 0x7fe10407c310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40098a0 tx=0x7fe0f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df8959c9e6b5940 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.091+0000 7fe102000700 1 -- 172.21.15.2:0/391823723 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f4004160 con 0x7fe10407de60 2024-06-13T02:04:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.091+0000 7fe102000700 1 -- 172.21.15.2:0/391823723 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0f4004300 con 0x7fe10407de60 2024-06-13T02:04:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.091+0000 7fe102000700 1 -- 172.21.15.2:0/391823723 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f4011b20 con 0x7fe10407de60 2024-06-13T02:04:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.092+0000 7fe10a600700 1 -- 172.21.15.2:0/391823723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe10407de60 msgr2=0x7fe10407c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:32.969 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.092+0000 7fe10a600700 1 --2- 172.21.15.2:0/391823723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe10407de60 0x7fe10407c310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40098a0 tx=0x7fe0f4009bb0 comp rx=0 tx=0).stop 2024-06-13T02:04:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.092+0000 7fe10a600700 1 -- 172.21.15.2:0/391823723 shutdown_connections 2024-06-13T02:04:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.092+0000 7fe10a600700 1 --2- 172.21.15.2:0/391823723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe10407de60 0x7fe10407c310 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.092+0000 7fe10a600700 1 -- 172.21.15.2:0/391823723 >> 172.21.15.2:0/391823723 conn(0x7fe104103430 msgr2=0x7fe104105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.092+0000 7fe10a600700 1 -- 172.21.15.2:0/391823723 shutdown_connections 2024-06-13T02:04:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.092+0000 7fe10a600700 1 -- 172.21.15.2:0/391823723 wait complete. 2024-06-13T02:04:32.970 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.093+0000 7fe10a600700 1 Processor -- start 2024-06-13T02:04:32.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.093+0000 7fe10a600700 1 -- start start 2024-06-13T02:04:32.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.094+0000 7fe10a600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe10407de60 0x7fe10419df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:32.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.094+0000 7fe10a600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe10410e4b0 con 0x7fe10407de60 2024-06-13T02:04:32.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.094+0000 7fe103400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe10407de60 0x7fe10419df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:32.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.094+0000 7fe103400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe10407de60 0x7fe10419df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51798/0 (socket says 172.21.15.2:51798) 2024-06-13T02:04:32.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.094+0000 7fe103400700 1 -- 172.21.15.2:0/1895364655 learned_addr learned my addr 172.21.15.2:0/1895364655 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:32.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.095+0000 7fe103400700 1 -- 172.21.15.2:0/1895364655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10419e4d0 con 0x7fe10407de60 2024-06-13T02:04:32.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.095+0000 7fe103400700 1 --2- 172.21.15.2:0/1895364655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe10407de60 0x7fe10419df90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40117e0 tx=0x7fe0f4011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:32.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.095+0000 7fe0fbe00700 1 -- 172.21.15.2:0/1895364655 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f4003ba0 con 0x7fe10407de60 2024-06-13T02:04:32.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.095+0000 7fe0fbe00700 1 -- 172.21.15.2:0/1895364655 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0f401a910 con 0x7fe10407de60 2024-06-13T02:04:32.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.095+0000 7fe0fbe00700 1 -- 172.21.15.2:0/1895364655 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f40248f0 con 0x7fe10407de60 2024-06-13T02:04:32.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.095+0000 7fe10a600700 1 -- 172.21.15.2:0/1895364655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10419e760 con 0x7fe10407de60 2024-06-13T02:04:32.974 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.096+0000 7fe10a600700 1 -- 172.21.15.2:0/1895364655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe10419ebc0 con 0x7fe10407de60 2024-06-13T02:04:32.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.097+0000 7fe0fbe00700 1 -- 172.21.15.2:0/1895364655 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fe0f4022020 con 0x7fe10407de60 2024-06-13T02:04:32.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.097+0000 7fe10a600700 1 -- 172.21.15.2:0/1895364655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe104063af0 con 0x7fe10407de60 2024-06-13T02:04:32.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.097+0000 7fe0fbe00700 1 --2- 172.21.15.2:0/1895364655 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fe0e8039140 0x7fe0e803b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:32.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.097+0000 7fe0fbe00700 1 -- 172.21.15.2:0/1895364655 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe0f404dc30 con 0x7fe10407de60 2024-06-13T02:04:32.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.097+0000 7fe102a00700 1 --2- 172.21.15.2:0/1895364655 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fe0e8039140 0x7fe0e803b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:32.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.098+0000 7fe102a00700 1 --2- 172.21.15.2:0/1895364655 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fe0e8039140 0x7fe0e803b600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0006fd0 tx=0x7fe0f0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:32.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.103+0000 7fe0fbe00700 1 -- 172.21.15.2:0/1895364655 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fe0f400b3e0 con 0x7fe10407de60 2024-06-13T02:04:32.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.346+0000 7fe10a600700 1 -- 172.21.15.2:0/1895364655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fe1041a1590 con 0x7fe10407de60 2024-06-13T02:04:32.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.347+0000 7fe0fbe00700 1 -- 172.21.15.2:0/1895364655 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fe0f402cd60 con 0x7fe10407de60 2024-06-13T02:04:32.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.350+0000 7fe10a600700 1 -- 172.21.15.2:0/1895364655 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fe0e8039140 msgr2=0x7fe0e803b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:32.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.350+0000 7fe10a600700 1 --2- 172.21.15.2:0/1895364655 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fe0e8039140 0x7fe0e803b600 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0006fd0 tx=0x7fe0f0006e40 comp rx=0 tx=0).stop 2024-06-13T02:04:32.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.350+0000 7fe10a600700 1 -- 172.21.15.2:0/1895364655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe10407de60 msgr2=0x7fe10419df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:32.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.350+0000 7fe10a600700 1 --2- 172.21.15.2:0/1895364655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe10407de60 0x7fe10419df90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40117e0 tx=0x7fe0f4011ba0 comp rx=0 tx=0).stop 2024-06-13T02:04:32.975 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.350+0000 7fe10a600700 1 -- 172.21.15.2:0/1895364655 shutdown_connections 2024-06-13T02:04:32.976 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.350+0000 7fe10a600700 1 --2- 172.21.15.2:0/1895364655 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fe0e8039140 0x7fe0e803b600 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:32.976 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.350+0000 7fe10a600700 1 --2- 172.21.15.2:0/1895364655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe10407de60 0x7fe10419df90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:32.976 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.350+0000 7fe10a600700 1 -- 172.21.15.2:0/1895364655 >> 172.21.15.2:0/1895364655 conn(0x7fe104103430 msgr2=0x7fe104103ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:32.976 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.351+0000 7fe10a600700 1 -- 172.21.15.2:0/1895364655 shutdown_connections 2024-06-13T02:04:32.976 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:31.351+0000 7fe10a600700 1 -- 172.21.15.2:0/1895364655 wait complete. 2024-06-13T02:04:33.001 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-13T02:04:33.002 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout disabled 2024-06-13T02:04:33.032 INFO:teuthology.orchestra.run.smithi002.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-13T02:04:33.033 INFO:teuthology.orchestra.run.smithi002.stdout:systemctl: stdout inactive 2024-06-13T02:04:33.033 INFO:teuthology.orchestra.run.smithi002.stdout:firewalld.service is not enabled 2024-06-13T02:04:33.033 INFO:teuthology.orchestra.run.smithi002.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-06-13T02:04:33.041 INFO:teuthology.orchestra.run.smithi002.stdout:Ceph Dashboard is now available at: 2024-06-13T02:04:33.041 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:04:33.041 INFO:teuthology.orchestra.run.smithi002.stdout: URL: https://smithi002.front.sepia.ceph.com:8443/ 2024-06-13T02:04:33.042 INFO:teuthology.orchestra.run.smithi002.stdout: User: admin 2024-06-13T02:04:33.042 INFO:teuthology.orchestra.run.smithi002.stdout: Password: za7srmwx8h 2024-06-13T02:04:33.042 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:04:33.043 INFO:teuthology.orchestra.run.smithi002.stdout:Saving cluster configuration to /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config directory 2024-06-13T02:04:33.045 INFO:teuthology.orchestra.run.smithi002.stdout:Enabling autotune for osd_memory_target 2024-06-13T02:04:34.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.685+0000 7fb9a3000700 1 Processor -- start 2024-06-13T02:04:34.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.685+0000 7fb9a3000700 1 -- start start 2024-06-13T02:04:34.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.686+0000 7fb9a3000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c108900 0x7fb99c10acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:34.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.686+0000 7fb9a3000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c07be30 con 0x7fb99c108900 2024-06-13T02:04:34.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.686+0000 7fb99be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c108900 0x7fb99c10acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:34.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.686+0000 7fb99be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c108900 0x7fb99c10acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53938/0 (socket says 172.21.15.2:53938) 2024-06-13T02:04:34.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.686+0000 7fb99be00700 1 -- 172.21.15.2:0/970581227 learned_addr learned my addr 172.21.15.2:0/970581227 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:34.705 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.687+0000 7fb99be00700 1 -- 172.21.15.2:0/970581227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c10b230 con 0x7fb99c108900 2024-06-13T02:04:34.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.687+0000 7fb99be00700 1 --2- 172.21.15.2:0/970581227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c108900 0x7fb99c10acf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0098a0 tx=0x7fb98c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc177be66367a0f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:34.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.687+0000 7fb99aa00700 1 -- 172.21.15.2:0/970581227 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c004160 con 0x7fb99c108900 2024-06-13T02:04:34.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.688+0000 7fb99aa00700 1 -- 172.21.15.2:0/970581227 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb98c004300 con 0x7fb99c108900 2024-06-13T02:04:34.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.688+0000 7fb99aa00700 1 -- 172.21.15.2:0/970581227 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c011b20 con 0x7fb99c108900 2024-06-13T02:04:34.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.688+0000 7fb9a3000700 1 -- 172.21.15.2:0/970581227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c108900 msgr2=0x7fb99c10acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:34.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.688+0000 7fb9a3000700 1 --2- 172.21.15.2:0/970581227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c108900 0x7fb99c10acf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0098a0 tx=0x7fb98c009bb0 comp rx=0 tx=0).stop 2024-06-13T02:04:34.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.689+0000 7fb9a3000700 1 -- 172.21.15.2:0/970581227 shutdown_connections 2024-06-13T02:04:34.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.689+0000 7fb9a3000700 1 --2- 172.21.15.2:0/970581227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c108900 0x7fb99c10acf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:34.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.689+0000 7fb9a3000700 1 -- 172.21.15.2:0/970581227 >> 172.21.15.2:0/970581227 conn(0x7fb99c102390 msgr2=0x7fb99c1047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:34.706 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.689+0000 7fb9a3000700 1 -- 172.21.15.2:0/970581227 shutdown_connections 2024-06-13T02:04:34.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.689+0000 7fb9a3000700 1 -- 172.21.15.2:0/970581227 wait complete. 2024-06-13T02:04:34.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.690+0000 7fb9a3000700 1 Processor -- start 2024-06-13T02:04:34.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.690+0000 7fb9a3000700 1 -- start start 2024-06-13T02:04:34.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.690+0000 7fb9a3000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c108900 0x7fb99c19dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:34.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.690+0000 7fb9a3000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c10c290 con 0x7fb99c108900 2024-06-13T02:04:34.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.690+0000 7fb99be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c108900 0x7fb99c19dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:34.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.690+0000 7fb99be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c108900 0x7fb99c19dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53946/0 (socket says 172.21.15.2:53946) 2024-06-13T02:04:34.707 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.690+0000 7fb99be00700 1 -- 172.21.15.2:0/403152404 learned_addr learned my addr 172.21.15.2:0/403152404 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:34.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.691+0000 7fb99be00700 1 -- 172.21.15.2:0/403152404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c19e510 con 0x7fb99c108900 2024-06-13T02:04:34.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.691+0000 7fb99be00700 1 --2- 172.21.15.2:0/403152404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c108900 0x7fb99c19dfd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0117e0 tx=0x7fb98c011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:34.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.691+0000 7fb998c00700 1 -- 172.21.15.2:0/403152404 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c003ba0 con 0x7fb99c108900 2024-06-13T02:04:34.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.691+0000 7fb998c00700 1 -- 172.21.15.2:0/403152404 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb98c01a910 con 0x7fb99c108900 2024-06-13T02:04:34.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.691+0000 7fb998c00700 1 -- 172.21.15.2:0/403152404 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c0248f0 con 0x7fb99c108900 2024-06-13T02:04:34.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.692+0000 7fb9a3000700 1 -- 172.21.15.2:0/403152404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99c19e7a0 con 0x7fb99c108900 2024-06-13T02:04:34.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.692+0000 7fb9a3000700 1 -- 172.21.15.2:0/403152404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99c19ec00 con 0x7fb99c108900 2024-06-13T02:04:34.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.693+0000 7fb9a3000700 1 -- 172.21.15.2:0/403152404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb99c063af0 con 0x7fb99c108900 2024-06-13T02:04:34.708 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.693+0000 7fb998c00700 1 -- 172.21.15.2:0/403152404 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fb98c022020 con 0x7fb99c108900 2024-06-13T02:04:34.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.693+0000 7fb998c00700 1 --2- 172.21.15.2:0/403152404 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb9800391a0 0x7fb98003b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:34.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.693+0000 7fb998c00700 1 -- 172.21.15.2:0/403152404 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb98c04d680 con 0x7fb99c108900 2024-06-13T02:04:34.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.694+0000 7fb99b400700 1 --2- 172.21.15.2:0/403152404 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb9800391a0 0x7fb98003b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:34.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.694+0000 7fb99b400700 1 --2- 172.21.15.2:0/403152404 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb9800391a0 0x7fb98003b660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb988006fd0 tx=0x7fb988006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:34.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.699+0000 7fb998c00700 1 -- 172.21.15.2:0/403152404 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb98c01ab70 con 0x7fb99c108900 2024-06-13T02:04:34.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.925+0000 7fb9a3000700 1 -- 172.21.15.2:0/403152404 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7fb99c1a1690 con 0x7fb99c108900 2024-06-13T02:04:34.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.926+0000 7fb998c00700 1 -- 172.21.15.2:0/403152404 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7fb98c010380 con 0x7fb99c108900 2024-06-13T02:04:34.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.929+0000 7fb9a3000700 1 -- 172.21.15.2:0/403152404 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb9800391a0 msgr2=0x7fb98003b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:34.709 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.929+0000 7fb9a3000700 1 --2- 172.21.15.2:0/403152404 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb9800391a0 0x7fb98003b660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb988006fd0 tx=0x7fb988006e40 comp rx=0 tx=0).stop 2024-06-13T02:04:34.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.929+0000 7fb9a3000700 1 -- 172.21.15.2:0/403152404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c108900 msgr2=0x7fb99c19dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:34.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.929+0000 7fb9a3000700 1 --2- 172.21.15.2:0/403152404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c108900 0x7fb99c19dfd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0117e0 tx=0x7fb98c011ba0 comp rx=0 tx=0).stop 2024-06-13T02:04:34.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.929+0000 7fb9a3000700 1 -- 172.21.15.2:0/403152404 shutdown_connections 2024-06-13T02:04:34.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.929+0000 7fb9a3000700 1 --2- 172.21.15.2:0/403152404 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb9800391a0 0x7fb98003b660 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:34.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.929+0000 7fb9a3000700 1 --2- 172.21.15.2:0/403152404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c108900 0x7fb99c19dfd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:34.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.929+0000 7fb9a3000700 1 -- 172.21.15.2:0/403152404 >> 172.21.15.2:0/403152404 conn(0x7fb99c102390 msgr2=0x7fb99c102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:34.710 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.929+0000 7fb9a3000700 1 -- 172.21.15.2:0/403152404 shutdown_connections 2024-06-13T02:04:34.711 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:33.929+0000 7fb9a3000700 1 -- 172.21.15.2:0/403152404 wait complete. 2024-06-13T02:04:36.397 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.395+0000 7f142b000700 1 Processor -- start 2024-06-13T02:04:36.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.395+0000 7f142b000700 1 -- start start 2024-06-13T02:04:36.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.396+0000 7f142b000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1424106d90 0x7f14241071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:36.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.396+0000 7f142b000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1424107780 con 0x7f1424106d90 2024-06-13T02:04:36.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.396+0000 7f1423e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1424106d90 0x7f14241071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:36.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.396+0000 7f1423e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1424106d90 0x7f14241071b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53956/0 (socket says 172.21.15.2:53956) 2024-06-13T02:04:36.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.396+0000 7f1423e00700 1 -- 172.21.15.2:0/471619663 learned_addr learned my addr 172.21.15.2:0/471619663 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:36.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.397+0000 7f1423e00700 1 -- 172.21.15.2:0/471619663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1424107f40 con 0x7f1424106d90 2024-06-13T02:04:36.398 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.397+0000 7f1423e00700 1 --2- 172.21.15.2:0/471619663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1424106d90 0x7f14241071b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14140098a0 tx=0x7f1414009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315a93c89dcf0761 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:36.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.397+0000 7f1422a00700 1 -- 172.21.15.2:0/471619663 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1414004160 con 0x7f1424106d90 2024-06-13T02:04:36.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.397+0000 7f1422a00700 1 -- 172.21.15.2:0/471619663 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1414004300 con 0x7f1424106d90 2024-06-13T02:04:36.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.397+0000 7f1422a00700 1 -- 172.21.15.2:0/471619663 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1414011b20 con 0x7f1424106d90 2024-06-13T02:04:36.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.398+0000 7f142b000700 1 -- 172.21.15.2:0/471619663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1424106d90 msgr2=0x7f14241071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:36.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.398+0000 7f142b000700 1 --2- 172.21.15.2:0/471619663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1424106d90 0x7f14241071b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14140098a0 tx=0x7f1414009bb0 comp rx=0 tx=0).stop 2024-06-13T02:04:36.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.398+0000 7f142b000700 1 -- 172.21.15.2:0/471619663 shutdown_connections 2024-06-13T02:04:36.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.398+0000 7f142b000700 1 --2- 172.21.15.2:0/471619663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1424106d90 0x7f14241071b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:36.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.398+0000 7f142b000700 1 -- 172.21.15.2:0/471619663 >> 172.21.15.2:0/471619663 conn(0x7f1424102390 msgr2=0x7f14241047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:36.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.398+0000 7f142b000700 1 -- 172.21.15.2:0/471619663 shutdown_connections 2024-06-13T02:04:36.399 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.398+0000 7f142b000700 1 -- 172.21.15.2:0/471619663 wait complete. 2024-06-13T02:04:36.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.399+0000 7f142b000700 1 Processor -- start 2024-06-13T02:04:36.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.400+0000 7f142b000700 1 -- start start 2024-06-13T02:04:36.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.400+0000 7f142b000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1424106d90 0x7f142419dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:36.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.400+0000 7f142b000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f142410b2f0 con 0x7f1424106d90 2024-06-13T02:04:36.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.400+0000 7f1423e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1424106d90 0x7f142419dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:36.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.400+0000 7f1423e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1424106d90 0x7f142419dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53958/0 (socket says 172.21.15.2:53958) 2024-06-13T02:04:36.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.400+0000 7f1423e00700 1 -- 172.21.15.2:0/1367091064 learned_addr learned my addr 172.21.15.2:0/1367091064 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:36.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.401+0000 7f1423e00700 1 -- 172.21.15.2:0/1367091064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142419e520 con 0x7f1424106d90 2024-06-13T02:04:36.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.401+0000 7f1423e00700 1 --2- 172.21.15.2:0/1367091064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1424106d90 0x7f142419dfe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f14140117e0 tx=0x7f1414011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:36.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.401+0000 7f1420c00700 1 -- 172.21.15.2:0/1367091064 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1414003bf0 con 0x7f1424106d90 2024-06-13T02:04:36.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.401+0000 7f1420c00700 1 -- 172.21.15.2:0/1367091064 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f141401a910 con 0x7f1424106d90 2024-06-13T02:04:36.400 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.401+0000 7f1420c00700 1 -- 172.21.15.2:0/1367091064 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1414024970 con 0x7f1424106d90 2024-06-13T02:04:36.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.401+0000 7f142b000700 1 -- 172.21.15.2:0/1367091064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f142419e7b0 con 0x7f1424106d90 2024-06-13T02:04:36.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.401+0000 7f142b000700 1 -- 172.21.15.2:0/1367091064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f142419ec10 con 0x7f1424106d90 2024-06-13T02:04:36.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.402+0000 7f1420c00700 1 -- 172.21.15.2:0/1367091064 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f1414022020 con 0x7f1424106d90 2024-06-13T02:04:36.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.403+0000 7f142b000700 1 -- 172.21.15.2:0/1367091064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1424063af0 con 0x7f1424106d90 2024-06-13T02:04:36.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.403+0000 7f1420c00700 1 --2- 172.21.15.2:0/1367091064 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f14080391f0 0x7f140803b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:36.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.403+0000 7f1420c00700 1 -- 172.21.15.2:0/1367091064 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f141404d680 con 0x7f1424106d90 2024-06-13T02:04:36.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.403+0000 7f1423400700 1 --2- 172.21.15.2:0/1367091064 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f14080391f0 0x7f140803b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:36.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.404+0000 7f1423400700 1 --2- 172.21.15.2:0/1367091064 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f14080391f0 0x7f140803b6b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1410006fd0 tx=0x7f1410006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:36.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.408+0000 7f1420c00700 1 -- 172.21.15.2:0/1367091064 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1414010380 con 0x7f1424106d90 2024-06-13T02:04:36.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.754+0000 7f142b000700 1 -- 172.21.15.2:0/1367091064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f14240630a0 con 0x7f1424106d90 2024-06-13T02:04:36.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.758+0000 7f1420c00700 1 -- 172.21.15.2:0/1367091064 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f14140212c0 con 0x7f1424106d90 2024-06-13T02:04:36.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.760+0000 7f142b000700 1 -- 172.21.15.2:0/1367091064 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f14080391f0 msgr2=0x7f140803b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:36.401 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.760+0000 7f142b000700 1 --2- 172.21.15.2:0/1367091064 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f14080391f0 0x7f140803b6b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1410006fd0 tx=0x7f1410006e40 comp rx=0 tx=0).stop 2024-06-13T02:04:36.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.760+0000 7f142b000700 1 -- 172.21.15.2:0/1367091064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1424106d90 msgr2=0x7f142419dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:36.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.760+0000 7f142b000700 1 --2- 172.21.15.2:0/1367091064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1424106d90 0x7f142419dfe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f14140117e0 tx=0x7f1414011ba0 comp rx=0 tx=0).stop 2024-06-13T02:04:36.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.761+0000 7f142b000700 1 -- 172.21.15.2:0/1367091064 shutdown_connections 2024-06-13T02:04:36.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.761+0000 7f142b000700 1 --2- 172.21.15.2:0/1367091064 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f14080391f0 0x7f140803b6b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:36.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.761+0000 7f142b000700 1 --2- 172.21.15.2:0/1367091064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1424106d90 0x7f142419dfe0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:36.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.761+0000 7f142b000700 1 -- 172.21.15.2:0/1367091064 >> 172.21.15.2:0/1367091064 conn(0x7f1424102390 msgr2=0x7f1424103200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:36.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.761+0000 7f142b000700 1 -- 172.21.15.2:0/1367091064 shutdown_connections 2024-06-13T02:04:36.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr 2024-06-13T02:04:35.761+0000 7f142b000700 1 -- 172.21.15.2:0/1367091064 wait complete. 2024-06-13T02:04:36.402 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-06-13T02:04:36.402 INFO:teuthology.orchestra.run.smithi002.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-06-13T02:04:36.402 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:04:36.402 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-06-13T02:04:36.402 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:04:36.403 INFO:teuthology.orchestra.run.smithi002.stdout:Or, if you are only running a single cluster on this host: 2024-06-13T02:04:36.403 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:04:36.403 INFO:teuthology.orchestra.run.smithi002.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-06-13T02:04:36.403 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:04:36.403 INFO:teuthology.orchestra.run.smithi002.stdout:Please consider enabling telemetry to help improve Ceph: 2024-06-13T02:04:36.403 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:04:36.403 INFO:teuthology.orchestra.run.smithi002.stdout: ceph telemetry on 2024-06-13T02:04:36.403 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:04:36.403 INFO:teuthology.orchestra.run.smithi002.stdout:For more information see: 2024-06-13T02:04:36.403 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:04:36.403 INFO:teuthology.orchestra.run.smithi002.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-06-13T02:04:36.403 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:04:36.403 INFO:teuthology.orchestra.run.smithi002.stdout:Bootstrap complete. 2024-06-13T02:04:36.498 INFO:tasks.cephadm:Fetching config... 2024-06-13T02:04:36.498 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:04:36.499 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-06-13T02:04:36.549 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-06-13T02:04:36.549 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:04:36.549 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-06-13T02:04:36.639 INFO:tasks.cephadm:Fetching mon keyring... 2024-06-13T02:04:36.640 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:04:36.640 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/keyring of=/dev/stdout 2024-06-13T02:04:36.710 INFO:tasks.cephadm:Fetching pub ssh key... 2024-06-13T02:04:36.711 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:04:36.711 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-06-13T02:04:36.800 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-06-13T02:04:36.800 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJV41UUUyVZ4/6tOIYVcCQ2Jzw6YxkdOK0XECte3iXKzyiIID3N5ZP5Tat9PkSuG5dpA7SKbDRUMGkLiGnS3+6bjMuppiqKlhaYeqnoacJhx7r23TeWmyavs6Zo9GAGw0BSw5oidQ63tkuR9uj+ihhpHosGDUCgqr3GnqR2LthQd4dEEocoQjDyMeyBv/SMTzGF7j5QNtWAWsoOvSU/7oADVmCajvoVjC4qdhiMkGou5FUxpD6poEkLyDk5ih3RRHPW/rGFECyvEqJYZHYP13x+USsDPpEixl5XjMZxUnFtCnJ33+dy3vCibuK0Bx6qoEfci4pYnBRI+GAbNW76OW0nUkTOGuieK+/BpUdaSXsGkuILBfA3Tfm+WOP2odSqRIIXCSZ9UaSH8rye6CIqnRzUwWqTAYVrrIBHBBLRDitnAvljUnynuMF+NpGS4FqLseARfmkwn2ob25woKDf93qv0OJ7oJQ1wqe2Q9zUieZ83HotiA8ikIvo7YlMhplwc4s= ceph-efed8ab4-2928-11ef-bc9c-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-13T02:04:36.961 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:36 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1367091064' entity='client.admin' 2024-06-13T02:04:36.974 INFO:teuthology.orchestra.run.smithi002.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJV41UUUyVZ4/6tOIYVcCQ2Jzw6YxkdOK0XECte3iXKzyiIID3N5ZP5Tat9PkSuG5dpA7SKbDRUMGkLiGnS3+6bjMuppiqKlhaYeqnoacJhx7r23TeWmyavs6Zo9GAGw0BSw5oidQ63tkuR9uj+ihhpHosGDUCgqr3GnqR2LthQd4dEEocoQjDyMeyBv/SMTzGF7j5QNtWAWsoOvSU/7oADVmCajvoVjC4qdhiMkGou5FUxpD6poEkLyDk5ih3RRHPW/rGFECyvEqJYZHYP13x+USsDPpEixl5XjMZxUnFtCnJ33+dy3vCibuK0Bx6qoEfci4pYnBRI+GAbNW76OW0nUkTOGuieK+/BpUdaSXsGkuILBfA3Tfm+WOP2odSqRIIXCSZ9UaSH8rye6CIqnRzUwWqTAYVrrIBHBBLRDitnAvljUnynuMF+NpGS4FqLseARfmkwn2ob25woKDf93qv0OJ7oJQ1wqe2Q9zUieZ83HotiA8ikIvo7YlMhplwc4s= ceph-efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:04:37.014 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJV41UUUyVZ4/6tOIYVcCQ2Jzw6YxkdOK0XECte3iXKzyiIID3N5ZP5Tat9PkSuG5dpA7SKbDRUMGkLiGnS3+6bjMuppiqKlhaYeqnoacJhx7r23TeWmyavs6Zo9GAGw0BSw5oidQ63tkuR9uj+ihhpHosGDUCgqr3GnqR2LthQd4dEEocoQjDyMeyBv/SMTzGF7j5QNtWAWsoOvSU/7oADVmCajvoVjC4qdhiMkGou5FUxpD6poEkLyDk5ih3RRHPW/rGFECyvEqJYZHYP13x+USsDPpEixl5XjMZxUnFtCnJ33+dy3vCibuK0Bx6qoEfci4pYnBRI+GAbNW76OW0nUkTOGuieK+/BpUdaSXsGkuILBfA3Tfm+WOP2odSqRIIXCSZ9UaSH8rye6CIqnRzUwWqTAYVrrIBHBBLRDitnAvljUnynuMF+NpGS4FqLseARfmkwn2ob25woKDf93qv0OJ7oJQ1wqe2Q9zUieZ83HotiA8ikIvo7YlMhplwc4s= ceph-efed8ab4-2928-11ef-bc9c-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-13T02:04:37.053 INFO:teuthology.orchestra.run.smithi084.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJV41UUUyVZ4/6tOIYVcCQ2Jzw6YxkdOK0XECte3iXKzyiIID3N5ZP5Tat9PkSuG5dpA7SKbDRUMGkLiGnS3+6bjMuppiqKlhaYeqnoacJhx7r23TeWmyavs6Zo9GAGw0BSw5oidQ63tkuR9uj+ihhpHosGDUCgqr3GnqR2LthQd4dEEocoQjDyMeyBv/SMTzGF7j5QNtWAWsoOvSU/7oADVmCajvoVjC4qdhiMkGou5FUxpD6poEkLyDk5ih3RRHPW/rGFECyvEqJYZHYP13x+USsDPpEixl5XjMZxUnFtCnJ33+dy3vCibuK0Bx6qoEfci4pYnBRI+GAbNW76OW0nUkTOGuieK+/BpUdaSXsGkuILBfA3Tfm+WOP2odSqRIIXCSZ9UaSH8rye6CIqnRzUwWqTAYVrrIBHBBLRDitnAvljUnynuMF+NpGS4FqLseARfmkwn2ob25woKDf93qv0OJ7oJQ1wqe2Q9zUieZ83HotiA8ikIvo7YlMhplwc4s= ceph-efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:04:37.064 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJV41UUUyVZ4/6tOIYVcCQ2Jzw6YxkdOK0XECte3iXKzyiIID3N5ZP5Tat9PkSuG5dpA7SKbDRUMGkLiGnS3+6bjMuppiqKlhaYeqnoacJhx7r23TeWmyavs6Zo9GAGw0BSw5oidQ63tkuR9uj+ihhpHosGDUCgqr3GnqR2LthQd4dEEocoQjDyMeyBv/SMTzGF7j5QNtWAWsoOvSU/7oADVmCajvoVjC4qdhiMkGou5FUxpD6poEkLyDk5ih3RRHPW/rGFECyvEqJYZHYP13x+USsDPpEixl5XjMZxUnFtCnJ33+dy3vCibuK0Bx6qoEfci4pYnBRI+GAbNW76OW0nUkTOGuieK+/BpUdaSXsGkuILBfA3Tfm+WOP2odSqRIIXCSZ9UaSH8rye6CIqnRzUwWqTAYVrrIBHBBLRDitnAvljUnynuMF+NpGS4FqLseARfmkwn2ob25woKDf93qv0OJ7oJQ1wqe2Q9zUieZ83HotiA8ikIvo7YlMhplwc4s= ceph-efed8ab4-2928-11ef-bc9c-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-13T02:04:37.103 INFO:teuthology.orchestra.run.smithi175.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJV41UUUyVZ4/6tOIYVcCQ2Jzw6YxkdOK0XECte3iXKzyiIID3N5ZP5Tat9PkSuG5dpA7SKbDRUMGkLiGnS3+6bjMuppiqKlhaYeqnoacJhx7r23TeWmyavs6Zo9GAGw0BSw5oidQ63tkuR9uj+ihhpHosGDUCgqr3GnqR2LthQd4dEEocoQjDyMeyBv/SMTzGF7j5QNtWAWsoOvSU/7oADVmCajvoVjC4qdhiMkGou5FUxpD6poEkLyDk5ih3RRHPW/rGFECyvEqJYZHYP13x+USsDPpEixl5XjMZxUnFtCnJ33+dy3vCibuK0Bx6qoEfci4pYnBRI+GAbNW76OW0nUkTOGuieK+/BpUdaSXsGkuILBfA3Tfm+WOP2odSqRIIXCSZ9UaSH8rye6CIqnRzUwWqTAYVrrIBHBBLRDitnAvljUnynuMF+NpGS4FqLseARfmkwn2ob25woKDf93qv0OJ7oJQ1wqe2Q9zUieZ83HotiA8ikIvo7YlMhplwc4s= ceph-efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:04:37.114 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-06-13T02:04:37.583 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:04:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.742+0000 7f9fe2200700 1 -- 172.21.15.2:0/2374153301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fdc101ea0 msgr2=0x7f9fdc1022c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:40.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.742+0000 7f9fe2200700 1 --2- 172.21.15.2:0/2374153301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fdc101ea0 0x7f9fdc1022c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009910 tx=0x7f9fcc009c20 comp rx=0 tx=0).stop 2024-06-13T02:04:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.742+0000 7f9fe2200700 1 -- 172.21.15.2:0/2374153301 shutdown_connections 2024-06-13T02:04:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.742+0000 7f9fe2200700 1 --2- 172.21.15.2:0/2374153301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fdc101ea0 0x7f9fdc1022c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.742+0000 7f9fe2200700 1 -- 172.21.15.2:0/2374153301 >> 172.21.15.2:0/2374153301 conn(0x7f9fdc0fd490 msgr2=0x7f9fdc0ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.742+0000 7f9fe2200700 1 -- 172.21.15.2:0/2374153301 shutdown_connections 2024-06-13T02:04:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.742+0000 7f9fe2200700 1 -- 172.21.15.2:0/2374153301 wait complete. 2024-06-13T02:04:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.744+0000 7f9fe2200700 1 Processor -- start 2024-06-13T02:04:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.744+0000 7f9fe2200700 1 -- start start 2024-06-13T02:04:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.744+0000 7f9fe2200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fdc101ea0 0x7f9fdc076150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.744+0000 7f9fe2200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc107ef0 con 0x7f9fdc101ea0 2024-06-13T02:04:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.744+0000 7f9fdb400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fdc101ea0 0x7f9fdc076150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.744+0000 7f9fdb400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fdc101ea0 0x7f9fdc076150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53988/0 (socket says 172.21.15.2:53988) 2024-06-13T02:04:40.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.745+0000 7f9fdb400700 1 -- 172.21.15.2:0/426597694 learned_addr learned my addr 172.21.15.2:0/426597694 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:40.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.745+0000 7f9fdb400700 1 -- 172.21.15.2:0/426597694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc076690 con 0x7f9fdc101ea0 2024-06-13T02:04:40.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.745+0000 7f9fdb400700 1 --2- 172.21.15.2:0/426597694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fdc101ea0 0x7f9fdc076150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc006010 tx=0x7f9fcc005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:40.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.746+0000 7f9fd3e00700 1 -- 172.21.15.2:0/426597694 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fcc027070 con 0x7f9fdc101ea0 2024-06-13T02:04:40.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.746+0000 7f9fd3e00700 1 -- 172.21.15.2:0/426597694 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fcc00be40 con 0x7f9fdc101ea0 2024-06-13T02:04:40.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.746+0000 7f9fd3e00700 1 -- 172.21.15.2:0/426597694 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fcc00f460 con 0x7f9fdc101ea0 2024-06-13T02:04:40.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.746+0000 7f9fe2200700 1 -- 172.21.15.2:0/426597694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fdc074880 con 0x7f9fdc101ea0 2024-06-13T02:04:40.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.746+0000 7f9fe2200700 1 -- 172.21.15.2:0/426597694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fdc074dc0 con 0x7f9fdc101ea0 2024-06-13T02:04:40.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.747+0000 7f9fd3e00700 1 -- 172.21.15.2:0/426597694 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f9fcc02a070 con 0x7f9fdc101ea0 2024-06-13T02:04:40.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.747+0000 7f9fe2200700 1 -- 172.21.15.2:0/426597694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fdc108670 con 0x7f9fdc101ea0 2024-06-13T02:04:40.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.748+0000 7f9fd3e00700 1 --2- 172.21.15.2:0/426597694 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9fc00391a0 0x7f9fc003b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:40.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.748+0000 7f9fd3e00700 1 -- 172.21.15.2:0/426597694 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9fcc01e030 con 0x7f9fdc101ea0 2024-06-13T02:04:40.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.748+0000 7f9fdaa00700 1 --2- 172.21.15.2:0/426597694 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9fc00391a0 0x7f9fc003b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:40.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.748+0000 7f9fdaa00700 1 --2- 172.21.15.2:0/426597694 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9fc00391a0 0x7f9fc003b660 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8006fd0 tx=0x7f9fc8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:40.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:39.753+0000 7f9fd3e00700 1 -- 172.21.15.2:0/426597694 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9fcc013070 con 0x7f9fdc101ea0 2024-06-13T02:04:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:40.001+0000 7f9fe2200700 1 -- 172.21.15.2:0/426597694 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f9fdc190970 con 0x7f9fdc101ea0 2024-06-13T02:04:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:40.004+0000 7f9fd3e00700 1 -- 172.21.15.2:0/426597694 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f9fcc031020 con 0x7f9fdc101ea0 2024-06-13T02:04:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:40.007+0000 7f9fe2200700 1 -- 172.21.15.2:0/426597694 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9fc00391a0 msgr2=0x7f9fc003b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:40.007+0000 7f9fe2200700 1 --2- 172.21.15.2:0/426597694 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9fc00391a0 0x7f9fc003b660 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8006fd0 tx=0x7f9fc8006e40 comp rx=0 tx=0).stop 2024-06-13T02:04:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:40.007+0000 7f9fe2200700 1 -- 172.21.15.2:0/426597694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fdc101ea0 msgr2=0x7f9fdc076150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:40.007+0000 7f9fe2200700 1 --2- 172.21.15.2:0/426597694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fdc101ea0 0x7f9fdc076150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc006010 tx=0x7f9fcc005050 comp rx=0 tx=0).stop 2024-06-13T02:04:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:40.007+0000 7f9fe2200700 1 -- 172.21.15.2:0/426597694 shutdown_connections 2024-06-13T02:04:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:40.007+0000 7f9fe2200700 1 --2- 172.21.15.2:0/426597694 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9fc00391a0 0x7f9fc003b660 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:40.007+0000 7f9fe2200700 1 --2- 172.21.15.2:0/426597694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9fdc101ea0 0x7f9fdc076150 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:40.007+0000 7f9fe2200700 1 -- 172.21.15.2:0/426597694 >> 172.21.15.2:0/426597694 conn(0x7f9fdc0fd490 msgr2=0x7f9fdc0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:40.008+0000 7f9fe2200700 1 -- 172.21.15.2:0/426597694 shutdown_connections 2024-06-13T02:04:40.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:40.008+0000 7f9fe2200700 1 -- 172.21.15.2:0/426597694 wait complete. 2024-06-13T02:04:40.736 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-06-13T02:04:40.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-06-13T02:04:41.190 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:04:41.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:41.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:41.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi002", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:04:41.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:41.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:40 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/426597694' entity='client.admin' 2024-06-13T02:04:41.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:04:41.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:43.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.057+0000 7f65e9a00700 1 -- 172.21.15.2:0/2176154147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65e4101f20 msgr2=0x7f65e4102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:43.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.057+0000 7f65e9a00700 1 --2- 172.21.15.2:0/2176154147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65e4101f20 0x7f65e4102340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009910 tx=0x7f65d4009c20 comp rx=0 tx=0).stop 2024-06-13T02:04:43.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.058+0000 7f65e9a00700 1 -- 172.21.15.2:0/2176154147 shutdown_connections 2024-06-13T02:04:43.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.058+0000 7f65e9a00700 1 --2- 172.21.15.2:0/2176154147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65e4101f20 0x7f65e4102340 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:43.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.058+0000 7f65e9a00700 1 -- 172.21.15.2:0/2176154147 >> 172.21.15.2:0/2176154147 conn(0x7f65e40fd4e0 msgr2=0x7f65e40ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:43.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.058+0000 7f65e9a00700 1 -- 172.21.15.2:0/2176154147 shutdown_connections 2024-06-13T02:04:43.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.058+0000 7f65e9a00700 1 -- 172.21.15.2:0/2176154147 wait complete. 2024-06-13T02:04:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.059+0000 7f65e9a00700 1 Processor -- start 2024-06-13T02:04:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.059+0000 7f65e9a00700 1 -- start start 2024-06-13T02:04:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.059+0000 7f65e9a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65e4101f20 0x7f65e41997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.059+0000 7f65e9a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f65e4107f30 con 0x7f65e4101f20 2024-06-13T02:04:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.060+0000 7f65e2a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65e4101f20 0x7f65e41997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:43.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.060+0000 7f65e2a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65e4101f20 0x7f65e41997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52604/0 (socket says 172.21.15.2:52604) 2024-06-13T02:04:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.060+0000 7f65e2a00700 1 -- 172.21.15.2:0/120071969 learned_addr learned my addr 172.21.15.2:0/120071969 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.060+0000 7f65e2a00700 1 -- 172.21.15.2:0/120071969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e4199d30 con 0x7f65e4101f20 2024-06-13T02:04:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.060+0000 7f65e2a00700 1 --2- 172.21.15.2:0/120071969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65e4101f20 0x7f65e41997f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f65d4005950 tx=0x7f65d4005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.061+0000 7f65dbe00700 1 -- 172.21.15.2:0/120071969 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d4026070 con 0x7f65e4101f20 2024-06-13T02:04:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.061+0000 7f65dbe00700 1 -- 172.21.15.2:0/120071969 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65d400bc30 con 0x7f65e4101f20 2024-06-13T02:04:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.061+0000 7f65e9a00700 1 -- 172.21.15.2:0/120071969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e4199fc0 con 0x7f65e4101f20 2024-06-13T02:04:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.061+0000 7f65dbe00700 1 -- 172.21.15.2:0/120071969 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d4003b30 con 0x7f65e4101f20 2024-06-13T02:04:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.061+0000 7f65e9a00700 1 -- 172.21.15.2:0/120071969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e419ccb0 con 0x7f65e4101f20 2024-06-13T02:04:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.062+0000 7f65dbe00700 1 -- 172.21.15.2:0/120071969 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f65d4029070 con 0x7f65e4101f20 2024-06-13T02:04:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.062+0000 7f65e9a00700 1 -- 172.21.15.2:0/120071969 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65e41086b0 con 0x7f65e4101f20 2024-06-13T02:04:43.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.063+0000 7f65dbe00700 1 --2- 172.21.15.2:0/120071969 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f65c4039150 0x7f65c403b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:43.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.063+0000 7f65dbe00700 1 -- 172.21.15.2:0/120071969 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f65d401e070 con 0x7f65e4101f20 2024-06-13T02:04:43.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.063+0000 7f65da000700 1 --2- 172.21.15.2:0/120071969 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f65c4039150 0x7f65c403b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.064+0000 7f65da000700 1 --2- 172.21.15.2:0/120071969 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f65c4039150 0x7f65c403b610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f65cc006fd0 tx=0x7f65cc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.068+0000 7f65dbe00700 1 -- 172.21.15.2:0/120071969 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f65d4013070 con 0x7f65e4101f20 2024-06-13T02:04:43.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.301+0000 7f65e9a00700 1 -- 172.21.15.2:0/120071969 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f65e402ddb0 con 0x7f65c4039150 2024-06-13T02:04:43.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.306+0000 7f65dbe00700 1 -- 172.21.15.2:0/120071969 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f65e402ddb0 con 0x7f65c4039150 2024-06-13T02:04:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.310+0000 7f65e9a00700 1 -- 172.21.15.2:0/120071969 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f65c4039150 msgr2=0x7f65c403b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.310+0000 7f65e9a00700 1 --2- 172.21.15.2:0/120071969 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f65c4039150 0x7f65c403b610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f65cc006fd0 tx=0x7f65cc006e40 comp rx=0 tx=0).stop 2024-06-13T02:04:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.310+0000 7f65e9a00700 1 -- 172.21.15.2:0/120071969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65e4101f20 msgr2=0x7f65e41997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:43.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.310+0000 7f65e9a00700 1 --2- 172.21.15.2:0/120071969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65e4101f20 0x7f65e41997f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f65d4005950 tx=0x7f65d4005030 comp rx=0 tx=0).stop 2024-06-13T02:04:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.310+0000 7f65e9a00700 1 -- 172.21.15.2:0/120071969 shutdown_connections 2024-06-13T02:04:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.310+0000 7f65e9a00700 1 --2- 172.21.15.2:0/120071969 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f65c4039150 0x7f65c403b610 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.310+0000 7f65e9a00700 1 --2- 172.21.15.2:0/120071969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65e4101f20 0x7f65e41997f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.310+0000 7f65e9a00700 1 -- 172.21.15.2:0/120071969 >> 172.21.15.2:0/120071969 conn(0x7f65e40fd4e0 msgr2=0x7f65e40fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.310+0000 7f65e9a00700 1 -- 172.21.15.2:0/120071969 shutdown_connections 2024-06-13T02:04:43.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:43.310+0000 7f65e9a00700 1 -- 172.21.15.2:0/120071969 wait complete. 2024-06-13T02:04:44.001 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi084 2024-06-13T02:04:44.002 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-06-13T02:04:44.002 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/etc/ceph/ceph.conf 2024-06-13T02:04:44.021 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-06-13T02:04:44.021 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:04:44.078 INFO:tasks.cephadm:Adding host smithi084 to orchestrator... 2024-06-13T02:04:44.078 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch host add smithi084 2024-06-13T02:04:44.506 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:04:44.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:44 smithi002 ceph-mon[31960]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:04:44.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:44 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:44.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:44 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:04:44.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:44 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:04:44.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:44 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:04:44.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:44 smithi002 ceph-mon[31960]: Updating smithi002:/etc/ceph/ceph.conf 2024-06-13T02:04:44.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:44 smithi002 ceph-mon[31960]: Updating smithi002:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:04:45.588 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:45 smithi002 ceph-mon[31960]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:04:45.588 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:45 smithi002 ceph-mon[31960]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:04:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.346+0000 7f1a03600700 1 -- 172.21.15.2:0/2676187628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19fc10d4e0 msgr2=0x7f19fc10d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.346+0000 7f1a03600700 1 --2- 172.21.15.2:0/2676187628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19fc10d4e0 0x7f19fc10d8c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009910 tx=0x7f19f0009c20 comp rx=0 tx=0).stop 2024-06-13T02:04:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.346+0000 7f1a03600700 1 -- 172.21.15.2:0/2676187628 shutdown_connections 2024-06-13T02:04:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.346+0000 7f1a03600700 1 --2- 172.21.15.2:0/2676187628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19fc10d4e0 0x7f19fc10d8c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.346+0000 7f1a03600700 1 -- 172.21.15.2:0/2676187628 >> 172.21.15.2:0/2676187628 conn(0x7f19fc077d20 msgr2=0x7f19fc07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.346+0000 7f1a03600700 1 -- 172.21.15.2:0/2676187628 shutdown_connections 2024-06-13T02:04:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.346+0000 7f1a03600700 1 -- 172.21.15.2:0/2676187628 wait complete. 2024-06-13T02:04:46.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.347+0000 7f1a03600700 1 Processor -- start 2024-06-13T02:04:46.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.348+0000 7f1a03600700 1 -- start start 2024-06-13T02:04:46.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.348+0000 7f1a03600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19fc10d4e0 0x7f19fc19df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:46.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.348+0000 7f1a03600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc112b50 con 0x7f19fc10d4e0 2024-06-13T02:04:46.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.348+0000 7f1a00c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19fc10d4e0 0x7f19fc19df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:46.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.348+0000 7f1a00c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19fc10d4e0 0x7f19fc19df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52610/0 (socket says 172.21.15.2:52610) 2024-06-13T02:04:46.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.348+0000 7f1a00c00700 1 -- 172.21.15.2:0/3479061960 learned_addr learned my addr 172.21.15.2:0/3479061960 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.349+0000 7f1a00c00700 1 -- 172.21.15.2:0/3479061960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19fc19e4d0 con 0x7f19fc10d4e0 2024-06-13T02:04:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.349+0000 7f1a00c00700 1 --2- 172.21.15.2:0/3479061960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19fc10d4e0 0x7f19fc19df90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f19f00092e0 tx=0x7f19f0005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.349+0000 7f19f9600700 1 -- 172.21.15.2:0/3479061960 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f0026070 con 0x7f19fc10d4e0 2024-06-13T02:04:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.350+0000 7f19f9600700 1 -- 172.21.15.2:0/3479061960 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19f000b750 con 0x7f19fc10d4e0 2024-06-13T02:04:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.350+0000 7f1a03600700 1 -- 172.21.15.2:0/3479061960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19fc19e760 con 0x7f19fc10d4e0 2024-06-13T02:04:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.350+0000 7f19f9600700 1 -- 172.21.15.2:0/3479061960 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f0003970 con 0x7f19fc10d4e0 2024-06-13T02:04:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.350+0000 7f1a03600700 1 -- 172.21.15.2:0/3479061960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19fc1a2860 con 0x7f19fc10d4e0 2024-06-13T02:04:46.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.351+0000 7f19f9600700 1 -- 172.21.15.2:0/3479061960 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f19f0029070 con 0x7f19fc10d4e0 2024-06-13T02:04:46.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.351+0000 7f1a03600700 1 -- 172.21.15.2:0/3479061960 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19fc109be0 con 0x7f19fc10d4e0 2024-06-13T02:04:46.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.351+0000 7f19f9600700 1 --2- 172.21.15.2:0/3479061960 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19e40390f0 0x7f19e403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:46.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.352+0000 7f19f9600700 1 -- 172.21.15.2:0/3479061960 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f19f001e070 con 0x7f19fc10d4e0 2024-06-13T02:04:46.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.352+0000 7f19fbe00700 1 --2- 172.21.15.2:0/3479061960 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19e40390f0 0x7f19e403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:46.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.353+0000 7f19fbe00700 1 --2- 172.21.15.2:0/3479061960 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19e40390f0 0x7f19e403b5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f19e8006fd0 tx=0x7f19e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:46.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.357+0000 7f19f9600700 1 -- 172.21.15.2:0/3479061960 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f19f0013070 con 0x7f19fc10d4e0 2024-06-13T02:04:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:46.592+0000 7f1a03600700 1 -- 172.21.15.2:0/3479061960 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi084", "target": ["mon-mgr", ""]}) -- 0x7f19fc19f2f0 con 0x7f19e40390f0 2024-06-13T02:04:47.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:46 smithi002 ceph-mon[31960]: Updating smithi002:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:04:47.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:46 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:47.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:46 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:47.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:46 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:48.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:47 smithi002 ceph-mon[31960]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:04:48.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:47 smithi002 ceph-mon[31960]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi084", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:04:49.282 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:48 smithi002 ceph-mon[31960]: Deploying cephadm binary to smithi084 2024-06-13T02:04:50.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:49 smithi002 ceph-mon[31960]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:04:51.579 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi084' with addr '172.21.15.84' 2024-06-13T02:04:51.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:51.577+0000 7f19f9600700 1 -- 172.21.15.2:0/3479061960 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f19fc19f2f0 con 0x7f19e40390f0 2024-06-13T02:04:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:51.581+0000 7f1a03600700 1 -- 172.21.15.2:0/3479061960 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19e40390f0 msgr2=0x7f19e403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:51.581+0000 7f1a03600700 1 --2- 172.21.15.2:0/3479061960 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19e40390f0 0x7f19e403b5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f19e8006fd0 tx=0x7f19e8006e40 comp rx=0 tx=0).stop 2024-06-13T02:04:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:51.581+0000 7f1a03600700 1 -- 172.21.15.2:0/3479061960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19fc10d4e0 msgr2=0x7f19fc19df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:51.581+0000 7f1a03600700 1 --2- 172.21.15.2:0/3479061960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19fc10d4e0 0x7f19fc19df90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f19f00092e0 tx=0x7f19f0005030 comp rx=0 tx=0).stop 2024-06-13T02:04:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:51.581+0000 7f1a03600700 1 -- 172.21.15.2:0/3479061960 shutdown_connections 2024-06-13T02:04:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:51.581+0000 7f1a03600700 1 --2- 172.21.15.2:0/3479061960 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19e40390f0 0x7f19e403b5b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:51.581+0000 7f1a03600700 1 --2- 172.21.15.2:0/3479061960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19fc10d4e0 0x7f19fc19df90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:51.581+0000 7f1a03600700 1 -- 172.21.15.2:0/3479061960 >> 172.21.15.2:0/3479061960 conn(0x7f19fc077d20 msgr2=0x7f19fc0788e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:51.582+0000 7f1a03600700 1 -- 172.21.15.2:0/3479061960 shutdown_connections 2024-06-13T02:04:51.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:51.582+0000 7f1a03600700 1 -- 172.21.15.2:0/3479061960 wait complete. 2024-06-13T02:04:52.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:51 smithi002 ceph-mon[31960]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:04:52.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:51 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:52.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:51 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:04:52.279 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch host ls --format=json 2024-06-13T02:04:52.729 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:04:53.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:52 smithi002 ceph-mon[31960]: Added host smithi084 2024-06-13T02:04:53.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:52 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:53.182 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:52 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:54.244 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:53 smithi002 ceph-mon[31960]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:04:54.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.695+0000 7ff9e1e00700 1 -- 172.21.15.2:0/1743289491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc104310 msgr2=0x7ff9dc1046f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:54.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.695+0000 7ff9e1e00700 1 --2- 172.21.15.2:0/1743289491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc104310 0x7ff9dc1046f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009910 tx=0x7ff9cc009c20 comp rx=0 tx=0).stop 2024-06-13T02:04:54.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.695+0000 7ff9e1e00700 1 -- 172.21.15.2:0/1743289491 shutdown_connections 2024-06-13T02:04:54.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.695+0000 7ff9e1e00700 1 --2- 172.21.15.2:0/1743289491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc104310 0x7ff9dc1046f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:54.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.695+0000 7ff9e1e00700 1 -- 172.21.15.2:0/1743289491 >> 172.21.15.2:0/1743289491 conn(0x7ff9dc0ffbe0 msgr2=0x7ff9dc102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:54.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.695+0000 7ff9e1e00700 1 -- 172.21.15.2:0/1743289491 shutdown_connections 2024-06-13T02:04:54.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.695+0000 7ff9e1e00700 1 -- 172.21.15.2:0/1743289491 wait complete. 2024-06-13T02:04:54.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.696+0000 7ff9e1e00700 1 Processor -- start 2024-06-13T02:04:54.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.696+0000 7ff9e1e00700 1 -- start start 2024-06-13T02:04:54.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.697+0000 7ff9e1e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc104310 0x7ff9dc19f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:54.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.697+0000 7ff9e1e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc10e6e0 con 0x7ff9dc104310 2024-06-13T02:04:54.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.697+0000 7ff9daa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc104310 0x7ff9dc19f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:54.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.697+0000 7ff9daa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc104310 0x7ff9dc19f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53446/0 (socket says 172.21.15.2:53446) 2024-06-13T02:04:54.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.697+0000 7ff9daa00700 1 -- 172.21.15.2:0/460875622 learned_addr learned my addr 172.21.15.2:0/460875622 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:54.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.697+0000 7ff9daa00700 1 -- 172.21.15.2:0/460875622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9dc19fd50 con 0x7ff9dc104310 2024-06-13T02:04:54.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.698+0000 7ff9daa00700 1 --2- 172.21.15.2:0/460875622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc104310 0x7ff9dc19f810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc005850 tx=0x7ff9cc005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:54.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.698+0000 7ff9e0a00700 1 -- 172.21.15.2:0/460875622 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9cc026070 con 0x7ff9dc104310 2024-06-13T02:04:54.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.698+0000 7ff9e0a00700 1 -- 172.21.15.2:0/460875622 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9cc00bbd0 con 0x7ff9dc104310 2024-06-13T02:04:54.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.698+0000 7ff9e0a00700 1 -- 172.21.15.2:0/460875622 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9cc003970 con 0x7ff9dc104310 2024-06-13T02:04:54.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.698+0000 7ff9e1e00700 1 -- 172.21.15.2:0/460875622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9dc1a0040 con 0x7ff9dc104310 2024-06-13T02:04:54.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.698+0000 7ff9e1e00700 1 -- 172.21.15.2:0/460875622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9dc1999d0 con 0x7ff9dc104310 2024-06-13T02:04:54.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.699+0000 7ff9e1e00700 1 -- 172.21.15.2:0/460875622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9dc1057f0 con 0x7ff9dc104310 2024-06-13T02:04:54.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.699+0000 7ff9e0a00700 1 -- 172.21.15.2:0/460875622 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7ff9cc029070 con 0x7ff9dc104310 2024-06-13T02:04:54.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.700+0000 7ff9e0a00700 1 --2- 172.21.15.2:0/460875622 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff9c00390f0 0x7ff9c003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:54.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.700+0000 7ff9e0a00700 1 -- 172.21.15.2:0/460875622 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff9cc01e070 con 0x7ff9dc104310 2024-06-13T02:04:54.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.700+0000 7ff9da000700 1 --2- 172.21.15.2:0/460875622 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff9c00390f0 0x7ff9c003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:54.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.701+0000 7ff9da000700 1 --2- 172.21.15.2:0/460875622 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff9c00390f0 0x7ff9c003b5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8006fd0 tx=0x7ff9c8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:54.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.706+0000 7ff9e0a00700 1 -- 172.21.15.2:0/460875622 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff9cc013070 con 0x7ff9dc104310 2024-06-13T02:04:54.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.946+0000 7ff9e1e00700 1 -- 172.21.15.2:0/460875622 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9dc19af00 con 0x7ff9c00390f0 2024-06-13T02:04:54.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.949+0000 7ff9e0a00700 1 -- 172.21.15.2:0/460875622 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7ff9dc19af00 con 0x7ff9c00390f0 2024-06-13T02:04:54.950 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:04:54.950 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}] 2024-06-13T02:04:54.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.952+0000 7ff9e1e00700 1 -- 172.21.15.2:0/460875622 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff9c00390f0 msgr2=0x7ff9c003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:54.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.952+0000 7ff9e1e00700 1 --2- 172.21.15.2:0/460875622 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff9c00390f0 0x7ff9c003b5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8006fd0 tx=0x7ff9c8006e40 comp rx=0 tx=0).stop 2024-06-13T02:04:54.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.952+0000 7ff9e1e00700 1 -- 172.21.15.2:0/460875622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc104310 msgr2=0x7ff9dc19f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:54.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.952+0000 7ff9e1e00700 1 --2- 172.21.15.2:0/460875622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc104310 0x7ff9dc19f810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc005850 tx=0x7ff9cc005030 comp rx=0 tx=0).stop 2024-06-13T02:04:54.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.952+0000 7ff9e1e00700 1 -- 172.21.15.2:0/460875622 shutdown_connections 2024-06-13T02:04:54.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.952+0000 7ff9e1e00700 1 --2- 172.21.15.2:0/460875622 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff9c00390f0 0x7ff9c003b5b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:54.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.952+0000 7ff9e1e00700 1 --2- 172.21.15.2:0/460875622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9dc104310 0x7ff9dc19f810 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:54.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.952+0000 7ff9e1e00700 1 -- 172.21.15.2:0/460875622 >> 172.21.15.2:0/460875622 conn(0x7ff9dc0ffbe0 msgr2=0x7ff9dc105ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:54.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.952+0000 7ff9e1e00700 1 -- 172.21.15.2:0/460875622 shutdown_connections 2024-06-13T02:04:54.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:54.953+0000 7ff9e1e00700 1 -- 172.21.15.2:0/460875622 wait complete. 2024-06-13T02:04:55.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:55 smithi002 ceph-mon[31960]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:04:55.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:55 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:55.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:55 smithi002 ceph-mon[31960]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:04:55.707 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi175 2024-06-13T02:04:55.707 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-06-13T02:04:55.707 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.conf 2024-06-13T02:04:55.726 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-06-13T02:04:55.726 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:04:55.783 INFO:tasks.cephadm:Adding host smithi175 to orchestrator... 2024-06-13T02:04:55.784 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch host add smithi175 2024-06-13T02:04:56.243 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:04:57.461 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:57 smithi002 ceph-mon[31960]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:04:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.286+0000 7fd8d9e00700 1 -- 172.21.15.2:0/3883091379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d4107f10 msgr2=0x7fd8d41082f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:04:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.286+0000 7fd8d9e00700 1 --2- 172.21.15.2:0/3883091379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d4107f10 0x7fd8d41082f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009910 tx=0x7fd8c4009c20 comp rx=0 tx=0).stop 2024-06-13T02:04:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.286+0000 7fd8d9e00700 1 -- 172.21.15.2:0/3883091379 shutdown_connections 2024-06-13T02:04:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.286+0000 7fd8d9e00700 1 --2- 172.21.15.2:0/3883091379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d4107f10 0x7fd8d41082f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:04:58.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.286+0000 7fd8d9e00700 1 -- 172.21.15.2:0/3883091379 >> 172.21.15.2:0/3883091379 conn(0x7fd8d40768e0 msgr2=0x7fd8d4076cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:04:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.286+0000 7fd8d9e00700 1 -- 172.21.15.2:0/3883091379 shutdown_connections 2024-06-13T02:04:58.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.286+0000 7fd8d9e00700 1 -- 172.21.15.2:0/3883091379 wait complete. 2024-06-13T02:04:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.287+0000 7fd8d9e00700 1 Processor -- start 2024-06-13T02:04:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.287+0000 7fd8d9e00700 1 -- start start 2024-06-13T02:04:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.288+0000 7fd8d9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d4107f10 0x7fd8d419f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.288+0000 7fd8d9e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d410c490 con 0x7fd8d4107f10 2024-06-13T02:04:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.288+0000 7fd8d2a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d4107f10 0x7fd8d419f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.288+0000 7fd8d2a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d4107f10 0x7fd8d419f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53460/0 (socket says 172.21.15.2:53460) 2024-06-13T02:04:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.288+0000 7fd8d2a00700 1 -- 172.21.15.2:0/3118931648 learned_addr learned my addr 172.21.15.2:0/3118931648 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:04:58.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.289+0000 7fd8d2a00700 1 -- 172.21.15.2:0/3118931648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d419fd50 con 0x7fd8d4107f10 2024-06-13T02:04:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.289+0000 7fd8d2a00700 1 --2- 172.21.15.2:0/3118931648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d4107f10 0x7fd8d419f810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4005850 tx=0x7fd8c4005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.289+0000 7fd8d8a00700 1 -- 172.21.15.2:0/3118931648 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8c4026070 con 0x7fd8d4107f10 2024-06-13T02:04:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.289+0000 7fd8d8a00700 1 -- 172.21.15.2:0/3118931648 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8c400bbd0 con 0x7fd8d4107f10 2024-06-13T02:04:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.289+0000 7fd8d8a00700 1 -- 172.21.15.2:0/3118931648 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8c4003970 con 0x7fd8d4107f10 2024-06-13T02:04:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.289+0000 7fd8d9e00700 1 -- 172.21.15.2:0/3118931648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d41a0040 con 0x7fd8d4107f10 2024-06-13T02:04:58.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.290+0000 7fd8d9e00700 1 -- 172.21.15.2:0/3118931648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d41999d0 con 0x7fd8d4107f10 2024-06-13T02:04:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.291+0000 7fd8d8a00700 1 -- 172.21.15.2:0/3118931648 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fd8c4029070 con 0x7fd8d4107f10 2024-06-13T02:04:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.291+0000 7fd8d9e00700 1 -- 172.21.15.2:0/3118931648 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d41035c0 con 0x7fd8d4107f10 2024-06-13T02:04:58.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.291+0000 7fd8d8a00700 1 --2- 172.21.15.2:0/3118931648 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8b8039150 0x7fd8b803b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:04:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.291+0000 7fd8d8a00700 1 -- 172.21.15.2:0/3118931648 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd8c401e070 con 0x7fd8d4107f10 2024-06-13T02:04:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.292+0000 7fd8d2000700 1 --2- 172.21.15.2:0/3118931648 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8b8039150 0x7fd8b803b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:04:58.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.292+0000 7fd8d2000700 1 --2- 172.21.15.2:0/3118931648 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8b8039150 0x7fd8b803b610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0006fd0 tx=0x7fd8c0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:04:58.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.297+0000 7fd8d8a00700 1 -- 172.21.15.2:0/3118931648 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd8c4051070 con 0x7fd8d4107f10 2024-06-13T02:04:58.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:04:58.530+0000 7fd8d9e00700 1 -- 172.21.15.2:0/3118931648 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}) -- 0x7fd8d419af00 con 0x7fd8b8039150 2024-06-13T02:04:58.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:58 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:58.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:58 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:58.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:58 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:58.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:58 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:04:58.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:58 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:04:58.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:58 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:04:58.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:58 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:04:58.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:58 smithi002 ceph-mon[31960]: Updating smithi084:/etc/ceph/ceph.conf 2024-06-13T02:04:58.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:58 smithi002 ceph-mon[31960]: Updating smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:00.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:59 smithi002 ceph-mon[31960]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:05:00.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:59 smithi002 ceph-mon[31960]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:00.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:59 smithi002 ceph-mon[31960]: Updating smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:05:00.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:59 smithi002 ceph-mon[31960]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:05:00.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:59 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:00.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:59 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:00.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:04:59 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:01.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:00 smithi002 ceph-mon[31960]: Deploying cephadm binary to smithi175 2024-06-13T02:05:02.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:01 smithi002 ceph-mon[31960]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:03.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:03.495+0000 7fd8d8a00700 1 -- 172.21.15.2:0/3118931648 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fd8d419af00 con 0x7fd8b8039150 2024-06-13T02:05:03.496 INFO:teuthology.orchestra.run.smithi002.stdout:Added host 'smithi175' with addr '172.21.15.175' 2024-06-13T02:05:03.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:03.499+0000 7fd8d9e00700 1 -- 172.21.15.2:0/3118931648 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8b8039150 msgr2=0x7fd8b803b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:03.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:03.499+0000 7fd8d9e00700 1 --2- 172.21.15.2:0/3118931648 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8b8039150 0x7fd8b803b610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0006fd0 tx=0x7fd8c0006e40 comp rx=0 tx=0).stop 2024-06-13T02:05:03.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:03.499+0000 7fd8d9e00700 1 -- 172.21.15.2:0/3118931648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d4107f10 msgr2=0x7fd8d419f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:03.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:03.499+0000 7fd8d9e00700 1 --2- 172.21.15.2:0/3118931648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d4107f10 0x7fd8d419f810 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4005850 tx=0x7fd8c4005030 comp rx=0 tx=0).stop 2024-06-13T02:05:03.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:03.499+0000 7fd8d9e00700 1 -- 172.21.15.2:0/3118931648 shutdown_connections 2024-06-13T02:05:03.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:03.499+0000 7fd8d9e00700 1 --2- 172.21.15.2:0/3118931648 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8b8039150 0x7fd8b803b610 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:03.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:03.499+0000 7fd8d9e00700 1 --2- 172.21.15.2:0/3118931648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8d4107f10 0x7fd8d419f810 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:03.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:03.499+0000 7fd8d9e00700 1 -- 172.21.15.2:0/3118931648 >> 172.21.15.2:0/3118931648 conn(0x7fd8d40768e0 msgr2=0x7fd8d410a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:03.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:03.499+0000 7fd8d9e00700 1 -- 172.21.15.2:0/3118931648 shutdown_connections 2024-06-13T02:05:03.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:03.499+0000 7fd8d9e00700 1 -- 172.21.15.2:0/3118931648 wait complete. 2024-06-13T02:05:04.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:03 smithi002 ceph-mon[31960]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:04.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:03 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:04.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:03 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:04.258 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch host ls --format=json 2024-06-13T02:05:04.734 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:05:05.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:05 smithi002 ceph-mon[31960]: Added host smithi175 2024-06-13T02:05:05.157 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:05.158 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:06.242 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:06 smithi002 ceph-mon[31960]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.737+0000 7f81b0a00700 1 -- 172.21.15.2:0/1186670798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ac101040 msgr2=0x7f81ac101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:06.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.737+0000 7f81b0a00700 1 --2- 172.21.15.2:0/1186670798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ac101040 0x7f81ac101420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f819c009910 tx=0x7f819c009c20 comp rx=0 tx=0).stop 2024-06-13T02:05:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.737+0000 7f81b0a00700 1 -- 172.21.15.2:0/1186670798 shutdown_connections 2024-06-13T02:05:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.737+0000 7f81b0a00700 1 --2- 172.21.15.2:0/1186670798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ac101040 0x7f81ac101420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.737+0000 7f81b0a00700 1 -- 172.21.15.2:0/1186670798 >> 172.21.15.2:0/1186670798 conn(0x7f81ac0768f0 msgr2=0x7f81ac076d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.738+0000 7f81b0a00700 1 -- 172.21.15.2:0/1186670798 shutdown_connections 2024-06-13T02:05:06.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.738+0000 7f81b0a00700 1 -- 172.21.15.2:0/1186670798 wait complete. 2024-06-13T02:05:06.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.739+0000 7f81b0a00700 1 Processor -- start 2024-06-13T02:05:06.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.739+0000 7f81b0a00700 1 -- start start 2024-06-13T02:05:06.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.739+0000 7f81b0a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ac101040 0x7f81ac19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:06.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.739+0000 7f81b0a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac10b3c0 con 0x7f81ac101040 2024-06-13T02:05:06.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.740+0000 7f81a9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ac101040 0x7f81ac19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:06.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.740+0000 7f81a9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ac101040 0x7f81ac19d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41644/0 (socket says 172.21.15.2:41644) 2024-06-13T02:05:06.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.740+0000 7f81a9e00700 1 -- 172.21.15.2:0/179857521 learned_addr learned my addr 172.21.15.2:0/179857521 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:05:06.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.740+0000 7f81a9e00700 1 -- 172.21.15.2:0/179857521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ac19db90 con 0x7f81ac101040 2024-06-13T02:05:06.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.740+0000 7f81a9e00700 1 --2- 172.21.15.2:0/179857521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ac101040 0x7f81ac19d650 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f819c005850 tx=0x7f819c005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:06.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.741+0000 7f81a2a00700 1 -- 172.21.15.2:0/179857521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f819c026070 con 0x7f81ac101040 2024-06-13T02:05:06.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.741+0000 7f81a2a00700 1 -- 172.21.15.2:0/179857521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f819c00bbd0 con 0x7f81ac101040 2024-06-13T02:05:06.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.741+0000 7f81b0a00700 1 -- 172.21.15.2:0/179857521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ac19de80 con 0x7f81ac101040 2024-06-13T02:05:06.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.741+0000 7f81a2a00700 1 -- 172.21.15.2:0/179857521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f819c003970 con 0x7f81ac101040 2024-06-13T02:05:06.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.741+0000 7f81b0a00700 1 -- 172.21.15.2:0/179857521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ac197870 con 0x7f81ac101040 2024-06-13T02:05:06.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.742+0000 7f81a2a00700 1 -- 172.21.15.2:0/179857521 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f819c029070 con 0x7f81ac101040 2024-06-13T02:05:06.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.742+0000 7f81b0a00700 1 -- 172.21.15.2:0/179857521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81ac1024d0 con 0x7f81ac101040 2024-06-13T02:05:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.743+0000 7f81a2a00700 1 --2- 172.21.15.2:0/179857521 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f81900390f0 0x7f819003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.743+0000 7f81a2a00700 1 -- 172.21.15.2:0/179857521 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f819c01e070 con 0x7f81ac101040 2024-06-13T02:05:06.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.743+0000 7f81a9400700 1 --2- 172.21.15.2:0/179857521 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f81900390f0 0x7f819003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:06.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.744+0000 7f81a9400700 1 --2- 172.21.15.2:0/179857521 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f81900390f0 0x7f819003b5b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8198006fd0 tx=0x7f8198006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:06.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.748+0000 7f81a2a00700 1 -- 172.21.15.2:0/179857521 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f819c013070 con 0x7f81ac101040 2024-06-13T02:05:06.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.982+0000 7f81b0a00700 1 -- 172.21.15.2:0/179857521 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81ac198d00 con 0x7f81900390f0 2024-06-13T02:05:06.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.985+0000 7f81a2a00700 1 -- 172.21.15.2:0/179857521 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+238 (secure 0 0 0) 0x7f81ac198d00 con 0x7f81900390f0 2024-06-13T02:05:06.987 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:05:06.988 INFO:teuthology.orchestra.run.smithi002.stdout:[{"addr": "172.21.15.2", "hostname": "smithi002", "labels": [], "status": ""}, {"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}, {"addr": "172.21.15.175", "hostname": "smithi175", "labels": [], "status": ""}] 2024-06-13T02:05:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.989+0000 7f81b0a00700 1 -- 172.21.15.2:0/179857521 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f81900390f0 msgr2=0x7f819003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.989+0000 7f81b0a00700 1 --2- 172.21.15.2:0/179857521 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f81900390f0 0x7f819003b5b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8198006fd0 tx=0x7f8198006e40 comp rx=0 tx=0).stop 2024-06-13T02:05:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.989+0000 7f81b0a00700 1 -- 172.21.15.2:0/179857521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ac101040 msgr2=0x7f81ac19d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.989+0000 7f81b0a00700 1 --2- 172.21.15.2:0/179857521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ac101040 0x7f81ac19d650 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f819c005850 tx=0x7f819c005030 comp rx=0 tx=0).stop 2024-06-13T02:05:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.989+0000 7f81b0a00700 1 -- 172.21.15.2:0/179857521 shutdown_connections 2024-06-13T02:05:06.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.989+0000 7f81b0a00700 1 --2- 172.21.15.2:0/179857521 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f81900390f0 0x7f819003b5b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.989+0000 7f81b0a00700 1 --2- 172.21.15.2:0/179857521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81ac101040 0x7f81ac19d650 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.989+0000 7f81b0a00700 1 -- 172.21.15.2:0/179857521 >> 172.21.15.2:0/179857521 conn(0x7f81ac0768f0 msgr2=0x7f81ac0698b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.989+0000 7f81b0a00700 1 -- 172.21.15.2:0/179857521 shutdown_connections 2024-06-13T02:05:06.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:06.989+0000 7f81b0a00700 1 -- 172.21.15.2:0/179857521 wait complete. 2024-06-13T02:05:07.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:07 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:07.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:07 smithi002 ceph-mon[31960]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:07.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:07 smithi002 ceph-mon[31960]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:05:07.805 INFO:tasks.cephadm:Setting crush tunables to default 2024-06-13T02:05:07.806 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd crush tunables default 2024-06-13T02:05:08.262 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:05:09.564 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:09 smithi002 ceph-mon[31960]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:09.564 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:09.564 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:09.564 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:09.564 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:09.565 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:05:09.565 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:09.565 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:10.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.392+0000 7fef36e00700 1 -- 172.21.15.2:0/3731332450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef30107d90 msgr2=0x7fef30108170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:10.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.392+0000 7fef36e00700 1 --2- 172.21.15.2:0/3731332450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef30107d90 0x7fef30108170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef24009910 tx=0x7fef24009c20 comp rx=0 tx=0).stop 2024-06-13T02:05:10.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.392+0000 7fef36e00700 1 -- 172.21.15.2:0/3731332450 shutdown_connections 2024-06-13T02:05:10.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.392+0000 7fef36e00700 1 --2- 172.21.15.2:0/3731332450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef30107d90 0x7fef30108170 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:10.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.392+0000 7fef36e00700 1 -- 172.21.15.2:0/3731332450 >> 172.21.15.2:0/3731332450 conn(0x7fef30076740 msgr2=0x7fef30076b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:10.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.393+0000 7fef36e00700 1 -- 172.21.15.2:0/3731332450 shutdown_connections 2024-06-13T02:05:10.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.393+0000 7fef36e00700 1 -- 172.21.15.2:0/3731332450 wait complete. 2024-06-13T02:05:10.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.394+0000 7fef36e00700 1 Processor -- start 2024-06-13T02:05:10.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.394+0000 7fef36e00700 1 -- start start 2024-06-13T02:05:10.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.394+0000 7fef36e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef30107d90 0x7fef30100d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:10.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.394+0000 7fef36e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fef3010c310 con 0x7fef30107d90 2024-06-13T02:05:10.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.395+0000 7fef35a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef30107d90 0x7fef30100d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:10.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.395+0000 7fef35a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef30107d90 0x7fef30100d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41654/0 (socket says 172.21.15.2:41654) 2024-06-13T02:05:10.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.395+0000 7fef35a00700 1 -- 172.21.15.2:0/1642723808 learned_addr learned my addr 172.21.15.2:0/1642723808 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:05:10.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.395+0000 7fef35a00700 1 -- 172.21.15.2:0/1642723808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef30102c00 con 0x7fef30107d90 2024-06-13T02:05:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.395+0000 7fef35a00700 1 --2- 172.21.15.2:0/1642723808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef30107d90 0x7fef30100d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef24005850 tx=0x7fef24005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.396+0000 7fef2e000700 1 -- 172.21.15.2:0/1642723808 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef24026070 con 0x7fef30107d90 2024-06-13T02:05:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.396+0000 7fef2e000700 1 -- 172.21.15.2:0/1642723808 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef2400bc30 con 0x7fef30107d90 2024-06-13T02:05:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.396+0000 7fef2e000700 1 -- 172.21.15.2:0/1642723808 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef24003a20 con 0x7fef30107d90 2024-06-13T02:05:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.396+0000 7fef36e00700 1 -- 172.21.15.2:0/1642723808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef301012b0 con 0x7fef30107d90 2024-06-13T02:05:10.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.396+0000 7fef36e00700 1 -- 172.21.15.2:0/1642723808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef30101770 con 0x7fef30107d90 2024-06-13T02:05:10.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.397+0000 7fef36e00700 1 -- 172.21.15.2:0/1642723808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef30103440 con 0x7fef30107d90 2024-06-13T02:05:10.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.397+0000 7fef2e000700 1 -- 172.21.15.2:0/1642723808 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fef24029070 con 0x7fef30107d90 2024-06-13T02:05:10.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.398+0000 7fef2e000700 1 --2- 172.21.15.2:0/1642723808 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fef18039150 0x7fef1803b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:10.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.398+0000 7fef2e000700 1 -- 172.21.15.2:0/1642723808 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fef2401e070 con 0x7fef30107d90 2024-06-13T02:05:10.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.398+0000 7fef35000700 1 --2- 172.21.15.2:0/1642723808 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fef18039150 0x7fef1803b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:10.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.399+0000 7fef35000700 1 --2- 172.21.15.2:0/1642723808 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fef18039150 0x7fef1803b610 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fef1c006fd0 tx=0x7fef1c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:10.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.404+0000 7fef2e000700 1 -- 172.21.15.2:0/1642723808 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fef24013070 con 0x7fef30107d90 2024-06-13T02:05:10.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:10 smithi002 ceph-mon[31960]: Updating smithi175:/etc/ceph/ceph.conf 2024-06-13T02:05:10.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:10 smithi002 ceph-mon[31960]: Updating smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:10.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:10 smithi002 ceph-mon[31960]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:05:10.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:10.648+0000 7fef36e00700 1 -- 172.21.15.2:0/1642723808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fef30102240 con 0x7fef30107d90 2024-06-13T02:05:11.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:11.612+0000 7fef2e000700 1 -- 172.21.15.2:0/1642723808 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fef24030090 con 0x7fef30107d90 2024-06-13T02:05:11.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:11.616+0000 7fef36e00700 1 -- 172.21.15.2:0/1642723808 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fef18039150 msgr2=0x7fef1803b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:11.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:11.616+0000 7fef36e00700 1 --2- 172.21.15.2:0/1642723808 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fef18039150 0x7fef1803b610 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fef1c006fd0 tx=0x7fef1c006e40 comp rx=0 tx=0).stop 2024-06-13T02:05:11.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:11.616+0000 7fef36e00700 1 -- 172.21.15.2:0/1642723808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef30107d90 msgr2=0x7fef30100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:11.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:11.616+0000 7fef36e00700 1 --2- 172.21.15.2:0/1642723808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef30107d90 0x7fef30100d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef24005850 tx=0x7fef24005030 comp rx=0 tx=0).stop 2024-06-13T02:05:11.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:11.616+0000 7fef36e00700 1 -- 172.21.15.2:0/1642723808 shutdown_connections 2024-06-13T02:05:11.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:11.616+0000 7fef36e00700 1 --2- 172.21.15.2:0/1642723808 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fef18039150 0x7fef1803b610 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:11.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:11.616+0000 7fef36e00700 1 --2- 172.21.15.2:0/1642723808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef30107d90 0x7fef30100d10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:11.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:11.616+0000 7fef36e00700 1 -- 172.21.15.2:0/1642723808 >> 172.21.15.2:0/1642723808 conn(0x7fef30076740 msgr2=0x7fef300fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:11.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:11.616+0000 7fef36e00700 1 -- 172.21.15.2:0/1642723808 shutdown_connections 2024-06-13T02:05:11.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:11.617+0000 7fef36e00700 1 -- 172.21.15.2:0/1642723808 wait complete. 2024-06-13T02:05:11.619 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-06-13T02:05:11.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:11 smithi002 ceph-mon[31960]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:11.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:11 smithi002 ceph-mon[31960]: Updating smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:05:11.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:11.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:11.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:11.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:11 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1642723808' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-13T02:05:12.365 INFO:tasks.cephadm:Adding mon.a on smithi002 2024-06-13T02:05:12.366 INFO:tasks.cephadm:Adding mon.b on smithi084 2024-06-13T02:05:12.366 INFO:tasks.cephadm:Adding mon.c on smithi175 2024-06-13T02:05:12.366 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch apply mon '3;smithi002:172.21.15.2=a;smithi084:172.21.15.84=b;smithi175:172.21.15.175=c' 2024-06-13T02:05:12.600 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:12.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:12 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1642723808' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-13T02:05:12.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:12 smithi002 ceph-mon[31960]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T02:05:13.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:13 smithi002 ceph-mon[31960]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.977+0000 7f7a105b6700 1 -- 172.21.15.175:0/4041686170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a08100fe0 msgr2=0x7f7a081013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.977+0000 7f7a105b6700 1 --2- 172.21.15.175:0/4041686170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a08100fe0 0x7f7a081013c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009910 tx=0x7f79f8009c20 comp rx=0 tx=0).stop 2024-06-13T02:05:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.977+0000 7f7a105b6700 1 -- 172.21.15.175:0/4041686170 shutdown_connections 2024-06-13T02:05:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.977+0000 7f7a105b6700 1 --2- 172.21.15.175:0/4041686170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a08100fe0 0x7f7a081013c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.977+0000 7f7a105b6700 1 -- 172.21.15.175:0/4041686170 >> 172.21.15.175:0/4041686170 conn(0x7f7a080fc890 msgr2=0x7f7a080fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.977+0000 7f7a105b6700 1 -- 172.21.15.175:0/4041686170 shutdown_connections 2024-06-13T02:05:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.977+0000 7f7a105b6700 1 -- 172.21.15.175:0/4041686170 wait complete. 2024-06-13T02:05:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.978+0000 7f7a105b6700 1 Processor -- start 2024-06-13T02:05:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.978+0000 7f7a105b6700 1 -- start start 2024-06-13T02:05:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.978+0000 7f7a105b6700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a08100fe0 0x7f7a0819f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:13.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.978+0000 7f7a105b6700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0810b3b0 con 0x7f7a08100fe0 2024-06-13T02:05:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.978+0000 7f7a0e352700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a08100fe0 0x7f7a0819f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.979+0000 7f7a0e352700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a08100fe0 0x7f7a0819f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.175:52432/0 (socket says 172.21.15.175:52432) 2024-06-13T02:05:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.979+0000 7f7a0e352700 1 -- 172.21.15.175:0/2395701255 learned_addr learned my addr 172.21.15.175:0/2395701255 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-06-13T02:05:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.979+0000 7f7a0e352700 1 -- 172.21.15.175:0/2395701255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0819fd70 con 0x7f7a08100fe0 2024-06-13T02:05:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.979+0000 7f7a0e352700 1 --2- 172.21.15.175:0/2395701255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a08100fe0 0x7f7a0819f830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f79f8005850 tx=0x7f79f8005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.980+0000 7f79ff7fe700 1 -- 172.21.15.175:0/2395701255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79f8026070 con 0x7f7a08100fe0 2024-06-13T02:05:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.980+0000 7f7a105b6700 1 -- 172.21.15.175:0/2395701255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a081a0060 con 0x7f7a08100fe0 2024-06-13T02:05:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.980+0000 7f7a105b6700 1 -- 172.21.15.175:0/2395701255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a081999f0 con 0x7f7a08100fe0 2024-06-13T02:05:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.980+0000 7f79ff7fe700 1 -- 172.21.15.175:0/2395701255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79f800bbd0 con 0x7f7a08100fe0 2024-06-13T02:05:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.980+0000 7f79ff7fe700 1 -- 172.21.15.175:0/2395701255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79f8030060 con 0x7f7a08100fe0 2024-06-13T02:05:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.981+0000 7f7a105b6700 1 -- 172.21.15.175:0/2395701255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ec005330 con 0x7f7a08100fe0 2024-06-13T02:05:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.981+0000 7f79ff7fe700 1 -- 172.21.15.175:0/2395701255 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f79f8029070 con 0x7f7a08100fe0 2024-06-13T02:05:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.981+0000 7f79ff7fe700 1 --2- 172.21.15.175:0/2395701255 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f79f40390f0 0x7f79f403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.982+0000 7f79ff7fe700 1 -- 172.21.15.175:0/2395701255 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f79f801e070 con 0x7f7a08100fe0 2024-06-13T02:05:13.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.982+0000 7f7a0db51700 1 --2- 172.21.15.175:0/2395701255 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f79f40390f0 0x7f79f403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:13.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.983+0000 7f7a0db51700 1 --2- 172.21.15.175:0/2395701255 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f79f40390f0 0x7f79f403b5b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7a04006fd0 tx=0x7f7a04006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:13.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:13.998+0000 7f79ff7fe700 1 -- 172.21.15.175:0/2395701255 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f79f8013070 con 0x7f7a08100fe0 2024-06-13T02:05:14.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:14.209+0000 7f7a105b6700 1 -- 172.21.15.175:0/2395701255 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi084:172.21.15.84=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}) -- 0x7f79ec000c70 con 0x7f79f40390f0 2024-06-13T02:05:14.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:14.224+0000 7f79ff7fe700 1 -- 172.21.15.175:0/2395701255 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f79ec000c70 con 0x7f79f40390f0 2024-06-13T02:05:14.225 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mon update... 2024-06-13T02:05:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:14.226+0000 7f7a105b6700 1 -- 172.21.15.175:0/2395701255 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f79f40390f0 msgr2=0x7f79f403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:14.226+0000 7f7a105b6700 1 --2- 172.21.15.175:0/2395701255 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f79f40390f0 0x7f79f403b5b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7a04006fd0 tx=0x7f7a04006e40 comp rx=0 tx=0).stop 2024-06-13T02:05:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:14.226+0000 7f7a105b6700 1 -- 172.21.15.175:0/2395701255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a08100fe0 msgr2=0x7f7a0819f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:14.226+0000 7f7a105b6700 1 --2- 172.21.15.175:0/2395701255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a08100fe0 0x7f7a0819f830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f79f8005850 tx=0x7f79f8005030 comp rx=0 tx=0).stop 2024-06-13T02:05:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:14.226+0000 7f7a105b6700 1 -- 172.21.15.175:0/2395701255 shutdown_connections 2024-06-13T02:05:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:14.226+0000 7f7a105b6700 1 --2- 172.21.15.175:0/2395701255 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f79f40390f0 0x7f79f403b5b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:14.226+0000 7f7a105b6700 1 --2- 172.21.15.175:0/2395701255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a08100fe0 0x7f7a0819f830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:14.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:14.226+0000 7f7a105b6700 1 -- 172.21.15.175:0/2395701255 >> 172.21.15.175:0/2395701255 conn(0x7f7a080fc890 msgr2=0x7f7a0806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:14.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:14.226+0000 7f7a105b6700 1 -- 172.21.15.175:0/2395701255 shutdown_connections 2024-06-13T02:05:14.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:14.226+0000 7f7a105b6700 1 -- 172.21.15.175:0/2395701255 wait complete. 2024-06-13T02:05:14.860 DEBUG:teuthology.orchestra.run.smithi084:mon.b> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mon.b.service 2024-06-13T02:05:14.862 DEBUG:teuthology.orchestra.run.smithi175:mon.c> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mon.c.service 2024-06-13T02:05:14.865 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-13T02:05:14.865 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph mon dump -f json 2024-06-13T02:05:15.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:15 smithi002 ceph-mon[31960]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi084:172.21.15.84=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:05:15.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:15 smithi002 ceph-mon[31960]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi084:172.21.15.84=b;smithi175:172.21.15.175=c;count:3 2024-06-13T02:05:15.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:15 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:15.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:15 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:15.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:15 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:15.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:15 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:15.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:15 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:15.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:15 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T02:05:15.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:15 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:15.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:15 smithi002 ceph-mon[31960]: Deploying daemon mon.c on smithi175 2024-06-13T02:05:15.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:15 smithi002 ceph-mon[31960]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:16.534 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:17.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:17 smithi002 ceph-mon[31960]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:18.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:17 smithi175 systemd[1]: Starting Ceph mon.c for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:05:18.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.648+0000 7f1c376d0700 1 -- 172.21.15.175:0/3996962177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c301030a0 msgr2=0x7f1c30103480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:18.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.648+0000 7f1c376d0700 1 --2- 172.21.15.175:0/3996962177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c301030a0 0x7f1c30103480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800b0a0 tx=0x7f1c2800b3b0 comp rx=0 tx=0).stop 2024-06-13T02:05:18.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.648+0000 7f1c376d0700 1 -- 172.21.15.175:0/3996962177 shutdown_connections 2024-06-13T02:05:18.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.648+0000 7f1c376d0700 1 --2- 172.21.15.175:0/3996962177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c301030a0 0x7f1c30103480 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:18.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.648+0000 7f1c376d0700 1 -- 172.21.15.175:0/3996962177 >> 172.21.15.175:0/3996962177 conn(0x7f1c300fc8f0 msgr2=0x7f1c300fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:18.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.649+0000 7f1c376d0700 1 -- 172.21.15.175:0/3996962177 shutdown_connections 2024-06-13T02:05:18.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.649+0000 7f1c376d0700 1 -- 172.21.15.175:0/3996962177 wait complete. 2024-06-13T02:05:18.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.649+0000 7f1c376d0700 1 Processor -- start 2024-06-13T02:05:18.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.649+0000 7f1c376d0700 1 -- start start 2024-06-13T02:05:18.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.649+0000 7f1c376d0700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c301030a0 0x7f1c3019fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:18.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.649+0000 7f1c376d0700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1c30101af0 con 0x7f1c301030a0 2024-06-13T02:05:18.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.650+0000 7f1c3546c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c301030a0 0x7f1c3019fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:18.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.650+0000 7f1c3546c700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c301030a0 0x7f1c3019fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.175:54188/0 (socket says 172.21.15.175:54188) 2024-06-13T02:05:18.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.650+0000 7f1c3546c700 1 -- 172.21.15.175:0/995919747 learned_addr learned my addr 172.21.15.175:0/995919747 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-06-13T02:05:18.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.651+0000 7f1c3546c700 1 -- 172.21.15.175:0/995919747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3019ffc0 con 0x7f1c301030a0 2024-06-13T02:05:18.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.651+0000 7f1c3546c700 1 --2- 172.21.15.175:0/995919747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c301030a0 0x7f1c3019fa80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1c280062a0 tx=0x7f1c2800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:18.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.651+0000 7f1c2e7fc700 1 -- 172.21.15.175:0/995919747 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c28017050 con 0x7f1c301030a0 2024-06-13T02:05:18.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.652+0000 7f1c376d0700 1 -- 172.21.15.175:0/995919747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c301a0250 con 0x7f1c301030a0 2024-06-13T02:05:18.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.652+0000 7f1c2e7fc700 1 -- 172.21.15.175:0/995919747 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c28023070 con 0x7f1c301030a0 2024-06-13T02:05:18.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.652+0000 7f1c2e7fc700 1 -- 172.21.15.175:0/995919747 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c28004000 con 0x7f1c301030a0 2024-06-13T02:05:18.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.652+0000 7f1c376d0700 1 -- 172.21.15.175:0/995919747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c30199a80 con 0x7f1c301030a0 2024-06-13T02:05:18.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.653+0000 7f1c376d0700 1 -- 172.21.15.175:0/995919747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c3006abe0 con 0x7f1c301030a0 2024-06-13T02:05:18.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.653+0000 7f1c2e7fc700 1 -- 172.21.15.175:0/995919747 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f1c2801e450 con 0x7f1c301030a0 2024-06-13T02:05:18.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.653+0000 7f1c2e7fc700 1 --2- 172.21.15.175:0/995919747 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1c180390f0 0x7f1c1803b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:18.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.653+0000 7f1c2e7fc700 1 -- 172.21.15.175:0/995919747 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1c2800f050 con 0x7f1c301030a0 2024-06-13T02:05:18.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.654+0000 7f1c34c6b700 1 --2- 172.21.15.175:0/995919747 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1c180390f0 0x7f1c1803b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:18.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.655+0000 7f1c34c6b700 1 --2- 172.21.15.175:0/995919747 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1c180390f0 0x7f1c1803b5b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1c24006fd0 tx=0x7f1c24006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:18.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.669+0000 7f1c2e7fc700 1 -- 172.21.15.175:0/995919747 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1c28026bb0 con 0x7f1c301030a0 2024-06-13T02:05:18.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.950+0000 7f1c376d0700 1 -- 172.21.15.175:0/995919747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f1c30063af0 con 0x7f1c301030a0 2024-06-13T02:05:18.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.951+0000 7f1c2e7fc700 1 -- 172.21.15.175:0/995919747 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f1c28008cb0 con 0x7f1c301030a0 2024-06-13T02:05:18.952 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:05:18.953 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":1,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","modified":"2024-06-13T02:03:12.349818Z","created":"2024-06-13T02:03:12.349818Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-13T02:05:18.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.953+0000 7f1c376d0700 1 -- 172.21.15.175:0/995919747 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1c180390f0 msgr2=0x7f1c1803b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:18.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.953+0000 7f1c376d0700 1 --2- 172.21.15.175:0/995919747 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1c180390f0 0x7f1c1803b5b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1c24006fd0 tx=0x7f1c24006e40 comp rx=0 tx=0).stop 2024-06-13T02:05:18.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.953+0000 7f1c376d0700 1 -- 172.21.15.175:0/995919747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c301030a0 msgr2=0x7f1c3019fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:18.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.953+0000 7f1c376d0700 1 --2- 172.21.15.175:0/995919747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c301030a0 0x7f1c3019fa80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1c280062a0 tx=0x7f1c2800bdd0 comp rx=0 tx=0).stop 2024-06-13T02:05:18.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.953+0000 7f1c376d0700 1 -- 172.21.15.175:0/995919747 shutdown_connections 2024-06-13T02:05:18.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.953+0000 7f1c376d0700 1 --2- 172.21.15.175:0/995919747 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1c180390f0 0x7f1c1803b5b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:18.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.953+0000 7f1c376d0700 1 --2- 172.21.15.175:0/995919747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c301030a0 0x7f1c3019fa80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:18.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.953+0000 7f1c376d0700 1 -- 172.21.15.175:0/995919747 >> 172.21.15.175:0/995919747 conn(0x7f1c300fc8f0 msgr2=0x7f1c300fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:18.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.953+0000 7f1c376d0700 1 -- 172.21.15.175:0/995919747 shutdown_connections 2024-06-13T02:05:18.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:18.953+0000 7f1c376d0700 1 -- 172.21.15.175:0/995919747 wait complete. 2024-06-13T02:05:18.955 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 1 2024-06-13T02:05:18.984 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 podman[36936]: 2024-06-13 02:05:18.727311999 +0000 UTC m=+0.091301229 container create bc7859d039529d1e5cb2954b63128eee1da243252cdfeada721066ebb7987351 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-c, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS) 2024-06-13T02:05:18.984 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 podman[36936]: 2024-06-13 02:05:18.654203329 +0000 UTC m=+0.018192575 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:05:18.984 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 podman[36936]: 2024-06-13 02:05:18.954653387 +0000 UTC m=+0.318642635 container init bc7859d039529d1e5cb2954b63128eee1da243252cdfeada721066ebb7987351 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T02:05:18.985 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 podman[36936]: 2024-06-13 02:05:18.958028618 +0000 UTC m=+0.322017849 container start bc7859d039529d1e5cb2954b63128eee1da243252cdfeada721066ebb7987351 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-06-13T02:05:18.985 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: set uid:gid to 167:167 (ceph:ceph) 2024-06-13T02:05:18.985 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc), process ceph-mon, pid 2 2024-06-13T02:05:18.985 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: pidfile_write: ignore empty --pid-file 2024-06-13T02:05:19.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: load: jerasure load: lrc 2024-06-13T02:05:19.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: RocksDB version: 7.9.2 2024-06-13T02:05:19.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Git sha 0 2024-06-13T02:05:19.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Compile date 2024-05-30 15:42:47 2024-06-13T02:05:19.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: DB SUMMARY 2024-06-13T02:05:19.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: DB Session ID: 3KCXDNT9JAFRTPMUV2G1 2024-06-13T02:05:19.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: CURRENT file: CURRENT 2024-06-13T02:05:19.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: IDENTITY file: IDENTITY 2024-06-13T02:05:19.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-06-13T02:05:19.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-06-13T02:05:19.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-06-13T02:05:19.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.error_if_exists: 0 2024-06-13T02:05:19.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.create_if_missing: 0 2024-06-13T02:05:19.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.paranoid_checks: 1 2024-06-13T02:05:19.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-13T02:05:19.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-13T02:05:19.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-13T02:05:19.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.env: 0x55a396f22c60 2024-06-13T02:05:19.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.fs: PosixFileSystem 2024-06-13T02:05:19.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.info_log: 0x55a397ebbb20 2024-06-13T02:05:19.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_file_opening_threads: 16 2024-06-13T02:05:19.285 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.statistics: (nil) 2024-06-13T02:05:19.285 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.use_fsync: 0 2024-06-13T02:05:19.285 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_log_file_size: 0 2024-06-13T02:05:19.285 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-13T02:05:19.285 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-13T02:05:19.285 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.keep_log_file_num: 1000 2024-06-13T02:05:19.285 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.recycle_log_file_num: 0 2024-06-13T02:05:19.285 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.allow_fallocate: 1 2024-06-13T02:05:19.285 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.allow_mmap_reads: 0 2024-06-13T02:05:19.285 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.allow_mmap_writes: 0 2024-06-13T02:05:19.285 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.use_direct_reads: 0 2024-06-13T02:05:19.285 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-13T02:05:19.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.create_missing_column_families: 0 2024-06-13T02:05:19.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.db_log_dir: 2024-06-13T02:05:19.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.wal_dir: 2024-06-13T02:05:19.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-13T02:05:19.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-13T02:05:19.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-13T02:05:19.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-13T02:05:19.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-13T02:05:19.286 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-13T02:05:19.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.advise_random_on_open: 1 2024-06-13T02:05:19.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.db_write_buffer_size: 0 2024-06-13T02:05:19.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.write_buffer_manager: 0x55a397e8c1e0 2024-06-13T02:05:19.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-13T02:05:19.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-13T02:05:19.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-13T02:05:19.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.rate_limiter: (nil) 2024-06-13T02:05:19.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-13T02:05:19.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.wal_recovery_mode: 2 2024-06-13T02:05:19.287 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.enable_thread_tracking: 0 2024-06-13T02:05:19.288 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.enable_pipelined_write: 0 2024-06-13T02:05:19.288 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.unordered_write: 0 2024-06-13T02:05:19.288 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-13T02:05:19.288 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-13T02:05:19.288 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-13T02:05:19.288 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-13T02:05:19.288 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.row_cache: None 2024-06-13T02:05:19.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.wal_filter: None 2024-06-13T02:05:19.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-13T02:05:19.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.allow_ingest_behind: 0 2024-06-13T02:05:19.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.two_write_queues: 0 2024-06-13T02:05:19.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.manual_wal_flush: 0 2024-06-13T02:05:19.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.wal_compression: 0 2024-06-13T02:05:19.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.atomic_flush: 0 2024-06-13T02:05:19.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-13T02:05:19.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-13T02:05:19.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-13T02:05:19.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.log_readahead_size: 0 2024-06-13T02:05:19.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-13T02:05:19.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.best_efforts_recovery: 0 2024-06-13T02:05:19.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-13T02:05:19.291 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-13T02:05:19.291 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.allow_data_in_errors: 0 2024-06-13T02:05:19.291 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.db_host_id: __hostname__ 2024-06-13T02:05:19.291 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-13T02:05:19.291 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_background_jobs: 2 2024-06-13T02:05:19.291 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_background_compactions: -1 2024-06-13T02:05:19.291 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_subcompactions: 1 2024-06-13T02:05:19.294 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-13T02:05:19.294 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-13T02:05:19.294 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-13T02:05:19.294 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_total_wal_size: 0 2024-06-13T02:05:19.294 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-13T02:05:19.295 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-13T02:05:19.295 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-13T02:05:19.295 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-13T02:05:19.295 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_open_files: -1 2024-06-13T02:05:19.295 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.bytes_per_sync: 0 2024-06-13T02:05:19.295 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-13T02:05:19.295 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-13T02:05:19.296 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compaction_readahead_size: 0 2024-06-13T02:05:19.296 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_background_flushes: -1 2024-06-13T02:05:19.296 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Compression algorithms supported: 2024-06-13T02:05:19.296 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-13T02:05:19.296 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: kZSTD supported: 0 2024-06-13T02:05:19.296 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: kXpressCompression supported: 0 2024-06-13T02:05:19.296 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: kLZ4HCCompression supported: 1 2024-06-13T02:05:19.297 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: kZlibCompression supported: 1 2024-06-13T02:05:19.297 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: kSnappyCompression supported: 1 2024-06-13T02:05:19.297 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: kLZ4Compression supported: 1 2024-06-13T02:05:19.297 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: kBZip2Compression supported: 0 2024-06-13T02:05:19.297 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-13T02:05:19.297 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-13T02:05:19.297 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-06-13T02:05:19.298 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-13T02:05:19.298 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-13T02:05:19.298 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.merge_operator: 2024-06-13T02:05:19.298 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compaction_filter: None 2024-06-13T02:05:19.298 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compaction_filter_factory: None 2024-06-13T02:05:19.299 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.sst_partitioner_factory: None 2024-06-13T02:05:19.299 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-13T02:05:19.299 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-13T02:05:19.299 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a397ebbc40) 2024-06-13T02:05:19.299 INFO:journalctl@ceph.mon.c.smithi175.stdout: cache_index_and_filter_blocks: 1 2024-06-13T02:05:19.299 INFO:journalctl@ceph.mon.c.smithi175.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-13T02:05:19.299 INFO:journalctl@ceph.mon.c.smithi175.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-13T02:05:19.300 INFO:journalctl@ceph.mon.c.smithi175.stdout: pin_top_level_index_and_filter: 1 2024-06-13T02:05:19.300 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_type: 0 2024-06-13T02:05:19.300 INFO:journalctl@ceph.mon.c.smithi175.stdout: data_block_index_type: 0 2024-06-13T02:05:19.300 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_shortening: 1 2024-06-13T02:05:19.300 INFO:journalctl@ceph.mon.c.smithi175.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-13T02:05:19.300 INFO:journalctl@ceph.mon.c.smithi175.stdout: checksum: 4 2024-06-13T02:05:19.300 INFO:journalctl@ceph.mon.c.smithi175.stdout: no_block_cache: 0 2024-06-13T02:05:19.301 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache: 0x55a397ebd090 2024-06-13T02:05:19.301 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_name: BinnedLRUCache 2024-06-13T02:05:19.301 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_options: 2024-06-13T02:05:19.301 INFO:journalctl@ceph.mon.c.smithi175.stdout: capacity : 536870912 2024-06-13T02:05:19.301 INFO:journalctl@ceph.mon.c.smithi175.stdout: num_shard_bits : 4 2024-06-13T02:05:19.301 INFO:journalctl@ceph.mon.c.smithi175.stdout: strict_capacity_limit : 0 2024-06-13T02:05:19.301 INFO:journalctl@ceph.mon.c.smithi175.stdout: high_pri_pool_ratio: 0.000 2024-06-13T02:05:19.301 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_cache_compressed: (nil) 2024-06-13T02:05:19.302 INFO:journalctl@ceph.mon.c.smithi175.stdout: persistent_cache: (nil) 2024-06-13T02:05:19.302 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_size: 4096 2024-06-13T02:05:19.302 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_size_deviation: 10 2024-06-13T02:05:19.302 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_restart_interval: 16 2024-06-13T02:05:19.302 INFO:journalctl@ceph.mon.c.smithi175.stdout: index_block_restart_interval: 1 2024-06-13T02:05:19.302 INFO:journalctl@ceph.mon.c.smithi175.stdout: metadata_block_size: 4096 2024-06-13T02:05:19.302 INFO:journalctl@ceph.mon.c.smithi175.stdout: partition_filters: 0 2024-06-13T02:05:19.303 INFO:journalctl@ceph.mon.c.smithi175.stdout: use_delta_encoding: 1 2024-06-13T02:05:19.303 INFO:journalctl@ceph.mon.c.smithi175.stdout: filter_policy: bloomfilter 2024-06-13T02:05:19.303 INFO:journalctl@ceph.mon.c.smithi175.stdout: whole_key_filtering: 1 2024-06-13T02:05:19.303 INFO:journalctl@ceph.mon.c.smithi175.stdout: verify_compression: 0 2024-06-13T02:05:19.303 INFO:journalctl@ceph.mon.c.smithi175.stdout: read_amp_bytes_per_bit: 0 2024-06-13T02:05:19.303 INFO:journalctl@ceph.mon.c.smithi175.stdout: format_version: 5 2024-06-13T02:05:19.303 INFO:journalctl@ceph.mon.c.smithi175.stdout: enable_index_compression: 1 2024-06-13T02:05:19.304 INFO:journalctl@ceph.mon.c.smithi175.stdout: block_align: 0 2024-06-13T02:05:19.304 INFO:journalctl@ceph.mon.c.smithi175.stdout: max_auto_readahead_size: 262144 2024-06-13T02:05:19.304 INFO:journalctl@ceph.mon.c.smithi175.stdout: prepopulate_block_cache: 0 2024-06-13T02:05:19.304 INFO:journalctl@ceph.mon.c.smithi175.stdout: initial_auto_readahead_size: 8192 2024-06-13T02:05:19.304 INFO:journalctl@ceph.mon.c.smithi175.stdout: num_file_reads_for_auto_readahead: 2 2024-06-13T02:05:19.304 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.write_buffer_size: 33554432 2024-06-13T02:05:19.304 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_write_buffer_number: 2 2024-06-13T02:05:19.304 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compression: NoCompression 2024-06-13T02:05:19.304 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.bottommost_compression: Disabled 2024-06-13T02:05:19.304 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.prefix_extractor: nullptr 2024-06-13T02:05:19.304 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-13T02:05:19.304 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.num_levels: 7 2024-06-13T02:05:19.305 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-13T02:05:19.305 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-13T02:05:19.305 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-13T02:05:19.305 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-13T02:05:19.305 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-13T02:05:19.305 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-13T02:05:19.305 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-13T02:05:19.305 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-13T02:05:19.306 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-13T02:05:19.306 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-13T02:05:19.306 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-13T02:05:19.306 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-13T02:05:19.306 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-13T02:05:19.306 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compression_opts.level: 32767 2024-06-13T02:05:19.306 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compression_opts.strategy: 0 2024-06-13T02:05:19.307 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-13T02:05:19.307 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-13T02:05:19.307 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-13T02:05:19.307 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-13T02:05:19.307 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compression_opts.enabled: false 2024-06-13T02:05:19.307 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-13T02:05:19.307 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-13T02:05:19.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-13T02:05:19.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-13T02:05:19.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.target_file_size_base: 67108864 2024-06-13T02:05:19.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-13T02:05:19.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-13T02:05:19.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-13T02:05:19.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-13T02:05:19.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-13T02:05:19.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-13T02:05:19.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-13T02:05:19.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-13T02:05:19.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-13T02:05:19.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-13T02:05:19.308 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-13T02:05:19.309 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-13T02:05:19.309 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-13T02:05:19.309 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-13T02:05:19.309 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.arena_block_size: 1048576 2024-06-13T02:05:19.309 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-13T02:05:19.309 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-13T02:05:19.309 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.disable_auto_compactions: 0 2024-06-13T02:05:19.309 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-13T02:05:19.309 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-13T02:05:19.309 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-13T02:05:19.309 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-13T02:05:19.309 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-13T02:05:19.309 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-13T02:05:19.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-13T02:05:19.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-13T02:05:19.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-13T02:05:19.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-13T02:05:19.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.table_properties_collectors: 2024-06-13T02:05:19.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.inplace_update_support: 0 2024-06-13T02:05:19.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-13T02:05:19.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-13T02:05:19.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-13T02:05:19.310 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-13T02:05:19.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.bloom_locality: 0 2024-06-13T02:05:19.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.max_successive_merges: 0 2024-06-13T02:05:19.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-13T02:05:19.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.paranoid_file_checks: 0 2024-06-13T02:05:19.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.force_consistency_checks: 1 2024-06-13T02:05:19.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.report_bg_io_stats: 0 2024-06-13T02:05:19.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.ttl: 2592000 2024-06-13T02:05:19.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-13T02:05:19.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-13T02:05:19.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-13T02:05:19.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.enable_blob_files: false 2024-06-13T02:05:19.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.min_blob_size: 0 2024-06-13T02:05:19.311 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.blob_file_size: 268435456 2024-06-13T02:05:19.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-13T02:05:19.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-13T02:05:19.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-13T02:05:19.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-13T02:05:19.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-13T02:05:19.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.blob_file_starting_level: 0 2024-06-13T02:05:19.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-13T02:05:19.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-13T02:05:19.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-06-13T02:05:19.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7da1d6f7-adc2-4388-b0dc-e21820926775 2024-06-13T02:05:19.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718244318990035, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-06-13T02:05:19.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-06-13T02:05:19.312 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718244318990439, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1718244318, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7da1d6f7-adc2-4388-b0dc-e21820926775", "db_session_id": "3KCXDNT9JAFRTPMUV2G1", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-06-13T02:05:19.313 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: EVENT_LOG_v1 {"time_micros": 1718244318990518, "job": 1, "event": "recovery_finished"} 2024-06-13T02:05:19.313 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-06-13T02:05:19.313 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-13T02:05:19.313 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a397fac000 2024-06-13T02:05:19.313 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: DB pointer 0x55a397f96000 2024-06-13T02:05:19.313 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-13T02:05:19.313 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-13T02:05:19.313 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** DB Stats ** 2024-06-13T02:05:19.313 INFO:journalctl@ceph.mon.c.smithi175.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-13T02:05:19.313 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-13T02:05:19.313 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-13T02:05:19.313 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-13T02:05:19.313 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-13T02:05:19.313 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-13T02:05:19.314 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-13T02:05:19.314 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-06-13T02:05:19.314 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** Compaction Stats [default] ** 2024-06-13T02:05:19.314 INFO:journalctl@ceph.mon.c.smithi175.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-13T02:05:19.314 INFO:journalctl@ceph.mon.c.smithi175.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-13T02:05:19.314 INFO:journalctl@ceph.mon.c.smithi175.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-13T02:05:19.314 INFO:journalctl@ceph.mon.c.smithi175.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-13T02:05:19.314 INFO:journalctl@ceph.mon.c.smithi175.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-13T02:05:19.314 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-06-13T02:05:19.314 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** Compaction Stats [default] ** 2024-06-13T02:05:19.314 INFO:journalctl@ceph.mon.c.smithi175.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-13T02:05:19.314 INFO:journalctl@ceph.mon.c.smithi175.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-13T02:05:19.315 INFO:journalctl@ceph.mon.c.smithi175.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-06-13T02:05:19.315 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-06-13T02:05:19.315 INFO:journalctl@ceph.mon.c.smithi175.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-13T02:05:19.315 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-06-13T02:05:19.315 INFO:journalctl@ceph.mon.c.smithi175.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-13T02:05:19.315 INFO:journalctl@ceph.mon.c.smithi175.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-13T02:05:19.315 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-13T02:05:19.315 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-13T02:05:19.315 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-13T02:05:19.315 INFO:journalctl@ceph.mon.c.smithi175.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-13T02:05:19.315 INFO:journalctl@ceph.mon.c.smithi175.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-13T02:05:19.315 INFO:journalctl@ceph.mon.c.smithi175.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-13T02:05:19.315 INFO:journalctl@ceph.mon.c.smithi175.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-13T02:05:19.316 INFO:journalctl@ceph.mon.c.smithi175.stdout: Block cache BinnedLRUCache@0x55a397ebd090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-06-13T02:05:19.316 INFO:journalctl@ceph.mon.c.smithi175.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-06-13T02:05:19.316 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-06-13T02:05:19.316 INFO:journalctl@ceph.mon.c.smithi175.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-13T02:05:19.316 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-06-13T02:05:19.316 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: using public_addr v2:172.21.15.175:0/0 -> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] 2024-06-13T02:05:19.316 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: starting mon.c rank -1 at public addrs [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] at bind addrs [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:05:19.316 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:18 smithi175 ceph-mon[36977]: mon.c@-1(???) e0 preinit fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:05:19.316 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: mon.c@-1(synchronizing).mds e1 new map 2024-06-13T02:05:19.316 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: mon.c@-1(synchronizing).mds e1 print_map 2024-06-13T02:05:19.316 INFO:journalctl@ceph.mon.c.smithi175.stdout: e1 2024-06-13T02:05:19.316 INFO:journalctl@ceph.mon.c.smithi175.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-13T02:05:19.316 INFO:journalctl@ceph.mon.c.smithi175.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-13T02:05:19.316 INFO:journalctl@ceph.mon.c.smithi175.stdout: legacy client fscid: -1 2024-06-13T02:05:19.317 INFO:journalctl@ceph.mon.c.smithi175.stdout: 2024-06-13T02:05:19.317 INFO:journalctl@ceph.mon.c.smithi175.stdout: No filesystems configured 2024-06-13T02:05:19.317 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-06-13T02:05:19.317 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-06-13T02:05:19.317 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-06-13T02:05:19.317 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-06-13T02:05:19.317 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-06-13T02:05:19.317 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-06-13T02:05:19.317 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-13T02:05:19.317 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T02:05:19.317 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T02:05:19.317 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T02:05:19.317 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: Added host smithi084 2024-06-13T02:05:19.317 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.318 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.318 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:19.318 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:19.318 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.318 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:05:19.318 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:19.318 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.318 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.318 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.318 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.318 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:05:19.318 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:19.319 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:19.319 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: Updating smithi084:/etc/ceph/ceph.conf 2024-06-13T02:05:19.319 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: Updating smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:19.319 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:05:19.319 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:19.319 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: Updating smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:05:19.319 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:05:19.319 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.319 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.319 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.319 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: Deploying cephadm binary to smithi175 2024-06-13T02:05:19.319 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:19.319 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:19.320 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.320 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:19.320 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: Added host smithi175 2024-06-13T02:05:19.320 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.320 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.320 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:19.320 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.320 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:19.320 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:05:19.320 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:19.320 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.320 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.320 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.320 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.320 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:05:19.321 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:19.321 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:19.321 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: Updating smithi175:/etc/ceph/ceph.conf 2024-06-13T02:05:19.321 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: Updating smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:19.321 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:05:19.321 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:19.321 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: Updating smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:05:19.321 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.321 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.321 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.321 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1642723808' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-13T02:05:19.321 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1642723808' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-13T02:05:19.321 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T02:05:19.321 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:19.322 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi084:172.21.15.84=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:05:19.322 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi084:172.21.15.84=b;smithi175:172.21.15.175=c;count:3 2024-06-13T02:05:19.322 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.322 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:19.322 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:19.322 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:19.322 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:19.323 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T02:05:19.323 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:19.323 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: Deploying daemon mon.c on smithi175 2024-06-13T02:05:19.323 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:19.323 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:19.323 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 ceph-mon[36977]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-13T02:05:19.324 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 bash[36936]: bc7859d039529d1e5cb2954b63128eee1da243252cdfeada721066ebb7987351 2024-06-13T02:05:19.324 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:19 smithi175 systemd[1]: Started Ceph mon.c for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:05:20.669 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-13T02:05:20.669 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph mon dump -f json 2024-06-13T02:05:20.911 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:05:24.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:24.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:05:24.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: mon.a calling monitor election 2024-06-13T02:05:24.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:24.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:24.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:24.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:24.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: mon.c calling monitor election 2024-06-13T02:05:24.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:24.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:24.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:24.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:24.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-13T02:05:24.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: monmap epoch 2 2024-06-13T02:05:24.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:05:24.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: last_changed 2024-06-13T02:05:19.026151+0000 2024-06-13T02:05:24.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: created 2024-06-13T02:03:12.349818+0000 2024-06-13T02:05:24.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: min_mon_release 19 (squid) 2024-06-13T02:05:24.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: election_strategy: 1 2024-06-13T02:05:24.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T02:05:24.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-06-13T02:05:24.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: fsmap 2024-06-13T02:05:24.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T02:05:24.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: mgrmap e13: x(active, since 59s) 2024-06-13T02:05:24.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: overall HEALTH_OK 2024-06-13T02:05:24.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:24.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:24.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:24.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:05:24.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: mon.a calling monitor election 2024-06-13T02:05:24.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:24.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:24.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:24.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:24.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: mon.c calling monitor election 2024-06-13T02:05:24.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:24.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:24.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:24.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:24.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-13T02:05:24.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: monmap epoch 2 2024-06-13T02:05:24.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:05:24.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: last_changed 2024-06-13T02:05:19.026151+0000 2024-06-13T02:05:24.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: created 2024-06-13T02:03:12.349818+0000 2024-06-13T02:05:24.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: min_mon_release 19 (squid) 2024-06-13T02:05:24.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: election_strategy: 1 2024-06-13T02:05:24.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T02:05:24.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-06-13T02:05:24.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: fsmap 2024-06-13T02:05:24.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T02:05:24.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: mgrmap e13: x(active, since 59s) 2024-06-13T02:05:24.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: overall HEALTH_OK 2024-06-13T02:05:24.535 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:24.535 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:25.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.274+0000 7fa2baffd700 1 -- 172.21.15.175:0/2923324832 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa2b0005260 con 0x7fa2bc1010e0 2024-06-13T02:05:25.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.275+0000 7fa2c2529700 1 -- 172.21.15.175:0/2923324832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2bc1010e0 msgr2=0x7fa2a4005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:25.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.275+0000 7fa2c2529700 1 --2- 172.21.15.175:0/2923324832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2bc1010e0 0x7fa2a4005610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0005fa0 tx=0x7fa2b000ffc0 comp rx=0 tx=0).stop 2024-06-13T02:05:25.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.275+0000 7fa2c2529700 1 -- 172.21.15.175:0/2923324832 shutdown_connections 2024-06-13T02:05:25.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.275+0000 7fa2c2529700 1 --2- 172.21.15.175:0/2923324832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2bc1010e0 0x7fa2a4005610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:25.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.275+0000 7fa2c2529700 1 -- 172.21.15.175:0/2923324832 >> 172.21.15.175:0/2923324832 conn(0x7fa2bc0fc970 msgr2=0x7fa2bc0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:25.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.275+0000 7fa2c2529700 1 -- 172.21.15.175:0/2923324832 shutdown_connections 2024-06-13T02:05:25.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.275+0000 7fa2c2529700 1 -- 172.21.15.175:0/2923324832 wait complete. 2024-06-13T02:05:25.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.276+0000 7fa2c2529700 1 Processor -- start 2024-06-13T02:05:25.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.276+0000 7fa2c2529700 1 -- start start 2024-06-13T02:05:25.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.277+0000 7fa2c2529700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2bc1010e0 0x7fa2bc107e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:25.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.277+0000 7fa2c2529700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2bc108370 0x7fa2bc1087f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:25.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.277+0000 7fa2c2529700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc10a0f0 con 0x7fa2bc1010e0 2024-06-13T02:05:25.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.277+0000 7fa2c2529700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc109f70 con 0x7fa2bc108370 2024-06-13T02:05:25.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.277+0000 7fa2bb7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2bc108370 0x7fa2bc1087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:25.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.277+0000 7fa2bb7fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2bc108370 0x7fa2bc1087f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52730/0 (socket says 172.21.15.175:52730) 2024-06-13T02:05:25.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.277+0000 7fa2bb7fe700 1 -- 172.21.15.175:0/1066950437 learned_addr learned my addr 172.21.15.175:0/1066950437 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-06-13T02:05:25.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.277+0000 7fa2bb7fe700 1 -- 172.21.15.175:0/1066950437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2bc108370 msgr2=0x7fa2bc1087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-06-13T02:05:25.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.277+0000 7fa2bb7fe700 1 -- 172.21.15.175:0/1066950437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2bc108370 msgr2=0x7fa2bc1087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-13T02:05:25.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.277+0000 7fa2bb7fe700 1 --2- 172.21.15.175:0/1066950437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2bc108370 0x7fa2bc1087f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T02:05:25.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.277+0000 7fa2bb7fe700 1 --2- 172.21.15.175:0/1066950437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2bc108370 0x7fa2bc1087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T02:05:25.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.277+0000 7fa2bbfff700 1 --2- 172.21.15.175:0/1066950437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2bc1010e0 0x7fa2bc107e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:25.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.278+0000 7fa2bbfff700 1 -- 172.21.15.175:0/1066950437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2bc108370 msgr2=0x7fa2bc1087f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T02:05:25.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.278+0000 7fa2bbfff700 1 --2- 172.21.15.175:0/1066950437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2bc108370 0x7fa2bc1087f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:25.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.278+0000 7fa2bbfff700 1 -- 172.21.15.175:0/1066950437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2bc109d50 con 0x7fa2bc1010e0 2024-06-13T02:05:25.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.278+0000 7fa2bbfff700 1 --2- 172.21.15.175:0/1066950437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2bc1010e0 0x7fa2bc107e30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0000c00 tx=0x7fa2b0004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:25.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.279+0000 7fa2b97fa700 1 -- 172.21.15.175:0/1066950437 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa2b00053b0 con 0x7fa2bc1010e0 2024-06-13T02:05:25.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.279+0000 7fa2c2529700 1 -- 172.21.15.175:0/1066950437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2bc1a3d80 con 0x7fa2bc1010e0 2024-06-13T02:05:25.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.279+0000 7fa2b97fa700 1 -- 172.21.15.175:0/1066950437 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2b0005550 con 0x7fa2bc1010e0 2024-06-13T02:05:25.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.279+0000 7fa2c2529700 1 -- 172.21.15.175:0/1066950437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2bc1a4230 con 0x7fa2bc1010e0 2024-06-13T02:05:25.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.279+0000 7fa2b97fa700 1 -- 172.21.15.175:0/1066950437 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa2b0011680 con 0x7fa2bc1010e0 2024-06-13T02:05:25.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.280+0000 7fa2c2529700 1 -- 172.21.15.175:0/1066950437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2bc1025c0 con 0x7fa2bc1010e0 2024-06-13T02:05:25.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.280+0000 7fa2b97fa700 1 -- 172.21.15.175:0/1066950437 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fa2b001b430 con 0x7fa2bc1010e0 2024-06-13T02:05:25.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.281+0000 7fa2b97fa700 1 --2- 172.21.15.175:0/1066950437 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa2a8038e90 0x7fa2a803b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:25.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.281+0000 7fa2b97fa700 1 -- 172.21.15.175:0/1066950437 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa2b004e8e0 con 0x7fa2bc1010e0 2024-06-13T02:05:25.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.281+0000 7fa2bb7fe700 1 --2- 172.21.15.175:0/1066950437 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa2a8038e90 0x7fa2a803b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:25.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.283+0000 7fa2bb7fe700 1 --2- 172.21.15.175:0/1066950437 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa2a8038e90 0x7fa2a803b350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009180 tx=0x7fa2ac008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:25.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.296+0000 7fa2b97fa700 1 -- 172.21.15.175:0/1066950437 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa2b0022070 con 0x7fa2bc1010e0 2024-06-13T02:05:25.414 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:25.414 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T02:05:25.415 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:25.415 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:25 smithi002 ceph-mon[31960]: Deploying daemon mon.b on smithi084 2024-06-13T02:05:25.415 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:25 smithi002 ceph-mon[31960]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:25.415 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T02:05:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:25 smithi175 ceph-mon[36977]: Deploying daemon mon.b on smithi084 2024-06-13T02:05:25.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:25 smithi175 ceph-mon[36977]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:25.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:25.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.577+0000 7fa2c2529700 1 -- 172.21.15.175:0/1066950437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa2bc02de60 con 0x7fa2bc1010e0 2024-06-13T02:05:25.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.579+0000 7fa2b97fa700 1 -- 172.21.15.175:0/1066950437 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7fa2b001b9a0 con 0x7fa2bc1010e0 2024-06-13T02:05:25.579 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:05:25.579 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","modified":"2024-06-13T02:05:19.026151Z","created":"2024-06-13T02:03:12.349818Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-13T02:05:25.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.581+0000 7fa2c2529700 1 -- 172.21.15.175:0/1066950437 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa2a8038e90 msgr2=0x7fa2a803b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:25.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.581+0000 7fa2c2529700 1 --2- 172.21.15.175:0/1066950437 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa2a8038e90 0x7fa2a803b350 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009180 tx=0x7fa2ac008040 comp rx=0 tx=0).stop 2024-06-13T02:05:25.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.581+0000 7fa2c2529700 1 -- 172.21.15.175:0/1066950437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2bc1010e0 msgr2=0x7fa2bc107e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:25.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.581+0000 7fa2c2529700 1 --2- 172.21.15.175:0/1066950437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2bc1010e0 0x7fa2bc107e30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0000c00 tx=0x7fa2b0004d60 comp rx=0 tx=0).stop 2024-06-13T02:05:25.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.581+0000 7fa2c2529700 1 -- 172.21.15.175:0/1066950437 shutdown_connections 2024-06-13T02:05:25.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.581+0000 7fa2c2529700 1 --2- 172.21.15.175:0/1066950437 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa2a8038e90 0x7fa2a803b350 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:25.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.581+0000 7fa2c2529700 1 --2- 172.21.15.175:0/1066950437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa2bc1010e0 0x7fa2bc107e30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:25.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.581+0000 7fa2c2529700 1 --2- 172.21.15.175:0/1066950437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2bc108370 0x7fa2bc1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:25.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.581+0000 7fa2c2529700 1 -- 172.21.15.175:0/1066950437 >> 172.21.15.175:0/1066950437 conn(0x7fa2bc0fc970 msgr2=0x7fa2bc0ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:25.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.581+0000 7fa2c2529700 1 -- 172.21.15.175:0/1066950437 shutdown_connections 2024-06-13T02:05:25.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:25.581+0000 7fa2c2529700 1 -- 172.21.15.175:0/1066950437 wait complete. 2024-06-13T02:05:25.583 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 2 2024-06-13T02:05:26.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:26 smithi002 ceph-mon[31960]: from='client.? 172.21.15.175:0/1066950437' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-13T02:05:26.381 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:05:26 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:05:26.026+0000 7f3475200700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-06-13T02:05:26.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:26 smithi175 ceph-mon[36977]: from='client.? 172.21.15.175:0/1066950437' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-13T02:05:27.163 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-13T02:05:27.163 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph mon dump -f json 2024-06-13T02:05:27.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:27 smithi002 ceph-mon[31960]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:27.403 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:05:27.525 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:27 smithi175 ceph-mon[36977]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.021 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-06-13T02:05:28.021 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-06-13T02:05:28.021 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-06-13T02:05:28.021 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-06-13T02:05:28.021 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-06-13T02:05:28.021 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-06-13T02:05:28.022 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-13T02:05:28.022 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T02:05:28.022 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T02:05:28.022 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-13T02:05:28.022 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: Added host smithi084 2024-06-13T02:05:28.022 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.022 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.022 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.022 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.022 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.022 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:05:28.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:05:28.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:28.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:28.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: Updating smithi084:/etc/ceph/ceph.conf 2024-06-13T02:05:28.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: Updating smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:28.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:05:28.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: Updating smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:05:28.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi175", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:05:28.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: Deploying cephadm binary to smithi175 2024-06-13T02:05:28.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:28.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: Added host smithi175 2024-06-13T02:05:28.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:05:28.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.474 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi175", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:05:28.474 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:28.474 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:28.474 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: Updating smithi175:/etc/ceph/ceph.conf 2024-06-13T02:05:28.474 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: Updating smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:28.474 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:05:28.474 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.474 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: Updating smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:05:28.474 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.474 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.474 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.474 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1642723808' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-13T02:05:28.475 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1642723808' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-13T02:05:28.475 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T02:05:28.475 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.475 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi002:172.21.15.2=a;smithi084:172.21.15.84=b;smithi175:172.21.15.175=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:05:28.475 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: Saving service mon spec with placement smithi002:172.21.15.2=a;smithi084:172.21.15.84=b;smithi175:172.21.15.175=c;count:3 2024-06-13T02:05:28.475 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.475 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:28.475 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:28.475 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:28.475 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.475 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T02:05:28.475 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:28.476 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: Deploying daemon mon.c on smithi175 2024-06-13T02:05:28.476 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.476 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.476 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.476 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:05:28.476 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: mon.a calling monitor election 2024-06-13T02:05:28.476 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:28.476 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:28.476 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.476 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:28.476 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: mon.c calling monitor election 2024-06-13T02:05:28.477 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:28.477 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.477 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:28.477 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:28.477 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-13T02:05:28.477 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: monmap epoch 2 2024-06-13T02:05:28.477 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:05:28.477 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: last_changed 2024-06-13T02:05:19.026151+0000 2024-06-13T02:05:28.477 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: created 2024-06-13T02:03:12.349818+0000 2024-06-13T02:05:28.477 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: min_mon_release 19 (squid) 2024-06-13T02:05:28.477 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: election_strategy: 1 2024-06-13T02:05:28.477 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T02:05:28.477 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-06-13T02:05:28.478 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: fsmap 2024-06-13T02:05:28.478 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T02:05:28.478 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: mgrmap e13: x(active, since 59s) 2024-06-13T02:05:28.478 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: overall HEALTH_OK 2024-06-13T02:05:28.478 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.478 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.478 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:28.478 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T02:05:28.478 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:28.478 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: Deploying daemon mon.b on smithi084 2024-06-13T02:05:28.478 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.478 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:28.479 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: from='client.? 172.21.15.175:0/1066950437' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-13T02:05:28.479 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:28.479 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 ceph-mon[36833]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-13T02:05:28.479 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 bash[36814]: c2faadf1f3354f7f7de70f5b188e80abb760502c0c9088a5333addf11daf0e94 2024-06-13T02:05:28.479 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:28 smithi084 systemd[1]: Started Ceph mon.b for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:05:33.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.100+0000 7f18d8512700 1 -- 172.21.15.175:0/3615118328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18bc0035c0 msgr2=0x7f18bc005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:33.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.100+0000 7f18d8512700 1 --2- 172.21.15.175:0/3615118328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18bc0035c0 0x7f18bc005a50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f18d0100dd0 tx=0x7f18cc00fe60 comp rx=0 tx=0).stop 2024-06-13T02:05:33.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.100+0000 7f18d8512700 1 -- 172.21.15.175:0/3615118328 shutdown_connections 2024-06-13T02:05:33.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.100+0000 7f18d8512700 1 --2- 172.21.15.175:0/3615118328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18bc0035c0 0x7f18bc005a50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:33.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.100+0000 7f18d8512700 1 -- 172.21.15.175:0/3615118328 >> 172.21.15.175:0/3615118328 conn(0x7f18d00fc9d0 msgr2=0x7f18d00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:33.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.100+0000 7f18d8512700 1 -- 172.21.15.175:0/3615118328 shutdown_connections 2024-06-13T02:05:33.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.100+0000 7f18d8512700 1 -- 172.21.15.175:0/3615118328 wait complete. 2024-06-13T02:05:33.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.101+0000 7f18d8512700 1 Processor -- start 2024-06-13T02:05:33.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.101+0000 7f18d8512700 1 -- start start 2024-06-13T02:05:33.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d8512700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18bc0035c0 0x7f18d00fd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:33.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d8512700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d00fd870 0x7f18d00fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:33.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d8512700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18d01a3df0 0x7f18d01a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:33.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d8512700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f18d0108ee0 con 0x7f18bc0035c0 2024-06-13T02:05:33.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d8512700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f18d0108d60 con 0x7f18d01a3df0 2024-06-13T02:05:33.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d8512700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18d0109060 con 0x7f18d00fd870 2024-06-13T02:05:33.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d5aad700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d00fd870 0x7f18d00fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:33.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d5aad700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d00fd870 0x7f18d00fdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32914/0 (socket says 172.21.15.175:32914) 2024-06-13T02:05:33.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d5aad700 1 -- 172.21.15.175:0/1529808426 learned_addr learned my addr 172.21.15.175:0/1529808426 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-06-13T02:05:33.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d6aaf700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18d01a3df0 0x7f18d01a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:33.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d5aad700 1 -- 172.21.15.175:0/1529808426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d00fd870 msgr2=0x7f18d00fdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-06-13T02:05:33.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d5aad700 1 -- 172.21.15.175:0/1529808426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d00fd870 msgr2=0x7f18d00fdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-13T02:05:33.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d5aad700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d00fd870 0x7f18d00fdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T02:05:33.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d5aad700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d00fd870 0x7f18d00fdcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T02:05:33.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d62ae700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18bc0035c0 0x7f18d00fd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:33.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d6aaf700 1 -- 172.21.15.175:0/1529808426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18d01a3df0 msgr2=0x7f18d01a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-06-13T02:05:33.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d6aaf700 1 -- 172.21.15.175:0/1529808426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18d01a3df0 msgr2=0x7f18d01a61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-13T02:05:33.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d6aaf700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18d01a3df0 0x7f18d01a61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-13T02:05:33.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.102+0000 7f18d6aaf700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18d01a3df0 0x7f18d01a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T02:05:33.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.103+0000 7f18d62ae700 1 -- 172.21.15.175:0/1529808426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d00fd870 msgr2=0x7f18d00fdcf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T02:05:33.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.103+0000 7f18d62ae700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d00fd870 0x7f18d00fdcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:33.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.103+0000 7f18d62ae700 1 -- 172.21.15.175:0/1529808426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18d01a3df0 msgr2=0x7f18d01a61e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T02:05:33.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.103+0000 7f18d62ae700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18d01a3df0 0x7f18d01a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:33.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.103+0000 7f18d62ae700 1 -- 172.21.15.175:0/1529808426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d01a6910 con 0x7f18bc0035c0 2024-06-13T02:05:33.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.103+0000 7f18d62ae700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18bc0035c0 0x7f18d00fd330 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f18d0100dd0 tx=0x7f18cc005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:33.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.114+0000 7f18c77fe700 1 -- 172.21.15.175:0/1529808426 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc02b030 con 0x7f18bc0035c0 2024-06-13T02:05:33.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.114+0000 7f18c77fe700 1 -- 172.21.15.175:0/1529808426 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18cc012e30 con 0x7f18bc0035c0 2024-06-13T02:05:33.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.114+0000 7f18d8512700 1 -- 172.21.15.175:0/1529808426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d01a6ba0 con 0x7f18bc0035c0 2024-06-13T02:05:33.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.114+0000 7f18c77fe700 1 -- 172.21.15.175:0/1529808426 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18cc022040 con 0x7f18bc0035c0 2024-06-13T02:05:33.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.114+0000 7f18d8512700 1 -- 172.21.15.175:0/1529808426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d01a70e0 con 0x7f18bc0035c0 2024-06-13T02:05:33.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.115+0000 7f18d8512700 1 -- 172.21.15.175:0/1529808426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18d0063af0 con 0x7f18bc0035c0 2024-06-13T02:05:33.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.120+0000 7f18c77fe700 1 -- 172.21.15.175:0/1529808426 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f18cc02e070 con 0x7f18bc0035c0 2024-06-13T02:05:33.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.120+0000 7f18c77fe700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f18b4039580 0x7f18b403ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:33.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.120+0000 7f18c77fe700 1 -- 172.21.15.175:0/1529808426 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f18cc04efd0 con 0x7f18bc0035c0 2024-06-13T02:05:33.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.121+0000 7f18d5aad700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f18b4039580 0x7f18b403ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:33.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.122+0000 7f18d5aad700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f18b4039580 0x7f18b403ba40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009180 tx=0x7f18c0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:33.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.137+0000 7f18c77fe700 1 -- 172.21.15.175:0/1529808426 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f18cc0052d0 con 0x7f18bc0035c0 2024-06-13T02:05:33.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: mon.c calling monitor election 2024-06-13T02:05:33.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:05:33.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: mon.a calling monitor election 2024-06-13T02:05:33.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:33.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:33.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:33.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:33.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:33.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:33.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:33.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:33.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:33.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-13T02:05:33.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: monmap epoch 3 2024-06-13T02:05:33.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:05:33.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: last_changed 2024-06-13T02:05:28.027476+0000 2024-06-13T02:05:33.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: created 2024-06-13T02:03:12.349818+0000 2024-06-13T02:05:33.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: min_mon_release 19 (squid) 2024-06-13T02:05:33.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: election_strategy: 1 2024-06-13T02:05:33.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T02:05:33.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-06-13T02:05:33.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: 2: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.b 2024-06-13T02:05:33.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: fsmap 2024-06-13T02:05:33.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T02:05:33.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: mgrmap e13: x(active, since 68s) 2024-06-13T02:05:33.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: overall HEALTH_OK 2024-06-13T02:05:33.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:33.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:33.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:33.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:33.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.413+0000 7f18d8512700 1 -- 172.21.15.175:0/1529808426 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f18d002dca0 con 0x7f18bc0035c0 2024-06-13T02:05:33.414 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: mon.c calling monitor election 2024-06-13T02:05:33.414 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:05:33.414 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: mon.a calling monitor election 2024-06-13T02:05:33.414 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:33.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:33.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:33.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:33.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:33.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:33.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:33.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:33.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:33.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-13T02:05:33.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: monmap epoch 3 2024-06-13T02:05:33.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:05:33.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: last_changed 2024-06-13T02:05:28.027476+0000 2024-06-13T02:05:33.415 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: created 2024-06-13T02:03:12.349818+0000 2024-06-13T02:05:33.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: min_mon_release 19 (squid) 2024-06-13T02:05:33.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: election_strategy: 1 2024-06-13T02:05:33.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T02:05:33.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-06-13T02:05:33.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: 2: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.b 2024-06-13T02:05:33.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: fsmap 2024-06-13T02:05:33.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T02:05:33.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: mgrmap e13: x(active, since 68s) 2024-06-13T02:05:33.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: overall HEALTH_OK 2024-06-13T02:05:33.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:33.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:33.416 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:33.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:33.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.414+0000 7f18c77fe700 1 -- 172.21.15.175:0/1529808426 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1275 (secure 0 0 0) 0x7f18cc04d8e0 con 0x7f18bc0035c0 2024-06-13T02:05:33.417 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-06-13T02:05:33.417 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":3,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","modified":"2024-06-13T02:05:28.027476Z","created":"2024-06-13T02:03:12.349818Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-13T02:05:33.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.416+0000 7f18d8512700 1 -- 172.21.15.175:0/1529808426 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f18b4039580 msgr2=0x7f18b403ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:33.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.416+0000 7f18d8512700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f18b4039580 0x7f18b403ba40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009180 tx=0x7f18c0008040 comp rx=0 tx=0).stop 2024-06-13T02:05:33.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.416+0000 7f18d8512700 1 -- 172.21.15.175:0/1529808426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18bc0035c0 msgr2=0x7f18d00fd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:33.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.416+0000 7f18d8512700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18bc0035c0 0x7f18d00fd330 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f18d0100dd0 tx=0x7f18cc005be0 comp rx=0 tx=0).stop 2024-06-13T02:05:33.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.416+0000 7f18d8512700 1 -- 172.21.15.175:0/1529808426 shutdown_connections 2024-06-13T02:05:33.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.416+0000 7f18d8512700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f18b4039580 0x7f18b403ba40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:33.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.416+0000 7f18d8512700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18d01a3df0 0x7f18d01a61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:33.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.416+0000 7f18d8512700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f18bc0035c0 0x7f18d00fd330 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:33.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.416+0000 7f18d8512700 1 --2- 172.21.15.175:0/1529808426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d00fd870 0x7f18d00fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:33.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.416+0000 7f18d8512700 1 -- 172.21.15.175:0/1529808426 >> 172.21.15.175:0/1529808426 conn(0x7f18d00fc9d0 msgr2=0x7f18d006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:33.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.416+0000 7f18d8512700 1 -- 172.21.15.175:0/1529808426 shutdown_connections 2024-06-13T02:05:33.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:33.417+0000 7f18d8512700 1 -- 172.21.15.175:0/1529808426 wait complete. 2024-06-13T02:05:33.419 INFO:teuthology.orchestra.run.smithi175.stderr:dumped monmap epoch 3 2024-06-13T02:05:34.085 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-06-13T02:05:34.085 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph config generate-minimal-conf 2024-06-13T02:05:34.364 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:34 smithi175 ceph-mon[36977]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:34.365 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:34 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:34.365 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:34 smithi175 ceph-mon[36977]: from='client.? 172.21.15.175:0/1529808426' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-13T02:05:34.365 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:34 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:34.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:34 smithi002 ceph-mon[31960]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:34.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:34 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:34.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:34 smithi002 ceph-mon[31960]: from='client.? 172.21.15.175:0/1529808426' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-13T02:05:34.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:34 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:34.534 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:05:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: mon.c calling monitor election 2024-06-13T02:05:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:05:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: mon.a calling monitor election 2024-06-13T02:05:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:05:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:35.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:35.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:35.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:35.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-13T02:05:35.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: monmap epoch 3 2024-06-13T02:05:35.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:05:35.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: last_changed 2024-06-13T02:05:28.027476+0000 2024-06-13T02:05:35.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: created 2024-06-13T02:03:12.349818+0000 2024-06-13T02:05:35.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: min_mon_release 19 (squid) 2024-06-13T02:05:35.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: election_strategy: 1 2024-06-13T02:05:35.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T02:05:35.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-06-13T02:05:35.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: 2: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.b 2024-06-13T02:05:35.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: fsmap 2024-06-13T02:05:35.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T02:05:35.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: mgrmap e13: x(active, since 68s) 2024-06-13T02:05:35.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: overall HEALTH_OK 2024-06-13T02:05:35.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:35.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:35.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:35.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:35.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:35.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:35.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='client.? 172.21.15.175:0/1529808426' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-13T02:05:35.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:35.967 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: mon.b calling monitor election 2024-06-13T02:05:35.967 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:35.967 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: Updating smithi002:/etc/ceph/ceph.conf 2024-06-13T02:05:35.967 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: Updating smithi084:/etc/ceph/ceph.conf 2024-06-13T02:05:35.967 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: Updating smithi175:/etc/ceph/ceph.conf 2024-06-13T02:05:35.967 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: mon.b calling monitor election 2024-06-13T02:05:35.968 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: mon.c calling monitor election 2024-06-13T02:05:35.968 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: mon.a calling monitor election 2024-06-13T02:05:35.968 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-13T02:05:35.968 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: monmap epoch 3 2024-06-13T02:05:35.968 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:05:35.968 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: last_changed 2024-06-13T02:05:28.027476+0000 2024-06-13T02:05:35.968 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: created 2024-06-13T02:03:12.349818+0000 2024-06-13T02:05:35.968 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: min_mon_release 19 (squid) 2024-06-13T02:05:35.968 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: election_strategy: 1 2024-06-13T02:05:35.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T02:05:35.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-06-13T02:05:35.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: 2: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.b 2024-06-13T02:05:35.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: fsmap 2024-06-13T02:05:35.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T02:05:35.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: mgrmap e13: x(active, since 70s) 2024-06-13T02:05:35.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: overall HEALTH_OK 2024-06-13T02:05:35.969 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:35.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:35.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:35.970 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:36.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: mon.b calling monitor election 2024-06-13T02:05:36.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:36.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: Updating smithi002:/etc/ceph/ceph.conf 2024-06-13T02:05:36.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: Updating smithi084:/etc/ceph/ceph.conf 2024-06-13T02:05:36.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: Updating smithi175:/etc/ceph/ceph.conf 2024-06-13T02:05:36.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: mon.b calling monitor election 2024-06-13T02:05:36.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: mon.c calling monitor election 2024-06-13T02:05:36.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: mon.a calling monitor election 2024-06-13T02:05:36.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-13T02:05:36.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: monmap epoch 3 2024-06-13T02:05:36.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:05:36.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: last_changed 2024-06-13T02:05:28.027476+0000 2024-06-13T02:05:36.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: created 2024-06-13T02:03:12.349818+0000 2024-06-13T02:05:36.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: min_mon_release 19 (squid) 2024-06-13T02:05:36.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: election_strategy: 1 2024-06-13T02:05:36.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T02:05:36.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-06-13T02:05:36.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: 2: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.b 2024-06-13T02:05:36.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: fsmap 2024-06-13T02:05:36.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T02:05:36.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: mgrmap e13: x(active, since 70s) 2024-06-13T02:05:36.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: overall HEALTH_OK 2024-06-13T02:05:36.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:36.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:36.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:36.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:36.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: mon.b calling monitor election 2024-06-13T02:05:36.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: Updating smithi002:/etc/ceph/ceph.conf 2024-06-13T02:05:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: Updating smithi084:/etc/ceph/ceph.conf 2024-06-13T02:05:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: Updating smithi175:/etc/ceph/ceph.conf 2024-06-13T02:05:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: mon.b calling monitor election 2024-06-13T02:05:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: mon.c calling monitor election 2024-06-13T02:05:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: mon.a calling monitor election 2024-06-13T02:05:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-13T02:05:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: monmap epoch 3 2024-06-13T02:05:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:05:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: last_changed 2024-06-13T02:05:28.027476+0000 2024-06-13T02:05:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: created 2024-06-13T02:03:12.349818+0000 2024-06-13T02:05:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: min_mon_release 19 (squid) 2024-06-13T02:05:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: election_strategy: 1 2024-06-13T02:05:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: 0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-06-13T02:05:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: 1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.c 2024-06-13T02:05:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: 2: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.b 2024-06-13T02:05:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: fsmap 2024-06-13T02:05:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: osdmap e4: 0 total, 0 up, 0 in 2024-06-13T02:05:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: mgrmap e13: x(active, since 70s) 2024-06-13T02:05:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: overall HEALTH_OK 2024-06-13T02:05:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.737+0000 7fa8da400700 1 -- 172.21.15.2:0/561136214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8d41020d0 msgr2=0x7fa8d41024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.737+0000 7fa8da400700 1 --2- 172.21.15.2:0/561136214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8d41020d0 0x7fa8d41024b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009910 tx=0x7fa8c4009c20 comp rx=0 tx=0).stop 2024-06-13T02:05:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.737+0000 7fa8da400700 1 -- 172.21.15.2:0/561136214 shutdown_connections 2024-06-13T02:05:36.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.737+0000 7fa8da400700 1 --2- 172.21.15.2:0/561136214 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8d41020d0 0x7fa8d41024b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.737+0000 7fa8da400700 1 -- 172.21.15.2:0/561136214 >> 172.21.15.2:0/561136214 conn(0x7fa8d40fd9a0 msgr2=0x7fa8d40ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.737+0000 7fa8da400700 1 -- 172.21.15.2:0/561136214 shutdown_connections 2024-06-13T02:05:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.737+0000 7fa8da400700 1 -- 172.21.15.2:0/561136214 wait complete. 2024-06-13T02:05:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.739+0000 7fa8da400700 1 Processor -- start 2024-06-13T02:05:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.739+0000 7fa8da400700 1 -- start start 2024-06-13T02:05:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.739+0000 7fa8da400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8d41020d0 0x7fa8d4074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.739+0000 7fa8da400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d4074cd0 0x7fa8d4075150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.739+0000 7fa8da400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41a3e00 0x7fa8d41a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.739+0000 7fa8da400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d410c460 con 0x7fa8d41020d0 2024-06-13T02:05:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.739+0000 7fa8da400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d410c2e0 con 0x7fa8d4074cd0 2024-06-13T02:05:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.739+0000 7fa8da400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d410c5e0 con 0x7fa8d41a3e00 2024-06-13T02:05:36.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.740+0000 7fa8d2a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d4074cd0 0x7fa8d4075150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:36.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.740+0000 7fa8d3400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8d41020d0 0x7fa8d4074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:36.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.740+0000 7fa8d2a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d4074cd0 0x7fa8d4075150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:59192/0 (socket says 172.21.15.2:59192) 2024-06-13T02:05:36.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.740+0000 7fa8d2a00700 1 -- 172.21.15.2:0/3476195580 learned_addr learned my addr 172.21.15.2:0/3476195580 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:05:36.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.740+0000 7fa8d3e00700 1 --2- 172.21.15.2:0/3476195580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41a3e00 0x7fa8d41a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:36.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.740+0000 7fa8d3400700 1 -- 172.21.15.2:0/3476195580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41a3e00 msgr2=0x7fa8d41a61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:36.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.740+0000 7fa8d3400700 1 --2- 172.21.15.2:0/3476195580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41a3e00 0x7fa8d41a61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:36.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.740+0000 7fa8d3400700 1 -- 172.21.15.2:0/3476195580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d4074cd0 msgr2=0x7fa8d4075150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:36.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.740+0000 7fa8d3400700 1 --2- 172.21.15.2:0/3476195580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d4074cd0 0x7fa8d4075150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:36.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.740+0000 7fa8d3400700 1 -- 172.21.15.2:0/3476195580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d41a6920 con 0x7fa8d41020d0 2024-06-13T02:05:36.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.740+0000 7fa8d2a00700 1 --2- 172.21.15.2:0/3476195580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d4074cd0 0x7fa8d4075150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:05:36.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.741+0000 7fa8d3400700 1 --2- 172.21.15.2:0/3476195580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8d41020d0 0x7fa8d4074790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4014000 tx=0x7fa8c400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:36.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.741+0000 7fa8cbe00700 1 -- 172.21.15.2:0/3476195580 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4026070 con 0x7fa8d41020d0 2024-06-13T02:05:36.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.741+0000 7fa8cbe00700 1 -- 172.21.15.2:0/3476195580 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8c4005da0 con 0x7fa8d41020d0 2024-06-13T02:05:36.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.741+0000 7fa8da400700 1 -- 172.21.15.2:0/3476195580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d41a6c10 con 0x7fa8d41020d0 2024-06-13T02:05:36.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.741+0000 7fa8cbe00700 1 -- 172.21.15.2:0/3476195580 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40038e0 con 0x7fa8d41020d0 2024-06-13T02:05:36.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.741+0000 7fa8da400700 1 -- 172.21.15.2:0/3476195580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d41a71a0 con 0x7fa8d41020d0 2024-06-13T02:05:36.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.742+0000 7fa8cbe00700 1 -- 172.21.15.2:0/3476195580 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fa8c4029070 con 0x7fa8d41020d0 2024-06-13T02:05:36.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.743+0000 7fa8da400700 1 -- 172.21.15.2:0/3476195580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d4063af0 con 0x7fa8d41020d0 2024-06-13T02:05:36.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.743+0000 7fa8cbe00700 1 --2- 172.21.15.2:0/3476195580 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa8b8039580 0x7fa8b803ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:36.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.743+0000 7fa8cbe00700 1 -- 172.21.15.2:0/3476195580 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa8c404cce0 con 0x7fa8d41020d0 2024-06-13T02:05:36.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.743+0000 7fa8d2a00700 1 --2- 172.21.15.2:0/3476195580 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa8b8039580 0x7fa8b803ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:36.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.744+0000 7fa8d2a00700 1 --2- 172.21.15.2:0/3476195580 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa8b8039580 0x7fa8b803ba40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009f70 tx=0x7fa8c00092c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:36.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.749+0000 7fa8cbe00700 1 -- 172.21.15.2:0/3476195580 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa8c4013070 con 0x7fa8d41020d0 2024-06-13T02:05:36.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.994+0000 7fa8da400700 1 -- 172.21.15.2:0/3476195580 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fa8d41a7410 con 0x7fa8d41020d0 2024-06-13T02:05:36.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.994+0000 7fa8cbe00700 1 -- 172.21.15.2:0/3476195580 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+271 (secure 0 0 0) 0x7fa8c4030090 con 0x7fa8d41020d0 2024-06-13T02:05:36.995 INFO:teuthology.orchestra.run.smithi002.stdout:# minimal ceph.conf for efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:05:36.995 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-06-13T02:05:36.995 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:05:36.995 INFO:teuthology.orchestra.run.smithi002.stdout: mon_host = [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] 2024-06-13T02:05:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.998+0000 7fa8da400700 1 -- 172.21.15.2:0/3476195580 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa8b8039580 msgr2=0x7fa8b803ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.998+0000 7fa8da400700 1 --2- 172.21.15.2:0/3476195580 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa8b8039580 0x7fa8b803ba40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009f70 tx=0x7fa8c00092c0 comp rx=0 tx=0).stop 2024-06-13T02:05:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.998+0000 7fa8da400700 1 -- 172.21.15.2:0/3476195580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8d41020d0 msgr2=0x7fa8d4074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.998+0000 7fa8da400700 1 --2- 172.21.15.2:0/3476195580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8d41020d0 0x7fa8d4074790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4014000 tx=0x7fa8c400bdc0 comp rx=0 tx=0).stop 2024-06-13T02:05:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.998+0000 7fa8da400700 1 -- 172.21.15.2:0/3476195580 shutdown_connections 2024-06-13T02:05:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.998+0000 7fa8da400700 1 --2- 172.21.15.2:0/3476195580 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa8b8039580 0x7fa8b803ba40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.998+0000 7fa8da400700 1 --2- 172.21.15.2:0/3476195580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8d41a3e00 0x7fa8d41a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.998+0000 7fa8da400700 1 --2- 172.21.15.2:0/3476195580 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa8d41020d0 0x7fa8d4074790 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.998+0000 7fa8da400700 1 --2- 172.21.15.2:0/3476195580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa8d4074cd0 0x7fa8d4075150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.998+0000 7fa8da400700 1 -- 172.21.15.2:0/3476195580 >> 172.21.15.2:0/3476195580 conn(0x7fa8d40fd9a0 msgr2=0x7fa8d4103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:36.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.999+0000 7fa8da400700 1 -- 172.21.15.2:0/3476195580 shutdown_connections 2024-06-13T02:05:37.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:36.999+0000 7fa8da400700 1 -- 172.21.15.2:0/3476195580 wait complete. 2024-06-13T02:05:37.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:36 smithi175 ceph-mon[36977]: Updating smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:37.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:36 smithi175 ceph-mon[36977]: Updating smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:37.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:36 smithi175 ceph-mon[36977]: Updating smithi002:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:37.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:37.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T02:05:37.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T02:05:37.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:37.075 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:05:37 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:05:37.029+0000 7f3475200700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-06-13T02:05:37.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:36 smithi002 ceph-mon[31960]: Updating smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:37.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:36 smithi002 ceph-mon[31960]: Updating smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:37.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:36 smithi002 ceph-mon[31960]: Updating smithi002:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:37.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:37.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T02:05:37.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T02:05:37.076 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:37.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:36 smithi084 ceph-mon[36833]: Updating smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:36 smithi084 ceph-mon[36833]: Updating smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:36 smithi084 ceph-mon[36833]: Updating smithi002:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:05:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:05:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T02:05:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T02:05:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:37.752 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-06-13T02:05:37.752 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:05:37.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.conf 2024-06-13T02:05:37.842 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:05:37.842 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:05:37.965 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:37 smithi002 ceph-mon[31960]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:37.966 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:37 smithi002 ceph-mon[31960]: Reconfiguring mon.a (unknown last config time)... 2024-06-13T02:05:37.966 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:37 smithi002 ceph-mon[31960]: Reconfiguring daemon mon.a on smithi002 2024-06-13T02:05:37.966 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:37 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3476195580' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:37.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:37 smithi084 ceph-mon[36833]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:37.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:37 smithi084 ceph-mon[36833]: Reconfiguring mon.a (unknown last config time)... 2024-06-13T02:05:37.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:37 smithi084 ceph-mon[36833]: Reconfiguring daemon mon.a on smithi002 2024-06-13T02:05:37.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:37 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3476195580' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:37.986 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-06-13T02:05:37.986 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.conf 2024-06-13T02:05:38.016 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-06-13T02:05:38.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:05:38.083 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-06-13T02:05:38.083 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.conf 2024-06-13T02:05:38.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:37 smithi175 ceph-mon[36977]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:38.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:37 smithi175 ceph-mon[36977]: Reconfiguring mon.a (unknown last config time)... 2024-06-13T02:05:38.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:37 smithi175 ceph-mon[36977]: Reconfiguring daemon mon.a on smithi002 2024-06-13T02:05:38.105 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:37 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3476195580' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:38.110 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-06-13T02:05:38.110 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:05:38.173 INFO:tasks.cephadm:Adding mgr.x on smithi002 2024-06-13T02:05:38.173 INFO:tasks.cephadm:Adding mgr.y on smithi084 2024-06-13T02:05:38.173 INFO:tasks.cephadm:Adding mgr.z on smithi175 2024-06-13T02:05:38.174 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch apply mgr '3;smithi002=x;smithi084=y;smithi175=z' 2024-06-13T02:05:38.447 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:05:39.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.900+0000 7f499a6ad700 1 -- 172.21.15.175:0/3708197093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49941002d0 msgr2=0x7f49941006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:39.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.900+0000 7f499a6ad700 1 --2- 172.21.15.175:0/3708197093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49941002d0 0x7f49941006f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4984009910 tx=0x7f4984009c20 comp rx=0 tx=0).stop 2024-06-13T02:05:39.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.900+0000 7f499a6ad700 1 -- 172.21.15.175:0/3708197093 shutdown_connections 2024-06-13T02:05:39.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.900+0000 7f499a6ad700 1 --2- 172.21.15.175:0/3708197093 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49941002d0 0x7f49941006f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:39.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.900+0000 7f499a6ad700 1 -- 172.21.15.175:0/3708197093 >> 172.21.15.175:0/3708197093 conn(0x7f49940fbbf0 msgr2=0x7f49940fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:39.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.900+0000 7f499a6ad700 1 -- 172.21.15.175:0/3708197093 shutdown_connections 2024-06-13T02:05:39.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.900+0000 7f499a6ad700 1 -- 172.21.15.175:0/3708197093 wait complete. 2024-06-13T02:05:39.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.900+0000 7f499a6ad700 1 Processor -- start 2024-06-13T02:05:39.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f499a6ad700 1 -- start start 2024-06-13T02:05:39.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f499a6ad700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49941002d0 0x7f4994197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:39.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f499a6ad700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4994197d50 0x7f499419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:39.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f499a6ad700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49941981d0 0x7f499419f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:39.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f499a6ad700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4994107fd0 con 0x7f49941981d0 2024-06-13T02:05:39.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f499a6ad700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4994107e50 con 0x7f49941002d0 2024-06-13T02:05:39.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f499a6ad700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4994108150 con 0x7f4994197d50 2024-06-13T02:05:39.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f49937fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4994197d50 0x7f499419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:39.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f49937fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4994197d50 0x7f499419cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43980/0 (socket says 172.21.15.175:43980) 2024-06-13T02:05:39.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f49937fe700 1 -- 172.21.15.175:0/3571044915 learned_addr learned my addr 172.21.15.175:0/3571044915 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-06-13T02:05:39.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f4998c4a700 1 --2- 172.21.15.175:0/3571044915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49941981d0 0x7f499419f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:39.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f4993fff700 1 --2- 172.21.15.175:0/3571044915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49941002d0 0x7f4994197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:39.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f49937fe700 1 -- 172.21.15.175:0/3571044915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49941002d0 msgr2=0x7f4994197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:39.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f49937fe700 1 --2- 172.21.15.175:0/3571044915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49941002d0 0x7f4994197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:39.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f49937fe700 1 -- 172.21.15.175:0/3571044915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49941981d0 msgr2=0x7f499419f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:39.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f49937fe700 1 --2- 172.21.15.175:0/3571044915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49941981d0 0x7f499419f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:39.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.901+0000 7f49937fe700 1 -- 172.21.15.175:0/3571044915 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499419fc20 con 0x7f4994197d50 2024-06-13T02:05:39.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.902+0000 7f4993fff700 1 --2- 172.21.15.175:0/3571044915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49941002d0 0x7f4994197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:05:39.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.902+0000 7f49937fe700 1 --2- 172.21.15.175:0/3571044915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4994197d50 0x7f499419cdc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f498800b780 tx=0x7f498800bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:39.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.902+0000 7f49917fa700 1 -- 172.21.15.175:0/3571044915 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988004230 con 0x7f4994197d50 2024-06-13T02:05:39.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.902+0000 7f49917fa700 1 -- 172.21.15.175:0/3571044915 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49880043d0 con 0x7f4994197d50 2024-06-13T02:05:39.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.902+0000 7f49917fa700 1 -- 172.21.15.175:0/3571044915 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988011c60 con 0x7f4994197d50 2024-06-13T02:05:39.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.902+0000 7f499a6ad700 1 -- 172.21.15.175:0/3571044915 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499419ff10 con 0x7f4994197d50 2024-06-13T02:05:39.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.902+0000 7f499a6ad700 1 -- 172.21.15.175:0/3571044915 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49941a03f0 con 0x7f4994197d50 2024-06-13T02:05:39.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.903+0000 7f49917fa700 1 -- 172.21.15.175:0/3571044915 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7f498801a400 con 0x7f4994197d50 2024-06-13T02:05:39.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.903+0000 7f499a6ad700 1 -- 172.21.15.175:0/3571044915 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4994063b30 con 0x7f4994197d50 2024-06-13T02:05:39.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.903+0000 7f49917fa700 1 --2- 172.21.15.175:0/3571044915 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f497c039580 0x7f497c03ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:39.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.903+0000 7f49917fa700 1 -- 172.21.15.175:0/3571044915 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f498804be30 con 0x7f4994197d50 2024-06-13T02:05:39.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.903+0000 7f4993fff700 1 --2- 172.21.15.175:0/3571044915 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f497c039580 0x7f497c03ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:39.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.904+0000 7f4993fff700 1 --2- 172.21.15.175:0/3571044915 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f497c039580 0x7f497c03ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4984009750 tx=0x7f4984005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:39.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:39.908+0000 7f49917fa700 1 -- 172.21.15.175:0/3571044915 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f498801a840 con 0x7f4994197d50 2024-06-13T02:05:40.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:40.119+0000 7f499a6ad700 1 -- 172.21.15.175:0/3571044915 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi084=y;smithi175=z", "target": ["mon-mgr", ""]}) -- 0x7f4994062960 con 0x7f497c039580 2024-06-13T02:05:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:40.133+0000 7f49917fa700 1 -- 172.21.15.175:0/3571044915 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4994062960 con 0x7f497c039580 2024-06-13T02:05:40.134 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mgr update... 2024-06-13T02:05:40.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:40.136+0000 7f499a6ad700 1 -- 172.21.15.175:0/3571044915 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f497c039580 msgr2=0x7f497c03ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:40.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:40.136+0000 7f499a6ad700 1 --2- 172.21.15.175:0/3571044915 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f497c039580 0x7f497c03ba40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4984009750 tx=0x7f4984005fd0 comp rx=0 tx=0).stop 2024-06-13T02:05:40.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:40.136+0000 7f499a6ad700 1 -- 172.21.15.175:0/3571044915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4994197d50 msgr2=0x7f499419cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:40.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:40.136+0000 7f499a6ad700 1 --2- 172.21.15.175:0/3571044915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4994197d50 0x7f499419cdc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f498800b780 tx=0x7f498800bb40 comp rx=0 tx=0).stop 2024-06-13T02:05:40.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:40.136+0000 7f499a6ad700 1 -- 172.21.15.175:0/3571044915 shutdown_connections 2024-06-13T02:05:40.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:40.136+0000 7f499a6ad700 1 --2- 172.21.15.175:0/3571044915 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f497c039580 0x7f497c03ba40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:40.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:40.136+0000 7f499a6ad700 1 --2- 172.21.15.175:0/3571044915 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49941981d0 0x7f499419f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:40.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:40.136+0000 7f499a6ad700 1 --2- 172.21.15.175:0/3571044915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49941002d0 0x7f4994197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:40.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:40.136+0000 7f499a6ad700 1 --2- 172.21.15.175:0/3571044915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4994197d50 0x7f499419cdc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:40.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:40.136+0000 7f499a6ad700 1 -- 172.21.15.175:0/3571044915 >> 172.21.15.175:0/3571044915 conn(0x7f49940fbbf0 msgr2=0x7f49940fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:40.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:40.136+0000 7f499a6ad700 1 -- 172.21.15.175:0/3571044915 shutdown_connections 2024-06-13T02:05:40.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:05:40.136+0000 7f499a6ad700 1 -- 172.21.15.175:0/3571044915 wait complete. 2024-06-13T02:05:40.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:40 smithi002 ceph-mon[31960]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:40.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:40.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:40.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:40 smithi002 ceph-mon[31960]: Reconfiguring mon.b (monmap changed)... 2024-06-13T02:05:40.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T02:05:40.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T02:05:40.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:40.445 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:40 smithi084 ceph-mon[36833]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:40.445 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:40 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:40.445 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:40 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:40.445 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:40 smithi084 ceph-mon[36833]: Reconfiguring mon.b (monmap changed)... 2024-06-13T02:05:40.445 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:40 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T02:05:40.445 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:40 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T02:05:40.445 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:40 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:40.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:40 smithi175 ceph-mon[36977]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:40.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:40 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:40.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:40 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:40.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:40 smithi175 ceph-mon[36977]: Reconfiguring mon.b (monmap changed)... 2024-06-13T02:05:40.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:40 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T02:05:40.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:40 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T02:05:40.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:40 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:40.867 DEBUG:teuthology.orchestra.run.smithi084:mgr.y> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.y.service 2024-06-13T02:05:40.869 DEBUG:teuthology.orchestra.run.smithi175:mgr.z> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.z.service 2024-06-13T02:05:40.872 INFO:tasks.cephadm:Deploying OSDs... 2024-06-13T02:05:40.872 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:05:40.872 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-06-13T02:05:40.933 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-13T02:05:40.933 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-06-13T02:05:40.990 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-13T02:05:40.990 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T02:05:40.990 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-06-13T02:05:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T02:05:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T02:05:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-06-13 02:04:38.233574725 +0000 2024-06-13T02:05:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-06-13 01:57:36.129859661 +0000 2024-06-13T02:05:40.991 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-06-13 01:57:36.129859661 +0000 2024-06-13T02:05:40.991 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-06-13 01:57:36.129859661 +0000 2024-06-13T02:05:40.991 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-13T02:05:41.081 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-06-13T02:05:41.081 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-06-13T02:05:41.081 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000271787 s, 1.9 MB/s 2024-06-13T02:05:41.085 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-13T02:05:41.127 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:41 smithi175 ceph-mon[36977]: Reconfiguring daemon mon.b on smithi084 2024-06-13T02:05:41.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:41 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:41.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:41 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:41.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:41 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:41.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:41 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T02:05:41.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:41 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T02:05:41.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:41 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:41.144 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-06-13T02:05:41.195 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-13T02:05:41.195 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T02:05:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-06-13T02:05:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T02:05:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T02:05:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-06-13 02:04:38.350572168 +0000 2024-06-13T02:05:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-06-13 01:57:36.746846438 +0000 2024-06-13T02:05:41.195 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-06-13 01:57:36.746846438 +0000 2024-06-13T02:05:41.195 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-06-13 01:57:36.746846438 +0000 2024-06-13T02:05:41.195 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-13T02:05:41.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:41 smithi084 ceph-mon[36833]: Reconfiguring daemon mon.b on smithi084 2024-06-13T02:05:41.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:41 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:41.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:41 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:41.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:41 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:41.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:41 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T02:05:41.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:41 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T02:05:41.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:41 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:41.276 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-06-13T02:05:41.277 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-06-13T02:05:41.277 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000290423 s, 1.8 MB/s 2024-06-13T02:05:41.281 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-13T02:05:41.337 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-06-13T02:05:41.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:41 smithi002 ceph-mon[31960]: Reconfiguring daemon mon.b on smithi084 2024-06-13T02:05:41.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:41 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:41.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:41 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:41.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:41 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:41.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:41 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-13T02:05:41.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:41 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-13T02:05:41.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:41 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:41.390 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-13T02:05:41.390 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T02:05:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-06-13T02:05:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T02:05:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T02:05:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-06-13 02:04:38.464569677 +0000 2024-06-13T02:05:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-06-13 01:57:37.330833922 +0000 2024-06-13T02:05:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-06-13 01:57:37.330833922 +0000 2024-06-13T02:05:41.391 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-06-13 01:57:37.330833922 +0000 2024-06-13T02:05:41.391 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-13T02:05:41.519 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-06-13T02:05:41.519 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-06-13T02:05:41.520 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000299277 s, 1.7 MB/s 2024-06-13T02:05:41.523 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-13T02:05:41.583 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-06-13T02:05:41.633 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-13T02:05:41.633 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T02:05:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-06-13T02:05:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T02:05:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T02:05:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-06-13 02:04:38.557567645 +0000 2024-06-13T02:05:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-06-13 01:57:37.941820827 +0000 2024-06-13T02:05:41.633 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-06-13 01:57:37.941820827 +0000 2024-06-13T02:05:41.633 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-06-13 01:57:37.941820827 +0000 2024-06-13T02:05:41.634 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-13T02:05:41.707 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-06-13T02:05:41.707 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-06-13T02:05:41.707 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000272446 s, 1.9 MB/s 2024-06-13T02:05:41.710 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-13T02:05:41.765 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-06-13T02:05:41.765 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-06-13T02:05:41.785 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-13T02:05:41.785 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-06-13T02:05:41.843 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-13T02:05:41.843 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T02:05:41.843 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-06-13T02:05:41.843 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T02:05:41.843 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T02:05:41.843 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-06-13 02:05:27.464710829 +0000 2024-06-13T02:05:41.843 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-06-13 01:56:10.907973946 +0000 2024-06-13T02:05:41.843 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-06-13 01:56:10.907973946 +0000 2024-06-13T02:05:41.843 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-06-13 01:56:10.907973946 +0000 2024-06-13T02:05:41.844 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-13T02:05:41.909 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-06-13T02:05:41.909 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-06-13T02:05:41.909 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000353956 s, 1.4 MB/s 2024-06-13T02:05:41.911 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-13T02:05:41.968 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-06-13T02:05:42.025 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-13T02:05:42.025 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T02:05:42.025 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-06-13T02:05:42.025 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T02:05:42.025 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T02:05:42.025 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-06-13 02:05:27.464710829 +0000 2024-06-13T02:05:42.025 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-06-13 01:56:11.250967892 +0000 2024-06-13T02:05:42.025 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-06-13 01:56:11.250967892 +0000 2024-06-13T02:05:42.025 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-06-13 01:56:11.250967892 +0000 2024-06-13T02:05:42.025 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-13T02:05:42.089 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-06-13T02:05:42.090 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-06-13T02:05:42.090 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000212106 s, 2.4 MB/s 2024-06-13T02:05:42.091 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-13T02:05:42.147 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-06-13T02:05:42.202 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-13T02:05:42.202 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T02:05:42.203 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-06-13T02:05:42.203 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T02:05:42.203 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T02:05:42.203 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-06-13 02:05:27.464710829 +0000 2024-06-13T02:05:42.203 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-06-13 01:56:11.591961875 +0000 2024-06-13T02:05:42.203 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-06-13 01:56:11.591961875 +0000 2024-06-13T02:05:42.203 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-06-13 01:56:11.591961875 +0000 2024-06-13T02:05:42.203 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-13T02:05:42.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:42 smithi084 ceph-mon[36833]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi084=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:05:42.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:42 smithi084 ceph-mon[36833]: Saving service mgr spec with placement smithi002=x;smithi084=y;smithi175=z;count:3 2024-06-13T02:05:42.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:42 smithi084 ceph-mon[36833]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:42.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:42 smithi084 ceph-mon[36833]: Reconfiguring mon.c (monmap changed)... 2024-06-13T02:05:42.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:42 smithi084 ceph-mon[36833]: Reconfiguring daemon mon.c on smithi175 2024-06-13T02:05:42.242 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-06-13T02:05:42.242 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-06-13T02:05:42.243 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.00025191 s, 2.0 MB/s 2024-06-13T02:05:42.244 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-13T02:05:42.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:42 smithi175 ceph-mon[36977]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi084=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:05:42.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:42 smithi175 ceph-mon[36977]: Saving service mgr spec with placement smithi002=x;smithi084=y;smithi175=z;count:3 2024-06-13T02:05:42.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:42 smithi175 ceph-mon[36977]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:42.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:42 smithi175 ceph-mon[36977]: Reconfiguring mon.c (monmap changed)... 2024-06-13T02:05:42.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:42 smithi175 ceph-mon[36977]: Reconfiguring daemon mon.c on smithi175 2024-06-13T02:05:42.300 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-06-13T02:05:42.355 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-13T02:05:42.355 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T02:05:42.355 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-06-13T02:05:42.355 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T02:05:42.355 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T02:05:42.355 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-06-13 02:05:27.465710812 +0000 2024-06-13T02:05:42.355 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-06-13 01:56:11.934955821 +0000 2024-06-13T02:05:42.356 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-06-13 01:56:11.934955821 +0000 2024-06-13T02:05:42.356 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-06-13 01:56:11.934955821 +0000 2024-06-13T02:05:42.356 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-13T02:05:42.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:42 smithi002 ceph-mon[31960]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi002=x;smithi084=y;smithi175=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:05:42.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:42 smithi002 ceph-mon[31960]: Saving service mgr spec with placement smithi002=x;smithi084=y;smithi175=z;count:3 2024-06-13T02:05:42.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:42 smithi002 ceph-mon[31960]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:42.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:42 smithi002 ceph-mon[31960]: Reconfiguring mon.c (monmap changed)... 2024-06-13T02:05:42.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:42 smithi002 ceph-mon[31960]: Reconfiguring daemon mon.c on smithi175 2024-06-13T02:05:42.417 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-06-13T02:05:42.418 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-06-13T02:05:42.418 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000216363 s, 2.4 MB/s 2024-06-13T02:05:42.419 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-13T02:05:42.475 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-06-13T02:05:42.475 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-06-13T02:05:42.490 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-13T02:05:42.490 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-06-13T02:05:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-13T02:05:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T02:05:42.545 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-06-13T02:05:42.545 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T02:05:42.545 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T02:05:42.545 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-06-13 02:05:17.879420691 +0000 2024-06-13T02:05:42.545 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-06-13 01:56:10.902338628 +0000 2024-06-13T02:05:42.545 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-06-13 01:56:10.902338628 +0000 2024-06-13T02:05:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-06-13 01:56:10.902338628 +0000 2024-06-13T02:05:42.545 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-13T02:05:42.607 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-06-13T02:05:42.608 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-06-13T02:05:42.608 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000196214 s, 2.6 MB/s 2024-06-13T02:05:42.609 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-13T02:05:42.665 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-06-13T02:05:42.720 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-13T02:05:42.721 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T02:05:42.721 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-06-13T02:05:42.721 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T02:05:42.721 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T02:05:42.721 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-06-13 02:05:17.880420676 +0000 2024-06-13T02:05:42.721 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-06-13 01:56:11.226333790 +0000 2024-06-13T02:05:42.721 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-06-13 01:56:11.226333790 +0000 2024-06-13T02:05:42.721 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-06-13 01:56:11.226333790 +0000 2024-06-13T02:05:42.722 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-13T02:05:42.782 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-06-13T02:05:42.782 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-06-13T02:05:42.783 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000216129 s, 2.4 MB/s 2024-06-13T02:05:42.784 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-13T02:05:42.839 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-06-13T02:05:42.893 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-13T02:05:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T02:05:42.894 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-06-13T02:05:42.894 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T02:05:42.894 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T02:05:42.894 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-06-13 02:05:17.880420676 +0000 2024-06-13T02:05:42.894 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-06-13 01:56:11.553328906 +0000 2024-06-13T02:05:42.894 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-06-13 01:56:11.553328906 +0000 2024-06-13T02:05:42.894 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-06-13 01:56:11.553328906 +0000 2024-06-13T02:05:42.894 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-13T02:05:42.955 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-06-13T02:05:42.955 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-06-13T02:05:42.955 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000207239 s, 2.5 MB/s 2024-06-13T02:05:42.956 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-13T02:05:43.011 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-06-13T02:05:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-13T02:05:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-13T02:05:43.067 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-06-13T02:05:43.068 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T02:05:43.068 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-06-13T02:05:43.068 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-06-13 02:05:17.880420676 +0000 2024-06-13T02:05:43.068 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-06-13 01:56:11.893323829 +0000 2024-06-13T02:05:43.068 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-06-13 01:56:11.893323829 +0000 2024-06-13T02:05:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-06-13 01:56:11.893323829 +0000 2024-06-13T02:05:43.068 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-13T02:05:43.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:43 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:43.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:43 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:43.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:43 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:43.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:43 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:43.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:43 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:43.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:43 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:43.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:43 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T02:05:43.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:43 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-13T02:05:43.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:43 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T02:05:43.114 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:43 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:43.129 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-06-13T02:05:43.129 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-06-13T02:05:43.129 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000175369 s, 2.9 MB/s 2024-06-13T02:05:43.131 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-13T02:05:43.186 INFO:tasks.cephadm:Deploying osd.0 on smithi002 with /dev/vg_nvme/lv_4... 2024-06-13T02:05:43.186 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-13T02:05:43.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:43 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:43 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:43 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:43 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:43 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:43 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:43 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T02:05:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:43 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-13T02:05:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:43 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T02:05:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:43 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:43.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:43 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:43.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:43 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:43.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:43 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:43.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:43 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:43.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:43 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:43.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:43 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:43.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:43 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T02:05:43.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:43 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-13T02:05:43.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:43 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T02:05:43.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:43 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:43.636 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:05:44.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:44 smithi175 ceph-mon[36977]: Deploying daemon mgr.z on smithi175 2024-06-13T02:05:44.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:44 smithi175 ceph-mon[36977]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:44.283 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:44 smithi175 systemd[1]: Starting Ceph mgr.z for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:05:44.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:44 smithi002 ceph-mon[31960]: Deploying daemon mgr.z on smithi175 2024-06-13T02:05:44.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:44 smithi002 ceph-mon[31960]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:44.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:44 smithi084 ceph-mon[36833]: Deploying daemon mgr.z on smithi175 2024-06-13T02:05:44.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:44 smithi084 ceph-mon[36833]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:44.647 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:44 smithi175 podman[38825]: 2024-06-13 02:05:44.25130828 +0000 UTC m=+0.017259116 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:05:44.647 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:44 smithi175 podman[38825]: 2024-06-13 02:05:44.361277224 +0000 UTC m=+0.127228086 container create bd62bf3c6000c5033f5aa222e8f8cd5e415777945b88b5a3e477e058b1843f40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-06-13T02:05:44.648 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:44 smithi175 podman[38825]: 2024-06-13 02:05:44.563942119 +0000 UTC m=+0.329892954 container init bd62bf3c6000c5033f5aa222e8f8cd5e415777945b88b5a3e477e058b1843f40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-06-13T02:05:44.648 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:44 smithi175 podman[38825]: 2024-06-13 02:05:44.566716078 +0000 UTC m=+0.332666899 container start bd62bf3c6000c5033f5aa222e8f8cd5e415777945b88b5a3e477e058b1843f40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-06-13T02:05:44.648 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:44 smithi175 ceph-mgr[38844]: -- 172.21.15.175:0/4109677235 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559d440ca5a0 con 0x559d4409e800 2024-06-13T02:05:44.648 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:44 smithi175 bash[38825]: bd62bf3c6000c5033f5aa222e8f8cd5e415777945b88b5a3e477e058b1843f40 2024-06-13T02:05:44.906 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:44 smithi175 systemd[1]: Started Ceph mgr.z for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:05:44.906 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:44 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:44.718+0000 7f2190564200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T02:05:44.906 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:44 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:44.905+0000 7f2190564200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:05:45.282 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:45.006+0000 7f2190564200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T02:05:45.721 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:45.315+0000 7f2190564200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T02:05:45.721 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:45.400+0000 7f2190564200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T02:05:45.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:45 smithi002 ceph-mon[31960]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T02:05:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-13T02:05:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T02:05:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:45 smithi002 ceph-mon[31960]: Deploying daemon mgr.y on smithi084 2024-06-13T02:05:45.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:45 smithi084 ceph-mon[36833]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:45.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:45.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:45.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:45.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T02:05:45.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-13T02:05:45.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T02:05:45.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:45.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:45 smithi084 ceph-mon[36833]: Deploying daemon mgr.y on smithi084 2024-06-13T02:05:46.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:45 smithi175 ceph-mon[36977]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:46.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:46.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:46.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:46.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T02:05:46.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-13T02:05:46.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T02:05:46.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:46.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:45 smithi175 ceph-mon[36977]: Deploying daemon mgr.y on smithi084 2024-06-13T02:05:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-13T02:05:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-13T02:05:46.534 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10+0 records in 2024-06-13T02:05:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:10+0 records out 2024-06-13T02:05:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0343273 s, 305 MB/s 2024-06-13T02:05:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping successful for: 2024-06-13T02:05:46.882 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:46 smithi084 systemd[1]: Starting Ceph mgr.y for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:05:46.951 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:46 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:46.604+0000 7f2190564200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T02:05:46.951 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:46 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:46.778+0000 7f2190564200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T02:05:46.952 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:46 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:46.949+0000 7f2190564200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T02:05:47.143 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:46 smithi084 podman[38186]: 2024-06-13 02:05:46.784055181 +0000 UTC m=+0.016987430 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:05:47.143 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:46 smithi084 podman[38186]: 2024-06-13 02:05:46.896493911 +0000 UTC m=+0.129426191 container create e34ef6cf1c8c82701bff5405771df5c7e58f8e98d8251a05691f2c1c747c38b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T02:05:47.143 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:47 smithi084 podman[38186]: 2024-06-13 02:05:47.115789656 +0000 UTC m=+0.348721903 container init e34ef6cf1c8c82701bff5405771df5c7e58f8e98d8251a05691f2c1c747c38b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-06-13T02:05:47.143 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:47 smithi084 podman[38186]: 2024-06-13 02:05:47.118204508 +0000 UTC m=+0.351136756 container start e34ef6cf1c8c82701bff5405771df5c7e58f8e98d8251a05691f2c1c747c38b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-06-13T02:05:47.143 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:47 smithi084 ceph-mgr[38206]: -- 172.21.15.84:0/2170255821 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564a5cbf65a0 con 0x564a5cbcb000 2024-06-13T02:05:47.318 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_4 2024-06-13T02:05:47.464 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:47 smithi084 bash[38186]: e34ef6cf1c8c82701bff5405771df5c7e58f8e98d8251a05691f2c1c747c38b3 2024-06-13T02:05:47.484 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:47 smithi084 systemd[1]: Started Ceph mgr.y for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:05:47.484 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:47 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:47.271+0000 7f7b4b169200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T02:05:47.485 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:47 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:47.463+0000 7f7b4b169200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:05:47.532 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:47 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:47.235+0000 7f2190564200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T02:05:47.532 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:47 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:47.327+0000 7f2190564200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T02:05:47.720 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:47 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:47.570+0000 7f7b4b169200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T02:05:47.755 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:05:47.997 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:47 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:47.906+0000 7f7b4b169200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T02:05:47.997 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:47 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:47.996+0000 7f7b4b169200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T02:05:47.997 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:47 smithi084 ceph-mon[36833]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:47.997 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:47.997 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:47.998 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:47.998 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:47.998 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:48.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:47 smithi175 ceph-mon[36977]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:48.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:48.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:48.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:48.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:48.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:48.033 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:47 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:47.534+0000 7f2190564200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T02:05:48.033 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:47 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:47.734+0000 7f2190564200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:05:48.054 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:47 smithi002 ceph-mon[31960]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:48.054 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:48.054 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:48.054 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:48.054 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:48.054 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:48.782 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:48 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:48.372+0000 7f2190564200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T02:05:49.120 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:48 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:48.812+0000 7f2190564200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T02:05:49.120 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:48 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:48.916+0000 7f2190564200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T02:05:49.120 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:49.118+0000 7f2190564200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T02:05:49.598 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:49.261+0000 7f7b4b169200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T02:05:49.598 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:49.429+0000 7f7b4b169200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T02:05:49.598 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:49.597+0000 7f7b4b169200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T02:05:49.884 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-mon[36833]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:49.884 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:49.884 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:49.884 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:49.884 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:49.884 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:49.884 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:49.885 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:49.885 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T02:05:49.885 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T02:05:49.885 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:49.885 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.906+0000 7fb0e0800700 1 -- 172.21.15.2:0/3087909893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d8102500 msgr2=0x7fb0d8102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.906+0000 7fb0e0800700 1 --2- 172.21.15.2:0/3087909893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d8102500 0x7fb0d8102920 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009990 tx=0x7fb0cc009ca0 comp rx=0 tx=0).stop 2024-06-13T02:05:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.907+0000 7fb0e0800700 1 -- 172.21.15.2:0/3087909893 shutdown_connections 2024-06-13T02:05:49.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.907+0000 7fb0e0800700 1 --2- 172.21.15.2:0/3087909893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0d81040a0 0x7fb0d810a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.907+0000 7fb0e0800700 1 --2- 172.21.15.2:0/3087909893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d8102500 0x7fb0d8102920 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.907+0000 7fb0e0800700 1 --2- 172.21.15.2:0/3087909893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0d8103700 0x7fb0d8103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.907+0000 7fb0e0800700 1 -- 172.21.15.2:0/3087909893 >> 172.21.15.2:0/3087909893 conn(0x7fb0d80fdaa0 msgr2=0x7fb0d80ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:05:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.907+0000 7fb0e0800700 1 -- 172.21.15.2:0/3087909893 shutdown_connections 2024-06-13T02:05:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.907+0000 7fb0e0800700 1 -- 172.21.15.2:0/3087909893 wait complete. 2024-06-13T02:05:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.908+0000 7fb0e0800700 1 Processor -- start 2024-06-13T02:05:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.908+0000 7fb0e0800700 1 -- start start 2024-06-13T02:05:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0e0800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0d8102500 0x7fb0d819a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0e0800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0d8103700 0x7fb0d819ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0e0800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d81040a0 0x7fb0d81a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:49.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0dde00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0d8102500 0x7fb0d819a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0e0800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d810e0e0 con 0x7fb0d8103700 2024-06-13T02:05:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0e0800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d810df60 con 0x7fb0d8102500 2024-06-13T02:05:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0e0800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d810e260 con 0x7fb0d81040a0 2024-06-13T02:05:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0dde00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0d8102500 0x7fb0d819a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:52480/0 (socket says 172.21.15.2:52480) 2024-06-13T02:05:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0dde00700 1 -- 172.21.15.2:0/687749519 learned_addr learned my addr 172.21.15.2:0/687749519 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:05:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0dd400700 1 --2- 172.21.15.2:0/687749519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0d8103700 0x7fb0d819ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0de800700 1 --2- 172.21.15.2:0/687749519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d81040a0 0x7fb0d81a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0dde00700 1 -- 172.21.15.2:0/687749519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d81040a0 msgr2=0x7fb0d81a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:49.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0dde00700 1 --2- 172.21.15.2:0/687749519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d81040a0 0x7fb0d81a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0dde00700 1 -- 172.21.15.2:0/687749519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0d8103700 msgr2=0x7fb0d819ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:05:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0dde00700 1 --2- 172.21.15.2:0/687749519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0d8103700 0x7fb0d819ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:05:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0dde00700 1 -- 172.21.15.2:0/687749519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d81a2560 con 0x7fb0d8102500 2024-06-13T02:05:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.909+0000 7fb0dd400700 1 --2- 172.21.15.2:0/687749519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0d8103700 0x7fb0d819ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:05:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.910+0000 7fb0dde00700 1 --2- 172.21.15.2:0/687749519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0d8102500 0x7fb0d819a900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0098e0 tx=0x7fb0cc00f740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.910+0000 7fb0d2a00700 1 -- 172.21.15.2:0/687749519 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc027070 con 0x7fb0d8102500 2024-06-13T02:05:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.910+0000 7fb0d2a00700 1 -- 172.21.15.2:0/687749519 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0cc022950 con 0x7fb0d8102500 2024-06-13T02:05:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.910+0000 7fb0d2a00700 1 -- 172.21.15.2:0/687749519 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc017630 con 0x7fb0d8102500 2024-06-13T02:05:49.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.910+0000 7fb0e0800700 1 -- 172.21.15.2:0/687749519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d81a27f0 con 0x7fb0d8102500 2024-06-13T02:05:49.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.911+0000 7fb0e0800700 1 -- 172.21.15.2:0/687749519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d81a2bf0 con 0x7fb0d8102500 2024-06-13T02:05:49.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.912+0000 7fb0d2a00700 1 -- 172.21.15.2:0/687749519 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 13) ==== 46342+0+0 (secure 0 0 0) 0x7fb0cc02a070 con 0x7fb0d8102500 2024-06-13T02:05:49.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.912+0000 7fb0d2a00700 1 --2- 172.21.15.2:0/687749519 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb0c0039330 0x7fb0c003b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:05:49.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.912+0000 7fb0d2a00700 1 -- 172.21.15.2:0/687749519 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb0cc04d820 con 0x7fb0d8102500 2024-06-13T02:05:49.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.912+0000 7fb0e0800700 1 -- 172.21.15.2:0/687749519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d8069180 con 0x7fb0d8102500 2024-06-13T02:05:49.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.913+0000 7fb0dd400700 1 --2- 172.21.15.2:0/687749519 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb0c0039330 0x7fb0c003b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:05:49.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.913+0000 7fb0dd400700 1 --2- 172.21.15.2:0/687749519 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb0c0039330 0x7fb0c003b7f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009cb0 tx=0x7fb0c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:05:49.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:49.923+0000 7fb0d2a00700 1 -- 172.21.15.2:0/687749519 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb0cc013070 con 0x7fb0d8102500 2024-06-13T02:05:49.990 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:49.658+0000 7f2190564200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T02:05:49.990 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:49.748+0000 7f2190564200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T02:05:49.990 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-mon[36977]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:49.990 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:49.990 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:49.990 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:49.990 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:49.990 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:49.991 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:49.991 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:49.991 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T02:05:49.991 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T02:05:49.991 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:49.991 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:50.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:49 smithi002 ceph-mon[31960]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:50.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:49 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:50.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:49 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:50.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:49 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:50.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:49 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:50.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:49 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:50.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:49 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:50.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:49 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:50.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:49 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-13T02:05:50.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:49 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-13T02:05:50.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:49 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:50.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:49 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:50.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:50.174+0000 7fb0e0800700 1 -- 172.21.15.2:0/687749519 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb0d8075de0 con 0x7fb0c0039330 2024-06-13T02:05:50.180 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:49.883+0000 7f7b4b169200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T02:05:50.180 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:49 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:49.979+0000 7f7b4b169200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T02:05:50.180 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:50 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:50.179+0000 7f7b4b169200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T02:05:50.282 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:49 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:49.988+0000 7f2190564200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T02:05:50.282 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:50 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:50.119+0000 7f2190564200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T02:05:50.283 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:50 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:50.215+0000 7f2190564200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T02:05:50.470 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:50 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:50.369+0000 7f7b4b169200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:05:50.636 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:50 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:50.331+0000 7f2190564200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T02:05:50.636 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:50 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:50.634+0000 7f2190564200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T02:05:51.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:50 smithi175 ceph-mon[36977]: Reconfiguring mgr.x (unknown last config time)... 2024-06-13T02:05:51.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:50 smithi175 ceph-mon[36977]: Reconfiguring daemon mgr.x on smithi002 2024-06-13T02:05:51.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:50 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:05:51.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:50 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:05:51.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:50 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:51.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:50 smithi002 ceph-mon[31960]: Reconfiguring mgr.x (unknown last config time)... 2024-06-13T02:05:51.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:50 smithi002 ceph-mon[31960]: Reconfiguring daemon mgr.x on smithi002 2024-06-13T02:05:51.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:50 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:05:51.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:50 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:05:51.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:50 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:51.220 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:50 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:50.965+0000 7f7b4b169200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T02:05:51.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:50 smithi084 ceph-mon[36833]: Reconfiguring mgr.x (unknown last config time)... 2024-06-13T02:05:51.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:50 smithi084 ceph-mon[36833]: Reconfiguring daemon mgr.x on smithi002 2024-06-13T02:05:51.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:50 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:05:51.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:50 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:05:51.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:50 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:51.532 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:51 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:51.233+0000 7f2190564200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T02:05:51.533 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:05:51 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:05:51.451+0000 7f2190564200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T02:05:51.686 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:51.387+0000 7f7b4b169200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T02:05:51.687 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:51.484+0000 7f7b4b169200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T02:05:51.687 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:51.686+0000 7f7b4b169200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T02:05:51.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-mon[36833]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:05:51.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-mon[36833]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:51.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:51.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:51.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:51.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:51.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:51.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:51.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-mon[36833]: Standby manager daemon z started 2024-06-13T02:05:51.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.175:0/4205008653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-13T02:05:51.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.175:0/4205008653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T02:05:51.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.175:0/4205008653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-13T02:05:51.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:51 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.175:0/4205008653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T02:05:52.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:51 smithi002 ceph-mon[31960]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:05:52.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:51 smithi002 ceph-mon[31960]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:52.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:51 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:52.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:51 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:52.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:51 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:52.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:51 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:52.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:51 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:52.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:51 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:52.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:51 smithi002 ceph-mon[31960]: Standby manager daemon z started 2024-06-13T02:05:52.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:51 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.175:0/4205008653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-13T02:05:52.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:51 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.175:0/4205008653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T02:05:52.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:51 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.175:0/4205008653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-13T02:05:52.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:51 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.175:0/4205008653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T02:05:52.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:51 smithi175 ceph-mon[36977]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:05:52.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:51 smithi175 ceph-mon[36977]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:52.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:51 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:52.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:51 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:52.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:51 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:05:52.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:51 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:05:52.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:51 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:05:52.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:51 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:05:52.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:51 smithi175 ceph-mon[36977]: Standby manager daemon z started 2024-06-13T02:05:52.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:51 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.175:0/4205008653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-13T02:05:52.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:51 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.175:0/4205008653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T02:05:52.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:51 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.175:0/4205008653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-13T02:05:52.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:51 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.175:0/4205008653' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T02:05:52.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:52.375+0000 7fb0d2a00700 1 -- 172.21.15.2:0/687749519 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 14) ==== 92059+0+0 (secure 0 0 0) 0x7fb0cc009d10 con 0x7fb0d8102500 2024-06-13T02:05:52.470 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:52 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:52.203+0000 7f7b4b169200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T02:05:52.470 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:52 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:52.294+0000 7f7b4b169200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T02:05:52.873 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:52 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:52.533+0000 7f7b4b169200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T02:05:52.873 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:52 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:52.664+0000 7f7b4b169200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T02:05:52.873 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:52 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:52.756+0000 7f7b4b169200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T02:05:52.873 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:52 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:52.872+0000 7f7b4b169200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T02:05:53.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:53 smithi084 ceph-mon[36833]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:53.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:53 smithi084 ceph-mon[36833]: mgrmap e14: x(active, since 88s), standbys: z 2024-06-13T02:05:53.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:53 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-13T02:05:53.471 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:53 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:53.169+0000 7f7b4b169200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T02:05:53.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:53 smithi002 ceph-mon[31960]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:53.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:53 smithi002 ceph-mon[31960]: mgrmap e14: x(active, since 88s), standbys: z 2024-06-13T02:05:53.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:53 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-13T02:05:53.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:53 smithi175 ceph-mon[36977]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:53.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:53 smithi175 ceph-mon[36977]: mgrmap e14: x(active, since 88s), standbys: z 2024-06-13T02:05:53.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:53 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-13T02:05:54.220 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:53 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:53.765+0000 7f7b4b169200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T02:05:54.220 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:05:53 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:05:53.977+0000 7f7b4b169200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T02:05:54.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:05:54.397+0000 7fb0d2a00700 1 -- 172.21.15.2:0/687749519 <== mon.2 v2:172.21.15.84:3300/0 8 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7fb0cc022470 con 0x7fb0d8102500 2024-06-13T02:05:54.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:54 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.84:0/1204078664' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-13T02:05:54.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:54 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.84:0/1204078664' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T02:05:54.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:54 smithi002 ceph-mon[31960]: Standby manager daemon y started 2024-06-13T02:05:54.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:54 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.84:0/1204078664' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-13T02:05:54.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:54 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.84:0/1204078664' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T02:05:54.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:54 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.84:0/1204078664' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-13T02:05:54.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:54 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.84:0/1204078664' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T02:05:54.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:54 smithi084 ceph-mon[36833]: Standby manager daemon y started 2024-06-13T02:05:54.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:54 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.84:0/1204078664' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-13T02:05:54.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:54 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.84:0/1204078664' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T02:05:54.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:54 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.84:0/1204078664' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-13T02:05:54.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:54 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.84:0/1204078664' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T02:05:54.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:54 smithi175 ceph-mon[36977]: Standby manager daemon y started 2024-06-13T02:05:54.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:54 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.84:0/1204078664' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-13T02:05:54.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:54 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.84:0/1204078664' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T02:05:55.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:55 smithi002 ceph-mon[31960]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:55.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:55 smithi002 ceph-mon[31960]: mgrmap e15: x(active, since 90s), standbys: y, z 2024-06-13T02:05:55.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:55 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-13T02:05:55.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:55 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/4066054763' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96b4d494-453c-48aa-b1e2-ee30dfa83e2e"}]: dispatch 2024-06-13T02:05:55.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:55 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96b4d494-453c-48aa-b1e2-ee30dfa83e2e"}]: dispatch 2024-06-13T02:05:55.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:55 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "96b4d494-453c-48aa-b1e2-ee30dfa83e2e"}]': finished 2024-06-13T02:05:55.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:55 smithi002 ceph-mon[31960]: osdmap e5: 1 total, 0 up, 1 in 2024-06-13T02:05:55.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:55 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:05:55.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:55 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/4027349302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:05:55.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:55 smithi084 ceph-mon[36833]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:55.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:55 smithi084 ceph-mon[36833]: mgrmap e15: x(active, since 90s), standbys: y, z 2024-06-13T02:05:55.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:55 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-13T02:05:55.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:55 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/4066054763' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96b4d494-453c-48aa-b1e2-ee30dfa83e2e"}]: dispatch 2024-06-13T02:05:55.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:55 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96b4d494-453c-48aa-b1e2-ee30dfa83e2e"}]: dispatch 2024-06-13T02:05:55.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:55 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "96b4d494-453c-48aa-b1e2-ee30dfa83e2e"}]': finished 2024-06-13T02:05:55.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:55 smithi084 ceph-mon[36833]: osdmap e5: 1 total, 0 up, 1 in 2024-06-13T02:05:55.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:55 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:05:55.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:55 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/4027349302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:05:55.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:55 smithi175 ceph-mon[36977]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:55.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:55 smithi175 ceph-mon[36977]: mgrmap e15: x(active, since 90s), standbys: y, z 2024-06-13T02:05:55.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:55 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-13T02:05:55.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:55 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/4066054763' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96b4d494-453c-48aa-b1e2-ee30dfa83e2e"}]: dispatch 2024-06-13T02:05:55.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:55 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96b4d494-453c-48aa-b1e2-ee30dfa83e2e"}]: dispatch 2024-06-13T02:05:55.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:55 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "96b4d494-453c-48aa-b1e2-ee30dfa83e2e"}]': finished 2024-06-13T02:05:55.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:55 smithi175 ceph-mon[36977]: osdmap e5: 1 total, 0 up, 1 in 2024-06-13T02:05:55.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:55 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:05:55.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:55 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/4027349302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:05:57.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:57 smithi084 ceph-mon[36833]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:57.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:57 smithi175 ceph-mon[36977]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:57.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:57 smithi002 ceph-mon[31960]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:59.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:05:59 smithi084 ceph-mon[36833]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:59.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:05:59 smithi175 ceph-mon[36977]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:05:59.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:05:59 smithi002 ceph-mon[31960]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:01.512 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:01 smithi002 ceph-mon[31960]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:01.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:01 smithi084 ceph-mon[36833]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:01.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:01 smithi175 ceph-mon[36977]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:03.613 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:03 smithi002 ceph-mon[31960]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:03.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:03 smithi084 ceph-mon[36833]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:03.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:03 smithi175 ceph-mon[36977]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:04.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:04 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-13T02:06:04.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:04 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:04.705 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:04 smithi002 ceph-mon[31960]: Deploying daemon osd.0 on smithi002 2024-06-13T02:06:04.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:04 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-13T02:06:04.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:04 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:04.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:04 smithi084 ceph-mon[36833]: Deploying daemon osd.0 on smithi002 2024-06-13T02:06:04.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:04 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-13T02:06:04.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:04 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:04.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:04 smithi175 ceph-mon[36977]: Deploying daemon osd.0 on smithi002 2024-06-13T02:06:05.719 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:05 smithi002 ceph-mon[31960]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:05.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:05 smithi084 ceph-mon[36833]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:05.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:05 smithi175 ceph-mon[36977]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:07.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:07 smithi002 ceph-mon[31960]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:07.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:07 smithi084 ceph-mon[36833]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:07.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:07 smithi175 ceph-mon[36977]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:09.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:09 smithi084 ceph-mon[36833]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:09.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:09 smithi175 ceph-mon[36977]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:09.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:09 smithi002 ceph-mon[31960]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:11.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:11 smithi084 ceph-mon[36833]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:11.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:11 smithi002 ceph-mon[31960]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:11.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:11 smithi175 ceph-mon[36977]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:13.255 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:12 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:13.256 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:12 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:13.256 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:12 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:06:13.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:12 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:13.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:12 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:13.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:12 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:06:13.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:12 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:13.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:12 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:13.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:12 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:06:14.035 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:13 smithi002 ceph-mon[31960]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:14.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:13 smithi175 ceph-mon[36977]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:14.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:13 smithi084 ceph-mon[36833]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:16.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:15 smithi002 ceph-mon[31960]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:16.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:15 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:16.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:15 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:16.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:15 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:16.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:15 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:06:16.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:15 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:16.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:15 smithi084 ceph-mon[36833]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:16.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:15 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:16.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:15 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:16.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:15 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:16.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:15 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:06:16.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:15 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:16.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:15 smithi175 ceph-mon[36977]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:16.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:15 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:16.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:15 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:16.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:15 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:16.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:15 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:06:16.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:15 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:16.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:06:16.815+0000 7fb0d2a00700 1 -- 172.21.15.2:0/687749519 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb0d8075de0 con 0x7fb0c0039330 2024-06-13T02:06:16.817 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 0 on host 'smithi002' 2024-06-13T02:06:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:06:16.819+0000 7fb0e0800700 1 -- 172.21.15.2:0/687749519 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb0c0039330 msgr2=0x7fb0c003b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:06:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:06:16.819+0000 7fb0e0800700 1 --2- 172.21.15.2:0/687749519 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb0c0039330 0x7fb0c003b7f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009cb0 tx=0x7fb0c8009260 comp rx=0 tx=0).stop 2024-06-13T02:06:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:06:16.819+0000 7fb0e0800700 1 -- 172.21.15.2:0/687749519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0d8102500 msgr2=0x7fb0d819a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:06:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:06:16.819+0000 7fb0e0800700 1 --2- 172.21.15.2:0/687749519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0d8102500 0x7fb0d819a900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0098e0 tx=0x7fb0cc00f740 comp rx=0 tx=0).stop 2024-06-13T02:06:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:06:16.820+0000 7fb0e0800700 1 -- 172.21.15.2:0/687749519 shutdown_connections 2024-06-13T02:06:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:06:16.820+0000 7fb0e0800700 1 --2- 172.21.15.2:0/687749519 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb0c0039330 0x7fb0c003b7f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:16.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:06:16.820+0000 7fb0e0800700 1 --2- 172.21.15.2:0/687749519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d81040a0 0x7fb0d81a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:06:16.820+0000 7fb0e0800700 1 --2- 172.21.15.2:0/687749519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb0d8102500 0x7fb0d819a900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:06:16.820+0000 7fb0e0800700 1 --2- 172.21.15.2:0/687749519 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb0d8103700 0x7fb0d819ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:06:16.820+0000 7fb0e0800700 1 -- 172.21.15.2:0/687749519 >> 172.21.15.2:0/687749519 conn(0x7fb0d80fdaa0 msgr2=0x7fb0d80746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:06:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:06:16.820+0000 7fb0e0800700 1 -- 172.21.15.2:0/687749519 shutdown_connections 2024-06-13T02:06:16.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:06:16.820+0000 7fb0e0800700 1 -- 172.21.15.2:0/687749519 wait complete. 2024-06-13T02:06:17.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:16 smithi002 ceph-mon[31960]: from='osd.0 [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-13T02:06:17.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:16 smithi002 ceph-mon[31960]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-13T02:06:17.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:16 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:17.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:16 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:17.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:16 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:06:17.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:16 smithi084 ceph-mon[36833]: from='osd.0 [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-13T02:06:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:16 smithi084 ceph-mon[36833]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-13T02:06:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:16 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:16 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:16 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:06:17.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:16 smithi175 ceph-mon[36977]: from='osd.0 [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-13T02:06:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:16 smithi175 ceph-mon[36977]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-13T02:06:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:16 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:16 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:16 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:06:17.654 DEBUG:teuthology.orchestra.run.smithi002:osd.0> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.0.service 2024-06-13T02:06:17.659 INFO:tasks.cephadm:Deploying osd.1 on smithi084 with /dev/vg_nvme/lv_4... 2024-06-13T02:06:17.659 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-13T02:06:17.889 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T02:06:17.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:17 smithi084 ceph-mon[36833]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:17.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:17 smithi084 ceph-mon[36833]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-13T02:06:17.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:17 smithi084 ceph-mon[36833]: from='osd.0 [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:06:17.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:17 smithi084 ceph-mon[36833]: osdmap e6: 1 total, 0 up, 1 in 2024-06-13T02:06:17.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:17 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:06:17.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:17 smithi084 ceph-mon[36833]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:06:18.234 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:17 smithi002 ceph-mon[31960]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:18.234 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:17 smithi002 ceph-mon[31960]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-13T02:06:18.234 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:17 smithi002 ceph-mon[31960]: from='osd.0 [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:06:18.234 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:17 smithi002 ceph-mon[31960]: osdmap e6: 1 total, 0 up, 1 in 2024-06-13T02:06:18.234 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:17 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:06:18.234 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:17 smithi002 ceph-mon[31960]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:06:18.234 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:06:17 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-0[44001]: 2024-06-13T02:06:17.912+0000 7f3327000700 -1 osd.0 0 waiting for initial osdmap 2024-06-13T02:06:18.234 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:06:17 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-0[44001]: 2024-06-13T02:06:17.920+0000 7f3321e00700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T02:06:18.281 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:17 smithi175 ceph-mon[36977]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:18.281 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:17 smithi175 ceph-mon[36977]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-13T02:06:18.281 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:17 smithi175 ceph-mon[36977]: from='osd.0 [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:06:18.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:17 smithi175 ceph-mon[36977]: osdmap e6: 1 total, 0 up, 1 in 2024-06-13T02:06:18.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:17 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:06:18.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:17 smithi175 ceph-mon[36977]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:06:19.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:18 smithi002 ceph-mon[31960]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T02:06:19.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:18 smithi002 ceph-mon[31960]: osdmap e7: 1 total, 0 up, 1 in 2024-06-13T02:06:19.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:18 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:06:19.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:18 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:06:19.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:18 smithi084 ceph-mon[36833]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T02:06:19.151 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:18 smithi084 ceph-mon[36833]: osdmap e7: 1 total, 0 up, 1 in 2024-06-13T02:06:19.151 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:18 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:06:19.151 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:18 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:06:19.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:18 smithi175 ceph-mon[36977]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T02:06:19.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:18 smithi175 ceph-mon[36977]: osdmap e7: 1 total, 0 up, 1 in 2024-06-13T02:06:19.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:18 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:06:19.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:18 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:06:19.705 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-13T02:06:19.706 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-13T02:06:19.706 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-06-13T02:06:19.706 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-06-13T02:06:19.706 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113124 s, 927 MB/s 2024-06-13T02:06:19.706 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-06-13T02:06:20.094 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:19 smithi084 ceph-mon[36833]: purged_snaps scrub starts 2024-06-13T02:06:20.094 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:19 smithi084 ceph-mon[36833]: purged_snaps scrub ok 2024-06-13T02:06:20.094 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:19 smithi084 ceph-mon[36833]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:20.094 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:19 smithi084 ceph-mon[36833]: osd.0 [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126] boot 2024-06-13T02:06:20.094 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:19 smithi084 ceph-mon[36833]: osdmap e8: 1 total, 1 up, 1 in 2024-06-13T02:06:20.094 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:19 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:06:20.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:19 smithi002 ceph-mon[31960]: purged_snaps scrub starts 2024-06-13T02:06:20.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:19 smithi002 ceph-mon[31960]: purged_snaps scrub ok 2024-06-13T02:06:20.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:19 smithi002 ceph-mon[31960]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:20.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:19 smithi002 ceph-mon[31960]: osd.0 [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126] boot 2024-06-13T02:06:20.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:19 smithi002 ceph-mon[31960]: osdmap e8: 1 total, 1 up, 1 in 2024-06-13T02:06:20.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:19 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:06:20.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:19 smithi175 ceph-mon[36977]: purged_snaps scrub starts 2024-06-13T02:06:20.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:19 smithi175 ceph-mon[36977]: purged_snaps scrub ok 2024-06-13T02:06:20.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:19 smithi175 ceph-mon[36977]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-13T02:06:20.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:19 smithi175 ceph-mon[36977]: osd.0 [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126] boot 2024-06-13T02:06:20.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:19 smithi175 ceph-mon[36977]: osdmap e8: 1 total, 1 up, 1 in 2024-06-13T02:06:20.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:06:20.377 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi084:vg_nvme/lv_4 2024-06-13T02:06:20.607 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T02:06:21.029 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:20 smithi084 ceph-mon[36833]: osdmap e9: 1 total, 1 up, 1 in 2024-06-13T02:06:21.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:20 smithi175 ceph-mon[36977]: osdmap e9: 1 total, 1 up, 1 in 2024-06-13T02:06:21.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:20 smithi002 ceph-mon[31960]: osdmap e9: 1 total, 1 up, 1 in 2024-06-13T02:06:22.085 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:21 smithi084 ceph-mon[36833]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.087+0000 7f76920ea700 1 -- 172.21.15.84:0/2303881009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f768c102540 msgr2=0x7f768c102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:06:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.087+0000 7f76920ea700 1 --2- 172.21.15.84:0/2303881009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f768c102540 0x7f768c102960 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f767c0099c0 tx=0x7f767c009cd0 comp rx=0 tx=0).stop 2024-06-13T02:06:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.087+0000 7f76920ea700 1 -- 172.21.15.84:0/2303881009 shutdown_connections 2024-06-13T02:06:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.087+0000 7f76920ea700 1 --2- 172.21.15.84:0/2303881009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f768c1040e0 0x7f768c10a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.088+0000 7f76920ea700 1 --2- 172.21.15.84:0/2303881009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f768c102540 0x7f768c102960 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.088+0000 7f76920ea700 1 --2- 172.21.15.84:0/2303881009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f768c103740 0x7f768c103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.088+0000 7f76920ea700 1 -- 172.21.15.84:0/2303881009 >> 172.21.15.84:0/2303881009 conn(0x7f768c0fdae0 msgr2=0x7f768c0fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:06:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.088+0000 7f76920ea700 1 -- 172.21.15.84:0/2303881009 shutdown_connections 2024-06-13T02:06:22.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.088+0000 7f76920ea700 1 -- 172.21.15.84:0/2303881009 wait complete. 2024-06-13T02:06:22.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.088+0000 7f76920ea700 1 Processor -- start 2024-06-13T02:06:22.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.088+0000 7f76920ea700 1 -- start start 2024-06-13T02:06:22.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.088+0000 7f76920ea700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f768c102540 0x7f768c1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:06:22.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f76920ea700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f768c103740 0x7f768c198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:06:22.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f76920ea700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f768c1040e0 0x7f768c19fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:06:22.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f76920ea700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f768c10e250 con 0x7f768c102540 2024-06-13T02:06:22.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f76920ea700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f768c10e0d0 con 0x7f768c1040e0 2024-06-13T02:06:22.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f76920ea700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f768c10e3d0 con 0x7f768c103740 2024-06-13T02:06:22.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f768bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f768c1040e0 0x7f768c19fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:06:22.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f768bfff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f768c1040e0 0x7f768c19fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54460/0 (socket says 172.21.15.84:54460) 2024-06-13T02:06:22.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f768bfff700 1 -- 172.21.15.84:0/1917679840 learned_addr learned my addr 172.21.15.84:0/1917679840 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-06-13T02:06:22.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f768affd700 1 --2- 172.21.15.84:0/1917679840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f768c103740 0x7f768c198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:06:22.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f768bfff700 1 -- 172.21.15.84:0/1917679840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f768c103740 msgr2=0x7f768c198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:06:22.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f768bfff700 1 --2- 172.21.15.84:0/1917679840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f768c103740 0x7f768c198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:22.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f768bfff700 1 -- 172.21.15.84:0/1917679840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f768c102540 msgr2=0x7f768c1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:06:22.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f768bfff700 1 --2- 172.21.15.84:0/1917679840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f768c102540 0x7f768c1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:22.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f768bfff700 1 -- 172.21.15.84:0/1917679840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768c1a0530 con 0x7f768c1040e0 2024-06-13T02:06:22.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f768bfff700 1 --2- 172.21.15.84:0/1917679840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f768c1040e0 0x7f768c19fe90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f768400b970 tx=0x7f768400bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:06:22.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f7688ff9700 1 -- 172.21.15.84:0/1917679840 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7684019070 con 0x7f768c1040e0 2024-06-13T02:06:22.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f7688ff9700 1 -- 172.21.15.84:0/1917679840 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f768400ce10 con 0x7f768c1040e0 2024-06-13T02:06:22.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f76920ea700 1 -- 172.21.15.84:0/1917679840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f768c1a0820 con 0x7f768c1040e0 2024-06-13T02:06:22.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f7688ff9700 1 -- 172.21.15.84:0/1917679840 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76840073d0 con 0x7f768c1040e0 2024-06-13T02:06:22.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.089+0000 7f76920ea700 1 -- 172.21.15.84:0/1917679840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f768c1a0de0 con 0x7f768c1040e0 2024-06-13T02:06:22.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.090+0000 7f76920ea700 1 -- 172.21.15.84:0/1917679840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f768c069180 con 0x7f768c1040e0 2024-06-13T02:06:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.091+0000 7f7688ff9700 1 -- 172.21.15.84:0/1917679840 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f768401c070 con 0x7f768c1040e0 2024-06-13T02:06:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.092+0000 7f7688ff9700 1 --2- 172.21.15.84:0/1917679840 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f76740a2c10 0x7f76740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:06:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.092+0000 7f7688ff9700 1 -- 172.21.15.84:0/1917679840 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f76840cc8a0 con 0x7f768c1040e0 2024-06-13T02:06:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.092+0000 7f768b7fe700 1 --2- 172.21.15.84:0/1917679840 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f76740a2c10 0x7f76740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:06:22.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.093+0000 7f768b7fe700 1 --2- 172.21.15.84:0/1917679840 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f76740a2c10 0x7f76740a50d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f767c003890 tx=0x7f767c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:06:22.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.096+0000 7f7688ff9700 1 -- 172.21.15.84:0/1917679840 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f768409b270 con 0x7f768c1040e0 2024-06-13T02:06:22.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:21 smithi175 ceph-mon[36977]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:22.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:22.296+0000 7f76920ea700 1 -- 172.21.15.84:0/1917679840 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f768c0628d0 con 0x7f76740a2c10 2024-06-13T02:06:22.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:21 smithi002 ceph-mon[31960]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:23.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:06:23.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:06:23.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:23.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:23.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:23.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:06:23.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:23.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:23.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:06:23.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:23.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:06:23.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:06:23.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:23.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:23.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:23.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:06:23.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:23.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:23.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:06:23.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:23.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:06:23.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:06:23.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:23.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:23.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:23.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:06:23.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:23.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:23.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:06:23.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:24.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:23 smithi084 ceph-mon[36833]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:06:24.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:23 smithi084 ceph-mon[36833]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:24.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:23 smithi084 ceph-mon[36833]: Detected new or changed devices on smithi002 2024-06-13T02:06:24.158 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:23 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi002 to 17094M 2024-06-13T02:06:24.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:23 smithi175 ceph-mon[36977]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:06:24.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:23 smithi175 ceph-mon[36977]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:24.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:23 smithi175 ceph-mon[36977]: Detected new or changed devices on smithi002 2024-06-13T02:06:24.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:23 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi002 to 17094M 2024-06-13T02:06:24.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:23 smithi002 ceph-mon[31960]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:06:24.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:23 smithi002 ceph-mon[31960]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:24.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:23 smithi002 ceph-mon[31960]: Detected new or changed devices on smithi002 2024-06-13T02:06:24.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:23 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi002 to 17094M 2024-06-13T02:06:26.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:25 smithi084 ceph-mon[36833]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:26.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:25 smithi084 ceph-mon[36833]: from='client.? 172.21.15.84:0/3068411515' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "856e86b6-9281-485b-a36b-2fe04de31329"}]: dispatch 2024-06-13T02:06:26.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:25 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "856e86b6-9281-485b-a36b-2fe04de31329"}]: dispatch 2024-06-13T02:06:26.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:25 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "856e86b6-9281-485b-a36b-2fe04de31329"}]': finished 2024-06-13T02:06:26.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:25 smithi084 ceph-mon[36833]: osdmap e10: 2 total, 1 up, 2 in 2024-06-13T02:06:26.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:06:26.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:25 smithi084 ceph-mon[36833]: from='client.? 172.21.15.84:0/2338745989' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:06:26.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:25 smithi175 ceph-mon[36977]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:26.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:25 smithi175 ceph-mon[36977]: from='client.? 172.21.15.84:0/3068411515' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "856e86b6-9281-485b-a36b-2fe04de31329"}]: dispatch 2024-06-13T02:06:26.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:25 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "856e86b6-9281-485b-a36b-2fe04de31329"}]: dispatch 2024-06-13T02:06:26.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:25 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "856e86b6-9281-485b-a36b-2fe04de31329"}]': finished 2024-06-13T02:06:26.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:25 smithi175 ceph-mon[36977]: osdmap e10: 2 total, 1 up, 2 in 2024-06-13T02:06:26.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:06:26.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:25 smithi175 ceph-mon[36977]: from='client.? 172.21.15.84:0/2338745989' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:06:26.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:25 smithi002 ceph-mon[31960]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:26.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:25 smithi002 ceph-mon[31960]: from='client.? 172.21.15.84:0/3068411515' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "856e86b6-9281-485b-a36b-2fe04de31329"}]: dispatch 2024-06-13T02:06:26.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:25 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "856e86b6-9281-485b-a36b-2fe04de31329"}]: dispatch 2024-06-13T02:06:26.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:25 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "856e86b6-9281-485b-a36b-2fe04de31329"}]': finished 2024-06-13T02:06:26.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:25 smithi002 ceph-mon[31960]: osdmap e10: 2 total, 1 up, 2 in 2024-06-13T02:06:26.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:06:26.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:25 smithi002 ceph-mon[31960]: from='client.? 172.21.15.84:0/2338745989' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:06:28.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:27 smithi084 ceph-mon[36833]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:28.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:27 smithi175 ceph-mon[36977]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:28.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:27 smithi002 ceph-mon[31960]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:30.195 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:29 smithi084 ceph-mon[36833]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:30.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:29 smithi175 ceph-mon[36977]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:30.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:29 smithi002 ceph-mon[31960]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:32.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:31 smithi084 ceph-mon[36833]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:32.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:31 smithi175 ceph-mon[36977]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:32.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:31 smithi002 ceph-mon[31960]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:33.048 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:32 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-13T02:06:33.049 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:32 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:33.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:32 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-13T02:06:33.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:32 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:33.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:32 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-13T02:06:33.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:32 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:34.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:33 smithi175 ceph-mon[36977]: Deploying daemon osd.1 on smithi084 2024-06-13T02:06:34.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:33 smithi175 ceph-mon[36977]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:34.362 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:33 smithi084 ceph-mon[36833]: Deploying daemon osd.1 on smithi084 2024-06-13T02:06:34.362 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:33 smithi084 ceph-mon[36833]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:34.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:33 smithi002 ceph-mon[31960]: Deploying daemon osd.1 on smithi084 2024-06-13T02:06:34.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:33 smithi002 ceph-mon[31960]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:36.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:35 smithi175 ceph-mon[36977]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:36.326 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:35 smithi084 ceph-mon[36833]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:36.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:35 smithi002 ceph-mon[31960]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:38.109 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:37 smithi084 ceph-mon[36833]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:38.109 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:37 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:38.109 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:37 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:38.109 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:37 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:06:38.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:37 smithi175 ceph-mon[36977]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:38.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:37 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:38.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:37 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:38.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:37 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:06:38.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:37 smithi002 ceph-mon[31960]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:38.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:37 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:38.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:37 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:38.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:37 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:06:40.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:39 smithi084 ceph-mon[36833]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:40.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:40.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:40.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:40.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:06:40.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:40.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:39 smithi175 ceph-mon[36977]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:40.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:40.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:40.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:40.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:06:40.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:40.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:39 smithi002 ceph-mon[31960]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:40.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:40.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:40.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:40.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:06:40.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:41.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:41.385+0000 7f7688ff9700 1 -- 172.21.15.84:0/1917679840 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f768c0628d0 con 0x7f76740a2c10 2024-06-13T02:06:41.386 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 1 on host 'smithi084' 2024-06-13T02:06:41.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:41.387+0000 7f76920ea700 1 -- 172.21.15.84:0/1917679840 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f76740a2c10 msgr2=0x7f76740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:06:41.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:41.387+0000 7f76920ea700 1 --2- 172.21.15.84:0/1917679840 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f76740a2c10 0x7f76740a50d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f767c003890 tx=0x7f767c000bc0 comp rx=0 tx=0).stop 2024-06-13T02:06:41.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:41.387+0000 7f76920ea700 1 -- 172.21.15.84:0/1917679840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f768c1040e0 msgr2=0x7f768c19fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:06:41.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:41.387+0000 7f76920ea700 1 --2- 172.21.15.84:0/1917679840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f768c1040e0 0x7f768c19fe90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f768400b970 tx=0x7f768400bc80 comp rx=0 tx=0).stop 2024-06-13T02:06:41.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:41.387+0000 7f76920ea700 1 -- 172.21.15.84:0/1917679840 shutdown_connections 2024-06-13T02:06:41.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:41.387+0000 7f76920ea700 1 --2- 172.21.15.84:0/1917679840 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f76740a2c10 0x7f76740a50d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:41.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:41.387+0000 7f76920ea700 1 --2- 172.21.15.84:0/1917679840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f768c1040e0 0x7f768c19fe90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:41.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:41.387+0000 7f76920ea700 1 --2- 172.21.15.84:0/1917679840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f768c102540 0x7f768c1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:41.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:41.387+0000 7f76920ea700 1 --2- 172.21.15.84:0/1917679840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f768c103740 0x7f768c198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:41.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:41.387+0000 7f76920ea700 1 -- 172.21.15.84:0/1917679840 >> 172.21.15.84:0/1917679840 conn(0x7f768c0fdae0 msgr2=0x7f768c106ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:06:41.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:41.388+0000 7f76920ea700 1 -- 172.21.15.84:0/1917679840 shutdown_connections 2024-06-13T02:06:41.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:06:41.388+0000 7f76920ea700 1 -- 172.21.15.84:0/1917679840 wait complete. 2024-06-13T02:06:41.952 DEBUG:teuthology.orchestra.run.smithi084:osd.1> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.1.service 2024-06-13T02:06:41.955 INFO:tasks.cephadm:Deploying osd.2 on smithi175 with /dev/vg_nvme/lv_4... 2024-06-13T02:06:41.955 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-13T02:06:42.200 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:06:42.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:42 smithi084 ceph-mon[36833]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:42.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:42 smithi084 ceph-mon[36833]: from='osd.1 [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-13T02:06:42.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:42 smithi084 ceph-mon[36833]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-13T02:06:42.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:42.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:06:42.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:42.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:42 smithi175 ceph-mon[36977]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:42.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:42 smithi175 ceph-mon[36977]: from='osd.1 [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-13T02:06:42.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:42 smithi175 ceph-mon[36977]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-13T02:06:42.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:42.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:06:42.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:42.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:42 smithi002 ceph-mon[31960]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:42 smithi002 ceph-mon[31960]: from='osd.1 [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-13T02:06:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:42 smithi002 ceph-mon[31960]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-13T02:06:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:06:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:43.330 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:43 smithi175 ceph-mon[36977]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-13T02:06:43.330 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:43 smithi175 ceph-mon[36977]: from='osd.1 [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:06:43.330 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:43 smithi175 ceph-mon[36977]: osdmap e11: 2 total, 1 up, 2 in 2024-06-13T02:06:43.330 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:43 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:06:43.330 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:43 smithi175 ceph-mon[36977]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:06:43.330 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:43 smithi175 ceph-mon[36977]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-06-13T02:06:43.330 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:43 smithi175 ceph-mon[36977]: osdmap e12: 2 total, 1 up, 2 in 2024-06-13T02:06:43.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:43 smithi002 ceph-mon[31960]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-13T02:06:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:43 smithi002 ceph-mon[31960]: from='osd.1 [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:06:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:43 smithi002 ceph-mon[31960]: osdmap e11: 2 total, 1 up, 2 in 2024-06-13T02:06:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:43 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:06:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:43 smithi002 ceph-mon[31960]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:06:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:43 smithi002 ceph-mon[31960]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-06-13T02:06:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:43 smithi002 ceph-mon[31960]: osdmap e12: 2 total, 1 up, 2 in 2024-06-13T02:06:43.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:43 smithi084 ceph-mon[36833]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-13T02:06:43.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:43 smithi084 ceph-mon[36833]: from='osd.1 [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:06:43.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:43 smithi084 ceph-mon[36833]: osdmap e11: 2 total, 1 up, 2 in 2024-06-13T02:06:43.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:43 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:06:43.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:43 smithi084 ceph-mon[36833]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:06:43.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:43 smithi084 ceph-mon[36833]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-06-13T02:06:43.430 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:43 smithi084 ceph-mon[36833]: osdmap e12: 2 total, 1 up, 2 in 2024-06-13T02:06:43.970 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:06:43 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-1[41372]: 2024-06-13T02:06:43.688+0000 7f1a5ba0b700 -1 osd.1 0 waiting for initial osdmap 2024-06-13T02:06:43.971 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:06:43 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-1[41372]: 2024-06-13T02:06:43.692+0000 7f1a537f6700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T02:06:44.033 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-13T02:06:44.033 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-13T02:06:44.033 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-06-13T02:06:44.034 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-06-13T02:06:44.034 INFO:teuthology.orchestra.run.smithi175.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0130414 s, 804 MB/s 2024-06-13T02:06:44.034 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-06-13T02:06:44.331 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:44 smithi175 ceph-mon[36977]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:44.331 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:44 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:06:44.331 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:44 smithi175 ceph-mon[36977]: from='osd.1 ' entity='osd.1' 2024-06-13T02:06:44.331 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:44 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:06:44.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:44 smithi002 ceph-mon[31960]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:44.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:44 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:06:44.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:44 smithi002 ceph-mon[31960]: from='osd.1 ' entity='osd.1' 2024-06-13T02:06:44.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:44 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:06:44.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:44 smithi084 ceph-mon[36833]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:44.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:44 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:06:44.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:44 smithi084 ceph-mon[36833]: from='osd.1 ' entity='osd.1' 2024-06-13T02:06:44.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:44 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:06:44.610 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_4 2024-06-13T02:06:44.845 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:06:45.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:45 smithi084 ceph-mon[36833]: purged_snaps scrub starts 2024-06-13T02:06:45.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:45 smithi084 ceph-mon[36833]: purged_snaps scrub ok 2024-06-13T02:06:45.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:45 smithi084 ceph-mon[36833]: osd.1 [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403] boot 2024-06-13T02:06:45.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:45 smithi084 ceph-mon[36833]: osdmap e13: 2 total, 2 up, 2 in 2024-06-13T02:06:45.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:06:45.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:45.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:45.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:06:45.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:45.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:45.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:06:45.275 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:45 smithi175 ceph-mon[36977]: purged_snaps scrub starts 2024-06-13T02:06:45.276 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:45 smithi175 ceph-mon[36977]: purged_snaps scrub ok 2024-06-13T02:06:45.276 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:45 smithi175 ceph-mon[36977]: osd.1 [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403] boot 2024-06-13T02:06:45.276 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:45 smithi175 ceph-mon[36977]: osdmap e13: 2 total, 2 up, 2 in 2024-06-13T02:06:45.276 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:06:45.276 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:45.276 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:45.276 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:06:45.276 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:45.276 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:45.276 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:06:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:45 smithi002 ceph-mon[31960]: purged_snaps scrub starts 2024-06-13T02:06:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:45 smithi002 ceph-mon[31960]: purged_snaps scrub ok 2024-06-13T02:06:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:45 smithi002 ceph-mon[31960]: osd.1 [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403] boot 2024-06-13T02:06:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:45 smithi002 ceph-mon[31960]: osdmap e13: 2 total, 2 up, 2 in 2024-06-13T02:06:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:06:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:06:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:06:46.189 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:46 smithi175 ceph-mon[36977]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:46.189 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:46 smithi175 ceph-mon[36977]: Detected new or changed devices on smithi084 2024-06-13T02:06:46.189 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:46 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi084 to 17088M 2024-06-13T02:06:46.189 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:46 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:46.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.376+0000 7fce31cff700 1 -- 172.21.15.175:0/3109724809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce2c1036f0 msgr2=0x7fce2c103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:06:46.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.376+0000 7fce31cff700 1 --2- 172.21.15.175:0/3109724809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce2c1036f0 0x7fce2c103b50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fce14009990 tx=0x7fce14009ca0 comp rx=0 tx=0).stop 2024-06-13T02:06:46.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.376+0000 7fce31cff700 1 -- 172.21.15.175:0/3109724809 shutdown_connections 2024-06-13T02:06:46.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.376+0000 7fce31cff700 1 --2- 172.21.15.175:0/3109724809 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce2c104090 0x7fce2c10a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:46.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.376+0000 7fce31cff700 1 --2- 172.21.15.175:0/3109724809 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce2c1024f0 0x7fce2c102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:46.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.376+0000 7fce31cff700 1 --2- 172.21.15.175:0/3109724809 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce2c1036f0 0x7fce2c103b50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:46.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.376+0000 7fce31cff700 1 -- 172.21.15.175:0/3109724809 >> 172.21.15.175:0/3109724809 conn(0x7fce2c0fda90 msgr2=0x7fce2c0ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:06:46.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.376+0000 7fce31cff700 1 -- 172.21.15.175:0/3109724809 shutdown_connections 2024-06-13T02:06:46.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.376+0000 7fce31cff700 1 -- 172.21.15.175:0/3109724809 wait complete. 2024-06-13T02:06:46.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.376+0000 7fce31cff700 1 Processor -- start 2024-06-13T02:06:46.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.376+0000 7fce31cff700 1 -- start start 2024-06-13T02:06:46.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce31cff700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce2c1024f0 0x7fce2c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:06:46.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce31cff700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce2c1036f0 0x7fce2c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:06:46.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce31cff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce2c104090 0x7fce2c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:06:46.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce31cff700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c10e1a0 con 0x7fce2c1024f0 2024-06-13T02:06:46.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce31cff700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c10e020 con 0x7fce2c1036f0 2024-06-13T02:06:46.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce31cff700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c10e320 con 0x7fce2c104090 2024-06-13T02:06:46.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce2bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce2c104090 0x7fce2c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:06:46.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce2bfff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce2c104090 0x7fce2c19fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41518/0 (socket says 172.21.15.175:41518) 2024-06-13T02:06:46.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce2bfff700 1 -- 172.21.15.175:0/1950459181 learned_addr learned my addr 172.21.15.175:0/1950459181 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-06-13T02:06:46.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce22ffd700 1 --2- 172.21.15.175:0/1950459181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce2c1036f0 0x7fce2c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:06:46.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce2bfff700 1 -- 172.21.15.175:0/1950459181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce2c1036f0 msgr2=0x7fce2c198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:06:46.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce2bfff700 1 --2- 172.21.15.175:0/1950459181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce2c1036f0 0x7fce2c198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:46.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce2bfff700 1 -- 172.21.15.175:0/1950459181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce2c1024f0 msgr2=0x7fce2c1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:06:46.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce2bfff700 1 --2- 172.21.15.175:0/1950459181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce2c1024f0 0x7fce2c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:06:46.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce2bfff700 1 -- 172.21.15.175:0/1950459181 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2c1a0440 con 0x7fce2c104090 2024-06-13T02:06:46.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce2bfff700 1 --2- 172.21.15.175:0/1950459181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce2c104090 0x7fce2c19fda0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fce2400b9a0 tx=0x7fce2400bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:06:46.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce297fa700 1 -- 172.21.15.175:0/1950459181 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24019070 con 0x7fce2c104090 2024-06-13T02:06:46.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce297fa700 1 -- 172.21.15.175:0/1950459181 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce2400ce10 con 0x7fce2c104090 2024-06-13T02:06:46.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce31cff700 1 -- 172.21.15.175:0/1950459181 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce2c1a0730 con 0x7fce2c104090 2024-06-13T02:06:46.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.377+0000 7fce297fa700 1 -- 172.21.15.175:0/1950459181 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce240073d0 con 0x7fce2c104090 2024-06-13T02:06:46.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.378+0000 7fce31cff700 1 -- 172.21.15.175:0/1950459181 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce2c1a0cf0 con 0x7fce2c104090 2024-06-13T02:06:46.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.378+0000 7fce31cff700 1 -- 172.21.15.175:0/1950459181 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce2c069180 con 0x7fce2c104090 2024-06-13T02:06:46.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:46 smithi002 ceph-mon[31960]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:46.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:46 smithi002 ceph-mon[31960]: Detected new or changed devices on smithi084 2024-06-13T02:06:46.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:46 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi084 to 17088M 2024-06-13T02:06:46.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:46 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:46.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.380+0000 7fce297fa700 1 -- 172.21.15.175:0/1950459181 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7fce2401c070 con 0x7fce2c104090 2024-06-13T02:06:46.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.380+0000 7fce297fa700 1 --2- 172.21.15.175:0/1950459181 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fce180a2c10 0x7fce180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:06:46.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.380+0000 7fce297fa700 1 -- 172.21.15.175:0/1950459181 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7fce240ccf80 con 0x7fce2c104090 2024-06-13T02:06:46.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.381+0000 7fce2b7fe700 1 --2- 172.21.15.175:0/1950459181 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fce180a2c10 0x7fce180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:06:46.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.382+0000 7fce2b7fe700 1 --2- 172.21.15.175:0/1950459181 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fce180a2c10 0x7fce180a50d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fce2c103550 tx=0x7fce1c009470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:06:46.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.384+0000 7fce297fa700 1 -- 172.21.15.175:0/1950459181 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fce2409b730 con 0x7fce2c104090 2024-06-13T02:06:46.397 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:46 smithi084 ceph-mon[36833]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-13T02:06:46.397 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:46 smithi084 ceph-mon[36833]: Detected new or changed devices on smithi084 2024-06-13T02:06:46.397 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:46 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi084 to 17088M 2024-06-13T02:06:46.397 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:46 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:06:46.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:06:46.589+0000 7fce31cff700 1 -- 172.21.15.175:0/1950459181 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fce2c0628d0 con 0x7fce180a2c10 2024-06-13T02:06:47.376 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:47 smithi175 ceph-mon[36977]: osdmap e14: 2 total, 2 up, 2 in 2024-06-13T02:06:47.376 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:06:47.377 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:06:47.377 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:47.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:47 smithi002 ceph-mon[31960]: osdmap e14: 2 total, 2 up, 2 in 2024-06-13T02:06:47.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:06:47.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:06:47.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:47.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:47 smithi084 ceph-mon[36833]: osdmap e14: 2 total, 2 up, 2 in 2024-06-13T02:06:47.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:06:47.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:06:47.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:48.332 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:48 smithi175 ceph-mon[36977]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:48.332 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:48 smithi175 ceph-mon[36977]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:06:48.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:48 smithi002 ceph-mon[31960]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:48.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:48 smithi002 ceph-mon[31960]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:06:48.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:48 smithi084 ceph-mon[36833]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:48.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:48 smithi084 ceph-mon[36833]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:06:50.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:50 smithi002 ceph-mon[31960]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:50 smithi002 ceph-mon[31960]: from='client.? 172.21.15.175:0/435226533' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c9daa52-0dfb-471a-afb4-6eb0b908195a"}]: dispatch 2024-06-13T02:06:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:50 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c9daa52-0dfb-471a-afb4-6eb0b908195a"}]: dispatch 2024-06-13T02:06:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:50 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c9daa52-0dfb-471a-afb4-6eb0b908195a"}]': finished 2024-06-13T02:06:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:50 smithi002 ceph-mon[31960]: osdmap e15: 3 total, 2 up, 3 in 2024-06-13T02:06:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:50 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:06:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:50 smithi002 ceph-mon[31960]: from='client.? 172.21.15.175:0/1890505099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:06:50.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:50 smithi084 ceph-mon[36833]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:50.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:50 smithi084 ceph-mon[36833]: from='client.? 172.21.15.175:0/435226533' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c9daa52-0dfb-471a-afb4-6eb0b908195a"}]: dispatch 2024-06-13T02:06:50.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:50 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c9daa52-0dfb-471a-afb4-6eb0b908195a"}]: dispatch 2024-06-13T02:06:50.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:50 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c9daa52-0dfb-471a-afb4-6eb0b908195a"}]': finished 2024-06-13T02:06:50.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:50 smithi084 ceph-mon[36833]: osdmap e15: 3 total, 2 up, 3 in 2024-06-13T02:06:50.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:50 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:06:50.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:50 smithi084 ceph-mon[36833]: from='client.? 172.21.15.175:0/1890505099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:06:50.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:50 smithi175 ceph-mon[36977]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:50 smithi175 ceph-mon[36977]: from='client.? 172.21.15.175:0/435226533' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c9daa52-0dfb-471a-afb4-6eb0b908195a"}]: dispatch 2024-06-13T02:06:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:50 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c9daa52-0dfb-471a-afb4-6eb0b908195a"}]: dispatch 2024-06-13T02:06:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:50 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c9daa52-0dfb-471a-afb4-6eb0b908195a"}]': finished 2024-06-13T02:06:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:50 smithi175 ceph-mon[36977]: osdmap e15: 3 total, 2 up, 3 in 2024-06-13T02:06:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:50 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:06:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:50 smithi175 ceph-mon[36977]: from='client.? 172.21.15.175:0/1890505099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:06:52.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:52 smithi002 ceph-mon[31960]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:52.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:52 smithi084 ceph-mon[36833]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:52.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:52 smithi175 ceph-mon[36977]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:53.366 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:53 smithi175 ceph-mon[36977]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:53.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:53 smithi084 ceph-mon[36833]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:53.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:53 smithi002 ceph-mon[31960]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:55.574 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:55 smithi175 ceph-mon[36977]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:55.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:55 smithi084 ceph-mon[36833]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:55.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:55 smithi002 ceph-mon[31960]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:56.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:56 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-13T02:06:56.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:56 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:56.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:56 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-13T02:06:56.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:56 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:56.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:56 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-13T02:06:56.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:56 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:06:57.665 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:57 smithi175 ceph-mon[36977]: Deploying daemon osd.2 on smithi175 2024-06-13T02:06:57.665 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:57 smithi175 ceph-mon[36977]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:57.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:57 smithi084 ceph-mon[36833]: Deploying daemon osd.2 on smithi175 2024-06-13T02:06:57.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:57 smithi084 ceph-mon[36833]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:57.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:57 smithi002 ceph-mon[31960]: Deploying daemon osd.2 on smithi175 2024-06-13T02:06:57.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:57 smithi002 ceph-mon[31960]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:59.679 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:06:59 smithi175 ceph-mon[36977]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:59.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:06:59 smithi084 ceph-mon[36833]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:06:59.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:06:59 smithi002 ceph-mon[31960]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:01.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:01 smithi175 ceph-mon[36977]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:01.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:01 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:01.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:01 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:01.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:01 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:07:01.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:01 smithi084 ceph-mon[36833]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:01.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:01 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:01.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:01 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:01.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:01 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:07:01.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:01 smithi002 ceph-mon[31960]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:01.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:01 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:01.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:01 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:01.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:01 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:07:03.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:03 smithi175 ceph-mon[36977]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:03.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:03 smithi084 ceph-mon[36833]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:03.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:03 smithi002 ceph-mon[31960]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:04.476 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 2 on host 'smithi175' 2024-06-13T02:07:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:07:04.475+0000 7fce297fa700 1 -- 172.21.15.175:0/1950459181 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fce2c0628d0 con 0x7fce180a2c10 2024-06-13T02:07:04.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:07:04.478+0000 7fce31cff700 1 -- 172.21.15.175:0/1950459181 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fce180a2c10 msgr2=0x7fce180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:07:04.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:07:04.478+0000 7fce31cff700 1 --2- 172.21.15.175:0/1950459181 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fce180a2c10 0x7fce180a50d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fce2c103550 tx=0x7fce1c009470 comp rx=0 tx=0).stop 2024-06-13T02:07:04.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:07:04.478+0000 7fce31cff700 1 -- 172.21.15.175:0/1950459181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce2c104090 msgr2=0x7fce2c19fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:07:04.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:07:04.478+0000 7fce31cff700 1 --2- 172.21.15.175:0/1950459181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce2c104090 0x7fce2c19fda0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fce2400b9a0 tx=0x7fce2400bcb0 comp rx=0 tx=0).stop 2024-06-13T02:07:04.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:07:04.480+0000 7fce31cff700 1 -- 172.21.15.175:0/1950459181 shutdown_connections 2024-06-13T02:07:04.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:07:04.480+0000 7fce31cff700 1 --2- 172.21.15.175:0/1950459181 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fce180a2c10 0x7fce180a50d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:04.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:07:04.480+0000 7fce31cff700 1 --2- 172.21.15.175:0/1950459181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce2c104090 0x7fce2c19fda0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:04.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:07:04.480+0000 7fce31cff700 1 --2- 172.21.15.175:0/1950459181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce2c1024f0 0x7fce2c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:04.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:07:04.480+0000 7fce31cff700 1 --2- 172.21.15.175:0/1950459181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce2c1036f0 0x7fce2c198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:04.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:07:04.480+0000 7fce31cff700 1 -- 172.21.15.175:0/1950459181 >> 172.21.15.175:0/1950459181 conn(0x7fce2c0fda90 msgr2=0x7fce2c1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:07:04.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:07:04.480+0000 7fce31cff700 1 -- 172.21.15.175:0/1950459181 shutdown_connections 2024-06-13T02:07:04.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:07:04.480+0000 7fce31cff700 1 -- 172.21.15.175:0/1950459181 wait complete. 2024-06-13T02:07:05.065 DEBUG:teuthology.orchestra.run.smithi175:osd.2> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.2.service 2024-06-13T02:07:05.067 INFO:tasks.cephadm:Deploying osd.3 on smithi002 with /dev/vg_nvme/lv_3... 2024-06-13T02:07:05.067 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-13T02:07:05.412 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:07:05 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-2[42091]: 2024-06-13T02:07:05.236+0000 7fa22e9917c0 -1 osd.2 0 log_to_monitors true 2024-06-13T02:07:05.541 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:07:05.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:05 smithi002 ceph-mon[31960]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:05.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:05.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:05.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:05.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:05.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:05 smithi002 ceph-mon[31960]: from='osd.2 [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-13T02:07:05.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:05 smithi002 ceph-mon[31960]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-13T02:07:05.714 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:05 smithi175 ceph-mon[36977]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:05.714 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:05.714 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:05.714 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:05.714 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:05.714 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:05 smithi175 ceph-mon[36977]: from='osd.2 [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-13T02:07:05.714 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:05 smithi175 ceph-mon[36977]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-13T02:07:05.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:05 smithi084 ceph-mon[36833]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:05.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:05.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:05.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:05 smithi084 ceph-mon[36833]: from='osd.2 [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-13T02:07:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:05 smithi084 ceph-mon[36833]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-13T02:07:06.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:06 smithi002 ceph-mon[31960]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-13T02:07:06.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:06 smithi002 ceph-mon[31960]: from='osd.2 [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:07:06.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:06 smithi002 ceph-mon[31960]: osdmap e16: 3 total, 2 up, 3 in 2024-06-13T02:07:06.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:06 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:07:06.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:06 smithi002 ceph-mon[31960]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:07:06.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:06 smithi084 ceph-mon[36833]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-13T02:07:06.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:06 smithi084 ceph-mon[36833]: from='osd.2 [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:07:06.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:06 smithi084 ceph-mon[36833]: osdmap e16: 3 total, 2 up, 3 in 2024-06-13T02:07:06.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:06 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:07:06.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:06 smithi084 ceph-mon[36833]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:07:07.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:06 smithi175 ceph-mon[36977]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-13T02:07:07.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:06 smithi175 ceph-mon[36977]: from='osd.2 [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:07:07.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:06 smithi175 ceph-mon[36977]: osdmap e16: 3 total, 2 up, 3 in 2024-06-13T02:07:07.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:06 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:07:07.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:06 smithi175 ceph-mon[36977]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:07:07.915 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:07:07 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-2[42091]: 2024-06-13T02:07:07.576+0000 7fa223ff5700 -1 osd.2 0 waiting for initial osdmap 2024-06-13T02:07:07.916 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:07:07 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-2[42091]: 2024-06-13T02:07:07.582+0000 7fa21bde0700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T02:07:07.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:07 smithi175 ceph-mon[36977]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:07.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:07 smithi175 ceph-mon[36977]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-06-13T02:07:07.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:07 smithi175 ceph-mon[36977]: osdmap e17: 3 total, 2 up, 3 in 2024-06-13T02:07:07.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:07 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:07:07.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:07 smithi175 ceph-mon[36977]: from='osd.2 ' entity='osd.2' 2024-06-13T02:07:07.916 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:07 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:07:08.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:07 smithi002 ceph-mon[31960]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:08.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:07 smithi002 ceph-mon[31960]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-06-13T02:07:08.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:07 smithi002 ceph-mon[31960]: osdmap e17: 3 total, 2 up, 3 in 2024-06-13T02:07:08.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:07 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:07:08.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:07 smithi002 ceph-mon[31960]: from='osd.2 ' entity='osd.2' 2024-06-13T02:07:08.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:07 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:07:08.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:07 smithi084 ceph-mon[36833]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:08.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:07 smithi084 ceph-mon[36833]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-06-13T02:07:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:07 smithi084 ceph-mon[36833]: osdmap e17: 3 total, 2 up, 3 in 2024-06-13T02:07:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:07 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:07:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:07 smithi084 ceph-mon[36833]: from='osd.2 ' entity='osd.2' 2024-06-13T02:07:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:07 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:07:08.557 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-13T02:07:08.557 INFO:teuthology.orchestra.run.smithi002.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-13T02:07:08.557 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10+0 records in 2024-06-13T02:07:08.557 INFO:teuthology.orchestra.run.smithi002.stderr:10+0 records out 2024-06-13T02:07:08.557 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0321895 s, 326 MB/s 2024-06-13T02:07:08.557 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping successful for: 2024-06-13T02:07:09.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: purged_snaps scrub starts 2024-06-13T02:07:09.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: purged_snaps scrub ok 2024-06-13T02:07:09.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:09.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:09.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:07:09.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:09.104 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:09.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:07:09.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:09.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: osd.2 [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558] boot 2024-06-13T02:07:09.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: osdmap e18: 3 total, 3 up, 3 in 2024-06-13T02:07:09.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:07:09.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:07:09.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:09.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:07:09.105 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:08 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:09.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: purged_snaps scrub starts 2024-06-13T02:07:09.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: purged_snaps scrub ok 2024-06-13T02:07:09.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:09.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:09.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:07:09.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:09.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:09.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:07:09.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:09.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: osd.2 [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558] boot 2024-06-13T02:07:09.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: osdmap e18: 3 total, 3 up, 3 in 2024-06-13T02:07:09.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:07:09.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:07:09.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:09.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:07:09.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:08 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:09.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: purged_snaps scrub starts 2024-06-13T02:07:09.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: purged_snaps scrub ok 2024-06-13T02:07:09.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:09.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:09.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:07:09.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:09.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:09.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:07:09.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:09.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: osd.2 [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558] boot 2024-06-13T02:07:09.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: osdmap e18: 3 total, 3 up, 3 in 2024-06-13T02:07:09.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:07:09.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:07:09.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:09.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:07:09.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:08 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:09.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_3 2024-06-13T02:07:09.962 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:07:10.091 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:09 smithi002 ceph-mon[31960]: Detected new or changed devices on smithi175 2024-06-13T02:07:10.091 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:09 smithi002 ceph-mon[31960]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:10.091 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:09 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi175 to 17088M 2024-06-13T02:07:10.117 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:09 smithi175 ceph-mon[36977]: Detected new or changed devices on smithi175 2024-06-13T02:07:10.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:09 smithi175 ceph-mon[36977]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:10.118 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:09 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi175 to 17088M 2024-06-13T02:07:10.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:09 smithi084 ceph-mon[36833]: Detected new or changed devices on smithi175 2024-06-13T02:07:10.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:09 smithi084 ceph-mon[36833]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-13T02:07:10.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:09 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi175 to 17088M 2024-06-13T02:07:11.206 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:11 smithi002 ceph-mon[31960]: osdmap e19: 3 total, 3 up, 3 in 2024-06-13T02:07:11.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:11 smithi175 ceph-mon[36977]: osdmap e19: 3 total, 3 up, 3 in 2024-06-13T02:07:11.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:11 smithi084 ceph-mon[36833]: osdmap e19: 3 total, 3 up, 3 in 2024-06-13T02:07:12.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.039+0000 7f29a1c00700 1 -- 172.21.15.2:0/418641122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f299c10eae0 msgr2=0x7f299c110ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:07:12.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.039+0000 7f29a1c00700 1 --2- 172.21.15.2:0/418641122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f299c10eae0 0x7f299c110ed0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f299400b0a0 tx=0x7f299400b3b0 comp rx=0 tx=0).stop 2024-06-13T02:07:12.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.039+0000 7f29a1c00700 1 -- 172.21.15.2:0/418641122 shutdown_connections 2024-06-13T02:07:12.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.039+0000 7f29a1c00700 1 --2- 172.21.15.2:0/418641122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f299c10eae0 0x7f299c110ed0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:12.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.039+0000 7f29a1c00700 1 --2- 172.21.15.2:0/418641122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f299c0764c0 0x7f299c074920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:12.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.039+0000 7f29a1c00700 1 --2- 172.21.15.2:0/418641122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f299c074ef0 0x7f299c075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:12.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.039+0000 7f29a1c00700 1 -- 172.21.15.2:0/418641122 >> 172.21.15.2:0/418641122 conn(0x7f299c0fda60 msgr2=0x7f299c0ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:07:12.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.040+0000 7f29a1c00700 1 -- 172.21.15.2:0/418641122 shutdown_connections 2024-06-13T02:07:12.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.040+0000 7f29a1c00700 1 -- 172.21.15.2:0/418641122 wait complete. 2024-06-13T02:07:12.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.041+0000 7f29a1c00700 1 Processor -- start 2024-06-13T02:07:12.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.041+0000 7f29a1c00700 1 -- start start 2024-06-13T02:07:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.041+0000 7f29a1c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f299c074ef0 0x7f299c19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:07:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.041+0000 7f29a1c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f299c0764c0 0x7f299c19f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:07:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.041+0000 7f29a1c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f299c10eae0 0x7f299c1a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:07:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.041+0000 7f29a1c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f299c114730 con 0x7f299c0764c0 2024-06-13T02:07:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.041+0000 7f29a1c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f299c1145b0 con 0x7f299c074ef0 2024-06-13T02:07:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.041+0000 7f29a1c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f299c1148b0 con 0x7f299c10eae0 2024-06-13T02:07:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.042+0000 7f2993e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f299c0764c0 0x7f299c19f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:07:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.042+0000 7f299aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f299c074ef0 0x7f299c19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:07:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.042+0000 7f299aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f299c074ef0 0x7f299c19ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37698/0 (socket says 172.21.15.2:37698) 2024-06-13T02:07:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.042+0000 7f299aa00700 1 -- 172.21.15.2:0/2351223159 learned_addr learned my addr 172.21.15.2:0/2351223159 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:07:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.042+0000 7f299b400700 1 --2- 172.21.15.2:0/2351223159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f299c10eae0 0x7f299c1a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:07:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.042+0000 7f299aa00700 1 -- 172.21.15.2:0/2351223159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f299c10eae0 msgr2=0x7f299c1a6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:07:12.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.042+0000 7f299aa00700 1 --2- 172.21.15.2:0/2351223159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f299c10eae0 0x7f299c1a6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:12.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.042+0000 7f299aa00700 1 -- 172.21.15.2:0/2351223159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f299c0764c0 msgr2=0x7f299c19f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:07:12.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.042+0000 7f299aa00700 1 --2- 172.21.15.2:0/2351223159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f299c0764c0 0x7f299c19f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:12.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.042+0000 7f299aa00700 1 -- 172.21.15.2:0/2351223159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c1a6950 con 0x7f299c074ef0 2024-06-13T02:07:12.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.043+0000 7f299aa00700 1 --2- 172.21.15.2:0/2351223159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f299c074ef0 0x7f299c19ed00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f298c00e970 tx=0x7f298c00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:07:12.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.043+0000 7f2993400700 1 -- 172.21.15.2:0/2351223159 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c004a30 con 0x7f299c074ef0 2024-06-13T02:07:12.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.043+0000 7f29a1c00700 1 -- 172.21.15.2:0/2351223159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f299c1a6c40 con 0x7f299c074ef0 2024-06-13T02:07:12.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.043+0000 7f2993400700 1 -- 172.21.15.2:0/2351223159 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f298c00ccc0 con 0x7f299c074ef0 2024-06-13T02:07:12.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.043+0000 7f2993400700 1 -- 172.21.15.2:0/2351223159 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c005650 con 0x7f299c074ef0 2024-06-13T02:07:12.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.043+0000 7f29a1c00700 1 -- 172.21.15.2:0/2351223159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299c1a7180 con 0x7f299c074ef0 2024-06-13T02:07:12.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.044+0000 7f29a1c00700 1 -- 172.21.15.2:0/2351223159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f299c069180 con 0x7f299c074ef0 2024-06-13T02:07:12.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.046+0000 7f2993400700 1 -- 172.21.15.2:0/2351223159 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 15) ==== 137776+0+0 (secure 0 0 0) 0x7f298c004bd0 con 0x7f299c074ef0 2024-06-13T02:07:12.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.047+0000 7f2993400700 1 --2- 172.21.15.2:0/2351223159 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f29800a2c10 0x7f29800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:07:12.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.048+0000 7f2993400700 1 -- 172.21.15.2:0/2351223159 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3226+0+0 (secure 0 0 0) 0x7f298c0cdd10 con 0x7f299c074ef0 2024-06-13T02:07:12.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.048+0000 7f2993e00700 1 --2- 172.21.15.2:0/2351223159 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f29800a2c10 0x7f29800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:07:12.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.048+0000 7f2993e00700 1 --2- 172.21.15.2:0/2351223159 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f29800a2c10 0x7f29800a50d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f299c0761f0 tx=0x7f2984007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:07:12.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.052+0000 7f2993400700 1 -- 172.21.15.2:0/2351223159 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f298c09c090 con 0x7f299c074ef0 2024-06-13T02:07:12.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:12 smithi002 ceph-mon[31960]: pgmap v92: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:12.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:12 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-13T02:07:12.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:12 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-13T02:07:12.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:12 smithi002 ceph-mon[31960]: osdmap e20: 3 total, 3 up, 3 in 2024-06-13T02:07:12.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:12 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T02:07:12.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:12 smithi175 ceph-mon[36977]: pgmap v92: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:12 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-13T02:07:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:12 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-13T02:07:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:12 smithi175 ceph-mon[36977]: osdmap e20: 3 total, 3 up, 3 in 2024-06-13T02:07:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:12 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T02:07:12.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:12.299+0000 7f29a1c00700 1 -- 172.21.15.2:0/2351223159 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f299c0628d0 con 0x7f29800a2c10 2024-06-13T02:07:12.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:12 smithi084 ceph-mon[36833]: pgmap v92: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:12.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:12 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-13T02:07:12.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:12 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-13T02:07:12.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:12 smithi084 ceph-mon[36833]: osdmap e20: 3 total, 3 up, 3 in 2024-06-13T02:07:12.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:12 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T02:07:13.260 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:07:13 smithi002 sudo[48457]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-13T02:07:13.260 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:07:13 smithi002 sudo[48457]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T02:07:13.260 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:07:13 smithi002 sudo[48457]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T02:07:13.261 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:07:13 smithi002 sudo[48457]: pam_unix(sudo:session): session closed for user root 2024-06-13T02:07:13.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:13 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-13T02:07:13.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:13 smithi002 ceph-mon[31960]: osdmap e21: 3 total, 3 up, 3 in 2024-06-13T02:07:13.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:13 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:07:13.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:13 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:07:13.261 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:13 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:13.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:13 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-13T02:07:13.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:13 smithi084 ceph-mon[36833]: osdmap e21: 3 total, 3 up, 3 in 2024-06-13T02:07:13.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:13 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:07:13.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:13 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:07:13.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:13 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:13.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:13 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-13T02:07:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:13 smithi175 ceph-mon[36977]: osdmap e21: 3 total, 3 up, 3 in 2024-06-13T02:07:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:13 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:07:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:13 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:07:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:13 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:13.881 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:07:13 smithi002 sudo[48507]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-13T02:07:13.881 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:07:13 smithi002 sudo[48507]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T02:07:13.881 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:07:13 smithi002 sudo[48507]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T02:07:13.881 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:07:13 smithi002 sudo[48507]: pam_unix(sudo:session): session closed for user root 2024-06-13T02:07:14.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:14 smithi084 ceph-mon[36833]: from='client.24188 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:07:14.139 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:14 smithi084 ceph-mon[36833]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:14.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:14 smithi084 ceph-mon[36833]: osdmap e22: 3 total, 3 up, 3 in 2024-06-13T02:07:14.140 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:14 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:14.140 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:07:13 smithi084 sudo[45506]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-13T02:07:14.140 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:07:13 smithi084 sudo[45506]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T02:07:14.140 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:07:13 smithi084 sudo[45506]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T02:07:14.141 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:07:13 smithi084 sudo[45506]: pam_unix(sudo:session): session closed for user root 2024-06-13T02:07:14.268 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:14 smithi002 ceph-mon[31960]: from='client.24188 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:07:14.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:14 smithi002 ceph-mon[31960]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:14.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:14 smithi002 ceph-mon[31960]: osdmap e22: 3 total, 3 up, 3 in 2024-06-13T02:07:14.269 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:14 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:14.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:14 smithi175 ceph-mon[36977]: from='client.24188 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:07:14.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:14 smithi175 ceph-mon[36977]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:14.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:14 smithi175 ceph-mon[36977]: osdmap e22: 3 total, 3 up, 3 in 2024-06-13T02:07:14.429 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:14 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:14.470 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:07:14 smithi084 sudo[45509]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-13T02:07:14.470 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:07:14 smithi084 sudo[45509]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T02:07:14.471 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:07:14 smithi084 sudo[45509]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T02:07:14.471 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:07:14 smithi084 sudo[45509]: pam_unix(sudo:session): session closed for user root 2024-06-13T02:07:14.682 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:07:14 smithi175 sudo[45996]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-13T02:07:14.682 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:07:14 smithi175 sudo[45996]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T02:07:14.682 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:07:14 smithi175 sudo[45996]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T02:07:14.682 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:07:14 smithi175 sudo[45996]: pam_unix(sudo:session): session closed for user root 2024-06-13T02:07:15.032 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:07:14 smithi175 sudo[45999]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-13T02:07:15.032 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:07:14 smithi175 sudo[45999]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T02:07:15.033 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:07:14 smithi175 sudo[45999]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T02:07:15.033 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:07:14 smithi175 sudo[45999]: pam_unix(sudo:session): session closed for user root 2024-06-13T02:07:15.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:15 smithi002 sudo[48556]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-13T02:07:15.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:15 smithi002 sudo[48556]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T02:07:15.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:15 smithi002 sudo[48556]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T02:07:15.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:15 smithi002 sudo[48556]: pam_unix(sudo:session): session closed for user root 2024-06-13T02:07:15.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:15.937+0000 7f2993400700 1 -- 172.21.15.2:0/2351223159 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f298c098000 con 0x7f299c074ef0 2024-06-13T02:07:16.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:15 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:16.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:15 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:16.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:15 smithi084 ceph-mon[36833]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T02:07:16.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:15 smithi084 ceph-mon[36833]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T02:07:16.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:15 smithi002 sudo[48579]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-13T02:07:16.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:15 smithi002 sudo[48579]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T02:07:16.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:15 smithi002 sudo[48579]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T02:07:16.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:15 smithi002 sudo[48579]: pam_unix(sudo:session): session closed for user root 2024-06-13T02:07:16.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:15 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:16.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:15 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:16.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:15 smithi002 ceph-mon[31960]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T02:07:16.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:15 smithi002 ceph-mon[31960]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T02:07:16.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 sudo[46002]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-13T02:07:16.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 sudo[46002]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T02:07:16.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 sudo[46002]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T02:07:16.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 sudo[46002]: pam_unix(sudo:session): session closed for user root 2024-06-13T02:07:16.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 sudo[46005]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-13T02:07:16.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 sudo[46005]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T02:07:16.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 sudo[46005]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T02:07:16.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 sudo[46005]: pam_unix(sudo:session): session closed for user root 2024-06-13T02:07:16.422 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:16.423 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:16.423 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T02:07:16.423 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T02:07:16.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 sudo[45512]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-13T02:07:16.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 sudo[45512]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T02:07:16.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 sudo[45512]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T02:07:16.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 sudo[45512]: pam_unix(sudo:session): session closed for user root 2024-06-13T02:07:16.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 sudo[45515]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-13T02:07:16.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 sudo[45515]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-13T02:07:16.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 sudo[45515]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-13T02:07:16.904 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 sudo[45515]: pam_unix(sudo:session): session closed for user root 2024-06-13T02:07:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 93 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:07:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:07:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:07:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T02:07:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-06-13T02:07:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:07:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:07:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:07:17.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3219273182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e747d36-4aa5-4c4c-918d-b8100980cc8d"}]: dispatch 2024-06-13T02:07:17.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T02:07:17.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T02:07:17.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:07:17.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:07:17.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:07:17.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3219273182' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e747d36-4aa5-4c4c-918d-b8100980cc8d"}]': finished 2024-06-13T02:07:17.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: osdmap e23: 4 total, 3 up, 4 in 2024-06-13T02:07:17.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:07:17.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:16 smithi084 ceph-mon[36833]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T02:07:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 93 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:07:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:07:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:07:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T02:07:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-06-13T02:07:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:07:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:07:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:07:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3219273182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e747d36-4aa5-4c4c-918d-b8100980cc8d"}]: dispatch 2024-06-13T02:07:17.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T02:07:17.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T02:07:17.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:07:17.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:07:17.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:07:17.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3219273182' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e747d36-4aa5-4c4c-918d-b8100980cc8d"}]': finished 2024-06-13T02:07:17.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: osdmap e23: 4 total, 3 up, 4 in 2024-06-13T02:07:17.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:07:17.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:16 smithi175 ceph-mon[36977]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T02:07:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 93 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:07:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:07:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:07:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T02:07:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-06-13T02:07:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:07:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:07:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:07:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3219273182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e747d36-4aa5-4c4c-918d-b8100980cc8d"}]: dispatch 2024-06-13T02:07:17.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T02:07:17.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-13T02:07:17.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:07:17.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:07:17.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:07:17.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3219273182' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e747d36-4aa5-4c4c-918d-b8100980cc8d"}]': finished 2024-06-13T02:07:17.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: osdmap e23: 4 total, 3 up, 4 in 2024-06-13T02:07:17.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:07:17.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:16 smithi002 ceph-mon[31960]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-13T02:07:18.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:17 smithi084 ceph-mon[36833]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:18.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:17 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/482369416' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:07:18.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:17 smithi175 ceph-mon[36977]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:18.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:17 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/482369416' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:07:18.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:17 smithi002 ceph-mon[31960]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:18.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:17 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/482369416' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:07:20.198 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:19 smithi002 ceph-mon[31960]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:20.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:19 smithi084 ceph-mon[36833]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:20.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:19 smithi175 ceph-mon[36977]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:22.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:21 smithi002 ceph-mon[31960]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-06-13T02:07:22.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:21 smithi084 ceph-mon[36833]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-06-13T02:07:22.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:21 smithi175 ceph-mon[36977]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-06-13T02:07:24.027 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:23 smithi002 ceph-mon[31960]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-06-13T02:07:24.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:23 smithi084 ceph-mon[36833]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-06-13T02:07:24.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:23 smithi175 ceph-mon[36977]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-06-13T02:07:26.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:25 smithi084 ceph-mon[36833]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-06-13T02:07:26.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:25 smithi175 ceph-mon[36977]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-06-13T02:07:26.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:25 smithi002 ceph-mon[31960]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-06-13T02:07:27.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:26 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-13T02:07:27.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:26 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:27.279 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:26 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-13T02:07:27.279 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:26 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:27.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:26 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-13T02:07:27.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:26 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:28.126 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:27 smithi002 ceph-mon[31960]: Deploying daemon osd.3 on smithi002 2024-06-13T02:07:28.126 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:27 smithi002 ceph-mon[31960]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-13T02:07:28.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:27 smithi084 ceph-mon[36833]: Deploying daemon osd.3 on smithi002 2024-06-13T02:07:28.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:27 smithi084 ceph-mon[36833]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-13T02:07:28.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:27 smithi175 ceph-mon[36977]: Deploying daemon osd.3 on smithi002 2024-06-13T02:07:28.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:27 smithi175 ceph-mon[36977]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-06-13T02:07:30.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:29 smithi084 ceph-mon[36833]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 859 B/s rd, 22 KiB/s wr, 2 op/s 2024-06-13T02:07:30.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:29 smithi175 ceph-mon[36977]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 859 B/s rd, 22 KiB/s wr, 2 op/s 2024-06-13T02:07:30.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:29 smithi002 ceph-mon[31960]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 859 B/s rd, 22 KiB/s wr, 2 op/s 2024-06-13T02:07:32.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:31 smithi002 ceph-mon[31960]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-06-13T02:07:32.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:31 smithi175 ceph-mon[36977]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-06-13T02:07:32.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:31 smithi084 ceph-mon[36833]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-06-13T02:07:34.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:33 smithi002 ceph-mon[31960]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:34.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:33 smithi175 ceph-mon[36977]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:34.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:33 smithi084 ceph-mon[36833]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:35.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:35 smithi084 ceph-mon[36833]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:35.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:35.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:35.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:07:35.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:35 smithi002 ceph-mon[31960]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:35.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:35.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:35.971 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:07:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:35 smithi175 ceph-mon[36977]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:36.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:36.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:36.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:07:37.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:37 smithi084 ceph-mon[36833]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:37.980 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:37 smithi002 ceph-mon[31960]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:38.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:37 smithi175 ceph-mon[36977]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:39.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:39 smithi002 ceph-mon[31960]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:39.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:39.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:39.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:39.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:07:39.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:39.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:39 smithi002 ceph-mon[31960]: from='osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-13T02:07:39.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:39 smithi084 ceph-mon[36833]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:39.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:39.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:39.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:39.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:07:39.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:39.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:39 smithi084 ceph-mon[36833]: from='osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-13T02:07:39.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:39 smithi175 ceph-mon[36977]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:39.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:39.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:39.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:39.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:07:39.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:39.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:39 smithi175 ceph-mon[36977]: from='osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-13T02:07:39.799 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 3 on host 'smithi002' 2024-06-13T02:07:39.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:39.797+0000 7f2993400700 1 -- 172.21.15.2:0/2351223159 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f299c0628d0 con 0x7f29800a2c10 2024-06-13T02:07:39.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:39.801+0000 7f29a1c00700 1 -- 172.21.15.2:0/2351223159 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f29800a2c10 msgr2=0x7f29800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:07:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:39.801+0000 7f29a1c00700 1 --2- 172.21.15.2:0/2351223159 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f29800a2c10 0x7f29800a50d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f299c0761f0 tx=0x7f2984007400 comp rx=0 tx=0).stop 2024-06-13T02:07:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:39.801+0000 7f29a1c00700 1 -- 172.21.15.2:0/2351223159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f299c074ef0 msgr2=0x7f299c19ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:07:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:39.801+0000 7f29a1c00700 1 --2- 172.21.15.2:0/2351223159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f299c074ef0 0x7f299c19ed00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f298c00e970 tx=0x7f298c00ec80 comp rx=0 tx=0).stop 2024-06-13T02:07:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:39.801+0000 7f29a1c00700 1 -- 172.21.15.2:0/2351223159 shutdown_connections 2024-06-13T02:07:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:39.801+0000 7f29a1c00700 1 --2- 172.21.15.2:0/2351223159 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f29800a2c10 0x7f29800a50d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:39.801+0000 7f29a1c00700 1 --2- 172.21.15.2:0/2351223159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f299c10eae0 0x7f299c1a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:39.801+0000 7f29a1c00700 1 --2- 172.21.15.2:0/2351223159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f299c074ef0 0x7f299c19ed00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:39.801+0000 7f29a1c00700 1 --2- 172.21.15.2:0/2351223159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f299c0764c0 0x7f299c19f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:39.801+0000 7f29a1c00700 1 -- 172.21.15.2:0/2351223159 >> 172.21.15.2:0/2351223159 conn(0x7f299c0fda60 msgr2=0x7f299c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:07:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:39.801+0000 7f29a1c00700 1 -- 172.21.15.2:0/2351223159 shutdown_connections 2024-06-13T02:07:39.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:07:39.801+0000 7f29a1c00700 1 -- 172.21.15.2:0/2351223159 wait complete. 2024-06-13T02:07:40.551 DEBUG:teuthology.orchestra.run.smithi002:osd.3> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.3.service 2024-06-13T02:07:40.557 INFO:tasks.cephadm:Deploying osd.4 on smithi084 with /dev/vg_nvme/lv_3... 2024-06-13T02:07:40.557 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-13T02:07:40.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:40 smithi175 ceph-mon[36977]: from='osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-13T02:07:40.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:40 smithi175 ceph-mon[36977]: osdmap e24: 4 total, 3 up, 4 in 2024-06-13T02:07:40.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:40 smithi175 ceph-mon[36977]: from='osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:07:40.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:40 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:07:40.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:40 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:40.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:40 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:07:40.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:40 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T02:07:40.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:40 smithi002 ceph-mon[31960]: from='osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-13T02:07:40.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:40 smithi002 ceph-mon[31960]: osdmap e24: 4 total, 3 up, 4 in 2024-06-13T02:07:40.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:40 smithi002 ceph-mon[31960]: from='osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:07:40.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:07:40.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:40.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:07:40.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:40.921 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:40 smithi084 ceph-mon[36833]: from='osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-13T02:07:40.921 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:40 smithi084 ceph-mon[36833]: osdmap e24: 4 total, 3 up, 4 in 2024-06-13T02:07:40.921 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:40 smithi084 ceph-mon[36833]: from='osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:07:40.921 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:40 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:07:40.921 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:40 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:40.921 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:40 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:07:40.921 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:40 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:41.493 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:07:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3[50643]: 2024-06-13T02:07:41.213+0000 7fde58c00700 -1 osd.3 0 waiting for initial osdmap 2024-06-13T02:07:41.493 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:07:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3[50643]: 2024-06-13T02:07:41.235+0000 7fde4ea00700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T02:07:41.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:41 smithi084 ceph-mon[36833]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:41.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:41 smithi084 ceph-mon[36833]: from='osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T02:07:41.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:41 smithi084 ceph-mon[36833]: osdmap e25: 4 total, 3 up, 4 in 2024-06-13T02:07:41.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:41 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:07:41.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:41 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:07:41.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:41 smithi084 ceph-mon[36833]: from='osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289]' entity='osd.3' 2024-06-13T02:07:41.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:41 smithi175 ceph-mon[36977]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:41.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:41 smithi175 ceph-mon[36977]: from='osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T02:07:41.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:41 smithi175 ceph-mon[36977]: osdmap e25: 4 total, 3 up, 4 in 2024-06-13T02:07:41.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:41 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:07:41.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:41 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:07:41.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:41 smithi175 ceph-mon[36977]: from='osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289]' entity='osd.3' 2024-06-13T02:07:41.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:41 smithi002 ceph-mon[31960]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-06-13T02:07:41.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:41 smithi002 ceph-mon[31960]: from='osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T02:07:41.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:41 smithi002 ceph-mon[31960]: osdmap e25: 4 total, 3 up, 4 in 2024-06-13T02:07:41.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:41 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:07:41.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:41 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:07:41.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:41 smithi002 ceph-mon[31960]: from='osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289]' entity='osd.3' 2024-06-13T02:07:42.619 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-13T02:07:42.620 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-13T02:07:42.620 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-06-13T02:07:42.620 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-06-13T02:07:42.620 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113503 s, 924 MB/s 2024-06-13T02:07:42.620 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-06-13T02:07:42.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:42 smithi002 ceph-mon[31960]: purged_snaps scrub starts 2024-06-13T02:07:42.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:42 smithi002 ceph-mon[31960]: purged_snaps scrub ok 2024-06-13T02:07:42.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:42 smithi002 ceph-mon[31960]: osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289] boot 2024-06-13T02:07:42.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:42 smithi002 ceph-mon[31960]: osdmap e26: 4 total, 4 up, 4 in 2024-06-13T02:07:42.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:07:42.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:42 smithi002 ceph-mon[31960]: osdmap e27: 4 total, 4 up, 4 in 2024-06-13T02:07:42.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:42 smithi175 ceph-mon[36977]: purged_snaps scrub starts 2024-06-13T02:07:42.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:42 smithi175 ceph-mon[36977]: purged_snaps scrub ok 2024-06-13T02:07:42.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:42 smithi175 ceph-mon[36977]: osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289] boot 2024-06-13T02:07:42.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:42 smithi175 ceph-mon[36977]: osdmap e26: 4 total, 4 up, 4 in 2024-06-13T02:07:42.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:07:42.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:42 smithi175 ceph-mon[36977]: osdmap e27: 4 total, 4 up, 4 in 2024-06-13T02:07:42.940 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:42 smithi084 ceph-mon[36833]: purged_snaps scrub starts 2024-06-13T02:07:42.940 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:42 smithi084 ceph-mon[36833]: purged_snaps scrub ok 2024-06-13T02:07:42.941 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:42 smithi084 ceph-mon[36833]: osd.3 [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289] boot 2024-06-13T02:07:42.941 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:42 smithi084 ceph-mon[36833]: osdmap e26: 4 total, 4 up, 4 in 2024-06-13T02:07:42.941 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:07:42.941 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:42 smithi084 ceph-mon[36833]: osdmap e27: 4 total, 4 up, 4 in 2024-06-13T02:07:43.283 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi084:vg_nvme/lv_3 2024-06-13T02:07:43.533 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T02:07:43.711 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:43 smithi002 ceph-mon[31960]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:07:43.711 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:43 smithi002 ceph-mon[31960]: osdmap e28: 4 total, 4 up, 4 in 2024-06-13T02:07:43.758 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:43 smithi084 ceph-mon[36833]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:07:43.758 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:43 smithi084 ceph-mon[36833]: osdmap e28: 4 total, 4 up, 4 in 2024-06-13T02:07:43.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:43 smithi175 ceph-mon[36977]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:07:43.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:43 smithi175 ceph-mon[36977]: osdmap e28: 4 total, 4 up, 4 in 2024-06-13T02:07:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.203+0000 7f2437833700 1 -- 172.21.15.84:0/348580655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2430104090 msgr2=0x7f243010a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:07:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.203+0000 7f2437833700 1 --2- 172.21.15.84:0/348580655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2430104090 0x7f243010a940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f242800b0d0 tx=0x7f242800b3e0 comp rx=0 tx=0).stop 2024-06-13T02:07:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.204+0000 7f2437833700 1 -- 172.21.15.84:0/348580655 shutdown_connections 2024-06-13T02:07:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.204+0000 7f2437833700 1 --2- 172.21.15.84:0/348580655 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2430104090 0x7f243010a940 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.204+0000 7f2437833700 1 --2- 172.21.15.84:0/348580655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24301024f0 0x7f2430102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.204+0000 7f2437833700 1 --2- 172.21.15.84:0/348580655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24301036f0 0x7f2430103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.204+0000 7f2437833700 1 -- 172.21.15.84:0/348580655 >> 172.21.15.84:0/348580655 conn(0x7f24300fda90 msgr2=0x7f24300ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:07:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.204+0000 7f2437833700 1 -- 172.21.15.84:0/348580655 shutdown_connections 2024-06-13T02:07:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.204+0000 7f2437833700 1 -- 172.21.15.84:0/348580655 wait complete. 2024-06-13T02:07:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.204+0000 7f2437833700 1 Processor -- start 2024-06-13T02:07:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.204+0000 7f2437833700 1 -- start start 2024-06-13T02:07:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.204+0000 7f2437833700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24301024f0 0x7f2430076230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:07:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.204+0000 7f2437833700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24301036f0 0x7f2430074880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:07:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.204+0000 7f2437833700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2430104090 0x7f2430074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:07:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.204+0000 7f2437833700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f243010e1d0 con 0x7f24301024f0 2024-06-13T02:07:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.204+0000 7f2437833700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f243010e050 con 0x7f24301036f0 2024-06-13T02:07:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.204+0000 7f2437833700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f243010e350 con 0x7f2430104090 2024-06-13T02:07:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.205+0000 7f2434dce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24301036f0 0x7f2430074880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:07:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.205+0000 7f2434dce700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24301036f0 0x7f2430074880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45608/0 (socket says 172.21.15.84:45608) 2024-06-13T02:07:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.205+0000 7f2434dce700 1 -- 172.21.15.84:0/760647545 learned_addr learned my addr 172.21.15.84:0/760647545 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-06-13T02:07:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.205+0000 7f2435dd0700 1 --2- 172.21.15.84:0/760647545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2430104090 0x7f2430074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:07:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.205+0000 7f2434dce700 1 -- 172.21.15.84:0/760647545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2430104090 msgr2=0x7f2430074dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:07:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.205+0000 7f2434dce700 1 --2- 172.21.15.84:0/760647545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2430104090 0x7f2430074dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.205+0000 7f2434dce700 1 -- 172.21.15.84:0/760647545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24301024f0 msgr2=0x7f2430076230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:07:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.205+0000 7f2434dce700 1 --2- 172.21.15.84:0/760647545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24301024f0 0x7f2430076230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:07:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.205+0000 7f2434dce700 1 -- 172.21.15.84:0/760647545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2430075670 con 0x7f24301036f0 2024-06-13T02:07:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.205+0000 7f2434dce700 1 --2- 172.21.15.84:0/760647545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24301036f0 0x7f2430074880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f242000b530 tx=0x7f242000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:07:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.205+0000 7f24267fc700 1 -- 172.21.15.84:0/760647545 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2420015020 con 0x7f24301036f0 2024-06-13T02:07:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.205+0000 7f24267fc700 1 -- 172.21.15.84:0/760647545 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2420011d10 con 0x7f24301036f0 2024-06-13T02:07:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.205+0000 7f24267fc700 1 -- 172.21.15.84:0/760647545 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242000f2e0 con 0x7f24301036f0 2024-06-13T02:07:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.205+0000 7f2437833700 1 -- 172.21.15.84:0/760647545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24301a29a0 con 0x7f24301036f0 2024-06-13T02:07:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.205+0000 7f2437833700 1 -- 172.21.15.84:0/760647545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24301a2ee0 con 0x7f24301036f0 2024-06-13T02:07:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.206+0000 7f2437833700 1 -- 172.21.15.84:0/760647545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2430069180 con 0x7f24301036f0 2024-06-13T02:07:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.207+0000 7f24267fc700 1 -- 172.21.15.84:0/760647545 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2420018020 con 0x7f24301036f0 2024-06-13T02:07:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.208+0000 7f24267fc700 1 --2- 172.21.15.84:0/760647545 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f241c0a2c20 0x7f241c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:07:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.208+0000 7f24267fc700 1 -- 172.21.15.84:0/760647545 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3669+0+0 (secure 0 0 0) 0x7f24200cdc60 con 0x7f24301036f0 2024-06-13T02:07:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.208+0000 7f24355cf700 1 --2- 172.21.15.84:0/760647545 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f241c0a2c20 0x7f241c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:07:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.209+0000 7f24355cf700 1 --2- 172.21.15.84:0/760647545 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f241c0a2c20 0x7f241c0a50e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2430103550 tx=0x7f242c006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:07:45.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.212+0000 7f24267fc700 1 -- 172.21.15.84:0/760647545 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f242001f020 con 0x7f24301036f0 2024-06-13T02:07:45.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:07:45.415+0000 7f2437833700 1 -- 172.21.15.84:0/760647545 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f24300628d0 con 0x7f241c0a2c20 2024-06-13T02:07:45.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:45 smithi084 ceph-mon[36833]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:07:45.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:45 smithi084 ceph-mon[36833]: osdmap e29: 4 total, 4 up, 4 in 2024-06-13T02:07:45.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:07:45.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:07:45.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:45.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:45 smithi175 ceph-mon[36977]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:07:45.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:45 smithi175 ceph-mon[36977]: osdmap e29: 4 total, 4 up, 4 in 2024-06-13T02:07:45.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:07:45.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:07:45.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:45.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:45 smithi002 ceph-mon[31960]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:07:45.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:45 smithi002 ceph-mon[31960]: osdmap e29: 4 total, 4 up, 4 in 2024-06-13T02:07:45.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:07:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:07:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:46.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:46 smithi084 ceph-mon[36833]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:07:46.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:46 smithi084 ceph-mon[36833]: osdmap e30: 4 total, 4 up, 4 in 2024-06-13T02:07:46.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:46 smithi175 ceph-mon[36977]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:07:46.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:46 smithi175 ceph-mon[36977]: osdmap e30: 4 total, 4 up, 4 in 2024-06-13T02:07:46.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:46 smithi002 ceph-mon[31960]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:07:46.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:46 smithi002 ceph-mon[31960]: osdmap e30: 4 total, 4 up, 4 in 2024-06-13T02:07:47.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:47 smithi084 ceph-mon[36833]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-13T02:07:47.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:47 smithi084 ceph-mon[36833]: Detected new or changed devices on smithi002 2024-06-13T02:07:47.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:47.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:47.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:07:47.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:07:47.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:47 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi002 to 8547M 2024-06-13T02:07:47.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:47.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:47.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:07:47.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:48.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:47 smithi175 ceph-mon[36977]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-13T02:07:48.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:47 smithi175 ceph-mon[36977]: Detected new or changed devices on smithi002 2024-06-13T02:07:48.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:48.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:48.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:07:48.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:07:48.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:47 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi002 to 8547M 2024-06-13T02:07:48.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:48.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:48.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:07:48.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:48.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:47 smithi002 ceph-mon[31960]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 520 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-13T02:07:48.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:47 smithi002 ceph-mon[31960]: Detected new or changed devices on smithi002 2024-06-13T02:07:48.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:48.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:48.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:07:48.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:07:48.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:47 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi002 to 8547M 2024-06-13T02:07:48.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:48.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:48.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:07:48.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:07:48.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:48 smithi084 ceph-mon[36833]: from='client.? 172.21.15.84:0/3133534105' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd063fb2-1a65-4b18-898c-f80ddc2a1229"}]: dispatch 2024-06-13T02:07:48.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:48 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd063fb2-1a65-4b18-898c-f80ddc2a1229"}]: dispatch 2024-06-13T02:07:48.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:48 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd063fb2-1a65-4b18-898c-f80ddc2a1229"}]': finished 2024-06-13T02:07:48.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:48 smithi084 ceph-mon[36833]: osdmap e31: 5 total, 4 up, 5 in 2024-06-13T02:07:48.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:48 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:07:49.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:48 smithi175 ceph-mon[36977]: from='client.? 172.21.15.84:0/3133534105' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd063fb2-1a65-4b18-898c-f80ddc2a1229"}]: dispatch 2024-06-13T02:07:49.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:48 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd063fb2-1a65-4b18-898c-f80ddc2a1229"}]: dispatch 2024-06-13T02:07:49.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:48 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd063fb2-1a65-4b18-898c-f80ddc2a1229"}]': finished 2024-06-13T02:07:49.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:48 smithi175 ceph-mon[36977]: osdmap e31: 5 total, 4 up, 5 in 2024-06-13T02:07:49.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:48 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:07:49.115 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:48 smithi002 ceph-mon[31960]: from='client.? 172.21.15.84:0/3133534105' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd063fb2-1a65-4b18-898c-f80ddc2a1229"}]: dispatch 2024-06-13T02:07:49.116 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:48 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd063fb2-1a65-4b18-898c-f80ddc2a1229"}]: dispatch 2024-06-13T02:07:49.116 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:48 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd063fb2-1a65-4b18-898c-f80ddc2a1229"}]': finished 2024-06-13T02:07:49.116 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:48 smithi002 ceph-mon[31960]: osdmap e31: 5 total, 4 up, 5 in 2024-06-13T02:07:49.116 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:48 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:07:49.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:49 smithi084 ceph-mon[36833]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-06-13T02:07:49.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:49 smithi084 ceph-mon[36833]: from='client.? 172.21.15.84:0/158792619' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:07:50.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:49 smithi175 ceph-mon[36977]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-06-13T02:07:50.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:49 smithi175 ceph-mon[36977]: from='client.? 172.21.15.84:0/158792619' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:07:50.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:49 smithi002 ceph-mon[31960]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-06-13T02:07:50.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:49 smithi002 ceph-mon[31960]: from='client.? 172.21.15.84:0/158792619' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:07:51.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:51 smithi084 ceph-mon[36833]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-13T02:07:52.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:51 smithi175 ceph-mon[36977]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-13T02:07:52.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:51 smithi002 ceph-mon[31960]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-13T02:07:53.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:53 smithi084 ceph-mon[36833]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-06-13T02:07:54.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:53 smithi175 ceph-mon[36977]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-06-13T02:07:54.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:53 smithi002 ceph-mon[31960]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-06-13T02:07:55.933 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:55 smithi002 ceph-mon[31960]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:07:55.933 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:55 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-13T02:07:55.933 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:55 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:55.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:55 smithi084 ceph-mon[36833]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:07:55.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:55 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-13T02:07:55.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:55 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:56.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:55 smithi175 ceph-mon[36977]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:07:56.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:55 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-13T02:07:56.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:55 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:07:56.964 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:56 smithi002 ceph-mon[31960]: Deploying daemon osd.4 on smithi084 2024-06-13T02:07:56.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:56 smithi084 ceph-mon[36833]: Deploying daemon osd.4 on smithi084 2024-06-13T02:07:57.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:56 smithi175 ceph-mon[36977]: Deploying daemon osd.4 on smithi084 2024-06-13T02:07:57.833 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:57 smithi084 ceph-mon[36833]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:07:58.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:57 smithi175 ceph-mon[36977]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:07:58.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:57 smithi002 ceph-mon[31960]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:07:59.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:07:59 smithi084 ceph-mon[36833]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:00.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:07:59 smithi175 ceph-mon[36977]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:00.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:07:59 smithi002 ceph-mon[31960]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:01.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:01 smithi084 ceph-mon[36833]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:01.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:01 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:01.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:01 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:01.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:01 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:08:02.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:01 smithi175 ceph-mon[36977]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:02.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:01 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:02.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:01 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:02.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:01 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:08:02.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:01 smithi002 ceph-mon[31960]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:02.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:01 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:02.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:01 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:02.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:01 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:08:03.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:03 smithi084 ceph-mon[36833]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:04.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:03 smithi175 ceph-mon[36977]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:04.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:03 smithi002 ceph-mon[31960]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:05.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:08:05.498+0000 7f24267fc700 1 -- 172.21.15.84:0/760647545 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f24300628d0 con 0x7f241c0a2c20 2024-06-13T02:08:05.500 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 4 on host 'smithi084' 2024-06-13T02:08:05.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:08:05.500+0000 7f2437833700 1 -- 172.21.15.84:0/760647545 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f241c0a2c20 msgr2=0x7f241c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:08:05.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:08:05.500+0000 7f2437833700 1 --2- 172.21.15.84:0/760647545 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f241c0a2c20 0x7f241c0a50e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2430103550 tx=0x7f242c006d20 comp rx=0 tx=0).stop 2024-06-13T02:08:05.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:08:05.500+0000 7f2437833700 1 -- 172.21.15.84:0/760647545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24301036f0 msgr2=0x7f2430074880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:08:05.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:08:05.500+0000 7f2437833700 1 --2- 172.21.15.84:0/760647545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24301036f0 0x7f2430074880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f242000b530 tx=0x7f242000b840 comp rx=0 tx=0).stop 2024-06-13T02:08:05.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:08:05.500+0000 7f2437833700 1 -- 172.21.15.84:0/760647545 shutdown_connections 2024-06-13T02:08:05.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:08:05.500+0000 7f2437833700 1 --2- 172.21.15.84:0/760647545 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f241c0a2c20 0x7f241c0a50e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:05.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:08:05.500+0000 7f2437833700 1 --2- 172.21.15.84:0/760647545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2430104090 0x7f2430074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:05.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:08:05.500+0000 7f2437833700 1 --2- 172.21.15.84:0/760647545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24301024f0 0x7f2430076230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:05.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:08:05.500+0000 7f2437833700 1 --2- 172.21.15.84:0/760647545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24301036f0 0x7f2430074880 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:05.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:08:05.501+0000 7f2437833700 1 -- 172.21.15.84:0/760647545 >> 172.21.15.84:0/760647545 conn(0x7f24300fda90 msgr2=0x7f2430106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:08:05.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:08:05.501+0000 7f2437833700 1 -- 172.21.15.84:0/760647545 shutdown_connections 2024-06-13T02:08:05.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:08:05.501+0000 7f2437833700 1 -- 172.21.15.84:0/760647545 wait complete. 2024-06-13T02:08:05.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:05 smithi084 ceph-mon[36833]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:08:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:05 smithi084 ceph-mon[36833]: from='osd.4 [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-13T02:08:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:05 smithi084 ceph-mon[36833]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-13T02:08:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:08:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:05 smithi002 ceph-mon[31960]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:08:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:05 smithi002 ceph-mon[31960]: from='osd.4 [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-13T02:08:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:05 smithi002 ceph-mon[31960]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-13T02:08:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:05.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:08:06.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:05 smithi175 ceph-mon[36977]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:06.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:08:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:05 smithi175 ceph-mon[36977]: from='osd.4 [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-13T02:08:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:05 smithi175 ceph-mon[36977]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-13T02:08:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:08:06.222 DEBUG:teuthology.orchestra.run.smithi084:osd.4> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.4.service 2024-06-13T02:08:06.224 INFO:tasks.cephadm:Deploying osd.5 on smithi175 with /dev/vg_nvme/lv_3... 2024-06-13T02:08:06.224 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-13T02:08:06.466 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:08:06.914 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:06 smithi175 ceph-mon[36977]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-13T02:08:06.915 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:06 smithi175 ceph-mon[36977]: from='osd.4 [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:08:06.915 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:06 smithi175 ceph-mon[36977]: osdmap e32: 5 total, 4 up, 5 in 2024-06-13T02:08:06.915 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:06 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:08:06.915 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:06 smithi175 ceph-mon[36977]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:08:06.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:06 smithi084 ceph-mon[36833]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-13T02:08:06.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:06 smithi084 ceph-mon[36833]: from='osd.4 [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:08:06.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:06 smithi084 ceph-mon[36833]: osdmap e32: 5 total, 4 up, 5 in 2024-06-13T02:08:06.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:06 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:08:06.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:06 smithi084 ceph-mon[36833]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:08:06.971 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:08:06 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4[48296]: 2024-06-13T02:08:06.712+0000 7f2a23547700 -1 osd.4 0 waiting for initial osdmap 2024-06-13T02:08:06.971 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:08:06 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4[48296]: 2024-06-13T02:08:06.718+0000 7f2a1f33a700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T02:08:07.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:06 smithi002 ceph-mon[31960]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-13T02:08:07.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:06 smithi002 ceph-mon[31960]: from='osd.4 [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:08:07.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:06 smithi002 ceph-mon[31960]: osdmap e32: 5 total, 4 up, 5 in 2024-06-13T02:08:07.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:06 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:08:07.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:06 smithi002 ceph-mon[31960]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:08:07.861 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:07 smithi175 ceph-mon[36977]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:07.861 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:07 smithi175 ceph-mon[36977]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-06-13T02:08:07.861 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:07 smithi175 ceph-mon[36977]: osdmap e33: 5 total, 4 up, 5 in 2024-06-13T02:08:07.861 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:07 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:08:07.861 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:07 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:08:08.067 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:07 smithi002 ceph-mon[31960]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:08.067 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:07 smithi002 ceph-mon[31960]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-06-13T02:08:08.067 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:07 smithi002 ceph-mon[31960]: osdmap e33: 5 total, 4 up, 5 in 2024-06-13T02:08:08.067 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:07 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:08:08.067 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:07 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:08:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:07 smithi084 ceph-mon[36833]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:07 smithi084 ceph-mon[36833]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-06-13T02:08:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:07 smithi084 ceph-mon[36833]: osdmap e33: 5 total, 4 up, 5 in 2024-06-13T02:08:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:07 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:08:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:07 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:08:08.584 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-13T02:08:08.584 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-13T02:08:08.584 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-06-13T02:08:08.585 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-06-13T02:08:08.585 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0151619 s, 692 MB/s 2024-06-13T02:08:08.585 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-06-13T02:08:08.843 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:08 smithi084 ceph-mon[36833]: purged_snaps scrub starts 2024-06-13T02:08:08.843 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:08 smithi084 ceph-mon[36833]: purged_snaps scrub ok 2024-06-13T02:08:08.843 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:08 smithi084 ceph-mon[36833]: osd.4 [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390] boot 2024-06-13T02:08:08.843 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:08 smithi084 ceph-mon[36833]: osdmap e34: 5 total, 5 up, 5 in 2024-06-13T02:08:08.843 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:08 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:08:09.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:08 smithi175 ceph-mon[36977]: purged_snaps scrub starts 2024-06-13T02:08:09.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:08 smithi175 ceph-mon[36977]: purged_snaps scrub ok 2024-06-13T02:08:09.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:08 smithi175 ceph-mon[36977]: osd.4 [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390] boot 2024-06-13T02:08:09.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:08 smithi175 ceph-mon[36977]: osdmap e34: 5 total, 5 up, 5 in 2024-06-13T02:08:09.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:08 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:08:09.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:08 smithi002 ceph-mon[31960]: purged_snaps scrub starts 2024-06-13T02:08:09.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:08 smithi002 ceph-mon[31960]: purged_snaps scrub ok 2024-06-13T02:08:09.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:08 smithi002 ceph-mon[31960]: osd.4 [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390] boot 2024-06-13T02:08:09.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:08 smithi002 ceph-mon[31960]: osdmap e34: 5 total, 5 up, 5 in 2024-06-13T02:08:09.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:08 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:08:09.305 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_3 2024-06-13T02:08:09.540 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:08:09.963 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:09 smithi175 ceph-mon[36977]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:09.963 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:09 smithi175 ceph-mon[36977]: osdmap e35: 5 total, 5 up, 5 in 2024-06-13T02:08:09.963 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:09.964 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:09.964 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:08:09.964 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:08:09.964 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:09.964 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:09.964 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:08:09.964 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:10.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:09 smithi002 ceph-mon[31960]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:10.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:09 smithi002 ceph-mon[31960]: osdmap e35: 5 total, 5 up, 5 in 2024-06-13T02:08:10.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:10.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:10.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:08:10.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:08:10.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:10.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:10.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:08:10.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:10.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:09 smithi084 ceph-mon[36833]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-06-13T02:08:10.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:09 smithi084 ceph-mon[36833]: osdmap e35: 5 total, 5 up, 5 in 2024-06-13T02:08:10.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:10.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:10.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:08:10.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:08:10.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:10.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:10.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:08:10.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:10.946 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:10 smithi175 ceph-mon[36977]: Detected new or changed devices on smithi084 2024-06-13T02:08:10.946 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:10 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi084 to 8544M 2024-06-13T02:08:11.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:10 smithi002 ceph-mon[31960]: Detected new or changed devices on smithi084 2024-06-13T02:08:11.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:10 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi084 to 8544M 2024-06-13T02:08:11.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.187+0000 7f60cdbc7700 1 -- 172.21.15.175:0/2570337905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60c8102510 msgr2=0x7f60c8102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:08:11.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.187+0000 7f60cdbc7700 1 --2- 172.21.15.175:0/2570337905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60c8102510 0x7f60c8102930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f60c0009990 tx=0x7f60c0009ca0 comp rx=0 tx=0).stop 2024-06-13T02:08:11.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.187+0000 7f60cdbc7700 1 -- 172.21.15.175:0/2570337905 shutdown_connections 2024-06-13T02:08:11.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.187+0000 7f60cdbc7700 1 --2- 172.21.15.175:0/2570337905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c81040b0 0x7f60c810a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:11.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.187+0000 7f60cdbc7700 1 --2- 172.21.15.175:0/2570337905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60c8102510 0x7f60c8102930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:11.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.187+0000 7f60cdbc7700 1 --2- 172.21.15.175:0/2570337905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60c8103710 0x7f60c8103b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:11.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.187+0000 7f60cdbc7700 1 -- 172.21.15.175:0/2570337905 >> 172.21.15.175:0/2570337905 conn(0x7f60c80fdab0 msgr2=0x7f60c80ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:08:11.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.187+0000 7f60cdbc7700 1 -- 172.21.15.175:0/2570337905 shutdown_connections 2024-06-13T02:08:11.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.188+0000 7f60cdbc7700 1 -- 172.21.15.175:0/2570337905 wait complete. 2024-06-13T02:08:11.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.188+0000 7f60cdbc7700 1 Processor -- start 2024-06-13T02:08:11.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.188+0000 7f60cdbc7700 1 -- start start 2024-06-13T02:08:11.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.188+0000 7f60cdbc7700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c8102510 0x7f60c81986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:08:11.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.188+0000 7f60cdbc7700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60c8103710 0x7f60c8198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:08:11.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60cdbc7700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60c81040b0 0x7f60c819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:08:11.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60cdbc7700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f60c810e160 con 0x7f60c8102510 2024-06-13T02:08:11.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60cdbc7700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f60c810dfe0 con 0x7f60c8103710 2024-06-13T02:08:11.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60cdbc7700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f60c810e2e0 con 0x7f60c81040b0 2024-06-13T02:08:11.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60c7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60c81040b0 0x7f60c819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:08:11.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60c7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60c81040b0 0x7f60c819fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49418/0 (socket says 172.21.15.175:49418) 2024-06-13T02:08:11.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60c7fff700 1 -- 172.21.15.175:0/1745451377 learned_addr learned my addr 172.21.15.175:0/1745451377 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-06-13T02:08:11.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60c6ffd700 1 --2- 172.21.15.175:0/1745451377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60c8103710 0x7f60c8198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:08:11.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60c7fff700 1 -- 172.21.15.175:0/1745451377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60c8103710 msgr2=0x7f60c8198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:08:11.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60c7fff700 1 --2- 172.21.15.175:0/1745451377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60c8103710 0x7f60c8198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:11.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60c7fff700 1 -- 172.21.15.175:0/1745451377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c8102510 msgr2=0x7f60c81986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:08:11.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60c7fff700 1 --2- 172.21.15.175:0/1745451377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c8102510 0x7f60c81986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:11.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60c7fff700 1 -- 172.21.15.175:0/1745451377 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c81a0350 con 0x7f60c81040b0 2024-06-13T02:08:11.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60c7fff700 1 --2- 172.21.15.175:0/1745451377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60c81040b0 0x7f60c819fcb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f60b800b9a0 tx=0x7f60b800bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:08:11.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60c4ff9700 1 -- 172.21.15.175:0/1745451377 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b8019070 con 0x7f60c81040b0 2024-06-13T02:08:11.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60c4ff9700 1 -- 172.21.15.175:0/1745451377 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60b8014440 con 0x7f60c81040b0 2024-06-13T02:08:11.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60cdbc7700 1 -- 172.21.15.175:0/1745451377 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c81a0640 con 0x7f60c81040b0 2024-06-13T02:08:11.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60c4ff9700 1 -- 172.21.15.175:0/1745451377 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b80075d0 con 0x7f60c81040b0 2024-06-13T02:08:11.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.189+0000 7f60cdbc7700 1 -- 172.21.15.175:0/1745451377 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c81a0bb0 con 0x7f60c81040b0 2024-06-13T02:08:11.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.190+0000 7f60cdbc7700 1 -- 172.21.15.175:0/1745451377 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c8069180 con 0x7f60c81040b0 2024-06-13T02:08:11.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.191+0000 7f60c4ff9700 1 -- 172.21.15.175:0/1745451377 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f60b801c070 con 0x7f60c81040b0 2024-06-13T02:08:11.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.192+0000 7f60c4ff9700 1 --2- 172.21.15.175:0/1745451377 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f60b00a2c20 0x7f60b00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:08:11.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.192+0000 7f60c4ff9700 1 -- 172.21.15.175:0/1745451377 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4101+0+0 (secure 0 0 0) 0x7f60b80cd450 con 0x7f60c81040b0 2024-06-13T02:08:11.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.192+0000 7f60c77fe700 1 --2- 172.21.15.175:0/1745451377 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f60b00a2c20 0x7f60b00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:08:11.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.193+0000 7f60c77fe700 1 --2- 172.21.15.175:0/1745451377 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f60b00a2c20 0x7f60b00a50e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f60c0005f50 tx=0x7f60c0005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:08:11.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.197+0000 7f60c4ff9700 1 -- 172.21.15.175:0/1745451377 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f60b809b4b0 con 0x7f60c81040b0 2024-06-13T02:08:11.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:10 smithi084 ceph-mon[36833]: Detected new or changed devices on smithi084 2024-06-13T02:08:11.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:10 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi084 to 8544M 2024-06-13T02:08:11.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:11.401+0000 7f60cdbc7700 1 -- 172.21.15.175:0/1745451377 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f60c80628d0 con 0x7f60b00a2c20 2024-06-13T02:08:12.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:11 smithi175 ceph-mon[36977]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:12.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:08:12.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:08:12.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:12.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:11 smithi002 ceph-mon[31960]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:12.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:08:12.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:08:12.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:12.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:11 smithi084 ceph-mon[36833]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:12.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:08:12.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:08:12.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:13.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:12 smithi175 ceph-mon[36977]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:08:13.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:12 smithi002 ceph-mon[31960]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:08:13.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:12 smithi084 ceph-mon[36833]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:08:14.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:13 smithi175 ceph-mon[36977]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:14.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:13 smithi002 ceph-mon[31960]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:14.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:13 smithi084 ceph-mon[36833]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:15.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:14 smithi175 ceph-mon[36977]: from='client.? 172.21.15.175:0/3082141338' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0ea80fd-1bfe-4d2e-9733-ff442ec015b9"}]: dispatch 2024-06-13T02:08:15.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:14 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0ea80fd-1bfe-4d2e-9733-ff442ec015b9"}]: dispatch 2024-06-13T02:08:15.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:14 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e0ea80fd-1bfe-4d2e-9733-ff442ec015b9"}]': finished 2024-06-13T02:08:15.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:14 smithi175 ceph-mon[36977]: osdmap e36: 6 total, 5 up, 6 in 2024-06-13T02:08:15.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:14 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:08:15.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:14 smithi175 ceph-mon[36977]: from='client.? 172.21.15.175:0/1573937243' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:08:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:14 smithi002 ceph-mon[31960]: from='client.? 172.21.15.175:0/3082141338' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0ea80fd-1bfe-4d2e-9733-ff442ec015b9"}]: dispatch 2024-06-13T02:08:15.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:14 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0ea80fd-1bfe-4d2e-9733-ff442ec015b9"}]: dispatch 2024-06-13T02:08:15.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:14 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e0ea80fd-1bfe-4d2e-9733-ff442ec015b9"}]': finished 2024-06-13T02:08:15.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:14 smithi002 ceph-mon[31960]: osdmap e36: 6 total, 5 up, 6 in 2024-06-13T02:08:15.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:14 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:08:15.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:14 smithi002 ceph-mon[31960]: from='client.? 172.21.15.175:0/1573937243' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:08:15.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:14 smithi084 ceph-mon[36833]: from='client.? 172.21.15.175:0/3082141338' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0ea80fd-1bfe-4d2e-9733-ff442ec015b9"}]: dispatch 2024-06-13T02:08:15.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:14 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0ea80fd-1bfe-4d2e-9733-ff442ec015b9"}]: dispatch 2024-06-13T02:08:15.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:14 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e0ea80fd-1bfe-4d2e-9733-ff442ec015b9"}]': finished 2024-06-13T02:08:15.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:14 smithi084 ceph-mon[36833]: osdmap e36: 6 total, 5 up, 6 in 2024-06-13T02:08:15.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:14 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:08:15.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:14 smithi084 ceph-mon[36833]: from='client.? 172.21.15.175:0/1573937243' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:08:16.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:16 smithi175 ceph-mon[36977]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:16.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:16 smithi002 ceph-mon[31960]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:16.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:16 smithi084 ceph-mon[36833]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:18.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:18 smithi175 ceph-mon[36977]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:18.324 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:18 smithi084 ceph-mon[36833]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:18.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:18 smithi002 ceph-mon[31960]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:20.232 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:20 smithi175 ceph-mon[36977]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:20.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:20 smithi002 ceph-mon[31960]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:20.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:20 smithi084 ceph-mon[36833]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:22.153 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:22 smithi175 ceph-mon[36977]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:22.154 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-13T02:08:22.154 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:22.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:22 smithi002 ceph-mon[31960]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:22.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-13T02:08:22.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:22.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:22 smithi084 ceph-mon[36833]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:22.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-13T02:08:22.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:23.161 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:23 smithi175 ceph-mon[36977]: Deploying daemon osd.5 on smithi175 2024-06-13T02:08:23.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:23 smithi002 ceph-mon[31960]: Deploying daemon osd.5 on smithi175 2024-06-13T02:08:23.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:23 smithi084 ceph-mon[36833]: Deploying daemon osd.5 on smithi175 2024-06-13T02:08:24.131 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:24 smithi175 ceph-mon[36977]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:24.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:24 smithi002 ceph-mon[31960]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:24.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:24 smithi084 ceph-mon[36833]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:26.148 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:26 smithi175 ceph-mon[36977]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:26.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:26 smithi002 ceph-mon[31960]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:26.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:26 smithi084 ceph-mon[36833]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:28.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:27 smithi175 ceph-mon[36977]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:28.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:28.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:28.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:08:28.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:27 smithi002 ceph-mon[31960]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:28.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:28.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:28.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:08:28.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:27 smithi084 ceph-mon[36833]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:28.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:28.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:28.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:08:30.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:29 smithi175 ceph-mon[36977]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:30.093 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 5 on host 'smithi175' 2024-06-13T02:08:30.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:30.091+0000 7f60c4ff9700 1 -- 172.21.15.175:0/1745451377 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f60c80628d0 con 0x7f60b00a2c20 2024-06-13T02:08:30.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:30.094+0000 7f60cdbc7700 1 -- 172.21.15.175:0/1745451377 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f60b00a2c20 msgr2=0x7f60b00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:08:30.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:30.094+0000 7f60cdbc7700 1 --2- 172.21.15.175:0/1745451377 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f60b00a2c20 0x7f60b00a50e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f60c0005f50 tx=0x7f60c0005e80 comp rx=0 tx=0).stop 2024-06-13T02:08:30.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:30.094+0000 7f60cdbc7700 1 -- 172.21.15.175:0/1745451377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60c81040b0 msgr2=0x7f60c819fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:08:30.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:30.094+0000 7f60cdbc7700 1 --2- 172.21.15.175:0/1745451377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60c81040b0 0x7f60c819fcb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f60b800b9a0 tx=0x7f60b800bd60 comp rx=0 tx=0).stop 2024-06-13T02:08:30.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:30.094+0000 7f60cdbc7700 1 -- 172.21.15.175:0/1745451377 shutdown_connections 2024-06-13T02:08:30.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:30.094+0000 7f60cdbc7700 1 --2- 172.21.15.175:0/1745451377 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f60b00a2c20 0x7f60b00a50e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:30.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:30.094+0000 7f60cdbc7700 1 --2- 172.21.15.175:0/1745451377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60c81040b0 0x7f60c819fcb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:30.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:30.094+0000 7f60cdbc7700 1 --2- 172.21.15.175:0/1745451377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60c8102510 0x7f60c81986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:30.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:30.094+0000 7f60cdbc7700 1 --2- 172.21.15.175:0/1745451377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60c8103710 0x7f60c8198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:30.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:30.094+0000 7f60cdbc7700 1 -- 172.21.15.175:0/1745451377 >> 172.21.15.175:0/1745451377 conn(0x7f60c80fdab0 msgr2=0x7f60c8106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:08:30.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:30.094+0000 7f60cdbc7700 1 -- 172.21.15.175:0/1745451377 shutdown_connections 2024-06-13T02:08:30.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:08:30.094+0000 7f60cdbc7700 1 -- 172.21.15.175:0/1745451377 wait complete. 2024-06-13T02:08:30.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:29 smithi002 ceph-mon[31960]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:30.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:29 smithi084 ceph-mon[36833]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:30.703 DEBUG:teuthology.orchestra.run.smithi175:osd.5> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.5.service 2024-06-13T02:08:30.706 INFO:tasks.cephadm:Deploying osd.6 on smithi002 with /dev/vg_nvme/lv_2... 2024-06-13T02:08:30.706 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-13T02:08:31.153 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:08:31.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:31 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:31.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:31 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:31.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:31 smithi002 ceph-mon[31960]: from='osd.5 [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-13T02:08:31.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:31 smithi002 ceph-mon[31960]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-13T02:08:31.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:31 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:31.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:31 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:31.469 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:31 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:31.469 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:31 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:31.469 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:31 smithi175 ceph-mon[36977]: from='osd.5 [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-13T02:08:31.469 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:31 smithi175 ceph-mon[36977]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-13T02:08:31.469 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:31 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:31.469 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:31 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:31.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:31 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:31.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:31 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:31.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:31 smithi084 ceph-mon[36833]: from='osd.5 [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-13T02:08:31.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:31 smithi084 ceph-mon[36833]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-13T02:08:31.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:31 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:31.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:31 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:32.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:32 smithi002 ceph-mon[31960]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:32.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:32 smithi002 ceph-mon[31960]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-13T02:08:32.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:32 smithi002 ceph-mon[31960]: osdmap e37: 6 total, 5 up, 6 in 2024-06-13T02:08:32.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:32 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:08:32.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:32 smithi002 ceph-mon[31960]: from='osd.5 [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:08:32.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:32 smithi002 ceph-mon[31960]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:08:32.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:32 smithi175 ceph-mon[36977]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:32.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:32 smithi175 ceph-mon[36977]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-13T02:08:32.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:32 smithi175 ceph-mon[36977]: osdmap e37: 6 total, 5 up, 6 in 2024-06-13T02:08:32.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:32 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:08:32.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:32 smithi175 ceph-mon[36977]: from='osd.5 [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:08:32.417 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:32 smithi175 ceph-mon[36977]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:08:32.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:32 smithi084 ceph-mon[36833]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:32.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:32 smithi084 ceph-mon[36833]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-13T02:08:32.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:32 smithi084 ceph-mon[36833]: osdmap e37: 6 total, 5 up, 6 in 2024-06-13T02:08:32.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:32 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:08:32.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:32 smithi084 ceph-mon[36833]: from='osd.5 [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:08:32.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:32 smithi084 ceph-mon[36833]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:08:33.033 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:08:32 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:08:32.846+0000 7f8be8879700 -1 osd.5 0 waiting for initial osdmap 2024-06-13T02:08:33.033 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:08:32 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:08:32.852+0000 7f8bdfe63700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T02:08:33.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:33 smithi002 ceph-mon[31960]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-06-13T02:08:33.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:33 smithi002 ceph-mon[31960]: osdmap e38: 6 total, 5 up, 6 in 2024-06-13T02:08:33.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:08:33.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:08:33.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:33 smithi002 ceph-mon[31960]: from='osd.5 ' entity='osd.5' 2024-06-13T02:08:33.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:33 smithi002 ceph-mon[31960]: osd.5 [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885] boot 2024-06-13T02:08:33.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:33 smithi002 ceph-mon[31960]: osdmap e39: 6 total, 6 up, 6 in 2024-06-13T02:08:33.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:08:33.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:33 smithi084 ceph-mon[36833]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-06-13T02:08:33.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:33 smithi084 ceph-mon[36833]: osdmap e38: 6 total, 5 up, 6 in 2024-06-13T02:08:33.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:33 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:08:33.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:33 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:08:33.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:33 smithi084 ceph-mon[36833]: from='osd.5 ' entity='osd.5' 2024-06-13T02:08:33.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:33 smithi084 ceph-mon[36833]: osd.5 [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885] boot 2024-06-13T02:08:33.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:33 smithi084 ceph-mon[36833]: osdmap e39: 6 total, 6 up, 6 in 2024-06-13T02:08:33.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:33 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:08:33.530 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:33 smithi175 ceph-mon[36977]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-06-13T02:08:33.530 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:33 smithi175 ceph-mon[36977]: osdmap e38: 6 total, 5 up, 6 in 2024-06-13T02:08:33.530 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:08:33.531 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:08:33.531 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:33 smithi175 ceph-mon[36977]: from='osd.5 ' entity='osd.5' 2024-06-13T02:08:33.531 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:33 smithi175 ceph-mon[36977]: osd.5 [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885] boot 2024-06-13T02:08:33.531 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:33 smithi175 ceph-mon[36977]: osdmap e39: 6 total, 6 up, 6 in 2024-06-13T02:08:33.531 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:08:34.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:34 smithi002 ceph-mon[31960]: purged_snaps scrub starts 2024-06-13T02:08:34.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:34 smithi002 ceph-mon[31960]: purged_snaps scrub ok 2024-06-13T02:08:34.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:34 smithi002 ceph-mon[31960]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:34.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:34 smithi002 ceph-mon[31960]: osdmap e40: 6 total, 6 up, 6 in 2024-06-13T02:08:34.426 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-13T02:08:34.426 INFO:teuthology.orchestra.run.smithi002.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-13T02:08:34.426 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10+0 records in 2024-06-13T02:08:34.426 INFO:teuthology.orchestra.run.smithi002.stderr:10+0 records out 2024-06-13T02:08:34.426 INFO:teuthology.orchestra.run.smithi002.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0586604 s, 179 MB/s 2024-06-13T02:08:34.426 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping successful for: 2024-06-13T02:08:34.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:34 smithi084 ceph-mon[36833]: purged_snaps scrub starts 2024-06-13T02:08:34.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:34 smithi084 ceph-mon[36833]: purged_snaps scrub ok 2024-06-13T02:08:34.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:34 smithi084 ceph-mon[36833]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:34.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:34 smithi084 ceph-mon[36833]: osdmap e40: 6 total, 6 up, 6 in 2024-06-13T02:08:34.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:34 smithi175 ceph-mon[36977]: purged_snaps scrub starts 2024-06-13T02:08:34.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:34 smithi175 ceph-mon[36977]: purged_snaps scrub ok 2024-06-13T02:08:34.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:34 smithi175 ceph-mon[36977]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-06-13T02:08:34.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:34 smithi175 ceph-mon[36977]: osdmap e40: 6 total, 6 up, 6 in 2024-06-13T02:08:35.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: osdmap e41: 6 total, 6 up, 6 in 2024-06-13T02:08:35.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: Detected new or changed devices on smithi175 2024-06-13T02:08:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:08:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:08:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi175 to 8544M 2024-06-13T02:08:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:08:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 578 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:08:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:08:35.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:35.384 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_2 2024-06-13T02:08:35.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: osdmap e41: 6 total, 6 up, 6 in 2024-06-13T02:08:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: Detected new or changed devices on smithi175 2024-06-13T02:08:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:08:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:08:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi175 to 8544M 2024-06-13T02:08:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:08:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 578 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:08:35.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:35.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:08:35.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:35.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: osdmap e41: 6 total, 6 up, 6 in 2024-06-13T02:08:35.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: Detected new or changed devices on smithi175 2024-06-13T02:08:35.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:35.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:35.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:08:35.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:08:35.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi175 to 8544M 2024-06-13T02:08:35.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:35.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:35.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:08:35.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:35.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 578 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:35.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:08:35.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:35.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:08:35.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:08:35.842 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:08:36.339 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:36 smithi002 ceph-mon[31960]: osdmap e42: 6 total, 6 up, 6 in 2024-06-13T02:08:36.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:36 smithi084 ceph-mon[36833]: osdmap e42: 6 total, 6 up, 6 in 2024-06-13T02:08:36.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:36 smithi175 ceph-mon[36977]: osdmap e42: 6 total, 6 up, 6 in 2024-06-13T02:08:37.370 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:37 smithi002 ceph-mon[31960]: osdmap e43: 6 total, 6 up, 6 in 2024-06-13T02:08:37.371 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:37 smithi002 ceph-mon[31960]: pgmap v159: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 578 MiB used, 536 GiB / 536 GiB avail; 177 KiB/s, 0 objects/s recovering 2024-06-13T02:08:37.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:37 smithi084 ceph-mon[36833]: osdmap e43: 6 total, 6 up, 6 in 2024-06-13T02:08:37.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:37 smithi084 ceph-mon[36833]: pgmap v159: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 578 MiB used, 536 GiB / 536 GiB avail; 177 KiB/s, 0 objects/s recovering 2024-06-13T02:08:37.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:37 smithi175 ceph-mon[36977]: osdmap e43: 6 total, 6 up, 6 in 2024-06-13T02:08:37.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:37 smithi175 ceph-mon[36977]: pgmap v159: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 578 MiB used, 536 GiB / 536 GiB avail; 177 KiB/s, 0 objects/s recovering 2024-06-13T02:08:37.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.915+0000 7f26fde00700 1 -- 172.21.15.2:0/2111873048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26f810a6d0 msgr2=0x7f26f8110f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:08:37.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.915+0000 7f26fde00700 1 --2- 172.21.15.2:0/2111873048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26f810a6d0 0x7f26f8110f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f26f000b0a0 tx=0x7f26f000b3b0 comp rx=0 tx=0).stop 2024-06-13T02:08:37.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.915+0000 7f26fde00700 1 -- 172.21.15.2:0/2111873048 shutdown_connections 2024-06-13T02:08:37.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.915+0000 7f26fde00700 1 --2- 172.21.15.2:0/2111873048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26f810a6d0 0x7f26f8110f80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:37.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.915+0000 7f26fde00700 1 --2- 172.21.15.2:0/2111873048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26f8108b30 0x7f26f8108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:37.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.915+0000 7f26fde00700 1 --2- 172.21.15.2:0/2111873048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26f8109d30 0x7f26f810a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:37.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.915+0000 7f26fde00700 1 -- 172.21.15.2:0/2111873048 >> 172.21.15.2:0/2111873048 conn(0x7f26f8077b00 msgr2=0x7f26f8079f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:08:37.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.915+0000 7f26fde00700 1 -- 172.21.15.2:0/2111873048 shutdown_connections 2024-06-13T02:08:37.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.915+0000 7f26fde00700 1 -- 172.21.15.2:0/2111873048 wait complete. 2024-06-13T02:08:37.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.916+0000 7f26fde00700 1 Processor -- start 2024-06-13T02:08:37.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.916+0000 7f26fde00700 1 -- start start 2024-06-13T02:08:37.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.917+0000 7f26fde00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26f8108b30 0x7f26f819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:08:37.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.917+0000 7f26fde00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26f8109d30 0x7f26f819f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:08:37.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.917+0000 7f26fde00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26f810a6d0 0x7f26f81a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:08:37.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.917+0000 7f26fde00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8114750 con 0x7f26f8108b30 2024-06-13T02:08:37.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.917+0000 7f26fde00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f26f81145d0 con 0x7f26f8109d30 2024-06-13T02:08:37.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.917+0000 7f26fde00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f26f81148d0 con 0x7f26f810a6d0 2024-06-13T02:08:37.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.917+0000 7f26f6a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26f8108b30 0x7f26f819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:08:37.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.917+0000 7f26f6a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26f8108b30 0x7f26f819eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52776/0 (socket says 172.21.15.2:52776) 2024-06-13T02:08:37.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.917+0000 7f26f6a00700 1 -- 172.21.15.2:0/623999407 learned_addr learned my addr 172.21.15.2:0/623999407 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:08:37.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.917+0000 7f26f7400700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26f810a6d0 0x7f26f81a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:08:37.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.917+0000 7f26f6000700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26f8109d30 0x7f26f819f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:08:37.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.918+0000 7f26f6a00700 1 -- 172.21.15.2:0/623999407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26f810a6d0 msgr2=0x7f26f81a6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:08:37.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.918+0000 7f26f6a00700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26f810a6d0 0x7f26f81a6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:37.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.918+0000 7f26f6a00700 1 -- 172.21.15.2:0/623999407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26f8109d30 msgr2=0x7f26f819f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:08:37.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.918+0000 7f26f6a00700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26f8109d30 0x7f26f819f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:08:37.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.918+0000 7f26f6a00700 1 -- 172.21.15.2:0/623999407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f81a6920 con 0x7f26f8108b30 2024-06-13T02:08:37.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.918+0000 7f26f7400700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26f810a6d0 0x7f26f81a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:08:37.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.918+0000 7f26f6000700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26f8109d30 0x7f26f819f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:08:37.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.918+0000 7f26f6a00700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26f8108b30 0x7f26f819eca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f26e800ea50 tx=0x7f26e800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:08:37.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.918+0000 7f26fca00700 1 -- 172.21.15.2:0/623999407 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e800cbd0 con 0x7f26f8108b30 2024-06-13T02:08:37.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.918+0000 7f26fde00700 1 -- 172.21.15.2:0/623999407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f81a6c10 con 0x7f26f8108b30 2024-06-13T02:08:37.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.919+0000 7f26fca00700 1 -- 172.21.15.2:0/623999407 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26e800cd70 con 0x7f26f8108b30 2024-06-13T02:08:37.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.919+0000 7f26fca00700 1 -- 172.21.15.2:0/623999407 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e8018750 con 0x7f26f8108b30 2024-06-13T02:08:37.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.919+0000 7f26fde00700 1 -- 172.21.15.2:0/623999407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f81a71a0 con 0x7f26f8108b30 2024-06-13T02:08:37.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.920+0000 7f26fde00700 1 -- 172.21.15.2:0/623999407 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f8069180 con 0x7f26f8108b30 2024-06-13T02:08:37.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.922+0000 7f26fca00700 1 -- 172.21.15.2:0/623999407 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f26e801f020 con 0x7f26f8108b30 2024-06-13T02:08:37.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.924+0000 7f26fca00700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f26dc0a2c20 0x7f26dc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:08:37.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.924+0000 7f26fca00700 1 -- 172.21.15.2:0/623999407 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4533+0+0 (secure 0 0 0) 0x7f26e80ce360 con 0x7f26f8108b30 2024-06-13T02:08:37.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.924+0000 7f26f6000700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f26dc0a2c20 0x7f26dc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:08:37.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.925+0000 7f26f6000700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f26dc0a2c20 0x7f26dc0a50e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26f81a01b0 tx=0x7f26e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:08:37.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:37.928+0000 7f26fca00700 1 -- 172.21.15.2:0/623999407 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f26e8053850 con 0x7f26f8108b30 2024-06-13T02:08:38.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:08:38.171+0000 7f26fde00700 1 -- 172.21.15.2:0/623999407 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f26f80628d0 con 0x7f26dc0a2c20 2024-06-13T02:08:38.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:38 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:08:38.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:38 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:08:38.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:38 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:38.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:38 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:08:38.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:38 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:08:38.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:38 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:38.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:38 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:08:38.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:38 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:08:38.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:38 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:39.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:39 smithi002 ceph-mon[31960]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:08:39.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:39 smithi002 ceph-mon[31960]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-06-13T02:08:39.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:39 smithi175 ceph-mon[36977]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:08:39.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:39 smithi175 ceph-mon[36977]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-06-13T02:08:39.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:39 smithi084 ceph-mon[36833]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:08:39.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:39 smithi084 ceph-mon[36833]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-06-13T02:08:41.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:41 smithi084 ceph-mon[36833]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-06-13T02:08:41.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:41 smithi175 ceph-mon[36977]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-06-13T02:08:41.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:41 smithi002 ceph-mon[31960]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-06-13T02:08:42.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:42 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/674975515' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c204d74-5e48-4e2e-bb98-6a8d4974187c"}]: dispatch 2024-06-13T02:08:42.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:42 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/674975515' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1c204d74-5e48-4e2e-bb98-6a8d4974187c"}]': finished 2024-06-13T02:08:42.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:42 smithi084 ceph-mon[36833]: osdmap e44: 7 total, 6 up, 7 in 2024-06-13T02:08:42.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:08:42.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:42 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/674975515' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c204d74-5e48-4e2e-bb98-6a8d4974187c"}]: dispatch 2024-06-13T02:08:42.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:42 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/674975515' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1c204d74-5e48-4e2e-bb98-6a8d4974187c"}]': finished 2024-06-13T02:08:42.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:42 smithi175 ceph-mon[36977]: osdmap e44: 7 total, 6 up, 7 in 2024-06-13T02:08:42.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:08:42.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:42 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/674975515' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1c204d74-5e48-4e2e-bb98-6a8d4974187c"}]: dispatch 2024-06-13T02:08:42.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:42 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/674975515' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1c204d74-5e48-4e2e-bb98-6a8d4974187c"}]': finished 2024-06-13T02:08:42.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:42 smithi002 ceph-mon[31960]: osdmap e44: 7 total, 6 up, 7 in 2024-06-13T02:08:42.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:08:43.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:43 smithi084 ceph-mon[36833]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:43.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:43 smithi175 ceph-mon[36977]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:43.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:43 smithi002 ceph-mon[31960]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:44.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:44 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2617278433' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:08:44.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:44 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2617278433' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:08:44.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:44 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2617278433' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:08:45.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:45 smithi002 ceph-mon[31960]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:45.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:45 smithi084 ceph-mon[36833]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:45.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:45 smithi175 ceph-mon[36977]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:47.540 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:47 smithi002 ceph-mon[31960]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:47.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:47 smithi084 ceph-mon[36833]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:47.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:47 smithi175 ceph-mon[36977]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:49.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:49 smithi002 ceph-mon[31960]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:49.714 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:49 smithi084 ceph-mon[36833]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:49.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:49 smithi175 ceph-mon[36977]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:51.624 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:51 smithi002 ceph-mon[31960]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:51.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:51 smithi084 ceph-mon[36833]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:51.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:51 smithi175 ceph-mon[36977]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:52.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:52 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-13T02:08:52.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:52 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:52.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:52 smithi084 ceph-mon[36833]: Deploying daemon osd.6 on smithi002 2024-06-13T02:08:52.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:52 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-13T02:08:52.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:52 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:52.753 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:52 smithi002 ceph-mon[31960]: Deploying daemon osd.6 on smithi002 2024-06-13T02:08:52.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:52 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-13T02:08:52.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:52 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:08:52.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:52 smithi175 ceph-mon[36977]: Deploying daemon osd.6 on smithi002 2024-06-13T02:08:53.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:53 smithi084 ceph-mon[36833]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:53.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:53 smithi175 ceph-mon[36977]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:53.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:53 smithi002 ceph-mon[31960]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:55.594 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:55 smithi002 ceph-mon[31960]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:55.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:55 smithi084 ceph-mon[36833]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:55.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:55 smithi175 ceph-mon[36977]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:57.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:57 smithi084 ceph-mon[36833]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:57.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:57 smithi002 ceph-mon[31960]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:57.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:57 smithi175 ceph-mon[36977]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:59.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:08:59 smithi084 ceph-mon[36833]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:59.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:08:59 smithi175 ceph-mon[36977]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:08:59.785 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:08:59 smithi002 ceph-mon[31960]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:09:01.598 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:01 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:01.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:01 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:01.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:01 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:01.599 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:01 smithi002 ceph-mon[31960]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:09:01.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:01 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:01.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:01 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:01.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:01 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:01.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:01 smithi084 ceph-mon[36833]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:09:01.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:01 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:01.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:01 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:01.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:01 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:01.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:01 smithi175 ceph-mon[36977]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:09:03.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:03 smithi084 ceph-mon[36833]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:09:03.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:03 smithi175 ceph-mon[36977]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:09:03.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:03 smithi002 ceph-mon[31960]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:09:05.082 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 6 on host 'smithi002' 2024-06-13T02:09:05.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:09:05.079+0000 7f26fca00700 1 -- 172.21.15.2:0/623999407 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f26f80628d0 con 0x7f26dc0a2c20 2024-06-13T02:09:05.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:09:05.083+0000 7f26fde00700 1 -- 172.21.15.2:0/623999407 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f26dc0a2c20 msgr2=0x7f26dc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:09:05.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:09:05.083+0000 7f26fde00700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f26dc0a2c20 0x7f26dc0a50e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26f81a01b0 tx=0x7f26e4009260 comp rx=0 tx=0).stop 2024-06-13T02:09:05.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:09:05.083+0000 7f26fde00700 1 -- 172.21.15.2:0/623999407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26f8108b30 msgr2=0x7f26f819eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:09:05.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:09:05.083+0000 7f26fde00700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26f8108b30 0x7f26f819eca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f26e800ea50 tx=0x7f26e800ed60 comp rx=0 tx=0).stop 2024-06-13T02:09:05.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:09:05.083+0000 7f26fde00700 1 -- 172.21.15.2:0/623999407 shutdown_connections 2024-06-13T02:09:05.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:09:05.083+0000 7f26fde00700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f26dc0a2c20 0x7f26dc0a50e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:05.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:09:05.083+0000 7f26fde00700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f26f810a6d0 0x7f26f81a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:05.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:09:05.083+0000 7f26fde00700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f26f8108b30 0x7f26f819eca0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:05.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:09:05.083+0000 7f26fde00700 1 --2- 172.21.15.2:0/623999407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26f8109d30 0x7f26f819f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:05.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:09:05.083+0000 7f26fde00700 1 -- 172.21.15.2:0/623999407 >> 172.21.15.2:0/623999407 conn(0x7f26f8077b00 msgr2=0x7f26f810cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:09:05.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:09:05.083+0000 7f26fde00700 1 -- 172.21.15.2:0/623999407 shutdown_connections 2024-06-13T02:09:05.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:09:05.083+0000 7f26fde00700 1 -- 172.21.15.2:0/623999407 wait complete. 2024-06-13T02:09:05.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:04 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:05.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:04 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:05.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:04 smithi084 ceph-mon[36833]: from='osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-13T02:09:05.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:04 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:05.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:04 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:05.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:04 smithi175 ceph-mon[36977]: from='osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-13T02:09:05.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:04 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:05.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:04 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:05.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:04 smithi002 ceph-mon[31960]: from='osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-13T02:09:05.987 DEBUG:teuthology.orchestra.run.smithi002:osd.6> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.6.service 2024-06-13T02:09:05.992 INFO:tasks.cephadm:Deploying osd.7 on smithi084 with /dev/vg_nvme/lv_2... 2024-06-13T02:09:05.992 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-13T02:09:06.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:05 smithi084 ceph-mon[36833]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:09:06.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:05 smithi084 ceph-mon[36833]: from='osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-13T02:09:06.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:05 smithi084 ceph-mon[36833]: osdmap e45: 7 total, 6 up, 7 in 2024-06-13T02:09:06.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:05 smithi084 ceph-mon[36833]: from='osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:09:06.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:09:06.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:06.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:06.234 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T02:09:06.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:05 smithi175 ceph-mon[36977]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:09:06.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:05 smithi175 ceph-mon[36977]: from='osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-13T02:09:06.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:05 smithi175 ceph-mon[36977]: osdmap e45: 7 total, 6 up, 7 in 2024-06-13T02:09:06.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:05 smithi175 ceph-mon[36977]: from='osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:09:06.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:09:06.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:06.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:06.285 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:05 smithi002 ceph-mon[31960]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:09:06.285 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:05 smithi002 ceph-mon[31960]: from='osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-13T02:09:06.285 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:05 smithi002 ceph-mon[31960]: osdmap e45: 7 total, 6 up, 7 in 2024-06-13T02:09:06.286 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:05 smithi002 ceph-mon[31960]: from='osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:09:06.286 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:09:06.286 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:06.286 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:06.881 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:09:06 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:09:06.671+0000 7f8928c00700 -1 osd.6 0 waiting for initial osdmap 2024-06-13T02:09:06.881 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:09:06 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:09:06.705+0000 7f891e000700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T02:09:07.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:06 smithi175 ceph-mon[36977]: from='osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T02:09:07.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:06 smithi175 ceph-mon[36977]: osdmap e46: 7 total, 6 up, 7 in 2024-06-13T02:09:07.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:06 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:09:07.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:06 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:09:07.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:06 smithi175 ceph-mon[36977]: from='osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106]' entity='osd.6' 2024-06-13T02:09:07.294 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:06 smithi002 ceph-mon[31960]: from='osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T02:09:07.295 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:06 smithi002 ceph-mon[31960]: osdmap e46: 7 total, 6 up, 7 in 2024-06-13T02:09:07.295 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:06 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:09:07.295 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:06 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:09:07.295 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:06 smithi002 ceph-mon[31960]: from='osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106]' entity='osd.6' 2024-06-13T02:09:07.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:06 smithi084 ceph-mon[36833]: from='osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T02:09:07.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:06 smithi084 ceph-mon[36833]: osdmap e46: 7 total, 6 up, 7 in 2024-06-13T02:09:07.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:06 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:09:07.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:06 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:09:07.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:06 smithi084 ceph-mon[36833]: from='osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106]' entity='osd.6' 2024-06-13T02:09:08.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:07 smithi002 ceph-mon[31960]: purged_snaps scrub starts 2024-06-13T02:09:08.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:07 smithi002 ceph-mon[31960]: purged_snaps scrub ok 2024-06-13T02:09:08.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:07 smithi002 ceph-mon[31960]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:09:08.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:07 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:09:08.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:07 smithi002 ceph-mon[31960]: osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106] boot 2024-06-13T02:09:08.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:07 smithi002 ceph-mon[31960]: osdmap e47: 7 total, 7 up, 7 in 2024-06-13T02:09:08.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:07 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:09:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:07 smithi084 ceph-mon[36833]: purged_snaps scrub starts 2024-06-13T02:09:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:07 smithi084 ceph-mon[36833]: purged_snaps scrub ok 2024-06-13T02:09:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:07 smithi084 ceph-mon[36833]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:09:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:07 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:09:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:07 smithi084 ceph-mon[36833]: osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106] boot 2024-06-13T02:09:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:07 smithi084 ceph-mon[36833]: osdmap e47: 7 total, 7 up, 7 in 2024-06-13T02:09:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:07 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:09:08.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:07 smithi175 ceph-mon[36977]: purged_snaps scrub starts 2024-06-13T02:09:08.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:07 smithi175 ceph-mon[36977]: purged_snaps scrub ok 2024-06-13T02:09:08.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:07 smithi175 ceph-mon[36977]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-06-13T02:09:08.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:07 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:09:08.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:07 smithi175 ceph-mon[36977]: osd.6 [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106] boot 2024-06-13T02:09:08.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:07 smithi175 ceph-mon[36977]: osdmap e47: 7 total, 7 up, 7 in 2024-06-13T02:09:08.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:07 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:09:08.320 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-13T02:09:08.320 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-13T02:09:08.320 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-06-13T02:09:08.320 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-06-13T02:09:08.321 INFO:teuthology.orchestra.run.smithi084.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128875 s, 814 MB/s 2024-06-13T02:09:08.321 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 2024-06-13T02:09:08.321 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-06-13T02:09:09.074 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi084:vg_nvme/lv_2 2024-06-13T02:09:09.313 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T02:09:10.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:09 smithi175 ceph-mon[36977]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:10.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:09 smithi175 ceph-mon[36977]: osdmap e48: 7 total, 7 up, 7 in 2024-06-13T02:09:10.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:09 smithi002 ceph-mon[31960]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:10.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:09 smithi002 ceph-mon[31960]: osdmap e48: 7 total, 7 up, 7 in 2024-06-13T02:09:10.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:09 smithi084 ceph-mon[36833]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:10.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:09 smithi084 ceph-mon[36833]: osdmap e48: 7 total, 7 up, 7 in 2024-06-13T02:09:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.022+0000 7ff99c590700 1 -- 172.21.15.84:0/3930419397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff994102fa0 msgr2=0x7ff994105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:09:11.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.022+0000 7ff99c590700 1 --2- 172.21.15.84:0/3930419397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff994102fa0 0x7ff994105390 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff990009990 tx=0x7ff990009ca0 comp rx=0 tx=0).stop 2024-06-13T02:09:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.022+0000 7ff99c590700 1 -- 172.21.15.84:0/3930419397 shutdown_connections 2024-06-13T02:09:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.022+0000 7ff99c590700 1 --2- 172.21.15.84:0/3930419397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff994108200 0x7ff99410a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.022+0000 7ff99c590700 1 --2- 172.21.15.84:0/3930419397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff994102fa0 0x7ff994105390 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.022+0000 7ff99c590700 1 --2- 172.21.15.84:0/3930419397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9941058d0 0x7ff994107cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.022+0000 7ff99c590700 1 -- 172.21.15.84:0/3930419397 >> 172.21.15.84:0/3930419397 conn(0x7ff9940fc950 msgr2=0x7ff9940fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:09:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.022+0000 7ff99c590700 1 -- 172.21.15.84:0/3930419397 shutdown_connections 2024-06-13T02:09:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.022+0000 7ff99c590700 1 -- 172.21.15.84:0/3930419397 wait complete. 2024-06-13T02:09:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.023+0000 7ff99c590700 1 Processor -- start 2024-06-13T02:09:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.023+0000 7ff99c590700 1 -- start start 2024-06-13T02:09:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.023+0000 7ff99c590700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff994102fa0 0x7ff994198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:09:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.023+0000 7ff99c590700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9941058d0 0x7ff994198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:09:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.023+0000 7ff99c590700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff994108200 0x7ff99419fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:09:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.023+0000 7ff99c590700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff99410e100 con 0x7ff994102fa0 2024-06-13T02:09:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.023+0000 7ff99c590700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff99410df80 con 0x7ff994108200 2024-06-13T02:09:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.023+0000 7ff99c590700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff99410e280 con 0x7ff9941058d0 2024-06-13T02:09:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.023+0000 7ff99ab2d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff994108200 0x7ff99419fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:09:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.023+0000 7ff99ab2d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff994108200 0x7ff99419fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50612/0 (socket says 172.21.15.84:50612) 2024-06-13T02:09:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.023+0000 7ff99ab2d700 1 -- 172.21.15.84:0/1593664930 learned_addr learned my addr 172.21.15.84:0/1593664930 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-06-13T02:09:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.023+0000 7ff999b2b700 1 --2- 172.21.15.84:0/1593664930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9941058d0 0x7ff994198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:09:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.024+0000 7ff99ab2d700 1 -- 172.21.15.84:0/1593664930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9941058d0 msgr2=0x7ff994198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:09:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.024+0000 7ff99ab2d700 1 --2- 172.21.15.84:0/1593664930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9941058d0 0x7ff994198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.024+0000 7ff99ab2d700 1 -- 172.21.15.84:0/1593664930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff994102fa0 msgr2=0x7ff994198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:09:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.024+0000 7ff99a32c700 1 --2- 172.21.15.84:0/1593664930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff994102fa0 0x7ff994198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:09:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.024+0000 7ff99ab2d700 1 --2- 172.21.15.84:0/1593664930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff994102fa0 0x7ff994198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.024+0000 7ff99ab2d700 1 -- 172.21.15.84:0/1593664930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9941a02c0 con 0x7ff994108200 2024-06-13T02:09:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.024+0000 7ff99ab2d700 1 --2- 172.21.15.84:0/1593664930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff994108200 0x7ff99419fc20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00b9e0 tx=0x7ff98c00bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:09:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.024+0000 7ff98b7fe700 1 -- 172.21.15.84:0/1593664930 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c019070 con 0x7ff994108200 2024-06-13T02:09:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.024+0000 7ff99c590700 1 -- 172.21.15.84:0/1593664930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9941a05b0 con 0x7ff994108200 2024-06-13T02:09:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.024+0000 7ff98b7fe700 1 -- 172.21.15.84:0/1593664930 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff98c014440 con 0x7ff994108200 2024-06-13T02:09:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.024+0000 7ff98b7fe700 1 -- 172.21.15.84:0/1593664930 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c0125a0 con 0x7ff994108200 2024-06-13T02:09:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.024+0000 7ff99c590700 1 -- 172.21.15.84:0/1593664930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9941a0b70 con 0x7ff994108200 2024-06-13T02:09:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.025+0000 7ff99c590700 1 -- 172.21.15.84:0/1593664930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff994069180 con 0x7ff994108200 2024-06-13T02:09:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.026+0000 7ff98b7fe700 1 -- 172.21.15.84:0/1593664930 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff98c01c070 con 0x7ff994108200 2024-06-13T02:09:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.026+0000 7ff98b7fe700 1 --2- 172.21.15.84:0/1593664930 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff9800a2c20 0x7ff9800a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:09:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.027+0000 7ff98b7fe700 1 -- 172.21.15.84:0/1593664930 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4965+0+0 (secure 0 0 0) 0x7ff98c0cd720 con 0x7ff994108200 2024-06-13T02:09:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.027+0000 7ff99a32c700 1 --2- 172.21.15.84:0/1593664930 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff9800a2c20 0x7ff9800a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:09:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.028+0000 7ff99a32c700 1 --2- 172.21.15.84:0/1593664930 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff9800a2c20 0x7ff9800a50e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff9900039c0 tx=0x7ff990005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:09:11.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.031+0000 7ff98b7fe700 1 -- 172.21.15.84:0/1593664930 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff98c09b390 con 0x7ff994108200 2024-06-13T02:09:11.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:11.237+0000 7ff99c590700 1 -- 172.21.15.84:0/1593664930 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff9940628d0 con 0x7ff9800a2c20 2024-06-13T02:09:12.205 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:12.205 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:09:12.205 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:09:12.205 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:12.205 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:12.205 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:12.205 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:12.205 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:12.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:12.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:12.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:12.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:09:12.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:12.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:12.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:12.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:09:12.206 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:11 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:09:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:09:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:09:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:12.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:12.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:12.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:09:12.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:11 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:12.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:12.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:09:12.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:09:12.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:12.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:12.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:12.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:12.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:12.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:12.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:12.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:12.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:09:12.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:12.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:12.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:12.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:09:12.386 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:11 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:13.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:13 smithi084 ceph-mon[36833]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:09:13.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:13 smithi084 ceph-mon[36833]: Detected new or changed devices on smithi002 2024-06-13T02:09:13.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:13 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi002 to 5698M 2024-06-13T02:09:13.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:13 smithi175 ceph-mon[36977]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:09:13.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:13 smithi175 ceph-mon[36977]: Detected new or changed devices on smithi002 2024-06-13T02:09:13.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:13 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi002 to 5698M 2024-06-13T02:09:13.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:13 smithi002 ceph-mon[31960]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:09:13.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:13 smithi002 ceph-mon[31960]: Detected new or changed devices on smithi002 2024-06-13T02:09:13.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:13 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi002 to 5698M 2024-06-13T02:09:14.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:14 smithi175 ceph-mon[36977]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:14.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:14 smithi002 ceph-mon[31960]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:14.442 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:14 smithi084 ceph-mon[36833]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:15.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:15 smithi175 ceph-mon[36977]: from='client.? 172.21.15.84:0/251057057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1299bbb1-fbfb-4aba-be6b-6704691735f6"}]: dispatch 2024-06-13T02:09:15.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:15 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1299bbb1-fbfb-4aba-be6b-6704691735f6"}]: dispatch 2024-06-13T02:09:15.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:15 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1299bbb1-fbfb-4aba-be6b-6704691735f6"}]': finished 2024-06-13T02:09:15.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:15 smithi175 ceph-mon[36977]: osdmap e49: 8 total, 7 up, 8 in 2024-06-13T02:09:15.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:15 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:09:15.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:15 smithi175 ceph-mon[36977]: from='client.? 172.21.15.84:0/2676496376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:09:15.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:15 smithi002 ceph-mon[31960]: from='client.? 172.21.15.84:0/251057057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1299bbb1-fbfb-4aba-be6b-6704691735f6"}]: dispatch 2024-06-13T02:09:15.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:15 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1299bbb1-fbfb-4aba-be6b-6704691735f6"}]: dispatch 2024-06-13T02:09:15.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:15 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1299bbb1-fbfb-4aba-be6b-6704691735f6"}]': finished 2024-06-13T02:09:15.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:15 smithi002 ceph-mon[31960]: osdmap e49: 8 total, 7 up, 8 in 2024-06-13T02:09:15.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:15 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:09:15.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:15 smithi002 ceph-mon[31960]: from='client.? 172.21.15.84:0/2676496376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:09:15.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:15 smithi084 ceph-mon[36833]: from='client.? 172.21.15.84:0/251057057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1299bbb1-fbfb-4aba-be6b-6704691735f6"}]: dispatch 2024-06-13T02:09:15.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:15 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1299bbb1-fbfb-4aba-be6b-6704691735f6"}]: dispatch 2024-06-13T02:09:15.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:15 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1299bbb1-fbfb-4aba-be6b-6704691735f6"}]': finished 2024-06-13T02:09:15.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:15 smithi084 ceph-mon[36833]: osdmap e49: 8 total, 7 up, 8 in 2024-06-13T02:09:15.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:15 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:09:15.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:15 smithi084 ceph-mon[36833]: from='client.? 172.21.15.84:0/2676496376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:09:16.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:16 smithi002 ceph-mon[31960]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:16.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:16 smithi084 ceph-mon[36833]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:16.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:16 smithi175 ceph-mon[36977]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:18.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:18 smithi002 ceph-mon[31960]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:18.460 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:18 smithi084 ceph-mon[36833]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:18.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:18 smithi175 ceph-mon[36977]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:20.321 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:20 smithi084 ceph-mon[36833]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:20.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:20 smithi002 ceph-mon[31960]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:20.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:20 smithi175 ceph-mon[36977]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:22.370 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:22 smithi084 ceph-mon[36833]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:22.370 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-13T02:09:22.370 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:22.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:22 smithi002 ceph-mon[31960]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:22.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-13T02:09:22.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:22.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:22 smithi175 ceph-mon[36977]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:22.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-13T02:09:22.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:23.375 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:23 smithi084 ceph-mon[36833]: Deploying daemon osd.7 on smithi084 2024-06-13T02:09:23.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:23 smithi002 ceph-mon[31960]: Deploying daemon osd.7 on smithi084 2024-06-13T02:09:23.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:23 smithi175 ceph-mon[36977]: Deploying daemon osd.7 on smithi084 2024-06-13T02:09:24.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:24 smithi002 ceph-mon[31960]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:24.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:24 smithi084 ceph-mon[36833]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:24.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:24 smithi175 ceph-mon[36977]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:26.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:26 smithi084 ceph-mon[36833]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:26.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:26 smithi002 ceph-mon[31960]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:26.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:26 smithi175 ceph-mon[36977]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:28.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:28 smithi002 ceph-mon[31960]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:28.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:28 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:28.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:28 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:28.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:28 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:28.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:28 smithi084 ceph-mon[36833]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:28.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:28.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:28.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:28 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:28.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:28 smithi175 ceph-mon[36977]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:28.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:28 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:28.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:28 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:28.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:28 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:30.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:30 smithi002 ceph-mon[31960]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:30.397 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:30 smithi084 ceph-mon[36833]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:30.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:30 smithi175 ceph-mon[36977]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:31.178 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 7 on host 'smithi084' 2024-06-13T02:09:31.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:31.176+0000 7ff98b7fe700 1 -- 172.21.15.84:0/1593664930 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff9940628d0 con 0x7ff9800a2c20 2024-06-13T02:09:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:31.179+0000 7ff99c590700 1 -- 172.21.15.84:0/1593664930 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff9800a2c20 msgr2=0x7ff9800a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:09:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:31.179+0000 7ff99c590700 1 --2- 172.21.15.84:0/1593664930 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff9800a2c20 0x7ff9800a50e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff9900039c0 tx=0x7ff990005fb0 comp rx=0 tx=0).stop 2024-06-13T02:09:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:31.179+0000 7ff99c590700 1 -- 172.21.15.84:0/1593664930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff994108200 msgr2=0x7ff99419fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:09:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:31.179+0000 7ff99c590700 1 --2- 172.21.15.84:0/1593664930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff994108200 0x7ff99419fc20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00b9e0 tx=0x7ff98c00bda0 comp rx=0 tx=0).stop 2024-06-13T02:09:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:31.179+0000 7ff99c590700 1 -- 172.21.15.84:0/1593664930 shutdown_connections 2024-06-13T02:09:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:31.179+0000 7ff99c590700 1 --2- 172.21.15.84:0/1593664930 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff9800a2c20 0x7ff9800a50e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:31.179+0000 7ff99c590700 1 --2- 172.21.15.84:0/1593664930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff994108200 0x7ff99419fc20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:31.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:31.179+0000 7ff99c590700 1 --2- 172.21.15.84:0/1593664930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff994102fa0 0x7ff994198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:31.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:31.179+0000 7ff99c590700 1 --2- 172.21.15.84:0/1593664930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9941058d0 0x7ff994198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:31.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:31.179+0000 7ff99c590700 1 -- 172.21.15.84:0/1593664930 >> 172.21.15.84:0/1593664930 conn(0x7ff9940fc950 msgr2=0x7ff9941038e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:09:31.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:31.179+0000 7ff99c590700 1 -- 172.21.15.84:0/1593664930 shutdown_connections 2024-06-13T02:09:31.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:09:31.179+0000 7ff99c590700 1 -- 172.21.15.84:0/1593664930 wait complete. 2024-06-13T02:09:31.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:31 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:31.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:31 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:31.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:31 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:31.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:31 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:09:31.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:31 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:31.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:31 smithi175 ceph-mon[36977]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:31.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:31 smithi175 ceph-mon[36977]: from='osd.7 [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-13T02:09:31.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:31 smithi175 ceph-mon[36977]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-13T02:09:31.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:31 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:31.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:31 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:31.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:31 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:31.559 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:31 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:31.559 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:31 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:31.560 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:31 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:31.560 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:31 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:09:31.560 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:31 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:31.560 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:31 smithi084 ceph-mon[36833]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:31.560 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:31 smithi084 ceph-mon[36833]: from='osd.7 [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-13T02:09:31.560 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:31 smithi084 ceph-mon[36833]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-13T02:09:31.560 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:31 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:31.560 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:31 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:31.560 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:31 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:31.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:31 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:31.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:31 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:31.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:31 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:31.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:31 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:09:31.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:31 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:31.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:31 smithi002 ceph-mon[31960]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:31.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:31 smithi002 ceph-mon[31960]: from='osd.7 [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-13T02:09:31.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:31 smithi002 ceph-mon[31960]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-13T02:09:31.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:31 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:31.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:31 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:31.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:31 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:31.880 DEBUG:teuthology.orchestra.run.smithi084:osd.7> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.7.service 2024-06-13T02:09:31.883 INFO:tasks.cephadm:Deploying osd.8 on smithi175 with /dev/vg_nvme/lv_2... 2024-06-13T02:09:31.883 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-13T02:09:32.128 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:09:32.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:32 smithi084 ceph-mon[36833]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-13T02:09:32.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:32 smithi084 ceph-mon[36833]: from='osd.7 [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:09:32.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:32 smithi084 ceph-mon[36833]: osdmap e50: 8 total, 7 up, 8 in 2024-06-13T02:09:32.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:32 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:09:32.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:32 smithi084 ceph-mon[36833]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:09:32.471 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:09:32 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:09:32.301+0000 7f33c2e51700 -1 osd.7 0 waiting for initial osdmap 2024-06-13T02:09:32.471 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:09:32 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:09:32.309+0000 7f33bec44700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T02:09:32.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:32 smithi175 ceph-mon[36977]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-13T02:09:32.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:32 smithi175 ceph-mon[36977]: from='osd.7 [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:09:32.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:32 smithi175 ceph-mon[36977]: osdmap e50: 8 total, 7 up, 8 in 2024-06-13T02:09:32.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:32 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:09:32.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:32 smithi175 ceph-mon[36977]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:09:32.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:32 smithi002 ceph-mon[31960]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-13T02:09:32.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:32 smithi002 ceph-mon[31960]: from='osd.7 [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:09:32.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:32 smithi002 ceph-mon[31960]: osdmap e50: 8 total, 7 up, 8 in 2024-06-13T02:09:32.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:32 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:09:32.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:32 smithi002 ceph-mon[31960]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:09:33.344 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:33 smithi084 ceph-mon[36833]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-06-13T02:09:33.344 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:33 smithi084 ceph-mon[36833]: osdmap e51: 8 total, 7 up, 8 in 2024-06-13T02:09:33.344 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:33 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:09:33.344 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:33 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:09:33.344 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:33 smithi084 ceph-mon[36833]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:33.344 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:33 smithi084 ceph-mon[36833]: osd.7 [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653] boot 2024-06-13T02:09:33.345 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:33 smithi084 ceph-mon[36833]: osdmap e52: 8 total, 8 up, 8 in 2024-06-13T02:09:33.345 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:33 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:09:33.451 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:33 smithi175 ceph-mon[36977]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-06-13T02:09:33.451 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:33 smithi175 ceph-mon[36977]: osdmap e51: 8 total, 7 up, 8 in 2024-06-13T02:09:33.451 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:09:33.451 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:09:33.451 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:33 smithi175 ceph-mon[36977]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:33.451 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:33 smithi175 ceph-mon[36977]: osd.7 [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653] boot 2024-06-13T02:09:33.452 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:33 smithi175 ceph-mon[36977]: osdmap e52: 8 total, 8 up, 8 in 2024-06-13T02:09:33.452 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:09:33.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:33 smithi002 ceph-mon[31960]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-06-13T02:09:33.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:33 smithi002 ceph-mon[31960]: osdmap e51: 8 total, 7 up, 8 in 2024-06-13T02:09:33.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:09:33.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:09:33.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:33 smithi002 ceph-mon[31960]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-06-13T02:09:33.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:33 smithi002 ceph-mon[31960]: osd.7 [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653] boot 2024-06-13T02:09:33.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:33 smithi002 ceph-mon[31960]: osdmap e52: 8 total, 8 up, 8 in 2024-06-13T02:09:33.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:09:34.049 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-13T02:09:34.049 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-13T02:09:34.049 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-06-13T02:09:34.049 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-06-13T02:09:34.049 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0117693 s, 891 MB/s 2024-06-13T02:09:34.049 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-06-13T02:09:34.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:34 smithi084 ceph-mon[36833]: purged_snaps scrub starts 2024-06-13T02:09:34.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:34 smithi084 ceph-mon[36833]: purged_snaps scrub ok 2024-06-13T02:09:34.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:34 smithi084 ceph-mon[36833]: osdmap e53: 8 total, 8 up, 8 in 2024-06-13T02:09:34.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:34 smithi002 ceph-mon[31960]: purged_snaps scrub starts 2024-06-13T02:09:34.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:34 smithi002 ceph-mon[31960]: purged_snaps scrub ok 2024-06-13T02:09:34.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:34 smithi002 ceph-mon[31960]: osdmap e53: 8 total, 8 up, 8 in 2024-06-13T02:09:34.633 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:34 smithi175 ceph-mon[36977]: purged_snaps scrub starts 2024-06-13T02:09:34.634 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:34 smithi175 ceph-mon[36977]: purged_snaps scrub ok 2024-06-13T02:09:34.634 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:34 smithi175 ceph-mon[36977]: osdmap e53: 8 total, 8 up, 8 in 2024-06-13T02:09:34.660 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_2 2024-06-13T02:09:34.899 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:09:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:35 smithi175 ceph-mon[36977]: pgmap v198: 1 pgs: 1 unknown; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:35 smithi175 ceph-mon[36977]: Detected new or changed devices on smithi084 2024-06-13T02:09:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:35 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi084 to 5696M 2024-06-13T02:09:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:36.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:09:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:35 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:35 smithi175 ceph-mon[36977]: osdmap e54: 8 total, 8 up, 8 in 2024-06-13T02:09:36.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:35 smithi175 ceph-mon[36977]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-06-13T02:09:36.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:35 smithi002 ceph-mon[31960]: pgmap v198: 1 pgs: 1 unknown; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:36.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:35 smithi002 ceph-mon[31960]: Detected new or changed devices on smithi084 2024-06-13T02:09:36.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:36.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:36.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:36.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:36.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:36.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:35 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi084 to 5696M 2024-06-13T02:09:36.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:36.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:36.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:09:36.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:35 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:36.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:35 smithi002 ceph-mon[31960]: osdmap e54: 8 total, 8 up, 8 in 2024-06-13T02:09:36.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:35 smithi002 ceph-mon[31960]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-06-13T02:09:36.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:35 smithi084 ceph-mon[36833]: pgmap v198: 1 pgs: 1 unknown; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:36.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:35 smithi084 ceph-mon[36833]: Detected new or changed devices on smithi084 2024-06-13T02:09:36.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:36.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:36.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:36.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:36.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:09:36.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:35 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi084 to 5696M 2024-06-13T02:09:36.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:36.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:36.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:09:36.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:35 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:36.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:35 smithi084 ceph-mon[36833]: osdmap e54: 8 total, 8 up, 8 in 2024-06-13T02:09:36.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:35 smithi084 ceph-mon[36833]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-06-13T02:09:36.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.562+0000 7f7d2d864700 1 -- 172.21.15.175:0/2267563848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d281081e0 msgr2=0x7f7d2810a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:09:36.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.562+0000 7f7d2d864700 1 --2- 172.21.15.175:0/2267563848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d281081e0 0x7f7d2810a650 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000b0a0 tx=0x7f7d2000b3b0 comp rx=0 tx=0).stop 2024-06-13T02:09:36.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.563+0000 7f7d2d864700 1 -- 172.21.15.175:0/2267563848 shutdown_connections 2024-06-13T02:09:36.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.563+0000 7f7d2d864700 1 --2- 172.21.15.175:0/2267563848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d281081e0 0x7f7d2810a650 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:36.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.563+0000 7f7d2d864700 1 --2- 172.21.15.175:0/2267563848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d28102f80 0x7f7d28105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:36.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.563+0000 7f7d2d864700 1 --2- 172.21.15.175:0/2267563848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d281058b0 0x7f7d28107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:36.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.563+0000 7f7d2d864700 1 -- 172.21.15.175:0/2267563848 >> 172.21.15.175:0/2267563848 conn(0x7f7d280fc9b0 msgr2=0x7f7d280fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:09:36.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.563+0000 7f7d2d864700 1 -- 172.21.15.175:0/2267563848 shutdown_connections 2024-06-13T02:09:36.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.563+0000 7f7d2d864700 1 -- 172.21.15.175:0/2267563848 wait complete. 2024-06-13T02:09:36.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.563+0000 7f7d2d864700 1 Processor -- start 2024-06-13T02:09:36.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.563+0000 7f7d2d864700 1 -- start start 2024-06-13T02:09:36.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.563+0000 7f7d2d864700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d28102f80 0x7f7d28198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:09:36.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d2d864700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d281058b0 0x7f7d28198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:09:36.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d2d864700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d281081e0 0x7f7d2819fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:09:36.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d2d864700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2810e120 con 0x7f7d28102f80 2024-06-13T02:09:36.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d2d864700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2810dfa0 con 0x7f7d281058b0 2024-06-13T02:09:36.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d2d864700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2810e2a0 con 0x7f7d281081e0 2024-06-13T02:09:36.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d277fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d281081e0 0x7f7d2819fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:09:36.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d277fe700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d281081e0 0x7f7d2819fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45886/0 (socket says 172.21.15.175:45886) 2024-06-13T02:09:36.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d277fe700 1 -- 172.21.15.175:0/3552347711 learned_addr learned my addr 172.21.15.175:0/3552347711 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-06-13T02:09:36.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d267fc700 1 --2- 172.21.15.175:0/3552347711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d281058b0 0x7f7d28198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:09:36.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d277fe700 1 -- 172.21.15.175:0/3552347711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d281058b0 msgr2=0x7f7d28198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:09:36.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d26ffd700 1 --2- 172.21.15.175:0/3552347711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d28102f80 0x7f7d28198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:09:36.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d277fe700 1 --2- 172.21.15.175:0/3552347711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d281058b0 0x7f7d28198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:36.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d277fe700 1 -- 172.21.15.175:0/3552347711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d28102f80 msgr2=0x7f7d28198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:09:36.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d277fe700 1 --2- 172.21.15.175:0/3552347711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d28102f80 0x7f7d28198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:36.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d277fe700 1 -- 172.21.15.175:0/3552347711 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d281a02c0 con 0x7f7d281081e0 2024-06-13T02:09:36.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d277fe700 1 --2- 172.21.15.175:0/3552347711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d281081e0 0x7f7d2819fc20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000d010 tx=0x7f7d20004e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:09:36.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d2c862700 1 -- 172.21.15.175:0/3552347711 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d20021070 con 0x7f7d281081e0 2024-06-13T02:09:36.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d2d864700 1 -- 172.21.15.175:0/3552347711 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d281a0550 con 0x7f7d281081e0 2024-06-13T02:09:36.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d2c862700 1 -- 172.21.15.175:0/3552347711 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d2001d930 con 0x7f7d281081e0 2024-06-13T02:09:36.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d2c862700 1 -- 172.21.15.175:0/3552347711 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d200055a0 con 0x7f7d281081e0 2024-06-13T02:09:36.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.564+0000 7f7d2d864700 1 -- 172.21.15.175:0/3552347711 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d281a09b0 con 0x7f7d281081e0 2024-06-13T02:09:36.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.566+0000 7f7d2d864700 1 -- 172.21.15.175:0/3552347711 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d28069180 con 0x7f7d281081e0 2024-06-13T02:09:36.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.567+0000 7f7d2c862700 1 -- 172.21.15.175:0/3552347711 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f7d20024070 con 0x7f7d281081e0 2024-06-13T02:09:36.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.567+0000 7f7d2c862700 1 --2- 172.21.15.175:0/3552347711 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d100a2c20 0x7f7d100a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:09:36.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.568+0000 7f7d2c862700 1 -- 172.21.15.175:0/3552347711 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5397+0+0 (secure 0 0 0) 0x7f7d200cf8f0 con 0x7f7d281081e0 2024-06-13T02:09:36.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.568+0000 7f7d26ffd700 1 --2- 172.21.15.175:0/3552347711 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d100a2c20 0x7f7d100a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:09:36.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.569+0000 7f7d26ffd700 1 --2- 172.21.15.175:0/3552347711 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d100a2c20 0x7f7d100a50e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800ba60 tx=0x7f7d18005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:09:36.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.572+0000 7f7d2c862700 1 -- 172.21.15.175:0/3552347711 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7d2009d440 con 0x7f7d281081e0 2024-06-13T02:09:36.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:36.774+0000 7f7d2d864700 1 -- 172.21.15.175:0/3552347711 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7d280628d0 con 0x7f7d100a2c20 2024-06-13T02:09:37.576 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:37 smithi175 ceph-mon[36977]: osdmap e55: 8 total, 8 up, 8 in 2024-06-13T02:09:37.576 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:37 smithi175 ceph-mon[36977]: pgmap v201: 1 pgs: 1 unknown; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:37.576 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:37 smithi175 ceph-mon[36977]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:09:37.576 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:37 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:09:37.576 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:37 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:09:37.576 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:37 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:37.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:37 smithi002 ceph-mon[31960]: osdmap e55: 8 total, 8 up, 8 in 2024-06-13T02:09:37.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:37 smithi002 ceph-mon[31960]: pgmap v201: 1 pgs: 1 unknown; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:37.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:37 smithi002 ceph-mon[31960]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:09:37.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:37 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:09:37.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:37 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:09:37.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:37 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:37.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:37 smithi084 ceph-mon[36833]: osdmap e55: 8 total, 8 up, 8 in 2024-06-13T02:09:37.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:37 smithi084 ceph-mon[36833]: pgmap v201: 1 pgs: 1 unknown; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:37.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:37 smithi084 ceph-mon[36833]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:09:37.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:37 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:09:37.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:37 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:09:37.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:37 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:38.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:38 smithi002 ceph-mon[31960]: osdmap e56: 8 total, 8 up, 8 in 2024-06-13T02:09:38.690 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:38 smithi175 ceph-mon[36977]: osdmap e56: 8 total, 8 up, 8 in 2024-06-13T02:09:38.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:38 smithi084 ceph-mon[36833]: osdmap e56: 8 total, 8 up, 8 in 2024-06-13T02:09:39.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:39 smithi002 ceph-mon[31960]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:39.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:39 smithi084 ceph-mon[36833]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:39.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:39 smithi175 ceph-mon[36977]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:40.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:40 smithi002 ceph-mon[31960]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-06-13T02:09:40.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:40 smithi002 ceph-mon[31960]: Cluster is now healthy 2024-06-13T02:09:40.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:40 smithi002 ceph-mon[31960]: from='client.? 172.21.15.175:0/1169703822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c3f2a92-d956-4246-bce9-620824d0da22"}]: dispatch 2024-06-13T02:09:40.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:40 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c3f2a92-d956-4246-bce9-620824d0da22"}]: dispatch 2024-06-13T02:09:40.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:40 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c3f2a92-d956-4246-bce9-620824d0da22"}]': finished 2024-06-13T02:09:40.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:40 smithi002 ceph-mon[31960]: osdmap e57: 9 total, 8 up, 9 in 2024-06-13T02:09:40.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:40 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:09:40.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:40 smithi002 ceph-mon[31960]: from='client.? 172.21.15.175:0/3285242513' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:09:40.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:40 smithi084 ceph-mon[36833]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-06-13T02:09:40.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:40 smithi084 ceph-mon[36833]: Cluster is now healthy 2024-06-13T02:09:40.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:40 smithi084 ceph-mon[36833]: from='client.? 172.21.15.175:0/1169703822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c3f2a92-d956-4246-bce9-620824d0da22"}]: dispatch 2024-06-13T02:09:40.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:40 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c3f2a92-d956-4246-bce9-620824d0da22"}]: dispatch 2024-06-13T02:09:40.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:40 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c3f2a92-d956-4246-bce9-620824d0da22"}]': finished 2024-06-13T02:09:40.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:40 smithi084 ceph-mon[36833]: osdmap e57: 9 total, 8 up, 9 in 2024-06-13T02:09:40.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:40 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:09:40.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:40 smithi084 ceph-mon[36833]: from='client.? 172.21.15.175:0/3285242513' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:09:40.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:40 smithi175 ceph-mon[36977]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-06-13T02:09:40.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:40 smithi175 ceph-mon[36977]: Cluster is now healthy 2024-06-13T02:09:40.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:40 smithi175 ceph-mon[36977]: from='client.? 172.21.15.175:0/1169703822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c3f2a92-d956-4246-bce9-620824d0da22"}]: dispatch 2024-06-13T02:09:40.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:40 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c3f2a92-d956-4246-bce9-620824d0da22"}]: dispatch 2024-06-13T02:09:40.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:40 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c3f2a92-d956-4246-bce9-620824d0da22"}]': finished 2024-06-13T02:09:40.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:40 smithi175 ceph-mon[36977]: osdmap e57: 9 total, 8 up, 9 in 2024-06-13T02:09:40.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:40 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:09:40.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:40 smithi175 ceph-mon[36977]: from='client.? 172.21.15.175:0/3285242513' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:09:41.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:41 smithi002 ceph-mon[31960]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:41.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:41 smithi084 ceph-mon[36833]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:41.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:41 smithi175 ceph-mon[36977]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:43.634 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:43 smithi175 ceph-mon[36977]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:43.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:43 smithi084 ceph-mon[36833]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:43.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:43 smithi002 ceph-mon[31960]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:45.718 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:45 smithi175 ceph-mon[36977]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:45.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:45 smithi084 ceph-mon[36833]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:45.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:45 smithi002 ceph-mon[31960]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:47.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:47 smithi084 ceph-mon[36833]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:47.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-13T02:09:47.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:47 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:47.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:47 smithi084 ceph-mon[36833]: Deploying daemon osd.8 on smithi175 2024-06-13T02:09:47.726 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:47 smithi175 ceph-mon[36977]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:47.726 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-13T02:09:47.726 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:47 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:47.727 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:47 smithi175 ceph-mon[36977]: Deploying daemon osd.8 on smithi175 2024-06-13T02:09:47.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:47 smithi002 ceph-mon[31960]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:47.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-13T02:09:47.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:47 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:47.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:47 smithi002 ceph-mon[31960]: Deploying daemon osd.8 on smithi175 2024-06-13T02:09:49.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:49 smithi084 ceph-mon[36833]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:49.742 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:49 smithi175 ceph-mon[36977]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:49.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:49 smithi002 ceph-mon[31960]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:51.637 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:51 smithi175 ceph-mon[36977]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:51.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:51 smithi084 ceph-mon[36833]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:51.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:51 smithi002 ceph-mon[31960]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:53.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:53 smithi175 ceph-mon[36977]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:53.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:53 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:53.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:53 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:53.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:53 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:53.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:53 smithi002 ceph-mon[31960]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:53.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:53 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:53.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:53 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:53.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:53 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:53.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:53 smithi084 ceph-mon[36833]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:53.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:53 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:53.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:53 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:53.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:53 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:55.725 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:55 smithi175 ceph-mon[36977]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:55.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:55 smithi002 ceph-mon[31960]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:55.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:55 smithi084 ceph-mon[36833]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:56.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:56.460+0000 7f7d2c862700 1 -- 172.21.15.175:0/3552347711 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7d280628d0 con 0x7f7d100a2c20 2024-06-13T02:09:56.461 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 8 on host 'smithi175' 2024-06-13T02:09:56.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:56.463+0000 7f7d2d864700 1 -- 172.21.15.175:0/3552347711 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d100a2c20 msgr2=0x7f7d100a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:09:56.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:56.463+0000 7f7d2d864700 1 --2- 172.21.15.175:0/3552347711 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d100a2c20 0x7f7d100a50e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800ba60 tx=0x7f7d18005d50 comp rx=0 tx=0).stop 2024-06-13T02:09:56.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:56.463+0000 7f7d2d864700 1 -- 172.21.15.175:0/3552347711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d281081e0 msgr2=0x7f7d2819fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:09:56.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:56.463+0000 7f7d2d864700 1 --2- 172.21.15.175:0/3552347711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d281081e0 0x7f7d2819fc20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000d010 tx=0x7f7d20004e40 comp rx=0 tx=0).stop 2024-06-13T02:09:56.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:56.463+0000 7f7d2d864700 1 -- 172.21.15.175:0/3552347711 shutdown_connections 2024-06-13T02:09:56.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:56.463+0000 7f7d2d864700 1 --2- 172.21.15.175:0/3552347711 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d100a2c20 0x7f7d100a50e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:56.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:56.463+0000 7f7d2d864700 1 --2- 172.21.15.175:0/3552347711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d281081e0 0x7f7d2819fc20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:56.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:56.463+0000 7f7d2d864700 1 --2- 172.21.15.175:0/3552347711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d28102f80 0x7f7d28198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:56.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:56.463+0000 7f7d2d864700 1 --2- 172.21.15.175:0/3552347711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d281058b0 0x7f7d28198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:09:56.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:56.463+0000 7f7d2d864700 1 -- 172.21.15.175:0/3552347711 >> 172.21.15.175:0/3552347711 conn(0x7f7d280fc9b0 msgr2=0x7f7d281038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:09:56.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:56.463+0000 7f7d2d864700 1 -- 172.21.15.175:0/3552347711 shutdown_connections 2024-06-13T02:09:56.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:09:56.463+0000 7f7d2d864700 1 -- 172.21.15.175:0/3552347711 wait complete. 2024-06-13T02:09:56.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:56 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:56.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:56 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:56.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:56 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:56.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:56 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:09:56.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:56 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:56.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:56 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:56.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:56 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:56.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:56 smithi175 ceph-mon[36977]: from='osd.8 [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-13T02:09:56.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:56 smithi175 ceph-mon[36977]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-13T02:09:56.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:56 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:56.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:56 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:56.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:56 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:56.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:56 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:56.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:56 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:09:56.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:56 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:56.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:56 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:56.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:56 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:56.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:56 smithi002 ceph-mon[31960]: from='osd.8 [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-13T02:09:56.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:56 smithi002 ceph-mon[31960]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-13T02:09:56.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:56 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:56.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:56 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:56.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:56 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:56.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:56 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:09:56.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:56 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:09:56.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:56 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:56.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:56 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:56.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:56 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:09:56.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:56 smithi084 ceph-mon[36833]: from='osd.8 [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-13T02:09:56.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:56 smithi084 ceph-mon[36833]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-13T02:09:56.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:56 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:09:57.073 DEBUG:teuthology.orchestra.run.smithi175:osd.8> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.8.service 2024-06-13T02:09:57.075 INFO:tasks.cephadm:Deploying osd.9 on smithi002 with /dev/vg_nvme/lv_1... 2024-06-13T02:09:57.076 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-13T02:09:57.586 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:09:57.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:57 smithi175 ceph-mon[36977]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:57.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:57 smithi175 ceph-mon[36977]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-13T02:09:57.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:57 smithi175 ceph-mon[36977]: from='osd.8 [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:09:57.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:57 smithi175 ceph-mon[36977]: osdmap e58: 9 total, 8 up, 9 in 2024-06-13T02:09:57.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:57 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:09:57.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:57 smithi175 ceph-mon[36977]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:09:57.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:57 smithi002 ceph-mon[31960]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:57.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:57 smithi002 ceph-mon[31960]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-13T02:09:57.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:57 smithi002 ceph-mon[31960]: from='osd.8 [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:09:57.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:57 smithi002 ceph-mon[31960]: osdmap e58: 9 total, 8 up, 9 in 2024-06-13T02:09:57.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:57 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:09:57.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:57 smithi002 ceph-mon[31960]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:09:57.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:57 smithi084 ceph-mon[36833]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:57.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:57 smithi084 ceph-mon[36833]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-13T02:09:57.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:57 smithi084 ceph-mon[36833]: from='osd.8 [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:09:57.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:57 smithi084 ceph-mon[36833]: osdmap e58: 9 total, 8 up, 9 in 2024-06-13T02:09:57.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:57 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:09:57.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:57 smithi084 ceph-mon[36833]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:09:58.783 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:09:58 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:09:58.436+0000 7f1f3de8b700 -1 osd.8 0 waiting for initial osdmap 2024-06-13T02:09:58.783 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:09:58 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:09:58.445+0000 7f1f39c7e700 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T02:09:59.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:59 smithi084 ceph-mon[36833]: purged_snaps scrub starts 2024-06-13T02:09:59.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:59 smithi084 ceph-mon[36833]: purged_snaps scrub ok 2024-06-13T02:09:59.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:59 smithi084 ceph-mon[36833]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:59.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:59 smithi084 ceph-mon[36833]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-06-13T02:09:59.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:59 smithi084 ceph-mon[36833]: osdmap e59: 9 total, 8 up, 9 in 2024-06-13T02:09:59.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:59 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:09:59.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:09:59 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:09:59.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:59 smithi175 ceph-mon[36977]: purged_snaps scrub starts 2024-06-13T02:09:59.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:59 smithi175 ceph-mon[36977]: purged_snaps scrub ok 2024-06-13T02:09:59.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:59 smithi175 ceph-mon[36977]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:59.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:59 smithi175 ceph-mon[36977]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-06-13T02:09:59.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:59 smithi175 ceph-mon[36977]: osdmap e59: 9 total, 8 up, 9 in 2024-06-13T02:09:59.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:59 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:09:59.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:09:59 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:09:59.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:59 smithi002 ceph-mon[31960]: purged_snaps scrub starts 2024-06-13T02:09:59.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:59 smithi002 ceph-mon[31960]: purged_snaps scrub ok 2024-06-13T02:09:59.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:59 smithi002 ceph-mon[31960]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-06-13T02:09:59.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:59 smithi002 ceph-mon[31960]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-06-13T02:09:59.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:59 smithi002 ceph-mon[31960]: osdmap e59: 9 total, 8 up, 9 in 2024-06-13T02:09:59.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:59 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:09:59.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:09:59 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:10:00.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: osd.8 [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232] boot 2024-06-13T02:10:00.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: osdmap e60: 9 total, 9 up, 9 in 2024-06-13T02:10:00.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:10:00.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: Detected new or changed devices on smithi175 2024-06-13T02:10:00.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:00.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:00.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:00.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:00.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:00.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi175 to 5696M 2024-06-13T02:10:00.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:00.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:00.722 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:10:00.722 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:00.722 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: overall HEALTH_OK 2024-06-13T02:10:00.722 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:00 smithi084 ceph-mon[36833]: osdmap e61: 9 total, 9 up, 9 in 2024-06-13T02:10:00.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: osd.8 [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232] boot 2024-06-13T02:10:00.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: osdmap e60: 9 total, 9 up, 9 in 2024-06-13T02:10:00.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:10:00.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: Detected new or changed devices on smithi175 2024-06-13T02:10:00.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:00.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:00.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:00.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:00.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:00.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi175 to 5696M 2024-06-13T02:10:00.784 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:00.784 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:00.784 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:10:00.784 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:00.784 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: overall HEALTH_OK 2024-06-13T02:10:00.784 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:00 smithi175 ceph-mon[36977]: osdmap e61: 9 total, 9 up, 9 in 2024-06-13T02:10:00.804 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: osd.8 [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232] boot 2024-06-13T02:10:00.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: osdmap e60: 9 total, 9 up, 9 in 2024-06-13T02:10:00.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:10:00.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: Detected new or changed devices on smithi175 2024-06-13T02:10:00.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:00.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:00.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:00.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:00.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:00.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi175 to 5696M 2024-06-13T02:10:00.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:00.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:00.805 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:10:00.806 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:00.806 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: overall HEALTH_OK 2024-06-13T02:10:00.806 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:00 smithi002 ceph-mon[31960]: osdmap e61: 9 total, 9 up, 9 in 2024-06-13T02:10:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-13T02:10:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-13T02:10:00.851 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10+0 records in 2024-06-13T02:10:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:10+0 records out 2024-06-13T02:10:00.851 INFO:teuthology.orchestra.run.smithi002.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0546386 s, 192 MB/s 2024-06-13T02:10:00.851 INFO:teuthology.orchestra.run.smithi002.stderr:--> Zapping successful for: 2024-06-13T02:10:01.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi002:vg_nvme/lv_1 2024-06-13T02:10:02.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:01 smithi002 ceph-mon[31960]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:02.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:01 smithi002 ceph-mon[31960]: osdmap e62: 9 total, 9 up, 9 in 2024-06-13T02:10:02.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:01 smithi084 ceph-mon[36833]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:02.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:01 smithi084 ceph-mon[36833]: osdmap e62: 9 total, 9 up, 9 in 2024-06-13T02:10:02.276 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:10:02.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:01 smithi175 ceph-mon[36977]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:02.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:01 smithi175 ceph-mon[36977]: osdmap e62: 9 total, 9 up, 9 in 2024-06-13T02:10:03.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:03 smithi084 ceph-mon[36833]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:03.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:03 smithi084 ceph-mon[36833]: osdmap e63: 9 total, 9 up, 9 in 2024-06-13T02:10:03.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:03 smithi175 ceph-mon[36977]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:03.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:03 smithi175 ceph-mon[36977]: osdmap e63: 9 total, 9 up, 9 in 2024-06-13T02:10:03.866 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:03 smithi002 ceph-mon[31960]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:03.866 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:03 smithi002 ceph-mon[31960]: osdmap e63: 9 total, 9 up, 9 in 2024-06-13T02:10:04.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.682+0000 7f2a65600700 1 -- 172.21.15.2:0/4260183506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a60105fe0 msgr2=0x7f2a60106460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:10:04.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.682+0000 7f2a65600700 1 --2- 172.21.15.2:0/4260183506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a60105fe0 0x7f2a60106460 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800b0a0 tx=0x7f2a5800b3b0 comp rx=0 tx=0).stop 2024-06-13T02:10:04.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.682+0000 7f2a65600700 1 -- 172.21.15.2:0/4260183506 shutdown_connections 2024-06-13T02:10:04.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.682+0000 7f2a65600700 1 --2- 172.21.15.2:0/4260183506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a60105fe0 0x7f2a60106460 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:04.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.682+0000 7f2a65600700 1 --2- 172.21.15.2:0/4260183506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a60100ca0 0x7f2a601030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:04.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.682+0000 7f2a65600700 1 --2- 172.21.15.2:0/4260183506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a60103610 0x7f2a60105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:04.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.682+0000 7f2a65600700 1 -- 172.21.15.2:0/4260183506 >> 172.21.15.2:0/4260183506 conn(0x7f2a600fc8c0 msgr2=0x7f2a600fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:10:04.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.683+0000 7f2a65600700 1 -- 172.21.15.2:0/4260183506 shutdown_connections 2024-06-13T02:10:04.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.683+0000 7f2a65600700 1 -- 172.21.15.2:0/4260183506 wait complete. 2024-06-13T02:10:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.684+0000 7f2a65600700 1 Processor -- start 2024-06-13T02:10:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.684+0000 7f2a65600700 1 -- start start 2024-06-13T02:10:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.684+0000 7f2a65600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a60100ca0 0x7f2a6019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:10:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.684+0000 7f2a65600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a60103610 0x7f2a6019f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:10:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.684+0000 7f2a65600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a60105fe0 0x7f2a601a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:10:04.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.684+0000 7f2a65600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a601145b0 con 0x7f2a60105fe0 2024-06-13T02:10:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.684+0000 7f2a65600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2a60114430 con 0x7f2a60100ca0 2024-06-13T02:10:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.684+0000 7f2a65600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2a60114730 con 0x7f2a60103610 2024-06-13T02:10:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.685+0000 7f2a5fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a60100ca0 0x7f2a6019eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:10:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.685+0000 7f2a5fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a60100ca0 0x7f2a6019eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:33704/0 (socket says 172.21.15.2:33704) 2024-06-13T02:10:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.685+0000 7f2a5fe00700 1 -- 172.21.15.2:0/798561165 learned_addr learned my addr 172.21.15.2:0/798561165 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:10:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.685+0000 7f2a64c00700 1 --2- 172.21.15.2:0/798561165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a60105fe0 0x7f2a601a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:10:04.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.685+0000 7f2a5f400700 1 --2- 172.21.15.2:0/798561165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a60103610 0x7f2a6019f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:10:04.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.685+0000 7f2a5fe00700 1 -- 172.21.15.2:0/798561165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a60103610 msgr2=0x7f2a6019f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:10:04.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.685+0000 7f2a5fe00700 1 --2- 172.21.15.2:0/798561165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a60103610 0x7f2a6019f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:04.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.685+0000 7f2a5fe00700 1 -- 172.21.15.2:0/798561165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a60105fe0 msgr2=0x7f2a601a60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:10:04.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.685+0000 7f2a5fe00700 1 --2- 172.21.15.2:0/798561165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a60105fe0 0x7f2a601a60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:04.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.685+0000 7f2a5fe00700 1 -- 172.21.15.2:0/798561165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a601a6790 con 0x7f2a60100ca0 2024-06-13T02:10:04.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.685+0000 7f2a64c00700 1 --2- 172.21.15.2:0/798561165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a60105fe0 0x7f2a601a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:10:04.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.686+0000 7f2a5fe00700 1 --2- 172.21.15.2:0/798561165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a60100ca0 0x7f2a6019eb30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000e9a0 tx=0x7f2a5000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:10:04.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.686+0000 7f2a5cc00700 1 -- 172.21.15.2:0/798561165 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5000ca10 con 0x7f2a60100ca0 2024-06-13T02:10:04.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.686+0000 7f2a5cc00700 1 -- 172.21.15.2:0/798561165 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a5000cbb0 con 0x7f2a60100ca0 2024-06-13T02:10:04.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.686+0000 7f2a5cc00700 1 -- 172.21.15.2:0/798561165 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a50018710 con 0x7f2a60100ca0 2024-06-13T02:10:04.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.686+0000 7f2a65600700 1 -- 172.21.15.2:0/798561165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a601a6a80 con 0x7f2a60100ca0 2024-06-13T02:10:04.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.686+0000 7f2a65600700 1 -- 172.21.15.2:0/798561165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a601a6f70 con 0x7f2a60100ca0 2024-06-13T02:10:04.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.687+0000 7f2a65600700 1 -- 172.21.15.2:0/798561165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a60069180 con 0x7f2a60100ca0 2024-06-13T02:10:04.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.689+0000 7f2a5cc00700 1 -- 172.21.15.2:0/798561165 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2a500188b0 con 0x7f2a60100ca0 2024-06-13T02:10:04.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.691+0000 7f2a5cc00700 1 --2- 172.21.15.2:0/798561165 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2a440a2c20 0x7f2a440a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:10:04.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.691+0000 7f2a5cc00700 1 -- 172.21.15.2:0/798561165 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5829+0+0 (secure 0 0 0) 0x7f2a500ce8b0 con 0x7f2a60100ca0 2024-06-13T02:10:04.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.691+0000 7f2a5f400700 1 --2- 172.21.15.2:0/798561165 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2a440a2c20 0x7f2a440a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:10:04.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.692+0000 7f2a5f400700 1 --2- 172.21.15.2:0/798561165 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2a440a2c20 0x7f2a440a50e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009c60 tx=0x7f2a4c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:10:04.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.695+0000 7f2a5cc00700 1 -- 172.21.15.2:0/798561165 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2a5009c120 con 0x7f2a60100ca0 2024-06-13T02:10:04.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:04 smithi084 ceph-mon[36833]: osdmap e64: 9 total, 9 up, 9 in 2024-06-13T02:10:04.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:04 smithi175 ceph-mon[36977]: osdmap e64: 9 total, 9 up, 9 in 2024-06-13T02:10:04.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:04 smithi002 ceph-mon[31960]: osdmap e64: 9 total, 9 up, 9 in 2024-06-13T02:10:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:04.936+0000 7f2a65600700 1 -- 172.21.15.2:0/798561165 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f2a60062990 con 0x7f2a440a2c20 2024-06-13T02:10:05.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:05 smithi084 ceph-mon[36833]: pgmap v224: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-13T02:10:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:05 smithi084 ceph-mon[36833]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:10:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:10:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:10:05.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:05.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:05 smithi175 ceph-mon[36977]: pgmap v224: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-13T02:10:05.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:05 smithi175 ceph-mon[36977]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:10:05.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:10:05.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:10:05.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:05.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:05 smithi002 ceph-mon[31960]: pgmap v224: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-06-13T02:10:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:05 smithi002 ceph-mon[31960]: from='client.24335 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi002:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:10:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:10:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:10:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:07.562 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:07 smithi002 ceph-mon[31960]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 278 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-06-13T02:10:07.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:07 smithi175 ceph-mon[36977]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 278 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-06-13T02:10:07.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:07 smithi084 ceph-mon[36833]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 278 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-06-13T02:10:09.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:09 smithi002 ceph-mon[31960]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 278 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-06-13T02:10:09.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:09 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3387463826' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9839f78-05c6-4b3f-bc14-cb771a03ff5c"}]: dispatch 2024-06-13T02:10:09.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:09 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3387463826' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e9839f78-05c6-4b3f-bc14-cb771a03ff5c"}]': finished 2024-06-13T02:10:09.738 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:09 smithi002 ceph-mon[31960]: osdmap e65: 10 total, 9 up, 10 in 2024-06-13T02:10:09.739 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:09.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:09 smithi175 ceph-mon[36977]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 278 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-06-13T02:10:09.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:09 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3387463826' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9839f78-05c6-4b3f-bc14-cb771a03ff5c"}]: dispatch 2024-06-13T02:10:09.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:09 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3387463826' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e9839f78-05c6-4b3f-bc14-cb771a03ff5c"}]': finished 2024-06-13T02:10:09.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:09 smithi175 ceph-mon[36977]: osdmap e65: 10 total, 9 up, 10 in 2024-06-13T02:10:09.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:09.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:09 smithi084 ceph-mon[36833]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 278 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-06-13T02:10:09.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:09 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3387463826' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9839f78-05c6-4b3f-bc14-cb771a03ff5c"}]: dispatch 2024-06-13T02:10:09.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:09 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3387463826' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e9839f78-05c6-4b3f-bc14-cb771a03ff5c"}]': finished 2024-06-13T02:10:09.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:09 smithi084 ceph-mon[36833]: osdmap e65: 10 total, 9 up, 10 in 2024-06-13T02:10:09.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:10.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:10 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2127722875' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:10:10.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:10 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2127722875' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:10:10.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:10 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2127722875' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:10:11.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:11 smithi175 ceph-mon[36977]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-06-13T02:10:11.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:11 smithi002 ceph-mon[31960]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-06-13T02:10:11.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:11 smithi084 ceph-mon[36833]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-06-13T02:10:13.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:13 smithi002 ceph-mon[31960]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:13.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:13 smithi175 ceph-mon[36977]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:13.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:13 smithi084 ceph-mon[36833]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:15.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:15 smithi002 ceph-mon[31960]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:15.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:15 smithi175 ceph-mon[36977]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:15.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:15 smithi084 ceph-mon[36833]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:17.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:17 smithi175 ceph-mon[36977]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:17.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:17 smithi002 ceph-mon[31960]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:17.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:17 smithi084 ceph-mon[36833]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:18.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:18 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-13T02:10:18.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:18 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:18.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:18 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-13T02:10:18.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:18 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:18.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:18 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-13T02:10:18.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:18 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:19.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:19 smithi002 ceph-mon[31960]: Deploying daemon osd.9 on smithi002 2024-06-13T02:10:19.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:19 smithi002 ceph-mon[31960]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:19.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:19 smithi175 ceph-mon[36977]: Deploying daemon osd.9 on smithi002 2024-06-13T02:10:19.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:19 smithi175 ceph-mon[36977]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:19.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:19 smithi084 ceph-mon[36833]: Deploying daemon osd.9 on smithi002 2024-06-13T02:10:19.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:19 smithi084 ceph-mon[36833]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:21.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:21 smithi002 ceph-mon[31960]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:21.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:21 smithi175 ceph-mon[36977]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:21.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:21 smithi084 ceph-mon[36833]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:23.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:23 smithi175 ceph-mon[36977]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:23.864 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:23 smithi002 ceph-mon[31960]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:23.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:23 smithi084 ceph-mon[36833]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:25.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:25 smithi175 ceph-mon[36977]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:25.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:25 smithi002 ceph-mon[31960]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:25.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:25 smithi084 ceph-mon[36833]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:27.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:27 smithi002 ceph-mon[31960]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:27.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:10:27.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:27.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:27.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:27 smithi175 ceph-mon[36977]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:27.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:10:27.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:27.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:27.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:27 smithi084 ceph-mon[36833]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:27.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:10:27.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:27.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:29.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:29 smithi002 ceph-mon[31960]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:29.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:29 smithi084 ceph-mon[36833]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:30.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:29 smithi175 ceph-mon[36977]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:32.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:31 smithi002 ceph-mon[31960]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:32.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:31 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:32.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:31 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:32.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:31 smithi002 ceph-mon[31960]: from='osd.9 [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-13T02:10:32.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:31 smithi002 ceph-mon[31960]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-13T02:10:32.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:31 smithi084 ceph-mon[36833]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:32.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:31 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:32.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:31 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:32.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:31 smithi084 ceph-mon[36833]: from='osd.9 [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-13T02:10:32.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:31 smithi084 ceph-mon[36833]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-13T02:10:32.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:32.240+0000 7f2a5cc00700 1 -- 172.21.15.2:0/798561165 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2a60062990 con 0x7f2a440a2c20 2024-06-13T02:10:32.243 INFO:teuthology.orchestra.run.smithi002.stdout:Created osd(s) 9 on host 'smithi002' 2024-06-13T02:10:32.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:32.243+0000 7f2a65600700 1 -- 172.21.15.2:0/798561165 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2a440a2c20 msgr2=0x7f2a440a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:10:32.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:32.243+0000 7f2a65600700 1 --2- 172.21.15.2:0/798561165 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2a440a2c20 0x7f2a440a50e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009c60 tx=0x7f2a4c009260 comp rx=0 tx=0).stop 2024-06-13T02:10:32.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:32.243+0000 7f2a65600700 1 -- 172.21.15.2:0/798561165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a60100ca0 msgr2=0x7f2a6019eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:10:32.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:32.243+0000 7f2a65600700 1 --2- 172.21.15.2:0/798561165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a60100ca0 0x7f2a6019eb30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000e9a0 tx=0x7f2a5000ecb0 comp rx=0 tx=0).stop 2024-06-13T02:10:32.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:32.244+0000 7f2a65600700 1 -- 172.21.15.2:0/798561165 shutdown_connections 2024-06-13T02:10:32.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:32.244+0000 7f2a65600700 1 --2- 172.21.15.2:0/798561165 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2a440a2c20 0x7f2a440a50e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:32.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:32.244+0000 7f2a65600700 1 --2- 172.21.15.2:0/798561165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a60105fe0 0x7f2a601a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:32.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:32.244+0000 7f2a65600700 1 --2- 172.21.15.2:0/798561165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a60100ca0 0x7f2a6019eb30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:32.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:32.244+0000 7f2a65600700 1 --2- 172.21.15.2:0/798561165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a60103610 0x7f2a6019f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:32.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:32.244+0000 7f2a65600700 1 -- 172.21.15.2:0/798561165 >> 172.21.15.2:0/798561165 conn(0x7f2a600fc8c0 msgr2=0x7f2a60101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:10:32.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:32.244+0000 7f2a65600700 1 -- 172.21.15.2:0/798561165 shutdown_connections 2024-06-13T02:10:32.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:10:32.244+0000 7f2a65600700 1 -- 172.21.15.2:0/798561165 wait complete. 2024-06-13T02:10:32.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:31 smithi175 ceph-mon[36977]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:32.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:31 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:32.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:31 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:32.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:31 smithi175 ceph-mon[36977]: from='osd.9 [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-13T02:10:32.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:31 smithi175 ceph-mon[36977]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-13T02:10:32.958 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:32 smithi002 ceph-mon[31960]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-13T02:10:32.958 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:32 smithi002 ceph-mon[31960]: osdmap e66: 10 total, 9 up, 10 in 2024-06-13T02:10:32.958 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:32 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:32.958 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:32 smithi002 ceph-mon[31960]: from='osd.9 [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:10:32.958 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:32 smithi002 ceph-mon[31960]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:10:32.958 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:32 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:32.959 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:32 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:33.017 DEBUG:teuthology.orchestra.run.smithi002:osd.9> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.9.service 2024-06-13T02:10:33.025 INFO:tasks.cephadm:Deploying osd.10 on smithi084 with /dev/vg_nvme/lv_1... 2024-06-13T02:10:33.026 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-13T02:10:33.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:32 smithi084 ceph-mon[36833]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-13T02:10:33.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:32 smithi084 ceph-mon[36833]: osdmap e66: 10 total, 9 up, 10 in 2024-06-13T02:10:33.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:32 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:33.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:32 smithi084 ceph-mon[36833]: from='osd.9 [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:10:33.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:32 smithi084 ceph-mon[36833]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:10:33.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:32 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:33.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:32 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:33.272 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T02:10:33.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:32 smithi175 ceph-mon[36977]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-13T02:10:33.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:32 smithi175 ceph-mon[36977]: osdmap e66: 10 total, 9 up, 10 in 2024-06-13T02:10:33.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:32 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:33.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:32 smithi175 ceph-mon[36977]: from='osd.9 [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:10:33.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:32 smithi175 ceph-mon[36977]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]: dispatch 2024-06-13T02:10:33.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:32 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:33.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:32 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:33.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:33 smithi084 ceph-mon[36833]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:33.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:33 smithi084 ceph-mon[36833]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T02:10:33.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:33 smithi084 ceph-mon[36833]: osdmap e67: 10 total, 9 up, 10 in 2024-06-13T02:10:33.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:33 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:33.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:33 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:34.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:33 smithi002 ceph-mon[31960]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:34.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:33 smithi002 ceph-mon[31960]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T02:10:34.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:33 smithi002 ceph-mon[31960]: osdmap e67: 10 total, 9 up, 10 in 2024-06-13T02:10:34.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:34.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:34.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:33 smithi175 ceph-mon[36977]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:34.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:33 smithi175 ceph-mon[36977]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi002", "root=default"]}]': finished 2024-06-13T02:10:34.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:33 smithi175 ceph-mon[36977]: osdmap e67: 10 total, 9 up, 10 in 2024-06-13T02:10:34.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:34.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:34.925 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:34 smithi084 ceph-mon[36833]: purged_snaps scrub starts 2024-06-13T02:10:34.925 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:34 smithi084 ceph-mon[36833]: purged_snaps scrub ok 2024-06-13T02:10:34.925 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:34 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:34.926 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:34 smithi084 ceph-mon[36833]: osd.9 [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390] boot 2024-06-13T02:10:34.926 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:34 smithi084 ceph-mon[36833]: osdmap e68: 10 total, 10 up, 10 in 2024-06-13T02:10:34.926 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:34 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:35.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:34 smithi002 ceph-mon[31960]: purged_snaps scrub starts 2024-06-13T02:10:35.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:34 smithi002 ceph-mon[31960]: purged_snaps scrub ok 2024-06-13T02:10:35.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:34 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:35.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:34 smithi002 ceph-mon[31960]: osd.9 [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390] boot 2024-06-13T02:10:35.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:34 smithi002 ceph-mon[31960]: osdmap e68: 10 total, 10 up, 10 in 2024-06-13T02:10:35.089 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:34 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:35.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:34 smithi175 ceph-mon[36977]: purged_snaps scrub starts 2024-06-13T02:10:35.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:34 smithi175 ceph-mon[36977]: purged_snaps scrub ok 2024-06-13T02:10:35.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:34 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:35.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:34 smithi175 ceph-mon[36977]: osd.9 [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390] boot 2024-06-13T02:10:35.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:34 smithi175 ceph-mon[36977]: osdmap e68: 10 total, 10 up, 10 in 2024-06-13T02:10:35.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:34 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:10:35.362 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-13T02:10:35.363 INFO:teuthology.orchestra.run.smithi084.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-13T02:10:35.363 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10+0 records in 2024-06-13T02:10:35.363 INFO:teuthology.orchestra.run.smithi084.stderr:10+0 records out 2024-06-13T02:10:35.363 INFO:teuthology.orchestra.run.smithi084.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111142 s, 943 MB/s 2024-06-13T02:10:35.363 INFO:teuthology.orchestra.run.smithi084.stderr:--> Zapping successful for: 2024-06-13T02:10:35.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:35 smithi084 ceph-mon[36833]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:35.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:35 smithi084 ceph-mon[36833]: osdmap e69: 10 total, 10 up, 10 in 2024-06-13T02:10:36.111 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi084:vg_nvme/lv_1 2024-06-13T02:10:36.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:35 smithi002 ceph-mon[31960]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:36.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:35 smithi002 ceph-mon[31960]: osdmap e69: 10 total, 10 up, 10 in 2024-06-13T02:10:36.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:35 smithi175 ceph-mon[36977]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-06-13T02:10:36.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:35 smithi175 ceph-mon[36977]: osdmap e69: 10 total, 10 up, 10 in 2024-06-13T02:10:36.352 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T02:10:38.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.059+0000 7fc48255d700 1 -- 172.21.15.84:0/3305582386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c105950 msgr2=0x7fc47c107d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:10:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.059+0000 7fc48255d700 1 --2- 172.21.15.84:0/3305582386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c105950 0x7fc47c107d40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009990 tx=0x7fc46c009ca0 comp rx=0 tx=0).stop 2024-06-13T02:10:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.059+0000 7fc48255d700 1 -- 172.21.15.84:0/3305582386 shutdown_connections 2024-06-13T02:10:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.059+0000 7fc48255d700 1 --2- 172.21.15.84:0/3305582386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc47c108280 0x7fc47c10a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.059+0000 7fc48255d700 1 --2- 172.21.15.84:0/3305582386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc47c103020 0x7fc47c105410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.059+0000 7fc48255d700 1 --2- 172.21.15.84:0/3305582386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c105950 0x7fc47c107d40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.059+0000 7fc48255d700 1 -- 172.21.15.84:0/3305582386 >> 172.21.15.84:0/3305582386 conn(0x7fc47c0fc990 msgr2=0x7fc47c0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:10:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.059+0000 7fc48255d700 1 -- 172.21.15.84:0/3305582386 shutdown_connections 2024-06-13T02:10:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.059+0000 7fc48255d700 1 -- 172.21.15.84:0/3305582386 wait complete. 2024-06-13T02:10:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.060+0000 7fc48255d700 1 Processor -- start 2024-06-13T02:10:38.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.060+0000 7fc48255d700 1 -- start start 2024-06-13T02:10:38.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.060+0000 7fc48255d700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc47c103020 0x7fc47c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:10:38.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.060+0000 7fc48255d700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c105950 0x7fc47c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:10:38.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.060+0000 7fc48255d700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc47c108280 0x7fc47c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:10:38.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.060+0000 7fc48255d700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c10e140 con 0x7fc47c108280 2024-06-13T02:10:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.060+0000 7fc48255d700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c10dfc0 con 0x7fc47c105950 2024-06-13T02:10:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.060+0000 7fc48255d700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c10e2c0 con 0x7fc47c103020 2024-06-13T02:10:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.061+0000 7fc47b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c105950 0x7fc47c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:10:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.061+0000 7fc47b7fe700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c105950 0x7fc47c198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50812/0 (socket says 172.21.15.84:50812) 2024-06-13T02:10:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.061+0000 7fc47b7fe700 1 -- 172.21.15.84:0/3754859763 learned_addr learned my addr 172.21.15.84:0/3754859763 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-06-13T02:10:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.061+0000 7fc47bfff700 1 --2- 172.21.15.84:0/3754859763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc47c103020 0x7fc47c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:10:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.061+0000 7fc47b7fe700 1 -- 172.21.15.84:0/3754859763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc47c103020 msgr2=0x7fc47c1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:10:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.061+0000 7fc47b7fe700 1 --2- 172.21.15.84:0/3754859763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc47c103020 0x7fc47c1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:38.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.061+0000 7fc47b7fe700 1 -- 172.21.15.84:0/3754859763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc47c108280 msgr2=0x7fc47c19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:10:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.061+0000 7fc47b7fe700 1 --2- 172.21.15.84:0/3754859763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc47c108280 0x7fc47c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.061+0000 7fc47b7fe700 1 -- 172.21.15.84:0/3754859763 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47c1a0440 con 0x7fc47c105950 2024-06-13T02:10:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.061+0000 7fc47b7fe700 1 --2- 172.21.15.84:0/3754859763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c105950 0x7fc47c198d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009580 tx=0x7fc46c005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:10:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.061+0000 7fc4797fa700 1 -- 172.21.15.84:0/3754859763 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c027070 con 0x7fc47c105950 2024-06-13T02:10:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.061+0000 7fc4797fa700 1 -- 172.21.15.84:0/3754859763 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc46c004150 con 0x7fc47c105950 2024-06-13T02:10:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.061+0000 7fc48255d700 1 -- 172.21.15.84:0/3754859763 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc47c1a06d0 con 0x7fc47c105950 2024-06-13T02:10:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.061+0000 7fc4797fa700 1 -- 172.21.15.84:0/3754859763 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c022dd0 con 0x7fc47c105950 2024-06-13T02:10:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.061+0000 7fc48255d700 1 -- 172.21.15.84:0/3754859763 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc47c1a0b80 con 0x7fc47c105950 2024-06-13T02:10:38.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.062+0000 7fc48255d700 1 -- 172.21.15.84:0/3754859763 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc47c069180 con 0x7fc47c105950 2024-06-13T02:10:38.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.063+0000 7fc4797fa700 1 -- 172.21.15.84:0/3754859763 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc46c02a070 con 0x7fc47c105950 2024-06-13T02:10:38.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.064+0000 7fc4797fa700 1 --2- 172.21.15.84:0/3754859763 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc4680a2ca0 0x7fc4680a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:10:38.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.064+0000 7fc4797fa700 1 -- 172.21.15.84:0/3754859763 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6261+0+0 (secure 0 0 0) 0x7fc46c0cfe70 con 0x7fc47c105950 2024-06-13T02:10:38.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.064+0000 7fc47bfff700 1 --2- 172.21.15.84:0/3754859763 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc4680a2ca0 0x7fc4680a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:10:38.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.065+0000 7fc47bfff700 1 --2- 172.21.15.84:0/3754859763 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc4680a2ca0 0x7fc4680a5160 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc464007c60 tx=0x7fc4640073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:10:38.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.068+0000 7fc4797fa700 1 -- 172.21.15.84:0/3754859763 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc46c013070 con 0x7fc47c105950 2024-06-13T02:10:38.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:37 smithi002 ceph-mon[31960]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:38.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:37 smithi084 ceph-mon[36833]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:38.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:38.276+0000 7fc48255d700 1 -- 172.21.15.84:0/3754859763 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc47c062990 con 0x7fc4680a2ca0 2024-06-13T02:10:38.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:37 smithi175 ceph-mon[36977]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:39.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: Detected new or changed devices on smithi002 2024-06-13T02:10:39.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:39.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:39.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:39.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:39.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:39.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:39.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi002 to 4273M 2024-06-13T02:10:39.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:39.216 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:39.217 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:10:39.217 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:39.217 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:10:39.217 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:10:39.217 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:39.217 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:10:39.217 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:39.217 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:10:39.217 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:39.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: Detected new or changed devices on smithi002 2024-06-13T02:10:39.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:39.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:39.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:39.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:39.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:39.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:39.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi002 to 4273M 2024-06-13T02:10:39.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:39.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:39.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:10:39.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:39.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:10:39.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:10:39.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:39.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:10:39.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:39.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:10:39.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:39.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: Detected new or changed devices on smithi002 2024-06-13T02:10:39.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:39.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:39.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:39.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:39.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:39.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:10:39.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi002 to 4273M 2024-06-13T02:10:39.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:39.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:39.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:10:39.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:39.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:10:39.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:10:39.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:39.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:10:39.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:39.385 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:10:39.385 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:40.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:40 smithi084 ceph-mon[36833]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:10:40.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:40 smithi084 ceph-mon[36833]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:40.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:40 smithi002 ceph-mon[31960]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:10:40.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:40 smithi002 ceph-mon[31960]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:40.464 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:40 smithi175 ceph-mon[36977]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:10:40.464 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:40 smithi175 ceph-mon[36977]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:42 smithi002 ceph-mon[31960]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:42 smithi002 ceph-mon[31960]: from='client.? 172.21.15.84:0/3060904417' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66719431-5ba9-4865-957b-f6582e607a00"}]: dispatch 2024-06-13T02:10:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:42 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66719431-5ba9-4865-957b-f6582e607a00"}]: dispatch 2024-06-13T02:10:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:42 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66719431-5ba9-4865-957b-f6582e607a00"}]': finished 2024-06-13T02:10:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:42 smithi002 ceph-mon[31960]: osdmap e70: 11 total, 10 up, 11 in 2024-06-13T02:10:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:10:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:42 smithi002 ceph-mon[31960]: from='client.? 172.21.15.84:0/1239242810' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:10:42.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:42 smithi084 ceph-mon[36833]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:42.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:42 smithi084 ceph-mon[36833]: from='client.? 172.21.15.84:0/3060904417' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66719431-5ba9-4865-957b-f6582e607a00"}]: dispatch 2024-06-13T02:10:42.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:42 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66719431-5ba9-4865-957b-f6582e607a00"}]: dispatch 2024-06-13T02:10:42.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:42 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66719431-5ba9-4865-957b-f6582e607a00"}]': finished 2024-06-13T02:10:42.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:42 smithi084 ceph-mon[36833]: osdmap e70: 11 total, 10 up, 11 in 2024-06-13T02:10:42.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:10:42.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:42 smithi084 ceph-mon[36833]: from='client.? 172.21.15.84:0/1239242810' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:10:42.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:42 smithi175 ceph-mon[36977]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:42.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:42 smithi175 ceph-mon[36977]: from='client.? 172.21.15.84:0/3060904417' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66719431-5ba9-4865-957b-f6582e607a00"}]: dispatch 2024-06-13T02:10:42.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:42 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66719431-5ba9-4865-957b-f6582e607a00"}]: dispatch 2024-06-13T02:10:42.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:42 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66719431-5ba9-4865-957b-f6582e607a00"}]': finished 2024-06-13T02:10:42.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:42 smithi175 ceph-mon[36977]: osdmap e70: 11 total, 10 up, 11 in 2024-06-13T02:10:42.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:10:42.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:42 smithi175 ceph-mon[36977]: from='client.? 172.21.15.84:0/1239242810' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:10:44.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:44 smithi002 ceph-mon[31960]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:44.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:44 smithi084 ceph-mon[36833]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:44.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:44 smithi175 ceph-mon[36977]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:46.349 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:46 smithi084 ceph-mon[36833]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:46.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:46 smithi002 ceph-mon[31960]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:46.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:46 smithi175 ceph-mon[36977]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:48.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:48 smithi002 ceph-mon[31960]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:48.414 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:48 smithi084 ceph-mon[36833]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:48.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:48 smithi175 ceph-mon[36977]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:49.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:49 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-13T02:10:49.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:49 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:49.396 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:49 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-13T02:10:49.396 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:49 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:49.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:49 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-13T02:10:49.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:49 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:50.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:50 smithi002 ceph-mon[31960]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:50.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:50 smithi002 ceph-mon[31960]: Deploying daemon osd.10 on smithi084 2024-06-13T02:10:50.453 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:50 smithi084 ceph-mon[36833]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:50.453 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:50 smithi084 ceph-mon[36833]: Deploying daemon osd.10 on smithi084 2024-06-13T02:10:50.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:50 smithi175 ceph-mon[36977]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:50.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:50 smithi175 ceph-mon[36977]: Deploying daemon osd.10 on smithi084 2024-06-13T02:10:52.378 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:52 smithi084 ceph-mon[36833]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:52.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:52 smithi002 ceph-mon[31960]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:52.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:52 smithi175 ceph-mon[36977]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:54.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:54 smithi002 ceph-mon[31960]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:54.388 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:54 smithi084 ceph-mon[36833]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:54.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:54 smithi175 ceph-mon[36977]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:56.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:55 smithi002 ceph-mon[31960]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:56.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:55 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:56.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:55 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:56.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:55 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:10:56.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:55 smithi084 ceph-mon[36833]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:56.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:55 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:56.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:55 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:56.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:55 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:10:56.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:55 smithi175 ceph-mon[36977]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:56.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:55 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:56.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:55 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:56.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:55 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:10:58.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:57 smithi002 ceph-mon[31960]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:58.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:57 smithi084 ceph-mon[36833]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:58.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:57 smithi175 ceph-mon[36977]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:10:58.626 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 10 on host 'smithi084' 2024-06-13T02:10:58.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:58.623+0000 7fc4797fa700 1 -- 172.21.15.84:0/3754859763 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc47c062990 con 0x7fc4680a2ca0 2024-06-13T02:10:58.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:58.626+0000 7fc48255d700 1 -- 172.21.15.84:0/3754859763 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc4680a2ca0 msgr2=0x7fc4680a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:10:58.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:58.626+0000 7fc48255d700 1 --2- 172.21.15.84:0/3754859763 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc4680a2ca0 0x7fc4680a5160 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc464007c60 tx=0x7fc4640073d0 comp rx=0 tx=0).stop 2024-06-13T02:10:58.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:58.626+0000 7fc48255d700 1 -- 172.21.15.84:0/3754859763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c105950 msgr2=0x7fc47c198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:10:58.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:58.626+0000 7fc48255d700 1 --2- 172.21.15.84:0/3754859763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c105950 0x7fc47c198d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009580 tx=0x7fc46c005e80 comp rx=0 tx=0).stop 2024-06-13T02:10:58.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:58.626+0000 7fc48255d700 1 -- 172.21.15.84:0/3754859763 shutdown_connections 2024-06-13T02:10:58.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:58.626+0000 7fc48255d700 1 --2- 172.21.15.84:0/3754859763 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc4680a2ca0 0x7fc4680a5160 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:58.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:58.626+0000 7fc48255d700 1 --2- 172.21.15.84:0/3754859763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc47c108280 0x7fc47c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:58.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:58.626+0000 7fc48255d700 1 --2- 172.21.15.84:0/3754859763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc47c103020 0x7fc47c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:58.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:58.626+0000 7fc48255d700 1 --2- 172.21.15.84:0/3754859763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47c105950 0x7fc47c198d20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:10:58.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:58.626+0000 7fc48255d700 1 -- 172.21.15.84:0/3754859763 >> 172.21.15.84:0/3754859763 conn(0x7fc47c0fc990 msgr2=0x7fc47c103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:10:58.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:58.626+0000 7fc48255d700 1 -- 172.21.15.84:0/3754859763 shutdown_connections 2024-06-13T02:10:58.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-06-13T02:10:58.626+0000 7fc48255d700 1 -- 172.21.15.84:0/3754859763 wait complete. 2024-06-13T02:10:59.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:58 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:59.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:58 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:59.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:58 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:59.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:58 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:10:59.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:58 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:59.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:58 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:59.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:58 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:59.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:58 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:10:59.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:58 smithi084 ceph-mon[36833]: from='osd.10 [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-13T02:10:59.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:58 smithi084 ceph-mon[36833]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-13T02:10:59.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:58 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:59.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:58 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:59.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:58 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:59.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:58 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:10:59.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:58 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:59.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:58 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:59.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:58 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:59.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:58 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:10:59.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:58 smithi175 ceph-mon[36977]: from='osd.10 [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-13T02:10:59.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:58 smithi175 ceph-mon[36977]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-13T02:10:59.347 DEBUG:teuthology.orchestra.run.smithi084:osd.10> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.10.service 2024-06-13T02:10:59.350 INFO:tasks.cephadm:Deploying osd.11 on smithi175 with /dev/vg_nvme/lv_1... 2024-06-13T02:10:59.350 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-13T02:10:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:58 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:58 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:58 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:10:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:58 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:10:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:58 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:58 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:58 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:10:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:58 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:10:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:58 smithi002 ceph-mon[31960]: from='osd.10 [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-13T02:10:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:58 smithi002 ceph-mon[31960]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-13T02:10:59.596 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:11:00.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:59 smithi175 ceph-mon[36977]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:11:00.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:59 smithi175 ceph-mon[36977]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-13T02:11:00.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:59 smithi175 ceph-mon[36977]: from='osd.10 [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:11:00.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:59 smithi175 ceph-mon[36977]: osdmap e71: 11 total, 10 up, 11 in 2024-06-13T02:11:00.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:59 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:11:00.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:10:59 smithi175 ceph-mon[36977]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:11:00.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:59 smithi084 ceph-mon[36833]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:11:00.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:59 smithi084 ceph-mon[36833]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-13T02:11:00.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:59 smithi084 ceph-mon[36833]: from='osd.10 [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:11:00.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:59 smithi084 ceph-mon[36833]: osdmap e71: 11 total, 10 up, 11 in 2024-06-13T02:11:00.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:59 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:11:00.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:10:59 smithi084 ceph-mon[36833]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:11:00.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:59 smithi002 ceph-mon[31960]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:11:00.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:59 smithi002 ceph-mon[31960]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-13T02:11:00.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:59 smithi002 ceph-mon[31960]: from='osd.10 [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:11:00.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:59 smithi002 ceph-mon[31960]: osdmap e71: 11 total, 10 up, 11 in 2024-06-13T02:11:00.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:59 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:11:00.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:10:59 smithi002 ceph-mon[31960]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]: dispatch 2024-06-13T02:11:00.929 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:11:00 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:11:00.596+0000 7f99e9a66700 -1 osd.10 0 waiting for initial osdmap 2024-06-13T02:11:00.929 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:11:00 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:11:00.608+0000 7f99e5859700 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T02:11:01.628 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-13T02:11:01.628 INFO:teuthology.orchestra.run.smithi175.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-13T02:11:01.628 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10+0 records in 2024-06-13T02:11:01.628 INFO:teuthology.orchestra.run.smithi175.stderr:10+0 records out 2024-06-13T02:11:01.628 INFO:teuthology.orchestra.run.smithi175.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114921 s, 912 MB/s 2024-06-13T02:11:01.628 INFO:teuthology.orchestra.run.smithi175.stderr:--> Zapping successful for: 2024-06-13T02:11:01.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:01 smithi084 ceph-mon[36833]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:11:01.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:01 smithi084 ceph-mon[36833]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-06-13T02:11:01.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:01 smithi084 ceph-mon[36833]: osdmap e72: 11 total, 10 up, 11 in 2024-06-13T02:11:01.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:01 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:11:01.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:01 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:11:01.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:01 smithi002 ceph-mon[31960]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:11:01.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:01 smithi002 ceph-mon[31960]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-06-13T02:11:01.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:01 smithi002 ceph-mon[31960]: osdmap e72: 11 total, 10 up, 11 in 2024-06-13T02:11:01.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:01 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:11:01.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:01 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:11:01.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:01 smithi175 ceph-mon[36977]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-06-13T02:11:01.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:01 smithi175 ceph-mon[36977]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-06-13T02:11:01.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:01 smithi175 ceph-mon[36977]: osdmap e72: 11 total, 10 up, 11 in 2024-06-13T02:11:01.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:01 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:11:01.929 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:01 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:11:02.266 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch daemon add osd smithi175:vg_nvme/lv_1 2024-06-13T02:11:02.508 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:11:02.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: purged_snaps scrub starts 2024-06-13T02:11:02.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: purged_snaps scrub ok 2024-06-13T02:11:02.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: osd.10 [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460] boot 2024-06-13T02:11:02.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: osdmap e73: 11 total, 11 up, 11 in 2024-06-13T02:11:02.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:11:02.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:02.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:02.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:02.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:02.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:02.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:02.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:02.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:02.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:11:02.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:02.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:02 smithi084 ceph-mon[36833]: osdmap e74: 11 total, 11 up, 11 in 2024-06-13T02:11:02.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: purged_snaps scrub starts 2024-06-13T02:11:02.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: purged_snaps scrub ok 2024-06-13T02:11:02.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: osd.10 [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460] boot 2024-06-13T02:11:02.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: osdmap e73: 11 total, 11 up, 11 in 2024-06-13T02:11:02.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:11:02.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:02.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:02.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:02.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:02.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:02.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:02.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:02.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:02.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:11:02.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:02.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:02 smithi002 ceph-mon[31960]: osdmap e74: 11 total, 11 up, 11 in 2024-06-13T02:11:02.911 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: purged_snaps scrub starts 2024-06-13T02:11:02.911 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: purged_snaps scrub ok 2024-06-13T02:11:02.911 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: osd.10 [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460] boot 2024-06-13T02:11:02.911 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: osdmap e73: 11 total, 11 up, 11 in 2024-06-13T02:11:02.911 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:11:02.911 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:02.911 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:02.911 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:02.911 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:02.911 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:02.912 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:02.912 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:02.912 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:02.912 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:11:02.912 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:02.912 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:02 smithi175 ceph-mon[36977]: osdmap e74: 11 total, 11 up, 11 in 2024-06-13T02:11:03.864 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:03 smithi175 ceph-mon[36977]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:03.864 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:03 smithi175 ceph-mon[36977]: Detected new or changed devices on smithi084 2024-06-13T02:11:03.864 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:03 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi084 to 4272M 2024-06-13T02:11:03.864 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:03 smithi175 ceph-mon[36977]: osdmap e75: 11 total, 11 up, 11 in 2024-06-13T02:11:03.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:03 smithi002 ceph-mon[31960]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:03.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:03 smithi002 ceph-mon[31960]: Detected new or changed devices on smithi084 2024-06-13T02:11:03.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:03 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi084 to 4272M 2024-06-13T02:11:03.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:03 smithi002 ceph-mon[31960]: osdmap e75: 11 total, 11 up, 11 in 2024-06-13T02:11:03.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:03 smithi084 ceph-mon[36833]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:03.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:03 smithi084 ceph-mon[36833]: Detected new or changed devices on smithi084 2024-06-13T02:11:03.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:03 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi084 to 4272M 2024-06-13T02:11:03.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:03 smithi084 ceph-mon[36833]: osdmap e75: 11 total, 11 up, 11 in 2024-06-13T02:11:04.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.074+0000 7f41c9372700 1 -- 172.21.15.175:0/3693505800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41c41025f0 msgr2=0x7f41c4102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:04.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.074+0000 7f41c9372700 1 --2- 172.21.15.175:0/3693505800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41c41025f0 0x7f41c4102a50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009990 tx=0x7f41ac009ca0 comp rx=0 tx=0).stop 2024-06-13T02:11:04.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.074+0000 7f41c9372700 1 -- 172.21.15.175:0/3693505800 shutdown_connections 2024-06-13T02:11:04.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.074+0000 7f41c9372700 1 --2- 172.21.15.175:0/3693505800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41c4102f90 0x7f41c4109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:04.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.074+0000 7f41c9372700 1 --2- 172.21.15.175:0/3693505800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41c41013f0 0x7f41c4101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:04.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.074+0000 7f41c9372700 1 --2- 172.21.15.175:0/3693505800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41c41025f0 0x7f41c4102a50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:04.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.074+0000 7f41c9372700 1 -- 172.21.15.175:0/3693505800 >> 172.21.15.175:0/3693505800 conn(0x7f41c40fc990 msgr2=0x7f41c40fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:04.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.074+0000 7f41c9372700 1 -- 172.21.15.175:0/3693505800 shutdown_connections 2024-06-13T02:11:04.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.074+0000 7f41c9372700 1 -- 172.21.15.175:0/3693505800 wait complete. 2024-06-13T02:11:04.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c9372700 1 Processor -- start 2024-06-13T02:11:04.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c9372700 1 -- start start 2024-06-13T02:11:04.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c9372700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41c41013f0 0x7f41c41988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:04.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c9372700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41c41025f0 0x7f41c4198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:04.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c9372700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41c4102f90 0x7f41c419fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:04.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c9372700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f41c410d0d0 con 0x7f41c41025f0 2024-06-13T02:11:04.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c9372700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f41c410cf50 con 0x7f41c4102f90 2024-06-13T02:11:04.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c9372700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f41c410d250 con 0x7f41c41013f0 2024-06-13T02:11:04.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c2ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41c41013f0 0x7f41c41988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:04.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c2ffd700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41c41013f0 0x7f41c41988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45242/0 (socket says 172.21.15.175:45242) 2024-06-13T02:11:04.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c2ffd700 1 -- 172.21.15.175:0/3755920344 learned_addr learned my addr 172.21.15.175:0/3755920344 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-06-13T02:11:04.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c37fe700 1 --2- 172.21.15.175:0/3755920344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41c4102f90 0x7f41c419fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:04.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c2ffd700 1 -- 172.21.15.175:0/3755920344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41c4102f90 msgr2=0x7f41c419fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:04.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c2ffd700 1 --2- 172.21.15.175:0/3755920344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41c4102f90 0x7f41c419fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:04.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c2ffd700 1 -- 172.21.15.175:0/3755920344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41c41025f0 msgr2=0x7f41c4198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:04.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c2ffd700 1 --2- 172.21.15.175:0/3755920344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41c41025f0 0x7f41c4198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:04.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.075+0000 7f41c2ffd700 1 -- 172.21.15.175:0/3755920344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c41a0530 con 0x7f41c41013f0 2024-06-13T02:11:04.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.076+0000 7f41c2ffd700 1 --2- 172.21.15.175:0/3755920344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41c41013f0 0x7f41c41988d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f41b400b9f0 tx=0x7f41b400bd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:04.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.076+0000 7f41bbfff700 1 -- 172.21.15.175:0/3755920344 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4019070 con 0x7f41c41013f0 2024-06-13T02:11:04.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.076+0000 7f41bbfff700 1 -- 172.21.15.175:0/3755920344 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41b400ce30 con 0x7f41c41013f0 2024-06-13T02:11:04.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.076+0000 7f41c9372700 1 -- 172.21.15.175:0/3755920344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c41a0820 con 0x7f41c41013f0 2024-06-13T02:11:04.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.076+0000 7f41bbfff700 1 -- 172.21.15.175:0/3755920344 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b40125a0 con 0x7f41c41013f0 2024-06-13T02:11:04.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.076+0000 7f41c9372700 1 -- 172.21.15.175:0/3755920344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c41a0de0 con 0x7f41c41013f0 2024-06-13T02:11:04.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.077+0000 7f41c9372700 1 -- 172.21.15.175:0/3755920344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c4069180 con 0x7f41c41013f0 2024-06-13T02:11:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.078+0000 7f41bbfff700 1 -- 172.21.15.175:0/3755920344 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f41b401c070 con 0x7f41c41013f0 2024-06-13T02:11:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.078+0000 7f41bbfff700 1 --2- 172.21.15.175:0/3755920344 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f41b00a2c20 0x7f41b00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.078+0000 7f41bbfff700 1 -- 172.21.15.175:0/3755920344 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6723+0+0 (secure 0 0 0) 0x7f41b40ce800 con 0x7f41c41013f0 2024-06-13T02:11:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.079+0000 7f41c27fc700 1 --2- 172.21.15.175:0/3755920344 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f41b00a2c20 0x7f41b00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:04.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.080+0000 7f41c27fc700 1 --2- 172.21.15.175:0/3755920344 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f41b00a2c20 0x7f41b00a50e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0098e0 tx=0x7f41ac005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:04.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.082+0000 7f41bbfff700 1 -- 172.21.15.175:0/3755920344 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f41b4023070 con 0x7f41c41013f0 2024-06-13T02:11:04.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:04.288+0000 7f41c9372700 1 -- 172.21.15.175:0/3755920344 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f41c406a880 con 0x7f41b00a2c20 2024-06-13T02:11:04.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:04 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:11:04.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:04 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:11:04.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:04 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:04.927 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:04 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:11:04.927 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:04 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:11:04.927 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:04 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:04.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:04 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-13T02:11:04.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:04 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-13T02:11:04.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:04 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:05.953 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:05 smithi175 ceph-mon[36977]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:11:05.953 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:05 smithi175 ceph-mon[36977]: pgmap v265: 1 pgs: 1 remapped+peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:05.953 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:05 smithi175 ceph-mon[36977]: osdmap e76: 11 total, 11 up, 11 in 2024-06-13T02:11:05.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:05 smithi084 ceph-mon[36833]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:11:05.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:05 smithi084 ceph-mon[36833]: pgmap v265: 1 pgs: 1 remapped+peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:05.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:05 smithi084 ceph-mon[36833]: osdmap e76: 11 total, 11 up, 11 in 2024-06-13T02:11:06.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:05 smithi002 ceph-mon[31960]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi175:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:11:06.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:05 smithi002 ceph-mon[31960]: pgmap v265: 1 pgs: 1 remapped+peering; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:06.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:05 smithi002 ceph-mon[31960]: osdmap e76: 11 total, 11 up, 11 in 2024-06-13T02:11:06.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:06 smithi084 ceph-mon[36833]: osdmap e77: 11 total, 11 up, 11 in 2024-06-13T02:11:07.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:06 smithi175 ceph-mon[36977]: osdmap e77: 11 total, 11 up, 11 in 2024-06-13T02:11:07.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:06 smithi002 ceph-mon[31960]: osdmap e77: 11 total, 11 up, 11 in 2024-06-13T02:11:07.967 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:07 smithi002 ceph-mon[31960]: pgmap v268: 1 pgs: 1 remapped+peering; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:07.967 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:07 smithi002 ceph-mon[31960]: from='client.? 172.21.15.175:0/3731161892' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ce6e6ee-6ff3-416f-b985-e3afe503093d"}]: dispatch 2024-06-13T02:11:07.967 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:07 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ce6e6ee-6ff3-416f-b985-e3afe503093d"}]: dispatch 2024-06-13T02:11:07.967 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:07 smithi002 ceph-mon[31960]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ce6e6ee-6ff3-416f-b985-e3afe503093d"}]': finished 2024-06-13T02:11:07.967 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:07 smithi002 ceph-mon[31960]: osdmap e78: 12 total, 11 up, 12 in 2024-06-13T02:11:07.967 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:07 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:11:07.967 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:07 smithi002 ceph-mon[31960]: from='client.? 172.21.15.175:0/3532834524' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:11:07.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:07 smithi084 ceph-mon[36833]: pgmap v268: 1 pgs: 1 remapped+peering; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:07.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:07 smithi084 ceph-mon[36833]: from='client.? 172.21.15.175:0/3731161892' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ce6e6ee-6ff3-416f-b985-e3afe503093d"}]: dispatch 2024-06-13T02:11:07.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:07 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ce6e6ee-6ff3-416f-b985-e3afe503093d"}]: dispatch 2024-06-13T02:11:07.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:07 smithi084 ceph-mon[36833]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ce6e6ee-6ff3-416f-b985-e3afe503093d"}]': finished 2024-06-13T02:11:07.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:07 smithi084 ceph-mon[36833]: osdmap e78: 12 total, 11 up, 12 in 2024-06-13T02:11:07.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:07 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:11:07.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:07 smithi084 ceph-mon[36833]: from='client.? 172.21.15.175:0/3532834524' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:11:08.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:07 smithi175 ceph-mon[36977]: pgmap v268: 1 pgs: 1 remapped+peering; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:08.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:07 smithi175 ceph-mon[36977]: from='client.? 172.21.15.175:0/3731161892' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ce6e6ee-6ff3-416f-b985-e3afe503093d"}]: dispatch 2024-06-13T02:11:08.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:07 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ce6e6ee-6ff3-416f-b985-e3afe503093d"}]: dispatch 2024-06-13T02:11:08.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:07 smithi175 ceph-mon[36977]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ce6e6ee-6ff3-416f-b985-e3afe503093d"}]': finished 2024-06-13T02:11:08.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:07 smithi175 ceph-mon[36977]: osdmap e78: 12 total, 11 up, 12 in 2024-06-13T02:11:08.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:07 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:11:08.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:07 smithi175 ceph-mon[36977]: from='client.? 172.21.15.175:0/3532834524' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-13T02:11:09.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:09 smithi084 ceph-mon[36833]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-06-13T02:11:10.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:09 smithi175 ceph-mon[36977]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-06-13T02:11:10.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:09 smithi002 ceph-mon[31960]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-06-13T02:11:11.921 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:11 smithi175 ceph-mon[36977]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-13T02:11:11.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:11 smithi084 ceph-mon[36833]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-13T02:11:12.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:11 smithi002 ceph-mon[31960]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-13T02:11:13.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:13 smithi175 ceph-mon[36977]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-06-13T02:11:13.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:13 smithi084 ceph-mon[36833]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-06-13T02:11:14.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:13 smithi002 ceph-mon[31960]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-06-13T02:11:14.954 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:14 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-13T02:11:14.954 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:14 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:14.954 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:14 smithi175 ceph-mon[36977]: Deploying daemon osd.11 on smithi175 2024-06-13T02:11:14.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:14 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-13T02:11:14.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:14 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:14.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:14 smithi084 ceph-mon[36833]: Deploying daemon osd.11 on smithi175 2024-06-13T02:11:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:14 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-13T02:11:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:14 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:15.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:14 smithi002 ceph-mon[31960]: Deploying daemon osd.11 on smithi175 2024-06-13T02:11:15.940 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:15 smithi175 ceph-mon[36977]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-06-13T02:11:15.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:15 smithi084 ceph-mon[36833]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-06-13T02:11:16.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:15 smithi002 ceph-mon[31960]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-06-13T02:11:17.857 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:17 smithi175 ceph-mon[36977]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-13T02:11:17.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:17 smithi084 ceph-mon[36833]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-13T02:11:18.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:17 smithi002 ceph-mon[31960]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-13T02:11:19.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:19 smithi175 ceph-mon[36977]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-06-13T02:11:19.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:19 smithi002 ceph-mon[31960]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-06-13T02:11:19.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:19 smithi084 ceph-mon[36833]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-06-13T02:11:20.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:20 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:20.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:20 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:20.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:20 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:11:20.920 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:20 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:20.920 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:20 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:20.921 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:20 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:11:21.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:20 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:21.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:20 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:21.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:20 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:11:21.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:21 smithi002 ceph-mon[31960]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:21.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:21 smithi084 ceph-mon[36833]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:22.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:21 smithi175 ceph-mon[36977]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:23.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:23.474+0000 7f41bbfff700 1 -- 172.21.15.175:0/3755920344 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f41c406a880 con 0x7f41b00a2c20 2024-06-13T02:11:23.475 INFO:teuthology.orchestra.run.smithi175.stdout:Created osd(s) 11 on host 'smithi175' 2024-06-13T02:11:23.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:23.476+0000 7f41c9372700 1 -- 172.21.15.175:0/3755920344 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f41b00a2c20 msgr2=0x7f41b00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:23.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:23.476+0000 7f41c9372700 1 --2- 172.21.15.175:0/3755920344 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f41b00a2c20 0x7f41b00a50e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0098e0 tx=0x7f41ac005fb0 comp rx=0 tx=0).stop 2024-06-13T02:11:23.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:23.476+0000 7f41c9372700 1 -- 172.21.15.175:0/3755920344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41c41013f0 msgr2=0x7f41c41988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:23.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:23.476+0000 7f41c9372700 1 --2- 172.21.15.175:0/3755920344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41c41013f0 0x7f41c41988d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f41b400b9f0 tx=0x7f41b400bd00 comp rx=0 tx=0).stop 2024-06-13T02:11:23.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:23.476+0000 7f41c9372700 1 -- 172.21.15.175:0/3755920344 shutdown_connections 2024-06-13T02:11:23.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:23.476+0000 7f41c9372700 1 --2- 172.21.15.175:0/3755920344 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f41b00a2c20 0x7f41b00a50e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:23.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:23.476+0000 7f41c9372700 1 --2- 172.21.15.175:0/3755920344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41c4102f90 0x7f41c419fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:23.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:23.476+0000 7f41c9372700 1 --2- 172.21.15.175:0/3755920344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41c41013f0 0x7f41c41988d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:23.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:23.476+0000 7f41c9372700 1 --2- 172.21.15.175:0/3755920344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41c41025f0 0x7f41c4198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:23.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:23.476+0000 7f41c9372700 1 -- 172.21.15.175:0/3755920344 >> 172.21.15.175:0/3755920344 conn(0x7f41c40fc990 msgr2=0x7f41c406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:23.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:23.477+0000 7f41c9372700 1 -- 172.21.15.175:0/3755920344 shutdown_connections 2024-06-13T02:11:23.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:23.477+0000 7f41c9372700 1 -- 172.21.15.175:0/3755920344 wait complete. 2024-06-13T02:11:23.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:23 smithi175 ceph-mon[36977]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:23.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:23 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:23.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:23 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:23.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:23 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:23.761 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:23 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:11:23.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:23 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:23.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:23 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:23.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:23 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:11:23.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:23 smithi175 ceph-mon[36977]: from='osd.11 [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-13T02:11:23.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:23 smithi175 ceph-mon[36977]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-13T02:11:23.762 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:23 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:23.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:23 smithi002 ceph-mon[31960]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:23.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:23 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:23.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:23 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:23.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:23 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:23.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:23 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:11:23.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:23 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:23.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:23 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:23.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:23 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:11:23.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:23 smithi002 ceph-mon[31960]: from='osd.11 [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-13T02:11:23.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:23 smithi002 ceph-mon[31960]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-13T02:11:23.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:23 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:23.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:23 smithi084 ceph-mon[36833]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:23.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:23 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:23.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:23 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:23.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:23 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:23.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:23 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:11:23.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:23 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:23.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:23 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:23.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:23 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:11:23.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:23 smithi084 ceph-mon[36833]: from='osd.11 [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-13T02:11:23.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:23 smithi084 ceph-mon[36833]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-13T02:11:23.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:23 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:24.066 DEBUG:teuthology.orchestra.run.smithi175:osd.11> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.11.service 2024-06-13T02:11:24.068 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-06-13T02:11:24.068 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd stat -f json 2024-06-13T02:11:24.534 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:11:25.531 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:11:25 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:11:25.458+0000 7f935723e700 -1 osd.11 0 waiting for initial osdmap 2024-06-13T02:11:25.531 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:11:25 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:11:25.472+0000 7f9353031700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-13T02:11:25.531 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:25 smithi175 ceph-mon[36977]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:25 smithi175 ceph-mon[36977]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-13T02:11:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:25 smithi175 ceph-mon[36977]: from='osd.11 [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:11:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:25 smithi175 ceph-mon[36977]: osdmap e79: 12 total, 11 up, 12 in 2024-06-13T02:11:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:11:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:25 smithi175 ceph-mon[36977]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:11:25.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:25 smithi002 ceph-mon[31960]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:25.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:25 smithi002 ceph-mon[31960]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-13T02:11:25.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:25 smithi002 ceph-mon[31960]: from='osd.11 [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:11:25.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:25 smithi002 ceph-mon[31960]: osdmap e79: 12 total, 11 up, 12 in 2024-06-13T02:11:25.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:11:25.716 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:25 smithi002 ceph-mon[31960]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:11:25.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:25 smithi084 ceph-mon[36833]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:25.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:25 smithi084 ceph-mon[36833]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-13T02:11:25.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:25 smithi084 ceph-mon[36833]: from='osd.11 [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:11:25.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:25 smithi084 ceph-mon[36833]: osdmap e79: 12 total, 11 up, 12 in 2024-06-13T02:11:25.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:11:25.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:25 smithi084 ceph-mon[36833]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]: dispatch 2024-06-13T02:11:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.695+0000 7f4622e00700 1 -- 172.21.15.2:0/910289731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f461c108240 msgr2=0x7f461c10a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.695+0000 7f4622e00700 1 --2- 172.21.15.2:0/910289731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f461c108240 0x7f461c10a650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f461400b0a0 tx=0x7f461400b3b0 comp rx=0 tx=0).stop 2024-06-13T02:11:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.696+0000 7f4622e00700 1 -- 172.21.15.2:0/910289731 shutdown_connections 2024-06-13T02:11:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.696+0000 7f4622e00700 1 --2- 172.21.15.2:0/910289731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f461c108240 0x7f461c10a650 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.696+0000 7f4622e00700 1 --2- 172.21.15.2:0/910289731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f461c102fe0 0x7f461c1053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.696+0000 7f4622e00700 1 --2- 172.21.15.2:0/910289731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f461c105910 0x7f461c107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:26.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.696+0000 7f4622e00700 1 -- 172.21.15.2:0/910289731 >> 172.21.15.2:0/910289731 conn(0x7f461c0fc990 msgr2=0x7f461c0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:26.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:26 smithi002 ceph-mon[31960]: purged_snaps scrub starts 2024-06-13T02:11:26.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:26 smithi002 ceph-mon[31960]: purged_snaps scrub ok 2024-06-13T02:11:26.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:26 smithi002 ceph-mon[31960]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-06-13T02:11:26.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:26 smithi002 ceph-mon[31960]: osdmap e80: 12 total, 11 up, 12 in 2024-06-13T02:11:26.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:26 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:11:26.699 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:26 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:11:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.696+0000 7f4622e00700 1 -- 172.21.15.2:0/910289731 shutdown_connections 2024-06-13T02:11:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.696+0000 7f4622e00700 1 -- 172.21.15.2:0/910289731 wait complete. 2024-06-13T02:11:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.697+0000 7f4622e00700 1 Processor -- start 2024-06-13T02:11:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.698+0000 7f4622e00700 1 -- start start 2024-06-13T02:11:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.698+0000 7f4622e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f461c102fe0 0x7f461c19a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.698+0000 7f4622e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f461c105910 0x7f461c19ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.698+0000 7f4622e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f461c108240 0x7f461c1a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.698+0000 7f4622e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f461c10e150 con 0x7f461c105910 2024-06-13T02:11:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.698+0000 7f4622e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f461c10dfd0 con 0x7f461c102fe0 2024-06-13T02:11:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.698+0000 7f4622e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f461c10e2d0 con 0x7f461c108240 2024-06-13T02:11:26.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.698+0000 7f461b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f461c105910 0x7f461c19ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.698+0000 7f461b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f461c105910 0x7f461c19ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43782/0 (socket says 172.21.15.2:43782) 2024-06-13T02:11:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.698+0000 7f461b400700 1 -- 172.21.15.2:0/464434497 learned_addr learned my addr 172.21.15.2:0/464434497 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:11:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.699+0000 7f461be00700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f461c102fe0 0x7f461c19a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.699+0000 7f4620e00700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f461c108240 0x7f461c1a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.699+0000 7f461b400700 1 -- 172.21.15.2:0/464434497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f461c108240 msgr2=0x7f461c1a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.699+0000 7f461b400700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f461c108240 0x7f461c1a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.699+0000 7f461b400700 1 -- 172.21.15.2:0/464434497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f461c102fe0 msgr2=0x7f461c19a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.699+0000 7f461b400700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f461c102fe0 0x7f461c19a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.699+0000 7f461b400700 1 -- 172.21.15.2:0/464434497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c1a2590 con 0x7f461c105910 2024-06-13T02:11:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.699+0000 7f461be00700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f461c102fe0 0x7f461c19a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:11:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.699+0000 7f4620e00700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f461c108240 0x7f461c1a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:11:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.700+0000 7f461b400700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f461c105910 0x7f461c19ae70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f460800e9d0 tx=0x7f460800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:26.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.700+0000 7f4618c00700 1 -- 172.21.15.2:0/464434497 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460800cbd0 con 0x7f461c105910 2024-06-13T02:11:26.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.700+0000 7f4618c00700 1 -- 172.21.15.2:0/464434497 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f460800ee70 con 0x7f461c105910 2024-06-13T02:11:26.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.700+0000 7f4622e00700 1 -- 172.21.15.2:0/464434497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461c1a2880 con 0x7f461c105910 2024-06-13T02:11:26.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.700+0000 7f4618c00700 1 -- 172.21.15.2:0/464434497 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608018660 con 0x7f461c105910 2024-06-13T02:11:26.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.700+0000 7f4622e00700 1 -- 172.21.15.2:0/464434497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461c1a2dc0 con 0x7f461c105910 2024-06-13T02:11:26.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.702+0000 7f4622e00700 1 -- 172.21.15.2:0/464434497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f461c069180 con 0x7f461c105910 2024-06-13T02:11:26.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.704+0000 7f4618c00700 1 -- 172.21.15.2:0/464434497 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f4608010430 con 0x7f461c105910 2024-06-13T02:11:26.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.706+0000 7f4618c00700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f46000a2c20 0x7f46000a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:26.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.706+0000 7f4618c00700 1 -- 172.21.15.2:0/464434497 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f46080cee40 con 0x7f461c105910 2024-06-13T02:11:26.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.706+0000 7f461be00700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f46000a2c20 0x7f46000a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:26.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.707+0000 7f461be00700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f46000a2c20 0x7f46000a50e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f460c011490 tx=0x7f460c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.711+0000 7f4618c00700 1 -- 172.21.15.2:0/464434497 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f460809c1a0 con 0x7f461c105910 2024-06-13T02:11:26.712 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:26 smithi175 ceph-mon[36977]: purged_snaps scrub starts 2024-06-13T02:11:26.712 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:26 smithi175 ceph-mon[36977]: purged_snaps scrub ok 2024-06-13T02:11:26.712 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:26 smithi175 ceph-mon[36977]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-06-13T02:11:26.712 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:26 smithi175 ceph-mon[36977]: osdmap e80: 12 total, 11 up, 12 in 2024-06-13T02:11:26.712 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:26 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:11:26.713 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:26 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:11:26.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.944+0000 7f4622e00700 1 -- 172.21.15.2:0/464434497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f461c0630a0 con 0x7f461c105910 2024-06-13T02:11:26.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.945+0000 7f4618c00700 1 -- 172.21.15.2:0/464434497 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7f460800cd70 con 0x7f461c105910 2024-06-13T02:11:26.947 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:11:26.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.948+0000 7f4622e00700 1 -- 172.21.15.2:0/464434497 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f46000a2c20 msgr2=0x7f46000a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:26.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.948+0000 7f4622e00700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f46000a2c20 0x7f46000a50e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f460c011490 tx=0x7f460c009260 comp rx=0 tx=0).stop 2024-06-13T02:11:26.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.948+0000 7f4622e00700 1 -- 172.21.15.2:0/464434497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f461c105910 msgr2=0x7f461c19ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:26.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.948+0000 7f4622e00700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f461c105910 0x7f461c19ae70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f460800e9d0 tx=0x7f460800ece0 comp rx=0 tx=0).stop 2024-06-13T02:11:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.949+0000 7f4622e00700 1 -- 172.21.15.2:0/464434497 shutdown_connections 2024-06-13T02:11:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.949+0000 7f4622e00700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f46000a2c20 0x7f46000a50e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.949+0000 7f4622e00700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f461c108240 0x7f461c1a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.949+0000 7f4622e00700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f461c102fe0 0x7f461c19a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.949+0000 7f4622e00700 1 --2- 172.21.15.2:0/464434497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f461c105910 0x7f461c19ae70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.949+0000 7f4622e00700 1 -- 172.21.15.2:0/464434497 >> 172.21.15.2:0/464434497 conn(0x7f461c0fc990 msgr2=0x7f461c1026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.949+0000 7f4622e00700 1 -- 172.21.15.2:0/464434497 shutdown_connections 2024-06-13T02:11:26.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:26.949+0000 7f4622e00700 1 -- 172.21.15.2:0/464434497 wait complete. 2024-06-13T02:11:26.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:26 smithi084 ceph-mon[36833]: purged_snaps scrub starts 2024-06-13T02:11:26.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:26 smithi084 ceph-mon[36833]: purged_snaps scrub ok 2024-06-13T02:11:26.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:26 smithi084 ceph-mon[36833]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi175", "root=default"]}]': finished 2024-06-13T02:11:26.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:26 smithi084 ceph-mon[36833]: osdmap e80: 12 total, 11 up, 12 in 2024-06-13T02:11:26.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:26 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:11:26.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:26 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:11:27.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:27.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: osd.11 [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732] boot 2024-06-13T02:11:27.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: osdmap e81: 12 total, 12 up, 12 in 2024-06-13T02:11:27.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:11:27.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/464434497' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-13T02:11:27.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: Detected new or changed devices on smithi175 2024-06-13T02:11:27.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:27.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:27.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:27.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:27.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:27.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:27.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi175 to 4272M 2024-06-13T02:11:27.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:27.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:27.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:11:27.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:27 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:27.712 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1718244686,"num_in_osds":12,"osd_in_since":1718244666,"num_remapped_pgs":0} 2024-06-13T02:11:27.712 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T02:11:27.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:27.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: osd.11 [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732] boot 2024-06-13T02:11:27.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: osdmap e81: 12 total, 12 up, 12 in 2024-06-13T02:11:27.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:11:27.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/464434497' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-13T02:11:27.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: Detected new or changed devices on smithi175 2024-06-13T02:11:27.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:27.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:27.784 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:27.784 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:27.784 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:27.784 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:27.784 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi175 to 4272M 2024-06-13T02:11:27.784 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:27.784 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:27.784 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:11:27.784 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:27 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:27.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 337 MiB used, 983 GiB / 983 GiB avail 2024-06-13T02:11:27.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: osd.11 [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732] boot 2024-06-13T02:11:27.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: osdmap e81: 12 total, 12 up, 12 in 2024-06-13T02:11:27.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:11:27.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/464434497' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-13T02:11:27.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: Detected new or changed devices on smithi175 2024-06-13T02:11:27.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:27.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:27.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:27.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:27.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:27.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:11:27.972 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi175 to 4272M 2024-06-13T02:11:27.972 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:27.972 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:27.972 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:11:27.972 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:27 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:28.161 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:11:29.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:29 smithi084 ceph-mon[36833]: osdmap e82: 12 total, 12 up, 12 in 2024-06-13T02:11:29.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:29 smithi175 ceph-mon[36977]: osdmap e82: 12 total, 12 up, 12 in 2024-06-13T02:11:29.619 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:29 smithi002 ceph-mon[31960]: osdmap e82: 12 total, 12 up, 12 in 2024-06-13T02:11:30.267 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:30 smithi002 ceph-mon[31960]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:30.425 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:30 smithi084 ceph-mon[36833]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:30.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.443+0000 7f8988800700 1 -- 172.21.15.2:0/3549932751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f898006a6e0 msgr2=0x7f898006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:30.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.443+0000 7f8988800700 1 --2- 172.21.15.2:0/3549932751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f898006a6e0 0x7f898006ab40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8970009990 tx=0x7f8970009ca0 comp rx=0 tx=0).stop 2024-06-13T02:11:30.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.443+0000 7f8988800700 1 -- 172.21.15.2:0/3549932751 shutdown_connections 2024-06-13T02:11:30.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.443+0000 7f8988800700 1 --2- 172.21.15.2:0/3549932751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8980104ed0 0x7f8980105360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:30.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.443+0000 7f8988800700 1 --2- 172.21.15.2:0/3549932751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89801073c0 0x7f898006a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:30.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.443+0000 7f8988800700 1 --2- 172.21.15.2:0/3549932751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f898006a6e0 0x7f898006ab40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:30.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.443+0000 7f8988800700 1 -- 172.21.15.2:0/3549932751 >> 172.21.15.2:0/3549932751 conn(0x7f8980078340 msgr2=0x7f8980078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:30.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.443+0000 7f8988800700 1 -- 172.21.15.2:0/3549932751 shutdown_connections 2024-06-13T02:11:30.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.443+0000 7f8988800700 1 -- 172.21.15.2:0/3549932751 wait complete. 2024-06-13T02:11:30.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.444+0000 7f8988800700 1 Processor -- start 2024-06-13T02:11:30.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.444+0000 7f8988800700 1 -- start start 2024-06-13T02:11:30.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8988800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898006a6e0 0x7f898019f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:30.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8988800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8980104ed0 0x7f898019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:30.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8988800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89801073c0 0x7f89801a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:30.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8988800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8980118db0 con 0x7f898006a6e0 2024-06-13T02:11:30.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8988800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8980118c30 con 0x7f89801073c0 2024-06-13T02:11:30.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8988800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8980118f30 con 0x7f8980104ed0 2024-06-13T02:11:30.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8985e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898006a6e0 0x7f898019f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:30.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8986800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89801073c0 0x7f89801a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:30.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8985e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898006a6e0 0x7f898019f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43794/0 (socket says 172.21.15.2:43794) 2024-06-13T02:11:30.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8985e00700 1 -- 172.21.15.2:0/1186803786 learned_addr learned my addr 172.21.15.2:0/1186803786 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:11:30.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8985400700 1 --2- 172.21.15.2:0/1186803786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8980104ed0 0x7f898019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8985400700 1 -- 172.21.15.2:0/1186803786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89801073c0 msgr2=0x7f89801a3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8985400700 1 --2- 172.21.15.2:0/1186803786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89801073c0 0x7f89801a3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8985400700 1 -- 172.21.15.2:0/1186803786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898006a6e0 msgr2=0x7f898019f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8985400700 1 --2- 172.21.15.2:0/1186803786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898006a6e0 0x7f898019f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8985400700 1 -- 172.21.15.2:0/1186803786 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89801a4270 con 0x7f8980104ed0 2024-06-13T02:11:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8986800700 1 --2- 172.21.15.2:0/1186803786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89801073c0 0x7f89801a3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:11:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.445+0000 7f8985e00700 1 --2- 172.21.15.2:0/1186803786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898006a6e0 0x7f898019f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:11:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.446+0000 7f8985400700 1 --2- 172.21.15.2:0/1186803786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8980104ed0 0x7f898019f7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8970000c00 tx=0x7f897000bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.446+0000 7f897aa00700 1 -- 172.21.15.2:0/1186803786 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970026070 con 0x7f8980104ed0 2024-06-13T02:11:30.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.446+0000 7f897aa00700 1 -- 172.21.15.2:0/1186803786 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8970003d70 con 0x7f8980104ed0 2024-06-13T02:11:30.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.446+0000 7f8988800700 1 -- 172.21.15.2:0/1186803786 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89801a4500 con 0x7f8980104ed0 2024-06-13T02:11:30.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.446+0000 7f897aa00700 1 -- 172.21.15.2:0/1186803786 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897000fd90 con 0x7f8980104ed0 2024-06-13T02:11:30.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.446+0000 7f8988800700 1 -- 172.21.15.2:0/1186803786 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89801abde0 con 0x7f8980104ed0 2024-06-13T02:11:30.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.448+0000 7f8988800700 1 -- 172.21.15.2:0/1186803786 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8980069180 con 0x7f8980104ed0 2024-06-13T02:11:30.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.449+0000 7f897aa00700 1 -- 172.21.15.2:0/1186803786 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8970029070 con 0x7f8980104ed0 2024-06-13T02:11:30.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.451+0000 7f897aa00700 1 --2- 172.21.15.2:0/1186803786 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f89680a2ca0 0x7f89680a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:30.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.451+0000 7f897aa00700 1 -- 172.21.15.2:0/1186803786 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f89700cf8e0 con 0x7f8980104ed0 2024-06-13T02:11:30.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.451+0000 7f8985e00700 1 --2- 172.21.15.2:0/1186803786 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f89680a2ca0 0x7f89680a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:30.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.452+0000 7f8985e00700 1 --2- 172.21.15.2:0/1186803786 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f89680a2ca0 0x7f89680a5160 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8974011550 tx=0x7f8974009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:30.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.455+0000 7f897aa00700 1 -- 172.21.15.2:0/1186803786 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f897005d850 con 0x7f8980104ed0 2024-06-13T02:11:30.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:30 smithi175 ceph-mon[36977]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:30.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.685+0000 7f8988800700 1 -- 172.21.15.2:0/1186803786 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89801abfb0 con 0x7f8980104ed0 2024-06-13T02:11:30.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.687+0000 7f897aa00700 1 -- 172.21.15.2:0/1186803786 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18364 (secure 0 0 0) 0x7f8970013070 con 0x7f8980104ed0 2024-06-13T02:11:30.689 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:11:30.689 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":82,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","created":"2024-06-13T02:03:16.412002+0000","modified":"2024-06-13T02:11:28.143999+0000","last_up_change":"2024-06-13T02:11:26.464184+0000","last_in_change":"2024-06-13T02:11:06.957351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T02:07:10.994857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"96b4d494-453c-48aa-b1e2-ee30dfa83e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6803","nonce":3254812126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6805","nonce":3254812126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6809","nonce":3254812126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6807","nonce":3254812126}]},"public_addr":"172.21.15.2:6803/3254812126","cluster_addr":"172.21.15.2:6805/3254812126","heartbeat_back_addr":"172.21.15.2:6809/3254812126","heartbeat_front_addr":"172.21.15.2:6807/3254812126","state":["exists","up"]},{"osd":1,"uuid":"856e86b6-9281-485b-a36b-2fe04de31329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6801","nonce":1593775403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6803","nonce":1593775403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6807","nonce":1593775403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6805","nonce":1593775403}]},"public_addr":"172.21.15.84:6801/1593775403","cluster_addr":"172.21.15.84:6803/1593775403","heartbeat_back_addr":"172.21.15.84:6807/1593775403","heartbeat_front_addr":"172.21.15.84:6805/1593775403","state":["exists","up"]},{"osd":2,"uuid":"8c9daa52-0dfb-471a-afb4-6eb0b908195a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6801","nonce":2174304558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6803","nonce":2174304558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6807","nonce":2174304558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6805","nonce":2174304558}]},"public_addr":"172.21.15.175:6801/2174304558","cluster_addr":"172.21.15.175:6803/2174304558","heartbeat_back_addr":"172.21.15.175:6807/2174304558","heartbeat_front_addr":"172.21.15.175:6805/2174304558","state":["exists","up"]},{"osd":3,"uuid":"2e747d36-4aa5-4c4c-918d-b8100980cc8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6811","nonce":3010864289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6813","nonce":3010864289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6817","nonce":3010864289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6815","nonce":3010864289}]},"public_addr":"172.21.15.2:6811/3010864289","cluster_addr":"172.21.15.2:6813/3010864289","heartbeat_back_addr":"172.21.15.2:6817/3010864289","heartbeat_front_addr":"172.21.15.2:6815/3010864289","state":["exists","up"]},{"osd":4,"uuid":"bd063fb2-1a65-4b18-898c-f80ddc2a1229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6809","nonce":2541323390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6811","nonce":2541323390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6815","nonce":2541323390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6813","nonce":2541323390}]},"public_addr":"172.21.15.84:6809/2541323390","cluster_addr":"172.21.15.84:6811/2541323390","heartbeat_back_addr":"172.21.15.84:6815/2541323390","heartbeat_front_addr":"172.21.15.84:6813/2541323390","state":["exists","up"]},{"osd":5,"uuid":"e0ea80fd-1bfe-4d2e-9733-ff442ec015b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6809","nonce":764262885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6811","nonce":764262885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6815","nonce":764262885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6813","nonce":764262885}]},"public_addr":"172.21.15.175:6809/764262885","cluster_addr":"172.21.15.175:6811/764262885","heartbeat_back_addr":"172.21.15.175:6815/764262885","heartbeat_front_addr":"172.21.15.175:6813/764262885","state":["exists","up"]},{"osd":6,"uuid":"1c204d74-5e48-4e2e-bb98-6a8d4974187c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6819","nonce":297321106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6821","nonce":297321106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6825","nonce":297321106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6823","nonce":297321106}]},"public_addr":"172.21.15.2:6819/297321106","cluster_addr":"172.21.15.2:6821/297321106","heartbeat_back_addr":"172.21.15.2:6825/297321106","heartbeat_front_addr":"172.21.15.2:6823/297321106","state":["exists","up"]},{"osd":7,"uuid":"1299bbb1-fbfb-4aba-be6b-6704691735f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6817","nonce":3873726653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6819","nonce":3873726653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6823","nonce":3873726653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6821","nonce":3873726653}]},"public_addr":"172.21.15.84:6817/3873726653","cluster_addr":"172.21.15.84:6819/3873726653","heartbeat_back_addr":"172.21.15.84:6823/3873726653","heartbeat_front_addr":"172.21.15.84:6821/3873726653","state":["exists","up"]},{"osd":8,"uuid":"9c3f2a92-d956-4246-bce9-620824d0da22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6817","nonce":2622818232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6819","nonce":2622818232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6823","nonce":2622818232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6821","nonce":2622818232}]},"public_addr":"172.21.15.175:6817/2622818232","cluster_addr":"172.21.15.175:6819/2622818232","heartbeat_back_addr":"172.21.15.175:6823/2622818232","heartbeat_front_addr":"172.21.15.175:6821/2622818232","state":["exists","up"]},{"osd":9,"uuid":"e9839f78-05c6-4b3f-bc14-cb771a03ff5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6827","nonce":1171735390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6829","nonce":1171735390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6833","nonce":1171735390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6831","nonce":1171735390}]},"public_addr":"172.21.15.2:6827/1171735390","cluster_addr":"172.21.15.2:6829/1171735390","heartbeat_back_addr":"172.21.15.2:6833/1171735390","heartbeat_front_addr":"172.21.15.2:6831/1171735390","state":["exists","up"]},{"osd":10,"uuid":"66719431-5ba9-4865-957b-f6582e607a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6825","nonce":4269523460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6827","nonce":4269523460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6831","nonce":4269523460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6829","nonce":4269523460}]},"public_addr":"172.21.15.84:6825/4269523460","cluster_addr":"172.21.15.84:6827/4269523460","heartbeat_back_addr":"172.21.15.84:6831/4269523460","heartbeat_front_addr":"172.21.15.84:6829/4269523460","state":["exists","up"]},{"osd":11,"uuid":"1ce6e6ee-6ff3-416f-b985-e3afe503093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6825","nonce":2762894732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6827","nonce":2762894732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6831","nonce":2762894732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6829","nonce":2762894732}]},"public_addr":"172.21.15.175:6825/2762894732","cluster_addr":"172.21.15.175:6827/2762894732","heartbeat_back_addr":"172.21.15.175:6831/2762894732","heartbeat_front_addr":"172.21.15.175:6829/2762894732","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:16.956638+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:42.268685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:06.272084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:39.696927+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:06.182991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:31.626603+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:05.247728+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:31.985114+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:57.474180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:31.988863+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:59.683056+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:11:24.493248+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6800/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3397168014":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/1789744365":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3831398703":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/3119270562":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/2163302458":"2024-06-14T02:03:50.073572+0000","172.21.15.2:6800/2830681579":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/1678672435":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6801/2830681579":"2024-06-14T02:03:50.073572+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T02:11:30.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.690+0000 7f8988800700 1 -- 172.21.15.2:0/1186803786 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f89680a2ca0 msgr2=0x7f89680a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:30.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.690+0000 7f8988800700 1 --2- 172.21.15.2:0/1186803786 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f89680a2ca0 0x7f89680a5160 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8974011550 tx=0x7f8974009260 comp rx=0 tx=0).stop 2024-06-13T02:11:30.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.690+0000 7f8988800700 1 -- 172.21.15.2:0/1186803786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8980104ed0 msgr2=0x7f898019f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:30.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.690+0000 7f8988800700 1 --2- 172.21.15.2:0/1186803786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8980104ed0 0x7f898019f7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8970000c00 tx=0x7f897000bab0 comp rx=0 tx=0).stop 2024-06-13T02:11:30.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.691+0000 7f8988800700 1 -- 172.21.15.2:0/1186803786 shutdown_connections 2024-06-13T02:11:30.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.691+0000 7f8988800700 1 --2- 172.21.15.2:0/1186803786 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f89680a2ca0 0x7f89680a5160 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:30.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.691+0000 7f8988800700 1 --2- 172.21.15.2:0/1186803786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89801073c0 0x7f89801a3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:30.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.691+0000 7f8988800700 1 --2- 172.21.15.2:0/1186803786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f898006a6e0 0x7f898019f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:30.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.691+0000 7f8988800700 1 --2- 172.21.15.2:0/1186803786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8980104ed0 0x7f898019f7a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:30.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.691+0000 7f8988800700 1 -- 172.21.15.2:0/1186803786 >> 172.21.15.2:0/1186803786 conn(0x7f8980078340 msgr2=0x7f8980103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:30.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.691+0000 7f8988800700 1 -- 172.21.15.2:0/1186803786 shutdown_connections 2024-06-13T02:11:30.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:30.691+0000 7f8988800700 1 -- 172.21.15.2:0/1186803786 wait complete. 2024-06-13T02:11:31.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:31 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1186803786' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:11:31.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:31 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1186803786' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:11:31.532 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-13T02:07:10.994857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-13T02:11:31.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-06-13T02:11:31.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:31 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1186803786' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:11:32.010 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:11:32.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:32 smithi084 ceph-mon[36833]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:32.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:32 smithi002 ceph-mon[31960]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:32.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:32 smithi175 ceph-mon[36977]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:33.312 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:33 smithi002 ceph-mon[31960]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:33.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:33 smithi084 ceph-mon[36833]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:33.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:33 smithi175 ceph-mon[36977]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:34.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.200+0000 7ff849000700 1 -- 172.21.15.2:0/3582736442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff844103ea0 msgr2=0x7ff84410c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:34.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.200+0000 7ff849000700 1 --2- 172.21.15.2:0/3582736442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff844103ea0 0x7ff84410c390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0098f0 tx=0x7ff82c009c00 comp rx=0 tx=0).stop 2024-06-13T02:11:34.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.200+0000 7ff849000700 1 -- 172.21.15.2:0/3582736442 shutdown_connections 2024-06-13T02:11:34.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.200+0000 7ff849000700 1 --2- 172.21.15.2:0/3582736442 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff84410c9b0 0x7ff84410ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:34.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.200+0000 7ff849000700 1 --2- 172.21.15.2:0/3582736442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff844103580 0x7ff844103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:34.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.200+0000 7ff849000700 1 --2- 172.21.15.2:0/3582736442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff844103ea0 0x7ff84410c390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:34.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.200+0000 7ff849000700 1 -- 172.21.15.2:0/3582736442 >> 172.21.15.2:0/3582736442 conn(0x7ff8440fcdb0 msgr2=0x7ff8440ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:34.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.200+0000 7ff849000700 1 -- 172.21.15.2:0/3582736442 shutdown_connections 2024-06-13T02:11:34.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.200+0000 7ff849000700 1 -- 172.21.15.2:0/3582736442 wait complete. 2024-06-13T02:11:34.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.201+0000 7ff849000700 1 Processor -- start 2024-06-13T02:11:34.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.201+0000 7ff849000700 1 -- start start 2024-06-13T02:11:34.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.202+0000 7ff849000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff844103580 0x7ff8441011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:34.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.202+0000 7ff849000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff844103ea0 0x7ff844101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.202+0000 7ff849000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff84410c9b0 0x7ff844101c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.202+0000 7ff849000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff844112720 con 0x7ff84410c9b0 2024-06-13T02:11:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.202+0000 7ff849000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff8441125a0 con 0x7ff844103580 2024-06-13T02:11:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.202+0000 7ff849000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff8441128a0 con 0x7ff844103ea0 2024-06-13T02:11:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.202+0000 7ff843e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff84410c9b0 0x7ff844101c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.202+0000 7ff843e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff84410c9b0 0x7ff844101c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55496/0 (socket says 172.21.15.2:55496) 2024-06-13T02:11:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.202+0000 7ff843400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff844103580 0x7ff8441011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.202+0000 7ff843e00700 1 -- 172.21.15.2:0/2857186209 learned_addr learned my addr 172.21.15.2:0/2857186209 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:11:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.202+0000 7ff83aa00700 1 --2- 172.21.15.2:0/2857186209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff844103ea0 0x7ff844101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.202+0000 7ff843e00700 1 -- 172.21.15.2:0/2857186209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff844103ea0 msgr2=0x7ff844101720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:34.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.202+0000 7ff843e00700 1 --2- 172.21.15.2:0/2857186209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff844103ea0 0x7ff844101720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.203+0000 7ff843e00700 1 -- 172.21.15.2:0/2857186209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff844103580 msgr2=0x7ff8441011e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.203+0000 7ff843e00700 1 --2- 172.21.15.2:0/2857186209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff844103580 0x7ff8441011e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.203+0000 7ff843e00700 1 -- 172.21.15.2:0/2857186209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8441a7160 con 0x7ff84410c9b0 2024-06-13T02:11:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.203+0000 7ff843400700 1 --2- 172.21.15.2:0/2857186209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff844103580 0x7ff8441011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:11:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.203+0000 7ff843e00700 1 --2- 172.21.15.2:0/2857186209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff84410c9b0 0x7ff844101c60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00eb80 tx=0x7ff83c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.203+0000 7ff840c00700 1 -- 172.21.15.2:0/2857186209 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00cc90 con 0x7ff84410c9b0 2024-06-13T02:11:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.203+0000 7ff840c00700 1 -- 172.21.15.2:0/2857186209 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff83c00ce30 con 0x7ff84410c9b0 2024-06-13T02:11:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.203+0000 7ff840c00700 1 -- 172.21.15.2:0/2857186209 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c010430 con 0x7ff84410c9b0 2024-06-13T02:11:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.203+0000 7ff849000700 1 -- 172.21.15.2:0/2857186209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8441a7450 con 0x7ff84410c9b0 2024-06-13T02:11:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.203+0000 7ff849000700 1 -- 172.21.15.2:0/2857186209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8441a7960 con 0x7ff84410c9b0 2024-06-13T02:11:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.205+0000 7ff849000700 1 -- 172.21.15.2:0/2857186209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff844069180 con 0x7ff84410c9b0 2024-06-13T02:11:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.206+0000 7ff840c00700 1 -- 172.21.15.2:0/2857186209 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff83c004000 con 0x7ff84410c9b0 2024-06-13T02:11:34.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.208+0000 7ff840c00700 1 --2- 172.21.15.2:0/2857186209 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff8280a2ca0 0x7ff8280a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.208+0000 7ff840c00700 1 -- 172.21.15.2:0/2857186209 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7ff83c0cee40 con 0x7ff84410c9b0 2024-06-13T02:11:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.208+0000 7ff843400700 1 --2- 172.21.15.2:0/2857186209 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff8280a2ca0 0x7ff8280a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.209+0000 7ff843400700 1 --2- 172.21.15.2:0/2857186209 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff8280a2ca0 0x7ff8280a5160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff834009480 tx=0x7ff83400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:34.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.212+0000 7ff840c00700 1 -- 172.21.15.2:0/2857186209 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff83c0042f0 con 0x7ff84410c9b0 2024-06-13T02:11:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.441+0000 7ff849000700 1 -- 172.21.15.2:0/2857186209 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff84402dca0 con 0x7ff84410c9b0 2024-06-13T02:11:34.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.442+0000 7ff840c00700 1 -- 172.21.15.2:0/2857186209 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7ff83c09c1a0 con 0x7ff84410c9b0 2024-06-13T02:11:34.444 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-06-13T02:11:34.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.445+0000 7ff849000700 1 -- 172.21.15.2:0/2857186209 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff8280a2ca0 msgr2=0x7ff8280a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.445+0000 7ff849000700 1 --2- 172.21.15.2:0/2857186209 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff8280a2ca0 0x7ff8280a5160 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff834009480 tx=0x7ff83400b040 comp rx=0 tx=0).stop 2024-06-13T02:11:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.445+0000 7ff849000700 1 -- 172.21.15.2:0/2857186209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff84410c9b0 msgr2=0x7ff844101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.445+0000 7ff849000700 1 --2- 172.21.15.2:0/2857186209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff84410c9b0 0x7ff844101c60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00eb80 tx=0x7ff83c00ee90 comp rx=0 tx=0).stop 2024-06-13T02:11:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.446+0000 7ff849000700 1 -- 172.21.15.2:0/2857186209 shutdown_connections 2024-06-13T02:11:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.446+0000 7ff849000700 1 --2- 172.21.15.2:0/2857186209 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff8280a2ca0 0x7ff8280a5160 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.446+0000 7ff849000700 1 --2- 172.21.15.2:0/2857186209 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff84410c9b0 0x7ff844101c60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:34.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.446+0000 7ff849000700 1 --2- 172.21.15.2:0/2857186209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff844103580 0x7ff8441011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.446+0000 7ff849000700 1 --2- 172.21.15.2:0/2857186209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff844103ea0 0x7ff844101720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.446+0000 7ff849000700 1 -- 172.21.15.2:0/2857186209 >> 172.21.15.2:0/2857186209 conn(0x7ff8440fcdb0 msgr2=0x7ff8440fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.446+0000 7ff849000700 1 -- 172.21.15.2:0/2857186209 shutdown_connections 2024-06-13T02:11:34.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:34.446+0000 7ff849000700 1 -- 172.21.15.2:0/2857186209 wait complete. 2024-06-13T02:11:34.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:34 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2857186209' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-13T02:11:34.876 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:34 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2857186209' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-13T02:11:34.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:34 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2857186209' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-13T02:11:35.247 INFO:tasks.cephadm:Adding mds.a on smithi002 2024-06-13T02:11:35.247 INFO:tasks.cephadm:Adding mds.d on smithi002 2024-06-13T02:11:35.247 INFO:tasks.cephadm:Adding mds.g on smithi002 2024-06-13T02:11:35.247 INFO:tasks.cephadm:Adding mds.j on smithi002 2024-06-13T02:11:35.247 INFO:tasks.cephadm:Adding mds.b on smithi084 2024-06-13T02:11:35.247 INFO:tasks.cephadm:Adding mds.e on smithi084 2024-06-13T02:11:35.248 INFO:tasks.cephadm:Adding mds.h on smithi084 2024-06-13T02:11:35.248 INFO:tasks.cephadm:Adding mds.k on smithi084 2024-06-13T02:11:35.248 INFO:tasks.cephadm:Adding mds.c on smithi175 2024-06-13T02:11:35.248 INFO:tasks.cephadm:Adding mds.f on smithi175 2024-06-13T02:11:35.248 INFO:tasks.cephadm:Adding mds.i on smithi175 2024-06-13T02:11:35.248 INFO:tasks.cephadm:Adding mds.l on smithi175 2024-06-13T02:11:35.248 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph orch apply mds all '12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l' 2024-06-13T02:11:35.497 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:11:35.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:35 smithi175 ceph-mon[36977]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:35.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:35 smithi002 ceph-mon[31960]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:35.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:35 smithi084 ceph-mon[36833]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:37.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.077+0000 7f32ddc22700 1 -- 172.21.15.175:0/2816194147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d81024e0 msgr2=0x7f32d8102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:37.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.077+0000 7f32ddc22700 1 --2- 172.21.15.175:0/2816194147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d81024e0 0x7f32d8102900 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009990 tx=0x7f32c8009ca0 comp rx=0 tx=0).stop 2024-06-13T02:11:37.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.077+0000 7f32ddc22700 1 -- 172.21.15.175:0/2816194147 shutdown_connections 2024-06-13T02:11:37.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.077+0000 7f32ddc22700 1 --2- 172.21.15.175:0/2816194147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32d8104080 0x7f32d810a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:37.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.077+0000 7f32ddc22700 1 --2- 172.21.15.175:0/2816194147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d81024e0 0x7f32d8102900 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:37.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.077+0000 7f32ddc22700 1 --2- 172.21.15.175:0/2816194147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32d81036e0 0x7f32d8103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:37.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.077+0000 7f32ddc22700 1 -- 172.21.15.175:0/2816194147 >> 172.21.15.175:0/2816194147 conn(0x7f32d80fda80 msgr2=0x7f32d80ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:37.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.077+0000 7f32ddc22700 1 -- 172.21.15.175:0/2816194147 shutdown_connections 2024-06-13T02:11:37.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.077+0000 7f32ddc22700 1 -- 172.21.15.175:0/2816194147 wait complete. 2024-06-13T02:11:37.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.077+0000 7f32ddc22700 1 Processor -- start 2024-06-13T02:11:37.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.077+0000 7f32ddc22700 1 -- start start 2024-06-13T02:11:37.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32ddc22700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32d81024e0 0x7f32d8198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:37.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32ddc22700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32d81036e0 0x7f32d8198cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:37.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32ddc22700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d8104080 0x7f32d819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:37.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32ddc22700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f32d810e120 con 0x7f32d81024e0 2024-06-13T02:11:37.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32ddc22700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f32d810dfa0 con 0x7f32d81036e0 2024-06-13T02:11:37.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32ddc22700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f32d810e2a0 con 0x7f32d8104080 2024-06-13T02:11:37.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32d7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d8104080 0x7f32d819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:37.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32d7fff700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d8104080 0x7f32d819fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35290/0 (socket says 172.21.15.175:35290) 2024-06-13T02:11:37.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32d7fff700 1 -- 172.21.15.175:0/1017095359 learned_addr learned my addr 172.21.15.175:0/1017095359 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-06-13T02:11:37.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32d6ffd700 1 --2- 172.21.15.175:0/1017095359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32d81036e0 0x7f32d8198cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:37.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32d7fff700 1 -- 172.21.15.175:0/1017095359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32d81036e0 msgr2=0x7f32d8198cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:37.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32d7fff700 1 --2- 172.21.15.175:0/1017095359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32d81036e0 0x7f32d8198cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:37.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32d7fff700 1 -- 172.21.15.175:0/1017095359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32d81024e0 msgr2=0x7f32d8198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:37.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32d7fff700 1 --2- 172.21.15.175:0/1017095359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32d81024e0 0x7f32d8198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:37.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32d7fff700 1 -- 172.21.15.175:0/1017095359 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d81a03f0 con 0x7f32d8104080 2024-06-13T02:11:37.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32d7fff700 1 --2- 172.21.15.175:0/1017095359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d8104080 0x7f32d819fd50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f32d0007f10 tx=0x7f32d000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:37.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32d4ff9700 1 -- 172.21.15.175:0/1017095359 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d000ddd0 con 0x7f32d8104080 2024-06-13T02:11:37.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32d4ff9700 1 -- 172.21.15.175:0/1017095359 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32d0004020 con 0x7f32d8104080 2024-06-13T02:11:37.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32ddc22700 1 -- 172.21.15.175:0/1017095359 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d81a06e0 con 0x7f32d8104080 2024-06-13T02:11:37.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32d4ff9700 1 -- 172.21.15.175:0/1017095359 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0015660 con 0x7f32d8104080 2024-06-13T02:11:37.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.078+0000 7f32ddc22700 1 -- 172.21.15.175:0/1017095359 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d81a0c20 con 0x7f32d8104080 2024-06-13T02:11:37.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.079+0000 7f32ddc22700 1 -- 172.21.15.175:0/1017095359 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32d8069180 con 0x7f32d8104080 2024-06-13T02:11:37.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.080+0000 7f32d4ff9700 1 -- 172.21.15.175:0/1017095359 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f32d00041d0 con 0x7f32d8104080 2024-06-13T02:11:37.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.081+0000 7f32d4ff9700 1 --2- 172.21.15.175:0/1017095359 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f32c00a2c20 0x7f32c00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:37.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.081+0000 7f32d4ff9700 1 -- 172.21.15.175:0/1017095359 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f32d00ce6e0 con 0x7f32d8104080 2024-06-13T02:11:37.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.081+0000 7f32d77fe700 1 --2- 172.21.15.175:0/1017095359 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f32c00a2c20 0x7f32c00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:37.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.082+0000 7f32d77fe700 1 --2- 172.21.15.175:0/1017095359 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f32c00a2c20 0x7f32c00a50e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f32c80098e0 tx=0x7f32c8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:37.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.085+0000 7f32d4ff9700 1 -- 172.21.15.175:0/1017095359 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f32d0010070 con 0x7f32d8104080 2024-06-13T02:11:37.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.290+0000 7f32ddc22700 1 -- 172.21.15.175:0/1017095359 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}) -- 0x7f32d8062b90 con 0x7f32c00a2c20 2024-06-13T02:11:37.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.307+0000 7f32d4ff9700 1 -- 172.21.15.175:0/1017095359 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f32d8062b90 con 0x7f32c00a2c20 2024-06-13T02:11:37.308 INFO:teuthology.orchestra.run.smithi175.stdout:Scheduled mds.all update... 2024-06-13T02:11:37.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.310+0000 7f32ddc22700 1 -- 172.21.15.175:0/1017095359 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f32c00a2c20 msgr2=0x7f32c00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:37.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.310+0000 7f32ddc22700 1 --2- 172.21.15.175:0/1017095359 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f32c00a2c20 0x7f32c00a50e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f32c80098e0 tx=0x7f32c8005fb0 comp rx=0 tx=0).stop 2024-06-13T02:11:37.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.310+0000 7f32ddc22700 1 -- 172.21.15.175:0/1017095359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d8104080 msgr2=0x7f32d819fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:37.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.310+0000 7f32ddc22700 1 --2- 172.21.15.175:0/1017095359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d8104080 0x7f32d819fd50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f32d0007f10 tx=0x7f32d000d3b0 comp rx=0 tx=0).stop 2024-06-13T02:11:37.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.310+0000 7f32ddc22700 1 -- 172.21.15.175:0/1017095359 shutdown_connections 2024-06-13T02:11:37.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.310+0000 7f32ddc22700 1 --2- 172.21.15.175:0/1017095359 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f32c00a2c20 0x7f32c00a50e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:37.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.310+0000 7f32ddc22700 1 --2- 172.21.15.175:0/1017095359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d8104080 0x7f32d819fd50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:37.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.310+0000 7f32ddc22700 1 --2- 172.21.15.175:0/1017095359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32d81024e0 0x7f32d8198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:37.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.310+0000 7f32ddc22700 1 --2- 172.21.15.175:0/1017095359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32d81036e0 0x7f32d8198cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:37.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.310+0000 7f32ddc22700 1 -- 172.21.15.175:0/1017095359 >> 172.21.15.175:0/1017095359 conn(0x7f32d80fda80 msgr2=0x7f32d8106b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:37.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.310+0000 7f32ddc22700 1 -- 172.21.15.175:0/1017095359 shutdown_connections 2024-06-13T02:11:37.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-06-13T02:11:37.310+0000 7f32ddc22700 1 -- 172.21.15.175:0/1017095359 wait complete. 2024-06-13T02:11:37.571 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:37 smithi175 ceph-mon[36977]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:37.571 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:37 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:37.571 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:37 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:11:37.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:37 smithi002 ceph-mon[31960]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:37.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:37 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:37.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:37 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:11:37.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:37 smithi084 ceph-mon[36833]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:37.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:37 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:37.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:37 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:11:37.984 DEBUG:teuthology.orchestra.run.smithi002:mds.a> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.a.service 2024-06-13T02:11:37.995 DEBUG:teuthology.orchestra.run.smithi002:mds.d> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.d.service 2024-06-13T02:11:38.041 DEBUG:teuthology.orchestra.run.smithi002:mds.g> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.g.service 2024-06-13T02:11:38.087 DEBUG:teuthology.orchestra.run.smithi002:mds.j> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.j.service 2024-06-13T02:11:38.131 DEBUG:teuthology.orchestra.run.smithi084:mds.b> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.b.service 2024-06-13T02:11:38.134 DEBUG:teuthology.orchestra.run.smithi084:mds.e> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.e.service 2024-06-13T02:11:38.176 DEBUG:teuthology.orchestra.run.smithi084:mds.h> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.h.service 2024-06-13T02:11:38.219 DEBUG:teuthology.orchestra.run.smithi084:mds.k> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.k.service 2024-06-13T02:11:38.262 DEBUG:teuthology.orchestra.run.smithi175:mds.c> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.c.service 2024-06-13T02:11:38.264 DEBUG:teuthology.orchestra.run.smithi175:mds.f> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.f.service 2024-06-13T02:11:38.307 DEBUG:teuthology.orchestra.run.smithi175:mds.i> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.i.service 2024-06-13T02:11:38.350 DEBUG:teuthology.orchestra.run.smithi175:mds.l> sudo journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.l.service 2024-06-13T02:11:38.393 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-06-13T02:11:38.393 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:11:38.566 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:38 smithi175 ceph-mon[36977]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:11:38.566 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:38 smithi175 ceph-mon[36977]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-06-13T02:11:38.873 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:11:38.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:38 smithi002 ceph-mon[31960]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:11:38.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:38 smithi002 ceph-mon[31960]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-06-13T02:11:38.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:38 smithi084 ceph-mon[36833]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:11:38.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:38 smithi084 ceph-mon[36833]: Saving service mds.all spec with placement smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-06-13T02:11:39.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:39 smithi002 ceph-mon[31960]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:39.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:39.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:11:39.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:39.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:39.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:39.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:39 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:39.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:39 smithi002 ceph-mon[31960]: Deploying daemon mds.l on smithi175 2024-06-13T02:11:39.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:39 smithi175 ceph-mon[36977]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:39.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:39.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:11:39.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:39.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:39.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:39.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:39 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:39.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:39 smithi175 ceph-mon[36977]: Deploying daemon mds.l on smithi175 2024-06-13T02:11:39.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:39 smithi084 ceph-mon[36833]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:39.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:39.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:11:39.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:39.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:39.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:39.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:39 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:39.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:39 smithi084 ceph-mon[36833]: Deploying daemon mds.l on smithi175 2024-06-13T02:11:40.782 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:11:40 smithi175 systemd[1]: Starting Ceph mds.l for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:11:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.993+0000 7f0f25200700 1 -- 172.21.15.2:0/427964274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f2006b3c0 msgr2=0x7f0f2010f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.993+0000 7f0f25200700 1 --2- 172.21.15.2:0/427964274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f2006b3c0 0x7f0f2010f310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800b0a0 tx=0x7f0f1800b3b0 comp rx=0 tx=0).stop 2024-06-13T02:11:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.993+0000 7f0f25200700 1 -- 172.21.15.2:0/427964274 shutdown_connections 2024-06-13T02:11:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.993+0000 7f0f25200700 1 --2- 172.21.15.2:0/427964274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f2006b3c0 0x7f0f2010f310 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.993+0000 7f0f25200700 1 --2- 172.21.15.2:0/427964274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f201084f0 0x7f0f201088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.993+0000 7f0f25200700 1 --2- 172.21.15.2:0/427964274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f2006aa00 0x7f0f2006ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:40.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.993+0000 7f0f25200700 1 -- 172.21.15.2:0/427964274 >> 172.21.15.2:0/427964274 conn(0x7f0f20078300 msgr2=0x7f0f20078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:40.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.993+0000 7f0f25200700 1 -- 172.21.15.2:0/427964274 shutdown_connections 2024-06-13T02:11:40.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.993+0000 7f0f25200700 1 -- 172.21.15.2:0/427964274 wait complete. 2024-06-13T02:11:40.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.994+0000 7f0f25200700 1 Processor -- start 2024-06-13T02:11:40.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.995+0000 7f0f25200700 1 -- start start 2024-06-13T02:11:40.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.995+0000 7f0f25200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f2006aa00 0x7f0f2019ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:40.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.995+0000 7f0f25200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f2006b3c0 0x7f0f2019b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:40.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.995+0000 7f0f25200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f201084f0 0x7f0f2019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:40.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.995+0000 7f0f25200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0f20112840 con 0x7f0f201084f0 2024-06-13T02:11:40.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.995+0000 7f0f25200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0f201126c0 con 0x7f0f2006aa00 2024-06-13T02:11:40.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.995+0000 7f0f25200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f201129c0 con 0x7f0f2006b3c0 2024-06-13T02:11:40.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.995+0000 7f0f1de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f2006aa00 0x7f0f2019ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:40.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.995+0000 7f0f1de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f2006aa00 0x7f0f2019ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:55494/0 (socket says 172.21.15.2:55494) 2024-06-13T02:11:40.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.995+0000 7f0f1de00700 1 -- 172.21.15.2:0/689050832 learned_addr learned my addr 172.21.15.2:0/689050832 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:11:40.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.995+0000 7f0f1d400700 1 --2- 172.21.15.2:0/689050832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f2006b3c0 0x7f0f2019b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:40.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.995+0000 7f0f1e800700 1 --2- 172.21.15.2:0/689050832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f201084f0 0x7f0f2019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.996+0000 7f0f1de00700 1 -- 172.21.15.2:0/689050832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f2006b3c0 msgr2=0x7f0f2019b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.996+0000 7f0f1de00700 1 --2- 172.21.15.2:0/689050832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f2006b3c0 0x7f0f2019b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.996+0000 7f0f1de00700 1 -- 172.21.15.2:0/689050832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f201084f0 msgr2=0x7f0f2019f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.996+0000 7f0f1de00700 1 --2- 172.21.15.2:0/689050832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f201084f0 0x7f0f2019f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.996+0000 7f0f1de00700 1 -- 172.21.15.2:0/689050832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2019fe80 con 0x7f0f2006aa00 2024-06-13T02:11:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.996+0000 7f0f1de00700 1 --2- 172.21.15.2:0/689050832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f2006aa00 0x7f0f2019ae70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000e9a0 tx=0x7f0f1000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.996+0000 7f0f16a00700 1 -- 172.21.15.2:0/689050832 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1000ca10 con 0x7f0f2006aa00 2024-06-13T02:11:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.997+0000 7f0f16a00700 1 -- 172.21.15.2:0/689050832 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f1000cbb0 con 0x7f0f2006aa00 2024-06-13T02:11:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.997+0000 7f0f16a00700 1 -- 172.21.15.2:0/689050832 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f10018680 con 0x7f0f2006aa00 2024-06-13T02:11:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.997+0000 7f0f25200700 1 -- 172.21.15.2:0/689050832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f201a0170 con 0x7f0f2006aa00 2024-06-13T02:11:40.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.997+0000 7f0f25200700 1 -- 172.21.15.2:0/689050832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f20109250 con 0x7f0f2006aa00 2024-06-13T02:11:41.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:40.998+0000 7f0f25200700 1 -- 172.21.15.2:0/689050832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f20069180 con 0x7f0f2006aa00 2024-06-13T02:11:41.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.000+0000 7f0f16a00700 1 -- 172.21.15.2:0/689050832 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f0f10010430 con 0x7f0f2006aa00 2024-06-13T02:11:41.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.001+0000 7f0f16a00700 1 --2- 172.21.15.2:0/689050832 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f0f040a2ca0 0x7f0f040a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:41.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.002+0000 7f0f16a00700 1 -- 172.21.15.2:0/689050832 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f0f100cf2b0 con 0x7f0f2006aa00 2024-06-13T02:11:41.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.002+0000 7f0f1d400700 1 --2- 172.21.15.2:0/689050832 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f0f040a2ca0 0x7f0f040a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:41.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.002+0000 7f0f1d400700 1 --2- 172.21.15.2:0/689050832 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f0f040a2ca0 0x7f0f040a5160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0f201033a0 tx=0x7f0f0c013040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:41.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.003+0000 7f0f16a00700 1 -- 172.21.15.2:0/689050832 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0f1009c610 con 0x7f0f2006aa00 2024-06-13T02:11:41.130 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:11:40 smithi175 podman[66653]: 2024-06-13 02:11:40.779263289 +0000 UTC m=+0.016949719 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:11:41.130 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:11:40 smithi175 podman[66653]: 2024-06-13 02:11:40.892212392 +0000 UTC m=+0.129898812 container create 3508dacb20518ac1a1993218193d6638185ffabf6f68026cd4b226b83bd7946d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T02:11:41.130 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:11:41 smithi175 podman[66653]: 2024-06-13 02:11:41.104124642 +0000 UTC m=+0.341811079 container init 3508dacb20518ac1a1993218193d6638185ffabf6f68026cd4b226b83bd7946d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528) 2024-06-13T02:11:41.130 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:11:41 smithi175 podman[66653]: 2024-06-13 02:11:41.106795293 +0000 UTC m=+0.344481714 container start 3508dacb20518ac1a1993218193d6638185ffabf6f68026cd4b226b83bd7946d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528) 2024-06-13T02:11:41.130 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:11:41 smithi175 ceph-mds[66672]: -- 172.21.15.175:0/2241948900 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555d12123a40 con 0x555d120f6c00 2024-06-13T02:11:41.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.298+0000 7f0f25200700 1 -- 172.21.15.2:0/689050832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f201094b0 con 0x7f0f2006aa00 2024-06-13T02:11:41.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.298+0000 7f0f16a00700 1 -- 172.21.15.2:0/689050832 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f0f1009bf10 con 0x7f0f2006aa00 2024-06-13T02:11:41.300 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:11:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-13T02:11:41.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.301+0000 7f0f25200700 1 -- 172.21.15.2:0/689050832 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f0f040a2ca0 msgr2=0x7f0f040a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:41.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.301+0000 7f0f25200700 1 --2- 172.21.15.2:0/689050832 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f0f040a2ca0 0x7f0f040a5160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0f201033a0 tx=0x7f0f0c013040 comp rx=0 tx=0).stop 2024-06-13T02:11:41.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.301+0000 7f0f25200700 1 -- 172.21.15.2:0/689050832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f2006aa00 msgr2=0x7f0f2019ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:41.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.301+0000 7f0f25200700 1 --2- 172.21.15.2:0/689050832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f2006aa00 0x7f0f2019ae70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000e9a0 tx=0x7f0f1000ecb0 comp rx=0 tx=0).stop 2024-06-13T02:11:41.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.302+0000 7f0f25200700 1 -- 172.21.15.2:0/689050832 shutdown_connections 2024-06-13T02:11:41.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.302+0000 7f0f25200700 1 --2- 172.21.15.2:0/689050832 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f0f040a2ca0 0x7f0f040a5160 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:41.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.302+0000 7f0f25200700 1 --2- 172.21.15.2:0/689050832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f201084f0 0x7f0f2019f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:41.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.302+0000 7f0f25200700 1 --2- 172.21.15.2:0/689050832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f2006aa00 0x7f0f2019ae70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:41.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.302+0000 7f0f25200700 1 --2- 172.21.15.2:0/689050832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f2006b3c0 0x7f0f2019b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:41.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.302+0000 7f0f25200700 1 -- 172.21.15.2:0/689050832 >> 172.21.15.2:0/689050832 conn(0x7f0f20078300 msgr2=0x7f0f2010d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:41.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.302+0000 7f0f25200700 1 -- 172.21.15.2:0/689050832 shutdown_connections 2024-06-13T02:11:41.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:41.302+0000 7f0f25200700 1 -- 172.21.15.2:0/689050832 wait complete. 2024-06-13T02:11:41.305 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2024-06-13T02:11:41.532 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:11:41 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-l[66668]: starting mds.l at 2024-06-13T02:11:41.532 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:11:41 smithi175 bash[66653]: 3508dacb20518ac1a1993218193d6638185ffabf6f68026cd4b226b83bd7946d 2024-06-13T02:11:41.533 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:11:41 smithi175 systemd[1]: Started Ceph mds.l for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:11:42.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:42 smithi084 ceph-mon[36833]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:42.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:42 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.175:6832/1278226284,v1:172.21.15.175:6833/1278226284] up:boot 2024-06-13T02:11:42.297 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:42 smithi084 ceph-mon[36833]: fsmap 1 up:standby 2024-06-13T02:11:42.298 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-13T02:11:42.298 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:42.298 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:42.298 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:42 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/689050832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:11:42.298 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:42.298 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:42.298 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:42.298 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:42 smithi002 ceph-mon[31960]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:42 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.175:6832/1278226284,v1:172.21.15.175:6833/1278226284] up:boot 2024-06-13T02:11:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:42 smithi002 ceph-mon[31960]: fsmap 1 up:standby 2024-06-13T02:11:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-13T02:11:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:42 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/689050832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:11:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:42.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:42.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:42.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:42.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:42 smithi175 ceph-mon[36977]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:42.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:42 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.175:6832/1278226284,v1:172.21.15.175:6833/1278226284] up:boot 2024-06-13T02:11:42.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:42 smithi175 ceph-mon[36977]: fsmap 1 up:standby 2024-06-13T02:11:42.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-13T02:11:42.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:42.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:42.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:42 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/689050832' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:11:42.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:42.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:42.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:42.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:43.383 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:43 smithi084 ceph-mon[36833]: Deploying daemon mds.k on smithi084 2024-06-13T02:11:43.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:43 smithi175 ceph-mon[36977]: Deploying daemon mds.k on smithi084 2024-06-13T02:11:43.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:43 smithi002 ceph-mon[31960]: Deploying daemon mds.k on smithi084 2024-06-13T02:11:43.721 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:11:43 smithi084 systemd[1]: Starting Ceph mds.k for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:11:44.032 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:11:43 smithi084 podman[66127]: 2024-06-13 02:11:43.683580171 +0000 UTC m=+0.017515375 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:11:44.032 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:11:43 smithi084 podman[66127]: 2024-06-13 02:11:43.796790204 +0000 UTC m=+0.130725398 container create 320cc84d5724b64888dbe06dd6c0f0d60a23407cba27d06355ca18292f7a6c05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-k, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-06-13T02:11:44.033 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:11:44 smithi084 podman[66127]: 2024-06-13 02:11:44.032638516 +0000 UTC m=+0.366573722 container init 320cc84d5724b64888dbe06dd6c0f0d60a23407cba27d06355ca18292f7a6c05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc) 2024-06-13T02:11:44.099 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:11:44.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:44 smithi084 ceph-mon[36833]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:44.471 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:11:44 smithi084 podman[66127]: 2024-06-13 02:11:44.035453873 +0000 UTC m=+0.369389068 container start 320cc84d5724b64888dbe06dd6c0f0d60a23407cba27d06355ca18292f7a6c05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-k, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-06-13T02:11:44.471 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:11:44 smithi084 ceph-mds[66146]: -- 172.21.15.84:0/1492784346 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5587d735da40 con 0x5587d7330c00 2024-06-13T02:11:44.471 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:11:44 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-k[66142]: starting mds.k at 2024-06-13T02:11:44.471 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:11:44 smithi084 bash[66127]: 320cc84d5724b64888dbe06dd6c0f0d60a23407cba27d06355ca18292f7a6c05 2024-06-13T02:11:44.471 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:11:44 smithi084 systemd[1]: Started Ceph mds.k for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:11:44.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:44 smithi175 ceph-mon[36977]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:44.584 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:11:44.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:44 smithi002 ceph-mon[31960]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:45 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.84:6832/3039491270,v1:172.21.15.84:6833/3039491270] up:boot 2024-06-13T02:11:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:45 smithi002 ceph-mon[31960]: fsmap 2 up:standby 2024-06-13T02:11:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-13T02:11:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:45.448 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:45 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.84:6832/3039491270,v1:172.21.15.84:6833/3039491270] up:boot 2024-06-13T02:11:45.448 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:45 smithi084 ceph-mon[36833]: fsmap 2 up:standby 2024-06-13T02:11:45.449 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-13T02:11:45.449 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:45.449 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:45.449 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:45.449 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:45.449 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:45.449 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:45.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:45 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.84:6832/3039491270,v1:172.21.15.84:6833/3039491270] up:boot 2024-06-13T02:11:45.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:45 smithi175 ceph-mon[36977]: fsmap 2 up:standby 2024-06-13T02:11:45.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-13T02:11:45.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:45.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:45.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:45.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:45.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:45.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:46.320 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:46 smithi002 ceph-mon[31960]: Deploying daemon mds.j on smithi002 2024-06-13T02:11:46.320 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:46 smithi002 ceph-mon[31960]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:46.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:46 smithi084 ceph-mon[36833]: Deploying daemon mds.j on smithi002 2024-06-13T02:11:46.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:46 smithi084 ceph-mon[36833]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:46.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:46 smithi175 ceph-mon[36977]: Deploying daemon mds.j on smithi002 2024-06-13T02:11:46.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:46 smithi175 ceph-mon[36977]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.941+0000 7f5846e00700 1 -- 172.21.15.2:0/3344632112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5840074fe0 msgr2=0x7f5840113120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.941+0000 7f5846e00700 1 --2- 172.21.15.2:0/3344632112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5840074fe0 0x7f5840113120 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f582c009990 tx=0x7f582c009ca0 comp rx=0 tx=0).stop 2024-06-13T02:11:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.941+0000 7f5846e00700 1 -- 172.21.15.2:0/3344632112 shutdown_connections 2024-06-13T02:11:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.941+0000 7f5846e00700 1 --2- 172.21.15.2:0/3344632112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5840113660 0x7f5840115a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.941+0000 7f5846e00700 1 --2- 172.21.15.2:0/3344632112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58400746c0 0x7f5840074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.941+0000 7f5846e00700 1 --2- 172.21.15.2:0/3344632112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5840074fe0 0x7f5840113120 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.941+0000 7f5846e00700 1 -- 172.21.15.2:0/3344632112 >> 172.21.15.2:0/3344632112 conn(0x7f58400795f0 msgr2=0x7f5840079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:47.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.941+0000 7f5846e00700 1 -- 172.21.15.2:0/3344632112 shutdown_connections 2024-06-13T02:11:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.941+0000 7f5846e00700 1 -- 172.21.15.2:0/3344632112 wait complete. 2024-06-13T02:11:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.942+0000 7f5846e00700 1 Processor -- start 2024-06-13T02:11:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.942+0000 7f5846e00700 1 -- start start 2024-06-13T02:11:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.943+0000 7f5846e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58400746c0 0x7f584019f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.943+0000 7f5846e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5840074fe0 0x7f584019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.943+0000 7f5846e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5840113660 0x7f58401a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.943+0000 7f5846e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5840118da0 con 0x7f5840074fe0 2024-06-13T02:11:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.943+0000 7f5846e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5840118c20 con 0x7f58400746c0 2024-06-13T02:11:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.943+0000 7f5846e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5840118f20 con 0x7f5840113660 2024-06-13T02:11:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.943+0000 7f583f400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5840074fe0 0x7f584019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.943+0000 7f583f400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5840074fe0 0x7f584019f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60704/0 (socket says 172.21.15.2:60704) 2024-06-13T02:11:47.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.943+0000 7f583f400700 1 -- 172.21.15.2:0/2743484720 learned_addr learned my addr 172.21.15.2:0/2743484720 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:11:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.943+0000 7f583fe00700 1 --2- 172.21.15.2:0/2743484720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58400746c0 0x7f584019f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.943+0000 7f5844e00700 1 --2- 172.21.15.2:0/2743484720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5840113660 0x7f58401a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.944+0000 7f583f400700 1 -- 172.21.15.2:0/2743484720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5840113660 msgr2=0x7f58401a3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.944+0000 7f583f400700 1 --2- 172.21.15.2:0/2743484720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5840113660 0x7f58401a3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.944+0000 7f583f400700 1 -- 172.21.15.2:0/2743484720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58400746c0 msgr2=0x7f584019f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.944+0000 7f583f400700 1 --2- 172.21.15.2:0/2743484720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58400746c0 0x7f584019f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.944+0000 7f583f400700 1 -- 172.21.15.2:0/2743484720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58401a4260 con 0x7f5840074fe0 2024-06-13T02:11:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.944+0000 7f583f400700 1 --2- 172.21.15.2:0/2743484720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5840074fe0 0x7f584019f790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f582c000c00 tx=0x7f582c00bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.944+0000 7f583cc00700 1 -- 172.21.15.2:0/2743484720 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c027070 con 0x7f5840074fe0 2024-06-13T02:11:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.944+0000 7f583cc00700 1 -- 172.21.15.2:0/2743484720 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f582c003d70 con 0x7f5840074fe0 2024-06-13T02:11:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.944+0000 7f5846e00700 1 -- 172.21.15.2:0/2743484720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58401a44f0 con 0x7f5840074fe0 2024-06-13T02:11:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.944+0000 7f583cc00700 1 -- 172.21.15.2:0/2743484720 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c00f460 con 0x7f5840074fe0 2024-06-13T02:11:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.944+0000 7f5846e00700 1 -- 172.21.15.2:0/2743484720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58401abdd0 con 0x7f5840074fe0 2024-06-13T02:11:47.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.945+0000 7f5846e00700 1 -- 172.21.15.2:0/2743484720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5840069180 con 0x7f5840074fe0 2024-06-13T02:11:47.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.948+0000 7f583cc00700 1 -- 172.21.15.2:0/2743484720 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f582c02a070 con 0x7f5840074fe0 2024-06-13T02:11:47.328 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:11:47.328 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-06-13T02:11:47.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.950+0000 7f583cc00700 1 --2- 172.21.15.2:0/2743484720 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f58240a2ca0 0x7f58240a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:47.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.950+0000 7f583cc00700 1 -- 172.21.15.2:0/2743484720 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f582c0cfd60 con 0x7f5840074fe0 2024-06-13T02:11:47.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.950+0000 7f583fe00700 1 --2- 172.21.15.2:0/2743484720 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f58240a2ca0 0x7f58240a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:47.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.951+0000 7f583fe00700 1 --2- 172.21.15.2:0/2743484720 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f58240a2ca0 0x7f58240a5160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5830009c60 tx=0x7f5830009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:47.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:46.952+0000 7f583cc00700 1 -- 172.21.15.2:0/2743484720 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f582c013070 con 0x7f5840074fe0 2024-06-13T02:11:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:47.234+0000 7f5846e00700 1 -- 172.21.15.2:0/2743484720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58401abfa0 con 0x7f5840074fe0 2024-06-13T02:11:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:47.235+0000 7f583cc00700 1 -- 172.21.15.2:0/2743484720 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7f582c09d150 con 0x7f5840074fe0 2024-06-13T02:11:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:47.238+0000 7f5846e00700 1 -- 172.21.15.2:0/2743484720 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f58240a2ca0 msgr2=0x7f58240a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:47.238+0000 7f5846e00700 1 --2- 172.21.15.2:0/2743484720 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f58240a2ca0 0x7f58240a5160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5830009c60 tx=0x7f5830009260 comp rx=0 tx=0).stop 2024-06-13T02:11:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:47.238+0000 7f5846e00700 1 -- 172.21.15.2:0/2743484720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5840074fe0 msgr2=0x7f584019f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:47.238+0000 7f5846e00700 1 --2- 172.21.15.2:0/2743484720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5840074fe0 0x7f584019f790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f582c000c00 tx=0x7f582c00bab0 comp rx=0 tx=0).stop 2024-06-13T02:11:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:47.239+0000 7f5846e00700 1 -- 172.21.15.2:0/2743484720 shutdown_connections 2024-06-13T02:11:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:47.239+0000 7f5846e00700 1 --2- 172.21.15.2:0/2743484720 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f58240a2ca0 0x7f58240a5160 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:47.239+0000 7f5846e00700 1 --2- 172.21.15.2:0/2743484720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5840113660 0x7f58401a3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:47.239+0000 7f5846e00700 1 --2- 172.21.15.2:0/2743484720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58400746c0 0x7f584019f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:47.239+0000 7f5846e00700 1 --2- 172.21.15.2:0/2743484720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5840074fe0 0x7f584019f790 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:47.239+0000 7f5846e00700 1 -- 172.21.15.2:0/2743484720 >> 172.21.15.2:0/2743484720 conn(0x7f58400795f0 msgr2=0x7f5840112430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:47.239+0000 7f5846e00700 1 -- 172.21.15.2:0/2743484720 shutdown_connections 2024-06-13T02:11:47.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:47.239+0000 7f5846e00700 1 -- 172.21.15.2:0/2743484720 wait complete. 2024-06-13T02:11:47.330 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 3 2024-06-13T02:11:48.377 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:48 smithi002 ceph-mon[31960]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:48.377 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:48 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2743484720' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:11:48.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:48 smithi084 ceph-mon[36833]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:48.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:48 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2743484720' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:11:48.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:48 smithi175 ceph-mon[36977]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:48.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:48 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2743484720' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:11:49.130 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:11:48 smithi002 systemd[1]: Starting Ceph mds.j for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:11:49.381 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:11:49 smithi002 podman[69748]: 2024-06-13 02:11:49.033566621 +0000 UTC m=+0.034116755 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:11:49.381 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:11:49 smithi002 podman[69748]: 2024-06-13 02:11:49.150605342 +0000 UTC m=+0.151155509 container create 6db8fa3c9f76a197fe9e013cc0bbf4e7b1c6bfc2ebb4b960a88e1ac8faf0e06f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528) 2024-06-13T02:11:49.880 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:11:49 smithi002 podman[69748]: 2024-06-13 02:11:49.421864266 +0000 UTC m=+0.422414440 container init 6db8fa3c9f76a197fe9e013cc0bbf4e7b1c6bfc2ebb4b960a88e1ac8faf0e06f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc) 2024-06-13T02:11:49.881 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:11:49 smithi002 podman[69748]: 2024-06-13 02:11:49.432571758 +0000 UTC m=+0.433121945 container start 6db8fa3c9f76a197fe9e013cc0bbf4e7b1c6bfc2ebb4b960a88e1ac8faf0e06f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-j, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_CLEAN=True) 2024-06-13T02:11:49.881 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:11:49 smithi002 ceph-mds[69766]: -- 172.21.15.2:0/1683129456 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e0ebb37a40 con 0x55e0ebb0ac00 2024-06-13T02:11:49.881 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:11:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-j[69762]: starting mds.j at 2024-06-13T02:11:49.881 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:11:49 smithi002 bash[69748]: 6db8fa3c9f76a197fe9e013cc0bbf4e7b1c6bfc2ebb4b960a88e1ac8faf0e06f 2024-06-13T02:11:49.881 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:11:49 smithi002 systemd[1]: Started Ceph mds.j for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:11:50.428 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:11:50.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:50 smithi084 ceph-mon[36833]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:50.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:50 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:50.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:50 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:50.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:50 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:50.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:50 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:50.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:50 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:50.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:50 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:50.493 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:50 smithi002 ceph-mon[31960]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:50.493 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:50 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:50.493 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:50 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:50.493 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:50 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:50.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:50 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:50.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:50 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:50.494 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:50 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:50.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:50 smithi175 ceph-mon[36977]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:50.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:50 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:50 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:50 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:50 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:50 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:50 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:51.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:51 smithi002 ceph-mon[31960]: Deploying daemon mds.d on smithi002 2024-06-13T02:11:51.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:51 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.2:6834/206981148,v1:172.21.15.2:6835/206981148] up:boot 2024-06-13T02:11:51.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:51 smithi002 ceph-mon[31960]: fsmap 3 up:standby 2024-06-13T02:11:51.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:51 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-13T02:11:51.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:51 smithi084 ceph-mon[36833]: Deploying daemon mds.d on smithi002 2024-06-13T02:11:51.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:51 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.2:6834/206981148,v1:172.21.15.2:6835/206981148] up:boot 2024-06-13T02:11:51.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:51 smithi084 ceph-mon[36833]: fsmap 3 up:standby 2024-06-13T02:11:51.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:51 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-13T02:11:51.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:51 smithi175 ceph-mon[36977]: Deploying daemon mds.d on smithi002 2024-06-13T02:11:51.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:51 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.2:6834/206981148,v1:172.21.15.2:6835/206981148] up:boot 2024-06-13T02:11:51.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:51 smithi175 ceph-mon[36977]: fsmap 3 up:standby 2024-06-13T02:11:51.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:51 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-13T02:11:51.976 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:11:52.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:52 smithi002 ceph-mon[31960]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:52.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:52 smithi084 ceph-mon[36833]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:52.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:52 smithi175 ceph-mon[36977]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:53.070 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:11:52 smithi002 systemd[1]: Starting Ceph mds.d for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:11:53.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:53 smithi002 ceph-mon[31960]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:53.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:53 smithi084 ceph-mon[36833]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:53.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:53 smithi175 ceph-mon[36977]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:53.712 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:11:53 smithi002 podman[70145]: 2024-06-13 02:11:53.358015762 +0000 UTC m=+0.229800662 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:11:53.712 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:11:53 smithi002 podman[70145]: 2024-06-13 02:11:53.550641621 +0000 UTC m=+0.422426517 container create 17bbf117897870a9e86826802c301c7a1af5655dac673a6f8e019a25bb894d99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-d, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-06-13T02:11:54.113 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:11:53 smithi002 podman[70145]: 2024-06-13 02:11:53.819566853 +0000 UTC m=+0.691351753 container init 17bbf117897870a9e86826802c301c7a1af5655dac673a6f8e019a25bb894d99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-d, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T02:11:54.113 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:11:53 smithi002 podman[70145]: 2024-06-13 02:11:53.827901791 +0000 UTC m=+0.699686691 container start 17bbf117897870a9e86826802c301c7a1af5655dac673a6f8e019a25bb894d99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-d, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-06-13T02:11:54.113 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:11:53 smithi002 ceph-mds[70181]: -- 172.21.15.2:0/1405258747 <== mon.0 v2:172.21.15.2:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557059759a40 con 0x55705972cc00 2024-06-13T02:11:54.113 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:11:53 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-d[70163]: starting mds.d at 2024-06-13T02:11:54.113 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:11:53 smithi002 bash[70145]: 17bbf117897870a9e86826802c301c7a1af5655dac673a6f8e019a25bb894d99 2024-06-13T02:11:54.113 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:11:53 smithi002 systemd[1]: Started Ceph mds.d for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:11:54.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.595+0000 7efe8ae00700 1 -- 172.21.15.2:0/2263303364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe841045c0 msgr2=0x7efe84104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.595+0000 7efe8ae00700 1 --2- 172.21.15.2:0/2263303364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe841045c0 0x7efe84104a40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe70009990 tx=0x7efe70009ca0 comp rx=0 tx=0).stop 2024-06-13T02:11:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.595+0000 7efe8ae00700 1 -- 172.21.15.2:0/2263303364 shutdown_connections 2024-06-13T02:11:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.595+0000 7efe8ae00700 1 --2- 172.21.15.2:0/2263303364 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe84104f80 0x7efe84111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.595+0000 7efe8ae00700 1 --2- 172.21.15.2:0/2263303364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe8410a650 0x7efe8410aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.595+0000 7efe8ae00700 1 --2- 172.21.15.2:0/2263303364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe841045c0 0x7efe84104a40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.595+0000 7efe8ae00700 1 -- 172.21.15.2:0/2263303364 >> 172.21.15.2:0/2263303364 conn(0x7efe841000b0 msgr2=0x7efe841024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.595+0000 7efe8ae00700 1 -- 172.21.15.2:0/2263303364 shutdown_connections 2024-06-13T02:11:54.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.596+0000 7efe8ae00700 1 -- 172.21.15.2:0/2263303364 wait complete. 2024-06-13T02:11:54.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.597+0000 7efe8ae00700 1 Processor -- start 2024-06-13T02:11:54.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.597+0000 7efe8ae00700 1 -- start start 2024-06-13T02:11:54.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.598+0000 7efe8ae00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe841045c0 0x7efe841a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:54.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.598+0000 7efe8ae00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe84104f80 0x7efe841a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:54.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.598+0000 7efe8ae00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8410a650 0x7efe8419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:54.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.598+0000 7efe8ae00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efe84114960 con 0x7efe84104f80 2024-06-13T02:11:54.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.598+0000 7efe8ae00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efe841147e0 con 0x7efe8410a650 2024-06-13T02:11:54.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.598+0000 7efe8ae00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efe84114ae0 con 0x7efe841045c0 2024-06-13T02:11:54.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.598+0000 7efe89000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe84104f80 0x7efe841a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:54.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.598+0000 7efe89000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe84104f80 0x7efe841a0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32982/0 (socket says 172.21.15.2:32982) 2024-06-13T02:11:54.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.598+0000 7efe89000700 1 -- 172.21.15.2:0/2820733948 learned_addr learned my addr 172.21.15.2:0/2820733948 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:11:54.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.598+0000 7efe8a400700 1 --2- 172.21.15.2:0/2820733948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8410a650 0x7efe8419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:54.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.598+0000 7efe89a00700 1 --2- 172.21.15.2:0/2820733948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe841045c0 0x7efe841a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:54.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.599+0000 7efe89000700 1 -- 172.21.15.2:0/2820733948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe841045c0 msgr2=0x7efe841a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:54.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.599+0000 7efe89000700 1 --2- 172.21.15.2:0/2820733948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe841045c0 0x7efe841a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:54.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.599+0000 7efe89000700 1 -- 172.21.15.2:0/2820733948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8410a650 msgr2=0x7efe8419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:54.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.599+0000 7efe89000700 1 --2- 172.21.15.2:0/2820733948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8410a650 0x7efe8419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:54.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.599+0000 7efe89000700 1 -- 172.21.15.2:0/2820733948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8419b440 con 0x7efe84104f80 2024-06-13T02:11:54.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.599+0000 7efe8a400700 1 --2- 172.21.15.2:0/2820733948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8410a650 0x7efe8419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:11:54.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.599+0000 7efe89000700 1 --2- 172.21.15.2:0/2820733948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe84104f80 0x7efe841a0f80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efe70000c00 tx=0x7efe7000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:54.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.599+0000 7efe82000700 1 -- 172.21.15.2:0/2820733948 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70027070 con 0x7efe84104f80 2024-06-13T02:11:54.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.599+0000 7efe8ae00700 1 -- 172.21.15.2:0/2820733948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe8419b6d0 con 0x7efe84104f80 2024-06-13T02:11:54.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.599+0000 7efe82000700 1 -- 172.21.15.2:0/2820733948 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe700056d0 con 0x7efe84104f80 2024-06-13T02:11:54.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.600+0000 7efe82000700 1 -- 172.21.15.2:0/2820733948 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70022e10 con 0x7efe84104f80 2024-06-13T02:11:54.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.600+0000 7efe8ae00700 1 -- 172.21.15.2:0/2820733948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe841a77f0 con 0x7efe84104f80 2024-06-13T02:11:54.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.601+0000 7efe8ae00700 1 -- 172.21.15.2:0/2820733948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe84105d00 con 0x7efe84104f80 2024-06-13T02:11:54.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.603+0000 7efe82000700 1 -- 172.21.15.2:0/2820733948 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7efe7002a070 con 0x7efe84104f80 2024-06-13T02:11:54.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.604+0000 7efe82000700 1 --2- 172.21.15.2:0/2820733948 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7efe6c0a2c20 0x7efe6c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:11:54.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.604+0000 7efe82000700 1 -- 172.21.15.2:0/2820733948 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7efe700cfee0 con 0x7efe84104f80 2024-06-13T02:11:54.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.604+0000 7efe89a00700 1 --2- 172.21.15.2:0/2820733948 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7efe6c0a2c20 0x7efe6c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:11:54.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.605+0000 7efe89a00700 1 --2- 172.21.15.2:0/2820733948 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7efe6c0a2c20 0x7efe6c0a50e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efe84105700 tx=0x7efe78009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:11:54.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.607+0000 7efe82000700 1 -- 172.21.15.2:0/2820733948 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7efe70013070 con 0x7efe84104f80 2024-06-13T02:11:54.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.888+0000 7efe8ae00700 1 -- 172.21.15.2:0/2820733948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe8419bfd0 con 0x7efe84104f80 2024-06-13T02:11:54.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.889+0000 7efe82000700 1 -- 172.21.15.2:0/2820733948 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3862 (secure 0 0 0) 0x7efe7009d2d0 con 0x7efe84104f80 2024-06-13T02:11:54.890 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:11:54.890 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-06-13T02:11:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.893+0000 7efe8ae00700 1 -- 172.21.15.2:0/2820733948 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7efe6c0a2c20 msgr2=0x7efe6c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.893+0000 7efe8ae00700 1 --2- 172.21.15.2:0/2820733948 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7efe6c0a2c20 0x7efe6c0a50e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efe84105700 tx=0x7efe78009260 comp rx=0 tx=0).stop 2024-06-13T02:11:54.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.893+0000 7efe8ae00700 1 -- 172.21.15.2:0/2820733948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe84104f80 msgr2=0x7efe841a0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:11:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.893+0000 7efe8ae00700 1 --2- 172.21.15.2:0/2820733948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe84104f80 0x7efe841a0f80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efe70000c00 tx=0x7efe7000bab0 comp rx=0 tx=0).stop 2024-06-13T02:11:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.893+0000 7efe8ae00700 1 -- 172.21.15.2:0/2820733948 shutdown_connections 2024-06-13T02:11:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.893+0000 7efe8ae00700 1 --2- 172.21.15.2:0/2820733948 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7efe6c0a2c20 0x7efe6c0a50e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.893+0000 7efe8ae00700 1 --2- 172.21.15.2:0/2820733948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe8410a650 0x7efe8419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.893+0000 7efe8ae00700 1 --2- 172.21.15.2:0/2820733948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe841045c0 0x7efe841a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.893+0000 7efe8ae00700 1 --2- 172.21.15.2:0/2820733948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe84104f80 0x7efe841a0f80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:11:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.893+0000 7efe8ae00700 1 -- 172.21.15.2:0/2820733948 >> 172.21.15.2:0/2820733948 conn(0x7efe841000b0 msgr2=0x7efe84101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:11:54.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.894+0000 7efe8ae00700 1 -- 172.21.15.2:0/2820733948 shutdown_connections 2024-06-13T02:11:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:11:54.894+0000 7efe8ae00700 1 -- 172.21.15.2:0/2820733948 wait complete. 2024-06-13T02:11:54.895 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 5 2024-06-13T02:11:55.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:55 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:55.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:55 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:55.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:55 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:55.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:55 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:55.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:55 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:55.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:55 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:55.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:55 smithi002 ceph-mon[31960]: Deploying daemon mds.e on smithi084 2024-06-13T02:11:55.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:55 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.2:6836/3732907395,v1:172.21.15.2:6837/3732907395] up:boot 2024-06-13T02:11:55.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:55 smithi002 ceph-mon[31960]: fsmap 4 up:standby 2024-06-13T02:11:55.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:55 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-13T02:11:55.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:55 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2820733948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:11:55.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:55 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:55 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:55 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:55 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:55 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:55 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:55 smithi084 ceph-mon[36833]: Deploying daemon mds.e on smithi084 2024-06-13T02:11:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:55 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.2:6836/3732907395,v1:172.21.15.2:6837/3732907395] up:boot 2024-06-13T02:11:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:55 smithi084 ceph-mon[36833]: fsmap 4 up:standby 2024-06-13T02:11:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:55 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-13T02:11:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:55 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2820733948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:11:55.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:55 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:55.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:55 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:55.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:55 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:55.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:55 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:55.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:55 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:55.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:55 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:55.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:55 smithi175 ceph-mon[36977]: Deploying daemon mds.e on smithi084 2024-06-13T02:11:55.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:55 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.2:6836/3732907395,v1:172.21.15.2:6837/3732907395] up:boot 2024-06-13T02:11:55.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:55 smithi175 ceph-mon[36977]: fsmap 4 up:standby 2024-06-13T02:11:55.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:55 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-13T02:11:55.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:55 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2820733948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:11:56.335 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:56 smithi084 ceph-mon[36833]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:56.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:56 smithi002 ceph-mon[31960]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:56.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:56 smithi175 ceph-mon[36977]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:57.221 INFO:journalctl@ceph.mds.e.smithi084.stdout:Jun 13 02:11:56 smithi084 systemd[1]: Started Ceph mds.e for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:11:57.723 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:11:58.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:57 smithi002 ceph-mon[31960]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:58.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:57 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:58.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:57 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:58.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:57 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:58.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:57 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:58.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:57 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:58.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:57 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:58.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:57 smithi002 ceph-mon[31960]: Deploying daemon mds.f on smithi175 2024-06-13T02:11:58.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:57 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.84:6834/2403775181,v1:172.21.15.84:6835/2403775181] up:boot 2024-06-13T02:11:58.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:57 smithi002 ceph-mon[31960]: fsmap 5 up:standby 2024-06-13T02:11:58.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:57 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T02:11:58.167 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:11:58.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:57 smithi084 ceph-mon[36833]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:58.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:57 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:58.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:57 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:58.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:57 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:58.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:57 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:58.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:57 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:58.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:57 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:58.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:57 smithi084 ceph-mon[36833]: Deploying daemon mds.f on smithi175 2024-06-13T02:11:58.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:57 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.84:6834/2403775181,v1:172.21.15.84:6835/2403775181] up:boot 2024-06-13T02:11:58.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:57 smithi084 ceph-mon[36833]: fsmap 5 up:standby 2024-06-13T02:11:58.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:57 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T02:11:58.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:57 smithi175 ceph-mon[36977]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:11:58.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:57 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:58.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:57 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:58.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:57 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:11:58.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:57 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:11:58.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:57 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:11:58.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:57 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:11:58.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:57 smithi175 ceph-mon[36977]: Deploying daemon mds.f on smithi175 2024-06-13T02:11:58.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:57 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.84:6834/2403775181,v1:172.21.15.84:6835/2403775181] up:boot 2024-06-13T02:11:58.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:57 smithi175 ceph-mon[36977]: fsmap 5 up:standby 2024-06-13T02:11:58.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:57 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T02:11:59.283 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:11:59 smithi175 systemd[1]: Starting Ceph mds.f for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:11:59.661 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:11:59 smithi175 podman[66958]: 2024-06-13 02:11:59.290745644 +0000 UTC m=+0.017500785 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:11:59.661 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:11:59 smithi175 podman[66958]: 2024-06-13 02:11:59.428196119 +0000 UTC m=+0.154951255 container create e81e240329d363e794e15416092478f651245ba9c183046208f26b28495ba374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T02:11:59.661 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:11:59 smithi175 podman[66958]: 2024-06-13 02:11:59.66075649 +0000 UTC m=+0.387511627 container init e81e240329d363e794e15416092478f651245ba9c183046208f26b28495ba374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-06-13T02:11:59.964 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:11:59 smithi175 podman[66958]: 2024-06-13 02:11:59.663555117 +0000 UTC m=+0.390310266 container start e81e240329d363e794e15416092478f651245ba9c183046208f26b28495ba374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2) 2024-06-13T02:11:59.965 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:11:59 smithi175 ceph-mds[66977]: -- 172.21.15.175:0/641571614 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a5a5eeba40 con 0x55a5a5ebf000 2024-06-13T02:11:59.965 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:11:59 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-f[66973]: starting mds.f at 2024-06-13T02:11:59.965 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:11:59 smithi175 bash[66958]: e81e240329d363e794e15416092478f651245ba9c183046208f26b28495ba374 2024-06-13T02:11:59.965 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:11:59 smithi175 systemd[1]: Started Ceph mds.f for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:12:00.192 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:59 smithi002 ceph-mon[31960]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:00.193 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:59 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:00.193 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:59 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:00.193 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:59 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:00.193 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:59 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:00.193 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:59 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:00.193 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:11:59 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:00.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:59 smithi084 ceph-mon[36833]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:00.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:59 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:00.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:59 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:00.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:59 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:00.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:59 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:00.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:59 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:00.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:11:59 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:00.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:59 smithi175 ceph-mon[36977]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:00.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:59 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:00.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:59 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:00.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:59 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:00.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:59 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:00.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:59 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:00.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:11:59 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:00.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.463+0000 7f153ba00700 1 -- 172.21.15.2:0/1525632208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15340764c0 msgr2=0x7f15340746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:00.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.463+0000 7f153ba00700 1 --2- 172.21.15.2:0/1525632208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15340764c0 0x7f15340746c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1524009990 tx=0x7f1524009ca0 comp rx=0 tx=0).stop 2024-06-13T02:12:00.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.463+0000 7f153ba00700 1 -- 172.21.15.2:0/1525632208 shutdown_connections 2024-06-13T02:12:00.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.463+0000 7f153ba00700 1 --2- 172.21.15.2:0/1525632208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1534113120 0x7f1534115510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:00.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.463+0000 7f153ba00700 1 --2- 172.21.15.2:0/1525632208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15340764c0 0x7f15340746c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:00.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.463+0000 7f153ba00700 1 --2- 172.21.15.2:0/1525632208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1534074c00 0x7f1534075080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:00.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.463+0000 7f153ba00700 1 -- 172.21.15.2:0/1525632208 >> 172.21.15.2:0/1525632208 conn(0x7f1534079530 msgr2=0x7f1534079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:00.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.463+0000 7f153ba00700 1 -- 172.21.15.2:0/1525632208 shutdown_connections 2024-06-13T02:12:00.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.463+0000 7f153ba00700 1 -- 172.21.15.2:0/1525632208 wait complete. 2024-06-13T02:12:00.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.465+0000 7f153ba00700 1 Processor -- start 2024-06-13T02:12:00.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.465+0000 7f153ba00700 1 -- start start 2024-06-13T02:12:00.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.465+0000 7f153ba00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1534074c00 0x7f153419f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:00.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.466+0000 7f153ba00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15340764c0 0x7f153419f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:00.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.466+0000 7f153ba00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1534113120 0x7f15341a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:00.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.466+0000 7f153ba00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1534118dc0 con 0x7f1534074c00 2024-06-13T02:12:00.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.466+0000 7f153ba00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1534118c40 con 0x7f15340764c0 2024-06-13T02:12:00.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.466+0000 7f153ba00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1534118f40 con 0x7f1534113120 2024-06-13T02:12:00.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.466+0000 7f1539000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1534074c00 0x7f153419f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:00.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.466+0000 7f1539000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1534074c00 0x7f153419f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:32992/0 (socket says 172.21.15.2:32992) 2024-06-13T02:12:00.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.466+0000 7f1539000700 1 -- 172.21.15.2:0/1643472258 learned_addr learned my addr 172.21.15.2:0/1643472258 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:12:00.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.466+0000 7f152be00700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15340764c0 0x7f153419f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:00.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.466+0000 7f1539a00700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1534113120 0x7f15341a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:00.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.467+0000 7f152be00700 1 -- 172.21.15.2:0/1643472258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1534113120 msgr2=0x7f15341a3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:00.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.467+0000 7f152be00700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1534113120 0x7f15341a3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:00.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.467+0000 7f152be00700 1 -- 172.21.15.2:0/1643472258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1534074c00 msgr2=0x7f153419f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:00.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.467+0000 7f152be00700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1534074c00 0x7f153419f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:00.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.467+0000 7f152be00700 1 -- 172.21.15.2:0/1643472258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15341a4280 con 0x7f15340764c0 2024-06-13T02:12:00.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.467+0000 7f1539000700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1534074c00 0x7f153419f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:12:00.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.467+0000 7f1539a00700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1534113120 0x7f15341a3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:12:00.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.467+0000 7f152be00700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15340764c0 0x7f153419f7b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f151c00e9f0 tx=0x7f151c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:00.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.467+0000 7f1532000700 1 -- 172.21.15.2:0/1643472258 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c00c9c0 con 0x7f15340764c0 2024-06-13T02:12:00.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.467+0000 7f1532000700 1 -- 172.21.15.2:0/1643472258 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f151c00cb60 con 0x7f15340764c0 2024-06-13T02:12:00.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.467+0000 7f153ba00700 1 -- 172.21.15.2:0/1643472258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15341a4570 con 0x7f15340764c0 2024-06-13T02:12:00.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.467+0000 7f1532000700 1 -- 172.21.15.2:0/1643472258 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151c018680 con 0x7f15340764c0 2024-06-13T02:12:00.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.468+0000 7f153ba00700 1 -- 172.21.15.2:0/1643472258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15341abdf0 con 0x7f15340764c0 2024-06-13T02:12:00.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.469+0000 7f153ba00700 1 -- 172.21.15.2:0/1643472258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1534069180 con 0x7f15340764c0 2024-06-13T02:12:00.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.471+0000 7f1532000700 1 -- 172.21.15.2:0/1643472258 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f151c010430 con 0x7f15340764c0 2024-06-13T02:12:00.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.472+0000 7f1532000700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f15180a2c20 0x7f15180a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:00.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.472+0000 7f1532000700 1 -- 172.21.15.2:0/1643472258 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f151c0cf090 con 0x7f15340764c0 2024-06-13T02:12:00.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.472+0000 7f1539000700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f15180a2c20 0x7f15180a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:00.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.473+0000 7f1539000700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f15180a2c20 0x7f15180a50e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1524009750 tx=0x7f152400b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:00.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.474+0000 7f1532000700 1 -- 172.21.15.2:0/1643472258 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f151c09c3f0 con 0x7f15340764c0 2024-06-13T02:12:00.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.751+0000 7f153ba00700 1 -- 172.21.15.2:0/1643472258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15341abff0 con 0x7f15340764c0 2024-06-13T02:12:00.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.752+0000 7f1532000700 1 -- 172.21.15.2:0/1643472258 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5515 (secure 0 0 0) 0x7f151c09bcf0 con 0x7f15340764c0 2024-06-13T02:12:00.754 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:12:00.754 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1709394731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1709394731},{"type":"v1","addr":"172.21.15.175:6835","nonce":1709394731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/2403775181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2403775181},{"type":"v1","addr":"172.21.15.84:6835","nonce":2403775181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-06-13T02:12:00.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.757+0000 7f153ba00700 1 -- 172.21.15.2:0/1643472258 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f15180a2c20 msgr2=0x7f15180a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:00.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.757+0000 7f153ba00700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f15180a2c20 0x7f15180a50e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1524009750 tx=0x7f152400b280 comp rx=0 tx=0).stop 2024-06-13T02:12:00.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.757+0000 7f153ba00700 1 -- 172.21.15.2:0/1643472258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15340764c0 msgr2=0x7f153419f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:00.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.757+0000 7f153ba00700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15340764c0 0x7f153419f7b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f151c00e9f0 tx=0x7f151c00ed00 comp rx=0 tx=0).stop 2024-06-13T02:12:00.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.757+0000 7f153ba00700 1 -- 172.21.15.2:0/1643472258 shutdown_connections 2024-06-13T02:12:00.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.757+0000 7f153ba00700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f15180a2c20 0x7f15180a50e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:00.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.757+0000 7f153ba00700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1534113120 0x7f15341a3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:00.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.757+0000 7f153ba00700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1534074c00 0x7f153419f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:00.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.757+0000 7f153ba00700 1 --2- 172.21.15.2:0/1643472258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15340764c0 0x7f153419f7b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:00.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.757+0000 7f153ba00700 1 -- 172.21.15.2:0/1643472258 >> 172.21.15.2:0/1643472258 conn(0x7f1534079530 msgr2=0x7f1534111ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:00.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.757+0000 7f153ba00700 1 -- 172.21.15.2:0/1643472258 shutdown_connections 2024-06-13T02:12:00.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:00.757+0000 7f153ba00700 1 -- 172.21.15.2:0/1643472258 wait complete. 2024-06-13T02:12:00.760 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 7 2024-06-13T02:12:01.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:00 smithi002 ceph-mon[31960]: Deploying daemon mds.c on smithi175 2024-06-13T02:12:01.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:00 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.175:6834/1709394731,v1:172.21.15.175:6835/1709394731] up:boot 2024-06-13T02:12:01.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:00 smithi002 ceph-mon[31960]: fsmap 6 up:standby 2024-06-13T02:12:01.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:00 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-13T02:12:01.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:00 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1643472258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:12:01.153 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:00 smithi175 ceph-mon[36977]: Deploying daemon mds.c on smithi175 2024-06-13T02:12:01.153 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:00 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.175:6834/1709394731,v1:172.21.15.175:6835/1709394731] up:boot 2024-06-13T02:12:01.153 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:00 smithi175 ceph-mon[36977]: fsmap 6 up:standby 2024-06-13T02:12:01.153 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:00 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-13T02:12:01.153 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:00 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1643472258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:12:01.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:00 smithi084 ceph-mon[36833]: Deploying daemon mds.c on smithi175 2024-06-13T02:12:01.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:00 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.175:6834/1709394731,v1:172.21.15.175:6835/1709394731] up:boot 2024-06-13T02:12:01.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:00 smithi084 ceph-mon[36833]: fsmap 6 up:standby 2024-06-13T02:12:01.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:00 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-13T02:12:01.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:00 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1643472258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:12:02.270 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:01 smithi175 ceph-mon[36977]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:02.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:01 smithi002 ceph-mon[31960]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:02.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:01 smithi084 ceph-mon[36833]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:02.532 INFO:journalctl@ceph.mds.c.smithi175.stdout:Jun 13 02:12:02 smithi175 systemd[1]: Started Ceph mds.c for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:12:03.588 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:12:03.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:03 smithi002 ceph-mon[31960]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:03.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:03 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:03.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:03 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:03.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:03 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:03.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:03 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:03.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:03 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:03.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:03 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:03.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:03 smithi002 ceph-mon[31960]: Deploying daemon mds.h on smithi084 2024-06-13T02:12:03.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:03 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.175:6836/1446546569,v1:172.21.15.175:6837/1446546569] up:boot 2024-06-13T02:12:03.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:03 smithi002 ceph-mon[31960]: fsmap 7 up:standby 2024-06-13T02:12:03.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:03 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T02:12:03.952 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:03 smithi084 ceph-mon[36833]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:03.952 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:03 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:03.953 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:03 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:03.953 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:03 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:03.953 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:03 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:03.953 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:03 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:03.953 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:03 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:03.953 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:03 smithi084 ceph-mon[36833]: Deploying daemon mds.h on smithi084 2024-06-13T02:12:03.953 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:03 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.175:6836/1446546569,v1:172.21.15.175:6837/1446546569] up:boot 2024-06-13T02:12:03.953 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:03 smithi084 ceph-mon[36833]: fsmap 7 up:standby 2024-06-13T02:12:03.953 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:03 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T02:12:04.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:03 smithi175 ceph-mon[36977]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:04.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:03 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:04.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:03 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:04.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:03 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:04.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:03 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:04.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:03 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:04.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:03 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:04.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:03 smithi175 ceph-mon[36977]: Deploying daemon mds.h on smithi084 2024-06-13T02:12:04.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:03 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.175:6836/1446546569,v1:172.21.15.175:6837/1446546569] up:boot 2024-06-13T02:12:04.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:03 smithi175 ceph-mon[36977]: fsmap 7 up:standby 2024-06-13T02:12:04.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:03 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T02:12:04.069 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:12:04.910 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:12:04 smithi084 systemd[1]: Starting Ceph mds.h for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:12:05.176 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:12:04 smithi084 podman[66744]: 2024-06-13 02:12:04.812139573 +0000 UTC m=+0.017179887 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:12:05.176 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:12:04 smithi084 podman[66744]: 2024-06-13 02:12:04.923115348 +0000 UTC m=+0.128155690 container create fe5b048a23b10669cb2bd52aad21cab1593f36ad88700432ff2419591a0a7e2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T02:12:05.176 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:12:05 smithi084 podman[66744]: 2024-06-13 02:12:05.175854884 +0000 UTC m=+0.380895195 container init fe5b048a23b10669cb2bd52aad21cab1593f36ad88700432ff2419591a0a7e2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-06-13T02:12:05.470 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:12:05 smithi084 podman[66744]: 2024-06-13 02:12:05.178688454 +0000 UTC m=+0.383728757 container start fe5b048a23b10669cb2bd52aad21cab1593f36ad88700432ff2419591a0a7e2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-3d89acc) 2024-06-13T02:12:05.471 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:12:05 smithi084 ceph-mds[66763]: -- 172.21.15.84:0/3708412922 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aeafa01a40 con 0x55aeaf9d4800 2024-06-13T02:12:05.471 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:12:05 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: starting mds.h at 2024-06-13T02:12:05.471 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:12:05 smithi084 bash[66744]: fe5b048a23b10669cb2bd52aad21cab1593f36ad88700432ff2419591a0a7e2b 2024-06-13T02:12:05.471 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:12:05 smithi084 systemd[1]: Started Ceph mds.h for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:12:05.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:05 smithi002 ceph-mon[31960]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:05.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:05.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:05.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:05.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:05.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:05.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:05 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:05.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:05 smithi084 ceph-mon[36833]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:05.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:05.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:05.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:05.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:05.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:05.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:05 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:05 smithi175 ceph-mon[36977]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:06.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:06.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:05 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:06.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.413+0000 7fd907a00700 1 -- 172.21.15.2:0/2860725852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9001046b0 msgr2=0x7fd900104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:06.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.413+0000 7fd907a00700 1 --2- 172.21.15.2:0/2860725852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9001046b0 0x7fd900104b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009990 tx=0x7fd8ec009ca0 comp rx=0 tx=0).stop 2024-06-13T02:12:06.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.413+0000 7fd907a00700 1 -- 172.21.15.2:0/2860725852 shutdown_connections 2024-06-13T02:12:06.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.413+0000 7fd907a00700 1 --2- 172.21.15.2:0/2860725852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd900105070 0x7fd900111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:06.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.413+0000 7fd907a00700 1 --2- 172.21.15.2:0/2860725852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd90010a6b0 0x7fd90010aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:06.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.413+0000 7fd907a00700 1 --2- 172.21.15.2:0/2860725852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd9001046b0 0x7fd900104b30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:06.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.413+0000 7fd907a00700 1 -- 172.21.15.2:0/2860725852 >> 172.21.15.2:0/2860725852 conn(0x7fd9001001a0 msgr2=0x7fd9001025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:06.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.413+0000 7fd907a00700 1 -- 172.21.15.2:0/2860725852 shutdown_connections 2024-06-13T02:12:06.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.413+0000 7fd907a00700 1 -- 172.21.15.2:0/2860725852 wait complete. 2024-06-13T02:12:06.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.414+0000 7fd907a00700 1 Processor -- start 2024-06-13T02:12:06.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.414+0000 7fd907a00700 1 -- start start 2024-06-13T02:12:06.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.415+0000 7fd907a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9001046b0 0x7fd90019aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:06.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.415+0000 7fd907a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd900105070 0x7fd90019b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:06.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.415+0000 7fd907a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd90010a6b0 0x7fd90019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:06.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.415+0000 7fd907a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd900114a90 con 0x7fd900105070 2024-06-13T02:12:06.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.415+0000 7fd907a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd900114910 con 0x7fd9001046b0 2024-06-13T02:12:06.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.415+0000 7fd907a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd900114c10 con 0x7fd90010a6b0 2024-06-13T02:12:06.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.415+0000 7fd905000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9001046b0 0x7fd90019aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:06.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.415+0000 7fd8ffe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd900105070 0x7fd90019b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:06.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.415+0000 7fd905000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9001046b0 0x7fd90019aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:57190/0 (socket says 172.21.15.2:57190) 2024-06-13T02:12:06.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.415+0000 7fd905000700 1 -- 172.21.15.2:0/3080014270 learned_addr learned my addr 172.21.15.2:0/3080014270 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:12:06.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.415+0000 7fd905a00700 1 --2- 172.21.15.2:0/3080014270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd90010a6b0 0x7fd90019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:06.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.416+0000 7fd905000700 1 -- 172.21.15.2:0/3080014270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd90010a6b0 msgr2=0x7fd90019f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:06.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.416+0000 7fd905000700 1 --2- 172.21.15.2:0/3080014270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd90010a6b0 0x7fd90019f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:06.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.416+0000 7fd905000700 1 -- 172.21.15.2:0/3080014270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd900105070 msgr2=0x7fd90019b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:06.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.416+0000 7fd905000700 1 --2- 172.21.15.2:0/3080014270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd900105070 0x7fd90019b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:06.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.416+0000 7fd905000700 1 -- 172.21.15.2:0/3080014270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90019fe80 con 0x7fd9001046b0 2024-06-13T02:12:06.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.416+0000 7fd8ffe00700 1 --2- 172.21.15.2:0/3080014270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd900105070 0x7fd90019b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:12:06.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.416+0000 7fd905000700 1 --2- 172.21.15.2:0/3080014270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9001046b0 0x7fd90019aec0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400e9a0 tx=0x7fd8f400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:06.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.416+0000 7fd8fd600700 1 -- 172.21.15.2:0/3080014270 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f400ca10 con 0x7fd9001046b0 2024-06-13T02:12:06.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.416+0000 7fd907a00700 1 -- 172.21.15.2:0/3080014270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9001a0170 con 0x7fd9001046b0 2024-06-13T02:12:06.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.416+0000 7fd8fd600700 1 -- 172.21.15.2:0/3080014270 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8f400cbb0 con 0x7fd9001046b0 2024-06-13T02:12:06.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.416+0000 7fd8fd600700 1 -- 172.21.15.2:0/3080014270 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4018680 con 0x7fd9001046b0 2024-06-13T02:12:06.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.416+0000 7fd907a00700 1 -- 172.21.15.2:0/3080014270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9001a79f0 con 0x7fd9001046b0 2024-06-13T02:12:06.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.417+0000 7fd907a00700 1 -- 172.21.15.2:0/3080014270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd900069180 con 0x7fd9001046b0 2024-06-13T02:12:06.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.420+0000 7fd8fd600700 1 -- 172.21.15.2:0/3080014270 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fd8f4010430 con 0x7fd9001046b0 2024-06-13T02:12:06.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.421+0000 7fd8fd600700 1 --2- 172.21.15.2:0/3080014270 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8e80a2c20 0x7fd8e80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:06.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.421+0000 7fd8fd600700 1 -- 172.21.15.2:0/3080014270 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fd8f40cf250 con 0x7fd9001046b0 2024-06-13T02:12:06.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.421+0000 7fd8ffe00700 1 --2- 172.21.15.2:0/3080014270 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8e80a2c20 0x7fd8e80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:06.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.422+0000 7fd8ffe00700 1 --2- 172.21.15.2:0/3080014270 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8e80a2c20 0x7fd8e80a50e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd900102750 tx=0x7fd8ec005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:06.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.423+0000 7fd8fd600700 1 -- 172.21.15.2:0/3080014270 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd8f409c5b0 con 0x7fd9001046b0 2024-06-13T02:12:06.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.698+0000 7fd907a00700 1 -- 172.21.15.2:0/3080014270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd90019c1d0 con 0x7fd9001046b0 2024-06-13T02:12:06.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.699+0000 7fd8fd600700 1 -- 172.21.15.2:0/3080014270 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7168 (secure 0 0 0) 0x7fd8f409beb0 con 0x7fd9001046b0 2024-06-13T02:12:06.701 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:12:06.701 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1709394731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1709394731},{"type":"v1","addr":"172.21.15.175:6835","nonce":1709394731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/2403775181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2403775181},{"type":"v1","addr":"172.21.15.84:6835","nonce":2403775181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1446546569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1446546569},{"type":"v1","addr":"172.21.15.175:6837","nonce":1446546569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2537381027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2537381027},{"type":"v1","addr":"172.21.15.84:6837","nonce":2537381027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-06-13T02:12:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.702+0000 7fd907a00700 1 -- 172.21.15.2:0/3080014270 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8e80a2c20 msgr2=0x7fd8e80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.702+0000 7fd907a00700 1 --2- 172.21.15.2:0/3080014270 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8e80a2c20 0x7fd8e80a50e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd900102750 tx=0x7fd8ec005fd0 comp rx=0 tx=0).stop 2024-06-13T02:12:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.702+0000 7fd907a00700 1 -- 172.21.15.2:0/3080014270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9001046b0 msgr2=0x7fd90019aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.702+0000 7fd907a00700 1 --2- 172.21.15.2:0/3080014270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9001046b0 0x7fd90019aec0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400e9a0 tx=0x7fd8f400ecb0 comp rx=0 tx=0).stop 2024-06-13T02:12:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.702+0000 7fd907a00700 1 -- 172.21.15.2:0/3080014270 shutdown_connections 2024-06-13T02:12:06.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.702+0000 7fd907a00700 1 --2- 172.21.15.2:0/3080014270 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8e80a2c20 0x7fd8e80a50e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.702+0000 7fd907a00700 1 --2- 172.21.15.2:0/3080014270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd90010a6b0 0x7fd90019f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.702+0000 7fd907a00700 1 --2- 172.21.15.2:0/3080014270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9001046b0 0x7fd90019aec0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.703+0000 7fd907a00700 1 --2- 172.21.15.2:0/3080014270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd900105070 0x7fd90019b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.703+0000 7fd907a00700 1 -- 172.21.15.2:0/3080014270 >> 172.21.15.2:0/3080014270 conn(0x7fd9001001a0 msgr2=0x7fd900100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.703+0000 7fd907a00700 1 -- 172.21.15.2:0/3080014270 shutdown_connections 2024-06-13T02:12:06.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:06.703+0000 7fd907a00700 1 -- 172.21.15.2:0/3080014270 wait complete. 2024-06-13T02:12:06.706 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 9 2024-06-13T02:12:06.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:06 smithi175 ceph-mon[36977]: Deploying daemon mds.i on smithi175 2024-06-13T02:12:06.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:06 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.84:6836/2537381027,v1:172.21.15.84:6837/2537381027] up:boot 2024-06-13T02:12:06.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:06 smithi175 ceph-mon[36977]: fsmap 8 up:standby 2024-06-13T02:12:06.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:06 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:12:06.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:06 smithi002 ceph-mon[31960]: Deploying daemon mds.i on smithi175 2024-06-13T02:12:06.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:06 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.84:6836/2537381027,v1:172.21.15.84:6837/2537381027] up:boot 2024-06-13T02:12:06.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:06 smithi002 ceph-mon[31960]: fsmap 8 up:standby 2024-06-13T02:12:06.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:06 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:12:06.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:06 smithi084 ceph-mon[36833]: Deploying daemon mds.i on smithi175 2024-06-13T02:12:06.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:06 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.84:6836/2537381027,v1:172.21.15.84:6837/2537381027] up:boot 2024-06-13T02:12:06.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:06 smithi084 ceph-mon[36833]: fsmap 8 up:standby 2024-06-13T02:12:06.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:06 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:12:07.758 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:07 smithi175 ceph-mon[36977]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:07.758 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:07 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3080014270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:12:07.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:07 smithi002 ceph-mon[31960]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:07.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:07 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3080014270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:12:07.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:07 smithi084 ceph-mon[36833]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:07.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:07 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3080014270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:12:08.033 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:12:07 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-i[67580]: starting mds.i at 2024-06-13T02:12:08.532 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:12:08 smithi175 bash[67565]: 722ce890b28942936af8b5007dcd541266abb3c0d4f5aa31731a1ab6db777e93 2024-06-13T02:12:08.533 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:12:08 smithi175 systemd[1]: Started Ceph mds.i for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:12:09.355 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:09.355 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:09.355 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:09.355 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:09.356 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:09.356 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:09.356 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:09 smithi175 ceph-mon[36977]: Deploying daemon mds.g on smithi002 2024-06-13T02:12:09.356 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:09 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] up:boot 2024-06-13T02:12:09.356 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:09 smithi175 ceph-mon[36977]: fsmap 9 up:standby 2024-06-13T02:12:09.356 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:09 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T02:12:09.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:09.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:09.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:09.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:09.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:09.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:09.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:09 smithi002 ceph-mon[31960]: Deploying daemon mds.g on smithi002 2024-06-13T02:12:09.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:09 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] up:boot 2024-06-13T02:12:09.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:09 smithi002 ceph-mon[31960]: fsmap 9 up:standby 2024-06-13T02:12:09.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:09 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T02:12:09.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:09.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:09.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:09.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:09.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:09.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:09.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:09 smithi084 ceph-mon[36833]: Deploying daemon mds.g on smithi002 2024-06-13T02:12:09.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:09 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] up:boot 2024-06-13T02:12:09.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:09 smithi084 ceph-mon[36833]: fsmap 9 up:standby 2024-06-13T02:12:09.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:09 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T02:12:09.638 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:12:10.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:10 smithi002 ceph-mon[31960]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:10.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:10 smithi084 ceph-mon[36833]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:10.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:10 smithi175 ceph-mon[36977]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:10.559 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:12:11.631 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:12:11 smithi002 systemd[1]: Starting Ceph mds.g for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:12:12.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:12 smithi002 ceph-mon[31960]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:12.381 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:12:12 smithi002 podman[70926]: 2024-06-13 02:12:12.091220087 +0000 UTC m=+0.036922299 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:12:12.381 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:12:12 smithi002 podman[70926]: 2024-06-13 02:12:12.216686487 +0000 UTC m=+0.162388739 container create 2504394209ed9995ea607ae17bb9e530edf632fde676e49bf3d4410cce2df6ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-06-13T02:12:12.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:12 smithi084 ceph-mon[36833]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:12.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:12 smithi175 ceph-mon[36977]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:12.992 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:12:12 smithi002 podman[70926]: 2024-06-13 02:12:12.778672332 +0000 UTC m=+0.724374605 container init 2504394209ed9995ea607ae17bb9e530edf632fde676e49bf3d4410cce2df6ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-g, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-06-13T02:12:12.993 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:12:12 smithi002 podman[70926]: 2024-06-13 02:12:12.790845258 +0000 UTC m=+0.736547514 container start 2504394209ed9995ea607ae17bb9e530edf632fde676e49bf3d4410cce2df6ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240528) 2024-06-13T02:12:12.993 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:12:12 smithi002 ceph-mds[70967]: -- 172.21.15.2:0/2406079596 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5585c9cc9a40 con 0x5585c9c9d000 2024-06-13T02:12:12.993 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:12:12 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-g[70955]: starting mds.g at 2024-06-13T02:12:13.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.054+0000 7fa070200700 1 -- 172.21.15.2:0/3446328615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa06806a170 msgr2=0x7fa06806a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:13.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.054+0000 7fa070200700 1 --2- 172.21.15.2:0/3446328615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa06806a170 0x7fa06806a5f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa054009990 tx=0x7fa054009ca0 comp rx=0 tx=0).stop 2024-06-13T02:12:13.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.054+0000 7fa070200700 1 -- 172.21.15.2:0/3446328615 shutdown_connections 2024-06-13T02:12:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.054+0000 7fa070200700 1 --2- 172.21.15.2:0/3446328615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa06806ab30 0x7fa06810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.054+0000 7fa070200700 1 --2- 172.21.15.2:0/3446328615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa068108500 0x7fa0681088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.054+0000 7fa070200700 1 --2- 172.21.15.2:0/3446328615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa06806a170 0x7fa06806a5f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.054+0000 7fa070200700 1 -- 172.21.15.2:0/3446328615 >> 172.21.15.2:0/3446328615 conn(0x7fa068078340 msgr2=0x7fa068078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.054+0000 7fa070200700 1 -- 172.21.15.2:0/3446328615 shutdown_connections 2024-06-13T02:12:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.054+0000 7fa070200700 1 -- 172.21.15.2:0/3446328615 wait complete. 2024-06-13T02:12:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.055+0000 7fa070200700 1 Processor -- start 2024-06-13T02:12:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.056+0000 7fa070200700 1 -- start start 2024-06-13T02:12:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.056+0000 7fa070200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa06806a170 0x7fa068101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.056+0000 7fa070200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa06806ab30 0x7fa0681019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:13.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.056+0000 7fa070200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa068108500 0x7fa068101ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:13.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.056+0000 7fa070200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa0681127b0 con 0x7fa068108500 2024-06-13T02:12:13.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.056+0000 7fa070200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa068112630 con 0x7fa06806a170 2024-06-13T02:12:13.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.056+0000 7fa070200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa068112930 con 0x7fa06806ab30 2024-06-13T02:12:13.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.056+0000 7fa06ce00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa06806ab30 0x7fa0681019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:13.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.056+0000 7fa06d800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa06806a170 0x7fa068101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:13.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.056+0000 7fa06ce00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa06806ab30 0x7fa0681019a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:38830/0 (socket says 172.21.15.2:38830) 2024-06-13T02:12:13.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.056+0000 7fa06ce00700 1 -- 172.21.15.2:0/637777701 learned_addr learned my addr 172.21.15.2:0/637777701 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:12:13.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.057+0000 7fa06ce00700 1 -- 172.21.15.2:0/637777701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa06806a170 msgr2=0x7fa068101460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:13.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.057+0000 7fa06ce00700 1 --2- 172.21.15.2:0/637777701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa06806a170 0x7fa068101460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:13.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.057+0000 7fa06ce00700 1 -- 172.21.15.2:0/637777701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa068108500 msgr2=0x7fa068101ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T02:12:13.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.057+0000 7fa06ce00700 1 --2- 172.21.15.2:0/637777701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa068108500 0x7fa068101ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:13.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.057+0000 7fa06ce00700 1 -- 172.21.15.2:0/637777701 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0681a71d0 con 0x7fa06806ab30 2024-06-13T02:12:13.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.057+0000 7fa06ce00700 1 --2- 172.21.15.2:0/637777701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa06806ab30 0x7fa0681019a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa054000c00 tx=0x7fa05400bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:13.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.057+0000 7fa066000700 1 -- 172.21.15.2:0/637777701 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054027070 con 0x7fa06806ab30 2024-06-13T02:12:13.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.057+0000 7fa066000700 1 -- 172.21.15.2:0/637777701 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa054003d70 con 0x7fa06806ab30 2024-06-13T02:12:13.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.057+0000 7fa066000700 1 -- 172.21.15.2:0/637777701 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05400f460 con 0x7fa06806ab30 2024-06-13T02:12:13.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.057+0000 7fa070200700 1 -- 172.21.15.2:0/637777701 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0681a7460 con 0x7fa06806ab30 2024-06-13T02:12:13.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.058+0000 7fa070200700 1 -- 172.21.15.2:0/637777701 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0681a7860 con 0x7fa06806ab30 2024-06-13T02:12:13.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.059+0000 7fa070200700 1 -- 172.21.15.2:0/637777701 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa068069180 con 0x7fa06806ab30 2024-06-13T02:12:13.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.061+0000 7fa066000700 1 -- 172.21.15.2:0/637777701 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fa05402a070 con 0x7fa06806ab30 2024-06-13T02:12:13.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.062+0000 7fa066000700 1 --2- 172.21.15.2:0/637777701 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa0500a2ca0 0x7fa0500a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:13.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.062+0000 7fa066000700 1 -- 172.21.15.2:0/637777701 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fa0540d0210 con 0x7fa06806ab30 2024-06-13T02:12:13.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.063+0000 7fa06d800700 1 --2- 172.21.15.2:0/637777701 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa0500a2ca0 0x7fa0500a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:13.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.063+0000 7fa06d800700 1 --2- 172.21.15.2:0/637777701 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa0500a2ca0 0x7fa0500a5160 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00f540 tx=0x7fa05c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:13.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.065+0000 7fa066000700 1 -- 172.21.15.2:0/637777701 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa054013070 con 0x7fa06806ab30 2024-06-13T02:12:13.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.360+0000 7fa070200700 1 -- 172.21.15.2:0/637777701 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa06802dd40 con 0x7fa06806ab30 2024-06-13T02:12:13.362 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:12:12 smithi002 bash[70926]: 2504394209ed9995ea607ae17bb9e530edf632fde676e49bf3d4410cce2df6ec 2024-06-13T02:12:13.362 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:12:13 smithi002 systemd[1]: Started Ceph mds.g for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:12:13.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.361+0000 7fa066000700 1 -- 172.21.15.2:0/637777701 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8821 (secure 0 0 0) 0x7fa05409d600 con 0x7fa06806ab30 2024-06-13T02:12:13.363 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:12:13.363 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1709394731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1709394731},{"type":"v1","addr":"172.21.15.175:6835","nonce":1709394731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/2403775181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2403775181},{"type":"v1","addr":"172.21.15.84:6835","nonce":2403775181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1446546569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1446546569},{"type":"v1","addr":"172.21.15.175:6837","nonce":1446546569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2537381027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2537381027},{"type":"v1","addr":"172.21.15.84:6837","nonce":2537381027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/2743442301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":2743442301},{"type":"v1","addr":"172.21.15.175:6839","nonce":2743442301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24503,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3208917373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3208917373},{"type":"v1","addr":"172.21.15.2:6839","nonce":3208917373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-06-13T02:12:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.365+0000 7fa070200700 1 -- 172.21.15.2:0/637777701 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa0500a2ca0 msgr2=0x7fa0500a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.365+0000 7fa070200700 1 --2- 172.21.15.2:0/637777701 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa0500a2ca0 0x7fa0500a5160 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00f540 tx=0x7fa05c00b040 comp rx=0 tx=0).stop 2024-06-13T02:12:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.365+0000 7fa070200700 1 -- 172.21.15.2:0/637777701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa06806ab30 msgr2=0x7fa0681019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.365+0000 7fa070200700 1 --2- 172.21.15.2:0/637777701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa06806ab30 0x7fa0681019a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa054000c00 tx=0x7fa05400bab0 comp rx=0 tx=0).stop 2024-06-13T02:12:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.365+0000 7fa070200700 1 -- 172.21.15.2:0/637777701 shutdown_connections 2024-06-13T02:12:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.365+0000 7fa070200700 1 --2- 172.21.15.2:0/637777701 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa0500a2ca0 0x7fa0500a5160 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00f540 tx=0x7fa05c00b040 comp rx=0 tx=0).stop 2024-06-13T02:12:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.365+0000 7fa070200700 1 --2- 172.21.15.2:0/637777701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa068108500 0x7fa068101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.365+0000 7fa070200700 1 --2- 172.21.15.2:0/637777701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa06806a170 0x7fa068101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:13.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.365+0000 7fa070200700 1 --2- 172.21.15.2:0/637777701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa06806ab30 0x7fa0681019a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.365+0000 7fa070200700 1 -- 172.21.15.2:0/637777701 >> 172.21.15.2:0/637777701 conn(0x7fa068078340 msgr2=0x7fa068100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.366+0000 7fa070200700 1 -- 172.21.15.2:0/637777701 shutdown_connections 2024-06-13T02:12:13.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:13.366+0000 7fa070200700 1 -- 172.21.15.2:0/637777701 wait complete. 2024-06-13T02:12:13.369 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 11 2024-06-13T02:12:14.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:14 smithi002 ceph-mon[31960]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:14.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:14 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:14.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:14 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:14.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:14 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:14.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:14 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:14.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:14 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:14.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:14 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:14.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:14 smithi002 ceph-mon[31960]: Deploying daemon mds.a on smithi002 2024-06-13T02:12:14.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:14 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] up:boot 2024-06-13T02:12:14.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:14 smithi002 ceph-mon[31960]: fsmap 10 up:standby 2024-06-13T02:12:14.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:14 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-13T02:12:14.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:14 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/637777701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:12:14.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:14 smithi084 ceph-mon[36833]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:14.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:14 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:14.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:14 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:14.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:14 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:14.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:14 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:14.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:14 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:14.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:14 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:14.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:14 smithi084 ceph-mon[36833]: Deploying daemon mds.a on smithi002 2024-06-13T02:12:14.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:14 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] up:boot 2024-06-13T02:12:14.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:14 smithi084 ceph-mon[36833]: fsmap 10 up:standby 2024-06-13T02:12:14.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:14 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-13T02:12:14.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:14 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/637777701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:12:14.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:14 smithi175 ceph-mon[36977]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:14.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:14 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:14.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:14 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:14.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:14 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:14.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:14 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:14.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:14 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:14.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:14 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:14.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:14 smithi175 ceph-mon[36977]: Deploying daemon mds.a on smithi002 2024-06-13T02:12:14.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:14 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] up:boot 2024-06-13T02:12:14.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:14 smithi175 ceph-mon[36977]: fsmap 10 up:standby 2024-06-13T02:12:14.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:14 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-13T02:12:14.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:14 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/637777701' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:12:16.329 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:12:16.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:16 smithi002 ceph-mon[31960]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:16.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:16 smithi084 ceph-mon[36833]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:16.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:16 smithi175 ceph-mon[36977]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:16.820 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:12:16 smithi002 systemd[1]: Starting Ceph mds.a for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:12:17.108 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:12:16 smithi002 podman[71320]: 2024-06-13 02:12:16.723885887 +0000 UTC m=+0.042628287 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:12:17.108 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:12:16 smithi002 podman[71320]: 2024-06-13 02:12:16.832154401 +0000 UTC m=+0.150896785 container create 50d50d5421ccc17e0c6b62326ed4f8151f97452de564e734eb5f0284867c5009 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-a, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-06-13T02:12:17.108 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:12:17 smithi002 podman[71320]: 2024-06-13 02:12:17.107071389 +0000 UTC m=+0.425813814 container init 50d50d5421ccc17e0c6b62326ed4f8151f97452de564e734eb5f0284867c5009 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-13T02:12:17.250 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:12:17.381 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:12:17 smithi002 podman[71320]: 2024-06-13 02:12:17.12017617 +0000 UTC m=+0.438918579 container start 50d50d5421ccc17e0c6b62326ed4f8151f97452de564e734eb5f0284867c5009 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc) 2024-06-13T02:12:17.381 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:12:17 smithi002 ceph-mds[71365]: -- 172.21.15.2:0/509970131 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56133d52ba40 con 0x56133d4fec00 2024-06-13T02:12:17.381 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:12:17 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-a[71361]: starting mds.a at 2024-06-13T02:12:17.381 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:12:17 smithi002 bash[71320]: 50d50d5421ccc17e0c6b62326ed4f8151f97452de564e734eb5f0284867c5009 2024-06-13T02:12:17.381 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:12:17 smithi002 systemd[1]: Started Ceph mds.a for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:12:18.362 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:18 smithi084 ceph-mon[36833]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:18.362 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:18 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:18.362 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:18 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:18.363 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:18 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:18.363 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:18 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:18.363 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:18 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:18.363 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:18 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:18.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:18 smithi002 ceph-mon[31960]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:18.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:18 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:18.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:18 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:18.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:18 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:18.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:18 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:18.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:18 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:18.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:18 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:18.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:18 smithi175 ceph-mon[36977]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:18.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:18 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:18.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:18 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:18.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:18 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:18.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:18 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-13T02:12:18.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:18 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-13T02:12:18.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:18 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:19.215 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:19 smithi002 ceph-mon[31960]: Deploying daemon mds.b on smithi084 2024-06-13T02:12:19.215 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:19 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.2:6840/3458450195,v1:172.21.15.2:6841/3458450195] up:boot 2024-06-13T02:12:19.216 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:19 smithi002 ceph-mon[31960]: fsmap 11 up:standby 2024-06-13T02:12:19.216 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:19 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-13T02:12:19.286 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:19 smithi084 ceph-mon[36833]: Deploying daemon mds.b on smithi084 2024-06-13T02:12:19.287 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:19 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.2:6840/3458450195,v1:172.21.15.2:6841/3458450195] up:boot 2024-06-13T02:12:19.287 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:19 smithi084 ceph-mon[36833]: fsmap 11 up:standby 2024-06-13T02:12:19.287 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:19 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-13T02:12:19.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:19 smithi175 ceph-mon[36977]: Deploying daemon mds.b on smithi084 2024-06-13T02:12:19.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:19 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.2:6840/3458450195,v1:172.21.15.2:6841/3458450195] up:boot 2024-06-13T02:12:19.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:19 smithi175 ceph-mon[36977]: fsmap 11 up:standby 2024-06-13T02:12:19.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:19 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-13T02:12:19.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.540+0000 7f389f200700 1 -- 172.21.15.2:0/1452710633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a01076e0 msgr2=0x7f38a010f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:19.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.540+0000 7f389f200700 1 --2- 172.21.15.2:0/1452710633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a01076e0 0x7f38a010f2b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f389800b0a0 tx=0x7f389800b3b0 comp rx=0 tx=0).stop 2024-06-13T02:12:19.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.540+0000 7f389f200700 1 -- 172.21.15.2:0/1452710633 shutdown_connections 2024-06-13T02:12:19.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.540+0000 7f389f200700 1 --2- 172.21.15.2:0/1452710633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a01076e0 0x7f38a010f2b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:19.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.540+0000 7f389f200700 1 --2- 172.21.15.2:0/1452710633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38a0102600 0x7f38a01029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:19.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.540+0000 7f389f200700 1 --2- 172.21.15.2:0/1452710633 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38a0102fb0 0x7f38a0107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:19.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.540+0000 7f389f200700 1 -- 172.21.15.2:0/1452710633 >> 172.21.15.2:0/1452710633 conn(0x7f38a00fdeb0 msgr2=0x7f38a01002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:19.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.541+0000 7f389f200700 1 -- 172.21.15.2:0/1452710633 shutdown_connections 2024-06-13T02:12:19.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.541+0000 7f389f200700 1 -- 172.21.15.2:0/1452710633 wait complete. 2024-06-13T02:12:19.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.542+0000 7f389f200700 1 Processor -- start 2024-06-13T02:12:19.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.542+0000 7f389f200700 1 -- start start 2024-06-13T02:12:19.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.543+0000 7f389f200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38a0102600 0x7f38a019e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:19.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.543+0000 7f389f200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38a0102fb0 0x7f38a019ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:19.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.543+0000 7f389f200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a01076e0 0x7f38a0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:19.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.543+0000 7f389f200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f38a0112720 con 0x7f38a0102600 2024-06-13T02:12:19.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.543+0000 7f389f200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f38a01125a0 con 0x7f38a01076e0 2024-06-13T02:12:19.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.543+0000 7f389f200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f38a01128a0 con 0x7f38a0102fb0 2024-06-13T02:12:19.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.543+0000 7f389e800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a01076e0 0x7f38a0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:19.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.543+0000 7f389de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38a0102600 0x7f38a019e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:19.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.543+0000 7f389e800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a01076e0 0x7f38a0198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36196/0 (socket says 172.21.15.2:36196) 2024-06-13T02:12:19.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.543+0000 7f389e800700 1 -- 172.21.15.2:0/2894942070 learned_addr learned my addr 172.21.15.2:0/2894942070 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:12:19.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.543+0000 7f389d400700 1 --2- 172.21.15.2:0/2894942070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38a0102fb0 0x7f38a019ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:19.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.544+0000 7f389e800700 1 -- 172.21.15.2:0/2894942070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38a0102fb0 msgr2=0x7f38a019ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:19.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.544+0000 7f389e800700 1 --2- 172.21.15.2:0/2894942070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38a0102fb0 0x7f38a019ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:19.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.544+0000 7f389e800700 1 -- 172.21.15.2:0/2894942070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38a0102600 msgr2=0x7f38a019e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:19.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.544+0000 7f389e800700 1 --2- 172.21.15.2:0/2894942070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38a0102600 0x7f38a019e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:19.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.544+0000 7f389e800700 1 -- 172.21.15.2:0/2894942070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a01990e0 con 0x7f38a01076e0 2024-06-13T02:12:19.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.544+0000 7f389d400700 1 --2- 172.21.15.2:0/2894942070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38a0102fb0 0x7f38a019ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:12:19.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.544+0000 7f389e800700 1 --2- 172.21.15.2:0/2894942070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a01076e0 0x7f38a0198980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3898006070 tx=0x7f3898004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:19.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.544+0000 7f3896a00700 1 -- 172.21.15.2:0/2894942070 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898021070 con 0x7f38a01076e0 2024-06-13T02:12:19.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.544+0000 7f3896a00700 1 -- 172.21.15.2:0/2894942070 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3898003c00 con 0x7f38a01076e0 2024-06-13T02:12:19.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.544+0000 7f389f200700 1 -- 172.21.15.2:0/2894942070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a0199370 con 0x7f38a01076e0 2024-06-13T02:12:19.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.544+0000 7f3896a00700 1 -- 172.21.15.2:0/2894942070 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38980047d0 con 0x7f38a01076e0 2024-06-13T02:12:19.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.545+0000 7f389f200700 1 -- 172.21.15.2:0/2894942070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a01a5640 con 0x7f38a01076e0 2024-06-13T02:12:19.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.546+0000 7f389f200700 1 -- 172.21.15.2:0/2894942070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38a0069180 con 0x7f38a01076e0 2024-06-13T02:12:19.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.548+0000 7f3896a00700 1 -- 172.21.15.2:0/2894942070 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f3898007980 con 0x7f38a01076e0 2024-06-13T02:12:19.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.549+0000 7f3896a00700 1 --2- 172.21.15.2:0/2894942070 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f38840a2ca0 0x7f38840a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:19.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.549+0000 7f3896a00700 1 -- 172.21.15.2:0/2894942070 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f38980cfe40 con 0x7f38a01076e0 2024-06-13T02:12:19.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.549+0000 7f389de00700 1 --2- 172.21.15.2:0/2894942070 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f38840a2ca0 0x7f38840a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:19.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.550+0000 7f389de00700 1 --2- 172.21.15.2:0/2894942070 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f38840a2ca0 0x7f38840a5160 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f38a0107460 tx=0x7f3890009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.553+0000 7f3896a00700 1 -- 172.21.15.2:0/2894942070 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f389809d230 con 0x7f38a01076e0 2024-06-13T02:12:19.679 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:12:19 smithi084 systemd[1]: Starting Ceph mds.b for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:12:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.837+0000 7f389f200700 1 -- 172.21.15.2:0/2894942070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38a01a5810 con 0x7f38a01076e0 2024-06-13T02:12:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.838+0000 7f3896a00700 1 -- 172.21.15.2:0/2894942070 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9644 (secure 0 0 0) 0x7f3898003db0 con 0x7f38a01076e0 2024-06-13T02:12:19.840 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:12:19.840 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3458450195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3458450195},{"type":"v1","addr":"172.21.15.2:6841","nonce":3458450195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1709394731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1709394731},{"type":"v1","addr":"172.21.15.175:6835","nonce":1709394731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/2403775181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2403775181},{"type":"v1","addr":"172.21.15.84:6835","nonce":2403775181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1446546569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1446546569},{"type":"v1","addr":"172.21.15.175:6837","nonce":1446546569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2537381027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2537381027},{"type":"v1","addr":"172.21.15.84:6837","nonce":2537381027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/2743442301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":2743442301},{"type":"v1","addr":"172.21.15.175:6839","nonce":2743442301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24503,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3208917373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3208917373},{"type":"v1","addr":"172.21.15.2:6839","nonce":3208917373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-06-13T02:12:19.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.841+0000 7f389f200700 1 -- 172.21.15.2:0/2894942070 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f38840a2ca0 msgr2=0x7f38840a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.841+0000 7f389f200700 1 --2- 172.21.15.2:0/2894942070 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f38840a2ca0 0x7f38840a5160 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f38a0107460 tx=0x7f3890009260 comp rx=0 tx=0).stop 2024-06-13T02:12:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.842+0000 7f389f200700 1 -- 172.21.15.2:0/2894942070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a01076e0 msgr2=0x7f38a0198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.842+0000 7f389f200700 1 --2- 172.21.15.2:0/2894942070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a01076e0 0x7f38a0198980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3898006070 tx=0x7f3898004c80 comp rx=0 tx=0).stop 2024-06-13T02:12:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.842+0000 7f389f200700 1 -- 172.21.15.2:0/2894942070 shutdown_connections 2024-06-13T02:12:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.842+0000 7f389f200700 1 --2- 172.21.15.2:0/2894942070 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f38840a2ca0 0x7f38840a5160 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.842+0000 7f389f200700 1 --2- 172.21.15.2:0/2894942070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38a01076e0 0x7f38a0198980 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.842+0000 7f389f200700 1 --2- 172.21.15.2:0/2894942070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38a0102600 0x7f38a019e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.842+0000 7f389f200700 1 --2- 172.21.15.2:0/2894942070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38a0102fb0 0x7f38a019ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.842+0000 7f389f200700 1 -- 172.21.15.2:0/2894942070 >> 172.21.15.2:0/2894942070 conn(0x7f38a00fdeb0 msgr2=0x7f38a00fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.842+0000 7f389f200700 1 -- 172.21.15.2:0/2894942070 shutdown_connections 2024-06-13T02:12:19.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:19.842+0000 7f389f200700 1 -- 172.21.15.2:0/2894942070 wait complete. 2024-06-13T02:12:19.845 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 12 2024-06-13T02:12:19.938 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:12:19 smithi084 podman[67050]: 2024-06-13 02:12:19.581974675 +0000 UTC m=+0.017282344 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:12:19.938 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:12:19 smithi084 podman[67050]: 2024-06-13 02:12:19.710467032 +0000 UTC m=+0.145774699 container create 3724c4a3dab648a9a3f62a03971eb480f601f1acc4a94d57acc2b6d99369c85b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-b, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-06-13T02:12:20.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:20 smithi084 ceph-mon[36833]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:20.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:20 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2894942070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:12:20.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:20 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:20.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:20 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:20.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:20 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:20.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:20 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:20.221 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:12:19 smithi084 podman[67050]: 2024-06-13 02:12:19.938166203 +0000 UTC m=+0.373473870 container init 3724c4a3dab648a9a3f62a03971eb480f601f1acc4a94d57acc2b6d99369c85b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-b, ceph=True, RELEASE=squid-3d89acc, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-06-13T02:12:20.221 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:12:19 smithi084 podman[67050]: 2024-06-13 02:12:19.940843952 +0000 UTC m=+0.376151631 container start 3724c4a3dab648a9a3f62a03971eb480f601f1acc4a94d57acc2b6d99369c85b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-06-13T02:12:20.221 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:12:19 smithi084 ceph-mds[67069]: -- 172.21.15.84:0/1752199828 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55deab5b5a40 con 0x55deab588800 2024-06-13T02:12:20.221 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:12:19 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-b[67065]: starting mds.b at 2024-06-13T02:12:20.221 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:12:20 smithi084 bash[67050]: 3724c4a3dab648a9a3f62a03971eb480f601f1acc4a94d57acc2b6d99369c85b 2024-06-13T02:12:20.221 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:12:20 smithi084 systemd[1]: Started Ceph mds.b for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:12:20.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:20 smithi175 ceph-mon[36977]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:20.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:20 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2894942070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:12:20.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:20 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:20.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:20 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:20.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:20 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:20.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:20 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:20.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:20 smithi002 ceph-mon[31960]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:20.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:20 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2894942070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:12:20.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:20 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:20.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:20 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:20.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:20 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:20.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:20 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:21.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:21 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] up:boot 2024-06-13T02:12:21.409 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:21 smithi175 ceph-mon[36977]: fsmap 12 up:standby 2024-06-13T02:12:21.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:21 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T02:12:21.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:21 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:21.410 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:21 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:12:21.439 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:21 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] up:boot 2024-06-13T02:12:21.439 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:21 smithi084 ceph-mon[36833]: fsmap 12 up:standby 2024-06-13T02:12:21.439 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:21 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T02:12:21.439 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:21 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:21.439 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:21 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:12:21.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:21 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] up:boot 2024-06-13T02:12:21.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:21 smithi002 ceph-mon[31960]: fsmap 12 up:standby 2024-06-13T02:12:21.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:21 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T02:12:21.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:21 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:21.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:21 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:12:22.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:22 smithi084 ceph-mon[36833]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:22.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:22.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:22 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:22.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:22 smithi175 ceph-mon[36977]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:22.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:22.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:22 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:22.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:22 smithi002 ceph-mon[31960]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:22.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:22.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:22 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:22.817 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:12:23.275 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:12:23.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:23 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:23.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:23 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:23.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:23 smithi175 ceph-mon[36977]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:23.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:23 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:23.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:23 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:23.601 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:23 smithi002 ceph-mon[31960]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:23.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:23 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:23.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:23 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:23.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:23 smithi084 ceph-mon[36833]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:24.463 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:24.463 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:24.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:24.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:12:24.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:24.464 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:12:24.609 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:24.609 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:24.609 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:24.609 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:12:24.609 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:24.609 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:12:24.612 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:24.612 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:24.612 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:24.612 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:12:24.612 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:24.612 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:12:25.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.482+0000 7f8628a00700 1 -- 172.21.15.2:0/1755651821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8624074fe0 msgr2=0x7f862410e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:25.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.482+0000 7f8628a00700 1 --2- 172.21.15.2:0/1755651821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8624074fe0 0x7f862410e9b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8610009990 tx=0x7f8610009ca0 comp rx=0 tx=0).stop 2024-06-13T02:12:25.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.482+0000 7f8628a00700 1 -- 172.21.15.2:0/1755651821 shutdown_connections 2024-06-13T02:12:25.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.482+0000 7f8628a00700 1 --2- 172.21.15.2:0/1755651821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f862410eef0 0x7f86241112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:25.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.482+0000 7f8628a00700 1 --2- 172.21.15.2:0/1755651821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86240746c0 0x7f8624074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:25.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.482+0000 7f8628a00700 1 --2- 172.21.15.2:0/1755651821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8624074fe0 0x7f862410e9b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:25.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.482+0000 7f8628a00700 1 -- 172.21.15.2:0/1755651821 >> 172.21.15.2:0/1755651821 conn(0x7f86240795f0 msgr2=0x7f8624079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:25.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.482+0000 7f8628a00700 1 -- 172.21.15.2:0/1755651821 shutdown_connections 2024-06-13T02:12:25.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.482+0000 7f8628a00700 1 -- 172.21.15.2:0/1755651821 wait complete. 2024-06-13T02:12:25.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.483+0000 7f8628a00700 1 Processor -- start 2024-06-13T02:12:25.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.483+0000 7f8628a00700 1 -- start start 2024-06-13T02:12:25.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8628a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86240746c0 0x7f862419ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8628a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8624074fe0 0x7f862419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8628a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f862410eef0 0x7f862419f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8628a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8624114a70 con 0x7f862410eef0 2024-06-13T02:12:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8628a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f86241148f0 con 0x7f8624074fe0 2024-06-13T02:12:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8628a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8624114bf0 con 0x7f86240746c0 2024-06-13T02:12:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8621e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86240746c0 0x7f862419ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8621400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8624074fe0 0x7f862419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8621e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86240746c0 0x7f862419ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:38416/0 (socket says 172.21.15.2:38416) 2024-06-13T02:12:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8621e00700 1 -- 172.21.15.2:0/2771386270 learned_addr learned my addr 172.21.15.2:0/2771386270 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:12:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8622800700 1 --2- 172.21.15.2:0/2771386270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f862410eef0 0x7f862419f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:25.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8621e00700 1 -- 172.21.15.2:0/2771386270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8624074fe0 msgr2=0x7f862419b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:25.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8621e00700 1 --2- 172.21.15.2:0/2771386270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8624074fe0 0x7f862419b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:25.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8621e00700 1 -- 172.21.15.2:0/2771386270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f862410eef0 msgr2=0x7f862419f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:25.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8621e00700 1 --2- 172.21.15.2:0/2771386270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f862410eef0 0x7f862419f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.484+0000 7f8621e00700 1 -- 172.21.15.2:0/2771386270 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f862419fe50 con 0x7f86240746c0 2024-06-13T02:12:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.485+0000 7f8621e00700 1 --2- 172.21.15.2:0/2771386270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86240746c0 0x7f862419ae40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f861400d980 tx=0x7f861400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.485+0000 7f861aa00700 1 -- 172.21.15.2:0/2771386270 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614016070 con 0x7f86240746c0 2024-06-13T02:12:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.485+0000 7f861aa00700 1 -- 172.21.15.2:0/2771386270 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8614004d10 con 0x7f86240746c0 2024-06-13T02:12:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.485+0000 7f8628a00700 1 -- 172.21.15.2:0/2771386270 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86241a0140 con 0x7f86240746c0 2024-06-13T02:12:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.485+0000 7f861aa00700 1 -- 172.21.15.2:0/2771386270 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614005670 con 0x7f86240746c0 2024-06-13T02:12:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.485+0000 7f8628a00700 1 -- 172.21.15.2:0/2771386270 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86241a79c0 con 0x7f86240746c0 2024-06-13T02:12:25.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.486+0000 7f8628a00700 1 -- 172.21.15.2:0/2771386270 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8624069180 con 0x7f86240746c0 2024-06-13T02:12:25.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.488+0000 7f861aa00700 1 -- 172.21.15.2:0/2771386270 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f8614004750 con 0x7f86240746c0 2024-06-13T02:12:25.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.489+0000 7f861aa00700 1 --2- 172.21.15.2:0/2771386270 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f86080a2ca0 0x7f86080a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:25.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.490+0000 7f861aa00700 1 -- 172.21.15.2:0/2771386270 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f86140ce9d0 con 0x7f86240746c0 2024-06-13T02:12:25.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.490+0000 7f8621400700 1 --2- 172.21.15.2:0/2771386270 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f86080a2ca0 0x7f86080a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:25.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.491+0000 7f8621400700 1 --2- 172.21.15.2:0/2771386270 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f86080a2ca0 0x7f86080a5160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8624110ab0 tx=0x7f8610005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:25.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.493+0000 7f861aa00700 1 -- 172.21.15.2:0/2771386270 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f861401f020 con 0x7f86240746c0 2024-06-13T02:12:25.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:25.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:25 smithi002 ceph-mon[31960]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:25.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:25.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:25.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:25.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:25.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:25 smithi084 ceph-mon[36833]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:25.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:25.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:25.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:25.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:25.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:25 smithi175 ceph-mon[36977]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:25.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:25.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:25.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:25.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.787+0000 7f8628a00700 1 -- 172.21.15.2:0/2771386270 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86241a7bf0 con 0x7f86240746c0 2024-06-13T02:12:25.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.788+0000 7f861aa00700 1 -- 172.21.15.2:0/2771386270 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10467 (secure 0 0 0) 0x7f861409bd30 con 0x7f86240746c0 2024-06-13T02:12:25.789 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:12:25.789 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3458450195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3458450195},{"type":"v1","addr":"172.21.15.2:6841","nonce":3458450195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1709394731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1709394731},{"type":"v1","addr":"172.21.15.175:6835","nonce":1709394731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/2403775181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2403775181},{"type":"v1","addr":"172.21.15.84:6835","nonce":2403775181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1446546569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1446546569},{"type":"v1","addr":"172.21.15.175:6837","nonce":1446546569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2537381027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2537381027},{"type":"v1","addr":"172.21.15.84:6837","nonce":2537381027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/2743442301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":2743442301},{"type":"v1","addr":"172.21.15.175:6839","nonce":2743442301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24503,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3208917373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3208917373},{"type":"v1","addr":"172.21.15.2:6839","nonce":3208917373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24527,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/541041266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":541041266},{"type":"v1","addr":"172.21.15.84:6839","nonce":541041266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-06-13T02:12:25.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.791+0000 7f8628a00700 1 -- 172.21.15.2:0/2771386270 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f86080a2ca0 msgr2=0x7f86080a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:25.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.791+0000 7f8628a00700 1 --2- 172.21.15.2:0/2771386270 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f86080a2ca0 0x7f86080a5160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8624110ab0 tx=0x7f8610005fd0 comp rx=0 tx=0).stop 2024-06-13T02:12:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.791+0000 7f8628a00700 1 -- 172.21.15.2:0/2771386270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86240746c0 msgr2=0x7f862419ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.791+0000 7f8628a00700 1 --2- 172.21.15.2:0/2771386270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86240746c0 0x7f862419ae40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f861400d980 tx=0x7f861400dc90 comp rx=0 tx=0).stop 2024-06-13T02:12:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.791+0000 7f8628a00700 1 -- 172.21.15.2:0/2771386270 shutdown_connections 2024-06-13T02:12:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.791+0000 7f8628a00700 1 --2- 172.21.15.2:0/2771386270 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f86080a2ca0 0x7f86080a5160 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.791+0000 7f8628a00700 1 --2- 172.21.15.2:0/2771386270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f862410eef0 0x7f862419f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.791+0000 7f8628a00700 1 --2- 172.21.15.2:0/2771386270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86240746c0 0x7f862419ae40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.791+0000 7f8628a00700 1 --2- 172.21.15.2:0/2771386270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8624074fe0 0x7f862419b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:25.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.791+0000 7f8628a00700 1 -- 172.21.15.2:0/2771386270 >> 172.21.15.2:0/2771386270 conn(0x7f86240795f0 msgr2=0x7f86240ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.791+0000 7f8628a00700 1 -- 172.21.15.2:0/2771386270 shutdown_connections 2024-06-13T02:12:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:25.792+0000 7f8628a00700 1 -- 172.21.15.2:0/2771386270 wait complete. 2024-06-13T02:12:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 13 2024-06-13T02:12:26.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:26 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:26.715 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:26 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2771386270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:12:26.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:26 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:26.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:26 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2771386270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:12:26.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:26 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:26.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:26 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2771386270' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:12:26.784 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-06-13T02:12:27.344 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:12:27.720 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:27 smithi002 ceph-mon[31960]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:27.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:27 smithi084 ceph-mon[36833]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:27.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:27 smithi175 ceph-mon[36977]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.652+0000 7f73c4800700 1 -- 172.21.15.2:0/1149263562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73bc10ee90 msgr2=0x7f73bc111280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.652+0000 7f73c4800700 1 --2- 172.21.15.2:0/1149263562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73bc10ee90 0x7f73bc111280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f73b8009f90 tx=0x7f73b800b330 comp rx=0 tx=0).stop 2024-06-13T02:12:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.652+0000 7f73c4800700 1 -- 172.21.15.2:0/1149263562 shutdown_connections 2024-06-13T02:12:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.652+0000 7f73c4800700 1 --2- 172.21.15.2:0/1149263562 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73bc10ee90 0x7f73bc111280 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.652+0000 7f73c4800700 1 --2- 172.21.15.2:0/1149263562 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc0746c0 0x7f73bc074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.652+0000 7f73c4800700 1 --2- 172.21.15.2:0/1149263562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73bc074fe0 0x7f73bc10e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.652+0000 7f73c4800700 1 -- 172.21.15.2:0/1149263562 >> 172.21.15.2:0/1149263562 conn(0x7f73bc079640 msgr2=0x7f73bc079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.653+0000 7f73c4800700 1 -- 172.21.15.2:0/1149263562 shutdown_connections 2024-06-13T02:12:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.653+0000 7f73c4800700 1 -- 172.21.15.2:0/1149263562 wait complete. 2024-06-13T02:12:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.654+0000 7f73c4800700 1 Processor -- start 2024-06-13T02:12:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.654+0000 7f73c4800700 1 -- start start 2024-06-13T02:12:29.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.654+0000 7f73c4800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73bc0746c0 0x7f73bc19aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:29.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.654+0000 7f73c4800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc074fe0 0x7f73bc19b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.654+0000 7f73c4800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73bc10ee90 0x7f73bc19f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.655+0000 7f73c4800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc114a30 con 0x7f73bc074fe0 2024-06-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.655+0000 7f73c4800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc1148b0 con 0x7f73bc10ee90 2024-06-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.655+0000 7f73c4800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f73bc114bb0 con 0x7f73bc0746c0 2024-06-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.655+0000 7f73c1e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73bc0746c0 0x7f73bc19aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.655+0000 7f73c2800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73bc10ee90 0x7f73bc19f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.655+0000 7f73c1e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73bc0746c0 0x7f73bc19aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:38422/0 (socket says 172.21.15.2:38422) 2024-06-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.655+0000 7f73c1400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc074fe0 0x7f73bc19b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.655+0000 7f73c1e00700 1 -- 172.21.15.2:0/1974986570 learned_addr learned my addr 172.21.15.2:0/1974986570 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.655+0000 7f73c2800700 1 -- 172.21.15.2:0/1974986570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73bc0746c0 msgr2=0x7f73bc19aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.655+0000 7f73c2800700 1 --2- 172.21.15.2:0/1974986570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73bc0746c0 0x7f73bc19aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.655+0000 7f73c2800700 1 -- 172.21.15.2:0/1974986570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc074fe0 msgr2=0x7f73bc19b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.655+0000 7f73c2800700 1 --2- 172.21.15.2:0/1974986570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc074fe0 0x7f73bc19b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.655+0000 7f73c2800700 1 -- 172.21.15.2:0/1974986570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73bc19fea0 con 0x7f73bc10ee90 2024-06-13T02:12:29.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.656+0000 7f73c2800700 1 --2- 172.21.15.2:0/1974986570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73bc10ee90 0x7f73bc19f760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f73bc06af50 tx=0x7f73b800cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:29.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.656+0000 7f73b6a00700 1 -- 172.21.15.2:0/1974986570 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8021070 con 0x7f73bc10ee90 2024-06-13T02:12:29.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.656+0000 7f73b6a00700 1 -- 172.21.15.2:0/1974986570 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73b8007ac0 con 0x7f73bc10ee90 2024-06-13T02:12:29.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.656+0000 7f73b6a00700 1 -- 172.21.15.2:0/1974986570 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8005040 con 0x7f73bc10ee90 2024-06-13T02:12:29.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.656+0000 7f73c4800700 1 -- 172.21.15.2:0/1974986570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73bc1a0130 con 0x7f73bc10ee90 2024-06-13T02:12:29.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.657+0000 7f73c4800700 1 -- 172.21.15.2:0/1974986570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73bc1a7a10 con 0x7f73bc10ee90 2024-06-13T02:12:29.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.658+0000 7f73c4800700 1 -- 172.21.15.2:0/1974986570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73bc069180 con 0x7f73bc10ee90 2024-06-13T02:12:29.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.660+0000 7f73b6a00700 1 -- 172.21.15.2:0/1974986570 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f73b8024070 con 0x7f73bc10ee90 2024-06-13T02:12:29.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.661+0000 7f73b6a00700 1 --2- 172.21.15.2:0/1974986570 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f73a40a2c20 0x7f73a40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:29.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.661+0000 7f73b6a00700 1 -- 172.21.15.2:0/1974986570 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f73b800f020 con 0x7f73bc10ee90 2024-06-13T02:12:29.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.662+0000 7f73c1e00700 1 --2- 172.21.15.2:0/1974986570 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f73a40a2c20 0x7f73a40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:29.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.662+0000 7f73c1e00700 1 --2- 172.21.15.2:0/1974986570 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f73a40a2c20 0x7f73a40a50e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f73b0005d10 tx=0x7f73b0009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:29.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.664+0000 7f73b6a00700 1 -- 172.21.15.2:0/1974986570 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f73b802b020 con 0x7f73bc10ee90 2024-06-13T02:12:29.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:29 smithi084 ceph-mon[36833]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:29.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:29 smithi175 ceph-mon[36977]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:29.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:29 smithi002 ceph-mon[31960]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:29.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.902+0000 7f73c4800700 1 -- 172.21.15.2:0/1974986570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f73bc1a7be0 con 0x7f73bc10ee90 2024-06-13T02:12:29.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.903+0000 7f73b6a00700 1 -- 172.21.15.2:0/1974986570 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) ==== 84+0+65 (secure 0 0 0) 0x7f73b809d280 con 0x7f73bc10ee90 2024-06-13T02:12:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:12:29.904 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-06-13T02:12:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:12:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-06-13T02:12:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-06-13T02:12:29.904 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:12:29.905 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-06-13T02:12:29.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.906+0000 7f73c4800700 1 -- 172.21.15.2:0/1974986570 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f73a40a2c20 msgr2=0x7f73a40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:29.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.906+0000 7f73c4800700 1 --2- 172.21.15.2:0/1974986570 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f73a40a2c20 0x7f73a40a50e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f73b0005d10 tx=0x7f73b0009310 comp rx=0 tx=0).stop 2024-06-13T02:12:29.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.906+0000 7f73c4800700 1 -- 172.21.15.2:0/1974986570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73bc10ee90 msgr2=0x7f73bc19f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:29.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.906+0000 7f73c4800700 1 --2- 172.21.15.2:0/1974986570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73bc10ee90 0x7f73bc19f760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f73bc06af50 tx=0x7f73b800cef0 comp rx=0 tx=0).stop 2024-06-13T02:12:29.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.907+0000 7f73c4800700 1 -- 172.21.15.2:0/1974986570 shutdown_connections 2024-06-13T02:12:29.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.907+0000 7f73c4800700 1 --2- 172.21.15.2:0/1974986570 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f73a40a2c20 0x7f73a40a50e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:29.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.907+0000 7f73c4800700 1 --2- 172.21.15.2:0/1974986570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73bc10ee90 0x7f73bc19f760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:29.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.907+0000 7f73c4800700 1 --2- 172.21.15.2:0/1974986570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73bc0746c0 0x7f73bc19aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:29.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.907+0000 7f73c4800700 1 --2- 172.21.15.2:0/1974986570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73bc074fe0 0x7f73bc19b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:29.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.907+0000 7f73c4800700 1 -- 172.21.15.2:0/1974986570 >> 172.21.15.2:0/1974986570 conn(0x7f73bc079640 msgr2=0x7f73bc0ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:29.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.907+0000 7f73c4800700 1 -- 172.21.15.2:0/1974986570 shutdown_connections 2024-06-13T02:12:29.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:29.907+0000 7f73c4800700 1 -- 172.21.15.2:0/1974986570 wait complete. 2024-06-13T02:12:30.940 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-13T02:12:30.940 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-13T02:12:31.021 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:30 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:31.021 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:30 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:31.021 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:30 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:31.022 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:30 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:12:31.022 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:30 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:31.022 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:30 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1974986570' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-13T02:12:31.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:30 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:31.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:30 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:31.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:30 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:31.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:30 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:12:31.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:30 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:31.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:30 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1974986570' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-13T02:12:31.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:30 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:31.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:30 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:31.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:30 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:12:31.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:30 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:12:31.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:30 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:12:31.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:30 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1974986570' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-13T02:12:31.418 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:12:31.834 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:31 smithi002 ceph-mon[31960]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:32.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:31 smithi175 ceph-mon[36977]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:32.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:31 smithi084 ceph-mon[36833]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:33.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:33 smithi002 ceph-mon[31960]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:33.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.876+0000 7fb2f3e00700 1 -- 172.21.15.2:0/3939309003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2ec10a6b0 msgr2=0x7fb2ec10aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:33.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.876+0000 7fb2f3e00700 1 --2- 172.21.15.2:0/3939309003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2ec10a6b0 0x7fb2ec10aa90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009f90 tx=0x7fb2e000b330 comp rx=0 tx=0).stop 2024-06-13T02:12:33.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.876+0000 7fb2f3e00700 1 -- 172.21.15.2:0/3939309003 shutdown_connections 2024-06-13T02:12:33.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.876+0000 7fb2f3e00700 1 --2- 172.21.15.2:0/3939309003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec105070 0x7fb2ec111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:33.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.876+0000 7fb2f3e00700 1 --2- 172.21.15.2:0/3939309003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2ec10a6b0 0x7fb2ec10aa90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:33.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.876+0000 7fb2f3e00700 1 --2- 172.21.15.2:0/3939309003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec1046b0 0x7fb2ec104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:33.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.876+0000 7fb2f3e00700 1 -- 172.21.15.2:0/3939309003 >> 172.21.15.2:0/3939309003 conn(0x7fb2ec1001a0 msgr2=0x7fb2ec1025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:33.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.876+0000 7fb2f3e00700 1 -- 172.21.15.2:0/3939309003 shutdown_connections 2024-06-13T02:12:33.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.876+0000 7fb2f3e00700 1 -- 172.21.15.2:0/3939309003 wait complete. 2024-06-13T02:12:33.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.878+0000 7fb2f3e00700 1 Processor -- start 2024-06-13T02:12:33.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.878+0000 7fb2f3e00700 1 -- start start 2024-06-13T02:12:33.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.878+0000 7fb2f3e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2ec1046b0 0x7fb2ec19ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:33.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.878+0000 7fb2f3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec105070 0x7fb2ec19b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:33.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.878+0000 7fb2f3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec10a6b0 0x7fb2ec19f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:33.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.878+0000 7fb2f3e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec1149e0 con 0x7fb2ec105070 2024-06-13T02:12:33.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.878+0000 7fb2f3e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec114860 con 0x7fb2ec10a6b0 2024-06-13T02:12:33.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.878+0000 7fb2f3e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec114b60 con 0x7fb2ec1046b0 2024-06-13T02:12:33.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.879+0000 7fb2f1e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec10a6b0 0x7fb2ec19f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:33.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.879+0000 7fb2f0a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec105070 0x7fb2ec19b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:33.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.879+0000 7fb2f1400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2ec1046b0 0x7fb2ec19ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.879+0000 7fb2f1e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec10a6b0 0x7fb2ec19f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:34996/0 (socket says 172.21.15.2:34996) 2024-06-13T02:12:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.879+0000 7fb2f1e00700 1 -- 172.21.15.2:0/3039094875 learned_addr learned my addr 172.21.15.2:0/3039094875 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:12:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.879+0000 7fb2f1400700 1 -- 172.21.15.2:0/3039094875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec10a6b0 msgr2=0x7fb2ec19f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.879+0000 7fb2f1400700 1 --2- 172.21.15.2:0/3039094875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec10a6b0 0x7fb2ec19f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.879+0000 7fb2f1400700 1 -- 172.21.15.2:0/3039094875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec105070 msgr2=0x7fb2ec19b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.879+0000 7fb2f1400700 1 --2- 172.21.15.2:0/3039094875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec105070 0x7fb2ec19b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.879+0000 7fb2f1400700 1 -- 172.21.15.2:0/3039094875 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ec19fe30 con 0x7fb2ec1046b0 2024-06-13T02:12:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.880+0000 7fb2f1400700 1 --2- 172.21.15.2:0/3039094875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2ec1046b0 0x7fb2ec19ae70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009f90 tx=0x7fb2e0009b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.880+0000 7fb2ea000700 1 -- 172.21.15.2:0/3039094875 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0021070 con 0x7fb2ec1046b0 2024-06-13T02:12:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.880+0000 7fb2f3e00700 1 -- 172.21.15.2:0/3039094875 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2ec1a00c0 con 0x7fb2ec1046b0 2024-06-13T02:12:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.880+0000 7fb2ea000700 1 -- 172.21.15.2:0/3039094875 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2e0007ac0 con 0x7fb2ec1046b0 2024-06-13T02:12:33.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.880+0000 7fb2ea000700 1 -- 172.21.15.2:0/3039094875 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e00052a0 con 0x7fb2ec1046b0 2024-06-13T02:12:33.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.880+0000 7fb2f3e00700 1 -- 172.21.15.2:0/3039094875 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2ec1a79a0 con 0x7fb2ec1046b0 2024-06-13T02:12:33.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.882+0000 7fb2f3e00700 1 -- 172.21.15.2:0/3039094875 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2ec10cc40 con 0x7fb2ec1046b0 2024-06-13T02:12:33.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.884+0000 7fb2ea000700 1 -- 172.21.15.2:0/3039094875 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fb2e0024070 con 0x7fb2ec1046b0 2024-06-13T02:12:33.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.885+0000 7fb2ea000700 1 --2- 172.21.15.2:0/3039094875 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb2d40a2ca0 0x7fb2d40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:33.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.885+0000 7fb2ea000700 1 -- 172.21.15.2:0/3039094875 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fb2e000f020 con 0x7fb2ec1046b0 2024-06-13T02:12:33.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.885+0000 7fb2f0a00700 1 --2- 172.21.15.2:0/3039094875 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb2d40a2ca0 0x7fb2d40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:33.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.886+0000 7fb2f0a00700 1 --2- 172.21.15.2:0/3039094875 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb2d40a2ca0 0x7fb2d40a5160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec102830 tx=0x7fb2d800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:33.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:33.888+0000 7fb2ea000700 1 -- 172.21.15.2:0/3039094875 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb2e002b020 con 0x7fb2ec1046b0 2024-06-13T02:12:34.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:33 smithi175 ceph-mon[36977]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:34.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:34.115+0000 7fb2f3e00700 1 -- 172.21.15.2:0/3039094875 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb2ec19c180 con 0x7fb2ec1046b0 2024-06-13T02:12:34.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:33 smithi084 ceph-mon[36833]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:34.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:34.790+0000 7fb2ea000700 1 -- 172.21.15.2:0/3039094875 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) ==== 138+0+0 (secure 0 0 0) 0x7fb2e009d380 con 0x7fb2ec1046b0 2024-06-13T02:12:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:34.796+0000 7fb2f3e00700 1 -- 172.21.15.2:0/3039094875 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb2d40a2ca0 msgr2=0x7fb2d40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:34.796+0000 7fb2f3e00700 1 --2- 172.21.15.2:0/3039094875 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb2d40a2ca0 0x7fb2d40a5160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec102830 tx=0x7fb2d800b410 comp rx=0 tx=0).stop 2024-06-13T02:12:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:34.796+0000 7fb2f3e00700 1 -- 172.21.15.2:0/3039094875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2ec1046b0 msgr2=0x7fb2ec19ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:34.796+0000 7fb2f3e00700 1 --2- 172.21.15.2:0/3039094875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2ec1046b0 0x7fb2ec19ae70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009f90 tx=0x7fb2e0009b70 comp rx=0 tx=0).stop 2024-06-13T02:12:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:34.796+0000 7fb2f3e00700 1 -- 172.21.15.2:0/3039094875 shutdown_connections 2024-06-13T02:12:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:34.796+0000 7fb2f3e00700 1 --2- 172.21.15.2:0/3039094875 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb2d40a2ca0 0x7fb2d40a5160 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:34.796+0000 7fb2f3e00700 1 --2- 172.21.15.2:0/3039094875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2ec10a6b0 0x7fb2ec19f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:34.796+0000 7fb2f3e00700 1 --2- 172.21.15.2:0/3039094875 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2ec1046b0 0x7fb2ec19ae70 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009f90 tx=0x7fb2e0009b70 comp rx=0 tx=0).stop 2024-06-13T02:12:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:34.796+0000 7fb2f3e00700 1 --2- 172.21.15.2:0/3039094875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2ec105070 0x7fb2ec19b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:34.796+0000 7fb2f3e00700 1 -- 172.21.15.2:0/3039094875 >> 172.21.15.2:0/3039094875 conn(0x7fb2ec1001a0 msgr2=0x7fb2ec1009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:34.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:34.798+0000 7fb2f3e00700 1 -- 172.21.15.2:0/3039094875 shutdown_connections 2024-06-13T02:12:34.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:34.799+0000 7fb2f3e00700 1 -- 172.21.15.2:0/3039094875 wait complete. 2024-06-13T02:12:34.802 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-06-13T02:12:35.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:34 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3039094875' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-13T02:12:35.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:34 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-13T02:12:35.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:34 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3039094875' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-13T02:12:35.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:34 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-13T02:12:35.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:34 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3039094875' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-13T02:12:35.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:34 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-13T02:12:35.536 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-06-13T02:12:35.997 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:12:36.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:35 smithi002 ceph-mon[31960]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:36.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:35 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-13T02:12:36.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:35 smithi002 ceph-mon[31960]: osdmap e83: 12 total, 12 up, 12 in 2024-06-13T02:12:36.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:35 smithi084 ceph-mon[36833]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:36.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:35 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-13T02:12:36.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:35 smithi084 ceph-mon[36833]: osdmap e83: 12 total, 12 up, 12 in 2024-06-13T02:12:36.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:35 smithi175 ceph-mon[36977]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:36.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:35 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-13T02:12:36.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:35 smithi175 ceph-mon[36977]: osdmap e83: 12 total, 12 up, 12 in 2024-06-13T02:12:37.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:36 smithi002 ceph-mon[31960]: osdmap e84: 12 total, 12 up, 12 in 2024-06-13T02:12:37.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:36 smithi084 ceph-mon[36833]: osdmap e84: 12 total, 12 up, 12 in 2024-06-13T02:12:37.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:36 smithi175 ceph-mon[36977]: osdmap e84: 12 total, 12 up, 12 in 2024-06-13T02:12:38.079 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:37 smithi002 ceph-mon[31960]: pgmap v320: 33 pgs: 4 creating+peering, 1 active+clean, 28 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:38.079 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:37 smithi002 ceph-mon[31960]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T02:12:38.079 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:37 smithi002 ceph-mon[31960]: osdmap e85: 12 total, 12 up, 12 in 2024-06-13T02:12:38.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:37 smithi084 ceph-mon[36833]: pgmap v320: 33 pgs: 4 creating+peering, 1 active+clean, 28 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:38.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:37 smithi084 ceph-mon[36833]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T02:12:38.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:37 smithi084 ceph-mon[36833]: osdmap e85: 12 total, 12 up, 12 in 2024-06-13T02:12:38.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:37 smithi175 ceph-mon[36977]: pgmap v320: 33 pgs: 4 creating+peering, 1 active+clean, 28 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:38.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:37 smithi175 ceph-mon[36977]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T02:12:38.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:37 smithi175 ceph-mon[36977]: osdmap e85: 12 total, 12 up, 12 in 2024-06-13T02:12:38.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.405+0000 7fb5db200700 1 -- 172.21.15.2:0/2126363105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5dc102610 msgr2=0x7fb5dc1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.405+0000 7fb5db200700 1 --2- 172.21.15.2:0/2126363105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5dc102610 0x7fb5dc1029f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc0098f0 tx=0x7fb5cc009c00 comp rx=0 tx=0).stop 2024-06-13T02:12:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.405+0000 7fb5db200700 1 -- 172.21.15.2:0/2126363105 shutdown_connections 2024-06-13T02:12:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.405+0000 7fb5db200700 1 --2- 172.21.15.2:0/2126363105 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5dc1076f0 0x7fb5dc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.405+0000 7fb5db200700 1 --2- 172.21.15.2:0/2126363105 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5dc102610 0x7fb5dc1029f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.405+0000 7fb5db200700 1 --2- 172.21.15.2:0/2126363105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5dc102fc0 0x7fb5dc107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.405+0000 7fb5db200700 1 -- 172.21.15.2:0/2126363105 >> 172.21.15.2:0/2126363105 conn(0x7fb5dc0fdea0 msgr2=0x7fb5dc1002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.405+0000 7fb5db200700 1 -- 172.21.15.2:0/2126363105 shutdown_connections 2024-06-13T02:12:38.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.405+0000 7fb5db200700 1 -- 172.21.15.2:0/2126363105 wait complete. 2024-06-13T02:12:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.407+0000 7fb5db200700 1 Processor -- start 2024-06-13T02:12:38.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.407+0000 7fb5db200700 1 -- start start 2024-06-13T02:12:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.407+0000 7fb5db200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5dc102610 0x7fb5dc19ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.408+0000 7fb5db200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5dc102fc0 0x7fb5dc19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.408+0000 7fb5db200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5dc1076f0 0x7fb5dc19f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.408+0000 7fb5db200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc112740 con 0x7fb5dc1076f0 2024-06-13T02:12:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.408+0000 7fb5db200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc1125c0 con 0x7fb5dc102610 2024-06-13T02:12:38.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.408+0000 7fb5db200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb5dc1128c0 con 0x7fb5dc102fc0 2024-06-13T02:12:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.408+0000 7fb5d9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5dc102610 0x7fb5dc19ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.408+0000 7fb5da800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5dc1076f0 0x7fb5dc19f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.408+0000 7fb5d3e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5dc102fc0 0x7fb5dc19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.408+0000 7fb5d9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5dc102610 0x7fb5dc19ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:35012/0 (socket says 172.21.15.2:35012) 2024-06-13T02:12:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.408+0000 7fb5d9e00700 1 -- 172.21.15.2:0/3175444905 learned_addr learned my addr 172.21.15.2:0/3175444905 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:12:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.408+0000 7fb5d9e00700 1 -- 172.21.15.2:0/3175444905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5dc102fc0 msgr2=0x7fb5dc19b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.408+0000 7fb5d9e00700 1 --2- 172.21.15.2:0/3175444905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5dc102fc0 0x7fb5dc19b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.408+0000 7fb5d9e00700 1 -- 172.21.15.2:0/3175444905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5dc1076f0 msgr2=0x7fb5dc19f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.408+0000 7fb5d9e00700 1 --2- 172.21.15.2:0/3175444905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5dc1076f0 0x7fb5dc19f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:38.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.408+0000 7fb5d9e00700 1 -- 172.21.15.2:0/3175444905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5dc19fdd0 con 0x7fb5dc102610 2024-06-13T02:12:38.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.409+0000 7fb5d9e00700 1 --2- 172.21.15.2:0/3175444905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5dc102610 0x7fb5dc19ae10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009fd0 tx=0x7fb5cc0094b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:38.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.409+0000 7fb5d2a00700 1 -- 172.21.15.2:0/3175444905 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc025070 con 0x7fb5dc102610 2024-06-13T02:12:38.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.409+0000 7fb5db200700 1 -- 172.21.15.2:0/3175444905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5dc1a0060 con 0x7fb5dc102610 2024-06-13T02:12:38.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.409+0000 7fb5d2a00700 1 -- 172.21.15.2:0/3175444905 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5cc00b560 con 0x7fb5dc102610 2024-06-13T02:12:38.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.409+0000 7fb5d2a00700 1 -- 172.21.15.2:0/3175444905 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc004c30 con 0x7fb5dc102610 2024-06-13T02:12:38.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.409+0000 7fb5db200700 1 -- 172.21.15.2:0/3175444905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5dc1a7940 con 0x7fb5dc102610 2024-06-13T02:12:38.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.410+0000 7fb5db200700 1 -- 172.21.15.2:0/3175444905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5dc069180 con 0x7fb5dc102610 2024-06-13T02:12:38.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.412+0000 7fb5d2a00700 1 -- 172.21.15.2:0/3175444905 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fb5cc028070 con 0x7fb5dc102610 2024-06-13T02:12:38.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.414+0000 7fb5d2a00700 1 --2- 172.21.15.2:0/3175444905 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb5c00a2c20 0x7fb5c00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:38.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.414+0000 7fb5d2a00700 1 -- 172.21.15.2:0/3175444905 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7497+0+0 (secure 0 0 0) 0x7fb5cc0cf8e0 con 0x7fb5dc102610 2024-06-13T02:12:38.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.414+0000 7fb5d3e00700 1 --2- 172.21.15.2:0/3175444905 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb5c00a2c20 0x7fb5c00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:38.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.415+0000 7fb5d3e00700 1 --2- 172.21.15.2:0/3175444905 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb5c00a2c20 0x7fb5c00a50e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc109050 tx=0x7fb5c4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:38.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.416+0000 7fb5d2a00700 1 -- 172.21.15.2:0/3175444905 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb5cc02f080 con 0x7fb5dc102610 2024-06-13T02:12:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:38.646+0000 7fb5db200700 1 -- 172.21.15.2:0/3175444905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fb5dc1a7b10 con 0x7fb5dc102610 2024-06-13T02:12:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:39.276+0000 7fb5d2a00700 1 -- 172.21.15.2:0/3175444905 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v86) ==== 171+0+0 (secure 0 0 0) 0x7fb5cc013030 con 0x7fb5dc102610 2024-06-13T02:12:39.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:39.283+0000 7fb5db200700 1 -- 172.21.15.2:0/3175444905 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb5c00a2c20 msgr2=0x7fb5c00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:39.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:39.283+0000 7fb5db200700 1 --2- 172.21.15.2:0/3175444905 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb5c00a2c20 0x7fb5c00a50e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc109050 tx=0x7fb5c4009260 comp rx=0 tx=0).stop 2024-06-13T02:12:39.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:39.283+0000 7fb5db200700 1 -- 172.21.15.2:0/3175444905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5dc102610 msgr2=0x7fb5dc19ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:39.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:39.283+0000 7fb5db200700 1 --2- 172.21.15.2:0/3175444905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5dc102610 0x7fb5dc19ae10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009fd0 tx=0x7fb5cc0094b0 comp rx=0 tx=0).stop 2024-06-13T02:12:39.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:39.283+0000 7fb5db200700 1 -- 172.21.15.2:0/3175444905 shutdown_connections 2024-06-13T02:12:39.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:39.283+0000 7fb5db200700 1 --2- 172.21.15.2:0/3175444905 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb5c00a2c20 0x7fb5c00a50e0 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc109050 tx=0x7fb5c4009260 comp rx=0 tx=0).stop 2024-06-13T02:12:39.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:39.283+0000 7fb5db200700 1 --2- 172.21.15.2:0/3175444905 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5dc1076f0 0x7fb5dc19f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:39.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:39.284+0000 7fb5db200700 1 --2- 172.21.15.2:0/3175444905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5dc102610 0x7fb5dc19ae10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:39.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:39.284+0000 7fb5db200700 1 --2- 172.21.15.2:0/3175444905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5dc102fc0 0x7fb5dc19b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:39.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:39.284+0000 7fb5db200700 1 -- 172.21.15.2:0/3175444905 >> 172.21.15.2:0/3175444905 conn(0x7fb5dc0fdea0 msgr2=0x7fb5dc0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:39.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:39.286+0000 7fb5db200700 1 -- 172.21.15.2:0/3175444905 shutdown_connections 2024-06-13T02:12:39.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:39.286+0000 7fb5db200700 1 -- 172.21.15.2:0/3175444905 wait complete. 2024-06-13T02:12:39.291 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-06-13T02:12:39.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:39 smithi002 ceph-mon[31960]: pgmap v322: 33 pgs: 4 creating+peering, 17 active+clean, 12 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:39.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:39 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3175444905' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-13T02:12:39.533 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:39 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-13T02:12:39.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:39 smithi084 ceph-mon[36833]: pgmap v322: 33 pgs: 4 creating+peering, 17 active+clean, 12 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:39.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:39 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3175444905' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-13T02:12:39.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:39 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-13T02:12:39.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:39 smithi175 ceph-mon[36977]: pgmap v322: 33 pgs: 4 creating+peering, 17 active+clean, 12 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:39.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:39 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3175444905' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-13T02:12:39.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:39 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-06-13T02:12:40.200 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-13T02:12:40.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:40 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-06-13T02:12:40.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:40 smithi002 ceph-mon[31960]: osdmap e86: 12 total, 12 up, 12 in 2024-06-13T02:12:40.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:40 smithi002 ceph-mon[31960]: osdmap e87: 12 total, 12 up, 12 in 2024-06-13T02:12:40.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:40 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-06-13T02:12:40.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:40 smithi175 ceph-mon[36977]: osdmap e86: 12 total, 12 up, 12 in 2024-06-13T02:12:40.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:40 smithi175 ceph-mon[36977]: osdmap e87: 12 total, 12 up, 12 in 2024-06-13T02:12:40.685 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:12:40.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:40 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-06-13T02:12:40.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:40 smithi084 ceph-mon[36833]: osdmap e86: 12 total, 12 up, 12 in 2024-06-13T02:12:40.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:40 smithi084 ceph-mon[36833]: osdmap e87: 12 total, 12 up, 12 in 2024-06-13T02:12:41.596 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:41 smithi002 ceph-mon[31960]: pgmap v325: 97 pgs: 20 creating+peering, 33 active+clean, 44 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:41.597 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:41 smithi002 ceph-mon[31960]: osdmap e88: 12 total, 12 up, 12 in 2024-06-13T02:12:41.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:41 smithi084 ceph-mon[36833]: pgmap v325: 97 pgs: 20 creating+peering, 33 active+clean, 44 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:41.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:41 smithi084 ceph-mon[36833]: osdmap e88: 12 total, 12 up, 12 in 2024-06-13T02:12:41.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:41 smithi175 ceph-mon[36977]: pgmap v325: 97 pgs: 20 creating+peering, 33 active+clean, 44 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:41.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:41 smithi175 ceph-mon[36977]: osdmap e88: 12 total, 12 up, 12 in 2024-06-13T02:12:42.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.765+0000 7f2ae4400700 1 -- 172.21.15.2:0/3899736579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc107400 msgr2=0x7f2adc1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:42.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.765+0000 7f2ae4400700 1 --2- 172.21.15.2:0/3899736579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc107400 0x7f2adc1077e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009990 tx=0x7f2ad0009ca0 comp rx=0 tx=0).stop 2024-06-13T02:12:42.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.765+0000 7f2ae4400700 1 -- 172.21.15.2:0/3899736579 shutdown_connections 2024-06-13T02:12:42.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.765+0000 7f2ae4400700 1 --2- 172.21.15.2:0/3899736579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2adc101d50 0x7f2adc10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:42.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.765+0000 7f2ae4400700 1 --2- 172.21.15.2:0/3899736579 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc107400 0x7f2adc1077e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:42.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.765+0000 7f2ae4400700 1 --2- 172.21.15.2:0/3899736579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2adc101390 0x7f2adc101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:42.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.765+0000 7f2ae4400700 1 -- 172.21.15.2:0/3899736579 >> 172.21.15.2:0/3899736579 conn(0x7f2adc078340 msgr2=0x7f2adc078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:42.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.765+0000 7f2ae4400700 1 -- 172.21.15.2:0/3899736579 shutdown_connections 2024-06-13T02:12:42.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.765+0000 7f2ae4400700 1 -- 172.21.15.2:0/3899736579 wait complete. 2024-06-13T02:12:42.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.766+0000 7f2ae4400700 1 Processor -- start 2024-06-13T02:12:42.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.766+0000 7f2ae4400700 1 -- start start 2024-06-13T02:12:42.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.767+0000 7f2ae4400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc101390 0x7f2adc19ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:42.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.767+0000 7f2ae4400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2adc101d50 0x7f2adc19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:42.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.767+0000 7f2ae4400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2adc107400 0x7f2adc19f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:42.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.767+0000 7f2ae4400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc1127f0 con 0x7f2adc101390 2024-06-13T02:12:42.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.767+0000 7f2ae4400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc112670 con 0x7f2adc101d50 2024-06-13T02:12:42.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.767+0000 7f2ae4400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc112970 con 0x7f2adc107400 2024-06-13T02:12:42.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.767+0000 7f2ae1a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc101390 0x7f2adc19ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:42.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.767+0000 7f2ae1a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc101390 0x7f2adc19ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40986/0 (socket says 172.21.15.2:40986) 2024-06-13T02:12:42.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.767+0000 7f2ae1a00700 1 -- 172.21.15.2:0/2542164906 learned_addr learned my addr 172.21.15.2:0/2542164906 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:12:42.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.767+0000 7f2ae1000700 1 --2- 172.21.15.2:0/2542164906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2adc101d50 0x7f2adc19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:42.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.767+0000 7f2ae2400700 1 --2- 172.21.15.2:0/2542164906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2adc107400 0x7f2adc19f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:42.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.768+0000 7f2ae1a00700 1 -- 172.21.15.2:0/2542164906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2adc107400 msgr2=0x7f2adc19f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:42.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.768+0000 7f2ae1a00700 1 --2- 172.21.15.2:0/2542164906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2adc107400 0x7f2adc19f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:42.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.768+0000 7f2ae1a00700 1 -- 172.21.15.2:0/2542164906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2adc101d50 msgr2=0x7f2adc19b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:42.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.768+0000 7f2ae1a00700 1 --2- 172.21.15.2:0/2542164906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2adc101d50 0x7f2adc19b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:42.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.768+0000 7f2ae1a00700 1 -- 172.21.15.2:0/2542164906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2adc19fe90 con 0x7f2adc101390 2024-06-13T02:12:42.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.768+0000 7f2ae1000700 1 --2- 172.21.15.2:0/2542164906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2adc101d50 0x7f2adc19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:12:42.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.768+0000 7f2ae1a00700 1 --2- 172.21.15.2:0/2542164906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc101390 0x7f2adc19ae80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0005910 tx=0x7f2ad000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:42.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.768+0000 7f2ada000700 1 -- 172.21.15.2:0/2542164906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0027070 con 0x7f2adc101390 2024-06-13T02:12:42.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.768+0000 7f2ada000700 1 -- 172.21.15.2:0/2542164906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ad0003d70 con 0x7f2adc101390 2024-06-13T02:12:42.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.768+0000 7f2ae4400700 1 -- 172.21.15.2:0/2542164906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2adc1a0120 con 0x7f2adc101390 2024-06-13T02:12:42.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.768+0000 7f2ada000700 1 -- 172.21.15.2:0/2542164906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000f460 con 0x7f2adc101390 2024-06-13T02:12:42.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.769+0000 7f2ae4400700 1 -- 172.21.15.2:0/2542164906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2adc1a7a00 con 0x7f2adc101390 2024-06-13T02:12:42.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.770+0000 7f2ae4400700 1 -- 172.21.15.2:0/2542164906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2adc102ab0 con 0x7f2adc101390 2024-06-13T02:12:42.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.772+0000 7f2ada000700 1 -- 172.21.15.2:0/2542164906 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2ad002a070 con 0x7f2adc101390 2024-06-13T02:12:42.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.774+0000 7f2ada000700 1 --2- 172.21.15.2:0/2542164906 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2ac40a2c20 0x7f2ac40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:42.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.774+0000 7f2ada000700 1 -- 172.21.15.2:0/2542164906 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7879+0+0 (secure 0 0 0) 0x7f2ad00d0200 con 0x7f2adc101390 2024-06-13T02:12:42.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.774+0000 7f2ae1000700 1 --2- 172.21.15.2:0/2542164906 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2ac40a2c20 0x7f2ac40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:42.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.775+0000 7f2ae1000700 1 --2- 172.21.15.2:0/2542164906 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2ac40a2c20 0x7f2ac40a50e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2adc078be0 tx=0x7f2ac8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:42.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:42.777+0000 7f2ada000700 1 -- 172.21.15.2:0/2542164906 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2ad0031070 con 0x7f2adc101390 2024-06-13T02:12:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:43.060+0000 7f2ae4400700 1 -- 172.21.15.2:0/2542164906 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2adc1a7bd0 con 0x7f2adc101390 2024-06-13T02:12:43.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:43.501+0000 7f2ada000700 1 -- 172.21.15.2:0/2542164906 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f2ad0013070 con 0x7f2adc101390 2024-06-13T02:12:43.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:43.505+0000 7f2ae4400700 1 -- 172.21.15.2:0/2542164906 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2ac40a2c20 msgr2=0x7f2ac40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:43.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:43.505+0000 7f2ae4400700 1 --2- 172.21.15.2:0/2542164906 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2ac40a2c20 0x7f2ac40a50e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2adc078be0 tx=0x7f2ac8009260 comp rx=0 tx=0).stop 2024-06-13T02:12:43.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:43.505+0000 7f2ae4400700 1 -- 172.21.15.2:0/2542164906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc101390 msgr2=0x7f2adc19ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:43.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:43.505+0000 7f2ae4400700 1 --2- 172.21.15.2:0/2542164906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc101390 0x7f2adc19ae80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0005910 tx=0x7f2ad000bab0 comp rx=0 tx=0).stop 2024-06-13T02:12:43.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:43.506+0000 7f2ae4400700 1 -- 172.21.15.2:0/2542164906 shutdown_connections 2024-06-13T02:12:43.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:43.506+0000 7f2ae4400700 1 --2- 172.21.15.2:0/2542164906 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2ac40a2c20 0x7f2ac40a50e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:43.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:43.506+0000 7f2ae4400700 1 --2- 172.21.15.2:0/2542164906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2adc107400 0x7f2adc19f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:43.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:43.506+0000 7f2ae4400700 1 --2- 172.21.15.2:0/2542164906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2adc101390 0x7f2adc19ae80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:43.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:43.506+0000 7f2ae4400700 1 --2- 172.21.15.2:0/2542164906 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2adc101d50 0x7f2adc19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:43.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:43.506+0000 7f2ae4400700 1 -- 172.21.15.2:0/2542164906 >> 172.21.15.2:0/2542164906 conn(0x7f2adc078340 msgr2=0x7f2adc10ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:43.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:43.506+0000 7f2ae4400700 1 -- 172.21.15.2:0/2542164906 shutdown_connections 2024-06-13T02:12:43.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:43.506+0000 7f2ae4400700 1 -- 172.21.15.2:0/2542164906 wait complete. 2024-06-13T02:12:43.514 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 2 and data pool 3 2024-06-13T02:12:43.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:43 smithi175 ceph-mon[36977]: pgmap v327: 97 pgs: 20 creating+peering, 45 active+clean, 32 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:43.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:43 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2542164906' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-13T02:12:43.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:43 smithi175 ceph-mon[36977]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-06-13T02:12:43.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:43 smithi175 ceph-mon[36977]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T02:12:43.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:43 smithi002 ceph-mon[31960]: pgmap v327: 97 pgs: 20 creating+peering, 45 active+clean, 32 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:43.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:43 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2542164906' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-13T02:12:43.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:43 smithi002 ceph-mon[31960]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-06-13T02:12:43.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:43 smithi002 ceph-mon[31960]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T02:12:43.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:43 smithi084 ceph-mon[36833]: pgmap v327: 97 pgs: 20 creating+peering, 45 active+clean, 32 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:43.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:43 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2542164906' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-13T02:12:43.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:43 smithi084 ceph-mon[36833]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-06-13T02:12:43.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:43 smithi084 ceph-mon[36833]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T02:12:44.466 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-06-13T02:12:44.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-06-13T02:12:44.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:44 smithi175 ceph-mon[36977]: osdmap e89: 12 total, 12 up, 12 in 2024-06-13T02:12:44.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:44 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2542164906' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-13T02:12:44.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:44 smithi175 ceph-mon[36977]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-06-13T02:12:44.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:44 smithi175 ceph-mon[36977]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-06-13T02:12:44.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:44 smithi002 ceph-mon[31960]: osdmap e89: 12 total, 12 up, 12 in 2024-06-13T02:12:44.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:44 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2542164906' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-13T02:12:44.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:44 smithi002 ceph-mon[31960]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-06-13T02:12:44.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:44 smithi002 ceph-mon[31960]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-06-13T02:12:44.952 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:12:44.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:44 smithi084 ceph-mon[36833]: osdmap e89: 12 total, 12 up, 12 in 2024-06-13T02:12:44.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:44 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2542164906' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-13T02:12:44.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:44 smithi084 ceph-mon[36833]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-06-13T02:12:44.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:44 smithi084 ceph-mon[36833]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-06-13T02:12:45.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:45 smithi175 ceph-mon[36977]: pgmap v329: 97 pgs: 20 creating+peering, 77 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 1 op/s 2024-06-13T02:12:45.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:45 smithi175 ceph-mon[36977]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-13T02:12:45.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:45 smithi175 ceph-mon[36977]: Cluster is now healthy 2024-06-13T02:12:45.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:45 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] up:active 2024-06-13T02:12:45.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:45 smithi175 ceph-mon[36977]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-13T02:12:45.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:45 smithi175 ceph-mon[36977]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-13T02:12:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:45 smithi002 ceph-mon[31960]: pgmap v329: 97 pgs: 20 creating+peering, 77 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 1 op/s 2024-06-13T02:12:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:45 smithi002 ceph-mon[31960]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-13T02:12:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:45 smithi002 ceph-mon[31960]: Cluster is now healthy 2024-06-13T02:12:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:45 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] up:active 2024-06-13T02:12:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:45 smithi002 ceph-mon[31960]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-13T02:12:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:45 smithi002 ceph-mon[31960]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-13T02:12:45.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:45 smithi084 ceph-mon[36833]: pgmap v329: 97 pgs: 20 creating+peering, 77 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 1 op/s 2024-06-13T02:12:45.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:45 smithi084 ceph-mon[36833]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-13T02:12:45.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:45 smithi084 ceph-mon[36833]: Cluster is now healthy 2024-06-13T02:12:45.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:45 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] up:active 2024-06-13T02:12:45.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:45 smithi084 ceph-mon[36833]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-13T02:12:45.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:45 smithi084 ceph-mon[36833]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-13T02:12:46.470 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:12:46 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-b[67065]: 2024-06-13T02:12:46.158+0000 7f77d2174700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-13T02:12:47.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.337+0000 7f784f400700 1 -- 172.21.15.2:0/655519618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7848108ac0 msgr2=0x7f7848108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:47.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.337+0000 7f784f400700 1 --2- 172.21.15.2:0/655519618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7848108ac0 0x7f7848108f40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7838009990 tx=0x7f7838009ca0 comp rx=0 tx=0).stop 2024-06-13T02:12:47.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.337+0000 7f784f400700 1 -- 172.21.15.2:0/655519618 shutdown_connections 2024-06-13T02:12:47.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.337+0000 7f784f400700 1 --2- 172.21.15.2:0/655519618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7848109480 0x7f7848115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:47.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.337+0000 7f784f400700 1 --2- 172.21.15.2:0/655519618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f784810eac0 0x7f784810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:47.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.337+0000 7f784f400700 1 --2- 172.21.15.2:0/655519618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7848108ac0 0x7f7848108f40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:47.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.337+0000 7f784f400700 1 -- 172.21.15.2:0/655519618 >> 172.21.15.2:0/655519618 conn(0x7f7848075c60 msgr2=0x7f78481072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:47.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.337+0000 7f784f400700 1 -- 172.21.15.2:0/655519618 shutdown_connections 2024-06-13T02:12:47.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.337+0000 7f784f400700 1 -- 172.21.15.2:0/655519618 wait complete. 2024-06-13T02:12:47.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.339+0000 7f784f400700 1 Processor -- start 2024-06-13T02:12:47.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.339+0000 7f784f400700 1 -- start start 2024-06-13T02:12:47.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.340+0000 7f784f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7848108ac0 0x7f784819f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:47.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.340+0000 7f784f400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7848109480 0x7f784819f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:47.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.340+0000 7f784f400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784810eac0 0x7f78481a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:47.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.340+0000 7f784f400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7848118e10 con 0x7f784810eac0 2024-06-13T02:12:47.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.340+0000 7f784f400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7848118c90 con 0x7f7848108ac0 2024-06-13T02:12:47.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.340+0000 7f784f400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7848118f90 con 0x7f7848109480 2024-06-13T02:12:47.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.340+0000 7f784d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784810eac0 0x7f78481a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:47.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.340+0000 7f784d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784810eac0 0x7f78481a3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41002/0 (socket says 172.21.15.2:41002) 2024-06-13T02:12:47.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.340+0000 7f784d400700 1 -- 172.21.15.2:0/1353823453 learned_addr learned my addr 172.21.15.2:0/1353823453 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:12:47.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.340+0000 7f7847e00700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7848109480 0x7f784819f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:47.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.340+0000 7f784ca00700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7848108ac0 0x7f784819f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:47.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.341+0000 7f784d400700 1 -- 172.21.15.2:0/1353823453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7848109480 msgr2=0x7f784819f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:47.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.341+0000 7f784d400700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7848109480 0x7f784819f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:47.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.341+0000 7f784d400700 1 -- 172.21.15.2:0/1353823453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7848108ac0 msgr2=0x7f784819f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:47.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.341+0000 7f784d400700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7848108ac0 0x7f784819f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:47.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.341+0000 7f784d400700 1 -- 172.21.15.2:0/1353823453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78481a4250 con 0x7f784810eac0 2024-06-13T02:12:47.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.341+0000 7f784ca00700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7848108ac0 0x7f784819f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:12:47.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.341+0000 7f7847e00700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7848109480 0x7f784819f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:12:47.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.341+0000 7f784d400700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784810eac0 0x7f78481a3b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f784000ef30 tx=0x7f784000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:47.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.341+0000 7f7845600700 1 -- 172.21.15.2:0/1353823453 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78400092e0 con 0x7f784810eac0 2024-06-13T02:12:47.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.341+0000 7f784f400700 1 -- 172.21.15.2:0/1353823453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78481a44e0 con 0x7f784810eac0 2024-06-13T02:12:47.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.341+0000 7f7845600700 1 -- 172.21.15.2:0/1353823453 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7840004bb0 con 0x7f784810eac0 2024-06-13T02:12:47.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.341+0000 7f7845600700 1 -- 172.21.15.2:0/1353823453 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840004280 con 0x7f784810eac0 2024-06-13T02:12:47.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.342+0000 7f784f400700 1 -- 172.21.15.2:0/1353823453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78481abdc0 con 0x7f784810eac0 2024-06-13T02:12:47.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.343+0000 7f784f400700 1 -- 172.21.15.2:0/1353823453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7848069180 con 0x7f784810eac0 2024-06-13T02:12:47.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.345+0000 7f7845600700 1 -- 172.21.15.2:0/1353823453 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f784001b030 con 0x7f784810eac0 2024-06-13T02:12:47.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.346+0000 7f7845600700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f78300a2c20 0x7f78300a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:47.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.346+0000 7f7845600700 1 -- 172.21.15.2:0/1353823453 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 7979+0+0 (secure 0 0 0) 0x7f78400cea10 con 0x7f784810eac0 2024-06-13T02:12:47.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.346+0000 7f784ca00700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f78300a2c20 0x7f78300a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:47.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.347+0000 7f784ca00700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f78300a2c20 0x7f78300a50e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f783c009fd0 tx=0x7f783c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:47.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.351+0000 7f7845600700 1 -- 172.21.15.2:0/1353823453 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7840022020 con 0x7f784810eac0 2024-06-13T02:12:47.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:47.591+0000 7f784f400700 1 -- 172.21.15.2:0/1353823453 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f784802dca0 con 0x7f784810eac0 2024-06-13T02:12:47.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:47 smithi175 ceph-mon[36977]: pgmap v330: 97 pgs: 97 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-06-13T02:12:47.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:47 smithi002 ceph-mon[31960]: pgmap v330: 97 pgs: 97 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-06-13T02:12:47.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:47 smithi084 ceph-mon[36833]: pgmap v330: 97 pgs: 97 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-06-13T02:12:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:48.509+0000 7f7845600700 1 -- 172.21.15.2:0/1353823453 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v90) ==== 157+0+0 (secure 0 0 0) 0x7f7840010040 con 0x7f784810eac0 2024-06-13T02:12:48.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:48.513+0000 7f784f400700 1 -- 172.21.15.2:0/1353823453 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f78300a2c20 msgr2=0x7f78300a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:48.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:48.513+0000 7f784f400700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f78300a2c20 0x7f78300a50e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f783c009fd0 tx=0x7f783c009260 comp rx=0 tx=0).stop 2024-06-13T02:12:48.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:48.513+0000 7f784f400700 1 -- 172.21.15.2:0/1353823453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784810eac0 msgr2=0x7f78481a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:48.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:48.513+0000 7f784f400700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784810eac0 0x7f78481a3b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f784000ef30 tx=0x7f784000c3a0 comp rx=0 tx=0).stop 2024-06-13T02:12:48.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:48.514+0000 7f784f400700 1 -- 172.21.15.2:0/1353823453 shutdown_connections 2024-06-13T02:12:48.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:48.514+0000 7f784f400700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f78300a2c20 0x7f78300a50e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:48.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:48.514+0000 7f784f400700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784810eac0 0x7f78481a3b10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:48.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:48.514+0000 7f784f400700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7848108ac0 0x7f784819f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:48.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:48.514+0000 7f784f400700 1 --2- 172.21.15.2:0/1353823453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7848109480 0x7f784819f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:48.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:48.514+0000 7f784f400700 1 -- 172.21.15.2:0/1353823453 >> 172.21.15.2:0/1353823453 conn(0x7f7848075c60 msgr2=0x7f78480761e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:48.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:48.514+0000 7f784f400700 1 -- 172.21.15.2:0/1353823453 shutdown_connections 2024-06-13T02:12:48.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:48.514+0000 7f784f400700 1 -- 172.21.15.2:0/1353823453 wait complete. 2024-06-13T02:12:48.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:48 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1353823453' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-13T02:12:48.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:48 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1353823453' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-13T02:12:48.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:48 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1353823453' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-06-13T02:12:49.408 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-06-13T02:12:49.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:49 smithi002 ceph-mon[31960]: pgmap v331: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-13T02:12:49.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:49 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1353823453' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-06-13T02:12:49.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:49 smithi002 ceph-mon[31960]: osdmap e90: 12 total, 12 up, 12 in 2024-06-13T02:12:49.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:49 smithi175 ceph-mon[36977]: pgmap v331: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-13T02:12:49.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:49 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1353823453' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-06-13T02:12:49.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:49 smithi175 ceph-mon[36977]: osdmap e90: 12 total, 12 up, 12 in 2024-06-13T02:12:49.881 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:12:49.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:49 smithi084 ceph-mon[36833]: pgmap v331: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-13T02:12:49.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:49 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1353823453' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-06-13T02:12:49.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:49 smithi084 ceph-mon[36833]: osdmap e90: 12 total, 12 up, 12 in 2024-06-13T02:12:51.623 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:51 smithi002 ceph-mon[31960]: pgmap v333: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-13T02:12:51.773 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:51 smithi084 ceph-mon[36833]: pgmap v333: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-13T02:12:51.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:51 smithi175 ceph-mon[36977]: pgmap v333: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-13T02:12:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.207+0000 7f3288600700 1 -- 172.21.15.2:0/3407465691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32800764b0 msgr2=0x7f32800746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.207+0000 7f3288600700 1 --2- 172.21.15.2:0/3407465691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32800764b0 0x7f32800746c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3274009990 tx=0x7f3274009ca0 comp rx=0 tx=0).stop 2024-06-13T02:12:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.207+0000 7f3288600700 1 -- 172.21.15.2:0/3407465691 shutdown_connections 2024-06-13T02:12:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.207+0000 7f3288600700 1 --2- 172.21.15.2:0/3407465691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3280113180 0x7f3280115570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.207+0000 7f3288600700 1 --2- 172.21.15.2:0/3407465691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32800764b0 0x7f32800746c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:52.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.207+0000 7f3288600700 1 --2- 172.21.15.2:0/3407465691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3280074c00 0x7f3280075080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.207+0000 7f3288600700 1 -- 172.21.15.2:0/3407465691 >> 172.21.15.2:0/3407465691 conn(0x7f3280079560 msgr2=0x7f3280079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.207+0000 7f3288600700 1 -- 172.21.15.2:0/3407465691 shutdown_connections 2024-06-13T02:12:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.207+0000 7f3288600700 1 -- 172.21.15.2:0/3407465691 wait complete. 2024-06-13T02:12:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.209+0000 7f3288600700 1 Processor -- start 2024-06-13T02:12:52.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.209+0000 7f3288600700 1 -- start start 2024-06-13T02:12:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.209+0000 7f3288600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3280074c00 0x7f328019f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.209+0000 7f3288600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800764b0 0x7f328019f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.209+0000 7f3288600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3280113180 0x7f32801a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.209+0000 7f3288600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3280118de0 con 0x7f32800764b0 2024-06-13T02:12:52.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.209+0000 7f3288600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3280118c60 con 0x7f3280074c00 2024-06-13T02:12:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.209+0000 7f3288600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3280118f60 con 0x7f3280113180 2024-06-13T02:12:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.210+0000 7f3285c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3280074c00 0x7f328019f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.210+0000 7f3285200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800764b0 0x7f328019f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.210+0000 7f3285c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3280074c00 0x7f328019f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:33218/0 (socket says 172.21.15.2:33218) 2024-06-13T02:12:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.210+0000 7f3285200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800764b0 0x7f328019f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58386/0 (socket says 172.21.15.2:58386) 2024-06-13T02:12:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.210+0000 7f3285c00700 1 -- 172.21.15.2:0/487245536 learned_addr learned my addr 172.21.15.2:0/487245536 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:12:52.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.210+0000 7f3286600700 1 --2- 172.21.15.2:0/487245536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3280113180 0x7f32801a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.210+0000 7f3285c00700 1 -- 172.21.15.2:0/487245536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3280113180 msgr2=0x7f32801a3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.210+0000 7f3285c00700 1 --2- 172.21.15.2:0/487245536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3280113180 0x7f32801a3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.210+0000 7f3285c00700 1 -- 172.21.15.2:0/487245536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800764b0 msgr2=0x7f328019f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.210+0000 7f3285c00700 1 --2- 172.21.15.2:0/487245536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800764b0 0x7f328019f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.210+0000 7f3285c00700 1 -- 172.21.15.2:0/487245536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32801a4170 con 0x7f3280074c00 2024-06-13T02:12:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.211+0000 7f3285c00700 1 --2- 172.21.15.2:0/487245536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3280074c00 0x7f328019f1b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3274000c00 tx=0x7f327400bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.211+0000 7f327e000700 1 -- 172.21.15.2:0/487245536 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3274027070 con 0x7f3280074c00 2024-06-13T02:12:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.211+0000 7f3288600700 1 -- 172.21.15.2:0/487245536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32801a4400 con 0x7f3280074c00 2024-06-13T02:12:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.211+0000 7f327e000700 1 -- 172.21.15.2:0/487245536 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3274003d70 con 0x7f3280074c00 2024-06-13T02:12:52.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.211+0000 7f327e000700 1 -- 172.21.15.2:0/487245536 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327400f460 con 0x7f3280074c00 2024-06-13T02:12:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.211+0000 7f3288600700 1 -- 172.21.15.2:0/487245536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32801abce0 con 0x7f3280074c00 2024-06-13T02:12:52.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.212+0000 7f3288600700 1 -- 172.21.15.2:0/487245536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3280050a00 con 0x7f3280074c00 2024-06-13T02:12:52.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.214+0000 7f327e000700 1 -- 172.21.15.2:0/487245536 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f327402a070 con 0x7f3280074c00 2024-06-13T02:12:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.216+0000 7f327e000700 1 --2- 172.21.15.2:0/487245536 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f32680a2cc0 0x7f32680a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.216+0000 7f327e000700 1 -- 172.21.15.2:0/487245536 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8277+0+0 (secure 0 0 0) 0x7f32740d0260 con 0x7f3280074c00 2024-06-13T02:12:52.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.216+0000 7f3285200700 1 --2- 172.21.15.2:0/487245536 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f32680a2cc0 0x7f32680a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:52.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.217+0000 7f3285200700 1 --2- 172.21.15.2:0/487245536 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f32680a2cc0 0x7f32680a5180 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3280079d10 tx=0x7f326c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:52.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.218+0000 7f327e000700 1 -- 172.21.15.2:0/487245536 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3274013070 con 0x7f3280074c00 2024-06-13T02:12:52.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:52.447+0000 7f3288600700 1 -- 172.21.15.2:0/487245536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f32801abeb0 con 0x7f3280074c00 2024-06-13T02:12:52.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:52 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/487245536' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-13T02:12:52.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:52 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-13T02:12:52.786 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:52 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/487245536' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-13T02:12:52.787 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:52 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-13T02:12:52.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:52 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/487245536' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-13T02:12:52.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:52 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-13T02:12:53.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:53.549+0000 7f327e000700 1 -- 172.21.15.2:0/487245536 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v92) ==== 228+0+0 (secure 0 0 0) 0x7f327409d1c0 con 0x7f3280074c00 2024-06-13T02:12:53.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:53.556+0000 7f3288600700 1 -- 172.21.15.2:0/487245536 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f32680a2cc0 msgr2=0x7f32680a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:53.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:53.556+0000 7f3288600700 1 --2- 172.21.15.2:0/487245536 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f32680a2cc0 0x7f32680a5180 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3280079d10 tx=0x7f326c009260 comp rx=0 tx=0).stop 2024-06-13T02:12:53.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:53.556+0000 7f3288600700 1 -- 172.21.15.2:0/487245536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3280074c00 msgr2=0x7f328019f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:53.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:53.556+0000 7f3288600700 1 --2- 172.21.15.2:0/487245536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3280074c00 0x7f328019f1b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3274000c00 tx=0x7f327400bab0 comp rx=0 tx=0).stop 2024-06-13T02:12:53.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:53.557+0000 7f3288600700 1 -- 172.21.15.2:0/487245536 shutdown_connections 2024-06-13T02:12:53.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:53.557+0000 7f3288600700 1 --2- 172.21.15.2:0/487245536 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f32680a2cc0 0x7f32680a5180 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:53.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:53.557+0000 7f3288600700 1 --2- 172.21.15.2:0/487245536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3280113180 0x7f32801a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:53.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:53.557+0000 7f3288600700 1 --2- 172.21.15.2:0/487245536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3280074c00 0x7f328019f1b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:53.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:53.557+0000 7f3288600700 1 --2- 172.21.15.2:0/487245536 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32800764b0 0x7f328019f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:53.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:53.557+0000 7f3288600700 1 -- 172.21.15.2:0/487245536 >> 172.21.15.2:0/487245536 conn(0x7f3280079560 msgr2=0x7f3280111de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:53.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:53.559+0000 7f3288600700 1 -- 172.21.15.2:0/487245536 shutdown_connections 2024-06-13T02:12:53.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:53.559+0000 7f3288600700 1 -- 172.21.15.2:0/487245536 wait complete. 2024-06-13T02:12:53.565 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data_ec' created 2024-06-13T02:12:53.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:53 smithi002 ceph-mon[31960]: pgmap v334: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-06-13T02:12:53.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:53 smithi002 ceph-mon[31960]: osdmap e91: 12 total, 12 up, 12 in 2024-06-13T02:12:53.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:53 smithi084 ceph-mon[36833]: pgmap v334: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-06-13T02:12:53.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:53 smithi084 ceph-mon[36833]: osdmap e91: 12 total, 12 up, 12 in 2024-06-13T02:12:54.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:53 smithi175 ceph-mon[36977]: pgmap v334: 97 pgs: 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-06-13T02:12:54.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:53 smithi175 ceph-mon[36977]: osdmap e91: 12 total, 12 up, 12 in 2024-06-13T02:12:54.389 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-06-13T02:12:54.879 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:12:54.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:54 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-13T02:12:54.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:54 smithi002 ceph-mon[31960]: osdmap e92: 12 total, 12 up, 12 in 2024-06-13T02:12:54.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:54 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-13T02:12:54.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:54 smithi084 ceph-mon[36833]: osdmap e92: 12 total, 12 up, 12 in 2024-06-13T02:12:55.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:54 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-13T02:12:55.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:54 smithi175 ceph-mon[36977]: osdmap e92: 12 total, 12 up, 12 in 2024-06-13T02:12:55.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:55 smithi002 ceph-mon[31960]: pgmap v337: 129 pgs: 11 creating+peering, 21 unknown, 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-06-13T02:12:55.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:55 smithi002 ceph-mon[31960]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T02:12:55.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:55 smithi002 ceph-mon[31960]: osdmap e93: 12 total, 12 up, 12 in 2024-06-13T02:12:55.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:55 smithi084 ceph-mon[36833]: pgmap v337: 129 pgs: 11 creating+peering, 21 unknown, 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-06-13T02:12:55.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:55 smithi084 ceph-mon[36833]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T02:12:55.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:55 smithi084 ceph-mon[36833]: osdmap e93: 12 total, 12 up, 12 in 2024-06-13T02:12:56.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:55 smithi175 ceph-mon[36977]: pgmap v337: 129 pgs: 11 creating+peering, 21 unknown, 97 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-06-13T02:12:56.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:55 smithi175 ceph-mon[36977]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-13T02:12:56.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:55 smithi175 ceph-mon[36977]: osdmap e93: 12 total, 12 up, 12 in 2024-06-13T02:12:56.859 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:56 smithi002 ceph-mon[31960]: osdmap e94: 12 total, 12 up, 12 in 2024-06-13T02:12:56.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:56 smithi084 ceph-mon[36833]: osdmap e94: 12 total, 12 up, 12 in 2024-06-13T02:12:57.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:56 smithi175 ceph-mon[36977]: osdmap e94: 12 total, 12 up, 12 in 2024-06-13T02:12:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.174+0000 7f3bcfe00700 1 -- 172.21.15.2:0/938265349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd010d8a0 msgr2=0x7f3bd010dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.174+0000 7f3bcfe00700 1 --2- 172.21.15.2:0/938265349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd010d8a0 0x7f3bd010dc80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009990 tx=0x7f3bc0009ca0 comp rx=0 tx=0).stop 2024-06-13T02:12:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.174+0000 7f3bcfe00700 1 -- 172.21.15.2:0/938265349 shutdown_connections 2024-06-13T02:12:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.174+0000 7f3bcfe00700 1 --2- 172.21.15.2:0/938265349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bd0109390 0x7f3bd0115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.174+0000 7f3bcfe00700 1 --2- 172.21.15.2:0/938265349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd010d8a0 0x7f3bd010dc80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.174+0000 7f3bcfe00700 1 --2- 172.21.15.2:0/938265349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd01089d0 0x7f3bd0108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.174+0000 7f3bcfe00700 1 -- 172.21.15.2:0/938265349 >> 172.21.15.2:0/938265349 conn(0x7f3bd0078220 msgr2=0x7f3bd01072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.174+0000 7f3bcfe00700 1 -- 172.21.15.2:0/938265349 shutdown_connections 2024-06-13T02:12:57.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.174+0000 7f3bcfe00700 1 -- 172.21.15.2:0/938265349 wait complete. 2024-06-13T02:12:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.176+0000 7f3bcfe00700 1 Processor -- start 2024-06-13T02:12:57.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.176+0000 7f3bcfe00700 1 -- start start 2024-06-13T02:12:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.176+0000 7f3bcfe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bd01089d0 0x7f3bd019f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.176+0000 7f3bcfe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd0109390 0x7f3bd019f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.176+0000 7f3bcfe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd010d8a0 0x7f3bd01a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.176+0000 7f3bcfe00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd0118d10 con 0x7f3bd01089d0 2024-06-13T02:12:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.176+0000 7f3bcfe00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd0118b90 con 0x7f3bd010d8a0 2024-06-13T02:12:57.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.176+0000 7f3bcfe00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd0118e90 con 0x7f3bd0109390 2024-06-13T02:12:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.177+0000 7f3bcea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bd01089d0 0x7f3bd019f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.177+0000 7f3bcf400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd010d8a0 0x7f3bd01a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.177+0000 7f3bcea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bd01089d0 0x7f3bd019f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58408/0 (socket says 172.21.15.2:58408) 2024-06-13T02:12:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.177+0000 7f3bcea00700 1 -- 172.21.15.2:0/3869654647 learned_addr learned my addr 172.21.15.2:0/3869654647 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:12:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.177+0000 7f3bce000700 1 --2- 172.21.15.2:0/3869654647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd0109390 0x7f3bd019f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.177+0000 7f3bcf400700 1 -- 172.21.15.2:0/3869654647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd0109390 msgr2=0x7f3bd019f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.177+0000 7f3bcf400700 1 --2- 172.21.15.2:0/3869654647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd0109390 0x7f3bd019f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.177+0000 7f3bcf400700 1 -- 172.21.15.2:0/3869654647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bd01089d0 msgr2=0x7f3bd019f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.177+0000 7f3bcf400700 1 --2- 172.21.15.2:0/3869654647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bd01089d0 0x7f3bd019f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.177+0000 7f3bcf400700 1 -- 172.21.15.2:0/3869654647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd01a41a0 con 0x7f3bd010d8a0 2024-06-13T02:12:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.178+0000 7f3bcf400700 1 --2- 172.21.15.2:0/3869654647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd010d8a0 0x7f3bd01a3a60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800efc0 tx=0x7f3bc800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.178+0000 7f3bc7400700 1 -- 172.21.15.2:0/3869654647 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80092e0 con 0x7f3bd010d8a0 2024-06-13T02:12:57.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.178+0000 7f3bc7400700 1 -- 172.21.15.2:0/3869654647 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bc8004bb0 con 0x7f3bd010d8a0 2024-06-13T02:12:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.178+0000 7f3bcfe00700 1 -- 172.21.15.2:0/3869654647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd01a4430 con 0x7f3bd010d8a0 2024-06-13T02:12:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.178+0000 7f3bc7400700 1 -- 172.21.15.2:0/3869654647 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8004280 con 0x7f3bd010d8a0 2024-06-13T02:12:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.178+0000 7f3bcfe00700 1 -- 172.21.15.2:0/3869654647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd01abd10 con 0x7f3bd010d8a0 2024-06-13T02:12:57.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.179+0000 7f3bcfe00700 1 -- 172.21.15.2:0/3869654647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd0069180 con 0x7f3bd010d8a0 2024-06-13T02:12:57.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.181+0000 7f3bc7400700 1 -- 172.21.15.2:0/3869654647 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f3bc8044d10 con 0x7f3bd010d8a0 2024-06-13T02:12:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.182+0000 7f3bc7400700 1 --2- 172.21.15.2:0/3869654647 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3bb40a2c20 0x7f3bb40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:12:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.183+0000 7f3bc7400700 1 -- 172.21.15.2:0/3869654647 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8770+0+0 (secure 0 0 0) 0x7f3bc80cf1a0 con 0x7f3bd010d8a0 2024-06-13T02:12:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.183+0000 7f3bcea00700 1 --2- 172.21.15.2:0/3869654647 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3bb40a2c20 0x7f3bb40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:12:57.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.183+0000 7f3bcea00700 1 --2- 172.21.15.2:0/3869654647 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3bb40a2c20 0x7f3bb40a50e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009750 tx=0x7f3bc000b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:12:57.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.185+0000 7f3bc7400700 1 -- 172.21.15.2:0/3869654647 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3bc8022020 con 0x7f3bd010d8a0 2024-06-13T02:12:57.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.415+0000 7f3bcfe00700 1 -- 172.21.15.2:0/3869654647 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f3bd002dca0 con 0x7f3bd010d8a0 2024-06-13T02:12:57.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.592+0000 7f3bc7400700 1 -- 172.21.15.2:0/3869654647 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v95) ==== 169+0+0 (secure 0 0 0) 0x7f3bc8010040 con 0x7f3bd010d8a0 2024-06-13T02:12:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.597+0000 7f3bcfe00700 1 -- 172.21.15.2:0/3869654647 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3bb40a2c20 msgr2=0x7f3bb40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.597+0000 7f3bcfe00700 1 --2- 172.21.15.2:0/3869654647 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3bb40a2c20 0x7f3bb40a50e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009750 tx=0x7f3bc000b280 comp rx=0 tx=0).stop 2024-06-13T02:12:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.597+0000 7f3bcfe00700 1 -- 172.21.15.2:0/3869654647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd010d8a0 msgr2=0x7f3bd01a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:12:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.597+0000 7f3bcfe00700 1 --2- 172.21.15.2:0/3869654647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd010d8a0 0x7f3bd01a3a60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800efc0 tx=0x7f3bc800c3a0 comp rx=0 tx=0).stop 2024-06-13T02:12:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.598+0000 7f3bcfe00700 1 -- 172.21.15.2:0/3869654647 shutdown_connections 2024-06-13T02:12:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.598+0000 7f3bcfe00700 1 --2- 172.21.15.2:0/3869654647 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3bb40a2c20 0x7f3bb40a50e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.598+0000 7f3bcfe00700 1 --2- 172.21.15.2:0/3869654647 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3bd010d8a0 0x7f3bd01a3a60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.598+0000 7f3bcfe00700 1 --2- 172.21.15.2:0/3869654647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bd01089d0 0x7f3bd019f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.598+0000 7f3bcfe00700 1 --2- 172.21.15.2:0/3869654647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3bd0109390 0x7f3bd019f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:12:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.598+0000 7f3bcfe00700 1 -- 172.21.15.2:0/3869654647 >> 172.21.15.2:0/3869654647 conn(0x7f3bd0078220 msgr2=0x7f3bd0078880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:12:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.598+0000 7f3bcfe00700 1 -- 172.21.15.2:0/3869654647 shutdown_connections 2024-06-13T02:12:57.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:12:57.598+0000 7f3bcfe00700 1 -- 172.21.15.2:0/3869654647 wait complete. 2024-06-13T02:12:57.601 INFO:teuthology.orchestra.run.smithi002.stderr:set pool 4 allow_ec_overwrites to true 2024-06-13T02:12:57.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:57 smithi002 ceph-mon[31960]: pgmap v340: 129 pgs: 12 creating+peering, 13 unknown, 104 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:57.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:57 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3869654647' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-13T02:12:57.671 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:57 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-13T02:12:57.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:57 smithi084 ceph-mon[36833]: pgmap v340: 129 pgs: 12 creating+peering, 13 unknown, 104 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:57.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:57 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3869654647' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-13T02:12:57.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:57 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-13T02:12:58.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:57 smithi175 ceph-mon[36977]: pgmap v340: 129 pgs: 12 creating+peering, 13 unknown, 104 active+clean; 579 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:58.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:57 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3869654647' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-13T02:12:58.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:57 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-06-13T02:12:58.319 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-06-13T02:12:58.749 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:12:58.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:58 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-13T02:12:58.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:58 smithi002 ceph-mon[31960]: osdmap e95: 12 total, 12 up, 12 in 2024-06-13T02:12:58.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:58 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-13T02:12:58.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:58 smithi084 ceph-mon[36833]: osdmap e95: 12 total, 12 up, 12 in 2024-06-13T02:12:59.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:58 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-06-13T02:12:59.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:58 smithi175 ceph-mon[36977]: osdmap e95: 12 total, 12 up, 12 in 2024-06-13T02:12:59.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:12:59 smithi002 ceph-mon[31960]: pgmap v342: 129 pgs: 12 creating+peering, 117 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:12:59.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:12:59 smithi084 ceph-mon[36833]: pgmap v342: 129 pgs: 12 creating+peering, 117 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:00.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:12:59 smithi175 ceph-mon[36977]: pgmap v342: 129 pgs: 12 creating+peering, 117 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.917+0000 7ffa92600700 1 -- 172.21.15.2:0/1358559586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa8c105070 msgr2=0x7ffa8c111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.917+0000 7ffa92600700 1 --2- 172.21.15.2:0/1358559586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa8c105070 0x7ffa8c111580 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400b0a0 tx=0x7ffa8400b3b0 comp rx=0 tx=0).stop 2024-06-13T02:13:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.917+0000 7ffa92600700 1 -- 172.21.15.2:0/1358559586 shutdown_connections 2024-06-13T02:13:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.917+0000 7ffa92600700 1 --2- 172.21.15.2:0/1358559586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa8c105070 0x7ffa8c111580 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.917+0000 7ffa92600700 1 --2- 172.21.15.2:0/1358559586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa8c10a6b0 0x7ffa8c10aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:00.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.917+0000 7ffa92600700 1 --2- 172.21.15.2:0/1358559586 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c1046b0 0x7ffa8c104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:00.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.917+0000 7ffa92600700 1 -- 172.21.15.2:0/1358559586 >> 172.21.15.2:0/1358559586 conn(0x7ffa8c1001a0 msgr2=0x7ffa8c1025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:00.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.917+0000 7ffa92600700 1 -- 172.21.15.2:0/1358559586 shutdown_connections 2024-06-13T02:13:00.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.917+0000 7ffa92600700 1 -- 172.21.15.2:0/1358559586 wait complete. 2024-06-13T02:13:00.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.919+0000 7ffa92600700 1 Processor -- start 2024-06-13T02:13:00.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.919+0000 7ffa92600700 1 -- start start 2024-06-13T02:13:00.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.919+0000 7ffa92600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa8c1046b0 0x7ffa8c19adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:00.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.919+0000 7ffa92600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa8c105070 0x7ffa8c19b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:00.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.919+0000 7ffa92600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c10a6b0 0x7ffa8c19f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:00.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.919+0000 7ffa92600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c1149e0 con 0x7ffa8c105070 2024-06-13T02:13:00.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.919+0000 7ffa92600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c114860 con 0x7ffa8c10a6b0 2024-06-13T02:13:00.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.919+0000 7ffa92600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c114b60 con 0x7ffa8c1046b0 2024-06-13T02:13:00.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.920+0000 7ffa8b400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa8c1046b0 0x7ffa8c19adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:00.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.920+0000 7ffa8aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa8c105070 0x7ffa8c19b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:00.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.920+0000 7ffa8b400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa8c1046b0 0x7ffa8c19adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:49812/0 (socket says 172.21.15.2:49812) 2024-06-13T02:13:00.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.920+0000 7ffa8b400700 1 -- 172.21.15.2:0/835419262 learned_addr learned my addr 172.21.15.2:0/835419262 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:00.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.920+0000 7ffa8be00700 1 --2- 172.21.15.2:0/835419262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c10a6b0 0x7ffa8c19f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:00.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.920+0000 7ffa8aa00700 1 -- 172.21.15.2:0/835419262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa8c1046b0 msgr2=0x7ffa8c19adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:00.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.920+0000 7ffa8aa00700 1 --2- 172.21.15.2:0/835419262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa8c1046b0 0x7ffa8c19adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:00.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.920+0000 7ffa8aa00700 1 -- 172.21.15.2:0/835419262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c10a6b0 msgr2=0x7ffa8c19f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:00.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.920+0000 7ffa8aa00700 1 --2- 172.21.15.2:0/835419262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c10a6b0 0x7ffa8c19f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:00.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.920+0000 7ffa8aa00700 1 -- 172.21.15.2:0/835419262 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8c19fe00 con 0x7ffa8c105070 2024-06-13T02:13:00.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.920+0000 7ffa8be00700 1 --2- 172.21.15.2:0/835419262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c10a6b0 0x7ffa8c19f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:13:00.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.921+0000 7ffa8aa00700 1 --2- 172.21.15.2:0/835419262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa8c105070 0x7ffa8c19b330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800e9f0 tx=0x7ffa7800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:00.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.921+0000 7ffa83e00700 1 -- 172.21.15.2:0/835419262 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800c9c0 con 0x7ffa8c105070 2024-06-13T02:13:00.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.921+0000 7ffa92600700 1 -- 172.21.15.2:0/835419262 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8c1a00f0 con 0x7ffa8c105070 2024-06-13T02:13:00.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.921+0000 7ffa83e00700 1 -- 172.21.15.2:0/835419262 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa7800cb60 con 0x7ffa8c105070 2024-06-13T02:13:00.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.921+0000 7ffa83e00700 1 -- 172.21.15.2:0/835419262 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa78018680 con 0x7ffa8c105070 2024-06-13T02:13:00.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.921+0000 7ffa92600700 1 -- 172.21.15.2:0/835419262 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa8c1a7970 con 0x7ffa8c105070 2024-06-13T02:13:00.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.922+0000 7ffa92600700 1 -- 172.21.15.2:0/835419262 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa8c069180 con 0x7ffa8c105070 2024-06-13T02:13:00.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.926+0000 7ffa83e00700 1 -- 172.21.15.2:0/835419262 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ffa78010430 con 0x7ffa8c105070 2024-06-13T02:13:00.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.927+0000 7ffa83e00700 1 --2- 172.21.15.2:0/835419262 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ffa700a2ca0 0x7ffa700a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:00.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.927+0000 7ffa83e00700 1 -- 172.21.15.2:0/835419262 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8770+0+0 (secure 0 0 0) 0x7ffa780cf4f0 con 0x7ffa8c105070 2024-06-13T02:13:00.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.928+0000 7ffa8b400700 1 --2- 172.21.15.2:0/835419262 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ffa700a2ca0 0x7ffa700a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:00.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.929+0000 7ffa8b400700 1 --2- 172.21.15.2:0/835419262 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ffa700a2ca0 0x7ffa700a5160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009ca0 tx=0x7ffa7c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:00.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:00.931+0000 7ffa83e00700 1 -- 172.21.15.2:0/835419262 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ffa7809c230 con 0x7ffa8c105070 2024-06-13T02:13:01.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:01.215+0000 7ffa92600700 1 -- 172.21.15.2:0/835419262 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7ffa8c02dca0 con 0x7ffa8c105070 2024-06-13T02:13:01.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:01.612+0000 7ffa83e00700 1 -- 172.21.15.2:0/835419262 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7ffa7809bb30 con 0x7ffa8c105070 2024-06-13T02:13:01.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:01.618+0000 7ffa92600700 1 -- 172.21.15.2:0/835419262 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ffa700a2ca0 msgr2=0x7ffa700a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:01.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:01.618+0000 7ffa92600700 1 --2- 172.21.15.2:0/835419262 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ffa700a2ca0 0x7ffa700a5160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009ca0 tx=0x7ffa7c009260 comp rx=0 tx=0).stop 2024-06-13T02:13:01.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:01.618+0000 7ffa92600700 1 -- 172.21.15.2:0/835419262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa8c105070 msgr2=0x7ffa8c19b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:01.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:01.618+0000 7ffa92600700 1 --2- 172.21.15.2:0/835419262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa8c105070 0x7ffa8c19b330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800e9f0 tx=0x7ffa7800ed00 comp rx=0 tx=0).stop 2024-06-13T02:13:01.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:01.618+0000 7ffa92600700 1 -- 172.21.15.2:0/835419262 shutdown_connections 2024-06-13T02:13:01.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:01.618+0000 7ffa92600700 1 --2- 172.21.15.2:0/835419262 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ffa700a2ca0 0x7ffa700a5160 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:01.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:01.618+0000 7ffa92600700 1 --2- 172.21.15.2:0/835419262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c10a6b0 0x7ffa8c19f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:01.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:01.618+0000 7ffa92600700 1 --2- 172.21.15.2:0/835419262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa8c1046b0 0x7ffa8c19adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:01.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:01.618+0000 7ffa92600700 1 --2- 172.21.15.2:0/835419262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa8c105070 0x7ffa8c19b330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:01.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:01.618+0000 7ffa92600700 1 -- 172.21.15.2:0/835419262 >> 172.21.15.2:0/835419262 conn(0x7ffa8c1001a0 msgr2=0x7ffa8c1006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:01.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:01.619+0000 7ffa92600700 1 -- 172.21.15.2:0/835419262 shutdown_connections 2024-06-13T02:13:01.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:01.619+0000 7ffa92600700 1 -- 172.21.15.2:0/835419262 wait complete. 2024-06-13T02:13:01.622 INFO:teuthology.orchestra.run.smithi002.stderr:added data pool 4 to fsmap 2024-06-13T02:13:01.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:01 smithi002 ceph-mon[31960]: pgmap v343: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:01.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:01 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/835419262' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-13T02:13:01.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:01 smithi084 ceph-mon[36833]: pgmap v343: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:01.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:01 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/835419262' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-13T02:13:02.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:01 smithi175 ceph-mon[36977]: pgmap v343: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:02.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:01 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/835419262' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-06-13T02:13:02.598 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:13:02.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:02 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/835419262' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-06-13T02:13:02.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:02 smithi002 ceph-mon[31960]: osdmap e96: 12 total, 12 up, 12 in 2024-06-13T02:13:02.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:02 smithi002 ceph-mon[31960]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-13T02:13:02.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:02 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/835419262' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-06-13T02:13:02.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:02 smithi084 ceph-mon[36833]: osdmap e96: 12 total, 12 up, 12 in 2024-06-13T02:13:02.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:02 smithi084 ceph-mon[36833]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-13T02:13:03.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:02 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/835419262' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-06-13T02:13:03.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:02 smithi175 ceph-mon[36977]: osdmap e96: 12 total, 12 up, 12 in 2024-06-13T02:13:03.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:02 smithi175 ceph-mon[36977]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-13T02:13:03.078 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:13:03.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:03 smithi002 ceph-mon[31960]: pgmap v345: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:03.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:03 smithi002 ceph-mon[31960]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-13T02:13:03.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:03 smithi002 ceph-mon[31960]: Cluster is now healthy 2024-06-13T02:13:03.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:03 smithi084 ceph-mon[36833]: pgmap v345: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:03.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:03 smithi084 ceph-mon[36833]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-13T02:13:03.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:03 smithi084 ceph-mon[36833]: Cluster is now healthy 2024-06-13T02:13:04.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:03 smithi175 ceph-mon[36977]: pgmap v345: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:04.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:03 smithi175 ceph-mon[36977]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-06-13T02:13:04.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:03 smithi175 ceph-mon[36977]: Cluster is now healthy 2024-06-13T02:13:05.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.234+0000 7f289cc00700 1 -- 172.21.15.2:0/3131645064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2898107840 msgr2=0x7f289810f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:05.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.234+0000 7f289cc00700 1 --2- 172.21.15.2:0/3131645064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2898107840 0x7f289810f3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f289000b0a0 tx=0x7f289000b3b0 comp rx=0 tx=0).stop 2024-06-13T02:13:05.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.234+0000 7f289cc00700 1 -- 172.21.15.2:0/3131645064 shutdown_connections 2024-06-13T02:13:05.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.234+0000 7f289cc00700 1 --2- 172.21.15.2:0/3131645064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2898107840 0x7f289810f3c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:05.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.234+0000 7f289cc00700 1 --2- 172.21.15.2:0/3131645064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2898102740 0x7f2898102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:05.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.234+0000 7f289cc00700 1 --2- 172.21.15.2:0/3131645064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f28981030f0 0x7f2898107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:05.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.234+0000 7f289cc00700 1 -- 172.21.15.2:0/3131645064 >> 172.21.15.2:0/3131645064 conn(0x7f28980795f0 msgr2=0x7f2898079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:05.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.234+0000 7f289cc00700 1 -- 172.21.15.2:0/3131645064 shutdown_connections 2024-06-13T02:13:05.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.234+0000 7f289cc00700 1 -- 172.21.15.2:0/3131645064 wait complete. 2024-06-13T02:13:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.235+0000 7f289cc00700 1 Processor -- start 2024-06-13T02:13:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.236+0000 7f289cc00700 1 -- start start 2024-06-13T02:13:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.236+0000 7f289cc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2898102740 0x7f2898074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.236+0000 7f289cc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28981030f0 0x7f2898074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.236+0000 7f289cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2898107840 0x7f2898075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.236+0000 7f289cc00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f28981127b0 con 0x7f2898107840 2024-06-13T02:13:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.236+0000 7f289cc00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2898112630 con 0x7f2898102740 2024-06-13T02:13:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.236+0000 7f289cc00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2898112930 con 0x7f28981030f0 2024-06-13T02:13:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.236+0000 7f2895e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2898102740 0x7f2898074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:05.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.236+0000 7f2896800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2898107840 0x7f2898075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.236+0000 7f2895e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2898102740 0x7f2898074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37322/0 (socket says 172.21.15.2:37322) 2024-06-13T02:13:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.236+0000 7f2895e00700 1 -- 172.21.15.2:0/3209457903 learned_addr learned my addr 172.21.15.2:0/3209457903 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.236+0000 7f2895400700 1 --2- 172.21.15.2:0/3209457903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28981030f0 0x7f2898074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:05.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.237+0000 7f2895e00700 1 -- 172.21.15.2:0/3209457903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28981030f0 msgr2=0x7f2898074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.237+0000 7f2895e00700 1 --2- 172.21.15.2:0/3209457903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28981030f0 0x7f2898074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.237+0000 7f2895e00700 1 -- 172.21.15.2:0/3209457903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2898107840 msgr2=0x7f2898075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.237+0000 7f2895e00700 1 --2- 172.21.15.2:0/3209457903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2898107840 0x7f2898075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.237+0000 7f2895e00700 1 -- 172.21.15.2:0/3209457903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28981a70f0 con 0x7f2898102740 2024-06-13T02:13:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.237+0000 7f2896800700 1 --2- 172.21.15.2:0/3209457903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2898107840 0x7f2898075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:13:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.237+0000 7f2895e00700 1 --2- 172.21.15.2:0/3209457903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2898102740 0x7f2898074790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f288800e9a0 tx=0x7f288800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.237+0000 7f288ea00700 1 -- 172.21.15.2:0/3209457903 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288800ca10 con 0x7f2898102740 2024-06-13T02:13:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.238+0000 7f289cc00700 1 -- 172.21.15.2:0/3209457903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28981a73e0 con 0x7f2898102740 2024-06-13T02:13:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.238+0000 7f288ea00700 1 -- 172.21.15.2:0/3209457903 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f288800cbb0 con 0x7f2898102740 2024-06-13T02:13:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.238+0000 7f288ea00700 1 -- 172.21.15.2:0/3209457903 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888018680 con 0x7f2898102740 2024-06-13T02:13:05.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.238+0000 7f289cc00700 1 -- 172.21.15.2:0/3209457903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28981a7970 con 0x7f2898102740 2024-06-13T02:13:05.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.239+0000 7f289cc00700 1 -- 172.21.15.2:0/3209457903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2898069180 con 0x7f2898102740 2024-06-13T02:13:05.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.241+0000 7f288ea00700 1 -- 172.21.15.2:0/3209457903 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2888010430 con 0x7f2898102740 2024-06-13T02:13:05.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.242+0000 7f288ea00700 1 --2- 172.21.15.2:0/3209457903 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f287c0a2ca0 0x7f287c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:05.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.242+0000 7f288ea00700 1 -- 172.21.15.2:0/3209457903 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8802+0+0 (secure 0 0 0) 0x7f28880cf460 con 0x7f2898102740 2024-06-13T02:13:05.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.242+0000 7f2895400700 1 --2- 172.21.15.2:0/3209457903 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f287c0a2ca0 0x7f287c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:05.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.243+0000 7f2895400700 1 --2- 172.21.15.2:0/3209457903 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f287c0a2ca0 0x7f287c0a5160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f28981071e0 tx=0x7f2884009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:05.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.246+0000 7f288ea00700 1 -- 172.21.15.2:0/3209457903 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f288809c120 con 0x7f2898102740 2024-06-13T02:13:05.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.524+0000 7f289cc00700 1 -- 172.21.15.2:0/3209457903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f289802dca0 con 0x7f2898102740 2024-06-13T02:13:05.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.525+0000 7f288ea00700 1 -- 172.21.15.2:0/3209457903 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11785 (secure 0 0 0) 0x7f288809ba20 con 0x7f2898102740 2024-06-13T02:13:05.527 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:13:05.528 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3458450195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3458450195},{"type":"v1","addr":"172.21.15.2:6841","nonce":3458450195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1709394731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1709394731},{"type":"v1","addr":"172.21.15.175:6835","nonce":1709394731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/2403775181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2403775181},{"type":"v1","addr":"172.21.15.84:6835","nonce":2403775181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1446546569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1446546569},{"type":"v1","addr":"172.21.15.175:6837","nonce":1446546569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2537381027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2537381027},{"type":"v1","addr":"172.21.15.84:6837","nonce":2537381027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/2743442301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":2743442301},{"type":"v1","addr":"172.21.15.175:6839","nonce":2743442301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24503,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3208917373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3208917373},{"type":"v1","addr":"172.21.15.2:6839","nonce":3208917373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T02:12:43.063161+0000","modified":"2024-06-13T02:13:01.217895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24527},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6839/541041266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":541041266},{"type":"v1","addr":"172.21.15.84:6839","nonce":541041266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24527,"qdb_cluster":[24527]},"id":1}]} 2024-06-13T02:13:05.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.530+0000 7f289cc00700 1 -- 172.21.15.2:0/3209457903 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f287c0a2ca0 msgr2=0x7f287c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:05.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.530+0000 7f289cc00700 1 --2- 172.21.15.2:0/3209457903 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f287c0a2ca0 0x7f287c0a5160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f28981071e0 tx=0x7f2884009260 comp rx=0 tx=0).stop 2024-06-13T02:13:05.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.530+0000 7f289cc00700 1 -- 172.21.15.2:0/3209457903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2898102740 msgr2=0x7f2898074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:05.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.530+0000 7f289cc00700 1 --2- 172.21.15.2:0/3209457903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2898102740 0x7f2898074790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f288800e9a0 tx=0x7f288800ecb0 comp rx=0 tx=0).stop 2024-06-13T02:13:05.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.530+0000 7f289cc00700 1 -- 172.21.15.2:0/3209457903 shutdown_connections 2024-06-13T02:13:05.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.530+0000 7f289cc00700 1 --2- 172.21.15.2:0/3209457903 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f287c0a2ca0 0x7f287c0a5160 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:05.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.530+0000 7f289cc00700 1 --2- 172.21.15.2:0/3209457903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2898107840 0x7f2898075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:05.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.530+0000 7f289cc00700 1 --2- 172.21.15.2:0/3209457903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2898102740 0x7f2898074790 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:05.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.530+0000 7f289cc00700 1 --2- 172.21.15.2:0/3209457903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28981030f0 0x7f2898074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:05.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.530+0000 7f289cc00700 1 -- 172.21.15.2:0/3209457903 >> 172.21.15.2:0/3209457903 conn(0x7f28980795f0 msgr2=0x7f2898100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:05.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.530+0000 7f289cc00700 1 -- 172.21.15.2:0/3209457903 shutdown_connections 2024-06-13T02:13:05.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:05.530+0000 7f289cc00700 1 -- 172.21.15.2:0/3209457903 wait complete. 2024-06-13T02:13:05.534 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-06-13T02:13:05.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:05 smithi002 ceph-mon[31960]: pgmap v346: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:05 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3209457903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:13:05.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:05 smithi084 ceph-mon[36833]: pgmap v346: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:05.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:05 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3209457903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:13:06.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:05 smithi175 ceph-mon[36977]: pgmap v346: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:06.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:05 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3209457903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:13:06.429 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T02:13:06.904 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:13:07.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:07 smithi002 ceph-mon[31960]: pgmap v347: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:07.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:07 smithi084 ceph-mon[36833]: pgmap v347: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:08.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:07 smithi175 ceph-mon[36977]: pgmap v347: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:09.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.206+0000 7fc457200700 1 -- 172.21.15.2:0/2360240798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4581035d0 msgr2=0x7fc4581039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.206+0000 7fc457200700 1 --2- 172.21.15.2:0/2360240798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4581035d0 0x7fc4581039b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc4480098f0 tx=0x7fc448009c00 comp rx=0 tx=0).stop 2024-06-13T02:13:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.206+0000 7fc457200700 1 -- 172.21.15.2:0/2360240798 shutdown_connections 2024-06-13T02:13:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.206+0000 7fc457200700 1 --2- 172.21.15.2:0/2360240798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc45810ca00 0x7fc45810eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.206+0000 7fc457200700 1 --2- 172.21.15.2:0/2360240798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4581035d0 0x7fc4581039b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.206+0000 7fc457200700 1 --2- 172.21.15.2:0/2360240798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc458103ef0 0x7fc45810c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.206+0000 7fc457200700 1 -- 172.21.15.2:0/2360240798 >> 172.21.15.2:0/2360240798 conn(0x7fc4580fce20 msgr2=0x7fc4580ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.206+0000 7fc457200700 1 -- 172.21.15.2:0/2360240798 shutdown_connections 2024-06-13T02:13:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.206+0000 7fc457200700 1 -- 172.21.15.2:0/2360240798 wait complete. 2024-06-13T02:13:09.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.207+0000 7fc457200700 1 Processor -- start 2024-06-13T02:13:09.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.208+0000 7fc457200700 1 -- start start 2024-06-13T02:13:09.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.208+0000 7fc457200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4581035d0 0x7fc45819ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:09.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.208+0000 7fc457200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc458103ef0 0x7fc45819b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:09.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.208+0000 7fc457200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc45810ca00 0x7fc45819f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:09.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.208+0000 7fc457200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc458112790 con 0x7fc4581035d0 2024-06-13T02:13:09.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.208+0000 7fc457200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc458112610 con 0x7fc458103ef0 2024-06-13T02:13:09.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.208+0000 7fc457200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc458112910 con 0x7fc45810ca00 2024-06-13T02:13:09.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.208+0000 7fc455e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4581035d0 0x7fc45819ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:09.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.208+0000 7fc455400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc458103ef0 0x7fc45819b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:09.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.208+0000 7fc455e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4581035d0 0x7fc45819ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40242/0 (socket says 172.21.15.2:40242) 2024-06-13T02:13:09.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.208+0000 7fc455e00700 1 -- 172.21.15.2:0/2259534688 learned_addr learned my addr 172.21.15.2:0/2259534688 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:09.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.209+0000 7fc456800700 1 --2- 172.21.15.2:0/2259534688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc45810ca00 0x7fc45819f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:09.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.209+0000 7fc455e00700 1 -- 172.21.15.2:0/2259534688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc45810ca00 msgr2=0x7fc45819f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:09.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.209+0000 7fc455e00700 1 --2- 172.21.15.2:0/2259534688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc45810ca00 0x7fc45819f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:09.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.209+0000 7fc455e00700 1 -- 172.21.15.2:0/2259534688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc458103ef0 msgr2=0x7fc45819b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:09.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.209+0000 7fc455e00700 1 --2- 172.21.15.2:0/2259534688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc458103ef0 0x7fc45819b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:09.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.209+0000 7fc455e00700 1 -- 172.21.15.2:0/2259534688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45819fe90 con 0x7fc4581035d0 2024-06-13T02:13:09.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.209+0000 7fc455400700 1 --2- 172.21.15.2:0/2259534688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc458103ef0 0x7fc45819b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:13:09.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.209+0000 7fc455e00700 1 --2- 172.21.15.2:0/2259534688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4581035d0 0x7fc45819ae80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc448005950 tx=0x7fc448005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:09.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.210+0000 7fc44ea00700 1 -- 172.21.15.2:0/2259534688 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4480052e0 con 0x7fc4581035d0 2024-06-13T02:13:09.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.210+0000 7fc44ea00700 1 -- 172.21.15.2:0/2259534688 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc44800ba40 con 0x7fc4581035d0 2024-06-13T02:13:09.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.210+0000 7fc457200700 1 -- 172.21.15.2:0/2259534688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4581a0120 con 0x7fc4581035d0 2024-06-13T02:13:09.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.210+0000 7fc44ea00700 1 -- 172.21.15.2:0/2259534688 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc448003b80 con 0x7fc4581035d0 2024-06-13T02:13:09.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.210+0000 7fc457200700 1 -- 172.21.15.2:0/2259534688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4581a7a00 con 0x7fc4581035d0 2024-06-13T02:13:09.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.211+0000 7fc457200700 1 -- 172.21.15.2:0/2259534688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc458069180 con 0x7fc4581035d0 2024-06-13T02:13:09.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.213+0000 7fc44ea00700 1 -- 172.21.15.2:0/2259534688 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc448005480 con 0x7fc4581035d0 2024-06-13T02:13:09.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.214+0000 7fc44ea00700 1 --2- 172.21.15.2:0/2259534688 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc43c0a2c20 0x7fc43c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:09.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.215+0000 7fc44ea00700 1 -- 172.21.15.2:0/2259534688 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8802+0+0 (secure 0 0 0) 0x7fc4480d09f0 con 0x7fc4581035d0 2024-06-13T02:13:09.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.215+0000 7fc455400700 1 --2- 172.21.15.2:0/2259534688 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc43c0a2c20 0x7fc43c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:09.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.215+0000 7fc455400700 1 --2- 172.21.15.2:0/2259534688 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc43c0a2c20 0x7fc43c0a50e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc45810f2f0 tx=0x7fc440009100 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:09.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.217+0000 7fc44ea00700 1 -- 172.21.15.2:0/2259534688 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc448013030 con 0x7fc4581035d0 2024-06-13T02:13:09.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.445+0000 7fc457200700 1 -- 172.21.15.2:0/2259534688 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4581a7bd0 con 0x7fc4581035d0 2024-06-13T02:13:09.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.448+0000 7fc44ea00700 1 -- 172.21.15.2:0/2259534688 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+24036 (secure 0 0 0) 0x7fc44809d740 con 0x7fc4581035d0 2024-06-13T02:13:09.450 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:13:09.450 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":96,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","created":"2024-06-13T02:03:16.412002+0000","modified":"2024-06-13T02:13:01.217478+0000","last_up_change":"2024-06-13T02:11:26.464184+0000","last_in_change":"2024-06-13T02:11:06.957351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T02:07:10.994857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T02:12:34.674172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T02:12:39.213985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T02:12:53.098590+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96b4d494-453c-48aa-b1e2-ee30dfa83e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6803","nonce":3254812126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6805","nonce":3254812126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6809","nonce":3254812126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6807","nonce":3254812126}]},"public_addr":"172.21.15.2:6803/3254812126","cluster_addr":"172.21.15.2:6805/3254812126","heartbeat_back_addr":"172.21.15.2:6809/3254812126","heartbeat_front_addr":"172.21.15.2:6807/3254812126","state":["exists","up"]},{"osd":1,"uuid":"856e86b6-9281-485b-a36b-2fe04de31329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6801","nonce":1593775403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6803","nonce":1593775403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6807","nonce":1593775403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6805","nonce":1593775403}]},"public_addr":"172.21.15.84:6801/1593775403","cluster_addr":"172.21.15.84:6803/1593775403","heartbeat_back_addr":"172.21.15.84:6807/1593775403","heartbeat_front_addr":"172.21.15.84:6805/1593775403","state":["exists","up"]},{"osd":2,"uuid":"8c9daa52-0dfb-471a-afb4-6eb0b908195a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6801","nonce":2174304558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6803","nonce":2174304558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6807","nonce":2174304558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6805","nonce":2174304558}]},"public_addr":"172.21.15.175:6801/2174304558","cluster_addr":"172.21.15.175:6803/2174304558","heartbeat_back_addr":"172.21.15.175:6807/2174304558","heartbeat_front_addr":"172.21.15.175:6805/2174304558","state":["exists","up"]},{"osd":3,"uuid":"2e747d36-4aa5-4c4c-918d-b8100980cc8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6811","nonce":3010864289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6813","nonce":3010864289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6817","nonce":3010864289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6815","nonce":3010864289}]},"public_addr":"172.21.15.2:6811/3010864289","cluster_addr":"172.21.15.2:6813/3010864289","heartbeat_back_addr":"172.21.15.2:6817/3010864289","heartbeat_front_addr":"172.21.15.2:6815/3010864289","state":["exists","up"]},{"osd":4,"uuid":"bd063fb2-1a65-4b18-898c-f80ddc2a1229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6809","nonce":2541323390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6811","nonce":2541323390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6815","nonce":2541323390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6813","nonce":2541323390}]},"public_addr":"172.21.15.84:6809/2541323390","cluster_addr":"172.21.15.84:6811/2541323390","heartbeat_back_addr":"172.21.15.84:6815/2541323390","heartbeat_front_addr":"172.21.15.84:6813/2541323390","state":["exists","up"]},{"osd":5,"uuid":"e0ea80fd-1bfe-4d2e-9733-ff442ec015b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6809","nonce":764262885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6811","nonce":764262885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6815","nonce":764262885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6813","nonce":764262885}]},"public_addr":"172.21.15.175:6809/764262885","cluster_addr":"172.21.15.175:6811/764262885","heartbeat_back_addr":"172.21.15.175:6815/764262885","heartbeat_front_addr":"172.21.15.175:6813/764262885","state":["exists","up"]},{"osd":6,"uuid":"1c204d74-5e48-4e2e-bb98-6a8d4974187c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6819","nonce":297321106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6821","nonce":297321106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6825","nonce":297321106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6823","nonce":297321106}]},"public_addr":"172.21.15.2:6819/297321106","cluster_addr":"172.21.15.2:6821/297321106","heartbeat_back_addr":"172.21.15.2:6825/297321106","heartbeat_front_addr":"172.21.15.2:6823/297321106","state":["exists","up"]},{"osd":7,"uuid":"1299bbb1-fbfb-4aba-be6b-6704691735f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6817","nonce":3873726653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6819","nonce":3873726653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6823","nonce":3873726653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6821","nonce":3873726653}]},"public_addr":"172.21.15.84:6817/3873726653","cluster_addr":"172.21.15.84:6819/3873726653","heartbeat_back_addr":"172.21.15.84:6823/3873726653","heartbeat_front_addr":"172.21.15.84:6821/3873726653","state":["exists","up"]},{"osd":8,"uuid":"9c3f2a92-d956-4246-bce9-620824d0da22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6817","nonce":2622818232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6819","nonce":2622818232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6823","nonce":2622818232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6821","nonce":2622818232}]},"public_addr":"172.21.15.175:6817/2622818232","cluster_addr":"172.21.15.175:6819/2622818232","heartbeat_back_addr":"172.21.15.175:6823/2622818232","heartbeat_front_addr":"172.21.15.175:6821/2622818232","state":["exists","up"]},{"osd":9,"uuid":"e9839f78-05c6-4b3f-bc14-cb771a03ff5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6827","nonce":1171735390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6829","nonce":1171735390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6833","nonce":1171735390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6831","nonce":1171735390}]},"public_addr":"172.21.15.2:6827/1171735390","cluster_addr":"172.21.15.2:6829/1171735390","heartbeat_back_addr":"172.21.15.2:6833/1171735390","heartbeat_front_addr":"172.21.15.2:6831/1171735390","state":["exists","up"]},{"osd":10,"uuid":"66719431-5ba9-4865-957b-f6582e607a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6825","nonce":4269523460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6827","nonce":4269523460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6831","nonce":4269523460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6829","nonce":4269523460}]},"public_addr":"172.21.15.84:6825/4269523460","cluster_addr":"172.21.15.84:6827/4269523460","heartbeat_back_addr":"172.21.15.84:6831/4269523460","heartbeat_front_addr":"172.21.15.84:6829/4269523460","state":["exists","up"]},{"osd":11,"uuid":"1ce6e6ee-6ff3-416f-b985-e3afe503093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6825","nonce":2762894732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6827","nonce":2762894732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6831","nonce":2762894732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6829","nonce":2762894732}]},"public_addr":"172.21.15.175:6825/2762894732","cluster_addr":"172.21.15.175:6827/2762894732","heartbeat_back_addr":"172.21.15.175:6831/2762894732","heartbeat_front_addr":"172.21.15.175:6829/2762894732","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:16.956638+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:42.268685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:06.272084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:39.696927+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:06.182991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:31.626603+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:05.247728+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:31.985114+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:57.474180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:31.988863+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:59.683056+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:11:24.493248+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6800/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3397168014":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/1789744365":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3831398703":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/3119270562":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/2163302458":"2024-06-14T02:03:50.073572+0000","172.21.15.2:6800/2830681579":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/1678672435":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6801/2830681579":"2024-06-14T02:03:50.073572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T02:13:09.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.450+0000 7fc457200700 1 -- 172.21.15.2:0/2259534688 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc43c0a2c20 msgr2=0x7fc43c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:09.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.450+0000 7fc457200700 1 --2- 172.21.15.2:0/2259534688 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc43c0a2c20 0x7fc43c0a50e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc45810f2f0 tx=0x7fc440009100 comp rx=0 tx=0).stop 2024-06-13T02:13:09.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.451+0000 7fc457200700 1 -- 172.21.15.2:0/2259534688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4581035d0 msgr2=0x7fc45819ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:09.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.451+0000 7fc457200700 1 --2- 172.21.15.2:0/2259534688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4581035d0 0x7fc45819ae80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc448005950 tx=0x7fc448005040 comp rx=0 tx=0).stop 2024-06-13T02:13:09.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.451+0000 7fc457200700 1 -- 172.21.15.2:0/2259534688 shutdown_connections 2024-06-13T02:13:09.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.451+0000 7fc457200700 1 --2- 172.21.15.2:0/2259534688 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc43c0a2c20 0x7fc43c0a50e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:09.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.451+0000 7fc457200700 1 --2- 172.21.15.2:0/2259534688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc45810ca00 0x7fc45819f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:09.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.451+0000 7fc457200700 1 --2- 172.21.15.2:0/2259534688 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4581035d0 0x7fc45819ae80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:09.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.451+0000 7fc457200700 1 --2- 172.21.15.2:0/2259534688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc458103ef0 0x7fc45819b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:09.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.451+0000 7fc457200700 1 -- 172.21.15.2:0/2259534688 >> 172.21.15.2:0/2259534688 conn(0x7fc4580fce20 msgr2=0x7fc45810dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:09.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.451+0000 7fc457200700 1 -- 172.21.15.2:0/2259534688 shutdown_connections 2024-06-13T02:13:09.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:09.451+0000 7fc457200700 1 -- 172.21.15.2:0/2259534688 wait complete. 2024-06-13T02:13:09.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:09 smithi084 ceph-mon[36833]: pgmap v348: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:09.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:09 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2259534688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:13:10.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:09 smithi175 ceph-mon[36977]: pgmap v348: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:10.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:09 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2259534688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:13:10.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:09 smithi002 ceph-mon[31960]: pgmap v348: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:10.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:09 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2259534688' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:13:10.267 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T02:13:10.730 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:13:11.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:11 smithi084 ceph-mon[36833]: pgmap v349: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:11.972 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:11 smithi002 ceph-mon[31960]: pgmap v349: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:12.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:11 smithi175 ceph-mon[36977]: pgmap v349: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:13.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.012+0000 7ffb78400700 1 -- 172.21.15.2:0/1178193220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb70074fe0 msgr2=0x7ffb70113120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:13.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.012+0000 7ffb78400700 1 --2- 172.21.15.2:0/1178193220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb70074fe0 0x7ffb70113120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009990 tx=0x7ffb5c009ca0 comp rx=0 tx=0).stop 2024-06-13T02:13:13.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.012+0000 7ffb78400700 1 -- 172.21.15.2:0/1178193220 shutdown_connections 2024-06-13T02:13:13.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.013+0000 7ffb78400700 1 --2- 172.21.15.2:0/1178193220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb70113660 0x7ffb70115a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:13.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.013+0000 7ffb78400700 1 --2- 172.21.15.2:0/1178193220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb700746c0 0x7ffb70074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:13.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.013+0000 7ffb78400700 1 --2- 172.21.15.2:0/1178193220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb70074fe0 0x7ffb70113120 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:13.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.013+0000 7ffb78400700 1 -- 172.21.15.2:0/1178193220 >> 172.21.15.2:0/1178193220 conn(0x7ffb700795f0 msgr2=0x7ffb70079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:13.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.013+0000 7ffb78400700 1 -- 172.21.15.2:0/1178193220 shutdown_connections 2024-06-13T02:13:13.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.013+0000 7ffb78400700 1 -- 172.21.15.2:0/1178193220 wait complete. 2024-06-13T02:13:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.014+0000 7ffb78400700 1 Processor -- start 2024-06-13T02:13:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.014+0000 7ffb78400700 1 -- start start 2024-06-13T02:13:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.015+0000 7ffb78400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb700746c0 0x7ffb7019f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.015+0000 7ffb78400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb70074fe0 0x7ffb7019f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.015+0000 7ffb78400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb70113660 0x7ffb701a3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.015+0000 7ffb78400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffb70118e10 con 0x7ffb70074fe0 2024-06-13T02:13:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.015+0000 7ffb78400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffb70118c90 con 0x7ffb700746c0 2024-06-13T02:13:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.015+0000 7ffb78400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb70118f90 con 0x7ffb70113660 2024-06-13T02:13:13.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.015+0000 7ffb75000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb70074fe0 0x7ffb7019f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:13.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.015+0000 7ffb75000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb70074fe0 0x7ffb7019f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33022/0 (socket says 172.21.15.2:33022) 2024-06-13T02:13:13.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.015+0000 7ffb75000700 1 -- 172.21.15.2:0/1351788880 learned_addr learned my addr 172.21.15.2:0/1351788880 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:13.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.015+0000 7ffb76400700 1 --2- 172.21.15.2:0/1351788880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb70113660 0x7ffb701a3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:13.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.015+0000 7ffb75a00700 1 --2- 172.21.15.2:0/1351788880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb700746c0 0x7ffb7019f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:13.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.015+0000 7ffb76400700 1 -- 172.21.15.2:0/1351788880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb700746c0 msgr2=0x7ffb7019f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:13.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.015+0000 7ffb76400700 1 --2- 172.21.15.2:0/1351788880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb700746c0 0x7ffb7019f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:13.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.015+0000 7ffb76400700 1 -- 172.21.15.2:0/1351788880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb70074fe0 msgr2=0x7ffb7019f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:13.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.015+0000 7ffb76400700 1 --2- 172.21.15.2:0/1351788880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb70074fe0 0x7ffb7019f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:13.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.016+0000 7ffb76400700 1 -- 172.21.15.2:0/1351788880 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb701a4290 con 0x7ffb70113660 2024-06-13T02:13:13.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.016+0000 7ffb76400700 1 --2- 172.21.15.2:0/1351788880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb70113660 0x7ffb701a3b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800ef90 tx=0x7ffb6800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:13.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.016+0000 7ffb6e000700 1 -- 172.21.15.2:0/1351788880 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb680092e0 con 0x7ffb70113660 2024-06-13T02:13:13.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.016+0000 7ffb78400700 1 -- 172.21.15.2:0/1351788880 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb701a4520 con 0x7ffb70113660 2024-06-13T02:13:13.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.017+0000 7ffb6e000700 1 -- 172.21.15.2:0/1351788880 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb68004bb0 con 0x7ffb70113660 2024-06-13T02:13:13.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.017+0000 7ffb6e000700 1 -- 172.21.15.2:0/1351788880 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb68004280 con 0x7ffb70113660 2024-06-13T02:13:13.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.017+0000 7ffb78400700 1 -- 172.21.15.2:0/1351788880 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb701abe00 con 0x7ffb70113660 2024-06-13T02:13:13.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.018+0000 7ffb78400700 1 -- 172.21.15.2:0/1351788880 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb70069180 con 0x7ffb70113660 2024-06-13T02:13:13.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.020+0000 7ffb6e000700 1 -- 172.21.15.2:0/1351788880 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ffb6801b030 con 0x7ffb70113660 2024-06-13T02:13:13.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.021+0000 7ffb6e000700 1 --2- 172.21.15.2:0/1351788880 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ffb580a2ca0 0x7ffb580a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:13.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.021+0000 7ffb6e000700 1 -- 172.21.15.2:0/1351788880 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8802+0+0 (secure 0 0 0) 0x7ffb680ce860 con 0x7ffb70113660 2024-06-13T02:13:13.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.022+0000 7ffb75a00700 1 --2- 172.21.15.2:0/1351788880 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ffb580a2ca0 0x7ffb580a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:13.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.022+0000 7ffb75a00700 1 --2- 172.21.15.2:0/1351788880 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ffb580a2ca0 0x7ffb580a5160 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009680 tx=0x7ffb64009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:13.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.026+0000 7ffb6e000700 1 -- 172.21.15.2:0/1351788880 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ffb68010040 con 0x7ffb70113660 2024-06-13T02:13:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.257+0000 7ffb78400700 1 -- 172.21.15.2:0/1351788880 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb701abfd0 con 0x7ffb70113660 2024-06-13T02:13:13.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.259+0000 7ffb6e000700 1 -- 172.21.15.2:0/1351788880 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+24036 (secure 0 0 0) 0x7ffb6809b520 con 0x7ffb70113660 2024-06-13T02:13:13.261 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:13:13.261 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":96,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","created":"2024-06-13T02:03:16.412002+0000","modified":"2024-06-13T02:13:01.217478+0000","last_up_change":"2024-06-13T02:11:26.464184+0000","last_in_change":"2024-06-13T02:11:06.957351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T02:07:10.994857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T02:12:34.674172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T02:12:39.213985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T02:12:53.098590+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96b4d494-453c-48aa-b1e2-ee30dfa83e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6803","nonce":3254812126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6805","nonce":3254812126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6809","nonce":3254812126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6807","nonce":3254812126}]},"public_addr":"172.21.15.2:6803/3254812126","cluster_addr":"172.21.15.2:6805/3254812126","heartbeat_back_addr":"172.21.15.2:6809/3254812126","heartbeat_front_addr":"172.21.15.2:6807/3254812126","state":["exists","up"]},{"osd":1,"uuid":"856e86b6-9281-485b-a36b-2fe04de31329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6801","nonce":1593775403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6803","nonce":1593775403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6807","nonce":1593775403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6805","nonce":1593775403}]},"public_addr":"172.21.15.84:6801/1593775403","cluster_addr":"172.21.15.84:6803/1593775403","heartbeat_back_addr":"172.21.15.84:6807/1593775403","heartbeat_front_addr":"172.21.15.84:6805/1593775403","state":["exists","up"]},{"osd":2,"uuid":"8c9daa52-0dfb-471a-afb4-6eb0b908195a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6801","nonce":2174304558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6803","nonce":2174304558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6807","nonce":2174304558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6805","nonce":2174304558}]},"public_addr":"172.21.15.175:6801/2174304558","cluster_addr":"172.21.15.175:6803/2174304558","heartbeat_back_addr":"172.21.15.175:6807/2174304558","heartbeat_front_addr":"172.21.15.175:6805/2174304558","state":["exists","up"]},{"osd":3,"uuid":"2e747d36-4aa5-4c4c-918d-b8100980cc8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6811","nonce":3010864289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6813","nonce":3010864289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6817","nonce":3010864289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6815","nonce":3010864289}]},"public_addr":"172.21.15.2:6811/3010864289","cluster_addr":"172.21.15.2:6813/3010864289","heartbeat_back_addr":"172.21.15.2:6817/3010864289","heartbeat_front_addr":"172.21.15.2:6815/3010864289","state":["exists","up"]},{"osd":4,"uuid":"bd063fb2-1a65-4b18-898c-f80ddc2a1229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6809","nonce":2541323390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6811","nonce":2541323390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6815","nonce":2541323390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6813","nonce":2541323390}]},"public_addr":"172.21.15.84:6809/2541323390","cluster_addr":"172.21.15.84:6811/2541323390","heartbeat_back_addr":"172.21.15.84:6815/2541323390","heartbeat_front_addr":"172.21.15.84:6813/2541323390","state":["exists","up"]},{"osd":5,"uuid":"e0ea80fd-1bfe-4d2e-9733-ff442ec015b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6809","nonce":764262885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6811","nonce":764262885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6815","nonce":764262885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6813","nonce":764262885}]},"public_addr":"172.21.15.175:6809/764262885","cluster_addr":"172.21.15.175:6811/764262885","heartbeat_back_addr":"172.21.15.175:6815/764262885","heartbeat_front_addr":"172.21.15.175:6813/764262885","state":["exists","up"]},{"osd":6,"uuid":"1c204d74-5e48-4e2e-bb98-6a8d4974187c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6819","nonce":297321106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6821","nonce":297321106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6825","nonce":297321106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6823","nonce":297321106}]},"public_addr":"172.21.15.2:6819/297321106","cluster_addr":"172.21.15.2:6821/297321106","heartbeat_back_addr":"172.21.15.2:6825/297321106","heartbeat_front_addr":"172.21.15.2:6823/297321106","state":["exists","up"]},{"osd":7,"uuid":"1299bbb1-fbfb-4aba-be6b-6704691735f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6817","nonce":3873726653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6819","nonce":3873726653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6823","nonce":3873726653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6821","nonce":3873726653}]},"public_addr":"172.21.15.84:6817/3873726653","cluster_addr":"172.21.15.84:6819/3873726653","heartbeat_back_addr":"172.21.15.84:6823/3873726653","heartbeat_front_addr":"172.21.15.84:6821/3873726653","state":["exists","up"]},{"osd":8,"uuid":"9c3f2a92-d956-4246-bce9-620824d0da22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6817","nonce":2622818232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6819","nonce":2622818232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6823","nonce":2622818232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6821","nonce":2622818232}]},"public_addr":"172.21.15.175:6817/2622818232","cluster_addr":"172.21.15.175:6819/2622818232","heartbeat_back_addr":"172.21.15.175:6823/2622818232","heartbeat_front_addr":"172.21.15.175:6821/2622818232","state":["exists","up"]},{"osd":9,"uuid":"e9839f78-05c6-4b3f-bc14-cb771a03ff5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6827","nonce":1171735390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6829","nonce":1171735390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6833","nonce":1171735390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6831","nonce":1171735390}]},"public_addr":"172.21.15.2:6827/1171735390","cluster_addr":"172.21.15.2:6829/1171735390","heartbeat_back_addr":"172.21.15.2:6833/1171735390","heartbeat_front_addr":"172.21.15.2:6831/1171735390","state":["exists","up"]},{"osd":10,"uuid":"66719431-5ba9-4865-957b-f6582e607a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6825","nonce":4269523460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6827","nonce":4269523460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6831","nonce":4269523460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6829","nonce":4269523460}]},"public_addr":"172.21.15.84:6825/4269523460","cluster_addr":"172.21.15.84:6827/4269523460","heartbeat_back_addr":"172.21.15.84:6831/4269523460","heartbeat_front_addr":"172.21.15.84:6829/4269523460","state":["exists","up"]},{"osd":11,"uuid":"1ce6e6ee-6ff3-416f-b985-e3afe503093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6825","nonce":2762894732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6827","nonce":2762894732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6831","nonce":2762894732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6829","nonce":2762894732}]},"public_addr":"172.21.15.175:6825/2762894732","cluster_addr":"172.21.15.175:6827/2762894732","heartbeat_back_addr":"172.21.15.175:6831/2762894732","heartbeat_front_addr":"172.21.15.175:6829/2762894732","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:16.956638+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:42.268685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:06.272084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:39.696927+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:06.182991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:31.626603+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:05.247728+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:31.985114+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:57.474180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:31.988863+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:59.683056+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:11:24.493248+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6800/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3397168014":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/1789744365":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3831398703":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/3119270562":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/2163302458":"2024-06-14T02:03:50.073572+0000","172.21.15.2:6800/2830681579":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/1678672435":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6801/2830681579":"2024-06-14T02:03:50.073572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T02:13:13.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.263+0000 7ffb78400700 1 -- 172.21.15.2:0/1351788880 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ffb580a2ca0 msgr2=0x7ffb580a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:13.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.263+0000 7ffb78400700 1 --2- 172.21.15.2:0/1351788880 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ffb580a2ca0 0x7ffb580a5160 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009680 tx=0x7ffb64009260 comp rx=0 tx=0).stop 2024-06-13T02:13:13.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.263+0000 7ffb78400700 1 -- 172.21.15.2:0/1351788880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb70113660 msgr2=0x7ffb701a3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:13.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.263+0000 7ffb78400700 1 --2- 172.21.15.2:0/1351788880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb70113660 0x7ffb701a3b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800ef90 tx=0x7ffb6800c3a0 comp rx=0 tx=0).stop 2024-06-13T02:13:13.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.263+0000 7ffb78400700 1 -- 172.21.15.2:0/1351788880 shutdown_connections 2024-06-13T02:13:13.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.263+0000 7ffb78400700 1 --2- 172.21.15.2:0/1351788880 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ffb580a2ca0 0x7ffb580a5160 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:13.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.263+0000 7ffb78400700 1 --2- 172.21.15.2:0/1351788880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb70113660 0x7ffb701a3b50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:13.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.263+0000 7ffb78400700 1 --2- 172.21.15.2:0/1351788880 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb700746c0 0x7ffb7019f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:13.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.263+0000 7ffb78400700 1 --2- 172.21.15.2:0/1351788880 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffb70074fe0 0x7ffb7019f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:13.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.263+0000 7ffb78400700 1 -- 172.21.15.2:0/1351788880 >> 172.21.15.2:0/1351788880 conn(0x7ffb700795f0 msgr2=0x7ffb70112490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:13.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.263+0000 7ffb78400700 1 -- 172.21.15.2:0/1351788880 shutdown_connections 2024-06-13T02:13:13.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:13.263+0000 7ffb78400700 1 -- 172.21.15.2:0/1351788880 wait complete. 2024-06-13T02:13:13.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:13 smithi084 ceph-mon[36833]: pgmap v350: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:13.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:13 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1351788880' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:13:14.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:13 smithi175 ceph-mon[36977]: pgmap v350: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:14.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:13 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1351788880' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:13:14.094 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:13 smithi002 ceph-mon[31960]: pgmap v350: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:14.094 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:13 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1351788880' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:13:14.199 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:13:14.669 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:13:15.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:15 smithi002 ceph-mon[31960]: pgmap v351: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:15.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:15 smithi084 ceph-mon[36833]: pgmap v351: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:16.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:15 smithi175 ceph-mon[36977]: pgmap v351: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.832+0000 7f7d36e00700 1 -- 172.21.15.2:0/168784147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d3006a170 msgr2=0x7f7d3006a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.832+0000 7f7d36e00700 1 --2- 172.21.15.2:0/168784147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d3006a170 0x7f7d3006a5f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009990 tx=0x7f7d18009ca0 comp rx=0 tx=0).stop 2024-06-13T02:13:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.832+0000 7f7d36e00700 1 -- 172.21.15.2:0/168784147 shutdown_connections 2024-06-13T02:13:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.832+0000 7f7d36e00700 1 --2- 172.21.15.2:0/168784147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d3006ab30 0x7f7d3010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.832+0000 7f7d36e00700 1 --2- 172.21.15.2:0/168784147 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d30108500 0x7f7d301088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:16.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.832+0000 7f7d36e00700 1 --2- 172.21.15.2:0/168784147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d3006a170 0x7f7d3006a5f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:16.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.832+0000 7f7d36e00700 1 -- 172.21.15.2:0/168784147 >> 172.21.15.2:0/168784147 conn(0x7f7d30078340 msgr2=0x7f7d30078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:16.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.832+0000 7f7d36e00700 1 -- 172.21.15.2:0/168784147 shutdown_connections 2024-06-13T02:13:16.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.832+0000 7f7d36e00700 1 -- 172.21.15.2:0/168784147 wait complete. 2024-06-13T02:13:16.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.833+0000 7f7d36e00700 1 Processor -- start 2024-06-13T02:13:16.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.833+0000 7f7d36e00700 1 -- start start 2024-06-13T02:13:16.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.834+0000 7f7d36e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d3006a170 0x7f7d3019ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:16.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.834+0000 7f7d36e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d3006ab30 0x7f7d3019b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:16.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.834+0000 7f7d36e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d30108500 0x7f7d3019f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:16.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.834+0000 7f7d36e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7d30112760 con 0x7f7d3006a170 2024-06-13T02:13:16.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.834+0000 7f7d36e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7d301125e0 con 0x7f7d30108500 2024-06-13T02:13:16.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.834+0000 7f7d36e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7d301128e0 con 0x7f7d3006ab30 2024-06-13T02:13:16.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.834+0000 7f7d2fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d3006a170 0x7f7d3019ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:16.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.834+0000 7f7d2fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d3006a170 0x7f7d3019ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33030/0 (socket says 172.21.15.2:33030) 2024-06-13T02:13:16.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.834+0000 7f7d2fe00700 1 -- 172.21.15.2:0/2714716141 learned_addr learned my addr 172.21.15.2:0/2714716141 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:16.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.834+0000 7f7d27400700 1 --2- 172.21.15.2:0/2714716141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d3006ab30 0x7f7d3019b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:16.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.834+0000 7f7d34e00700 1 --2- 172.21.15.2:0/2714716141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d30108500 0x7f7d3019f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:16.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.834+0000 7f7d2fe00700 1 -- 172.21.15.2:0/2714716141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d3006ab30 msgr2=0x7f7d3019b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:16.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.834+0000 7f7d2fe00700 1 --2- 172.21.15.2:0/2714716141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d3006ab30 0x7f7d3019b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:16.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.835+0000 7f7d2fe00700 1 -- 172.21.15.2:0/2714716141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d30108500 msgr2=0x7f7d3019f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:16.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.835+0000 7f7d2fe00700 1 --2- 172.21.15.2:0/2714716141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d30108500 0x7f7d3019f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:16.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.835+0000 7f7d2fe00700 1 -- 172.21.15.2:0/2714716141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3019fe40 con 0x7f7d3006a170 2024-06-13T02:13:16.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.835+0000 7f7d2fe00700 1 --2- 172.21.15.2:0/2714716141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d3006a170 0x7f7d3019ae30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000e9a0 tx=0x7f7d2000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:16.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.835+0000 7f7d2d600700 1 -- 172.21.15.2:0/2714716141 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2000ca10 con 0x7f7d3006a170 2024-06-13T02:13:16.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.835+0000 7f7d2d600700 1 -- 172.21.15.2:0/2714716141 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d2000cbb0 con 0x7f7d3006a170 2024-06-13T02:13:16.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.835+0000 7f7d2d600700 1 -- 172.21.15.2:0/2714716141 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d20018680 con 0x7f7d3006a170 2024-06-13T02:13:16.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.835+0000 7f7d36e00700 1 -- 172.21.15.2:0/2714716141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d301a0130 con 0x7f7d3006a170 2024-06-13T02:13:16.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.835+0000 7f7d36e00700 1 -- 172.21.15.2:0/2714716141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d301a79b0 con 0x7f7d3006a170 2024-06-13T02:13:16.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.837+0000 7f7d36e00700 1 -- 172.21.15.2:0/2714716141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d30069180 con 0x7f7d3006a170 2024-06-13T02:13:16.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.839+0000 7f7d2d600700 1 -- 172.21.15.2:0/2714716141 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f7d20010430 con 0x7f7d3006a170 2024-06-13T02:13:16.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.840+0000 7f7d2d600700 1 --2- 172.21.15.2:0/2714716141 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d140a2ca0 0x7f7d140a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:16.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.841+0000 7f7d2d600700 1 -- 172.21.15.2:0/2714716141 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8802+0+0 (secure 0 0 0) 0x7f7d200cf870 con 0x7f7d3006a170 2024-06-13T02:13:16.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.841+0000 7f7d27400700 1 --2- 172.21.15.2:0/2714716141 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d140a2ca0 0x7f7d140a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:16.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.842+0000 7f7d27400700 1 --2- 172.21.15.2:0/2714716141 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d140a2ca0 0x7f7d140a5160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800b2e0 tx=0x7f7d18005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:16.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:16.844+0000 7f7d2d600700 1 -- 172.21.15.2:0/2714716141 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7d2009c530 con 0x7f7d3006a170 2024-06-13T02:13:17.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:17.123+0000 7f7d36e00700 1 -- 172.21.15.2:0/2714716141 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d301a7b80 con 0x7f7d3006a170 2024-06-13T02:13:17.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:17.125+0000 7f7d2d600700 1 -- 172.21.15.2:0/2714716141 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11785 (secure 0 0 0) 0x7f7d2009be30 con 0x7f7d3006a170 2024-06-13T02:13:17.126 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:13:17.126 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3458450195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3458450195},{"type":"v1","addr":"172.21.15.2:6841","nonce":3458450195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1709394731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1709394731},{"type":"v1","addr":"172.21.15.175:6835","nonce":1709394731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/2403775181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2403775181},{"type":"v1","addr":"172.21.15.84:6835","nonce":2403775181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1446546569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1446546569},{"type":"v1","addr":"172.21.15.175:6837","nonce":1446546569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24488,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/2537381027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2537381027},{"type":"v1","addr":"172.21.15.84:6837","nonce":2537381027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6839/2743442301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":2743442301},{"type":"v1","addr":"172.21.15.175:6839","nonce":2743442301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24503,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6839/3208917373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3208917373},{"type":"v1","addr":"172.21.15.2:6839","nonce":3208917373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-06-13T02:12:43.063161+0000","modified":"2024-06-13T02:13:01.217895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24527},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6839/541041266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":541041266},{"type":"v1","addr":"172.21.15.84:6839","nonce":541041266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24527,"qdb_cluster":[24527]},"id":1}]} 2024-06-13T02:13:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:17.129+0000 7f7d36e00700 1 -- 172.21.15.2:0/2714716141 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d140a2ca0 msgr2=0x7f7d140a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:17.129+0000 7f7d36e00700 1 --2- 172.21.15.2:0/2714716141 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d140a2ca0 0x7f7d140a5160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800b2e0 tx=0x7f7d18005960 comp rx=0 tx=0).stop 2024-06-13T02:13:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:17.129+0000 7f7d36e00700 1 -- 172.21.15.2:0/2714716141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d3006a170 msgr2=0x7f7d3019ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:17.129+0000 7f7d36e00700 1 --2- 172.21.15.2:0/2714716141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d3006a170 0x7f7d3019ae30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000e9a0 tx=0x7f7d2000ecb0 comp rx=0 tx=0).stop 2024-06-13T02:13:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:17.129+0000 7f7d36e00700 1 -- 172.21.15.2:0/2714716141 shutdown_connections 2024-06-13T02:13:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:17.129+0000 7f7d36e00700 1 --2- 172.21.15.2:0/2714716141 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d140a2ca0 0x7f7d140a5160 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:17.129+0000 7f7d36e00700 1 --2- 172.21.15.2:0/2714716141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d30108500 0x7f7d3019f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:17.129+0000 7f7d36e00700 1 --2- 172.21.15.2:0/2714716141 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d3006a170 0x7f7d3019ae30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:17.129+0000 7f7d36e00700 1 --2- 172.21.15.2:0/2714716141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d3006ab30 0x7f7d3019b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:17.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:17.129+0000 7f7d36e00700 1 -- 172.21.15.2:0/2714716141 >> 172.21.15.2:0/2714716141 conn(0x7f7d30078340 msgr2=0x7f7d3010d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:17.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:17.130+0000 7f7d36e00700 1 -- 172.21.15.2:0/2714716141 shutdown_connections 2024-06-13T02:13:17.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:17.130+0000 7f7d36e00700 1 -- 172.21.15.2:0/2714716141 wait complete. 2024-06-13T02:13:17.131 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 17 2024-06-13T02:13:17.843 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:17 smithi002 ceph-mon[31960]: pgmap v352: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:17.843 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:17 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2714716141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:13:17.933 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T02:13:17.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:17 smithi084 ceph-mon[36833]: pgmap v352: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:17.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:17 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2714716141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:13:18.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:17 smithi175 ceph-mon[36977]: pgmap v352: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:18.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:17 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2714716141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:13:18.408 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:13:19.571 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:19 smithi002 ceph-mon[31960]: pgmap v353: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:19.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:19 smithi084 ceph-mon[36833]: pgmap v353: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:19.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:19 smithi175 ceph-mon[36977]: pgmap v353: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:20.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.645+0000 7f2cfc400700 1 -- 172.21.15.2:0/686935484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf4107390 msgr2=0x7f2cf4107770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:20.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.645+0000 7f2cfc400700 1 --2- 172.21.15.2:0/686935484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf4107390 0x7f2cf4107770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009920 tx=0x7f2ce8009c30 comp rx=0 tx=0).stop 2024-06-13T02:13:20.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.645+0000 7f2cfc400700 1 -- 172.21.15.2:0/686935484 shutdown_connections 2024-06-13T02:13:20.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.645+0000 7f2cfc400700 1 --2- 172.21.15.2:0/686935484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf406b5b0 0x7f2cf410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:20.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.645+0000 7f2cfc400700 1 --2- 172.21.15.2:0/686935484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf4107390 0x7f2cf4107770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:20.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.645+0000 7f2cfc400700 1 --2- 172.21.15.2:0/686935484 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cf406abf0 0x7f2cf406b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:20.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.645+0000 7f2cfc400700 1 -- 172.21.15.2:0/686935484 >> 172.21.15.2:0/686935484 conn(0x7f2cf4078340 msgr2=0x7f2cf4078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:20.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.645+0000 7f2cfc400700 1 -- 172.21.15.2:0/686935484 shutdown_connections 2024-06-13T02:13:20.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.645+0000 7f2cfc400700 1 -- 172.21.15.2:0/686935484 wait complete. 2024-06-13T02:13:20.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.646+0000 7f2cfc400700 1 Processor -- start 2024-06-13T02:13:20.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.647+0000 7f2cfc400700 1 -- start start 2024-06-13T02:13:20.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.647+0000 7f2cfc400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf406abf0 0x7f2cf419af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:20.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.647+0000 7f2cfc400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cf406b5b0 0x7f2cf419b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:20.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.647+0000 7f2cfc400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf4107390 0x7f2cf419f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:20.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.647+0000 7f2cfc400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf4112790 con 0x7f2cf406b5b0 2024-06-13T02:13:20.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.647+0000 7f2cfc400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf4112610 con 0x7f2cf406abf0 2024-06-13T02:13:20.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.647+0000 7f2cfc400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf4112910 con 0x7f2cf4107390 2024-06-13T02:13:20.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.647+0000 7f2cf9a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf406abf0 0x7f2cf419af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:20.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.647+0000 7f2cf9a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf406abf0 0x7f2cf419af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:57080/0 (socket says 172.21.15.2:57080) 2024-06-13T02:13:20.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.647+0000 7f2cf9a00700 1 -- 172.21.15.2:0/2012180341 learned_addr learned my addr 172.21.15.2:0/2012180341 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:20.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.647+0000 7f2cf9000700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cf406b5b0 0x7f2cf419b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:20.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.647+0000 7f2cfa400700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf4107390 0x7f2cf419f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:20.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.648+0000 7f2cf9a00700 1 -- 172.21.15.2:0/2012180341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf4107390 msgr2=0x7f2cf419f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:20.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.648+0000 7f2cf9a00700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf4107390 0x7f2cf419f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:20.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.648+0000 7f2cf9a00700 1 -- 172.21.15.2:0/2012180341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cf406b5b0 msgr2=0x7f2cf419b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:20.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.648+0000 7f2cf9a00700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cf406b5b0 0x7f2cf419b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:20.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.648+0000 7f2cf9a00700 1 -- 172.21.15.2:0/2012180341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf419fed0 con 0x7f2cf406abf0 2024-06-13T02:13:20.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.648+0000 7f2cfa400700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf4107390 0x7f2cf419f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:13:20.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.648+0000 7f2cf9000700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cf406b5b0 0x7f2cf419b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:13:20.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.648+0000 7f2cf9a00700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf406abf0 0x7f2cf419af10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8000c00 tx=0x7f2ce800fb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:20.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.648+0000 7f2cf2000700 1 -- 172.21.15.2:0/2012180341 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8027070 con 0x7f2cf406abf0 2024-06-13T02:13:20.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.649+0000 7f2cf2000700 1 -- 172.21.15.2:0/2012180341 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ce800b560 con 0x7f2cf406abf0 2024-06-13T02:13:20.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.649+0000 7f2cfc400700 1 -- 172.21.15.2:0/2012180341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf41a0160 con 0x7f2cf406abf0 2024-06-13T02:13:20.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.649+0000 7f2cf2000700 1 -- 172.21.15.2:0/2012180341 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80049e0 con 0x7f2cf406abf0 2024-06-13T02:13:20.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.649+0000 7f2cfc400700 1 -- 172.21.15.2:0/2012180341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf41a7a40 con 0x7f2cf406abf0 2024-06-13T02:13:20.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.650+0000 7f2cfc400700 1 -- 172.21.15.2:0/2012180341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf4103b70 con 0x7f2cf406abf0 2024-06-13T02:13:20.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.652+0000 7f2cf2000700 1 -- 172.21.15.2:0/2012180341 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f2ce802a070 con 0x7f2cf406abf0 2024-06-13T02:13:20.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.653+0000 7f2cf2000700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2cdc0a2c20 0x7f2cdc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:20.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.653+0000 7f2cf2000700 1 -- 172.21.15.2:0/2012180341 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8802+0+0 (secure 0 0 0) 0x7f2ce80cfec0 con 0x7f2cf406abf0 2024-06-13T02:13:20.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.653+0000 7f2cf9000700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2cdc0a2c20 0x7f2cdc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:20.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.654+0000 7f2cf9000700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2cdc0a2c20 0x7f2cdc0a50e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009750 tx=0x7f2ce0009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:20.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.657+0000 7f2cf2000700 1 -- 172.21.15.2:0/2012180341 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2ce805e850 con 0x7f2cf406abf0 2024-06-13T02:13:20.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.889+0000 7f2cfc400700 1 -- 172.21.15.2:0/2012180341 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2cf419c220 con 0x7f2cf406abf0 2024-06-13T02:13:20.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.891+0000 7f2cf2000700 1 -- 172.21.15.2:0/2012180341 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+24036 (secure 0 0 0) 0x7f2ce8013030 con 0x7f2cf406abf0 2024-06-13T02:13:20.892 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:13:20.892 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":96,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","created":"2024-06-13T02:03:16.412002+0000","modified":"2024-06-13T02:13:01.217478+0000","last_up_change":"2024-06-13T02:11:26.464184+0000","last_in_change":"2024-06-13T02:11:06.957351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T02:07:10.994857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T02:12:34.674172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T02:12:39.213985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T02:12:53.098590+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96b4d494-453c-48aa-b1e2-ee30dfa83e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6803","nonce":3254812126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6805","nonce":3254812126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6809","nonce":3254812126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6807","nonce":3254812126}]},"public_addr":"172.21.15.2:6803/3254812126","cluster_addr":"172.21.15.2:6805/3254812126","heartbeat_back_addr":"172.21.15.2:6809/3254812126","heartbeat_front_addr":"172.21.15.2:6807/3254812126","state":["exists","up"]},{"osd":1,"uuid":"856e86b6-9281-485b-a36b-2fe04de31329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6801","nonce":1593775403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6803","nonce":1593775403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6807","nonce":1593775403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6805","nonce":1593775403}]},"public_addr":"172.21.15.84:6801/1593775403","cluster_addr":"172.21.15.84:6803/1593775403","heartbeat_back_addr":"172.21.15.84:6807/1593775403","heartbeat_front_addr":"172.21.15.84:6805/1593775403","state":["exists","up"]},{"osd":2,"uuid":"8c9daa52-0dfb-471a-afb4-6eb0b908195a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6801","nonce":2174304558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6803","nonce":2174304558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6807","nonce":2174304558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6805","nonce":2174304558}]},"public_addr":"172.21.15.175:6801/2174304558","cluster_addr":"172.21.15.175:6803/2174304558","heartbeat_back_addr":"172.21.15.175:6807/2174304558","heartbeat_front_addr":"172.21.15.175:6805/2174304558","state":["exists","up"]},{"osd":3,"uuid":"2e747d36-4aa5-4c4c-918d-b8100980cc8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6811","nonce":3010864289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6813","nonce":3010864289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6817","nonce":3010864289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6815","nonce":3010864289}]},"public_addr":"172.21.15.2:6811/3010864289","cluster_addr":"172.21.15.2:6813/3010864289","heartbeat_back_addr":"172.21.15.2:6817/3010864289","heartbeat_front_addr":"172.21.15.2:6815/3010864289","state":["exists","up"]},{"osd":4,"uuid":"bd063fb2-1a65-4b18-898c-f80ddc2a1229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6809","nonce":2541323390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6811","nonce":2541323390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6815","nonce":2541323390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6813","nonce":2541323390}]},"public_addr":"172.21.15.84:6809/2541323390","cluster_addr":"172.21.15.84:6811/2541323390","heartbeat_back_addr":"172.21.15.84:6815/2541323390","heartbeat_front_addr":"172.21.15.84:6813/2541323390","state":["exists","up"]},{"osd":5,"uuid":"e0ea80fd-1bfe-4d2e-9733-ff442ec015b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6809","nonce":764262885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6811","nonce":764262885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6815","nonce":764262885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6813","nonce":764262885}]},"public_addr":"172.21.15.175:6809/764262885","cluster_addr":"172.21.15.175:6811/764262885","heartbeat_back_addr":"172.21.15.175:6815/764262885","heartbeat_front_addr":"172.21.15.175:6813/764262885","state":["exists","up"]},{"osd":6,"uuid":"1c204d74-5e48-4e2e-bb98-6a8d4974187c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6819","nonce":297321106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6821","nonce":297321106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6825","nonce":297321106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6823","nonce":297321106}]},"public_addr":"172.21.15.2:6819/297321106","cluster_addr":"172.21.15.2:6821/297321106","heartbeat_back_addr":"172.21.15.2:6825/297321106","heartbeat_front_addr":"172.21.15.2:6823/297321106","state":["exists","up"]},{"osd":7,"uuid":"1299bbb1-fbfb-4aba-be6b-6704691735f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6817","nonce":3873726653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6819","nonce":3873726653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6823","nonce":3873726653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6821","nonce":3873726653}]},"public_addr":"172.21.15.84:6817/3873726653","cluster_addr":"172.21.15.84:6819/3873726653","heartbeat_back_addr":"172.21.15.84:6823/3873726653","heartbeat_front_addr":"172.21.15.84:6821/3873726653","state":["exists","up"]},{"osd":8,"uuid":"9c3f2a92-d956-4246-bce9-620824d0da22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6817","nonce":2622818232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6819","nonce":2622818232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6823","nonce":2622818232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6821","nonce":2622818232}]},"public_addr":"172.21.15.175:6817/2622818232","cluster_addr":"172.21.15.175:6819/2622818232","heartbeat_back_addr":"172.21.15.175:6823/2622818232","heartbeat_front_addr":"172.21.15.175:6821/2622818232","state":["exists","up"]},{"osd":9,"uuid":"e9839f78-05c6-4b3f-bc14-cb771a03ff5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6827","nonce":1171735390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6829","nonce":1171735390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6833","nonce":1171735390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6831","nonce":1171735390}]},"public_addr":"172.21.15.2:6827/1171735390","cluster_addr":"172.21.15.2:6829/1171735390","heartbeat_back_addr":"172.21.15.2:6833/1171735390","heartbeat_front_addr":"172.21.15.2:6831/1171735390","state":["exists","up"]},{"osd":10,"uuid":"66719431-5ba9-4865-957b-f6582e607a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6825","nonce":4269523460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6827","nonce":4269523460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6831","nonce":4269523460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6829","nonce":4269523460}]},"public_addr":"172.21.15.84:6825/4269523460","cluster_addr":"172.21.15.84:6827/4269523460","heartbeat_back_addr":"172.21.15.84:6831/4269523460","heartbeat_front_addr":"172.21.15.84:6829/4269523460","state":["exists","up"]},{"osd":11,"uuid":"1ce6e6ee-6ff3-416f-b985-e3afe503093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6825","nonce":2762894732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6827","nonce":2762894732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6831","nonce":2762894732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6829","nonce":2762894732}]},"public_addr":"172.21.15.175:6825/2762894732","cluster_addr":"172.21.15.175:6827/2762894732","heartbeat_back_addr":"172.21.15.175:6831/2762894732","heartbeat_front_addr":"172.21.15.175:6829/2762894732","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:16.956638+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:42.268685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:06.272084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:39.696927+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:06.182991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:31.626603+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:05.247728+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:31.985114+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:57.474180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:31.988863+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:59.683056+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:11:24.493248+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6800/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3397168014":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/1789744365":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3831398703":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/3119270562":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/2163302458":"2024-06-14T02:03:50.073572+0000","172.21.15.2:6800/2830681579":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/1678672435":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6801/2830681579":"2024-06-14T02:03:50.073572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T02:13:20.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.895+0000 7f2cfc400700 1 -- 172.21.15.2:0/2012180341 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2cdc0a2c20 msgr2=0x7f2cdc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:20.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.895+0000 7f2cfc400700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2cdc0a2c20 0x7f2cdc0a50e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009750 tx=0x7f2ce0009310 comp rx=0 tx=0).stop 2024-06-13T02:13:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.895+0000 7f2cfc400700 1 -- 172.21.15.2:0/2012180341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf406abf0 msgr2=0x7f2cf419af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.895+0000 7f2cfc400700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf406abf0 0x7f2cf419af10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8000c00 tx=0x7f2ce800fb20 comp rx=0 tx=0).stop 2024-06-13T02:13:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.895+0000 7f2cfc400700 1 -- 172.21.15.2:0/2012180341 shutdown_connections 2024-06-13T02:13:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.895+0000 7f2cfc400700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2cdc0a2c20 0x7f2cdc0a50e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.895+0000 7f2cfc400700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2cf4107390 0x7f2cf419f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.895+0000 7f2cfc400700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2cf406abf0 0x7f2cf419af10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.895+0000 7f2cfc400700 1 --2- 172.21.15.2:0/2012180341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cf406b5b0 0x7f2cf419b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.895+0000 7f2cfc400700 1 -- 172.21.15.2:0/2012180341 >> 172.21.15.2:0/2012180341 conn(0x7f2cf4078340 msgr2=0x7f2cf410d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.895+0000 7f2cfc400700 1 -- 172.21.15.2:0/2012180341 shutdown_connections 2024-06-13T02:13:20.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:20.895+0000 7f2cfc400700 1 -- 172.21.15.2:0/2012180341 wait complete. 2024-06-13T02:13:21.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:21 smithi002 ceph-mon[31960]: pgmap v354: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:21.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:21 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2012180341' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:13:21.747 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-06-13T02:12:43.063161+0000', 'modified': '2024-06-13T02:13:01.217895+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24527}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24527': {'gid': 24527, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.84:6839/541041266', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6838', 'nonce': 541041266}, {'type': 'v1', 'addr': '172.21.15.84:6839', 'nonce': 541041266}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24527, 'qdb_cluster': [24527]} 2024-06-13T02:13:21.747 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-06-13T02:13:21.747 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell mds.b status 2024-06-13T02:13:21.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:21 smithi175 ceph-mon[36977]: pgmap v354: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:21.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:21 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2012180341' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:13:21.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:21 smithi084 ceph-mon[36833]: pgmap v354: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:21.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:21 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2012180341' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:13:22.228 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:13:23.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:23 smithi002 ceph-mon[31960]: pgmap v355: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:23.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:23 smithi175 ceph-mon[36977]: pgmap v355: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:23.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:23 smithi084 ceph-mon[36833]: pgmap v355: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:24.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.517+0000 7fd888600700 1 -- 172.21.15.2:0/2050374848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd880108500 msgr2=0x7fd8801088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:24.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.517+0000 7fd888600700 1 --2- 172.21.15.2:0/2050374848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd880108500 0x7fd8801088e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd874009990 tx=0x7fd874009ca0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.517+0000 7fd888600700 1 -- 172.21.15.2:0/2050374848 shutdown_connections 2024-06-13T02:13:24.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.517+0000 7fd888600700 1 --2- 172.21.15.2:0/2050374848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88006b580 0x7fd88010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.517+0000 7fd888600700 1 --2- 172.21.15.2:0/2050374848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd880108500 0x7fd8801088e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.517+0000 7fd888600700 1 --2- 172.21.15.2:0/2050374848 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd88006abc0 0x7fd88006b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.517+0000 7fd888600700 1 -- 172.21.15.2:0/2050374848 >> 172.21.15.2:0/2050374848 conn(0x7fd880078340 msgr2=0x7fd880078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:24.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.517+0000 7fd888600700 1 -- 172.21.15.2:0/2050374848 shutdown_connections 2024-06-13T02:13:24.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.517+0000 7fd888600700 1 -- 172.21.15.2:0/2050374848 wait complete. 2024-06-13T02:13:24.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.518+0000 7fd888600700 1 Processor -- start 2024-06-13T02:13:24.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.518+0000 7fd888600700 1 -- start start 2024-06-13T02:13:24.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.519+0000 7fd888600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd88006abc0 0x7fd880103080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.519+0000 7fd888600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88006b580 0x7fd880101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.519+0000 7fd888600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd880108500 0x7fd880101af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.519+0000 7fd888600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd8801127d0 con 0x7fd880108500 2024-06-13T02:13:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.519+0000 7fd888600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd880112650 con 0x7fd88006abc0 2024-06-13T02:13:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.519+0000 7fd888600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd880112950 con 0x7fd88006b580 2024-06-13T02:13:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.519+0000 7fd885200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88006b580 0x7fd880101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.519+0000 7fd885200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88006b580 0x7fd880101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:52004/0 (socket says 172.21.15.2:52004) 2024-06-13T02:13:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.519+0000 7fd885200700 1 -- 172.21.15.2:0/712908174 learned_addr learned my addr 172.21.15.2:0/712908174 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.520+0000 7fd885c00700 1 --2- 172.21.15.2:0/712908174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd88006abc0 0x7fd880103080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.520+0000 7fd886600700 1 --2- 172.21.15.2:0/712908174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd880108500 0x7fd880101af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.520+0000 7fd885200700 1 -- 172.21.15.2:0/712908174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd88006abc0 msgr2=0x7fd880103080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:24.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.520+0000 7fd885200700 1 --2- 172.21.15.2:0/712908174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd88006abc0 0x7fd880103080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.520+0000 7fd885200700 1 -- 172.21.15.2:0/712908174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd880108500 msgr2=0x7fd880101af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:24.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.520+0000 7fd885200700 1 --2- 172.21.15.2:0/712908174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd880108500 0x7fd880101af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.520+0000 7fd885200700 1 -- 172.21.15.2:0/712908174 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8801ab690 con 0x7fd88006b580 2024-06-13T02:13:24.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.521+0000 7fd885200700 1 --2- 172.21.15.2:0/712908174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88006b580 0x7fd880101490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00e9a0 tx=0x7fd86c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:24.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.529+0000 7fd87e000700 1 -- 172.21.15.2:0/712908174 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c00cbd0 con 0x7fd88006b580 2024-06-13T02:13:24.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.529+0000 7fd87e000700 1 -- 172.21.15.2:0/712908174 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd86c00cd70 con 0x7fd88006b580 2024-06-13T02:13:24.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.529+0000 7fd87e000700 1 -- 172.21.15.2:0/712908174 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c018750 con 0x7fd88006b580 2024-06-13T02:13:24.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.529+0000 7fd888600700 1 -- 172.21.15.2:0/712908174 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8801ab920 con 0x7fd88006b580 2024-06-13T02:13:24.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.529+0000 7fd888600700 1 -- 172.21.15.2:0/712908174 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8801abde0 con 0x7fd88006b580 2024-06-13T02:13:24.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.534+0000 7fd87e000700 1 -- 172.21.15.2:0/712908174 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fd86c0188f0 con 0x7fd88006b580 2024-06-13T02:13:24.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.536+0000 7fd892f42b80 1 Processor -- start 2024-06-13T02:13:24.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.536+0000 7fd87e000700 1 --2- 172.21.15.2:0/712908174 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8680a2d70 0x7fd8680a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.536+0000 7fd892f42b80 1 -- start start 2024-06-13T02:13:24.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.536+0000 7fd87e000700 1 -- 172.21.15.2:0/712908174 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7fd86c0cf500 con 0x7fd88006b580 2024-06-13T02:13:24.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.536+0000 7fd886600700 1 --2- 172.21.15.2:0/712908174 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8680a2d70 0x7fd8680a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.536+0000 7fd892f42b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aee52df0 0x55f1aeed6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.536+0000 7fd892f42b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeed69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.536+0000 7fd892f42b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aeee12b0 0x55f1aeee36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.536+0000 7fd892f42b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f1aede59c0 con 0x55f1aeed6560 2024-06-13T02:13:24.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.536+0000 7fd892f42b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f1aee28ab0 con 0x55f1aee52df0 2024-06-13T02:13:24.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.536+0000 7fd892f42b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f1aede38a0 con 0x55f1aeee12b0 2024-06-13T02:13:24.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.537+0000 7fd885200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeed69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.537+0000 7fd885c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aee52df0 0x55f1aeed6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.537+0000 7fd885c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aee52df0 0x55f1aeed6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:56800/0 (socket says 172.21.15.2:56800) 2024-06-13T02:13:24.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.537+0000 7fd885200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeed69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36978/0 (socket says 172.21.15.2:36978) 2024-06-13T02:13:24.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.537+0000 7fd885c00700 1 -- 172.21.15.2:0/97592335 learned_addr learned my addr 172.21.15.2:0/97592335 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:24.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.537+0000 7fd886600700 1 --2- 172.21.15.2:0/97592335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aeee12b0 0x55f1aeee36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.537+0000 7fd885c00700 1 -- 172.21.15.2:0/97592335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aeee12b0 msgr2=0x55f1aeee36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:13:24.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.537+0000 7fd885c00700 1 --2- 172.21.15.2:0/97592335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aeee12b0 0x55f1aeee36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.537+0000 7fd885c00700 1 -- 172.21.15.2:0/97592335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 msgr2=0x55f1aeed69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:13:24.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.537+0000 7fd885c00700 1 --2- 172.21.15.2:0/97592335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeed69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.537+0000 7fd885c00700 1 -- 172.21.15.2:0/97592335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1aedd0f40 con 0x55f1aee52df0 2024-06-13T02:13:24.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.537+0000 7fd885200700 1 --2- 172.21.15.2:0/97592335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeed69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:13:24.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.538+0000 7fd885c00700 1 --2- 172.21.15.2:0/97592335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aee52df0 0x55f1aeed6020 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd8740096e0 tx=0x7fd874009710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f8612edd871f6d8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:24.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.538+0000 7fd886600700 1 --2- 172.21.15.2:0/712908174 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8680a2d70 0x7fd8680a5230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd878009510 tx=0x7fd878009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:24.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.538+0000 7fd872a00700 1 -- 172.21.15.2:0/97592335 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874027070 con 0x55f1aee52df0 2024-06-13T02:13:24.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.538+0000 7fd872a00700 1 -- 172.21.15.2:0/97592335 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd87400bd10 con 0x55f1aee52df0 2024-06-13T02:13:24.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.538+0000 7fd872a00700 1 -- 172.21.15.2:0/97592335 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874003bb0 con 0x55f1aee52df0 2024-06-13T02:13:24.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.539+0000 7fd892f42b80 1 -- 172.21.15.2:0/97592335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aee52df0 msgr2=0x55f1aeed6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:24.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.539+0000 7fd892f42b80 1 --2- 172.21.15.2:0/97592335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aee52df0 0x55f1aeed6020 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd8740096e0 tx=0x7fd874009710 comp rx=0 tx=0).stop 2024-06-13T02:13:24.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.539+0000 7fd892f42b80 1 -- 172.21.15.2:0/97592335 shutdown_connections 2024-06-13T02:13:24.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.539+0000 7fd892f42b80 1 --2- 172.21.15.2:0/97592335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aeee12b0 0x55f1aeee36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.539+0000 7fd892f42b80 1 --2- 172.21.15.2:0/97592335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aee52df0 0x55f1aeed6020 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.539+0000 7fd892f42b80 1 --2- 172.21.15.2:0/97592335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeed69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.539+0000 7fd892f42b80 1 -- 172.21.15.2:0/97592335 >> 172.21.15.2:0/97592335 conn(0x55f1aee03120 msgr2=0x55f1aeed2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:24.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.539+0000 7fd892f42b80 1 -- 172.21.15.2:0/97592335 shutdown_connections 2024-06-13T02:13:24.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.539+0000 7fd892f42b80 1 -- 172.21.15.2:0/97592335 wait complete. 2024-06-13T02:13:24.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.540+0000 7fd892f42b80 1 -- start start 2024-06-13T02:13:24.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.540+0000 7fd892f42b80 1 Processor -- start 2024-06-13T02:13:24.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.541+0000 7fd892f42b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aee52df0 0x55f1aeee0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.541+0000 7fd892f42b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeed6560 0x55f1aeeddc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.541+0000 7fd892f42b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aeee12b0 0x55f1aeede160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.541+0000 7fd892f42b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f1aedc4f10 con 0x55f1aee52df0 2024-06-13T02:13:24.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.541+0000 7fd892f42b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f1aee24a70 con 0x55f1aeed6560 2024-06-13T02:13:24.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.541+0000 7fd892f42b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f1aeee3f10 con 0x55f1aeee12b0 2024-06-13T02:13:24.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.541+0000 7fd892f42b80 10 client.0 _ll_register_callbacks cb 0x55f1aedc26d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:13:24.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.541+0000 7fd885200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeed6560 0x55f1aeeddc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.541+0000 7fd885c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aee52df0 0x55f1aeee0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.541+0000 7fd885200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeed6560 0x55f1aeeddc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:56812/0 (socket says 172.21.15.2:56812) 2024-06-13T02:13:24.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.541+0000 7fd885200700 1 -- 172.21.15.2:0/1951142302 learned_addr learned my addr 172.21.15.2:0/1951142302 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:24.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.541+0000 7fd886600700 1 --2- 172.21.15.2:0/1951142302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aeee12b0 0x55f1aeede160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.542+0000 7fd885200700 1 -- 172.21.15.2:0/1951142302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aeee12b0 msgr2=0x55f1aeede160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:13:24.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.542+0000 7fd885200700 1 --2- 172.21.15.2:0/1951142302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aeee12b0 0x55f1aeede160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.542+0000 7fd885200700 1 -- 172.21.15.2:0/1951142302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aee52df0 msgr2=0x55f1aeee0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:13:24.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.542+0000 7fd885200700 1 --2- 172.21.15.2:0/1951142302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aee52df0 0x55f1aeee0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.542+0000 7fd885200700 1 -- 172.21.15.2:0/1951142302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1aed77880 con 0x55f1aeed6560 2024-06-13T02:13:24.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.542+0000 7fd885c00700 1 --2- 172.21.15.2:0/1951142302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aee52df0 0x55f1aeee0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:13:24.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.542+0000 7fd885200700 1 --2- 172.21.15.2:0/1951142302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeed6560 0x55f1aeeddc20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd86c010e10 tx=0x7fd86c09c170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c53e31c7d7890a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:24.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.542+0000 7fd867400700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:13:24.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.543+0000 7fd867400700 1 -- 172.21.15.2:0/1951142302 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c0b4020 con 0x55f1aeed6560 2024-06-13T02:13:24.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.543+0000 7fd867400700 1 -- 172.21.15.2:0/1951142302 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7fd86c09be00 con 0x55f1aeed6560 2024-06-13T02:13:24.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.543+0000 7fd892f42b80 1 -- 172.21.15.2:0/1951142302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd87400bd10 con 0x55f1aeed6560 2024-06-13T02:13:24.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.543+0000 7fd867400700 1 -- 172.21.15.2:0/1951142302 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd86c09fd50 con 0x55f1aeed6560 2024-06-13T02:13:24.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.543+0000 7fd892f42b80 10 client.24623 fetch_fsmap learned FSMap version 17 2024-06-13T02:13:24.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.543+0000 7fd892f42b80 1 -- 172.21.15.2:0/1951142302 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55f1aeeee590 con 0x55f1aeed6560 2024-06-13T02:13:24.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.543+0000 7fd867400700 1 -- 172.21.15.2:0/1951142302 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd87400bd10 con 0x55f1aeed6560 2024-06-13T02:13:24.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.543+0000 7fd867400700 1 -- 172.21.15.2:0/1951142302 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7fd86c09adf0 con 0x55f1aeed6560 2024-06-13T02:13:24.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.543+0000 7fd892f42b80 10 client.24623 fetch_fsmap finished waiting for FSMap version 17 2024-06-13T02:13:24.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.544+0000 7fd892f42b80 10 client.24623 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T02:13:24.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.544+0000 7fd892f42b80 20 client.24623 populate_metadata read hostname 'smithi002' 2024-06-13T02:13:24.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.544+0000 7fd892f42b80 1 --2- 172.21.15.2:0/1951142302 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f1aeef0c20 0x55f1aeef2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.544+0000 7fd892f42b80 4 client.24623 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:13:24.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.544+0000 7fd892f42b80 1 -- 172.21.15.2:0/1951142302 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1aee35fb0 con 0x55f1aeef0c20 2024-06-13T02:13:24.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.544+0000 7fd885c00700 1 --2- 172.21.15.2:0/1951142302 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f1aeef0c20 0x55f1aeef2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.545+0000 7fd885c00700 1 --2- 172.21.15.2:0/1951142302 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f1aeef0c20 0x55f1aeef2090 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ece03058b18f0831 server_cookie=8fa53f811545bd2d in_seq=0 out_seq=0 2024-06-13T02:13:24.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.545+0000 7fd867400700 10 client.24623 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:13:24.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.545+0000 7fd867400700 1 -- 172.21.15.2:0/1951142302 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f1aee35fb0 con 0x55f1aeef0c20 2024-06-13T02:13:24.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.545+0000 7fd867400700 10 client.24623 handle_command_reply: tid=0 2024-06-13T02:13:24.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.546+0000 7fd892f42b80 1 client.24623 shutdown 2024-06-13T02:13:24.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.546+0000 7fd892f42b80 1 -- 172.21.15.2:0/1951142302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeed6560 msgr2=0x55f1aeeddc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:24.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.546+0000 7fd892f42b80 1 --2- 172.21.15.2:0/1951142302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeed6560 0x55f1aeeddc20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd86c010e10 tx=0x7fd86c09c170 comp rx=0 tx=0).stop 2024-06-13T02:13:24.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.546+0000 7fd892f42b80 1 -- 172.21.15.2:0/1951142302 shutdown_connections 2024-06-13T02:13:24.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.546+0000 7fd892f42b80 1 --2- 172.21.15.2:0/1951142302 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f1aeef0c20 0x55f1aeef2090 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.546+0000 7fd892f42b80 1 --2- 172.21.15.2:0/1951142302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aeee12b0 0x55f1aeede160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.546+0000 7fd892f42b80 1 --2- 172.21.15.2:0/1951142302 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aee52df0 0x55f1aeee0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.546+0000 7fd892f42b80 1 --2- 172.21.15.2:0/1951142302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeed6560 0x55f1aeeddc20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.546+0000 7fd892f42b80 1 -- 172.21.15.2:0/1951142302 >> 172.21.15.2:0/1951142302 conn(0x55f1aee03120 msgr2=0x55f1aeed16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:24.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.546+0000 7fd867400700 0 client.24623 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:13:24.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.546+0000 7fd892f42b80 1 -- 172.21.15.2:0/1951142302 shutdown_connections 2024-06-13T02:13:24.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.546+0000 7fd892f42b80 1 -- 172.21.15.2:0/1951142302 wait complete. 2024-06-13T02:13:24.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.546+0000 7fd892f42b80 20 client.24623 trim_cache size 0 max 16384 2024-06-13T02:13:24.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.570+0000 7fd892f42b80 1 Processor -- start 2024-06-13T02:13:24.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.570+0000 7fd892f42b80 1 -- start start 2024-06-13T02:13:24.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd892f42b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aee52df0 0x55f1aeee36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd892f42b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeed25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd892f42b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeee12b0 0x55f1aeee26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd892f42b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f1aeef03d0 con 0x55f1aeed6560 2024-06-13T02:13:24.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd892f42b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f1aeef0aa0 con 0x55f1aeee12b0 2024-06-13T02:13:24.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd892f42b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f1aeef1170 con 0x55f1aee52df0 2024-06-13T02:13:24.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd885200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeed25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd886600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeee12b0 0x55f1aeee26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd885200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeed25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36992/0 (socket says 172.21.15.2:36992) 2024-06-13T02:13:24.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd885200700 1 -- 172.21.15.2:0/895477049 learned_addr learned my addr 172.21.15.2:0/895477049 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:24.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd885c00700 1 --2- 172.21.15.2:0/895477049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aee52df0 0x55f1aeee36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd886600700 1 -- 172.21.15.2:0/895477049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aee52df0 msgr2=0x55f1aeee36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:13:24.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd886600700 1 --2- 172.21.15.2:0/895477049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aee52df0 0x55f1aeee36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd886600700 1 -- 172.21.15.2:0/895477049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 msgr2=0x55f1aeed25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:13:24.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd886600700 1 --2- 172.21.15.2:0/895477049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeed25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.571+0000 7fd886600700 1 -- 172.21.15.2:0/895477049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1aeede190 con 0x55f1aeee12b0 2024-06-13T02:13:24.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.572+0000 7fd886600700 1 --2- 172.21.15.2:0/895477049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeee12b0 0x55f1aeee26a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd878009160 tx=0x7fd87800c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcc36ebd122cd0b0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:24.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.572+0000 7fd872000700 1 -- 172.21.15.2:0/895477049 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87802b070 con 0x55f1aeee12b0 2024-06-13T02:13:24.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.572+0000 7fd872000700 1 -- 172.21.15.2:0/895477049 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd878017cb0 con 0x55f1aeee12b0 2024-06-13T02:13:24.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.572+0000 7fd872000700 1 -- 172.21.15.2:0/895477049 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd878026640 con 0x55f1aeee12b0 2024-06-13T02:13:24.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.573+0000 7fd892f42b80 1 -- 172.21.15.2:0/895477049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeee12b0 msgr2=0x55f1aeee26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:24.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.573+0000 7fd892f42b80 1 --2- 172.21.15.2:0/895477049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeee12b0 0x55f1aeee26a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd878009160 tx=0x7fd87800c000 comp rx=0 tx=0).stop 2024-06-13T02:13:24.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.573+0000 7fd892f42b80 1 -- 172.21.15.2:0/895477049 shutdown_connections 2024-06-13T02:13:24.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.573+0000 7fd892f42b80 1 --2- 172.21.15.2:0/895477049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeee12b0 0x55f1aeee26a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.573+0000 7fd892f42b80 1 --2- 172.21.15.2:0/895477049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aee52df0 0x55f1aeee36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.573+0000 7fd892f42b80 1 --2- 172.21.15.2:0/895477049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeed25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.573+0000 7fd892f42b80 1 -- 172.21.15.2:0/895477049 >> 172.21.15.2:0/895477049 conn(0x55f1aee03120 msgr2=0x55f1aeee2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:24.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.573+0000 7fd892f42b80 1 -- 172.21.15.2:0/895477049 shutdown_connections 2024-06-13T02:13:24.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.573+0000 7fd892f42b80 1 -- 172.21.15.2:0/895477049 wait complete. 2024-06-13T02:13:24.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.573+0000 7fd892f42b80 1 -- start start 2024-06-13T02:13:24.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.573+0000 7fd892f42b80 1 Processor -- start 2024-06-13T02:13:24.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.574+0000 7fd892f42b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aee52df0 0x55f1aeefbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.574+0000 7fd892f42b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeee2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.574+0000 7fd892f42b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeee12b0 0x55f1aeee2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.574+0000 7fd892f42b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f1aeef1f10 con 0x55f1aeed6560 2024-06-13T02:13:24.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.574+0000 7fd892f42b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f1aeef1840 con 0x55f1aeee12b0 2024-06-13T02:13:24.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.574+0000 7fd892f42b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f1aeef25e0 con 0x55f1aee52df0 2024-06-13T02:13:24.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.574+0000 7fd892f42b80 10 client.0 _ll_register_callbacks cb 0x55f1aedc26d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:13:24.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.574+0000 7fd885200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeee2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.574+0000 7fd885200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeee2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:37008/0 (socket says 172.21.15.2:37008) 2024-06-13T02:13:24.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.574+0000 7fd886600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeee12b0 0x55f1aeee2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.574+0000 7fd885200700 1 -- 172.21.15.2:0/3375520757 learned_addr learned my addr 172.21.15.2:0/3375520757 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:24.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.574+0000 7fd885c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aee52df0 0x55f1aeefbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.575+0000 7fd886600700 1 -- 172.21.15.2:0/3375520757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aee52df0 msgr2=0x55f1aeefbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:13:24.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.575+0000 7fd886600700 1 --2- 172.21.15.2:0/3375520757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aee52df0 0x55f1aeefbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.575+0000 7fd886600700 1 -- 172.21.15.2:0/3375520757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 msgr2=0x55f1aeee2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:13:24.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.575+0000 7fd886600700 1 --2- 172.21.15.2:0/3375520757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeee2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.575+0000 7fd886600700 1 -- 172.21.15.2:0/3375520757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1aeee34a0 con 0x55f1aeee12b0 2024-06-13T02:13:24.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.575+0000 7fd885200700 1 --2- 172.21.15.2:0/3375520757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeee2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:13:24.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.575+0000 7fd886600700 1 --2- 172.21.15.2:0/3375520757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeee12b0 0x55f1aeee2c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd878008010 tx=0x7fd87801b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48eadfc1c46603d3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:24.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.575+0000 7fd867400700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:13:24.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.575+0000 7fd867400700 1 -- 172.21.15.2:0/3375520757 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd878034060 con 0x55f1aeee12b0 2024-06-13T02:13:24.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.575+0000 7fd892f42b80 1 -- 172.21.15.2:0/3375520757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd878017cb0 con 0x55f1aeee12b0 2024-06-13T02:13:24.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.575+0000 7fd867400700 1 -- 172.21.15.2:0/3375520757 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9092+0+0 (secure 0 0 0) 0x7fd87801b8e0 con 0x55f1aeee12b0 2024-06-13T02:13:24.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.576+0000 7fd867400700 1 -- 172.21.15.2:0/3375520757 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd87803b050 con 0x55f1aeee12b0 2024-06-13T02:13:24.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.576+0000 7fd892f42b80 10 client.24629 fetch_fsmap learned FSMap version 17 2024-06-13T02:13:24.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.576+0000 7fd892f42b80 1 -- 172.21.15.2:0/3375520757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55f1aef5c510 con 0x55f1aeee12b0 2024-06-13T02:13:24.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.576+0000 7fd867400700 1 -- 172.21.15.2:0/3375520757 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd878017cb0 con 0x55f1aeee12b0 2024-06-13T02:13:24.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.576+0000 7fd867400700 1 -- 172.21.15.2:0/3375520757 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7fd878012040 con 0x55f1aeee12b0 2024-06-13T02:13:24.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.576+0000 7fd892f42b80 10 client.24629 fetch_fsmap finished waiting for FSMap version 17 2024-06-13T02:13:24.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.576+0000 7fd892f42b80 10 client.24629 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T02:13:24.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.576+0000 7fd892f42b80 20 client.24629 populate_metadata read hostname 'smithi002' 2024-06-13T02:13:24.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.576+0000 7fd892f42b80 1 --2- 172.21.15.2:0/3375520757 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f1aef60d30 0x55f1aef5fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:24.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.576+0000 7fd892f42b80 4 client.24629 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T02:13:24.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.576+0000 7fd892f42b80 1 -- 172.21.15.2:0/3375520757 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "status"}) -- 0x55f1aee30530 con 0x55f1aef60d30 2024-06-13T02:13:24.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.576+0000 7fd885c00700 1 --2- 172.21.15.2:0/3375520757 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f1aef60d30 0x55f1aef5fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:24.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.577+0000 7fd885c00700 1 --2- 172.21.15.2:0/3375520757 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f1aef60d30 0x55f1aef5fa40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c02b4021ae84f9 server_cookie=8e016d2ac748aafd in_seq=0 out_seq=0 2024-06-13T02:13:24.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.577+0000 7fd867400700 10 client.24629 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:13:24.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.577+0000 7fd867400700 1 -- 172.21.15.2:0/3375520757 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f1aee30530 con 0x55f1aef60d30 2024-06-13T02:13:24.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.577+0000 7fd867400700 10 client.24629 handle_command_reply: tid=0 2024-06-13T02:13:24.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.577+0000 7fd892f42b80 1 client.24629 shutdown 2024-06-13T02:13:24.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.577+0000 7fd892f42b80 1 -- 172.21.15.2:0/3375520757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeee12b0 msgr2=0x55f1aeee2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:24.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.577+0000 7fd892f42b80 1 --2- 172.21.15.2:0/3375520757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeee12b0 0x55f1aeee2c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd878008010 tx=0x7fd87801b670 comp rx=0 tx=0).stop 2024-06-13T02:13:24.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.577+0000 7fd892f42b80 1 -- 172.21.15.2:0/3375520757 shutdown_connections 2024-06-13T02:13:24.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.577+0000 7fd892f42b80 1 --2- 172.21.15.2:0/3375520757 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f1aef60d30 0x55f1aef5fa40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.577+0000 7fd892f42b80 1 --2- 172.21.15.2:0/3375520757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f1aeee12b0 0x55f1aeee2c50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.577+0000 7fd892f42b80 1 --2- 172.21.15.2:0/3375520757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f1aee52df0 0x55f1aeefbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.577+0000 7fd892f42b80 1 --2- 172.21.15.2:0/3375520757 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f1aeed6560 0x55f1aeee2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.577+0000 7fd867400700 0 client.24629 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:13:24.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.577+0000 7fd892f42b80 1 -- 172.21.15.2:0/3375520757 >> 172.21.15.2:0/3375520757 conn(0x55f1aee03120 msgr2=0x55f1aeedda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:24.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.578+0000 7fd892f42b80 1 -- 172.21.15.2:0/3375520757 shutdown_connections 2024-06-13T02:13:24.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.578+0000 7fd892f42b80 1 -- 172.21.15.2:0/3375520757 wait complete. 2024-06-13T02:13:24.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.578+0000 7fd892f42b80 20 client.24629 trim_cache size 0 max 16384 2024-06-13T02:13:24.582 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T02:13:24.583 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "efed8ab4-2928-11ef-bc9c-c7b262605968", 2024-06-13T02:13:24.583 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-06-13T02:13:24.583 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24527, 2024-06-13T02:13:24.583 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-06-13T02:13:24.583 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-06-13T02:13:24.583 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-06-13T02:13:24.583 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 41.073656530000001, 2024-06-13T02:13:24.583 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 17, 2024-06-13T02:13:24.583 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 97, 2024-06-13T02:13:24.583 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 95, 2024-06-13T02:13:24.583 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 64.611392468999995 2024-06-13T02:13:24.583 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T02:13:24.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.579+0000 7fd888600700 1 -- 172.21.15.2:0/712908174 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8680a2d70 msgr2=0x7fd8680a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:24.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.579+0000 7fd888600700 1 --2- 172.21.15.2:0/712908174 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8680a2d70 0x7fd8680a5230 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd878009510 tx=0x7fd878009920 comp rx=0 tx=0).stop 2024-06-13T02:13:24.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.579+0000 7fd888600700 1 -- 172.21.15.2:0/712908174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88006b580 msgr2=0x7fd880101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:24.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.579+0000 7fd888600700 1 --2- 172.21.15.2:0/712908174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88006b580 0x7fd880101490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00e9a0 tx=0x7fd86c00ecb0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.579+0000 7fd888600700 1 -- 172.21.15.2:0/712908174 shutdown_connections 2024-06-13T02:13:24.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.579+0000 7fd888600700 1 --2- 172.21.15.2:0/712908174 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd8680a2d70 0x7fd8680a5230 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.579+0000 7fd888600700 1 --2- 172.21.15.2:0/712908174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd880108500 0x7fd880101af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.579+0000 7fd888600700 1 --2- 172.21.15.2:0/712908174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd88006abc0 0x7fd880103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.579+0000 7fd888600700 1 --2- 172.21.15.2:0/712908174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88006b580 0x7fd880101490 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:24.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.579+0000 7fd888600700 1 -- 172.21.15.2:0/712908174 >> 172.21.15.2:0/712908174 conn(0x7fd880078340 msgr2=0x7fd880100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:24.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.579+0000 7fd888600700 1 -- 172.21.15.2:0/712908174 shutdown_connections 2024-06-13T02:13:24.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:24.579+0000 7fd888600700 1 -- 172.21.15.2:0/712908174 wait complete. 2024-06-13T02:13:24.597 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-06-13T02:13:24.597 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-06-13T02:13:24.597 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-06-13T02:13:24.597 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]: dispatch 2024-06-13T02:13:24.597 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-06-13T02:13:24.597 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-06-13T02:13:24.597 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-06-13T02:13:24.597 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-06-13T02:13:24.598 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]: dispatch 2024-06-13T02:13:24.598 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-06-13T02:13:24.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-06-13T02:13:24.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-06-13T02:13:24.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-06-13T02:13:24.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]: dispatch 2024-06-13T02:13:24.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-06-13T02:13:24.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-06-13T02:13:24.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-06-13T02:13:24.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-06-13T02:13:24.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]: dispatch 2024-06-13T02:13:24.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-06-13T02:13:24.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-06-13T02:13:24.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-06-13T02:13:24.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-06-13T02:13:24.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]: dispatch 2024-06-13T02:13:24.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-06-13T02:13:24.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-06-13T02:13:24.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-06-13T02:13:24.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-06-13T02:13:24.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]: dispatch 2024-06-13T02:13:24.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-06-13T02:13:25.445 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-13T02:13:25.445 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-13T02:13:25.445 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs ls 2024-06-13T02:13:25.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:25 smithi002 ceph-mon[31960]: pgmap v356: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:25.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-06-13T02:13:25.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-06-13T02:13:25.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-06-13T02:13:25.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2024-06-13T02:13:25.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-06-13T02:13:25.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-06-13T02:13:25.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-06-13T02:13:25.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-06-13T02:13:25.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]': finished 2024-06-13T02:13:25.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-06-13T02:13:25.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:25 smithi002 ceph-mon[31960]: osdmap e97: 12 total, 12 up, 12 in 2024-06-13T02:13:25.912 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:13:25.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:25 smithi084 ceph-mon[36833]: pgmap v356: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:25.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-06-13T02:13:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-06-13T02:13:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-06-13T02:13:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2024-06-13T02:13:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-06-13T02:13:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-06-13T02:13:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-06-13T02:13:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-06-13T02:13:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]': finished 2024-06-13T02:13:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-06-13T02:13:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:25 smithi084 ceph-mon[36833]: osdmap e97: 12 total, 12 up, 12 in 2024-06-13T02:13:26.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:25 smithi175 ceph-mon[36977]: pgmap v356: 129 pgs: 129 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:26.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-06-13T02:13:26.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-06-13T02:13:26.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-06-13T02:13:26.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2024-06-13T02:13:26.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-06-13T02:13:26.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-06-13T02:13:26.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-06-13T02:13:26.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-06-13T02:13:26.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]': finished 2024-06-13T02:13:26.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-06-13T02:13:26.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:25 smithi175 ceph-mon[36977]: osdmap e97: 12 total, 12 up, 12 in 2024-06-13T02:13:26.787 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:26 smithi002 ceph-mon[31960]: osdmap e98: 12 total, 12 up, 12 in 2024-06-13T02:13:26.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:26 smithi084 ceph-mon[36833]: osdmap e98: 12 total, 12 up, 12 in 2024-06-13T02:13:27.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:26 smithi175 ceph-mon[36977]: osdmap e98: 12 total, 12 up, 12 in 2024-06-13T02:13:27.821 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:27 smithi002 ceph-mon[31960]: pgmap v359: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:27.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:27 smithi084 ceph-mon[36833]: pgmap v359: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:28.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:27 smithi175 ceph-mon[36977]: pgmap v359: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:28.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.089+0000 7f46b7800700 1 -- 172.21.15.2:0/2739765679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b0107400 msgr2=0x7f46b01077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:28.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.089+0000 7f46b7800700 1 --2- 172.21.15.2:0/2739765679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b0107400 0x7f46b01077e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f46a0009990 tx=0x7f46a0009ca0 comp rx=0 tx=0).stop 2024-06-13T02:13:28.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.089+0000 7f46b7800700 1 -- 172.21.15.2:0/2739765679 shutdown_connections 2024-06-13T02:13:28.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.089+0000 7f46b7800700 1 --2- 172.21.15.2:0/2739765679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46b0101d50 0x7f46b010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:28.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.089+0000 7f46b7800700 1 --2- 172.21.15.2:0/2739765679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b0107400 0x7f46b01077e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:28.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.089+0000 7f46b7800700 1 --2- 172.21.15.2:0/2739765679 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b0101390 0x7f46b0101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:28.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.089+0000 7f46b7800700 1 -- 172.21.15.2:0/2739765679 >> 172.21.15.2:0/2739765679 conn(0x7f46b0078340 msgr2=0x7f46b0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:28.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.089+0000 7f46b7800700 1 -- 172.21.15.2:0/2739765679 shutdown_connections 2024-06-13T02:13:28.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.089+0000 7f46b7800700 1 -- 172.21.15.2:0/2739765679 wait complete. 2024-06-13T02:13:28.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.090+0000 7f46b7800700 1 Processor -- start 2024-06-13T02:13:28.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.091+0000 7f46b7800700 1 -- start start 2024-06-13T02:13:28.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.091+0000 7f46b7800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b0101390 0x7f46b019ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:28.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.091+0000 7f46b7800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b0101d50 0x7f46b019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:28.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.091+0000 7f46b7800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46b0107400 0x7f46b019f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:28.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.091+0000 7f46b7800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f46b0111670 con 0x7f46b0101d50 2024-06-13T02:13:28.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.091+0000 7f46b7800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f46b01114f0 con 0x7f46b0101390 2024-06-13T02:13:28.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.091+0000 7f46b7800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46b01117f0 con 0x7f46b0107400 2024-06-13T02:13:28.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.092+0000 7f46b4e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b0101390 0x7f46b019ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:28.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.092+0000 7f46b4e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b0101390 0x7f46b019ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:56830/0 (socket says 172.21.15.2:56830) 2024-06-13T02:13:28.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.092+0000 7f46b4e00700 1 -- 172.21.15.2:0/2905272687 learned_addr learned my addr 172.21.15.2:0/2905272687 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:28.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.092+0000 7f46a7e00700 1 --2- 172.21.15.2:0/2905272687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b0101d50 0x7f46b019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:28.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.092+0000 7f46b5800700 1 --2- 172.21.15.2:0/2905272687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46b0107400 0x7f46b019f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:28.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.092+0000 7f46b4e00700 1 -- 172.21.15.2:0/2905272687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46b0107400 msgr2=0x7f46b019f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:28.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.092+0000 7f46b4e00700 1 --2- 172.21.15.2:0/2905272687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46b0107400 0x7f46b019f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:28.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.092+0000 7f46b4e00700 1 -- 172.21.15.2:0/2905272687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b0101d50 msgr2=0x7f46b019b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:28.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.092+0000 7f46b4e00700 1 --2- 172.21.15.2:0/2905272687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b0101d50 0x7f46b019b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:28.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.092+0000 7f46b4e00700 1 -- 172.21.15.2:0/2905272687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b019fe20 con 0x7f46b0101390 2024-06-13T02:13:28.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.092+0000 7f46b5800700 1 --2- 172.21.15.2:0/2905272687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46b0107400 0x7f46b019f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:13:28.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.093+0000 7f46b4e00700 1 --2- 172.21.15.2:0/2905272687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b0101390 0x7f46b019ae10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f46a0000c00 tx=0x7f46a00047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:28.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.093+0000 7f46ae000700 1 -- 172.21.15.2:0/2905272687 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0027070 con 0x7f46b0101390 2024-06-13T02:13:28.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.093+0000 7f46ae000700 1 -- 172.21.15.2:0/2905272687 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46a0003780 con 0x7f46b0101390 2024-06-13T02:13:28.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.093+0000 7f46b7800700 1 -- 172.21.15.2:0/2905272687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b01a00b0 con 0x7f46b0101390 2024-06-13T02:13:28.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.093+0000 7f46ae000700 1 -- 172.21.15.2:0/2905272687 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0022dd0 con 0x7f46b0101390 2024-06-13T02:13:28.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.093+0000 7f46b7800700 1 -- 172.21.15.2:0/2905272687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b01a7990 con 0x7f46b0101390 2024-06-13T02:13:28.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.094+0000 7f46b7800700 1 -- 172.21.15.2:0/2905272687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b0069180 con 0x7f46b0101390 2024-06-13T02:13:28.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.096+0000 7f46ae000700 1 -- 172.21.15.2:0/2905272687 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f46a002a070 con 0x7f46b0101390 2024-06-13T02:13:28.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.097+0000 7f46ae000700 1 --2- 172.21.15.2:0/2905272687 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f46940a2c20 0x7f46940a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:28.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.098+0000 7f46ae000700 1 -- 172.21.15.2:0/2905272687 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9092+0+0 (secure 0 0 0) 0x7f46a00d0480 con 0x7f46b0101390 2024-06-13T02:13:28.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.098+0000 7f46a7e00700 1 --2- 172.21.15.2:0/2905272687 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f46940a2c20 0x7f46940a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:28.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.099+0000 7f46a7e00700 1 --2- 172.21.15.2:0/2905272687 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f46940a2c20 0x7f46940a50e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f46b01012d0 tx=0x7f469800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:28.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.100+0000 7f46ae000700 1 -- 172.21.15.2:0/2905272687 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f46a0013070 con 0x7f46b0101390 2024-06-13T02:13:28.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.384+0000 7f46b7800700 1 -- 172.21.15.2:0/2905272687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f46b01a7b60 con 0x7f46b0101390 2024-06-13T02:13:28.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.385+0000 7f46ae000700 1 -- 172.21.15.2:0/2905272687 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f46a009d140 con 0x7f46b0101390 2024-06-13T02:13:28.386 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-13T02:13:28.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.388+0000 7f46b7800700 1 -- 172.21.15.2:0/2905272687 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f46940a2c20 msgr2=0x7f46940a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:28.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.388+0000 7f46b7800700 1 --2- 172.21.15.2:0/2905272687 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f46940a2c20 0x7f46940a50e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f46b01012d0 tx=0x7f469800b410 comp rx=0 tx=0).stop 2024-06-13T02:13:28.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.388+0000 7f46b7800700 1 -- 172.21.15.2:0/2905272687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b0101390 msgr2=0x7f46b019ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:28.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.388+0000 7f46b7800700 1 --2- 172.21.15.2:0/2905272687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b0101390 0x7f46b019ae10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f46a0000c00 tx=0x7f46a00047b0 comp rx=0 tx=0).stop 2024-06-13T02:13:28.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.388+0000 7f46b7800700 1 -- 172.21.15.2:0/2905272687 shutdown_connections 2024-06-13T02:13:28.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.388+0000 7f46b7800700 1 --2- 172.21.15.2:0/2905272687 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f46940a2c20 0x7f46940a50e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:28.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.388+0000 7f46b7800700 1 --2- 172.21.15.2:0/2905272687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46b0107400 0x7f46b019f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:28.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.388+0000 7f46b7800700 1 --2- 172.21.15.2:0/2905272687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46b0101390 0x7f46b019ae10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:28.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.388+0000 7f46b7800700 1 --2- 172.21.15.2:0/2905272687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b0101d50 0x7f46b019b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:28.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.388+0000 7f46b7800700 1 -- 172.21.15.2:0/2905272687 >> 172.21.15.2:0/2905272687 conn(0x7f46b0078340 msgr2=0x7f46b006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:28.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.388+0000 7f46b7800700 1 -- 172.21.15.2:0/2905272687 shutdown_connections 2024-06-13T02:13:28.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:28.388+0000 7f46b7800700 1 -- 172.21.15.2:0/2905272687 wait complete. 2024-06-13T02:13:28.783 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:28 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2905272687' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-13T02:13:28.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:28 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2905272687' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-13T02:13:29.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:28 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2905272687' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-13T02:13:29.239 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-06-13T02:13:29.239 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-13T02:13:29.239 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-06-13T02:13:29.239 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-06-13T02:13:29.239 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-06-13T02:13:29.239 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-06-13T02:13:29.239 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-13T02:13:29.239 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-13T02:13:29.240 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-06-13T02:13:29.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:13:29.240 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-06-13T02:13:29.302 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-13T02:13:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-13T02:13:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-06-13T02:13:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-06-13T02:13:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-06-13T02:13:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-06-13T02:13:29.302 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T02:13:29.302 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-06-13T02:13:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-06-13T02:13:29.303 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T02:13:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-06-13T02:13:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-06-13T02:13:29.303 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-13T02:13:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-06-13T02:13:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-06-13T02:13:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-06-13T02:13:29.303 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 41889sec preferred_lft 41889sec 2024-06-13T02:13:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-06-13T02:13:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-06-13T02:13:29.304 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T02:13:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-06-13T02:13:29.304 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-06-13T02:13:29.305 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-13T02:13:29.305 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T02:13:29.305 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T02:13:29.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-06-13T02:13:29.306 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-06-13T02:13:29.306 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-06-13T02:13:29.306 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-13T02:13:29.306 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T02:13:29.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T02:13:29.697 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:29 smithi002 ceph-mon[31960]: pgmap v360: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:29.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:13:29.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:13:29.818 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-13T02:13:29.889 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-06-13T02:13:29.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:13:29.893 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-06-13T02:13:29.955 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-06-13T02:13:29.955 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-13T02:13:29.955 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-13T02:13:29.955 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-13T02:13:29.955 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-13T02:13:29.956 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T02:13:29.956 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T02:13:29.956 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-13T02:13:29.956 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-13T02:13:29.956 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-13T02:13:29.956 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T02:13:29.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:29 smithi084 ceph-mon[36833]: pgmap v360: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:30.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:29 smithi175 ceph-mon[36977]: pgmap v360: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:30.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T02:13:30.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:30 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:13:30.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:13:30.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:13:30.691 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-06-13T02:13:30.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:13:30.731 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-06-13T02:13:30.817 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T02:13:30.818 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T02:13:30.818 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T02:13:30.818 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-06-13T02:13:30.818 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T02:13:30.845 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:30 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:13:30.874 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:30 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:13:30.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T02:13:31.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:13:31.026 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-06-13T02:13:31.026 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T02:13:31.026 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T02:13:31.026 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-06-13T02:13:31.026 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-13T02:13:31.026 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-06-13T02:13:31.026 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-06-13T02:13:31.026 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-06-13T02:13:31.026 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T02:13:31.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T02:13:31.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:13:31.341 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T02:13:31.341 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T02:13:31.341 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-06-13T02:13:31.341 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-06-13T02:13:31.341 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T02:13:31.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T02:13:31.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:13:31.535 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-06-13T02:13:31.536 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T02:13:31.536 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-06-13T02:13:31.578 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-06-13T02:13:31.578 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T02:13:31.578 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-06-13T02:13:31.672 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-06-13T02:13:31.735 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:31 smithi002 ceph-mon[31960]: pgmap v361: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:31.744 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-06-13T02:13:31.793 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-06-13T02:13:31.793 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-06-13T02:13:31.793 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-06-13T02:13:31.793 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-06-13T02:13:31.793 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-06-13T02:13:31.793 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-06-13T02:13:31.793 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-06-13T02:13:31.793 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-06-13T02:13:31.793 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-06-13T02:13:31.794 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-06-13T02:13:31.794 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-06-13T02:13:31.794 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-06-13T02:13:31.794 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-06-13T02:13:31.794 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-06-13T02:13:31.794 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-06-13T02:13:31.794 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-06-13T02:13:31.794 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-06-13T02:13:31.794 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-06-13T02:13:31.794 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-06-13T02:13:31.794 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-06-13T02:13:31.794 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-13T02:13:31.795 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-13T02:13:31.795 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-06-13T02:13:31.795 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-06-13T02:13:31.795 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-06-13T02:13:31.795 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-06-13T02:13:31.795 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/c7e027996e75277510c70982fa2ea473f8d1805da4ccff73b8a1f36f13cb8ff5/merged 2024-06-13T02:13:31.795 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/0b461acd3fa5a1790d647d523047fe8d76102e9a844c9c70553fcd4009d6bcb1/merged 2024-06-13T02:13:31.795 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-06-13T02:13:31.795 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-06-13T02:13:31.795 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/d012c177e52bcc4951774cdfcb9ffb40284e11911f970c152debc841dd915471/merged 2024-06-13T02:13:31.796 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/4c98fc8d73c0c0dfe64a4621baf453bbc6c01de9138371e8229f50744264eaad/merged 2024-06-13T02:13:31.796 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/50f7ce8660d10e01b4e9a211922b856ab5c735bc731092600b0f3e884de54dfa/merged 2024-06-13T02:13:31.796 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/5eab2848ae4990d200a9d446bc0930ba95e3519d06553b836847865bcd78a8d5/merged 2024-06-13T02:13:31.796 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/21bbc5661f53e99dbc7673c1d65b7bd890e59d183780f53042ba58ee047e02b8/merged 2024-06-13T02:13:31.796 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/cd85d938a40a558ff1ce3cc59135408daee61214902c17f6cce4bbb8a0bb33c6/merged 2024-06-13T02:13:31.796 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/04bed4a1ebd93a46bc6c4e4aa0065ad999fff22e159f4bf1ca490ab863287a82/merged 2024-06-13T02:13:31.796 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/de9b52eb58bf0b5f1322df2de1a68b165eb5bc3b5e956f8d44aaed06e2ef2544/merged 2024-06-13T02:13:31.796 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-06-13T02:13:31.796 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T02:13:31.796 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T02:13:31.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:13:31.797 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-06-13T02:13:31.841 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-06-13T02:13:31.841 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-06-13T02:13:31.886 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-06-13T02:13:31.953 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-06-13T02:13:31.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:31 smithi084 ceph-mon[36833]: pgmap v361: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:31.996 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-06-13T02:13:31.996 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-06-13T02:13:31.996 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-06-13T02:13:31.996 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-06-13T02:13:31.996 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-06-13T02:13:31.996 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-06-13T02:13:31.997 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-06-13T02:13:31.997 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-06-13T02:13:31.997 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-06-13T02:13:31.997 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-06-13T02:13:31.997 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-06-13T02:13:31.997 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-06-13T02:13:31.997 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-06-13T02:13:31.997 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-06-13T02:13:31.997 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-06-13T02:13:31.997 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-06-13T02:13:31.997 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-06-13T02:13:31.997 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-06-13T02:13:31.998 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-06-13T02:13:31.998 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-06-13T02:13:31.998 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-13T02:13:31.998 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-13T02:13:31.998 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-06-13T02:13:31.998 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-06-13T02:13:31.998 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-06-13T02:13:31.998 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-06-13T02:13:31.998 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/c7e027996e75277510c70982fa2ea473f8d1805da4ccff73b8a1f36f13cb8ff5/merged 2024-06-13T02:13:31.998 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/0b461acd3fa5a1790d647d523047fe8d76102e9a844c9c70553fcd4009d6bcb1/merged 2024-06-13T02:13:31.998 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-06-13T02:13:31.998 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-06-13T02:13:31.998 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/d012c177e52bcc4951774cdfcb9ffb40284e11911f970c152debc841dd915471/merged 2024-06-13T02:13:31.999 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/4c98fc8d73c0c0dfe64a4621baf453bbc6c01de9138371e8229f50744264eaad/merged 2024-06-13T02:13:31.999 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/50f7ce8660d10e01b4e9a211922b856ab5c735bc731092600b0f3e884de54dfa/merged 2024-06-13T02:13:31.999 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/5eab2848ae4990d200a9d446bc0930ba95e3519d06553b836847865bcd78a8d5/merged 2024-06-13T02:13:31.999 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/21bbc5661f53e99dbc7673c1d65b7bd890e59d183780f53042ba58ee047e02b8/merged 2024-06-13T02:13:31.999 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/cd85d938a40a558ff1ce3cc59135408daee61214902c17f6cce4bbb8a0bb33c6/merged 2024-06-13T02:13:31.999 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/04bed4a1ebd93a46bc6c4e4aa0065ad999fff22e159f4bf1ca490ab863287a82/merged 2024-06-13T02:13:31.999 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/de9b52eb58bf0b5f1322df2de1a68b165eb5bc3b5e956f8d44aaed06e2ef2544/merged 2024-06-13T02:13:31.999 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-06-13T02:13:31.999 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T02:13:31.999 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T02:13:32.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:13:32.000 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-06-13T02:13:32.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:31 smithi175 ceph-mon[36977]: pgmap v361: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:32.099 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:2024-06-13T02:13:32.098+0000 7f2b47a78480 -1 init, newargv = 0x5558922826d0 newargc=15 2024-06-13T02:13:32.099 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:ceph-fuse[75420]: starting ceph client 2024-06-13T02:13:32.110 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:ceph-fuse[75420]: starting fuse 2024-06-13T02:13:33.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:32 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:33.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:32 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:33.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:32 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:33.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:32 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:33.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:32 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:33.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:32 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:33.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:32 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:33.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:32 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:33.185 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-06-13T02:13:33.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:32 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:33.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:32 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:33.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:32 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:33.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:32 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:33.268 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-06-13T02:13:33.319 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-06-13T02:13:33.319 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-06-13T02:13:33.319 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-06-13T02:13:33.319 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-06-13T02:13:33.319 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-06-13T02:13:33.319 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-06-13T02:13:33.320 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-06-13T02:13:33.320 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-06-13T02:13:33.320 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-06-13T02:13:33.320 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-06-13T02:13:33.320 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-06-13T02:13:33.320 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-06-13T02:13:33.320 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-06-13T02:13:33.320 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-06-13T02:13:33.320 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-06-13T02:13:33.320 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-06-13T02:13:33.320 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-06-13T02:13:33.320 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-06-13T02:13:33.320 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-06-13T02:13:33.320 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-06-13T02:13:33.321 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-06-13T02:13:33.321 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-06-13T02:13:33.321 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-06-13T02:13:33.321 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-06-13T02:13:33.321 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-06-13T02:13:33.321 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay 2024-06-13T02:13:33.321 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/c7e027996e75277510c70982fa2ea473f8d1805da4ccff73b8a1f36f13cb8ff5/merged 2024-06-13T02:13:33.321 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/0b461acd3fa5a1790d647d523047fe8d76102e9a844c9c70553fcd4009d6bcb1/merged 2024-06-13T02:13:33.321 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/0 2024-06-13T02:13:33.321 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-06-13T02:13:33.321 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/d012c177e52bcc4951774cdfcb9ffb40284e11911f970c152debc841dd915471/merged 2024-06-13T02:13:33.321 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/4c98fc8d73c0c0dfe64a4621baf453bbc6c01de9138371e8229f50744264eaad/merged 2024-06-13T02:13:33.321 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/50f7ce8660d10e01b4e9a211922b856ab5c735bc731092600b0f3e884de54dfa/merged 2024-06-13T02:13:33.321 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/5eab2848ae4990d200a9d446bc0930ba95e3519d06553b836847865bcd78a8d5/merged 2024-06-13T02:13:33.322 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/21bbc5661f53e99dbc7673c1d65b7bd890e59d183780f53042ba58ee047e02b8/merged 2024-06-13T02:13:33.322 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/cd85d938a40a558ff1ce3cc59135408daee61214902c17f6cce4bbb8a0bb33c6/merged 2024-06-13T02:13:33.322 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/04bed4a1ebd93a46bc6c4e4aa0065ad999fff22e159f4bf1ca490ab863287a82/merged 2024-06-13T02:13:33.322 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/containers/storage/overlay/de9b52eb58bf0b5f1322df2de1a68b165eb5bc3b5e956f8d44aaed06e2ef2544/merged 2024-06-13T02:13:33.322 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-06-13T02:13:33.322 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T02:13:33.322 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T02:13:33.322 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.admin 2024-06-13T02:13:33.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:13:33.323 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-06-13T02:13:33.370 INFO:teuthology.orchestra.run.smithi002.stdout:119 2024-06-13T02:13:33.370 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-06-13T02:13:33.370 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2024-06-13T02:13:33.370 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2024-06-13T02:13:33.370 DEBUG:teuthology.orchestra.run.smithi002:> import re 2024-06-13T02:13:33.371 DEBUG:teuthology.orchestra.run.smithi002:> import os 2024-06-13T02:13:33.371 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2024-06-13T02:13:33.371 DEBUG:teuthology.orchestra.run.smithi002:> 2024-06-13T02:13:33.371 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2024-06-13T02:13:33.371 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-06-13T02:13:33.371 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2024-06-13T02:13:33.371 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-06-13T02:13:33.371 DEBUG:teuthology.orchestra.run.smithi002:> 2024-06-13T02:13:33.371 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2024-06-13T02:13:33.371 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2024-06-13T02:13:33.371 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2024-06-13T02:13:33.371 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2024-06-13T02:13:33.371 DEBUG:teuthology.orchestra.run.smithi002:> 2024-06-13T02:13:33.371 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2024-06-13T02:13:33.371 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-06-13T02:13:33.372 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2024-06-13T02:13:33.372 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-06-13T02:13:33.372 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2024-06-13T02:13:33.372 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2024-06-13T02:13:33.372 DEBUG:teuthology.orchestra.run.smithi002:> return f 2024-06-13T02:13:33.372 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-06-13T02:13:33.372 DEBUG:teuthology.orchestra.run.smithi002:> 2024-06-13T02:13:33.372 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.admin")) 2024-06-13T02:13:33.372 DEBUG:teuthology.orchestra.run.smithi002:> ' 2024-06-13T02:13:33.586 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.admin.75420.asok 2024-06-13T02:13:33.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:13:33.603 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75420.asok 2024-06-13T02:13:33.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:13:33.604 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75420.asok status 2024-06-13T02:13:33.819 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T02:13:33.819 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2024-06-13T02:13:33.819 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "3d89accfe3201286f000e065a1faea2a88c7a6ba", 2024-06-13T02:13:33.819 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.0.0-2946-g3d89accf (3d89accfe3201286f000e065a1faea2a88c7a6ba) squid (rc)", 2024-06-13T02:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "admin", 2024-06-13T02:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2024-06-13T02:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-06-13T02:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "75420", 2024-06-13T02:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2024-06-13T02:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2024-06-13T02:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2024-06-13T02:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24641, 2024-06-13T02:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2024-06-13T02:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2024-06-13T02:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2024-06-13T02:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 24641 2024-06-13T02:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:13:33.820 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-06-13T02:13:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-06-13T02:13:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-06-13T02:13:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2976482353 2024-06-13T02:13:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:13:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:13:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-06-13T02:13:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-06-13T02:13:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-06-13T02:13:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2976482353 2024-06-13T02:13:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:13:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.24641 172.21.15.2:0/2976482353", 2024-06-13T02:13:33.821 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "172.21.15.2:0/2976482353", 2024-06-13T02:13:33.822 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2024-06-13T02:13:33.822 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 17, 2024-06-13T02:13:33.822 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 98, 2024-06-13T02:13:33.822 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2024-06-13T02:13:33.822 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2024-06-13T02:13:33.822 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2024-06-13T02:13:33.822 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T02:13:33.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:13:33.835 DEBUG:teuthology.orchestra.run.smithi002:> stat --file-system '--printf=%T 2024-06-13T02:13:33.835 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-06-13T02:13:33.880 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2024-06-13T02:13:33.881 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-06-13T02:13:33.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:13:33.881 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-06-13T02:13:34.006 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-06-13T02:13:34.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T02:13:34.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:33 smithi002 ceph-mon[31960]: pgmap v362: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:34.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:34.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:33 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:34.149 INFO:teuthology.orchestra.run.smithi002.stdout:# file: . 2024-06-13T02:13:34.149 INFO:teuthology.orchestra.run.smithi002.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-06-13T02:13:34.149 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:13:34.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:13:34.160 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:13:34.160 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T02:13:34.210 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd blocklist ls 2024-06-13T02:13:34.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:33 smithi084 ceph-mon[36833]: pgmap v362: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:34.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:33 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:34.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:33 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:34.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:33 smithi175 ceph-mon[36977]: pgmap v362: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:34.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:34.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:33 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:34.701 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:13:35.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:34 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:13:35.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:34 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:13:35.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:34 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:35.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:34 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:13:35.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:34 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:13:35.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:34 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:35.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:34 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:13:35.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:34 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:13:35.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:34 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:13:36.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:36 smithi084 ceph-mon[36833]: pgmap v363: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:36.510 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:36 smithi002 ceph-mon[31960]: pgmap v363: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:36.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:36 smithi175 ceph-mon[36977]: pgmap v363: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:37.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.093+0000 7ff7a9000700 1 -- 172.21.15.2:0/749621396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7a4108ac0 msgr2=0x7ff7a4108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.093+0000 7ff7a9000700 1 --2- 172.21.15.2:0/749621396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7a4108ac0 0x7ff7a4108f40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009990 tx=0x7ff78c009ca0 comp rx=0 tx=0).stop 2024-06-13T02:13:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.093+0000 7ff7a9000700 1 -- 172.21.15.2:0/749621396 shutdown_connections 2024-06-13T02:13:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.093+0000 7ff7a9000700 1 --2- 172.21.15.2:0/749621396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a4109480 0x7ff7a4115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.093+0000 7ff7a9000700 1 --2- 172.21.15.2:0/749621396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a410eac0 0x7ff7a410eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.093+0000 7ff7a9000700 1 --2- 172.21.15.2:0/749621396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7a4108ac0 0x7ff7a4108f40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.093+0000 7ff7a9000700 1 -- 172.21.15.2:0/749621396 >> 172.21.15.2:0/749621396 conn(0x7ff7a4075c60 msgr2=0x7ff7a41072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.094+0000 7ff7a9000700 1 -- 172.21.15.2:0/749621396 shutdown_connections 2024-06-13T02:13:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.094+0000 7ff7a9000700 1 -- 172.21.15.2:0/749621396 wait complete. 2024-06-13T02:13:37.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.095+0000 7ff7a9000700 1 Processor -- start 2024-06-13T02:13:37.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.095+0000 7ff7a9000700 1 -- start start 2024-06-13T02:13:37.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.095+0000 7ff7a9000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7a4108ac0 0x7ff7a419f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:37.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.095+0000 7ff7a9000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a4109480 0x7ff7a419f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:37.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.095+0000 7ff7a9000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a410eac0 0x7ff7a41a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:37.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.095+0000 7ff7a9000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a4118e40 con 0x7ff7a4108ac0 2024-06-13T02:13:37.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.095+0000 7ff7a9000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a4118cc0 con 0x7ff7a410eac0 2024-06-13T02:13:37.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.095+0000 7ff7a9000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a4118fc0 con 0x7ff7a4109480 2024-06-13T02:13:37.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.096+0000 7ff7a2800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a410eac0 0x7ff7a41a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:37.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.096+0000 7ff79be00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a4109480 0x7ff7a419f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:37.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.096+0000 7ff7a1e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7a4108ac0 0x7ff7a419f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.096+0000 7ff7a2800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a410eac0 0x7ff7a41a3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:35130/0 (socket says 172.21.15.2:35130) 2024-06-13T02:13:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.096+0000 7ff7a2800700 1 -- 172.21.15.2:0/4161093062 learned_addr learned my addr 172.21.15.2:0/4161093062 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.096+0000 7ff7a2800700 1 -- 172.21.15.2:0/4161093062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a4109480 msgr2=0x7ff7a419f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.096+0000 7ff7a2800700 1 --2- 172.21.15.2:0/4161093062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a4109480 0x7ff7a419f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.096+0000 7ff7a2800700 1 -- 172.21.15.2:0/4161093062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7a4108ac0 msgr2=0x7ff7a419f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.096+0000 7ff7a2800700 1 --2- 172.21.15.2:0/4161093062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7a4108ac0 0x7ff7a419f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.096+0000 7ff7a2800700 1 -- 172.21.15.2:0/4161093062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a41a4280 con 0x7ff7a410eac0 2024-06-13T02:13:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.096+0000 7ff79be00700 1 --2- 172.21.15.2:0/4161093062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a4109480 0x7ff7a419f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:13:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.096+0000 7ff7a1e00700 1 --2- 172.21.15.2:0/4161093062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7a4108ac0 0x7ff7a419f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:13:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.097+0000 7ff7a2800700 1 --2- 172.21.15.2:0/4161093062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a410eac0 0x7ff7a41a3b40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00ef30 tx=0x7ff79c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.097+0000 7ff79aa00700 1 -- 172.21.15.2:0/4161093062 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c0092e0 con 0x7ff7a410eac0 2024-06-13T02:13:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.097+0000 7ff79aa00700 1 -- 172.21.15.2:0/4161093062 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff79c004bb0 con 0x7ff7a410eac0 2024-06-13T02:13:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.097+0000 7ff79aa00700 1 -- 172.21.15.2:0/4161093062 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c004280 con 0x7ff7a410eac0 2024-06-13T02:13:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.097+0000 7ff7a9000700 1 -- 172.21.15.2:0/4161093062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a41a4510 con 0x7ff7a410eac0 2024-06-13T02:13:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.097+0000 7ff7a9000700 1 -- 172.21.15.2:0/4161093062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a41abdf0 con 0x7ff7a410eac0 2024-06-13T02:13:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.099+0000 7ff7a9000700 1 -- 172.21.15.2:0/4161093062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7a4069180 con 0x7ff7a410eac0 2024-06-13T02:13:37.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.100+0000 7ff79aa00700 1 -- 172.21.15.2:0/4161093062 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7ff79c01b030 con 0x7ff7a410eac0 2024-06-13T02:13:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.102+0000 7ff79aa00700 1 --2- 172.21.15.2:0/4161093062 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff7880a2ca0 0x7ff7880a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.102+0000 7ff79aa00700 1 -- 172.21.15.2:0/4161093062 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9092+0+0 (secure 0 0 0) 0x7ff79c0cee40 con 0x7ff7a410eac0 2024-06-13T02:13:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.102+0000 7ff7a1e00700 1 --2- 172.21.15.2:0/4161093062 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff7880a2ca0 0x7ff7880a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:37.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.103+0000 7ff7a1e00700 1 --2- 172.21.15.2:0/4161093062 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff7880a2ca0 0x7ff7880a5160 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff794009fd0 tx=0x7ff794009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:37.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.106+0000 7ff79aa00700 1 -- 172.21.15.2:0/4161093062 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff79c022020 con 0x7ff7a410eac0 2024-06-13T02:13:37.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.354+0000 7ff7a9000700 1 -- 172.21.15.2:0/4161093062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff7a402dca0 con 0x7ff7a410eac0 2024-06-13T02:13:37.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.355+0000 7ff79aa00700 1 -- 172.21.15.2:0/4161093062 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v98) ==== 81+0+582 (secure 0 0 0) 0x7ff79c010040 con 0x7ff7a410eac0 2024-06-13T02:13:37.357 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3121279966 2024-06-14T02:04:24.281164+0000 2024-06-13T02:13:37.357 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3121279966 2024-06-14T02:04:24.281164+0000 2024-06-13T02:13:37.357 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3397168014 2024-06-14T02:04:24.281164+0000 2024-06-13T02:13:37.357 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1789744365 2024-06-14T02:04:24.281164+0000 2024-06-13T02:13:37.358 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3831398703 2024-06-14T02:03:50.073572+0000 2024-06-13T02:13:37.358 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3119270562 2024-06-14T02:03:50.073572+0000 2024-06-13T02:13:37.358 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2163302458 2024-06-14T02:03:50.073572+0000 2024-06-13T02:13:37.358 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2830681579 2024-06-14T02:03:50.073572+0000 2024-06-13T02:13:37.358 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1678672435 2024-06-14T02:04:24.281164+0000 2024-06-13T02:13:37.358 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2830681579 2024-06-14T02:03:50.073572+0000 2024-06-13T02:13:37.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.359+0000 7ff7a9000700 1 -- 172.21.15.2:0/4161093062 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff7880a2ca0 msgr2=0x7ff7880a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:37.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.359+0000 7ff7a9000700 1 --2- 172.21.15.2:0/4161093062 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff7880a2ca0 0x7ff7880a5160 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff794009fd0 tx=0x7ff794009260 comp rx=0 tx=0).stop 2024-06-13T02:13:37.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.359+0000 7ff7a9000700 1 -- 172.21.15.2:0/4161093062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a410eac0 msgr2=0x7ff7a41a3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:37.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.359+0000 7ff7a9000700 1 --2- 172.21.15.2:0/4161093062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a410eac0 0x7ff7a41a3b40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00ef30 tx=0x7ff79c00c3a0 comp rx=0 tx=0).stop 2024-06-13T02:13:37.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.359+0000 7ff7a9000700 1 -- 172.21.15.2:0/4161093062 shutdown_connections 2024-06-13T02:13:37.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.359+0000 7ff7a9000700 1 --2- 172.21.15.2:0/4161093062 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff7880a2ca0 0x7ff7880a5160 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:37.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.359+0000 7ff7a9000700 1 --2- 172.21.15.2:0/4161093062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7a410eac0 0x7ff7a41a3b40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:37.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.359+0000 7ff7a9000700 1 --2- 172.21.15.2:0/4161093062 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7a4108ac0 0x7ff7a419f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:37.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.359+0000 7ff7a9000700 1 --2- 172.21.15.2:0/4161093062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a4109480 0x7ff7a419f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:37.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.359+0000 7ff7a9000700 1 -- 172.21.15.2:0/4161093062 >> 172.21.15.2:0/4161093062 conn(0x7ff7a4075c60 msgr2=0x7ff7a40761e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:37.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.359+0000 7ff7a9000700 1 -- 172.21.15.2:0/4161093062 shutdown_connections 2024-06-13T02:13:37.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:37.359+0000 7ff7a9000700 1 -- 172.21.15.2:0/4161093062 wait complete. 2024-06-13T02:13:37.362 INFO:teuthology.orchestra.run.smithi002.stderr:listed 10 entries 2024-06-13T02:13:38.309 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:13:38.310 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T02:13:38.368 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd blocklist ls 2024-06-13T02:13:38.443 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:38 smithi002 ceph-mon[31960]: pgmap v364: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:38.443 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:38 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/4161093062' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T02:13:38.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:38 smithi084 ceph-mon[36833]: pgmap v364: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:38.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:38 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/4161093062' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T02:13:38.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:38 smithi175 ceph-mon[36977]: pgmap v364: 129 pgs: 129 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:13:38.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:38 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/4161093062' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T02:13:38.873 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:13:40.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:40 smithi084 ceph-mon[36833]: pgmap v365: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T02:13:40.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:40 smithi175 ceph-mon[36977]: pgmap v365: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T02:13:40.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:40 smithi002 ceph-mon[31960]: pgmap v365: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T02:13:41.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.194+0000 7f07f1600700 1 -- 172.21.15.2:0/1829821546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07ec105070 msgr2=0x7f07ec111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:41.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.194+0000 7f07f1600700 1 --2- 172.21.15.2:0/1829821546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07ec105070 0x7f07ec111580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009f90 tx=0x7f07e400b330 comp rx=0 tx=0).stop 2024-06-13T02:13:41.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.195+0000 7f07f1600700 1 -- 172.21.15.2:0/1829821546 shutdown_connections 2024-06-13T02:13:41.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.195+0000 7f07f1600700 1 --2- 172.21.15.2:0/1829821546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07ec105070 0x7f07ec111580 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:41.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.195+0000 7f07f1600700 1 --2- 172.21.15.2:0/1829821546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07ec10a6b0 0x7f07ec10aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:41.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.195+0000 7f07f1600700 1 --2- 172.21.15.2:0/1829821546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07ec1046b0 0x7f07ec104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:41.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.195+0000 7f07f1600700 1 -- 172.21.15.2:0/1829821546 >> 172.21.15.2:0/1829821546 conn(0x7f07ec1001a0 msgr2=0x7f07ec1025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:41.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.195+0000 7f07f1600700 1 -- 172.21.15.2:0/1829821546 shutdown_connections 2024-06-13T02:13:41.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.195+0000 7f07f1600700 1 -- 172.21.15.2:0/1829821546 wait complete. 2024-06-13T02:13:41.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.196+0000 7f07f1600700 1 Processor -- start 2024-06-13T02:13:41.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.196+0000 7f07f1600700 1 -- start start 2024-06-13T02:13:41.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.196+0000 7f07f1600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07ec1046b0 0x7f07ec19ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:41.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.196+0000 7f07f1600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07ec105070 0x7f07ec19b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:41.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.196+0000 7f07f1600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07ec10a6b0 0x7f07ec19f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:41.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.196+0000 7f07f1600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec114a90 con 0x7f07ec10a6b0 2024-06-13T02:13:41.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.196+0000 7f07f1600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec114910 con 0x7f07ec105070 2024-06-13T02:13:41.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.196+0000 7f07f1600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec114c10 con 0x7f07ec1046b0 2024-06-13T02:13:41.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.197+0000 7f07ea000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07ec105070 0x7f07ec19b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:41.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.197+0000 7f07eb400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07ec10a6b0 0x7f07ec19f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:41.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.197+0000 7f07ea000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07ec105070 0x7f07ec19b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:35144/0 (socket says 172.21.15.2:35144) 2024-06-13T02:13:41.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.197+0000 7f07ea000700 1 -- 172.21.15.2:0/673307358 learned_addr learned my addr 172.21.15.2:0/673307358 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:41.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.197+0000 7f07eaa00700 1 --2- 172.21.15.2:0/673307358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07ec1046b0 0x7f07ec19ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.197+0000 7f07ea000700 1 -- 172.21.15.2:0/673307358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07ec1046b0 msgr2=0x7f07ec19ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.197+0000 7f07ea000700 1 --2- 172.21.15.2:0/673307358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07ec1046b0 0x7f07ec19ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.197+0000 7f07ea000700 1 -- 172.21.15.2:0/673307358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07ec10a6b0 msgr2=0x7f07ec19f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.197+0000 7f07ea000700 1 --2- 172.21.15.2:0/673307358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07ec10a6b0 0x7f07ec19f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.197+0000 7f07ea000700 1 -- 172.21.15.2:0/673307358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ec19fdf0 con 0x7f07ec105070 2024-06-13T02:13:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.198+0000 7f07ea000700 1 --2- 172.21.15.2:0/673307358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07ec105070 0x7f07ec19b320 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f07d800e9c0 tx=0x7f07d800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.198+0000 7f07e3400700 1 -- 172.21.15.2:0/673307358 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8004a30 con 0x7f07ec105070 2024-06-13T02:13:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.198+0000 7f07f1600700 1 -- 172.21.15.2:0/673307358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07ec1a00e0 con 0x7f07ec105070 2024-06-13T02:13:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.198+0000 7f07e3400700 1 -- 172.21.15.2:0/673307358 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07d800cca0 con 0x7f07ec105070 2024-06-13T02:13:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.198+0000 7f07e3400700 1 -- 172.21.15.2:0/673307358 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8005610 con 0x7f07ec105070 2024-06-13T02:13:41.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.198+0000 7f07f1600700 1 -- 172.21.15.2:0/673307358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07ec1a7960 con 0x7f07ec105070 2024-06-13T02:13:41.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.199+0000 7f07f1600700 1 -- 172.21.15.2:0/673307358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07ec10cc40 con 0x7f07ec105070 2024-06-13T02:13:41.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.202+0000 7f07e3400700 1 -- 172.21.15.2:0/673307358 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f07d8004cf0 con 0x7f07ec105070 2024-06-13T02:13:41.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.203+0000 7f07e3400700 1 --2- 172.21.15.2:0/673307358 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f07d00a2ca0 0x7f07d00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:41.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.203+0000 7f07e3400700 1 -- 172.21.15.2:0/673307358 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9092+0+0 (secure 0 0 0) 0x7f07d80cf490 con 0x7f07ec105070 2024-06-13T02:13:41.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.203+0000 7f07eaa00700 1 --2- 172.21.15.2:0/673307358 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f07d00a2ca0 0x7f07d00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:41.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.204+0000 7f07eaa00700 1 --2- 172.21.15.2:0/673307358 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f07d00a2ca0 0x7f07d00a5160 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009be0 tx=0x7f07dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:41.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.208+0000 7f07e3400700 1 -- 172.21.15.2:0/673307358 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f07d809c030 con 0x7f07ec105070 2024-06-13T02:13:41.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.456+0000 7f07f1600700 1 -- 172.21.15.2:0/673307358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f07ec19c140 con 0x7f07ec105070 2024-06-13T02:13:41.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.456+0000 7f07e3400700 1 -- 172.21.15.2:0/673307358 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v98) ==== 81+0+582 (secure 0 0 0) 0x7f07d809b930 con 0x7f07ec105070 2024-06-13T02:13:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3121279966 2024-06-14T02:04:24.281164+0000 2024-06-13T02:13:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3121279966 2024-06-14T02:04:24.281164+0000 2024-06-13T02:13:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3397168014 2024-06-14T02:04:24.281164+0000 2024-06-13T02:13:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1789744365 2024-06-14T02:04:24.281164+0000 2024-06-13T02:13:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3831398703 2024-06-14T02:03:50.073572+0000 2024-06-13T02:13:41.458 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3119270562 2024-06-14T02:03:50.073572+0000 2024-06-13T02:13:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2163302458 2024-06-14T02:03:50.073572+0000 2024-06-13T02:13:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2830681579 2024-06-14T02:03:50.073572+0000 2024-06-13T02:13:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1678672435 2024-06-14T02:04:24.281164+0000 2024-06-13T02:13:41.459 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2830681579 2024-06-14T02:03:50.073572+0000 2024-06-13T02:13:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.459+0000 7f07f1600700 1 -- 172.21.15.2:0/673307358 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f07d00a2ca0 msgr2=0x7f07d00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.459+0000 7f07f1600700 1 --2- 172.21.15.2:0/673307358 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f07d00a2ca0 0x7f07d00a5160 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009be0 tx=0x7f07dc009260 comp rx=0 tx=0).stop 2024-06-13T02:13:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.459+0000 7f07f1600700 1 -- 172.21.15.2:0/673307358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07ec105070 msgr2=0x7f07ec19b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:41.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.459+0000 7f07f1600700 1 --2- 172.21.15.2:0/673307358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07ec105070 0x7f07ec19b320 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f07d800e9c0 tx=0x7f07d800ecd0 comp rx=0 tx=0).stop 2024-06-13T02:13:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.460+0000 7f07f1600700 1 -- 172.21.15.2:0/673307358 shutdown_connections 2024-06-13T02:13:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.460+0000 7f07f1600700 1 --2- 172.21.15.2:0/673307358 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f07d00a2ca0 0x7f07d00a5160 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.460+0000 7f07f1600700 1 --2- 172.21.15.2:0/673307358 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07ec10a6b0 0x7f07ec19f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.460+0000 7f07f1600700 1 --2- 172.21.15.2:0/673307358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07ec1046b0 0x7f07ec19ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.460+0000 7f07f1600700 1 --2- 172.21.15.2:0/673307358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07ec105070 0x7f07ec19b320 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.460+0000 7f07f1600700 1 -- 172.21.15.2:0/673307358 >> 172.21.15.2:0/673307358 conn(0x7f07ec1001a0 msgr2=0x7f07ec1006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.460+0000 7f07f1600700 1 -- 172.21.15.2:0/673307358 shutdown_connections 2024-06-13T02:13:41.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:41.460+0000 7f07f1600700 1 -- 172.21.15.2:0/673307358 wait complete. 2024-06-13T02:13:41.463 INFO:teuthology.orchestra.run.smithi002.stderr:listed 10 entries 2024-06-13T02:13:42.278 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2024-06-13T02:13:42.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:13:42.278 DEBUG:teuthology.orchestra.run.smithi002:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-06-13T02:13:42.373 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:ceph-fuse[75420]: fuse finished with error 0 and tester_r 0 2024-06-13T02:13:42.379 INFO:teuthology.orchestra.run:waiting for 300 2024-06-13T02:13:42.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:42 smithi084 ceph-mon[36833]: pgmap v366: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T02:13:42.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:42 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/673307358' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T02:13:42.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:42 smithi002 ceph-mon[31960]: pgmap v366: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T02:13:42.487 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:42 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/673307358' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T02:13:42.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:42 smithi175 ceph-mon[36977]: pgmap v366: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T02:13:42.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:42 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/673307358' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T02:13:44.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:44 smithi084 ceph-mon[36833]: pgmap v367: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T02:13:44.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:44 smithi175 ceph-mon[36977]: pgmap v367: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T02:13:44.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:44 smithi002 ceph-mon[31960]: pgmap v367: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T02:13:46.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:46 smithi084 ceph-mon[36833]: pgmap v368: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T02:13:46.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:46 smithi175 ceph-mon[36977]: pgmap v368: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T02:13:46.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:46 smithi002 ceph-mon[31960]: pgmap v368: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T02:13:48.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:48 smithi084 ceph-mon[36833]: pgmap v369: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T02:13:48.481 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T02:13:48.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:13:48.481 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-06-13T02:13:48.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:48 smithi175 ceph-mon[36977]: pgmap v369: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T02:13:48.552 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T02:13:48.625 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:48 smithi002 ceph-mon[31960]: pgmap v369: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-06-13T02:13:49.007 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:13:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:50 smithi002 ceph-mon[31960]: pgmap v370: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-06-13T02:13:50.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:50 smithi084 ceph-mon[36833]: pgmap v370: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-06-13T02:13:50.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:50 smithi175 ceph-mon[36977]: pgmap v370: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-06-13T02:13:51.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.338+0000 7faf6fc00700 1 -- 172.21.15.2:0/2216838604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf68105070 msgr2=0x7faf68111580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:51.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.338+0000 7faf6fc00700 1 --2- 172.21.15.2:0/2216838604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf68105070 0x7faf68111580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faf60009f90 tx=0x7faf6000b330 comp rx=0 tx=0).stop 2024-06-13T02:13:51.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.339+0000 7faf6fc00700 1 -- 172.21.15.2:0/2216838604 shutdown_connections 2024-06-13T02:13:51.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.339+0000 7faf6fc00700 1 --2- 172.21.15.2:0/2216838604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf68105070 0x7faf68111580 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:51.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.339+0000 7faf6fc00700 1 --2- 172.21.15.2:0/2216838604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf6810a6b0 0x7faf6810aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:51.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.339+0000 7faf6fc00700 1 --2- 172.21.15.2:0/2216838604 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf681046b0 0x7faf68104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:51.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.339+0000 7faf6fc00700 1 -- 172.21.15.2:0/2216838604 >> 172.21.15.2:0/2216838604 conn(0x7faf681001a0 msgr2=0x7faf681025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:51.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.339+0000 7faf6fc00700 1 -- 172.21.15.2:0/2216838604 shutdown_connections 2024-06-13T02:13:51.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.339+0000 7faf6fc00700 1 -- 172.21.15.2:0/2216838604 wait complete. 2024-06-13T02:13:51.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.340+0000 7faf6fc00700 1 Processor -- start 2024-06-13T02:13:51.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.340+0000 7faf6fc00700 1 -- start start 2024-06-13T02:13:51.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.341+0000 7faf6fc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf681046b0 0x7faf6819ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:51.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.341+0000 7faf6fc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf68105070 0x7faf6819b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:51.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.341+0000 7faf6fc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6810a6b0 0x7faf6819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:51.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.341+0000 7faf6fc00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faf68114a50 con 0x7faf68105070 2024-06-13T02:13:51.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.341+0000 7faf6fc00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faf681148d0 con 0x7faf681046b0 2024-06-13T02:13:51.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.341+0000 7faf6fc00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faf68114bd0 con 0x7faf6810a6b0 2024-06-13T02:13:51.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.341+0000 7faf6dc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6810a6b0 0x7faf6819f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:51.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.341+0000 7faf6dc00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6810a6b0 0x7faf6819f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:42682/0 (socket says 172.21.15.2:42682) 2024-06-13T02:13:51.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.341+0000 7faf6dc00700 1 -- 172.21.15.2:0/2305870139 learned_addr learned my addr 172.21.15.2:0/2305870139 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:51.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.341+0000 7faf6d200700 1 --2- 172.21.15.2:0/2305870139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf681046b0 0x7faf6819ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:51.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.341+0000 7faf67e00700 1 --2- 172.21.15.2:0/2305870139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf68105070 0x7faf6819b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:51.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.342+0000 7faf6dc00700 1 -- 172.21.15.2:0/2305870139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf681046b0 msgr2=0x7faf6819ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:51.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.342+0000 7faf6dc00700 1 --2- 172.21.15.2:0/2305870139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf681046b0 0x7faf6819ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:51.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.342+0000 7faf6dc00700 1 -- 172.21.15.2:0/2305870139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf68105070 msgr2=0x7faf6819b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:51.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.342+0000 7faf6dc00700 1 --2- 172.21.15.2:0/2305870139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf68105070 0x7faf6819b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:51.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.342+0000 7faf6dc00700 1 -- 172.21.15.2:0/2305870139 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6819fe00 con 0x7faf6810a6b0 2024-06-13T02:13:51.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.342+0000 7faf6dc00700 1 --2- 172.21.15.2:0/2305870139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6810a6b0 0x7faf6819f6c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faf60009550 tx=0x7faf60009ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:51.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.342+0000 7faf65600700 1 -- 172.21.15.2:0/2305870139 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf60021070 con 0x7faf6810a6b0 2024-06-13T02:13:51.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.342+0000 7faf65600700 1 -- 172.21.15.2:0/2305870139 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf60007b40 con 0x7faf6810a6b0 2024-06-13T02:13:51.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.342+0000 7faf6fc00700 1 -- 172.21.15.2:0/2305870139 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf681a0090 con 0x7faf6810a6b0 2024-06-13T02:13:51.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.342+0000 7faf65600700 1 -- 172.21.15.2:0/2305870139 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf600052a0 con 0x7faf6810a6b0 2024-06-13T02:13:51.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.343+0000 7faf6fc00700 1 -- 172.21.15.2:0/2305870139 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf681a7970 con 0x7faf6810a6b0 2024-06-13T02:13:51.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.344+0000 7faf6fc00700 1 -- 172.21.15.2:0/2305870139 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf68069180 con 0x7faf6810a6b0 2024-06-13T02:13:51.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.345+0000 7faf65600700 1 -- 172.21.15.2:0/2305870139 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7faf60024070 con 0x7faf6810a6b0 2024-06-13T02:13:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.347+0000 7faf65600700 1 --2- 172.21.15.2:0/2305870139 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faf500a2ca0 0x7faf500a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.347+0000 7faf65600700 1 -- 172.21.15.2:0/2305870139 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9092+0+0 (secure 0 0 0) 0x7faf600d0350 con 0x7faf6810a6b0 2024-06-13T02:13:51.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.347+0000 7faf6d200700 1 --2- 172.21.15.2:0/2305870139 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faf500a2ca0 0x7faf500a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:51.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.348+0000 7faf6d200700 1 --2- 172.21.15.2:0/2305870139 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faf500a2ca0 0x7faf500a5160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faf5c005fd0 tx=0x7faf5c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:51.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.351+0000 7faf65600700 1 -- 172.21.15.2:0/2305870139 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7faf6009cf80 con 0x7faf6810a6b0 2024-06-13T02:13:51.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:51 smithi084 ceph-mon[36833]: pgmap v371: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T02:13:51.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:51 smithi175 ceph-mon[36977]: pgmap v371: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T02:13:51.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.585+0000 7faf6fc00700 1 -- 172.21.15.2:0/2305870139 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf6802dca0 con 0x7faf6810a6b0 2024-06-13T02:13:51.587 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:51 smithi002 ceph-mon[31960]: pgmap v371: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T02:13:51.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.587+0000 7faf65600700 1 -- 172.21.15.2:0/2305870139 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+24561 (secure 0 0 0) 0x7faf6009c880 con 0x7faf6810a6b0 2024-06-13T02:13:51.589 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:13:51.589 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":98,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","created":"2024-06-13T02:03:16.412002+0000","modified":"2024-06-13T02:13:25.517401+0000","last_up_change":"2024-06-13T02:11:26.464184+0000","last_in_change":"2024-06-13T02:11:06.957351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T02:07:10.994857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T02:12:34.674172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T02:12:39.213985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T02:12:53.098590+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96b4d494-453c-48aa-b1e2-ee30dfa83e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6803","nonce":3254812126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6805","nonce":3254812126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6809","nonce":3254812126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6807","nonce":3254812126}]},"public_addr":"172.21.15.2:6803/3254812126","cluster_addr":"172.21.15.2:6805/3254812126","heartbeat_back_addr":"172.21.15.2:6809/3254812126","heartbeat_front_addr":"172.21.15.2:6807/3254812126","state":["exists","up"]},{"osd":1,"uuid":"856e86b6-9281-485b-a36b-2fe04de31329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6801","nonce":1593775403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6803","nonce":1593775403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6807","nonce":1593775403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6805","nonce":1593775403}]},"public_addr":"172.21.15.84:6801/1593775403","cluster_addr":"172.21.15.84:6803/1593775403","heartbeat_back_addr":"172.21.15.84:6807/1593775403","heartbeat_front_addr":"172.21.15.84:6805/1593775403","state":["exists","up"]},{"osd":2,"uuid":"8c9daa52-0dfb-471a-afb4-6eb0b908195a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6801","nonce":2174304558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6803","nonce":2174304558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6807","nonce":2174304558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6805","nonce":2174304558}]},"public_addr":"172.21.15.175:6801/2174304558","cluster_addr":"172.21.15.175:6803/2174304558","heartbeat_back_addr":"172.21.15.175:6807/2174304558","heartbeat_front_addr":"172.21.15.175:6805/2174304558","state":["exists","up"]},{"osd":3,"uuid":"2e747d36-4aa5-4c4c-918d-b8100980cc8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6811","nonce":3010864289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6813","nonce":3010864289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6817","nonce":3010864289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6815","nonce":3010864289}]},"public_addr":"172.21.15.2:6811/3010864289","cluster_addr":"172.21.15.2:6813/3010864289","heartbeat_back_addr":"172.21.15.2:6817/3010864289","heartbeat_front_addr":"172.21.15.2:6815/3010864289","state":["exists","up"]},{"osd":4,"uuid":"bd063fb2-1a65-4b18-898c-f80ddc2a1229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6809","nonce":2541323390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6811","nonce":2541323390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6815","nonce":2541323390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6813","nonce":2541323390}]},"public_addr":"172.21.15.84:6809/2541323390","cluster_addr":"172.21.15.84:6811/2541323390","heartbeat_back_addr":"172.21.15.84:6815/2541323390","heartbeat_front_addr":"172.21.15.84:6813/2541323390","state":["exists","up"]},{"osd":5,"uuid":"e0ea80fd-1bfe-4d2e-9733-ff442ec015b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6809","nonce":764262885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6811","nonce":764262885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6815","nonce":764262885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6813","nonce":764262885}]},"public_addr":"172.21.15.175:6809/764262885","cluster_addr":"172.21.15.175:6811/764262885","heartbeat_back_addr":"172.21.15.175:6815/764262885","heartbeat_front_addr":"172.21.15.175:6813/764262885","state":["exists","up"]},{"osd":6,"uuid":"1c204d74-5e48-4e2e-bb98-6a8d4974187c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6819","nonce":297321106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6821","nonce":297321106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6825","nonce":297321106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6823","nonce":297321106}]},"public_addr":"172.21.15.2:6819/297321106","cluster_addr":"172.21.15.2:6821/297321106","heartbeat_back_addr":"172.21.15.2:6825/297321106","heartbeat_front_addr":"172.21.15.2:6823/297321106","state":["exists","up"]},{"osd":7,"uuid":"1299bbb1-fbfb-4aba-be6b-6704691735f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6817","nonce":3873726653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6819","nonce":3873726653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6823","nonce":3873726653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6821","nonce":3873726653}]},"public_addr":"172.21.15.84:6817/3873726653","cluster_addr":"172.21.15.84:6819/3873726653","heartbeat_back_addr":"172.21.15.84:6823/3873726653","heartbeat_front_addr":"172.21.15.84:6821/3873726653","state":["exists","up"]},{"osd":8,"uuid":"9c3f2a92-d956-4246-bce9-620824d0da22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6817","nonce":2622818232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6819","nonce":2622818232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6823","nonce":2622818232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6821","nonce":2622818232}]},"public_addr":"172.21.15.175:6817/2622818232","cluster_addr":"172.21.15.175:6819/2622818232","heartbeat_back_addr":"172.21.15.175:6823/2622818232","heartbeat_front_addr":"172.21.15.175:6821/2622818232","state":["exists","up"]},{"osd":9,"uuid":"e9839f78-05c6-4b3f-bc14-cb771a03ff5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6827","nonce":1171735390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6829","nonce":1171735390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6833","nonce":1171735390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6831","nonce":1171735390}]},"public_addr":"172.21.15.2:6827/1171735390","cluster_addr":"172.21.15.2:6829/1171735390","heartbeat_back_addr":"172.21.15.2:6833/1171735390","heartbeat_front_addr":"172.21.15.2:6831/1171735390","state":["exists","up"]},{"osd":10,"uuid":"66719431-5ba9-4865-957b-f6582e607a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6825","nonce":4269523460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6827","nonce":4269523460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6831","nonce":4269523460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6829","nonce":4269523460}]},"public_addr":"172.21.15.84:6825/4269523460","cluster_addr":"172.21.15.84:6827/4269523460","heartbeat_back_addr":"172.21.15.84:6831/4269523460","heartbeat_front_addr":"172.21.15.84:6829/4269523460","state":["exists","up"]},{"osd":11,"uuid":"1ce6e6ee-6ff3-416f-b985-e3afe503093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6825","nonce":2762894732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6827","nonce":2762894732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6831","nonce":2762894732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6829","nonce":2762894732}]},"public_addr":"172.21.15.175:6825/2762894732","cluster_addr":"172.21.15.175:6827/2762894732","heartbeat_back_addr":"172.21.15.175:6831/2762894732","heartbeat_front_addr":"172.21.15.175:6829/2762894732","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:16.956638+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:42.268685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:06.272084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:39.696927+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:06.182991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:31.626603+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:05.247728+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:31.985114+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:57.474180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:31.988863+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:59.683056+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:11:24.493248+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6800/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3397168014":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/1789744365":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3831398703":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/3119270562":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/2163302458":"2024-06-14T02:03:50.073572+0000","172.21.15.2:6800/2830681579":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/1678672435":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6801/2830681579":"2024-06-14T02:03:50.073572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T02:13:51.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.590+0000 7faf6fc00700 1 -- 172.21.15.2:0/2305870139 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faf500a2ca0 msgr2=0x7faf500a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:51.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.590+0000 7faf6fc00700 1 --2- 172.21.15.2:0/2305870139 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faf500a2ca0 0x7faf500a5160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faf5c005fd0 tx=0x7faf5c009310 comp rx=0 tx=0).stop 2024-06-13T02:13:51.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.590+0000 7faf6fc00700 1 -- 172.21.15.2:0/2305870139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6810a6b0 msgr2=0x7faf6819f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:51.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.590+0000 7faf6fc00700 1 --2- 172.21.15.2:0/2305870139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6810a6b0 0x7faf6819f6c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faf60009550 tx=0x7faf60009ba0 comp rx=0 tx=0).stop 2024-06-13T02:13:51.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.591+0000 7faf6fc00700 1 -- 172.21.15.2:0/2305870139 shutdown_connections 2024-06-13T02:13:51.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.591+0000 7faf6fc00700 1 --2- 172.21.15.2:0/2305870139 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faf500a2ca0 0x7faf500a5160 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:51.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.591+0000 7faf6fc00700 1 --2- 172.21.15.2:0/2305870139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6810a6b0 0x7faf6819f6c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:51.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.591+0000 7faf6fc00700 1 --2- 172.21.15.2:0/2305870139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf681046b0 0x7faf6819ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:51.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.591+0000 7faf6fc00700 1 --2- 172.21.15.2:0/2305870139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faf68105070 0x7faf6819b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:51.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.591+0000 7faf6fc00700 1 -- 172.21.15.2:0/2305870139 >> 172.21.15.2:0/2305870139 conn(0x7faf681001a0 msgr2=0x7faf681006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:51.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.591+0000 7faf6fc00700 1 -- 172.21.15.2:0/2305870139 shutdown_connections 2024-06-13T02:13:51.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:51.591+0000 7faf6fc00700 1 -- 172.21.15.2:0/2305870139 wait complete. 2024-06-13T02:13:52.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:52 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2305870139' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:13:52.446 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T02:13:52.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:52 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2305870139' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:13:52.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:52 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2305870139' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:13:52.935 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:13:53.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:53 smithi002 ceph-mon[31960]: pgmap v372: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T02:13:53.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:53 smithi175 ceph-mon[36977]: pgmap v372: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T02:13:53.580 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:53 smithi084 ceph-mon[36833]: pgmap v372: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T02:13:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.129+0000 7fc4c9c00700 1 -- 172.21.15.2:0/2497740206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c406a170 msgr2=0x7fc4c406a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.129+0000 7fc4c9c00700 1 --2- 172.21.15.2:0/2497740206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c406a170 0x7fc4c406a5f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009990 tx=0x7fc4b0009ca0 comp rx=0 tx=0).stop 2024-06-13T02:13:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.129+0000 7fc4c9c00700 1 -- 172.21.15.2:0/2497740206 shutdown_connections 2024-06-13T02:13:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.129+0000 7fc4c9c00700 1 --2- 172.21.15.2:0/2497740206 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4c406ab30 0x7fc4c410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.129+0000 7fc4c9c00700 1 --2- 172.21.15.2:0/2497740206 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4c4108500 0x7fc4c41088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.129+0000 7fc4c9c00700 1 --2- 172.21.15.2:0/2497740206 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c406a170 0x7fc4c406a5f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.129+0000 7fc4c9c00700 1 -- 172.21.15.2:0/2497740206 >> 172.21.15.2:0/2497740206 conn(0x7fc4c4078340 msgr2=0x7fc4c4078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.129+0000 7fc4c9c00700 1 -- 172.21.15.2:0/2497740206 shutdown_connections 2024-06-13T02:13:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.129+0000 7fc4c9c00700 1 -- 172.21.15.2:0/2497740206 wait complete. 2024-06-13T02:13:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.131+0000 7fc4c9c00700 1 Processor -- start 2024-06-13T02:13:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.131+0000 7fc4c9c00700 1 -- start start 2024-06-13T02:13:55.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.132+0000 7fc4c9c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4c406a170 0x7fc4c419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.132+0000 7fc4c9c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c406ab30 0x7fc4c419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.132+0000 7fc4c9c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4c4108500 0x7fc4c4198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.132+0000 7fc4c9c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c4112780 con 0x7fc4c406a170 2024-06-13T02:13:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.132+0000 7fc4c9c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c4112600 con 0x7fc4c406ab30 2024-06-13T02:13:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.132+0000 7fc4c9c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c4112900 con 0x7fc4c4108500 2024-06-13T02:13:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.132+0000 7fc4c2a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4c406a170 0x7fc4c419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.132+0000 7fc4c2a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4c406a170 0x7fc4c419e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40276/0 (socket says 172.21.15.2:40276) 2024-06-13T02:13:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.132+0000 7fc4c2a00700 1 -- 172.21.15.2:0/3870753650 learned_addr learned my addr 172.21.15.2:0/3870753650 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.132+0000 7fc4c2000700 1 --2- 172.21.15.2:0/3870753650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c406ab30 0x7fc4c419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.132+0000 7fc4c3400700 1 --2- 172.21.15.2:0/3870753650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4c4108500 0x7fc4c4198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.133+0000 7fc4c2a00700 1 -- 172.21.15.2:0/3870753650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4c4108500 msgr2=0x7fc4c4198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.133+0000 7fc4c2a00700 1 --2- 172.21.15.2:0/3870753650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4c4108500 0x7fc4c4198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.133+0000 7fc4c2a00700 1 -- 172.21.15.2:0/3870753650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c406ab30 msgr2=0x7fc4c419ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.133+0000 7fc4c2a00700 1 --2- 172.21.15.2:0/3870753650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c406ab30 0x7fc4c419ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.133+0000 7fc4c2a00700 1 -- 172.21.15.2:0/3870753650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c4199220 con 0x7fc4c406a170 2024-06-13T02:13:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.133+0000 7fc4c2000700 1 --2- 172.21.15.2:0/3870753650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c406ab30 0x7fc4c419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:13:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.133+0000 7fc4c2a00700 1 --2- 172.21.15.2:0/3870753650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4c406a170 0x7fc4c419e900 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400eb30 tx=0x7fc4b400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.133+0000 7fc4bb400700 1 -- 172.21.15.2:0/3870753650 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400cbd0 con 0x7fc4c406a170 2024-06-13T02:13:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.134+0000 7fc4bb400700 1 -- 172.21.15.2:0/3870753650 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4b4004500 con 0x7fc4c406a170 2024-06-13T02:13:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.134+0000 7fc4c9c00700 1 -- 172.21.15.2:0/3870753650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c4199510 con 0x7fc4c406a170 2024-06-13T02:13:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.134+0000 7fc4bb400700 1 -- 172.21.15.2:0/3870753650 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4010430 con 0x7fc4c406a170 2024-06-13T02:13:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.134+0000 7fc4c9c00700 1 -- 172.21.15.2:0/3870753650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c41a57d0 con 0x7fc4c406a170 2024-06-13T02:13:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.135+0000 7fc4c9c00700 1 -- 172.21.15.2:0/3870753650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4c4069180 con 0x7fc4c406a170 2024-06-13T02:13:55.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.137+0000 7fc4bb400700 1 -- 172.21.15.2:0/3870753650 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fc4b4003f00 con 0x7fc4c406a170 2024-06-13T02:13:55.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.139+0000 7fc4bb400700 1 --2- 172.21.15.2:0/3870753650 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc4a80a2c20 0x7fc4a80a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:55.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.139+0000 7fc4bb400700 1 -- 172.21.15.2:0/3870753650 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9092+0+0 (secure 0 0 0) 0x7fc4b40cf700 con 0x7fc4c406a170 2024-06-13T02:13:55.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.139+0000 7fc4c2000700 1 --2- 172.21.15.2:0/3870753650 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc4a80a2c20 0x7fc4a80a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:55.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.140+0000 7fc4c2000700 1 --2- 172.21.15.2:0/3870753650 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc4a80a2c20 0x7fc4a80a50e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000b2e0 tx=0x7fc4b0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:55.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.143+0000 7fc4bb400700 1 -- 172.21.15.2:0/3870753650 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc4b409c2a0 con 0x7fc4c406a170 2024-06-13T02:13:55.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.378+0000 7fc4c9c00700 1 -- 172.21.15.2:0/3870753650 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4c4199ff0 con 0x7fc4c406a170 2024-06-13T02:13:55.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.380+0000 7fc4bb400700 1 -- 172.21.15.2:0/3870753650 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+24561 (secure 0 0 0) 0x7fc4b409bba0 con 0x7fc4c406a170 2024-06-13T02:13:55.382 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:13:55.382 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":98,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","created":"2024-06-13T02:03:16.412002+0000","modified":"2024-06-13T02:13:25.517401+0000","last_up_change":"2024-06-13T02:11:26.464184+0000","last_in_change":"2024-06-13T02:11:06.957351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T02:07:10.994857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T02:12:34.674172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T02:12:39.213985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T02:12:53.098590+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96b4d494-453c-48aa-b1e2-ee30dfa83e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6803","nonce":3254812126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6805","nonce":3254812126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6809","nonce":3254812126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6807","nonce":3254812126}]},"public_addr":"172.21.15.2:6803/3254812126","cluster_addr":"172.21.15.2:6805/3254812126","heartbeat_back_addr":"172.21.15.2:6809/3254812126","heartbeat_front_addr":"172.21.15.2:6807/3254812126","state":["exists","up"]},{"osd":1,"uuid":"856e86b6-9281-485b-a36b-2fe04de31329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6801","nonce":1593775403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6803","nonce":1593775403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6807","nonce":1593775403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6805","nonce":1593775403}]},"public_addr":"172.21.15.84:6801/1593775403","cluster_addr":"172.21.15.84:6803/1593775403","heartbeat_back_addr":"172.21.15.84:6807/1593775403","heartbeat_front_addr":"172.21.15.84:6805/1593775403","state":["exists","up"]},{"osd":2,"uuid":"8c9daa52-0dfb-471a-afb4-6eb0b908195a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6801","nonce":2174304558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6803","nonce":2174304558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6807","nonce":2174304558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6805","nonce":2174304558}]},"public_addr":"172.21.15.175:6801/2174304558","cluster_addr":"172.21.15.175:6803/2174304558","heartbeat_back_addr":"172.21.15.175:6807/2174304558","heartbeat_front_addr":"172.21.15.175:6805/2174304558","state":["exists","up"]},{"osd":3,"uuid":"2e747d36-4aa5-4c4c-918d-b8100980cc8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6811","nonce":3010864289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6813","nonce":3010864289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6817","nonce":3010864289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6815","nonce":3010864289}]},"public_addr":"172.21.15.2:6811/3010864289","cluster_addr":"172.21.15.2:6813/3010864289","heartbeat_back_addr":"172.21.15.2:6817/3010864289","heartbeat_front_addr":"172.21.15.2:6815/3010864289","state":["exists","up"]},{"osd":4,"uuid":"bd063fb2-1a65-4b18-898c-f80ddc2a1229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6809","nonce":2541323390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6811","nonce":2541323390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6815","nonce":2541323390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6813","nonce":2541323390}]},"public_addr":"172.21.15.84:6809/2541323390","cluster_addr":"172.21.15.84:6811/2541323390","heartbeat_back_addr":"172.21.15.84:6815/2541323390","heartbeat_front_addr":"172.21.15.84:6813/2541323390","state":["exists","up"]},{"osd":5,"uuid":"e0ea80fd-1bfe-4d2e-9733-ff442ec015b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6809","nonce":764262885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6811","nonce":764262885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6815","nonce":764262885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6813","nonce":764262885}]},"public_addr":"172.21.15.175:6809/764262885","cluster_addr":"172.21.15.175:6811/764262885","heartbeat_back_addr":"172.21.15.175:6815/764262885","heartbeat_front_addr":"172.21.15.175:6813/764262885","state":["exists","up"]},{"osd":6,"uuid":"1c204d74-5e48-4e2e-bb98-6a8d4974187c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6819","nonce":297321106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6821","nonce":297321106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6825","nonce":297321106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6823","nonce":297321106}]},"public_addr":"172.21.15.2:6819/297321106","cluster_addr":"172.21.15.2:6821/297321106","heartbeat_back_addr":"172.21.15.2:6825/297321106","heartbeat_front_addr":"172.21.15.2:6823/297321106","state":["exists","up"]},{"osd":7,"uuid":"1299bbb1-fbfb-4aba-be6b-6704691735f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6817","nonce":3873726653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6819","nonce":3873726653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6823","nonce":3873726653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6821","nonce":3873726653}]},"public_addr":"172.21.15.84:6817/3873726653","cluster_addr":"172.21.15.84:6819/3873726653","heartbeat_back_addr":"172.21.15.84:6823/3873726653","heartbeat_front_addr":"172.21.15.84:6821/3873726653","state":["exists","up"]},{"osd":8,"uuid":"9c3f2a92-d956-4246-bce9-620824d0da22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6817","nonce":2622818232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6819","nonce":2622818232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6823","nonce":2622818232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6821","nonce":2622818232}]},"public_addr":"172.21.15.175:6817/2622818232","cluster_addr":"172.21.15.175:6819/2622818232","heartbeat_back_addr":"172.21.15.175:6823/2622818232","heartbeat_front_addr":"172.21.15.175:6821/2622818232","state":["exists","up"]},{"osd":9,"uuid":"e9839f78-05c6-4b3f-bc14-cb771a03ff5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6827","nonce":1171735390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6829","nonce":1171735390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6833","nonce":1171735390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6831","nonce":1171735390}]},"public_addr":"172.21.15.2:6827/1171735390","cluster_addr":"172.21.15.2:6829/1171735390","heartbeat_back_addr":"172.21.15.2:6833/1171735390","heartbeat_front_addr":"172.21.15.2:6831/1171735390","state":["exists","up"]},{"osd":10,"uuid":"66719431-5ba9-4865-957b-f6582e607a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6825","nonce":4269523460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6827","nonce":4269523460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6831","nonce":4269523460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6829","nonce":4269523460}]},"public_addr":"172.21.15.84:6825/4269523460","cluster_addr":"172.21.15.84:6827/4269523460","heartbeat_back_addr":"172.21.15.84:6831/4269523460","heartbeat_front_addr":"172.21.15.84:6829/4269523460","state":["exists","up"]},{"osd":11,"uuid":"1ce6e6ee-6ff3-416f-b985-e3afe503093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6825","nonce":2762894732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6827","nonce":2762894732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6831","nonce":2762894732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6829","nonce":2762894732}]},"public_addr":"172.21.15.175:6825/2762894732","cluster_addr":"172.21.15.175:6827/2762894732","heartbeat_back_addr":"172.21.15.175:6831/2762894732","heartbeat_front_addr":"172.21.15.175:6829/2762894732","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:16.956638+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:42.268685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:06.272084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:39.696927+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:06.182991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:31.626603+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:05.247728+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:31.985114+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:57.474180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:31.988863+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:59.683056+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:11:24.493248+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6800/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3397168014":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/1789744365":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3831398703":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/3119270562":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/2163302458":"2024-06-14T02:03:50.073572+0000","172.21.15.2:6800/2830681579":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/1678672435":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6801/2830681579":"2024-06-14T02:03:50.073572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T02:13:55.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.383+0000 7fc4c9c00700 1 -- 172.21.15.2:0/3870753650 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc4a80a2c20 msgr2=0x7fc4a80a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:55.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.383+0000 7fc4c9c00700 1 --2- 172.21.15.2:0/3870753650 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc4a80a2c20 0x7fc4a80a50e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000b2e0 tx=0x7fc4b0005960 comp rx=0 tx=0).stop 2024-06-13T02:13:55.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.383+0000 7fc4c9c00700 1 -- 172.21.15.2:0/3870753650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4c406a170 msgr2=0x7fc4c419e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:55.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.383+0000 7fc4c9c00700 1 --2- 172.21.15.2:0/3870753650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4c406a170 0x7fc4c419e900 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400eb30 tx=0x7fc4b400ee40 comp rx=0 tx=0).stop 2024-06-13T02:13:55.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.383+0000 7fc4c9c00700 1 -- 172.21.15.2:0/3870753650 shutdown_connections 2024-06-13T02:13:55.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.384+0000 7fc4c9c00700 1 --2- 172.21.15.2:0/3870753650 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc4a80a2c20 0x7fc4a80a50e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:55.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.384+0000 7fc4c9c00700 1 --2- 172.21.15.2:0/3870753650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4c4108500 0x7fc4c4198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:55.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.384+0000 7fc4c9c00700 1 --2- 172.21.15.2:0/3870753650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4c406a170 0x7fc4c419e900 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:55.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.384+0000 7fc4c9c00700 1 --2- 172.21.15.2:0/3870753650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4c406ab30 0x7fc4c419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:55.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.384+0000 7fc4c9c00700 1 -- 172.21.15.2:0/3870753650 >> 172.21.15.2:0/3870753650 conn(0x7fc4c4078340 msgr2=0x7fc4c41000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:55.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.384+0000 7fc4c9c00700 1 -- 172.21.15.2:0/3870753650 shutdown_connections 2024-06-13T02:13:55.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:55.384+0000 7fc4c9c00700 1 -- 172.21.15.2:0/3870753650 wait complete. 2024-06-13T02:13:55.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:55 smithi002 ceph-mon[31960]: pgmap v373: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T02:13:55.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:55 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3870753650' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:13:55.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:55 smithi175 ceph-mon[36977]: pgmap v373: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T02:13:55.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:55 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3870753650' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:13:55.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:55 smithi084 ceph-mon[36833]: pgmap v373: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T02:13:55.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:55 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3870753650' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:13:56.343 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-06-13T02:13:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:13:57.585 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:57 smithi002 ceph-mon[31960]: pgmap v374: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T02:13:57.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:57 smithi175 ceph-mon[36977]: pgmap v374: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T02:13:57.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:57 smithi084 ceph-mon[36833]: pgmap v374: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T02:13:58.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.922+0000 7fcdf1600700 1 -- 172.21.15.2:0/1693613914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdec1045c0 msgr2=0x7fcdec104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:58.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.922+0000 7fcdf1600700 1 --2- 172.21.15.2:0/1693613914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdec1045c0 0x7fcdec104a40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009990 tx=0x7fcdd8009ca0 comp rx=0 tx=0).stop 2024-06-13T02:13:58.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.922+0000 7fcdf1600700 1 -- 172.21.15.2:0/1693613914 shutdown_connections 2024-06-13T02:13:58.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.922+0000 7fcdf1600700 1 --2- 172.21.15.2:0/1693613914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec104f80 0x7fcdec111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:58.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.922+0000 7fcdf1600700 1 --2- 172.21.15.2:0/1693613914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdec10a650 0x7fcdec10aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:58.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.922+0000 7fcdf1600700 1 --2- 172.21.15.2:0/1693613914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdec1045c0 0x7fcdec104a40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:58.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.922+0000 7fcdf1600700 1 -- 172.21.15.2:0/1693613914 >> 172.21.15.2:0/1693613914 conn(0x7fcdec1000b0 msgr2=0x7fcdec1024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:58.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.922+0000 7fcdf1600700 1 -- 172.21.15.2:0/1693613914 shutdown_connections 2024-06-13T02:13:58.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.922+0000 7fcdf1600700 1 -- 172.21.15.2:0/1693613914 wait complete. 2024-06-13T02:13:58.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.923+0000 7fcdf1600700 1 Processor -- start 2024-06-13T02:13:58.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.923+0000 7fcdf1600700 1 -- start start 2024-06-13T02:13:58.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.924+0000 7fcdf1600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec1045c0 0x7fcdec1a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:58.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.924+0000 7fcdf1600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdec104f80 0x7fcdec1a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:58.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.924+0000 7fcdf1600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdec10a650 0x7fcdec19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:58.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.924+0000 7fcdf1600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec114910 con 0x7fcdec104f80 2024-06-13T02:13:58.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.924+0000 7fcdf1600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec114790 con 0x7fcdec1045c0 2024-06-13T02:13:58.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.924+0000 7fcdf1600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcdec114a90 con 0x7fcdec10a650 2024-06-13T02:13:58.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.924+0000 7fcdeb400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdec104f80 0x7fcdec1a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.924+0000 7fcdeb400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdec104f80 0x7fcdec1a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40282/0 (socket says 172.21.15.2:40282) 2024-06-13T02:13:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.924+0000 7fcdeb400700 1 -- 172.21.15.2:0/3544960040 learned_addr learned my addr 172.21.15.2:0/3544960040 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:13:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.924+0000 7fcdebe00700 1 --2- 172.21.15.2:0/3544960040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec1045c0 0x7fcdec1a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.924+0000 7fcdf0c00700 1 --2- 172.21.15.2:0/3544960040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdec10a650 0x7fcdec19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.925+0000 7fcdeb400700 1 -- 172.21.15.2:0/3544960040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdec10a650 msgr2=0x7fcdec19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.925+0000 7fcdeb400700 1 --2- 172.21.15.2:0/3544960040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdec10a650 0x7fcdec19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.925+0000 7fcdeb400700 1 -- 172.21.15.2:0/3544960040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec1045c0 msgr2=0x7fcdec1a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.925+0000 7fcdeb400700 1 --2- 172.21.15.2:0/3544960040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec1045c0 0x7fcdec1a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:58.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.925+0000 7fcdeb400700 1 -- 172.21.15.2:0/3544960040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdec19b290 con 0x7fcdec104f80 2024-06-13T02:13:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.925+0000 7fcdeb400700 1 --2- 172.21.15.2:0/3544960040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdec104f80 0x7fcdec1a0e60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800bae0 tx=0x7fcdd800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.925+0000 7fcde8c00700 1 -- 172.21.15.2:0/3544960040 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8026070 con 0x7fcdec104f80 2024-06-13T02:13:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.925+0000 7fcde8c00700 1 -- 172.21.15.2:0/3544960040 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcdd8003d70 con 0x7fcdec104f80 2024-06-13T02:13:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.925+0000 7fcdf1600700 1 -- 172.21.15.2:0/3544960040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdec19b520 con 0x7fcdec104f80 2024-06-13T02:13:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.926+0000 7fcde8c00700 1 -- 172.21.15.2:0/3544960040 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd800fe50 con 0x7fcdec104f80 2024-06-13T02:13:58.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.926+0000 7fcdf1600700 1 -- 172.21.15.2:0/3544960040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdec1a77f0 con 0x7fcdec104f80 2024-06-13T02:13:58.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.927+0000 7fcdf1600700 1 -- 172.21.15.2:0/3544960040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdec069180 con 0x7fcdec104f80 2024-06-13T02:13:58.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.930+0000 7fcde8c00700 1 -- 172.21.15.2:0/3544960040 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7fcdd8029070 con 0x7fcdec104f80 2024-06-13T02:13:58.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.931+0000 7fcde8c00700 1 --2- 172.21.15.2:0/3544960040 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcdd00a2dc0 0x7fcdd00a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:13:58.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.931+0000 7fcde8c00700 1 -- 172.21.15.2:0/3544960040 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9092+0+0 (secure 0 0 0) 0x7fcdd80d00c0 con 0x7fcdec104f80 2024-06-13T02:13:58.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.931+0000 7fcdebe00700 1 --2- 172.21.15.2:0/3544960040 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcdd00a2dc0 0x7fcdd00a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:13:58.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.932+0000 7fcdebe00700 1 --2- 172.21.15.2:0/3544960040 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcdd00a2dc0 0x7fcdd00a5280 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcdec105700 tx=0x7fcddc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:13:58.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:58.936+0000 7fcde8c00700 1 -- 172.21.15.2:0/3544960040 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcdd805d850 con 0x7fcdec104f80 2024-06-13T02:13:59.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:59.214+0000 7fcdf1600700 1 -- 172.21.15.2:0/3544960040 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcdec02dca0 con 0x7fcdec104f80 2024-06-13T02:13:59.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:59.531+0000 7fcde8c00700 1 -- 172.21.15.2:0/3544960040 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fcdd8013070 con 0x7fcdec104f80 2024-06-13T02:13:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:59.535+0000 7fcdf1600700 1 -- 172.21.15.2:0/3544960040 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcdd00a2dc0 msgr2=0x7fcdd00a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:59.535+0000 7fcdf1600700 1 --2- 172.21.15.2:0/3544960040 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcdd00a2dc0 0x7fcdd00a5280 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcdec105700 tx=0x7fcddc009260 comp rx=0 tx=0).stop 2024-06-13T02:13:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:59.535+0000 7fcdf1600700 1 -- 172.21.15.2:0/3544960040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdec104f80 msgr2=0x7fcdec1a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:13:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:59.535+0000 7fcdf1600700 1 --2- 172.21.15.2:0/3544960040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdec104f80 0x7fcdec1a0e60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800bae0 tx=0x7fcdd800bb10 comp rx=0 tx=0).stop 2024-06-13T02:13:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:59.536+0000 7fcdf1600700 1 -- 172.21.15.2:0/3544960040 shutdown_connections 2024-06-13T02:13:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:59.536+0000 7fcdf1600700 1 --2- 172.21.15.2:0/3544960040 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcdd00a2dc0 0x7fcdd00a5280 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:59.536+0000 7fcdf1600700 1 --2- 172.21.15.2:0/3544960040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdec10a650 0x7fcdec19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:59.536+0000 7fcdf1600700 1 --2- 172.21.15.2:0/3544960040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcdec1045c0 0x7fcdec1a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:59.536+0000 7fcdf1600700 1 --2- 172.21.15.2:0/3544960040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdec104f80 0x7fcdec1a0e60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:13:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:59.536+0000 7fcdf1600700 1 -- 172.21.15.2:0/3544960040 >> 172.21.15.2:0/3544960040 conn(0x7fcdec1000b0 msgr2=0x7fcdec1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:13:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:59.536+0000 7fcdf1600700 1 -- 172.21.15.2:0/3544960040 shutdown_connections 2024-06-13T02:13:59.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:13:59.536+0000 7fcdf1600700 1 -- 172.21.15.2:0/3544960040 wait complete. 2024-06-13T02:13:59.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:59 smithi002 ceph-mon[31960]: pgmap v375: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T02:13:59.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:13:59 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3544960040' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-13T02:13:59.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:59 smithi084 ceph-mon[36833]: pgmap v375: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T02:13:59.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:13:59 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3544960040' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-13T02:14:00.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:59 smithi175 ceph-mon[36977]: pgmap v375: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-06-13T02:14:00.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:13:59 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3544960040' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-13T02:14:00.524 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-06-13T02:14:00.524 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-06-13T02:14:00.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:00 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3544960040' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-13T02:14:00.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:00 smithi002 ceph-mon[31960]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-13T02:14:00.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:00 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3544960040' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-13T02:14:00.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:00 smithi084 ceph-mon[36833]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-13T02:14:00.994 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:14:01.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:00 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3544960040' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-13T02:14:01.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:00 smithi175 ceph-mon[36977]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-13T02:14:01.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:01 smithi002 ceph-mon[31960]: pgmap v376: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:14:01.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:01 smithi084 ceph-mon[36833]: pgmap v376: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:14:02.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:01 smithi175 ceph-mon[36977]: pgmap v376: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:14:03.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.355+0000 7f19b3e00700 1 -- 172.21.15.2:0/1626959431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac06b520 msgr2=0x7f19ac10f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:03.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.355+0000 7f19b3e00700 1 --2- 172.21.15.2:0/1626959431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac06b520 0x7f19ac10f330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009f90 tx=0x7f19a400b330 comp rx=0 tx=0).stop 2024-06-13T02:14:03.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.355+0000 7f19b3e00700 1 -- 172.21.15.2:0/1626959431 shutdown_connections 2024-06-13T02:14:03.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.355+0000 7f19b3e00700 1 --2- 172.21.15.2:0/1626959431 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac06b520 0x7f19ac10f330 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:03.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.355+0000 7f19b3e00700 1 --2- 172.21.15.2:0/1626959431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19ac108510 0x7f19ac1088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:03.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.355+0000 7f19b3e00700 1 --2- 172.21.15.2:0/1626959431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19ac06ab60 0x7f19ac06afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:03.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.355+0000 7f19b3e00700 1 -- 172.21.15.2:0/1626959431 >> 172.21.15.2:0/1626959431 conn(0x7f19ac078340 msgr2=0x7f19ac078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:03.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.355+0000 7f19b3e00700 1 -- 172.21.15.2:0/1626959431 shutdown_connections 2024-06-13T02:14:03.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.355+0000 7f19b3e00700 1 -- 172.21.15.2:0/1626959431 wait complete. 2024-06-13T02:14:03.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.356+0000 7f19b3e00700 1 Processor -- start 2024-06-13T02:14:03.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.356+0000 7f19b3e00700 1 -- start start 2024-06-13T02:14:03.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.357+0000 7f19b3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac06ab60 0x7f19ac19ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:03.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.357+0000 7f19b3e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19ac06b520 0x7f19ac19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:03.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.357+0000 7f19b3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19ac108510 0x7f19ac19f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:03.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.357+0000 7f19b3e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac112770 con 0x7f19ac108510 2024-06-13T02:14:03.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.357+0000 7f19b3e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac1125f0 con 0x7f19ac06ab60 2024-06-13T02:14:03.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.357+0000 7f19b3e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac1128f0 con 0x7f19ac06b520 2024-06-13T02:14:03.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.357+0000 7f19b1e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19ac108510 0x7f19ac19f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:03.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.357+0000 7f19b1400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac06ab60 0x7f19ac19ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:03.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.357+0000 7f19b1400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac06ab60 0x7f19ac19ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:56864/0 (socket says 172.21.15.2:56864) 2024-06-13T02:14:03.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.357+0000 7f19b1400700 1 -- 172.21.15.2:0/507093363 learned_addr learned my addr 172.21.15.2:0/507093363 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:14:03.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.357+0000 7f19b0a00700 1 --2- 172.21.15.2:0/507093363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19ac06b520 0x7f19ac19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:03.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.358+0000 7f19b1400700 1 -- 172.21.15.2:0/507093363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19ac06b520 msgr2=0x7f19ac19b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:03.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.358+0000 7f19b1400700 1 --2- 172.21.15.2:0/507093363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19ac06b520 0x7f19ac19b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:03.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.358+0000 7f19b1400700 1 -- 172.21.15.2:0/507093363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19ac108510 msgr2=0x7f19ac19f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:03.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.358+0000 7f19b1400700 1 --2- 172.21.15.2:0/507093363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19ac108510 0x7f19ac19f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:03.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.358+0000 7f19b1400700 1 -- 172.21.15.2:0/507093363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ac19fe90 con 0x7f19ac06ab60 2024-06-13T02:14:03.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.358+0000 7f19b1400700 1 --2- 172.21.15.2:0/507093363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac06ab60 0x7f19ac19ae80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f19a000e9a0 tx=0x7f19a000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:03.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.358+0000 7f19aa000700 1 -- 172.21.15.2:0/507093363 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a000ca10 con 0x7f19ac06ab60 2024-06-13T02:14:03.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.358+0000 7f19aa000700 1 -- 172.21.15.2:0/507093363 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19a000cbb0 con 0x7f19ac06ab60 2024-06-13T02:14:03.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.358+0000 7f19aa000700 1 -- 172.21.15.2:0/507093363 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0018680 con 0x7f19ac06ab60 2024-06-13T02:14:03.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.358+0000 7f19b3e00700 1 -- 172.21.15.2:0/507093363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ac1a0180 con 0x7f19ac06ab60 2024-06-13T02:14:03.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.358+0000 7f19b3e00700 1 -- 172.21.15.2:0/507093363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ac1a7a00 con 0x7f19ac06ab60 2024-06-13T02:14:03.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.359+0000 7f19b3e00700 1 -- 172.21.15.2:0/507093363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ac103be0 con 0x7f19ac06ab60 2024-06-13T02:14:03.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.362+0000 7f19aa000700 1 -- 172.21.15.2:0/507093363 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f19a0010430 con 0x7f19ac06ab60 2024-06-13T02:14:03.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.363+0000 7f19aa000700 1 --2- 172.21.15.2:0/507093363 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19940a2ca0 0x7f19940a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:03.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.363+0000 7f19aa000700 1 -- 172.21.15.2:0/507093363 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9092+0+0 (secure 0 0 0) 0x7f19a00cf8c0 con 0x7f19ac06ab60 2024-06-13T02:14:03.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.363+0000 7f19b0a00700 1 --2- 172.21.15.2:0/507093363 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19940a2ca0 0x7f19940a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:03.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.364+0000 7f19b0a00700 1 --2- 172.21.15.2:0/507093363 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19940a2ca0 0x7f19940a5160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1998009750 tx=0x7f1998009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:03.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.366+0000 7f19aa000700 1 -- 172.21.15.2:0/507093363 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f19a009c460 con 0x7f19ac06ab60 2024-06-13T02:14:03.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:03.650+0000 7f19b3e00700 1 -- 172.21.15.2:0/507093363 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f19ac1a7bd0 con 0x7f19ac06ab60 2024-06-13T02:14:03.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:03 smithi002 ceph-mon[31960]: pgmap v377: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:14:03.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:03 smithi084 ceph-mon[36833]: pgmap v377: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:14:04.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:03 smithi175 ceph-mon[36977]: pgmap v377: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:14:04.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:04.560+0000 7f19aa000700 1 -- 172.21.15.2:0/507093363 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f19a009bd60 con 0x7f19ac06ab60 2024-06-13T02:14:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:04.565+0000 7f19b3e00700 1 -- 172.21.15.2:0/507093363 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19940a2ca0 msgr2=0x7f19940a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:04.565+0000 7f19b3e00700 1 --2- 172.21.15.2:0/507093363 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19940a2ca0 0x7f19940a5160 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1998009750 tx=0x7f1998009310 comp rx=0 tx=0).stop 2024-06-13T02:14:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:04.565+0000 7f19b3e00700 1 -- 172.21.15.2:0/507093363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac06ab60 msgr2=0x7f19ac19ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:04.565+0000 7f19b3e00700 1 --2- 172.21.15.2:0/507093363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac06ab60 0x7f19ac19ae80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f19a000e9a0 tx=0x7f19a000ecb0 comp rx=0 tx=0).stop 2024-06-13T02:14:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:04.565+0000 7f19b3e00700 1 -- 172.21.15.2:0/507093363 shutdown_connections 2024-06-13T02:14:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:04.565+0000 7f19b3e00700 1 --2- 172.21.15.2:0/507093363 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19940a2ca0 0x7f19940a5160 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:04.565+0000 7f19b3e00700 1 --2- 172.21.15.2:0/507093363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19ac108510 0x7f19ac19f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:04.565+0000 7f19b3e00700 1 --2- 172.21.15.2:0/507093363 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19ac06ab60 0x7f19ac19ae80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:04.565+0000 7f19b3e00700 1 --2- 172.21.15.2:0/507093363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19ac06b520 0x7f19ac19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:04.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:04.565+0000 7f19b3e00700 1 -- 172.21.15.2:0/507093363 >> 172.21.15.2:0/507093363 conn(0x7f19ac078340 msgr2=0x7f19ac10d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:04.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:04.566+0000 7f19b3e00700 1 -- 172.21.15.2:0/507093363 shutdown_connections 2024-06-13T02:14:04.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:04.566+0000 7f19b3e00700 1 -- 172.21.15.2:0/507093363 wait complete. 2024-06-13T02:14:04.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:04 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/507093363' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-13T02:14:04.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:04 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-13T02:14:04.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:04 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/507093363' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-13T02:14:04.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:04 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-13T02:14:05.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:04 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/507093363' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-13T02:14:05.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:04 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-13T02:14:05.550 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-06-13T02:14:05.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:05 smithi002 ceph-mon[31960]: pgmap v378: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:14:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:05 smithi002 ceph-mon[31960]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-13T02:14:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:05 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-06-13T02:14:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:05 smithi002 ceph-mon[31960]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-13T02:14:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:05 smithi002 ceph-mon[31960]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-13T02:14:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:05 smithi002 ceph-mon[31960]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-06-13T02:14:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:05 smithi002 ceph-mon[31960]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-06-13T02:14:05.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:05 smithi084 ceph-mon[36833]: pgmap v378: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:14:05.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:05 smithi084 ceph-mon[36833]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-13T02:14:05.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:05 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-06-13T02:14:05.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:05 smithi084 ceph-mon[36833]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-13T02:14:05.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:05 smithi084 ceph-mon[36833]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-13T02:14:05.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:05 smithi084 ceph-mon[36833]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-06-13T02:14:05.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:05 smithi084 ceph-mon[36833]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-06-13T02:14:06.001 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:14:06.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:05 smithi175 ceph-mon[36977]: pgmap v378: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:14:06.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:05 smithi175 ceph-mon[36977]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-13T02:14:06.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:05 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-06-13T02:14:06.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:05 smithi175 ceph-mon[36977]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-13T02:14:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:05 smithi175 ceph-mon[36977]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-13T02:14:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:05 smithi175 ceph-mon[36977]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-06-13T02:14:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:05 smithi175 ceph-mon[36977]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-06-13T02:14:06.470 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:14:06 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-b[67065]: 2024-06-13T02:14:06.162+0000 7f77d2174700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-06-13T02:14:06.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:06 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] up:active 2024-06-13T02:14:06.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:06 smithi002 ceph-mon[31960]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-13T02:14:06.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:06 smithi002 ceph-mon[31960]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-13T02:14:06.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:06 smithi002 ceph-mon[31960]: Cluster is now healthy 2024-06-13T02:14:06.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:06 smithi002 ceph-mon[31960]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-06-13T02:14:06.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:06 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-06-13T02:14:06.882 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:06 smithi002 ceph-mon[31960]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-06-13T02:14:06.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:06 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] up:active 2024-06-13T02:14:06.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:06 smithi084 ceph-mon[36833]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-13T02:14:06.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:06 smithi084 ceph-mon[36833]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-13T02:14:06.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:06 smithi084 ceph-mon[36833]: Cluster is now healthy 2024-06-13T02:14:06.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:06 smithi084 ceph-mon[36833]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-06-13T02:14:06.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:06 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-06-13T02:14:06.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:06 smithi084 ceph-mon[36833]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-06-13T02:14:07.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:06 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] up:active 2024-06-13T02:14:07.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:06 smithi175 ceph-mon[36977]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-13T02:14:07.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:06 smithi175 ceph-mon[36977]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-13T02:14:07.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:06 smithi175 ceph-mon[36977]: Cluster is now healthy 2024-06-13T02:14:07.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:06 smithi175 ceph-mon[36977]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-06-13T02:14:07.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:06 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-06-13T02:14:07.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:06 smithi175 ceph-mon[36977]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-06-13T02:14:07.764 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:07 smithi002 ceph-mon[31960]: pgmap v379: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-06-13T02:14:07.764 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:07 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] up:active 2024-06-13T02:14:07.764 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:07 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-06-13T02:14:07.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:07 smithi084 ceph-mon[36833]: pgmap v379: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-06-13T02:14:07.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:07 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] up:active 2024-06-13T02:14:07.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:07 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-06-13T02:14:08.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:07 smithi175 ceph-mon[36977]: pgmap v379: 129 pgs: 129 active+clean; 581 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-06-13T02:14:08.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:07 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] up:active 2024-06-13T02:14:08.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:07 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-06-13T02:14:08.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.327+0000 7f99a9200700 1 -- 172.21.15.2:0/3571045572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99a410c9b0 msgr2=0x7f99a410ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:08.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.327+0000 7f99a9200700 1 --2- 172.21.15.2:0/3571045572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99a410c9b0 0x7f99a410ee70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f999c009f90 tx=0x7f999c00b330 comp rx=0 tx=0).stop 2024-06-13T02:14:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.328+0000 7f99a9200700 1 -- 172.21.15.2:0/3571045572 shutdown_connections 2024-06-13T02:14:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.328+0000 7f99a9200700 1 --2- 172.21.15.2:0/3571045572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99a410c9b0 0x7f99a410ee70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.328+0000 7f99a9200700 1 --2- 172.21.15.2:0/3571045572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99a4103580 0x7f99a4103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.328+0000 7f99a9200700 1 --2- 172.21.15.2:0/3571045572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99a4103ea0 0x7f99a410c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.328+0000 7f99a9200700 1 -- 172.21.15.2:0/3571045572 >> 172.21.15.2:0/3571045572 conn(0x7f99a40fcdb0 msgr2=0x7f99a40ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.328+0000 7f99a9200700 1 -- 172.21.15.2:0/3571045572 shutdown_connections 2024-06-13T02:14:08.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.328+0000 7f99a9200700 1 -- 172.21.15.2:0/3571045572 wait complete. 2024-06-13T02:14:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.329+0000 7f99a9200700 1 Processor -- start 2024-06-13T02:14:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.329+0000 7f99a9200700 1 -- start start 2024-06-13T02:14:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.330+0000 7f99a9200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99a4103580 0x7f99a41011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.330+0000 7f99a9200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99a4103ea0 0x7f99a4101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.330+0000 7f99a9200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99a410c9b0 0x7f99a4101c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:08.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.330+0000 7f99a9200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f99a4112750 con 0x7f99a4103ea0 2024-06-13T02:14:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.330+0000 7f99a9200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41125d0 con 0x7f99a4103580 2024-06-13T02:14:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.330+0000 7f99a9200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f99a41128d0 con 0x7f99a410c9b0 2024-06-13T02:14:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.330+0000 7f99a3400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99a4103580 0x7f99a41011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.330+0000 7f99a2a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99a4103ea0 0x7f99a4101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.330+0000 7f99a3400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99a4103580 0x7f99a41011e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:56880/0 (socket says 172.21.15.2:56880) 2024-06-13T02:14:08.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.330+0000 7f99a3400700 1 -- 172.21.15.2:0/914252977 learned_addr learned my addr 172.21.15.2:0/914252977 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:14:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.330+0000 7f99a3e00700 1 --2- 172.21.15.2:0/914252977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99a410c9b0 0x7f99a4101c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.330+0000 7f99a3400700 1 -- 172.21.15.2:0/914252977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99a410c9b0 msgr2=0x7f99a4101c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.330+0000 7f99a3400700 1 --2- 172.21.15.2:0/914252977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99a410c9b0 0x7f99a4101c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.330+0000 7f99a3400700 1 -- 172.21.15.2:0/914252977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99a4103ea0 msgr2=0x7f99a4101720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:08.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.330+0000 7f99a3400700 1 --2- 172.21.15.2:0/914252977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99a4103ea0 0x7f99a4101720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.331+0000 7f99a3400700 1 -- 172.21.15.2:0/914252977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a41a7130 con 0x7f99a4103580 2024-06-13T02:14:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.331+0000 7f99a3400700 1 --2- 172.21.15.2:0/914252977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99a4103580 0x7f99a41011e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f999400eb30 tx=0x7f999400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.331+0000 7f999be00700 1 -- 172.21.15.2:0/914252977 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999400cbd0 con 0x7f99a4103580 2024-06-13T02:14:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.331+0000 7f99a9200700 1 -- 172.21.15.2:0/914252977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a41a7420 con 0x7f99a4103580 2024-06-13T02:14:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.331+0000 7f999be00700 1 -- 172.21.15.2:0/914252977 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9994004500 con 0x7f99a4103580 2024-06-13T02:14:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.331+0000 7f999be00700 1 -- 172.21.15.2:0/914252977 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994010430 con 0x7f99a4103580 2024-06-13T02:14:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.331+0000 7f99a9200700 1 -- 172.21.15.2:0/914252977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a41a79b0 con 0x7f99a4103580 2024-06-13T02:14:08.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.333+0000 7f99a9200700 1 -- 172.21.15.2:0/914252977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a4069180 con 0x7f99a4103580 2024-06-13T02:14:08.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.335+0000 7f999be00700 1 -- 172.21.15.2:0/914252977 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f9994003f00 con 0x7f99a4103580 2024-06-13T02:14:08.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.336+0000 7f999be00700 1 --2- 172.21.15.2:0/914252977 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f99880a2ca0 0x7f99880a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.336+0000 7f999be00700 1 -- 172.21.15.2:0/914252977 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9092+0+0 (secure 0 0 0) 0x7f99940cf6e0 con 0x7f99a4103580 2024-06-13T02:14:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.337+0000 7f99a2a00700 1 --2- 172.21.15.2:0/914252977 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f99880a2ca0 0x7f99880a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:08.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.337+0000 7f99a2a00700 1 --2- 172.21.15.2:0/914252977 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f99880a2ca0 0x7f99880a5160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9990009750 tx=0x7f9990009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:08.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.341+0000 7f999be00700 1 -- 172.21.15.2:0/914252977 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f999409c280 con 0x7f99a4103580 2024-06-13T02:14:08.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:08.619+0000 7f99a9200700 1 -- 172.21.15.2:0/914252977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f99a41a7c70 con 0x7f99a4103580 2024-06-13T02:14:09.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:09.605+0000 7f999be00700 1 -- 172.21.15.2:0/914252977 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f999409bb80 con 0x7f99a4103580 2024-06-13T02:14:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:09.610+0000 7f99a9200700 1 -- 172.21.15.2:0/914252977 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f99880a2ca0 msgr2=0x7f99880a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:09.610+0000 7f99a9200700 1 --2- 172.21.15.2:0/914252977 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f99880a2ca0 0x7f99880a5160 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9990009750 tx=0x7f9990009310 comp rx=0 tx=0).stop 2024-06-13T02:14:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:09.610+0000 7f99a9200700 1 -- 172.21.15.2:0/914252977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99a4103580 msgr2=0x7f99a41011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:09.610+0000 7f99a9200700 1 --2- 172.21.15.2:0/914252977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99a4103580 0x7f99a41011e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f999400eb30 tx=0x7f999400ee40 comp rx=0 tx=0).stop 2024-06-13T02:14:09.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:09.610+0000 7f99a9200700 1 -- 172.21.15.2:0/914252977 shutdown_connections 2024-06-13T02:14:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:09.610+0000 7f99a9200700 1 --2- 172.21.15.2:0/914252977 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f99880a2ca0 0x7f99880a5160 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:09.610+0000 7f99a9200700 1 --2- 172.21.15.2:0/914252977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99a410c9b0 0x7f99a4101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:09.610+0000 7f99a9200700 1 --2- 172.21.15.2:0/914252977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99a4103580 0x7f99a41011e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:09.610+0000 7f99a9200700 1 --2- 172.21.15.2:0/914252977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f99a4103ea0 0x7f99a4101720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:09.610+0000 7f99a9200700 1 -- 172.21.15.2:0/914252977 >> 172.21.15.2:0/914252977 conn(0x7f99a40fcdb0 msgr2=0x7f99a410ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:09.610+0000 7f99a9200700 1 -- 172.21.15.2:0/914252977 shutdown_connections 2024-06-13T02:14:09.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:09.610+0000 7f99a9200700 1 -- 172.21.15.2:0/914252977 wait complete. 2024-06-13T02:14:09.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:09 smithi002 ceph-mon[31960]: pgmap v380: 129 pgs: 129 active+clean; 583 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 3 op/s 2024-06-13T02:14:09.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:09 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/914252977' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-13T02:14:09.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:09 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-13T02:14:09.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:09 smithi084 ceph-mon[36833]: pgmap v380: 129 pgs: 129 active+clean; 583 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 3 op/s 2024-06-13T02:14:09.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:09 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/914252977' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-13T02:14:09.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:09 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-13T02:14:10.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:09 smithi175 ceph-mon[36977]: pgmap v380: 129 pgs: 129 active+clean; 583 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 3 op/s 2024-06-13T02:14:10.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:09 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/914252977' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-13T02:14:10.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:09 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-13T02:14:10.630 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-06-13T02:14:10.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:10 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-13T02:14:10.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:10 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-06-13T02:14:10.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:10 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:14:10.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:10 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-13T02:14:10.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:10 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-06-13T02:14:10.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:10 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:14:11.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:10 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-13T02:14:11.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:10 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-06-13T02:14:11.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:10 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:14:11.098 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:14:11.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:11 smithi002 ceph-mon[31960]: pgmap v381: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-06-13T02:14:11.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:11 smithi084 ceph-mon[36833]: pgmap v381: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-06-13T02:14:12.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:11 smithi175 ceph-mon[36977]: pgmap v381: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-06-13T02:14:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.257+0000 7f0bcce00700 1 -- 172.21.15.2:0/1954619342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc8109480 msgr2=0x7f0bc8115990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.257+0000 7f0bcce00700 1 --2- 172.21.15.2:0/1954619342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc8109480 0x7f0bc8115990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000b0a0 tx=0x7f0bc000b3b0 comp rx=0 tx=0).stop 2024-06-13T02:14:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.257+0000 7f0bcce00700 1 -- 172.21.15.2:0/1954619342 shutdown_connections 2024-06-13T02:14:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.257+0000 7f0bcce00700 1 --2- 172.21.15.2:0/1954619342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc8109480 0x7f0bc8115990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.257+0000 7f0bcce00700 1 --2- 172.21.15.2:0/1954619342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bc810eac0 0x7f0bc810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.257+0000 7f0bcce00700 1 --2- 172.21.15.2:0/1954619342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc8108ac0 0x7f0bc8108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.257+0000 7f0bcce00700 1 -- 172.21.15.2:0/1954619342 >> 172.21.15.2:0/1954619342 conn(0x7f0bc8075c60 msgr2=0x7f0bc81072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:13.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.257+0000 7f0bcce00700 1 -- 172.21.15.2:0/1954619342 shutdown_connections 2024-06-13T02:14:13.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.258+0000 7f0bcce00700 1 -- 172.21.15.2:0/1954619342 wait complete. 2024-06-13T02:14:13.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.259+0000 7f0bcce00700 1 Processor -- start 2024-06-13T02:14:13.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.259+0000 7f0bcce00700 1 -- start start 2024-06-13T02:14:13.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.259+0000 7f0bcce00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bc8108ac0 0x7f0bc819f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:13.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.259+0000 7f0bcce00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc8109480 0x7f0bc819f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:13.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.259+0000 7f0bcce00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc810eac0 0x7f0bc81a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:13.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.259+0000 7f0bcce00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc8118df0 con 0x7f0bc8109480 2024-06-13T02:14:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.259+0000 7f0bcce00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc8118c70 con 0x7f0bc810eac0 2024-06-13T02:14:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.259+0000 7f0bcce00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc8118f70 con 0x7f0bc8108ac0 2024-06-13T02:14:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.260+0000 7f0bc5400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc8109480 0x7f0bc819f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.260+0000 7f0bc5e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bc8108ac0 0x7f0bc819f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.260+0000 7f0bc5e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bc8108ac0 0x7f0bc819f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:53818/0 (socket says 172.21.15.2:53818) 2024-06-13T02:14:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.260+0000 7f0bc5e00700 1 -- 172.21.15.2:0/620996811 learned_addr learned my addr 172.21.15.2:0/620996811 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:14:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.260+0000 7f0bc6800700 1 --2- 172.21.15.2:0/620996811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc810eac0 0x7f0bc81a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.260+0000 7f0bc6800700 1 -- 172.21.15.2:0/620996811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bc8108ac0 msgr2=0x7f0bc819f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.260+0000 7f0bc6800700 1 --2- 172.21.15.2:0/620996811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bc8108ac0 0x7f0bc819f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.260+0000 7f0bc6800700 1 -- 172.21.15.2:0/620996811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc8109480 msgr2=0x7f0bc819f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:13.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.260+0000 7f0bc6800700 1 --2- 172.21.15.2:0/620996811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc8109480 0x7f0bc819f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:13.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.260+0000 7f0bc6800700 1 -- 172.21.15.2:0/620996811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc81a41e0 con 0x7f0bc810eac0 2024-06-13T02:14:13.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.261+0000 7f0bc6800700 1 --2- 172.21.15.2:0/620996811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc810eac0 0x7f0bc81a3aa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000b0a0 tx=0x7f0bc0004d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:13.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.261+0000 7f0bbea00700 1 -- 172.21.15.2:0/620996811 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0021070 con 0x7f0bc810eac0 2024-06-13T02:14:13.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.261+0000 7f0bbea00700 1 -- 172.21.15.2:0/620996811 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc0007b80 con 0x7f0bc810eac0 2024-06-13T02:14:13.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.261+0000 7f0bcce00700 1 -- 172.21.15.2:0/620996811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc81a4470 con 0x7f0bc810eac0 2024-06-13T02:14:13.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.261+0000 7f0bbea00700 1 -- 172.21.15.2:0/620996811 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0005040 con 0x7f0bc810eac0 2024-06-13T02:14:13.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.261+0000 7f0bcce00700 1 -- 172.21.15.2:0/620996811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc81abd50 con 0x7f0bc810eac0 2024-06-13T02:14:13.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.262+0000 7f0bcce00700 1 -- 172.21.15.2:0/620996811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bc8069180 con 0x7f0bc810eac0 2024-06-13T02:14:13.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.264+0000 7f0bbea00700 1 -- 172.21.15.2:0/620996811 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7f0bc0024070 con 0x7f0bc810eac0 2024-06-13T02:14:13.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.266+0000 7f0bbea00700 1 --2- 172.21.15.2:0/620996811 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f0bac0a2c20 0x7f0bac0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:13.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.266+0000 7f0bbea00700 1 -- 172.21.15.2:0/620996811 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9092+0+0 (secure 0 0 0) 0x7f0bc000f020 con 0x7f0bc810eac0 2024-06-13T02:14:13.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.266+0000 7f0bc5e00700 1 --2- 172.21.15.2:0/620996811 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f0bac0a2c20 0x7f0bac0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:13.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.267+0000 7f0bc5e00700 1 --2- 172.21.15.2:0/620996811 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f0bac0a2c20 0x7f0bac0a50e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009ca0 tx=0x7f0bb8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:13.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.270+0000 7f0bbea00700 1 -- 172.21.15.2:0/620996811 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f0bc002b020 con 0x7f0bc810eac0 2024-06-13T02:14:13.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.552+0000 7f0bcce00700 1 -- 172.21.15.2:0/620996811 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f0bc802dca0 con 0x7f0bc810eac0 2024-06-13T02:14:13.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.627+0000 7f0bbea00700 1 -- 172.21.15.2:0/620996811 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f0bc0007d30 con 0x7f0bc810eac0 2024-06-13T02:14:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.631+0000 7f0bcce00700 1 -- 172.21.15.2:0/620996811 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f0bac0a2c20 msgr2=0x7f0bac0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.631+0000 7f0bcce00700 1 --2- 172.21.15.2:0/620996811 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f0bac0a2c20 0x7f0bac0a50e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009ca0 tx=0x7f0bb8009260 comp rx=0 tx=0).stop 2024-06-13T02:14:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.631+0000 7f0bcce00700 1 -- 172.21.15.2:0/620996811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc810eac0 msgr2=0x7f0bc81a3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:13.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.631+0000 7f0bcce00700 1 --2- 172.21.15.2:0/620996811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc810eac0 0x7f0bc81a3aa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000b0a0 tx=0x7f0bc0004d00 comp rx=0 tx=0).stop 2024-06-13T02:14:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.631+0000 7f0bcce00700 1 -- 172.21.15.2:0/620996811 shutdown_connections 2024-06-13T02:14:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.631+0000 7f0bcce00700 1 --2- 172.21.15.2:0/620996811 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f0bac0a2c20 0x7f0bac0a50e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.632+0000 7f0bcce00700 1 --2- 172.21.15.2:0/620996811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0bc810eac0 0x7f0bc81a3aa0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.632+0000 7f0bcce00700 1 --2- 172.21.15.2:0/620996811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bc8108ac0 0x7f0bc819f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.632+0000 7f0bcce00700 1 --2- 172.21.15.2:0/620996811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc8109480 0x7f0bc819f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:13.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.632+0000 7f0bcce00700 1 -- 172.21.15.2:0/620996811 >> 172.21.15.2:0/620996811 conn(0x7f0bc8075c60 msgr2=0x7f0bc8076180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.632+0000 7f0bcce00700 1 -- 172.21.15.2:0/620996811 shutdown_connections 2024-06-13T02:14:13.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:13.632+0000 7f0bcce00700 1 -- 172.21.15.2:0/620996811 wait complete. 2024-06-13T02:14:13.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:13 smithi002 ceph-mon[31960]: pgmap v382: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-06-13T02:14:13.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:13 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/620996811' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-13T02:14:13.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:13 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-13T02:14:13.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:13 smithi084 ceph-mon[36833]: pgmap v382: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-06-13T02:14:13.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:13 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/620996811' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-13T02:14:13.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:13 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-13T02:14:14.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:13 smithi175 ceph-mon[36977]: pgmap v382: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-06-13T02:14:14.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:13 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/620996811' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-13T02:14:14.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:13 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-13T02:14:14.633 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-06-13T02:14:14.633 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-06-13T02:14:14.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:14 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-13T02:14:14.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:14 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:14:14.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:14 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-13T02:14:14.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:14 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:14:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:14 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-13T02:14:15.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:14 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:14:15.104 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:14:15.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:15 smithi002 ceph-mon[31960]: pgmap v383: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-13T02:14:15.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:15 smithi084 ceph-mon[36833]: pgmap v383: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-13T02:14:16.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:15 smithi175 ceph-mon[36977]: pgmap v383: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-13T02:14:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.348+0000 7facdc600700 1 -- 172.21.15.2:0/2021954069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd406a170 msgr2=0x7facd406a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.348+0000 7facdc600700 1 --2- 172.21.15.2:0/2021954069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd406a170 0x7facd406a5d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7facc00099c0 tx=0x7facc0009cd0 comp rx=0 tx=0).stop 2024-06-13T02:14:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.348+0000 7facdc600700 1 -- 172.21.15.2:0/2021954069 shutdown_connections 2024-06-13T02:14:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.348+0000 7facdc600700 1 --2- 172.21.15.2:0/2021954069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd406ab10 0x7facd410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.348+0000 7facdc600700 1 --2- 172.21.15.2:0/2021954069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd41084e0 0x7facd41088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:17.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.348+0000 7facdc600700 1 --2- 172.21.15.2:0/2021954069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd406a170 0x7facd406a5d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.348+0000 7facdc600700 1 -- 172.21.15.2:0/2021954069 >> 172.21.15.2:0/2021954069 conn(0x7facd40782c0 msgr2=0x7facd40786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.348+0000 7facdc600700 1 -- 172.21.15.2:0/2021954069 shutdown_connections 2024-06-13T02:14:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.348+0000 7facdc600700 1 -- 172.21.15.2:0/2021954069 wait complete. 2024-06-13T02:14:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.349+0000 7facdc600700 1 Processor -- start 2024-06-13T02:14:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.349+0000 7facdc600700 1 -- start start 2024-06-13T02:14:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.350+0000 7facdc600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd406a170 0x7facd419add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.350+0000 7facdc600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd406ab10 0x7facd419b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.350+0000 7facdc600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd41084e0 0x7facd419f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.350+0000 7facdc600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7facd4112740 con 0x7facd406a170 2024-06-13T02:14:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.350+0000 7facdc600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7facd41125c0 con 0x7facd41084e0 2024-06-13T02:14:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.350+0000 7facdc600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7facd41128c0 con 0x7facd406ab10 2024-06-13T02:14:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.350+0000 7facd9c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd406a170 0x7facd419add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.350+0000 7facd9200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd406ab10 0x7facd419b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.350+0000 7facd9200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd406ab10 0x7facd419b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:53830/0 (socket says 172.21.15.2:53830) 2024-06-13T02:14:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.350+0000 7facda600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd41084e0 0x7facd419f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.350+0000 7facd9200700 1 -- 172.21.15.2:0/1118407287 learned_addr learned my addr 172.21.15.2:0/1118407287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:14:17.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.350+0000 7facd9c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd406a170 0x7facd419add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39424/0 (socket says 172.21.15.2:39424) 2024-06-13T02:14:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.351+0000 7facda600700 1 -- 172.21.15.2:0/1118407287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd406ab10 msgr2=0x7facd419b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.351+0000 7facda600700 1 --2- 172.21.15.2:0/1118407287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd406ab10 0x7facd419b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.351+0000 7facda600700 1 -- 172.21.15.2:0/1118407287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd406a170 msgr2=0x7facd419add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.351+0000 7facda600700 1 --2- 172.21.15.2:0/1118407287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd406a170 0x7facd419add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.351+0000 7facda600700 1 -- 172.21.15.2:0/1118407287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd419fde0 con 0x7facd41084e0 2024-06-13T02:14:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.351+0000 7facd9200700 1 --2- 172.21.15.2:0/1118407287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd406ab10 0x7facd419b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:14:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.351+0000 7facd9c00700 1 --2- 172.21.15.2:0/1118407287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd406a170 0x7facd419add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:14:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.351+0000 7facda600700 1 --2- 172.21.15.2:0/1118407287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd41084e0 0x7facd419f6a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faccc00e970 tx=0x7faccc00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.351+0000 7facd2000700 1 -- 172.21.15.2:0/1118407287 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc004220 con 0x7facd41084e0 2024-06-13T02:14:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.352+0000 7facdc600700 1 -- 172.21.15.2:0/1118407287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd41a00d0 con 0x7facd41084e0 2024-06-13T02:14:17.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.352+0000 7facd2000700 1 -- 172.21.15.2:0/1118407287 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faccc004d10 con 0x7facd41084e0 2024-06-13T02:14:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.352+0000 7facd2000700 1 -- 172.21.15.2:0/1118407287 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc010700 con 0x7facd41084e0 2024-06-13T02:14:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.352+0000 7facdc600700 1 -- 172.21.15.2:0/1118407287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd41a7950 con 0x7facd41084e0 2024-06-13T02:14:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.353+0000 7facdc600700 1 -- 172.21.15.2:0/1118407287 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd4069180 con 0x7facd41084e0 2024-06-13T02:14:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.355+0000 7facd2000700 1 -- 172.21.15.2:0/1118407287 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 16) ==== 137832+0+0 (secure 0 0 0) 0x7faccc004750 con 0x7facd41084e0 2024-06-13T02:14:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.356+0000 7facd2000700 1 --2- 172.21.15.2:0/1118407287 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7facbc0a2c20 0x7facbc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.356+0000 7facd2000700 1 -- 172.21.15.2:0/1118407287 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9092+0+0 (secure 0 0 0) 0x7faccc0cf190 con 0x7facd41084e0 2024-06-13T02:14:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.357+0000 7facd9c00700 1 --2- 172.21.15.2:0/1118407287 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7facbc0a2c20 0x7facbc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.357+0000 7facd9c00700 1 --2- 172.21.15.2:0/1118407287 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7facbc0a2c20 0x7facbc0a50e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7facc8009480 tx=0x7facc800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:17.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.360+0000 7facd2000700 1 -- 172.21.15.2:0/1118407287 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7faccc01e300 con 0x7facd41084e0 2024-06-13T02:14:17.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.621+0000 7facdc600700 1 -- 172.21.15.2:0/1118407287 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7facd40628d0 con 0x7facbc0a2c20 2024-06-13T02:14:17.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.657+0000 7facd2000700 1 -- 172.21.15.2:0/1118407287 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7facd40628d0 con 0x7facbc0a2c20 2024-06-13T02:14:17.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.659+0000 7facdc600700 1 -- 172.21.15.2:0/1118407287 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7facbc0a2c20 msgr2=0x7facbc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:17.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.659+0000 7facdc600700 1 --2- 172.21.15.2:0/1118407287 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7facbc0a2c20 0x7facbc0a50e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7facc8009480 tx=0x7facc800b040 comp rx=0 tx=0).stop 2024-06-13T02:14:17.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.659+0000 7facdc600700 1 -- 172.21.15.2:0/1118407287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd41084e0 msgr2=0x7facd419f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:17.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.659+0000 7facdc600700 1 --2- 172.21.15.2:0/1118407287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd41084e0 0x7facd419f6a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faccc00e970 tx=0x7faccc00ec80 comp rx=0 tx=0).stop 2024-06-13T02:14:17.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.659+0000 7facdc600700 1 -- 172.21.15.2:0/1118407287 shutdown_connections 2024-06-13T02:14:17.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.659+0000 7facdc600700 1 --2- 172.21.15.2:0/1118407287 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7facbc0a2c20 0x7facbc0a50e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:17.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.659+0000 7facdc600700 1 --2- 172.21.15.2:0/1118407287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd41084e0 0x7facd419f6a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:17.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.659+0000 7facdc600700 1 --2- 172.21.15.2:0/1118407287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7facd406a170 0x7facd419add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:17.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.659+0000 7facdc600700 1 --2- 172.21.15.2:0/1118407287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facd406ab10 0x7facd419b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:17.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.659+0000 7facdc600700 1 -- 172.21.15.2:0/1118407287 >> 172.21.15.2:0/1118407287 conn(0x7facd40782c0 msgr2=0x7facd410d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:17.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.660+0000 7facdc600700 1 -- 172.21.15.2:0/1118407287 shutdown_connections 2024-06-13T02:14:17.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:17.660+0000 7facdc600700 1 -- 172.21.15.2:0/1118407287 wait complete. 2024-06-13T02:14:17.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:17 smithi002 ceph-mon[31960]: pgmap v384: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-13T02:14:17.881 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:14:17 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:14:17.635+0000 7f340e600700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:14:17.881 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:14:17 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:14:17.635+0000 7f340e600700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:14:17.881 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:14:17 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:14:17.635+0000 7f340e600700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:14:17.881 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:14:17 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:14:17.635+0000 7f340e600700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:14:17.882 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:14:17 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:14:17.635+0000 7f340e600700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:14:17.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:17 smithi084 ceph-mon[36833]: pgmap v384: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-13T02:14:18.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:17 smithi175 ceph-mon[36977]: pgmap v384: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-06-13T02:14:18.505 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-06-13T02:14:18.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:18 smithi084 ceph-mon[36833]: from='client.24695 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:14:18.998 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:14:19.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:18 smithi175 ceph-mon[36977]: from='client.24695 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:14:19.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:18 smithi002 ceph-mon[31960]: from='client.24695 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:14:19.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:19 smithi002 ceph-mon[31960]: pgmap v385: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-06-13T02:14:19.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:19 smithi002 ceph-mon[31960]: mgrmap e17: x(active, since 9m), standbys: y, z 2024-06-13T02:14:19.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:19 smithi084 ceph-mon[36833]: pgmap v385: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-06-13T02:14:19.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:19 smithi084 ceph-mon[36833]: mgrmap e17: x(active, since 9m), standbys: y, z 2024-06-13T02:14:20.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:19 smithi175 ceph-mon[36977]: pgmap v385: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-06-13T02:14:20.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:19 smithi175 ceph-mon[36977]: mgrmap e17: x(active, since 9m), standbys: y, z 2024-06-13T02:14:21.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.214+0000 7f56b5200700 1 -- 172.21.15.2:0/3661611008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56b010a6b0 msgr2=0x7f56b010aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:21.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.214+0000 7f56b5200700 1 --2- 172.21.15.2:0/3661611008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56b010a6b0 0x7f56b010aa90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f56a0009f90 tx=0x7f56a000b330 comp rx=0 tx=0).stop 2024-06-13T02:14:21.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.214+0000 7f56b5200700 1 -- 172.21.15.2:0/3661611008 shutdown_connections 2024-06-13T02:14:21.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.214+0000 7f56b5200700 1 --2- 172.21.15.2:0/3661611008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0105070 0x7f56b0111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:21.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.214+0000 7f56b5200700 1 --2- 172.21.15.2:0/3661611008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56b010a6b0 0x7f56b010aa90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:21.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.214+0000 7f56b5200700 1 --2- 172.21.15.2:0/3661611008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56b01046b0 0x7f56b0104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:21.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.214+0000 7f56b5200700 1 -- 172.21.15.2:0/3661611008 >> 172.21.15.2:0/3661611008 conn(0x7f56b01001a0 msgr2=0x7f56b01025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:21.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.214+0000 7f56b5200700 1 -- 172.21.15.2:0/3661611008 shutdown_connections 2024-06-13T02:14:21.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.215+0000 7f56b5200700 1 -- 172.21.15.2:0/3661611008 wait complete. 2024-06-13T02:14:21.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.216+0000 7f56b5200700 1 Processor -- start 2024-06-13T02:14:21.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.216+0000 7f56b5200700 1 -- start start 2024-06-13T02:14:21.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.216+0000 7f56b5200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56b01046b0 0x7f56b019aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:21.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.216+0000 7f56b5200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0105070 0x7f56b019b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:21.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.216+0000 7f56b5200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56b010a6b0 0x7f56b019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:21.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.216+0000 7f56b5200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f56b0114a50 con 0x7f56b0105070 2024-06-13T02:14:21.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.216+0000 7f56b5200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f56b01148d0 con 0x7f56b010a6b0 2024-06-13T02:14:21.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.216+0000 7f56b5200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f56b0114bd0 con 0x7f56b01046b0 2024-06-13T02:14:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.217+0000 7f56ade00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56b01046b0 0x7f56b019aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.217+0000 7f56a5400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0105070 0x7f56b019b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.217+0000 7f56ae800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56b010a6b0 0x7f56b019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:21.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.217+0000 7f56ade00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56b01046b0 0x7f56b019aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:53866/0 (socket says 172.21.15.2:53866) 2024-06-13T02:14:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.217+0000 7f56ade00700 1 -- 172.21.15.2:0/2021876788 learned_addr learned my addr 172.21.15.2:0/2021876788 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:14:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.217+0000 7f56ade00700 1 -- 172.21.15.2:0/2021876788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56b010a6b0 msgr2=0x7f56b019f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.217+0000 7f56ade00700 1 --2- 172.21.15.2:0/2021876788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56b010a6b0 0x7f56b019f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.217+0000 7f56ade00700 1 -- 172.21.15.2:0/2021876788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0105070 msgr2=0x7f56b019b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.217+0000 7f56ade00700 1 --2- 172.21.15.2:0/2021876788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0105070 0x7f56b019b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.217+0000 7f56ade00700 1 -- 172.21.15.2:0/2021876788 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b019fe80 con 0x7f56b01046b0 2024-06-13T02:14:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.218+0000 7f56ade00700 1 --2- 172.21.15.2:0/2021876788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56b01046b0 0x7f56b019aec0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f56a0004f20 tx=0x7f56a0004f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.218+0000 7f56a7400700 1 -- 172.21.15.2:0/2021876788 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0021070 con 0x7f56b01046b0 2024-06-13T02:14:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.218+0000 7f56b5200700 1 -- 172.21.15.2:0/2021876788 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b01a0110 con 0x7f56b01046b0 2024-06-13T02:14:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.218+0000 7f56a7400700 1 -- 172.21.15.2:0/2021876788 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56a0007ac0 con 0x7f56b01046b0 2024-06-13T02:14:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.218+0000 7f56b5200700 1 -- 172.21.15.2:0/2021876788 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b01a79f0 con 0x7f56b01046b0 2024-06-13T02:14:21.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.218+0000 7f56a7400700 1 -- 172.21.15.2:0/2021876788 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a00052a0 con 0x7f56b01046b0 2024-06-13T02:14:21.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.219+0000 7f56b5200700 1 -- 172.21.15.2:0/2021876788 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f568c005330 con 0x7f56b01046b0 2024-06-13T02:14:21.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.221+0000 7f56a7400700 1 -- 172.21.15.2:0/2021876788 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f56a0024070 con 0x7f56b01046b0 2024-06-13T02:14:21.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.223+0000 7f56a7400700 1 --2- 172.21.15.2:0/2021876788 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f56940a2d30 0x7f56940a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:21.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.223+0000 7f56a7400700 1 -- 172.21.15.2:0/2021876788 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9092+0+0 (secure 0 0 0) 0x7f56a000f020 con 0x7f56b01046b0 2024-06-13T02:14:21.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.223+0000 7f56a5400700 1 --2- 172.21.15.2:0/2021876788 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f56940a2d30 0x7f56940a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:21.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.224+0000 7f56a5400700 1 --2- 172.21.15.2:0/2021876788 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f56940a2d30 0x7f56940a51f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f56b0109c40 tx=0x7f5698009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:21.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.227+0000 7f56a7400700 1 -- 172.21.15.2:0/2021876788 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f56a002b020 con 0x7f56b01046b0 2024-06-13T02:14:21.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.492+0000 7f56b5200700 1 -- 172.21.15.2:0/2021876788 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f568c000bc0 con 0x7f56940a2d30 2024-06-13T02:14:21.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.537+0000 7f56a7400700 1 -- 172.21.15.2:0/2021876788 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f568c000bc0 con 0x7f56940a2d30 2024-06-13T02:14:21.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.540+0000 7f56b5200700 1 -- 172.21.15.2:0/2021876788 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f56940a2d30 msgr2=0x7f56940a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:21.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.540+0000 7f56b5200700 1 --2- 172.21.15.2:0/2021876788 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f56940a2d30 0x7f56940a51f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f56b0109c40 tx=0x7f5698009260 comp rx=0 tx=0).stop 2024-06-13T02:14:21.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.540+0000 7f56b5200700 1 -- 172.21.15.2:0/2021876788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56b01046b0 msgr2=0x7f56b019aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:21.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.540+0000 7f56b5200700 1 --2- 172.21.15.2:0/2021876788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56b01046b0 0x7f56b019aec0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f56a0004f20 tx=0x7f56a0004f50 comp rx=0 tx=0).stop 2024-06-13T02:14:21.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.540+0000 7f56b5200700 1 -- 172.21.15.2:0/2021876788 shutdown_connections 2024-06-13T02:14:21.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.540+0000 7f56b5200700 1 --2- 172.21.15.2:0/2021876788 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f56940a2d30 0x7f56940a51f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:21.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.540+0000 7f56b5200700 1 --2- 172.21.15.2:0/2021876788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56b010a6b0 0x7f56b019f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:21.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.540+0000 7f56b5200700 1 --2- 172.21.15.2:0/2021876788 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56b01046b0 0x7f56b019aec0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:21.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.540+0000 7f56b5200700 1 --2- 172.21.15.2:0/2021876788 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56b0105070 0x7f56b019b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:21.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.540+0000 7f56b5200700 1 -- 172.21.15.2:0/2021876788 >> 172.21.15.2:0/2021876788 conn(0x7f56b01001a0 msgr2=0x7f56b0100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:21.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.541+0000 7f56b5200700 1 -- 172.21.15.2:0/2021876788 shutdown_connections 2024-06-13T02:14:21.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:21.541+0000 7f56b5200700 1 -- 172.21.15.2:0/2021876788 wait complete. 2024-06-13T02:14:21.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:21 smithi002 ceph-mon[31960]: pgmap v386: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-06-13T02:14:21.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:21 smithi084 ceph-mon[36833]: pgmap v386: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-06-13T02:14:22.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:21 smithi175 ceph-mon[36977]: pgmap v386: 129 pgs: 129 active+clean; 584 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-06-13T02:14:22.356 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-06-13T02:14:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:14:22.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:22 smithi084 ceph-mon[36833]: from='client.24697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:14:22.984 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:22 smithi002 ceph-mon[31960]: from='client.24697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:14:23.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:22 smithi175 ceph-mon[36977]: from='client.24697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:14:23.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:23 smithi084 ceph-mon[36833]: pgmap v387: 129 pgs: 129 active+clean; 604 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-06-13T02:14:24.020 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:23 smithi002 ceph-mon[31960]: pgmap v387: 129 pgs: 129 active+clean; 604 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-06-13T02:14:24.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:23 smithi175 ceph-mon[36977]: pgmap v387: 129 pgs: 129 active+clean; 604 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-06-13T02:14:24.696 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-06-13T02:14:24.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-06-13T02:14:24.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-06-13T02:14:24.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-06-13T02:14:24.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]: dispatch 2024-06-13T02:14:24.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:24 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-06-13T02:14:25.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.000+0000 7fc9a2800700 1 -- 172.21.15.2:0/3323972112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c107400 msgr2=0x7fc99c1077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:25.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.000+0000 7fc9a2800700 1 --2- 172.21.15.2:0/3323972112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c107400 0x7fc99c1077e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0098f0 tx=0x7fc98c009c00 comp rx=0 tx=0).stop 2024-06-13T02:14:25.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.000+0000 7fc9a2800700 1 -- 172.21.15.2:0/3323972112 shutdown_connections 2024-06-13T02:14:25.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.000+0000 7fc9a2800700 1 --2- 172.21.15.2:0/3323972112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc99c101d50 0x7fc99c10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:25.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.000+0000 7fc9a2800700 1 --2- 172.21.15.2:0/3323972112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c107400 0x7fc99c1077e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:25.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.000+0000 7fc9a2800700 1 --2- 172.21.15.2:0/3323972112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc99c101390 0x7fc99c101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:25.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.000+0000 7fc9a2800700 1 -- 172.21.15.2:0/3323972112 >> 172.21.15.2:0/3323972112 conn(0x7fc99c078340 msgr2=0x7fc99c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:25.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.000+0000 7fc9a2800700 1 -- 172.21.15.2:0/3323972112 shutdown_connections 2024-06-13T02:14:25.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.000+0000 7fc9a2800700 1 -- 172.21.15.2:0/3323972112 wait complete. 2024-06-13T02:14:25.004 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-06-13T02:14:25.004 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-06-13T02:14:25.005 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]: dispatch 2024-06-13T02:14:25.005 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:24 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-06-13T02:14:25.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.002+0000 7fc9a2800700 1 Processor -- start 2024-06-13T02:14:25.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.002+0000 7fc9a2800700 1 -- start start 2024-06-13T02:14:25.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.002+0000 7fc9a2800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc99c101390 0x7fc99c19ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:25.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.002+0000 7fc9a2800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c101d50 0x7fc99c19b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:25.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.002+0000 7fc9a2800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc99c107400 0x7fc99c19f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:25.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.002+0000 7fc9a2800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c1116c0 con 0x7fc99c101390 2024-06-13T02:14:25.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.002+0000 7fc9a2800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c111540 con 0x7fc99c101d50 2024-06-13T02:14:25.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.002+0000 7fc9a2800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c111840 con 0x7fc99c107400 2024-06-13T02:14:25.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.003+0000 7fc99b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc99c101390 0x7fc99c19ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:25.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.003+0000 7fc99b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc99c101390 0x7fc99c19ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42120/0 (socket says 172.21.15.2:42120) 2024-06-13T02:14:25.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.003+0000 7fc99b400700 1 -- 172.21.15.2:0/4051425946 learned_addr learned my addr 172.21.15.2:0/4051425946 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:14:25.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.003+0000 7fc99aa00700 1 --2- 172.21.15.2:0/4051425946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c101d50 0x7fc99c19b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:25.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.003+0000 7fc99be00700 1 --2- 172.21.15.2:0/4051425946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc99c107400 0x7fc99c19f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:25.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.003+0000 7fc99b400700 1 -- 172.21.15.2:0/4051425946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc99c107400 msgr2=0x7fc99c19f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:25.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.003+0000 7fc99b400700 1 --2- 172.21.15.2:0/4051425946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc99c107400 0x7fc99c19f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:25.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.003+0000 7fc99b400700 1 -- 172.21.15.2:0/4051425946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c101d50 msgr2=0x7fc99c19b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:25.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.003+0000 7fc99b400700 1 --2- 172.21.15.2:0/4051425946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c101d50 0x7fc99c19b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:25.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.003+0000 7fc99b400700 1 -- 172.21.15.2:0/4051425946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99c19fea0 con 0x7fc99c101390 2024-06-13T02:14:25.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.003+0000 7fc99aa00700 1 --2- 172.21.15.2:0/4051425946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c101d50 0x7fc99c19b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:14:25.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.004+0000 7fc99b400700 1 --2- 172.21.15.2:0/4051425946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc99c101390 0x7fc99c19ae90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc98c005950 tx=0x7fc98c00fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:25.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.004+0000 7fc993e00700 1 -- 172.21.15.2:0/4051425946 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c0051f0 con 0x7fc99c101390 2024-06-13T02:14:25.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.004+0000 7fc9a2800700 1 -- 172.21.15.2:0/4051425946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc99c1a0130 con 0x7fc99c101390 2024-06-13T02:14:25.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.004+0000 7fc993e00700 1 -- 172.21.15.2:0/4051425946 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc98c00b560 con 0x7fc99c101390 2024-06-13T02:14:25.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.004+0000 7fc993e00700 1 -- 172.21.15.2:0/4051425946 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c003a40 con 0x7fc99c101390 2024-06-13T02:14:25.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.004+0000 7fc9a2800700 1 -- 172.21.15.2:0/4051425946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc99c1a7a10 con 0x7fc99c101390 2024-06-13T02:14:25.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.006+0000 7fc9a2800700 1 -- 172.21.15.2:0/4051425946 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc99c069180 con 0x7fc99c101390 2024-06-13T02:14:25.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.007+0000 7fc993e00700 1 -- 172.21.15.2:0/4051425946 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fc98c00ba80 con 0x7fc99c101390 2024-06-13T02:14:25.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.009+0000 7fc993e00700 1 --2- 172.21.15.2:0/4051425946 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc9800a2d30 0x7fc9800a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:25.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.009+0000 7fc993e00700 1 -- 172.21.15.2:0/4051425946 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9237+0+0 (secure 0 0 0) 0x7fc98c0d0540 con 0x7fc99c101390 2024-06-13T02:14:25.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.009+0000 7fc99aa00700 1 --2- 172.21.15.2:0/4051425946 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc9800a2d30 0x7fc9800a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:25.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.010+0000 7fc99aa00700 1 --2- 172.21.15.2:0/4051425946 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc9800a2d30 0x7fc9800a51f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc988009750 tx=0x7fc988009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:25.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.014+0000 7fc993e00700 1 -- 172.21.15.2:0/4051425946 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc98c013030 con 0x7fc99c101390 2024-06-13T02:14:25.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-06-13T02:14:25.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-06-13T02:14:25.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-06-13T02:14:25.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]: dispatch 2024-06-13T02:14:25.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:24 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-06-13T02:14:25.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.280+0000 7fc9a2800700 1 -- 172.21.15.2:0/4051425946 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fc99c06a8e0 con 0x7fc9800a2d30 2024-06-13T02:14:25.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.290+0000 7fc993e00700 1 -- 172.21.15.2:0/4051425946 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fc99c06a8e0 con 0x7fc9800a2d30 2024-06-13T02:14:25.292 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_0/ba5af598-0518-4abb-b6a9-24e342891767 2024-06-13T02:14:25.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.293+0000 7fc9a2800700 1 -- 172.21.15.2:0/4051425946 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc9800a2d30 msgr2=0x7fc9800a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:25.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.293+0000 7fc9a2800700 1 --2- 172.21.15.2:0/4051425946 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc9800a2d30 0x7fc9800a51f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc988009750 tx=0x7fc988009310 comp rx=0 tx=0).stop 2024-06-13T02:14:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.293+0000 7fc9a2800700 1 -- 172.21.15.2:0/4051425946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc99c101390 msgr2=0x7fc99c19ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.293+0000 7fc9a2800700 1 --2- 172.21.15.2:0/4051425946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc99c101390 0x7fc99c19ae90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc98c005950 tx=0x7fc98c00fb20 comp rx=0 tx=0).stop 2024-06-13T02:14:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.294+0000 7fc9a2800700 1 -- 172.21.15.2:0/4051425946 shutdown_connections 2024-06-13T02:14:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.294+0000 7fc9a2800700 1 --2- 172.21.15.2:0/4051425946 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc9800a2d30 0x7fc9800a51f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.294+0000 7fc9a2800700 1 --2- 172.21.15.2:0/4051425946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc99c107400 0x7fc99c19f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.294+0000 7fc9a2800700 1 --2- 172.21.15.2:0/4051425946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc99c101390 0x7fc99c19ae90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.294+0000 7fc9a2800700 1 --2- 172.21.15.2:0/4051425946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c101d50 0x7fc99c19b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.294+0000 7fc9a2800700 1 -- 172.21.15.2:0/4051425946 >> 172.21.15.2:0/4051425946 conn(0x7fc99c078340 msgr2=0x7fc99c06a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:25.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.294+0000 7fc9a2800700 1 -- 172.21.15.2:0/4051425946 shutdown_connections 2024-06-13T02:14:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:25.294+0000 7fc9a2800700 1 -- 172.21.15.2:0/4051425946 wait complete. 2024-06-13T02:14:25.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:25 smithi084 ceph-mon[36833]: pgmap v388: 129 pgs: 129 active+clean; 604 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-06-13T02:14:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-06-13T02:14:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-06-13T02:14:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-06-13T02:14:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]': finished 2024-06-13T02:14:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:25 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-06-13T02:14:25.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:25 smithi084 ceph-mon[36833]: osdmap e99: 12 total, 12 up, 12 in 2024-06-13T02:14:26.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:25 smithi002 ceph-mon[31960]: pgmap v388: 129 pgs: 129 active+clean; 604 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-06-13T02:14:26.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-06-13T02:14:26.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-06-13T02:14:26.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-06-13T02:14:26.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]': finished 2024-06-13T02:14:26.026 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:25 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-06-13T02:14:26.027 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:25 smithi002 ceph-mon[31960]: osdmap e99: 12 total, 12 up, 12 in 2024-06-13T02:14:26.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:25 smithi175 ceph-mon[36977]: pgmap v388: 129 pgs: 129 active+clean; 604 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-06-13T02:14:26.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-06-13T02:14:26.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-06-13T02:14:26.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-06-13T02:14:26.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 10]}]': finished 2024-06-13T02:14:26.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:25 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-06-13T02:14:26.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:25 smithi175 ceph-mon[36977]: osdmap e99: 12 total, 12 up, 12 in 2024-06-13T02:14:26.103 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-06-13T02:14:26.586 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:14:26.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:26 smithi084 ceph-mon[36833]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:14:26.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:26 smithi084 ceph-mon[36833]: osdmap e100: 12 total, 12 up, 12 in 2024-06-13T02:14:27.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:26 smithi175 ceph-mon[36977]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:14:27.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:26 smithi175 ceph-mon[36977]: osdmap e100: 12 total, 12 up, 12 in 2024-06-13T02:14:27.063 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:26 smithi002 ceph-mon[31960]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:14:27.063 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:26 smithi002 ceph-mon[31960]: osdmap e100: 12 total, 12 up, 12 in 2024-06-13T02:14:27.730 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:27 smithi002 ceph-mon[31960]: pgmap v391: 129 pgs: 129 active+clean; 604 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-06-13T02:14:27.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:27 smithi084 ceph-mon[36833]: pgmap v391: 129 pgs: 129 active+clean; 604 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-06-13T02:14:28.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:27 smithi175 ceph-mon[36977]: pgmap v391: 129 pgs: 129 active+clean; 604 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 3.5 KiB/s wr, 6 op/s 2024-06-13T02:14:28.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.931+0000 7f1f54e00700 1 -- 172.21.15.2:0/2644986621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f5010a6d0 msgr2=0x7f1f5010aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:28.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.931+0000 7f1f54e00700 1 --2- 172.21.15.2:0/2644986621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f5010a6d0 0x7f1f5010aab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009990 tx=0x7f1f40009ca0 comp rx=0 tx=0).stop 2024-06-13T02:14:28.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.931+0000 7f1f54e00700 1 -- 172.21.15.2:0/2644986621 shutdown_connections 2024-06-13T02:14:28.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.931+0000 7f1f54e00700 1 --2- 172.21.15.2:0/2644986621 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f50105090 0x7f1f501115a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:28.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.931+0000 7f1f54e00700 1 --2- 172.21.15.2:0/2644986621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f5010a6d0 0x7f1f5010aab0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:28.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.931+0000 7f1f54e00700 1 --2- 172.21.15.2:0/2644986621 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f501046d0 0x7f1f50104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:28.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.931+0000 7f1f54e00700 1 -- 172.21.15.2:0/2644986621 >> 172.21.15.2:0/2644986621 conn(0x7f1f501001c0 msgr2=0x7f1f501025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:28.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.932+0000 7f1f54e00700 1 -- 172.21.15.2:0/2644986621 shutdown_connections 2024-06-13T02:14:28.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.932+0000 7f1f54e00700 1 -- 172.21.15.2:0/2644986621 wait complete. 2024-06-13T02:14:28.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.933+0000 7f1f54e00700 1 Processor -- start 2024-06-13T02:14:28.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.933+0000 7f1f54e00700 1 -- start start 2024-06-13T02:14:28.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.934+0000 7f1f54e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f501046d0 0x7f1f5019aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:28.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.934+0000 7f1f54e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f50105090 0x7f1f5019b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:28.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.934+0000 7f1f54e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f5010a6d0 0x7f1f5019f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:28.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.934+0000 7f1f54e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1f50114a60 con 0x7f1f5010a6d0 2024-06-13T02:14:28.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.934+0000 7f1f54e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f501148e0 con 0x7f1f50105090 2024-06-13T02:14:28.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.934+0000 7f1f54e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1f50114be0 con 0x7f1f501046d0 2024-06-13T02:14:28.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.934+0000 7f1f4de00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f501046d0 0x7f1f5019aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:28.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.934+0000 7f1f4e800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f5010a6d0 0x7f1f5019f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:28.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.934+0000 7f1f4de00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f501046d0 0x7f1f5019aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:55916/0 (socket says 172.21.15.2:55916) 2024-06-13T02:14:28.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.934+0000 7f1f4de00700 1 -- 172.21.15.2:0/920465843 learned_addr learned my addr 172.21.15.2:0/920465843 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:14:28.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.934+0000 7f1f4d400700 1 --2- 172.21.15.2:0/920465843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f50105090 0x7f1f5019b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:28.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.935+0000 7f1f4de00700 1 -- 172.21.15.2:0/920465843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f50105090 msgr2=0x7f1f5019b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:28.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.935+0000 7f1f4de00700 1 --2- 172.21.15.2:0/920465843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f50105090 0x7f1f5019b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:28.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.935+0000 7f1f4de00700 1 -- 172.21.15.2:0/920465843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f5010a6d0 msgr2=0x7f1f5019f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:28.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.935+0000 7f1f4de00700 1 --2- 172.21.15.2:0/920465843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f5010a6d0 0x7f1f5019f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:28.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.935+0000 7f1f4de00700 1 -- 172.21.15.2:0/920465843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5019fe70 con 0x7f1f501046d0 2024-06-13T02:14:28.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.935+0000 7f1f4de00700 1 --2- 172.21.15.2:0/920465843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f501046d0 0x7f1f5019aeb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1f40005910 tx=0x7f1f4000bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:28.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.935+0000 7f1f46a00700 1 -- 172.21.15.2:0/920465843 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40027070 con 0x7f1f501046d0 2024-06-13T02:14:28.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.935+0000 7f1f46a00700 1 -- 172.21.15.2:0/920465843 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f40004650 con 0x7f1f501046d0 2024-06-13T02:14:28.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.935+0000 7f1f46a00700 1 -- 172.21.15.2:0/920465843 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4000f460 con 0x7f1f501046d0 2024-06-13T02:14:28.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.935+0000 7f1f54e00700 1 -- 172.21.15.2:0/920465843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f501a0100 con 0x7f1f501046d0 2024-06-13T02:14:28.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.935+0000 7f1f54e00700 1 -- 172.21.15.2:0/920465843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f501a79e0 con 0x7f1f501046d0 2024-06-13T02:14:28.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.936+0000 7f1f54e00700 1 -- 172.21.15.2:0/920465843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5010cc60 con 0x7f1f501046d0 2024-06-13T02:14:28.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.939+0000 7f1f46a00700 1 -- 172.21.15.2:0/920465843 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f1f4002a070 con 0x7f1f501046d0 2024-06-13T02:14:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.940+0000 7f1f46a00700 1 --2- 172.21.15.2:0/920465843 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1f340a2d30 0x7f1f340a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.940+0000 7f1f46a00700 1 -- 172.21.15.2:0/920465843 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f1f400d0830 con 0x7f1f501046d0 2024-06-13T02:14:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.940+0000 7f1f4d400700 1 --2- 172.21.15.2:0/920465843 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1f340a2d30 0x7f1f340a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:28.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.941+0000 7f1f4d400700 1 --2- 172.21.15.2:0/920465843 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1f340a2d30 0x7f1f340a51f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009680 tx=0x7f1f3c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:28.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:28.943+0000 7f1f46a00700 1 -- 172.21.15.2:0/920465843 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1f40013070 con 0x7f1f501046d0 2024-06-13T02:14:29.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:29.207+0000 7f1f54e00700 1 -- 172.21.15.2:0/920465843 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1f5019c1c0 con 0x7f1f340a2d30 2024-06-13T02:14:29.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:29.249+0000 7f1f46a00700 1 -- 172.21.15.2:0/920465843 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1f5019c1c0 con 0x7f1f340a2d30 2024-06-13T02:14:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:29.253+0000 7f1f54e00700 1 -- 172.21.15.2:0/920465843 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1f340a2d30 msgr2=0x7f1f340a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:29.253+0000 7f1f54e00700 1 --2- 172.21.15.2:0/920465843 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1f340a2d30 0x7f1f340a51f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009680 tx=0x7f1f3c009260 comp rx=0 tx=0).stop 2024-06-13T02:14:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:29.253+0000 7f1f54e00700 1 -- 172.21.15.2:0/920465843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f501046d0 msgr2=0x7f1f5019aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:29.253+0000 7f1f54e00700 1 --2- 172.21.15.2:0/920465843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f501046d0 0x7f1f5019aeb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1f40005910 tx=0x7f1f4000bab0 comp rx=0 tx=0).stop 2024-06-13T02:14:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:29.253+0000 7f1f54e00700 1 -- 172.21.15.2:0/920465843 shutdown_connections 2024-06-13T02:14:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:29.253+0000 7f1f54e00700 1 --2- 172.21.15.2:0/920465843 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1f340a2d30 0x7f1f340a51f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:29.253+0000 7f1f54e00700 1 --2- 172.21.15.2:0/920465843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f5010a6d0 0x7f1f5019f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:29.253+0000 7f1f54e00700 1 --2- 172.21.15.2:0/920465843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f501046d0 0x7f1f5019aeb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:29.253+0000 7f1f54e00700 1 --2- 172.21.15.2:0/920465843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f50105090 0x7f1f5019b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:29.253+0000 7f1f54e00700 1 -- 172.21.15.2:0/920465843 >> 172.21.15.2:0/920465843 conn(0x7f1f501001c0 msgr2=0x7f1f50100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:29.253+0000 7f1f54e00700 1 -- 172.21.15.2:0/920465843 shutdown_connections 2024-06-13T02:14:29.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:29.253+0000 7f1f54e00700 1 -- 172.21.15.2:0/920465843 wait complete. 2024-06-13T02:14:30.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:29 smithi175 ceph-mon[36977]: pgmap v392: 129 pgs: 129 active+clean; 610 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.2 KiB/s wr, 8 op/s; 13 B/s, 0 objects/s recovering 2024-06-13T02:14:30.033 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:29 smithi002 ceph-mon[31960]: pgmap v392: 129 pgs: 129 active+clean; 610 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.2 KiB/s wr, 8 op/s; 13 B/s, 0 objects/s recovering 2024-06-13T02:14:30.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-06-13T02:14:30.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:29 smithi084 ceph-mon[36833]: pgmap v392: 129 pgs: 129 active+clean; 610 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.2 KiB/s wr, 8 op/s; 13 B/s, 0 objects/s recovering 2024-06-13T02:14:30.605 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:14:31.016 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:30 smithi002 ceph-mon[31960]: from='client.24709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:14:31.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:30 smithi175 ceph-mon[36977]: from='client.24709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:14:31.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:30 smithi084 ceph-mon[36833]: from='client.24709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:14:32.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:31 smithi175 ceph-mon[36977]: pgmap v393: 129 pgs: 129 active+clean; 610 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s; 13 B/s, 0 objects/s recovering 2024-06-13T02:14:32.075 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:31 smithi002 ceph-mon[31960]: pgmap v393: 129 pgs: 129 active+clean; 610 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s; 13 B/s, 0 objects/s recovering 2024-06-13T02:14:32.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:31 smithi084 ceph-mon[36833]: pgmap v393: 129 pgs: 129 active+clean; 610 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.5 KiB/s wr, 7 op/s; 13 B/s, 0 objects/s recovering 2024-06-13T02:14:33.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.032+0000 7ff08b200700 1 -- 172.21.15.2:0/387583547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff08c101cd0 msgr2=0x7ff08c1056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:33.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.032+0000 7ff08b200700 1 --2- 172.21.15.2:0/387583547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff08c101cd0 0x7ff08c1056a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff07800aad0 tx=0x7ff07800ade0 comp rx=0 tx=0).stop 2024-06-13T02:14:33.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.032+0000 7ff08b200700 1 -- 172.21.15.2:0/387583547 shutdown_connections 2024-06-13T02:14:33.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.032+0000 7ff08b200700 1 --2- 172.21.15.2:0/387583547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff08c105d80 0x7ff08c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:33.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.032+0000 7ff08b200700 1 --2- 172.21.15.2:0/387583547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff08c101320 0x7ff08c101700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:33.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.032+0000 7ff08b200700 1 --2- 172.21.15.2:0/387583547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff08c101cd0 0x7ff08c1056a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:33.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.032+0000 7ff08b200700 1 -- 172.21.15.2:0/387583547 >> 172.21.15.2:0/387583547 conn(0x7ff08c076130 msgr2=0x7ff08c076540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:33.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.033+0000 7ff08b200700 1 -- 172.21.15.2:0/387583547 shutdown_connections 2024-06-13T02:14:33.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.033+0000 7ff08b200700 1 -- 172.21.15.2:0/387583547 wait complete. 2024-06-13T02:14:33.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.034+0000 7ff08b200700 1 Processor -- start 2024-06-13T02:14:33.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.034+0000 7ff08b200700 1 -- start start 2024-06-13T02:14:33.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.035+0000 7ff08b200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff08c101320 0x7ff08c19e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:33.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.035+0000 7ff08b200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff08c101cd0 0x7ff08c19ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:33.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.035+0000 7ff08b200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff08c105d80 0x7ff08c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:33.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.035+0000 7ff08b200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c1104c0 con 0x7ff08c105d80 2024-06-13T02:14:33.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.035+0000 7ff08b200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c110340 con 0x7ff08c101cd0 2024-06-13T02:14:33.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.035+0000 7ff08b200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c110640 con 0x7ff08c101320 2024-06-13T02:14:33.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.035+0000 7ff089e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff08c101320 0x7ff08c19e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:33.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.035+0000 7ff089e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff08c101320 0x7ff08c19e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:60628/0 (socket says 172.21.15.2:60628) 2024-06-13T02:14:33.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.035+0000 7ff089e00700 1 -- 172.21.15.2:0/183737876 learned_addr learned my addr 172.21.15.2:0/183737876 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:14:33.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.035+0000 7ff08a800700 1 --2- 172.21.15.2:0/183737876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff08c105d80 0x7ff08c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:33.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.035+0000 7ff089400700 1 --2- 172.21.15.2:0/183737876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff08c101cd0 0x7ff08c19ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:33.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.036+0000 7ff089400700 1 -- 172.21.15.2:0/183737876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff08c101320 msgr2=0x7ff08c19e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:33.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.036+0000 7ff089400700 1 --2- 172.21.15.2:0/183737876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff08c101320 0x7ff08c19e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:33.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.036+0000 7ff089400700 1 -- 172.21.15.2:0/183737876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff08c105d80 msgr2=0x7ff08c1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:33.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.036+0000 7ff089400700 1 --2- 172.21.15.2:0/183737876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff08c105d80 0x7ff08c1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:33.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.036+0000 7ff089400700 1 -- 172.21.15.2:0/183737876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08c199050 con 0x7ff08c101cd0 2024-06-13T02:14:33.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.036+0000 7ff089e00700 1 --2- 172.21.15.2:0/183737876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff08c101320 0x7ff08c19e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:14:33.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.036+0000 7ff089400700 1 --2- 172.21.15.2:0/183737876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff08c101cd0 0x7ff08c19ec70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff07800a9f0 tx=0x7ff07800cd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:33.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.036+0000 7ff082a00700 1 -- 172.21.15.2:0/183737876 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078025070 con 0x7ff08c101cd0 2024-06-13T02:14:33.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.037+0000 7ff082a00700 1 -- 172.21.15.2:0/183737876 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff078020460 con 0x7ff08c101cd0 2024-06-13T02:14:33.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.037+0000 7ff08b200700 1 -- 172.21.15.2:0/183737876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08c1992e0 con 0x7ff08c101cd0 2024-06-13T02:14:33.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.037+0000 7ff082a00700 1 -- 172.21.15.2:0/183737876 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07800e6b0 con 0x7ff08c101cd0 2024-06-13T02:14:33.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.037+0000 7ff08b200700 1 -- 172.21.15.2:0/183737876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff08c1a5600 con 0x7ff08c101cd0 2024-06-13T02:14:33.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.038+0000 7ff08b200700 1 -- 172.21.15.2:0/183737876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff08c069180 con 0x7ff08c101cd0 2024-06-13T02:14:33.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.040+0000 7ff082a00700 1 -- 172.21.15.2:0/183737876 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7ff078028070 con 0x7ff08c101cd0 2024-06-13T02:14:33.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.041+0000 7ff082a00700 1 --2- 172.21.15.2:0/183737876 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff0700a2d30 0x7ff0700a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:33.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.041+0000 7ff082a00700 1 -- 172.21.15.2:0/183737876 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7ff0780d0520 con 0x7ff08c101cd0 2024-06-13T02:14:33.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.041+0000 7ff089e00700 1 --2- 172.21.15.2:0/183737876 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff0700a2d30 0x7ff0700a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:33.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.042+0000 7ff089e00700 1 --2- 172.21.15.2:0/183737876 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff0700a2d30 0x7ff0700a51f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff08c199a30 tx=0x7ff07c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:33.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.045+0000 7ff082a00700 1 -- 172.21.15.2:0/183737876 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff07805c850 con 0x7ff08c101cd0 2024-06-13T02:14:33.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.316+0000 7ff08b200700 1 -- 172.21.15.2:0/183737876 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7ff08c199e20 con 0x7ff0700a2d30 2024-06-13T02:14:33.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.330+0000 7ff082a00700 1 -- 172.21.15.2:0/183737876 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ff08c199e20 con 0x7ff0700a2d30 2024-06-13T02:14:33.331 INFO:teuthology.orchestra.run.smithi002.stdout:/volumes/qa/sv_1/15597729-d88c-4a88-b8de-9b3ee6cd87e6 2024-06-13T02:14:33.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.333+0000 7ff08b200700 1 -- 172.21.15.2:0/183737876 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff0700a2d30 msgr2=0x7ff0700a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.333+0000 7ff08b200700 1 --2- 172.21.15.2:0/183737876 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff0700a2d30 0x7ff0700a51f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff08c199a30 tx=0x7ff07c009260 comp rx=0 tx=0).stop 2024-06-13T02:14:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.333+0000 7ff08b200700 1 -- 172.21.15.2:0/183737876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff08c101cd0 msgr2=0x7ff08c19ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.333+0000 7ff08b200700 1 --2- 172.21.15.2:0/183737876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff08c101cd0 0x7ff08c19ec70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff07800a9f0 tx=0x7ff07800cd60 comp rx=0 tx=0).stop 2024-06-13T02:14:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.333+0000 7ff08b200700 1 -- 172.21.15.2:0/183737876 shutdown_connections 2024-06-13T02:14:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.333+0000 7ff08b200700 1 --2- 172.21.15.2:0/183737876 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff0700a2d30 0x7ff0700a51f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.333+0000 7ff08b200700 1 --2- 172.21.15.2:0/183737876 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff08c105d80 0x7ff08c1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.333+0000 7ff08b200700 1 --2- 172.21.15.2:0/183737876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff08c101320 0x7ff08c19e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.333+0000 7ff08b200700 1 --2- 172.21.15.2:0/183737876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff08c101cd0 0x7ff08c19ec70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.333+0000 7ff08b200700 1 -- 172.21.15.2:0/183737876 >> 172.21.15.2:0/183737876 conn(0x7ff08c076130 msgr2=0x7ff08c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.333+0000 7ff08b200700 1 -- 172.21.15.2:0/183737876 shutdown_connections 2024-06-13T02:14:33.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:33.333+0000 7ff08b200700 1 -- 172.21.15.2:0/183737876 wait complete. 2024-06-13T02:14:34.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:33 smithi175 ceph-mon[36977]: pgmap v394: 129 pgs: 129 active+clean; 634 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.7 KiB/s wr, 8 op/s; 13 B/s, 0 objects/s recovering 2024-06-13T02:14:34.092 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:33 smithi002 ceph-mon[31960]: pgmap v394: 129 pgs: 129 active+clean; 634 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.7 KiB/s wr, 8 op/s; 13 B/s, 0 objects/s recovering 2024-06-13T02:14:34.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:14:34.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:33 smithi084 ceph-mon[36833]: pgmap v394: 129 pgs: 129 active+clean; 634 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.7 KiB/s wr, 8 op/s; 13 B/s, 0 objects/s recovering 2024-06-13T02:14:34.637 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:14:35.032 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:34 smithi002 ceph-mon[31960]: from='client.24725 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:14:35.032 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:34 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:14:35.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:34 smithi175 ceph-mon[36977]: from='client.24725 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:14:35.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:34 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:14:35.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:34 smithi084 ceph-mon[36833]: from='client.24725 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:14:35.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:34 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:14:35.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:35 smithi084 ceph-mon[36833]: pgmap v395: 129 pgs: 129 active+clean; 634 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.0 KiB/s wr, 8 op/s; 11 B/s, 0 objects/s recovering 2024-06-13T02:14:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:35 smithi175 ceph-mon[36977]: pgmap v395: 129 pgs: 129 active+clean; 634 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.0 KiB/s wr, 8 op/s; 11 B/s, 0 objects/s recovering 2024-06-13T02:14:36.101 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:35 smithi002 ceph-mon[31960]: pgmap v395: 129 pgs: 129 active+clean; 634 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.0 KiB/s wr, 8 op/s; 11 B/s, 0 objects/s recovering 2024-06-13T02:14:36.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.908+0000 7f8a7ce00700 1 -- 172.21.15.2:0/1944808886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a78102fd0 msgr2=0x7f8a78107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:36.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.908+0000 7f8a7ce00700 1 --2- 172.21.15.2:0/1944808886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a78102fd0 0x7f8a78107020 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8a640098f0 tx=0x7f8a64009c00 comp rx=0 tx=0).stop 2024-06-13T02:14:36.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.908+0000 7f8a7ce00700 1 -- 172.21.15.2:0/1944808886 shutdown_connections 2024-06-13T02:14:36.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.908+0000 7f8a7ce00700 1 --2- 172.21.15.2:0/1944808886 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78107700 0x7f8a7810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:36.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.908+0000 7f8a7ce00700 1 --2- 172.21.15.2:0/1944808886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a78102620 0x7f8a78102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:36.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.908+0000 7f8a7ce00700 1 --2- 172.21.15.2:0/1944808886 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a78102fd0 0x7f8a78107020 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:36.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.908+0000 7f8a7ce00700 1 -- 172.21.15.2:0/1944808886 >> 172.21.15.2:0/1944808886 conn(0x7f8a780fdf10 msgr2=0x7f8a78100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:36.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.908+0000 7f8a7ce00700 1 -- 172.21.15.2:0/1944808886 shutdown_connections 2024-06-13T02:14:36.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.908+0000 7f8a7ce00700 1 -- 172.21.15.2:0/1944808886 wait complete. 2024-06-13T02:14:36.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.909+0000 7f8a7ce00700 1 Processor -- start 2024-06-13T02:14:36.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.910+0000 7f8a7ce00700 1 -- start start 2024-06-13T02:14:36.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.910+0000 7f8a7ce00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a78102620 0x7f8a78074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:36.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.910+0000 7f8a7ce00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78102fd0 0x7f8a78074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:36.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.910+0000 7f8a7ce00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a78107700 0x7f8a78075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:36.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.910+0000 7f8a7ce00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78112730 con 0x7f8a78102fd0 2024-06-13T02:14:36.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.910+0000 7f8a7ce00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781125b0 con 0x7f8a78102620 2024-06-13T02:14:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.910+0000 7f8a7ce00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781128b0 con 0x7f8a78107700 2024-06-13T02:14:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.910+0000 7f8a77400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a78102620 0x7f8a78074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.910+0000 7f8a76a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78102fd0 0x7f8a78074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.910+0000 7f8a77400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a78102620 0x7f8a78074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:53238/0 (socket says 172.21.15.2:53238) 2024-06-13T02:14:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.910+0000 7f8a77400700 1 -- 172.21.15.2:0/3012024068 learned_addr learned my addr 172.21.15.2:0/3012024068 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:14:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.911+0000 7f8a77e00700 1 --2- 172.21.15.2:0/3012024068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a78107700 0x7f8a78075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:36.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.911+0000 7f8a77400700 1 -- 172.21.15.2:0/3012024068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a78107700 msgr2=0x7f8a78075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.911+0000 7f8a77400700 1 --2- 172.21.15.2:0/3012024068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a78107700 0x7f8a78075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.911+0000 7f8a77400700 1 -- 172.21.15.2:0/3012024068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78102fd0 msgr2=0x7f8a78074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.911+0000 7f8a77400700 1 --2- 172.21.15.2:0/3012024068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78102fd0 0x7f8a78074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.911+0000 7f8a77400700 1 -- 172.21.15.2:0/3012024068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a781a7160 con 0x7f8a78102620 2024-06-13T02:14:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.911+0000 7f8a77e00700 1 --2- 172.21.15.2:0/3012024068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a78107700 0x7f8a78075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:14:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.911+0000 7f8a77400700 1 --2- 172.21.15.2:0/3012024068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a78102620 0x7f8a78074790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800e9c0 tx=0x7f8a6800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.912+0000 7f8a6fe00700 1 -- 172.21.15.2:0/3012024068 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6800cbd0 con 0x7f8a78102620 2024-06-13T02:14:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.912+0000 7f8a6fe00700 1 -- 172.21.15.2:0/3012024068 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a6800ee60 con 0x7f8a78102620 2024-06-13T02:14:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.912+0000 7f8a7ce00700 1 -- 172.21.15.2:0/3012024068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a781a7450 con 0x7f8a78102620 2024-06-13T02:14:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.912+0000 7f8a6fe00700 1 -- 172.21.15.2:0/3012024068 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68005630 con 0x7f8a78102620 2024-06-13T02:14:36.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.912+0000 7f8a7ce00700 1 -- 172.21.15.2:0/3012024068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a781a7910 con 0x7f8a78102620 2024-06-13T02:14:36.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.913+0000 7f8a7ce00700 1 -- 172.21.15.2:0/3012024068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a78069180 con 0x7f8a78102620 2024-06-13T02:14:36.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.915+0000 7f8a6fe00700 1 -- 172.21.15.2:0/3012024068 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f8a68004830 con 0x7f8a78102620 2024-06-13T02:14:36.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.916+0000 7f8a6fe00700 1 --2- 172.21.15.2:0/3012024068 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f8a5c0a2cb0 0x7f8a5c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:36.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.916+0000 7f8a6fe00700 1 -- 172.21.15.2:0/3012024068 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f8a680cf8d0 con 0x7f8a78102620 2024-06-13T02:14:36.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.917+0000 7f8a76a00700 1 --2- 172.21.15.2:0/3012024068 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f8a5c0a2cb0 0x7f8a5c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:36.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.917+0000 7f8a76a00700 1 --2- 172.21.15.2:0/3012024068 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f8a5c0a2cb0 0x7f8a5c0a5170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009fd0 tx=0x7f8a6401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:36.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:36.920+0000 7f8a6fe00700 1 -- 172.21.15.2:0/3012024068 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8a6800b2c0 con 0x7f8a78102620 2024-06-13T02:14:37.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:36 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:36 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:37.228+0000 7f8a7ce00700 1 -- 172.21.15.2:0/3012024068 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a78075c70 con 0x7f8a78102620 2024-06-13T02:14:37.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:37.229+0000 7f8a6fe00700 1 -- 172.21.15.2:0/3012024068 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11857 (secure 0 0 0) 0x7f8a6809c280 con 0x7f8a78102620 2024-06-13T02:14:37.231 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:14:37.231 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3458450195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3458450195},{"type":"v1","addr":"172.21.15.2:6841","nonce":3458450195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1709394731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1709394731},{"type":"v1","addr":"172.21.15.175:6835","nonce":1709394731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T02:12:43.063161+0000","modified":"2024-06-13T02:14:13.553770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24503,"mds_2":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/2403775181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2403775181},{"type":"v1","addr":"172.21.15.84:6835","nonce":2403775181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/1446546569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1446546569},{"type":"v1","addr":"172.21.15.175:6837","nonce":1446546569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/2537381027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2537381027},{"type":"v1","addr":"172.21.15.84:6837","nonce":2537381027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/2743442301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":2743442301},{"type":"v1","addr":"172.21.15.175:6839","nonce":2743442301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":29,"addr":"172.21.15.2:6839/3208917373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3208917373},{"type":"v1","addr":"172.21.15.2:6839","nonce":3208917373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6839/541041266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":541041266},{"type":"v1","addr":"172.21.15.84:6839","nonce":541041266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24503,24527,24490]},"id":1}]} 2024-06-13T02:14:37.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:37.232+0000 7f8a7ce00700 1 -- 172.21.15.2:0/3012024068 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f8a5c0a2cb0 msgr2=0x7f8a5c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:37.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:37.232+0000 7f8a7ce00700 1 --2- 172.21.15.2:0/3012024068 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f8a5c0a2cb0 0x7f8a5c0a5170 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009fd0 tx=0x7f8a6401a040 comp rx=0 tx=0).stop 2024-06-13T02:14:37.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:37.232+0000 7f8a7ce00700 1 -- 172.21.15.2:0/3012024068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a78102620 msgr2=0x7f8a78074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:37.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:37.232+0000 7f8a7ce00700 1 --2- 172.21.15.2:0/3012024068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a78102620 0x7f8a78074790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800e9c0 tx=0x7f8a6800ecd0 comp rx=0 tx=0).stop 2024-06-13T02:14:37.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:37.233+0000 7f8a7ce00700 1 -- 172.21.15.2:0/3012024068 shutdown_connections 2024-06-13T02:14:37.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:37.233+0000 7f8a7ce00700 1 --2- 172.21.15.2:0/3012024068 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f8a5c0a2cb0 0x7f8a5c0a5170 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:37.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:37.233+0000 7f8a7ce00700 1 --2- 172.21.15.2:0/3012024068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a78107700 0x7f8a78075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:37.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:37.233+0000 7f8a7ce00700 1 --2- 172.21.15.2:0/3012024068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a78102620 0x7f8a78074790 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:37.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:37.233+0000 7f8a7ce00700 1 --2- 172.21.15.2:0/3012024068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a78102fd0 0x7f8a78074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:37.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:37.233+0000 7f8a7ce00700 1 -- 172.21.15.2:0/3012024068 >> 172.21.15.2:0/3012024068 conn(0x7f8a780fdf10 msgr2=0x7f8a78100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:37.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:37.233+0000 7f8a7ce00700 1 -- 172.21.15.2:0/3012024068 shutdown_connections 2024-06-13T02:14:37.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:37.233+0000 7f8a7ce00700 1 -- 172.21.15.2:0/3012024068 wait complete. 2024-06-13T02:14:37.236 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-06-13T02:14:37.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:37.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:36 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:38.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:37 smithi002 ceph-mon[31960]: pgmap v396: 129 pgs: 129 active+clean; 634 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.5 KiB/s wr, 7 op/s; 10 B/s, 0 objects/s recovering 2024-06-13T02:14:38.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:37 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3012024068' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:14:38.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:37 smithi084 ceph-mon[36833]: pgmap v396: 129 pgs: 129 active+clean; 634 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.5 KiB/s wr, 7 op/s; 10 B/s, 0 objects/s recovering 2024-06-13T02:14:38.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:37 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3012024068' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:14:38.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:37 smithi175 ceph-mon[36977]: pgmap v396: 129 pgs: 129 active+clean; 634 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.5 KiB/s wr, 7 op/s; 10 B/s, 0 objects/s recovering 2024-06-13T02:14:38.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:37 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3012024068' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:14:38.630 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T02:14:39.098 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:14:39.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:39 smithi002 ceph-mon[31960]: pgmap v397: 129 pgs: 129 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.7 KiB/s wr, 9 op/s; 9 B/s, 0 objects/s recovering 2024-06-13T02:14:40.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:39 smithi084 ceph-mon[36833]: pgmap v397: 129 pgs: 129 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.7 KiB/s wr, 9 op/s; 9 B/s, 0 objects/s recovering 2024-06-13T02:14:40.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:39 smithi175 ceph-mon[36977]: pgmap v397: 129 pgs: 129 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 3.7 KiB/s wr, 9 op/s; 9 B/s, 0 objects/s recovering 2024-06-13T02:14:41.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.359+0000 7f207d200700 1 -- 172.21.15.2:0/3415382808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f207810ee90 msgr2=0x7f2078111280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:41.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.359+0000 7f207d200700 1 --2- 172.21.15.2:0/3415382808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f207810ee90 0x7f2078111280 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2070009f90 tx=0x7f207000b330 comp rx=0 tx=0).stop 2024-06-13T02:14:41.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.359+0000 7f207d200700 1 -- 172.21.15.2:0/3415382808 shutdown_connections 2024-06-13T02:14:41.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.359+0000 7f207d200700 1 --2- 172.21.15.2:0/3415382808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f207810ee90 0x7f2078111280 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:41.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.359+0000 7f207d200700 1 --2- 172.21.15.2:0/3415382808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20780746c0 0x7f2078074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:41.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.359+0000 7f207d200700 1 --2- 172.21.15.2:0/3415382808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2078074fe0 0x7f207810e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:41.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.359+0000 7f207d200700 1 -- 172.21.15.2:0/3415382808 >> 172.21.15.2:0/3415382808 conn(0x7f2078079640 msgr2=0x7f2078079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:41.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.359+0000 7f207d200700 1 -- 172.21.15.2:0/3415382808 shutdown_connections 2024-06-13T02:14:41.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.359+0000 7f207d200700 1 -- 172.21.15.2:0/3415382808 wait complete. 2024-06-13T02:14:41.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.360+0000 7f207d200700 1 Processor -- start 2024-06-13T02:14:41.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.360+0000 7f207d200700 1 -- start start 2024-06-13T02:14:41.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.361+0000 7f207d200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20780746c0 0x7f207819af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:41.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.361+0000 7f207d200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2078074fe0 0x7f207819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:41.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.361+0000 7f207d200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f207810ee90 0x7f207819f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:41.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.361+0000 7f207d200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2078114a70 con 0x7f2078074fe0 2024-06-13T02:14:41.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.361+0000 7f207d200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f20781148f0 con 0x7f207810ee90 2024-06-13T02:14:41.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.361+0000 7f207d200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2078114bf0 con 0x7f20780746c0 2024-06-13T02:14:41.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.361+0000 7f2075400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2078074fe0 0x7f207819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:41.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.361+0000 7f2075e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20780746c0 0x7f207819af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:41.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.361+0000 7f2075e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20780746c0 0x7f207819af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:60664/0 (socket says 172.21.15.2:60664) 2024-06-13T02:14:41.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.361+0000 7f2076800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f207810ee90 0x7f207819f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:41.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.361+0000 7f2075400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2078074fe0 0x7f207819b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59900/0 (socket says 172.21.15.2:59900) 2024-06-13T02:14:41.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.361+0000 7f2075e00700 1 -- 172.21.15.2:0/4275539960 learned_addr learned my addr 172.21.15.2:0/4275539960 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:14:41.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.362+0000 7f2075e00700 1 -- 172.21.15.2:0/4275539960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f207810ee90 msgr2=0x7f207819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:41.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.362+0000 7f2075e00700 1 --2- 172.21.15.2:0/4275539960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f207810ee90 0x7f207819f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:41.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.362+0000 7f2075e00700 1 -- 172.21.15.2:0/4275539960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2078074fe0 msgr2=0x7f207819b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:41.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.362+0000 7f2075e00700 1 --2- 172.21.15.2:0/4275539960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2078074fe0 0x7f207819b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:41.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.362+0000 7f2075e00700 1 -- 172.21.15.2:0/4275539960 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f207819fee0 con 0x7f20780746c0 2024-06-13T02:14:41.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.362+0000 7f2076800700 1 --2- 172.21.15.2:0/4275539960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f207810ee90 0x7f207819f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:14:41.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.362+0000 7f2075e00700 1 --2- 172.21.15.2:0/4275539960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20780746c0 0x7f207819af20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f206800e9c0 tx=0x7f206800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:41.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.362+0000 7f206ea00700 1 -- 172.21.15.2:0/4275539960 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206800cbd0 con 0x7f20780746c0 2024-06-13T02:14:41.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.363+0000 7f206ea00700 1 -- 172.21.15.2:0/4275539960 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f206800ee50 con 0x7f20780746c0 2024-06-13T02:14:41.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.363+0000 7f207d200700 1 -- 172.21.15.2:0/4275539960 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20781a01d0 con 0x7f20780746c0 2024-06-13T02:14:41.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.363+0000 7f206ea00700 1 -- 172.21.15.2:0/4275539960 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20680055f0 con 0x7f20780746c0 2024-06-13T02:14:41.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.363+0000 7f207d200700 1 -- 172.21.15.2:0/4275539960 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20781a7a50 con 0x7f20780746c0 2024-06-13T02:14:41.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.364+0000 7f207d200700 1 -- 172.21.15.2:0/4275539960 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2078069180 con 0x7f20780746c0 2024-06-13T02:14:41.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.366+0000 7f206ea00700 1 -- 172.21.15.2:0/4275539960 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f2068004750 con 0x7f20780746c0 2024-06-13T02:14:41.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.367+0000 7f206ea00700 1 --2- 172.21.15.2:0/4275539960 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f205c0a2cb0 0x7f205c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:41.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.367+0000 7f206ea00700 1 -- 172.21.15.2:0/4275539960 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f20680cf800 con 0x7f20780746c0 2024-06-13T02:14:41.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.368+0000 7f2075400700 1 --2- 172.21.15.2:0/4275539960 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f205c0a2cb0 0x7f205c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:41.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.369+0000 7f2075400700 1 --2- 172.21.15.2:0/4275539960 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f205c0a2cb0 0x7f205c0a5170 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2078110ac0 tx=0x7f2064009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:41.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.371+0000 7f206ea00700 1 -- 172.21.15.2:0/4275539960 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f206809c1b0 con 0x7f20780746c0 2024-06-13T02:14:41.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:41 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:41.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:41 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:41.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:41 smithi175 ceph-mon[36977]: pgmap v398: 129 pgs: 129 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-06-13T02:14:41.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.606+0000 7f207d200700 1 -- 172.21.15.2:0/4275539960 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20781a7c80 con 0x7f20780746c0 2024-06-13T02:14:41.607 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:41 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:41.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:41 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:41.608 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:41 smithi002 ceph-mon[31960]: pgmap v398: 129 pgs: 129 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-06-13T02:14:41.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.608+0000 7f206ea00700 1 -- 172.21.15.2:0/4275539960 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+24854 (secure 0 0 0) 0x7f206809bab0 con 0x7f20780746c0 2024-06-13T02:14:41.611 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:14:41.611 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":100,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","created":"2024-06-13T02:03:16.412002+0000","modified":"2024-06-13T02:14:25.693752+0000","last_up_change":"2024-06-13T02:11:26.464184+0000","last_in_change":"2024-06-13T02:11:06.957351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T02:07:10.994857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T02:12:34.674172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T02:12:39.213985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T02:12:53.098590+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96b4d494-453c-48aa-b1e2-ee30dfa83e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6803","nonce":3254812126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6805","nonce":3254812126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6809","nonce":3254812126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6807","nonce":3254812126}]},"public_addr":"172.21.15.2:6803/3254812126","cluster_addr":"172.21.15.2:6805/3254812126","heartbeat_back_addr":"172.21.15.2:6809/3254812126","heartbeat_front_addr":"172.21.15.2:6807/3254812126","state":["exists","up"]},{"osd":1,"uuid":"856e86b6-9281-485b-a36b-2fe04de31329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6801","nonce":1593775403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6803","nonce":1593775403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6807","nonce":1593775403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6805","nonce":1593775403}]},"public_addr":"172.21.15.84:6801/1593775403","cluster_addr":"172.21.15.84:6803/1593775403","heartbeat_back_addr":"172.21.15.84:6807/1593775403","heartbeat_front_addr":"172.21.15.84:6805/1593775403","state":["exists","up"]},{"osd":2,"uuid":"8c9daa52-0dfb-471a-afb4-6eb0b908195a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6801","nonce":2174304558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6803","nonce":2174304558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6807","nonce":2174304558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6805","nonce":2174304558}]},"public_addr":"172.21.15.175:6801/2174304558","cluster_addr":"172.21.15.175:6803/2174304558","heartbeat_back_addr":"172.21.15.175:6807/2174304558","heartbeat_front_addr":"172.21.15.175:6805/2174304558","state":["exists","up"]},{"osd":3,"uuid":"2e747d36-4aa5-4c4c-918d-b8100980cc8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6811","nonce":3010864289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6813","nonce":3010864289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6817","nonce":3010864289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6815","nonce":3010864289}]},"public_addr":"172.21.15.2:6811/3010864289","cluster_addr":"172.21.15.2:6813/3010864289","heartbeat_back_addr":"172.21.15.2:6817/3010864289","heartbeat_front_addr":"172.21.15.2:6815/3010864289","state":["exists","up"]},{"osd":4,"uuid":"bd063fb2-1a65-4b18-898c-f80ddc2a1229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6809","nonce":2541323390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6811","nonce":2541323390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6815","nonce":2541323390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6813","nonce":2541323390}]},"public_addr":"172.21.15.84:6809/2541323390","cluster_addr":"172.21.15.84:6811/2541323390","heartbeat_back_addr":"172.21.15.84:6815/2541323390","heartbeat_front_addr":"172.21.15.84:6813/2541323390","state":["exists","up"]},{"osd":5,"uuid":"e0ea80fd-1bfe-4d2e-9733-ff442ec015b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6809","nonce":764262885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6811","nonce":764262885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6815","nonce":764262885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6813","nonce":764262885}]},"public_addr":"172.21.15.175:6809/764262885","cluster_addr":"172.21.15.175:6811/764262885","heartbeat_back_addr":"172.21.15.175:6815/764262885","heartbeat_front_addr":"172.21.15.175:6813/764262885","state":["exists","up"]},{"osd":6,"uuid":"1c204d74-5e48-4e2e-bb98-6a8d4974187c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6819","nonce":297321106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6821","nonce":297321106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6825","nonce":297321106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6823","nonce":297321106}]},"public_addr":"172.21.15.2:6819/297321106","cluster_addr":"172.21.15.2:6821/297321106","heartbeat_back_addr":"172.21.15.2:6825/297321106","heartbeat_front_addr":"172.21.15.2:6823/297321106","state":["exists","up"]},{"osd":7,"uuid":"1299bbb1-fbfb-4aba-be6b-6704691735f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6817","nonce":3873726653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6819","nonce":3873726653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6823","nonce":3873726653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6821","nonce":3873726653}]},"public_addr":"172.21.15.84:6817/3873726653","cluster_addr":"172.21.15.84:6819/3873726653","heartbeat_back_addr":"172.21.15.84:6823/3873726653","heartbeat_front_addr":"172.21.15.84:6821/3873726653","state":["exists","up"]},{"osd":8,"uuid":"9c3f2a92-d956-4246-bce9-620824d0da22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6817","nonce":2622818232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6819","nonce":2622818232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6823","nonce":2622818232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6821","nonce":2622818232}]},"public_addr":"172.21.15.175:6817/2622818232","cluster_addr":"172.21.15.175:6819/2622818232","heartbeat_back_addr":"172.21.15.175:6823/2622818232","heartbeat_front_addr":"172.21.15.175:6821/2622818232","state":["exists","up"]},{"osd":9,"uuid":"e9839f78-05c6-4b3f-bc14-cb771a03ff5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6827","nonce":1171735390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6829","nonce":1171735390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6833","nonce":1171735390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6831","nonce":1171735390}]},"public_addr":"172.21.15.2:6827/1171735390","cluster_addr":"172.21.15.2:6829/1171735390","heartbeat_back_addr":"172.21.15.2:6833/1171735390","heartbeat_front_addr":"172.21.15.2:6831/1171735390","state":["exists","up"]},{"osd":10,"uuid":"66719431-5ba9-4865-957b-f6582e607a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6825","nonce":4269523460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6827","nonce":4269523460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6831","nonce":4269523460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6829","nonce":4269523460}]},"public_addr":"172.21.15.84:6825/4269523460","cluster_addr":"172.21.15.84:6827/4269523460","heartbeat_back_addr":"172.21.15.84:6831/4269523460","heartbeat_front_addr":"172.21.15.84:6829/4269523460","state":["exists","up"]},{"osd":11,"uuid":"1ce6e6ee-6ff3-416f-b985-e3afe503093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6825","nonce":2762894732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6827","nonce":2762894732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6831","nonce":2762894732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6829","nonce":2762894732}]},"public_addr":"172.21.15.175:6825/2762894732","cluster_addr":"172.21.15.175:6827/2762894732","heartbeat_back_addr":"172.21.15.175:6831/2762894732","heartbeat_front_addr":"172.21.15.175:6829/2762894732","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:16.956638+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:42.268685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:06.272084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:39.696927+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:06.182991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:31.626603+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:05.247728+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:31.985114+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:57.474180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:31.988863+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:59.683056+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:11:24.493248+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6800/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3397168014":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/1789744365":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3831398703":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/3119270562":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/2163302458":"2024-06-14T02:03:50.073572+0000","172.21.15.2:6800/2830681579":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/1678672435":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6801/2830681579":"2024-06-14T02:03:50.073572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T02:14:41.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.611+0000 7f207d200700 1 -- 172.21.15.2:0/4275539960 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f205c0a2cb0 msgr2=0x7f205c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:41.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.611+0000 7f207d200700 1 --2- 172.21.15.2:0/4275539960 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f205c0a2cb0 0x7f205c0a5170 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2078110ac0 tx=0x7f2064009310 comp rx=0 tx=0).stop 2024-06-13T02:14:41.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.611+0000 7f207d200700 1 -- 172.21.15.2:0/4275539960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20780746c0 msgr2=0x7f207819af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:41.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.611+0000 7f207d200700 1 --2- 172.21.15.2:0/4275539960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20780746c0 0x7f207819af20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f206800e9c0 tx=0x7f206800ecd0 comp rx=0 tx=0).stop 2024-06-13T02:14:41.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.612+0000 7f207d200700 1 -- 172.21.15.2:0/4275539960 shutdown_connections 2024-06-13T02:14:41.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.612+0000 7f207d200700 1 --2- 172.21.15.2:0/4275539960 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f205c0a2cb0 0x7f205c0a5170 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:41.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.612+0000 7f207d200700 1 --2- 172.21.15.2:0/4275539960 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f207810ee90 0x7f207819f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:41.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.612+0000 7f207d200700 1 --2- 172.21.15.2:0/4275539960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20780746c0 0x7f207819af20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:41.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.612+0000 7f207d200700 1 --2- 172.21.15.2:0/4275539960 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2078074fe0 0x7f207819b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:41.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.612+0000 7f207d200700 1 -- 172.21.15.2:0/4275539960 >> 172.21.15.2:0/4275539960 conn(0x7f2078079640 msgr2=0x7f2078100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:41.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.612+0000 7f207d200700 1 -- 172.21.15.2:0/4275539960 shutdown_connections 2024-06-13T02:14:41.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:41.612+0000 7f207d200700 1 -- 172.21.15.2:0/4275539960 wait complete. 2024-06-13T02:14:41.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:41 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:41.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:41 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:41.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:41 smithi084 ceph-mon[36833]: pgmap v398: 129 pgs: 129 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-06-13T02:14:42.414 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-13T02:14:42.415 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph pg dump --format=json 2024-06-13T02:14:42.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:42 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/4275539960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:14:42.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:14:42.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:14:42.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:42.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:42 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/4275539960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:14:42.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:14:42.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:14:42.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:42.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:42 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/4275539960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:14:42.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:14:42.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:14:42.783 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:14:42.913 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:14:43.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:43 smithi002 ceph-mon[31960]: pgmap v399: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-06-13T02:14:43.684 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:43 smithi175 ceph-mon[36977]: pgmap v399: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-06-13T02:14:43.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:43 smithi084 ceph-mon[36833]: pgmap v399: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-06-13T02:14:45.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.003+0000 7f83cb200700 1 -- 172.21.15.2:0/3402586440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83cc06b610 msgr2=0x7f83cc107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:45.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.003+0000 7f83cb200700 1 --2- 172.21.15.2:0/3402586440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83cc06b610 0x7f83cc107090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009990 tx=0x7f83b8009ca0 comp rx=0 tx=0).stop 2024-06-13T02:14:45.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.003+0000 7f83cb200700 1 -- 172.21.15.2:0/3402586440 shutdown_connections 2024-06-13T02:14:45.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.003+0000 7f83cb200700 1 --2- 172.21.15.2:0/3402586440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc1077c0 0x7f83cc10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:45.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.003+0000 7f83cb200700 1 --2- 172.21.15.2:0/3402586440 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc06ac60 0x7f83cc06b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:45.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.003+0000 7f83cb200700 1 --2- 172.21.15.2:0/3402586440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83cc06b610 0x7f83cc107090 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:45.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.003+0000 7f83cb200700 1 -- 172.21.15.2:0/3402586440 >> 172.21.15.2:0/3402586440 conn(0x7f83cc0781d0 msgr2=0x7f83cc0785e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:45.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.003+0000 7f83cb200700 1 -- 172.21.15.2:0/3402586440 shutdown_connections 2024-06-13T02:14:45.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.003+0000 7f83cb200700 1 -- 172.21.15.2:0/3402586440 wait complete. 2024-06-13T02:14:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.004+0000 7f83cb200700 1 Processor -- start 2024-06-13T02:14:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.005+0000 7f83cb200700 1 -- start start 2024-06-13T02:14:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.005+0000 7f83cb200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc06ac60 0x7f83cc19adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.005+0000 7f83cb200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc06b610 0x7f83cc19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.005+0000 7f83cb200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83cc1077c0 0x7f83cc19f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:45.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.005+0000 7f83cb200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc1126b0 con 0x7f83cc06b610 2024-06-13T02:14:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.005+0000 7f83cb200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc112530 con 0x7f83cc06ac60 2024-06-13T02:14:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.005+0000 7f83cb200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc112830 con 0x7f83cc1077c0 2024-06-13T02:14:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.005+0000 7f83c9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc06ac60 0x7f83cc19adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.005+0000 7f83c9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc06ac60 0x7f83cc19adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:58570/0 (socket says 172.21.15.2:58570) 2024-06-13T02:14:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.005+0000 7f83c9e00700 1 -- 172.21.15.2:0/2058516111 learned_addr learned my addr 172.21.15.2:0/2058516111 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:14:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.005+0000 7f83c9400700 1 --2- 172.21.15.2:0/2058516111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc06b610 0x7f83cc19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.006+0000 7f83ca800700 1 --2- 172.21.15.2:0/2058516111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83cc1077c0 0x7f83cc19f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.006+0000 7f83c9e00700 1 -- 172.21.15.2:0/2058516111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83cc1077c0 msgr2=0x7f83cc19f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.006+0000 7f83c9e00700 1 --2- 172.21.15.2:0/2058516111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83cc1077c0 0x7f83cc19f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.006+0000 7f83c9e00700 1 -- 172.21.15.2:0/2058516111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc06b610 msgr2=0x7f83cc19b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.006+0000 7f83c9e00700 1 --2- 172.21.15.2:0/2058516111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc06b610 0x7f83cc19b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:45.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.006+0000 7f83c9e00700 1 -- 172.21.15.2:0/2058516111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc19fdc0 con 0x7f83cc06ac60 2024-06-13T02:14:45.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.006+0000 7f83c9e00700 1 --2- 172.21.15.2:0/2058516111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc06ac60 0x7f83cc19adb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00e9a0 tx=0x7f83bc00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:45.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.006+0000 7f83c2a00700 1 -- 172.21.15.2:0/2058516111 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00ca10 con 0x7f83cc06ac60 2024-06-13T02:14:45.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.007+0000 7f83c2a00700 1 -- 172.21.15.2:0/2058516111 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83bc00cbb0 con 0x7f83cc06ac60 2024-06-13T02:14:45.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.007+0000 7f83c2a00700 1 -- 172.21.15.2:0/2058516111 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc018680 con 0x7f83cc06ac60 2024-06-13T02:14:45.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.007+0000 7f83cb200700 1 -- 172.21.15.2:0/2058516111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83cc1a00b0 con 0x7f83cc06ac60 2024-06-13T02:14:45.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.007+0000 7f83cb200700 1 -- 172.21.15.2:0/2058516111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83cc1a7930 con 0x7f83cc06ac60 2024-06-13T02:14:45.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.008+0000 7f83cb200700 1 -- 172.21.15.2:0/2058516111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83cc069180 con 0x7f83cc06ac60 2024-06-13T02:14:45.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.010+0000 7f83c2a00700 1 -- 172.21.15.2:0/2058516111 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f83bc010430 con 0x7f83cc06ac60 2024-06-13T02:14:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.011+0000 7f83c2a00700 1 --2- 172.21.15.2:0/2058516111 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f83b00a2d30 0x7f83b00a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.013+0000 7f83c2a00700 1 -- 172.21.15.2:0/2058516111 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f83bc0cfc90 con 0x7f83cc06ac60 2024-06-13T02:14:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.013+0000 7f83c9400700 1 --2- 172.21.15.2:0/2058516111 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f83b00a2d30 0x7f83b00a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:45.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.013+0000 7f83c9400700 1 --2- 172.21.15.2:0/2058516111 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f83b00a2d30 0x7f83b00a51f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f83b8006010 tx=0x7f83b8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:45.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.013+0000 7f83c2a00700 1 -- 172.21.15.2:0/2058516111 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f83bc09c640 con 0x7f83cc06ac60 2024-06-13T02:14:45.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.237+0000 7f83cb200700 1 -- 172.21.15.2:0/2058516111 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83cc101560 con 0x7f83b00a2d30 2024-06-13T02:14:45.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.252+0000 7f83c2a00700 1 -- 172.21.15.2:0/2058516111 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340511 (secure 0 0 0) 0x7f83b8079230 con 0x7f83b00a2d30 2024-06-13T02:14:45.259 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:14:45.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.257+0000 7f83cb200700 1 -- 172.21.15.2:0/2058516111 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f83b00a2d30 msgr2=0x7f83b00a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:45.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.257+0000 7f83cb200700 1 --2- 172.21.15.2:0/2058516111 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f83b00a2d30 0x7f83b00a51f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f83b8006010 tx=0x7f83b8005960 comp rx=0 tx=0).stop 2024-06-13T02:14:45.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.257+0000 7f83cb200700 1 -- 172.21.15.2:0/2058516111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc06ac60 msgr2=0x7f83cc19adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:45.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.257+0000 7f83cb200700 1 --2- 172.21.15.2:0/2058516111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc06ac60 0x7f83cc19adb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00e9a0 tx=0x7f83bc00ecb0 comp rx=0 tx=0).stop 2024-06-13T02:14:45.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.257+0000 7f83cb200700 1 -- 172.21.15.2:0/2058516111 shutdown_connections 2024-06-13T02:14:45.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.257+0000 7f83cb200700 1 --2- 172.21.15.2:0/2058516111 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f83b00a2d30 0x7f83b00a51f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:45.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.257+0000 7f83cb200700 1 --2- 172.21.15.2:0/2058516111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83cc1077c0 0x7f83cc19f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:45.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.257+0000 7f83cb200700 1 --2- 172.21.15.2:0/2058516111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f83cc06ac60 0x7f83cc19adb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:45.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.257+0000 7f83cb200700 1 --2- 172.21.15.2:0/2058516111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f83cc06b610 0x7f83cc19b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:45.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.257+0000 7f83cb200700 1 -- 172.21.15.2:0/2058516111 >> 172.21.15.2:0/2058516111 conn(0x7f83cc0781d0 msgr2=0x7f83cc100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:45.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.258+0000 7f83cb200700 1 -- 172.21.15.2:0/2058516111 shutdown_connections 2024-06-13T02:14:45.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:45.258+0000 7f83cb200700 1 -- 172.21.15.2:0/2058516111 wait complete. 2024-06-13T02:14:45.263 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-06-13T02:14:45.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:45 smithi002 ceph-mon[31960]: pgmap v400: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-13T02:14:45.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:45 smithi084 ceph-mon[36833]: pgmap v400: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-13T02:14:46.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:45 smithi175 ceph-mon[36977]: pgmap v400: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-13T02:14:46.086 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":400,"stamp":"2024-06-13T02:14:44.487769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658270,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":361,"num_read_kb":301,"num_write":354,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":284,"ondisk_log_size":284,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377192,"kb_used_data":15532,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124564632,"statfs":{"total":1151940427776,"available":1151554183168,"internally_reserved":0,"allocated":15904768,"data_stored":8823591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9200,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":77,"num_read_kb":45,"num_write":13,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005729"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.717179+0000","last_change":"2024-06-13T02:12:40.307929+0000","last_active":"2024-06-13T02:14:25.717179+0000","last_peered":"2024-06-13T02:14:25.717179+0000","last_clean":"2024-06-13T02:14:25.717179+0000","last_became_active":"2024-06-13T02:12:40.307353+0000","last_became_peered":"2024-06-13T02:12:40.307353+0000","last_unstale":"2024-06-13T02:14:25.717179+0000","last_undegraded":"2024-06-13T02:14:25.717179+0000","last_fullsized":"2024-06-13T02:14:25.717179+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:43:19.850829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716980+0000","last_change":"2024-06-13T02:12:40.304715+0000","last_active":"2024-06-13T02:14:25.716980+0000","last_peered":"2024-06-13T02:14:25.716980+0000","last_clean":"2024-06-13T02:14:25.716980+0000","last_became_active":"2024-06-13T02:12:40.304216+0000","last_became_peered":"2024-06-13T02:12:40.304216+0000","last_unstale":"2024-06-13T02:14:25.716980+0000","last_undegraded":"2024-06-13T02:14:25.716980+0000","last_fullsized":"2024-06-13T02:14:25.716980+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:39:02.340749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715298+0000","last_change":"2024-06-13T02:12:40.303576+0000","last_active":"2024-06-13T02:14:25.715298+0000","last_peered":"2024-06-13T02:14:25.715298+0000","last_clean":"2024-06-13T02:14:25.715298+0000","last_became_active":"2024-06-13T02:12:40.303225+0000","last_became_peered":"2024-06-13T02:12:40.303225+0000","last_unstale":"2024-06-13T02:14:25.715298+0000","last_undegraded":"2024-06-13T02:14:25.715298+0000","last_fullsized":"2024-06-13T02:14:25.715298+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:54:17.144856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740616+0000","last_change":"2024-06-13T02:12:40.298405+0000","last_active":"2024-06-13T02:14:25.740616+0000","last_peered":"2024-06-13T02:14:25.740616+0000","last_clean":"2024-06-13T02:14:25.740616+0000","last_became_active":"2024-06-13T02:12:40.297742+0000","last_became_peered":"2024-06-13T02:12:40.297742+0000","last_unstale":"2024-06-13T02:14:25.740616+0000","last_undegraded":"2024-06-13T02:14:25.740616+0000","last_fullsized":"2024-06-13T02:14:25.740616+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:23:12.417602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715337+0000","last_change":"2024-06-13T02:12:40.318679+0000","last_active":"2024-06-13T02:14:25.715337+0000","last_peered":"2024-06-13T02:14:25.715337+0000","last_clean":"2024-06-13T02:14:25.715337+0000","last_became_active":"2024-06-13T02:12:40.318313+0000","last_became_peered":"2024-06-13T02:12:40.318313+0000","last_unstale":"2024-06-13T02:14:25.715337+0000","last_undegraded":"2024-06-13T02:14:25.715337+0000","last_fullsized":"2024-06-13T02:14:25.715337+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:36:30.580012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.107486+0000","last_change":"2024-06-13T02:13:25.537913+0000","last_active":"2024-06-13T02:14:26.107486+0000","last_peered":"2024-06-13T02:14:26.107486+0000","last_clean":"2024-06-13T02:14:26.107486+0000","last_became_active":"2024-06-13T02:13:25.537509+0000","last_became_peered":"2024-06-13T02:13:25.537509+0000","last_unstale":"2024-06-13T02:14:26.107486+0000","last_undegraded":"2024-06-13T02:14:26.107486+0000","last_fullsized":"2024-06-13T02:14:26.107486+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:54:04.905051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236292+0000","last_change":"2024-06-13T02:12:40.304737+0000","last_active":"2024-06-13T02:14:26.236292+0000","last_peered":"2024-06-13T02:14:26.236292+0000","last_clean":"2024-06-13T02:14:26.236292+0000","last_became_active":"2024-06-13T02:12:40.304239+0000","last_became_peered":"2024-06-13T02:12:40.304239+0000","last_unstale":"2024-06-13T02:14:26.236292+0000","last_undegraded":"2024-06-13T02:14:26.236292+0000","last_fullsized":"2024-06-13T02:14:26.236292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:09:23.403816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.738965+0000","last_change":"2024-06-13T02:12:40.317542+0000","last_active":"2024-06-13T02:14:26.738965+0000","last_peered":"2024-06-13T02:14:26.738965+0000","last_clean":"2024-06-13T02:14:26.738965+0000","last_became_active":"2024-06-13T02:12:40.317140+0000","last_became_peered":"2024-06-13T02:12:40.317140+0000","last_unstale":"2024-06-13T02:14:26.738965+0000","last_undegraded":"2024-06-13T02:14:26.738965+0000","last_fullsized":"2024-06-13T02:14:26.738965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:01:19.812336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.737339+0000","last_change":"2024-06-13T02:12:40.295445+0000","last_active":"2024-06-13T02:14:26.737339+0000","last_peered":"2024-06-13T02:14:26.737339+0000","last_clean":"2024-06-13T02:14:26.737339+0000","last_became_active":"2024-06-13T02:12:40.293498+0000","last_became_peered":"2024-06-13T02:12:40.293498+0000","last_unstale":"2024-06-13T02:14:26.737339+0000","last_undegraded":"2024-06-13T02:14:26.737339+0000","last_fullsized":"2024-06-13T02:14:26.737339+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:43:48.487157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.107795+0000","last_change":"2024-06-13T02:12:40.294665+0000","last_active":"2024-06-13T02:14:26.107795+0000","last_peered":"2024-06-13T02:14:26.107795+0000","last_clean":"2024-06-13T02:14:26.107795+0000","last_became_active":"2024-06-13T02:12:40.294339+0000","last_became_peered":"2024-06-13T02:12:40.294339+0000","last_unstale":"2024-06-13T02:14:26.107795+0000","last_undegraded":"2024-06-13T02:14:26.107795+0000","last_fullsized":"2024-06-13T02:14:26.107795+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:15:58.703675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236765+0000","last_change":"2024-06-13T02:12:40.294867+0000","last_active":"2024-06-13T02:14:26.236765+0000","last_peered":"2024-06-13T02:14:26.236765+0000","last_clean":"2024-06-13T02:14:26.236765+0000","last_became_active":"2024-06-13T02:12:40.293665+0000","last_became_peered":"2024-06-13T02:12:40.293665+0000","last_unstale":"2024-06-13T02:14:26.236765+0000","last_undegraded":"2024-06-13T02:14:26.236765+0000","last_fullsized":"2024-06-13T02:14:26.236765+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:52:02.171738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740459+0000","last_change":"2024-06-13T02:12:40.296253+0000","last_active":"2024-06-13T02:14:25.740459+0000","last_peered":"2024-06-13T02:14:25.740459+0000","last_clean":"2024-06-13T02:14:25.740459+0000","last_became_active":"2024-06-13T02:12:40.295932+0000","last_became_peered":"2024-06-13T02:12:40.295932+0000","last_unstale":"2024-06-13T02:14:25.740459+0000","last_undegraded":"2024-06-13T02:14:25.740459+0000","last_fullsized":"2024-06-13T02:14:25.740459+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:41:07.044402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719184+0000","last_change":"2024-06-13T02:12:40.288976+0000","last_active":"2024-06-13T02:14:25.719184+0000","last_peered":"2024-06-13T02:14:25.719184+0000","last_clean":"2024-06-13T02:14:25.719184+0000","last_became_active":"2024-06-13T02:12:40.288629+0000","last_became_peered":"2024-06-13T02:12:40.288629+0000","last_unstale":"2024-06-13T02:14:25.719184+0000","last_undegraded":"2024-06-13T02:14:25.719184+0000","last_fullsized":"2024-06-13T02:14:25.719184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:10:49.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.713418+0000","last_change":"2024-06-13T02:12:40.304020+0000","last_active":"2024-06-13T02:14:25.713418+0000","last_peered":"2024-06-13T02:14:25.713418+0000","last_clean":"2024-06-13T02:14:25.713418+0000","last_became_active":"2024-06-13T02:12:40.303671+0000","last_became_peered":"2024-06-13T02:12:40.303671+0000","last_unstale":"2024-06-13T02:14:25.713418+0000","last_undegraded":"2024-06-13T02:14:25.713418+0000","last_fullsized":"2024-06-13T02:14:25.713418+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:28:15.907085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.713835+0000","last_change":"2024-06-13T02:12:40.309501+0000","last_active":"2024-06-13T02:14:25.713835+0000","last_peered":"2024-06-13T02:14:25.713835+0000","last_clean":"2024-06-13T02:14:25.713835+0000","last_became_active":"2024-06-13T02:12:40.304938+0000","last_became_peered":"2024-06-13T02:12:40.304938+0000","last_unstale":"2024-06-13T02:14:25.713835+0000","last_undegraded":"2024-06-13T02:14:25.713835+0000","last_fullsized":"2024-06-13T02:14:25.713835+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:59:56.164448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.736640+0000","last_change":"2024-06-13T02:12:40.306574+0000","last_active":"2024-06-13T02:14:26.736640+0000","last_peered":"2024-06-13T02:14:26.736640+0000","last_clean":"2024-06-13T02:14:26.736640+0000","last_became_active":"2024-06-13T02:12:40.306227+0000","last_became_peered":"2024-06-13T02:12:40.306227+0000","last_unstale":"2024-06-13T02:14:26.736640+0000","last_undegraded":"2024-06-13T02:14:26.736640+0000","last_fullsized":"2024-06-13T02:14:26.736640+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:55:23.456256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716876+0000","last_change":"2024-06-13T02:12:40.308291+0000","last_active":"2024-06-13T02:14:25.716876+0000","last_peered":"2024-06-13T02:14:25.716876+0000","last_clean":"2024-06-13T02:14:25.716876+0000","last_became_active":"2024-06-13T02:12:40.307626+0000","last_became_peered":"2024-06-13T02:12:40.307626+0000","last_unstale":"2024-06-13T02:14:25.716876+0000","last_undegraded":"2024-06-13T02:14:25.716876+0000","last_fullsized":"2024-06-13T02:14:25.716876+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:16:47.025364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.721186+0000","last_change":"2024-06-13T02:12:40.308249+0000","last_active":"2024-06-13T02:14:25.721186+0000","last_peered":"2024-06-13T02:14:25.721186+0000","last_clean":"2024-06-13T02:14:25.721186+0000","last_became_active":"2024-06-13T02:12:40.303871+0000","last_became_peered":"2024-06-13T02:12:40.303871+0000","last_unstale":"2024-06-13T02:14:25.721186+0000","last_undegraded":"2024-06-13T02:14:25.721186+0000","last_fullsized":"2024-06-13T02:14:25.721186+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:27:05.852927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719100+0000","last_change":"2024-06-13T02:12:40.320970+0000","last_active":"2024-06-13T02:14:25.719100+0000","last_peered":"2024-06-13T02:14:25.719100+0000","last_clean":"2024-06-13T02:14:25.719100+0000","last_became_active":"2024-06-13T02:12:40.320537+0000","last_became_peered":"2024-06-13T02:12:40.320537+0000","last_unstale":"2024-06-13T02:14:25.719100+0000","last_undegraded":"2024-06-13T02:14:25.719100+0000","last_fullsized":"2024-06-13T02:14:25.719100+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:39:44.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719530+0000","last_change":"2024-06-13T02:12:54.594504+0000","last_active":"2024-06-13T02:14:25.719530+0000","last_peered":"2024-06-13T02:14:25.719530+0000","last_clean":"2024-06-13T02:14:25.719530+0000","last_became_active":"2024-06-13T02:12:54.594083+0000","last_became_peered":"2024-06-13T02:12:54.594083+0000","last_unstale":"2024-06-13T02:14:25.719530+0000","last_undegraded":"2024-06-13T02:14:25.719530+0000","last_fullsized":"2024-06-13T02:14:25.719530+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:40:11.592477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"98'9","reported_seq":55,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720880+0000","last_change":"2024-06-13T02:12:35.820414+0000","last_active":"2024-06-13T02:14:25.720880+0000","last_peered":"2024-06-13T02:14:25.720880+0000","last_clean":"2024-06-13T02:14:25.720880+0000","last_became_active":"2024-06-13T02:12:35.819320+0000","last_became_peered":"2024-06-13T02:12:35.819320+0000","last_unstale":"2024-06-13T02:14:25.720880+0000","last_undegraded":"2024-06-13T02:14:25.720880+0000","last_fullsized":"2024-06-13T02:14:25.720880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:02:44.226482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.740666+0000","last_change":"2024-06-13T02:12:40.317221+0000","last_active":"2024-06-13T02:14:26.740666+0000","last_peered":"2024-06-13T02:14:26.740666+0000","last_clean":"2024-06-13T02:14:26.740666+0000","last_became_active":"2024-06-13T02:12:40.315069+0000","last_became_peered":"2024-06-13T02:12:40.315069+0000","last_unstale":"2024-06-13T02:14:26.740666+0000","last_undegraded":"2024-06-13T02:14:26.740666+0000","last_fullsized":"2024-06-13T02:14:26.740666+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:44:36.577914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740578+0000","last_change":"2024-06-13T02:12:54.600490+0000","last_active":"2024-06-13T02:14:25.740578+0000","last_peered":"2024-06-13T02:14:25.740578+0000","last_clean":"2024-06-13T02:14:25.740578+0000","last_became_active":"2024-06-13T02:12:54.600192+0000","last_became_peered":"2024-06-13T02:12:54.600192+0000","last_unstale":"2024-06-13T02:14:25.740578+0000","last_undegraded":"2024-06-13T02:14:25.740578+0000","last_fullsized":"2024-06-13T02:14:25.740578+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:46:10.782977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"98'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.741163+0000","last_change":"2024-06-13T02:12:36.306113+0000","last_active":"2024-06-13T02:14:26.741163+0000","last_peered":"2024-06-13T02:14:26.741163+0000","last_clean":"2024-06-13T02:14:26.741163+0000","last_became_active":"2024-06-13T02:12:36.298787+0000","last_became_peered":"2024-06-13T02:12:36.298787+0000","last_unstale":"2024-06-13T02:14:26.741163+0000","last_undegraded":"2024-06-13T02:14:26.741163+0000","last_fullsized":"2024-06-13T02:14:26.741163+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:29:00.902574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716981+0000","last_change":"2024-06-13T02:12:40.314925+0000","last_active":"2024-06-13T02:14:25.716981+0000","last_peered":"2024-06-13T02:14:25.716981+0000","last_clean":"2024-06-13T02:14:25.716981+0000","last_became_active":"2024-06-13T02:12:40.312668+0000","last_became_peered":"2024-06-13T02:12:40.312668+0000","last_unstale":"2024-06-13T02:14:25.716981+0000","last_undegraded":"2024-06-13T02:14:25.716981+0000","last_fullsized":"2024-06-13T02:14:25.716981+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:47:42.896414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740147+0000","last_change":"2024-06-13T02:12:54.593653+0000","last_active":"2024-06-13T02:14:25.740147+0000","last_peered":"2024-06-13T02:14:25.740147+0000","last_clean":"2024-06-13T02:14:25.740147+0000","last_became_active":"2024-06-13T02:12:54.593250+0000","last_became_peered":"2024-06-13T02:12:54.593250+0000","last_unstale":"2024-06-13T02:14:25.740147+0000","last_undegraded":"2024-06-13T02:14:25.740147+0000","last_fullsized":"2024-06-13T02:14:25.740147+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:29:45.233850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"98'4","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715988+0000","last_change":"2024-06-13T02:12:35.809925+0000","last_active":"2024-06-13T02:14:25.715988+0000","last_peered":"2024-06-13T02:14:25.715988+0000","last_clean":"2024-06-13T02:14:25.715988+0000","last_became_active":"2024-06-13T02:12:35.809536+0000","last_became_peered":"2024-06-13T02:12:35.809536+0000","last_unstale":"2024-06-13T02:14:25.715988+0000","last_undegraded":"2024-06-13T02:14:25.715988+0000","last_fullsized":"2024-06-13T02:14:25.715988+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:41:46.322004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.736981+0000","last_change":"2024-06-13T02:12:40.299911+0000","last_active":"2024-06-13T02:14:26.736981+0000","last_peered":"2024-06-13T02:14:26.736981+0000","last_clean":"2024-06-13T02:14:26.736981+0000","last_became_active":"2024-06-13T02:12:40.298762+0000","last_became_peered":"2024-06-13T02:12:40.298762+0000","last_unstale":"2024-06-13T02:14:26.736981+0000","last_undegraded":"2024-06-13T02:14:26.736981+0000","last_fullsized":"2024-06-13T02:14:26.736981+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:52:43.996050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740096+0000","last_change":"2024-06-13T02:12:54.602831+0000","last_active":"2024-06-13T02:14:25.740096+0000","last_peered":"2024-06-13T02:14:25.740096+0000","last_clean":"2024-06-13T02:14:25.740096+0000","last_became_active":"2024-06-13T02:12:54.602406+0000","last_became_peered":"2024-06-13T02:12:54.602406+0000","last_unstale":"2024-06-13T02:14:25.740096+0000","last_undegraded":"2024-06-13T02:14:25.740096+0000","last_fullsized":"2024-06-13T02:14:25.740096+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:01:02.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715642+0000","last_change":"2024-06-13T02:12:35.808961+0000","last_active":"2024-06-13T02:14:25.715642+0000","last_peered":"2024-06-13T02:14:25.715642+0000","last_clean":"2024-06-13T02:14:25.715642+0000","last_became_active":"2024-06-13T02:12:35.808277+0000","last_became_peered":"2024-06-13T02:12:35.808277+0000","last_unstale":"2024-06-13T02:14:25.715642+0000","last_undegraded":"2024-06-13T02:14:25.715642+0000","last_fullsized":"2024-06-13T02:14:25.715642+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:38:54.356186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475561+0000","last_change":"2024-06-13T02:12:40.295392+0000","last_active":"2024-06-13T02:14:26.475561+0000","last_peered":"2024-06-13T02:14:26.475561+0000","last_clean":"2024-06-13T02:14:26.475561+0000","last_became_active":"2024-06-13T02:12:40.295052+0000","last_became_peered":"2024-06-13T02:12:40.295052+0000","last_unstale":"2024-06-13T02:14:26.475561+0000","last_undegraded":"2024-06-13T02:14:26.475561+0000","last_fullsized":"2024-06-13T02:14:26.475561+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:12:38.728062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.718908+0000","last_change":"2024-06-13T02:12:54.582150+0000","last_active":"2024-06-13T02:14:25.718908+0000","last_peered":"2024-06-13T02:14:25.718908+0000","last_clean":"2024-06-13T02:14:25.718908+0000","last_became_active":"2024-06-13T02:12:54.581734+0000","last_became_peered":"2024-06-13T02:12:54.581734+0000","last_unstale":"2024-06-13T02:14:25.718908+0000","last_undegraded":"2024-06-13T02:14:25.718908+0000","last_fullsized":"2024-06-13T02:14:25.718908+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:34:28.143198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"98'5","reported_seq":85,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:41.665165+0000","last_change":"2024-06-13T02:12:35.810286+0000","last_active":"2024-06-13T02:14:41.665165+0000","last_peered":"2024-06-13T02:14:41.665165+0000","last_clean":"2024-06-13T02:14:41.665165+0000","last_became_active":"2024-06-13T02:12:35.809910+0000","last_became_peered":"2024-06-13T02:12:35.809910+0000","last_unstale":"2024-06-13T02:14:41.665165+0000","last_undegraded":"2024-06-13T02:14:41.665165+0000","last_fullsized":"2024-06-13T02:14:41.665165+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:09:10.438115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715364+0000","last_change":"2024-06-13T02:13:25.643735+0000","last_active":"2024-06-13T02:14:25.715364+0000","last_peered":"2024-06-13T02:14:25.715364+0000","last_clean":"2024-06-13T02:14:25.715364+0000","last_became_active":"2024-06-13T02:13:25.643406+0000","last_became_peered":"2024-06-13T02:13:25.643406+0000","last_unstale":"2024-06-13T02:14:25.715364+0000","last_undegraded":"2024-06-13T02:14:25.715364+0000","last_fullsized":"2024-06-13T02:14:25.715364+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:20:17.267712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.476695+0000","last_change":"2024-06-13T02:14:26.476695+0000","last_active":"2024-06-13T02:14:26.476695+0000","last_peered":"2024-06-13T02:14:26.476695+0000","last_clean":"2024-06-13T02:14:26.476695+0000","last_became_active":"2024-06-13T02:14:26.476129+0000","last_became_peered":"2024-06-13T02:14:26.476129+0000","last_unstale":"2024-06-13T02:14:26.476695+0000","last_undegraded":"2024-06-13T02:14:26.476695+0000","last_fullsized":"2024-06-13T02:14:26.476695+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:00:39.577682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,10,5],"acting":[2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"98'3","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.107437+0000","last_change":"2024-06-13T02:12:35.817613+0000","last_active":"2024-06-13T02:14:26.107437+0000","last_peered":"2024-06-13T02:14:26.107437+0000","last_clean":"2024-06-13T02:14:26.107437+0000","last_became_active":"2024-06-13T02:12:35.817217+0000","last_became_peered":"2024-06-13T02:12:35.817217+0000","last_unstale":"2024-06-13T02:14:26.107437+0000","last_undegraded":"2024-06-13T02:14:26.107437+0000","last_fullsized":"2024-06-13T02:14:26.107437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:40:06.195493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475526+0000","last_change":"2024-06-13T02:13:25.538088+0000","last_active":"2024-06-13T02:14:26.475526+0000","last_peered":"2024-06-13T02:14:26.475526+0000","last_clean":"2024-06-13T02:14:26.475526+0000","last_became_active":"2024-06-13T02:13:25.537693+0000","last_became_peered":"2024-06-13T02:13:25.537693+0000","last_unstale":"2024-06-13T02:14:26.475526+0000","last_undegraded":"2024-06-13T02:14:26.475526+0000","last_fullsized":"2024-06-13T02:14:26.475526+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:52:59.032383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":35,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.742320+0000","last_change":"2024-06-13T02:14:25.742320+0000","last_active":"2024-06-13T02:14:25.742320+0000","last_peered":"2024-06-13T02:14:25.742320+0000","last_clean":"2024-06-13T02:14:25.742320+0000","last_became_active":"2024-06-13T02:14:25.741736+0000","last_became_peered":"2024-06-13T02:14:25.741736+0000","last_unstale":"2024-06-13T02:14:25.742320+0000","last_undegraded":"2024-06-13T02:14:25.742320+0000","last_fullsized":"2024-06-13T02:14:25.742320+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:16:53.587795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"98'2","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.718159+0000","last_change":"2024-06-13T02:12:35.824235+0000","last_active":"2024-06-13T02:14:25.718159+0000","last_peered":"2024-06-13T02:14:25.718159+0000","last_clean":"2024-06-13T02:14:25.718159+0000","last_became_active":"2024-06-13T02:12:35.821506+0000","last_became_peered":"2024-06-13T02:12:35.821506+0000","last_unstale":"2024-06-13T02:14:25.718159+0000","last_undegraded":"2024-06-13T02:14:25.718159+0000","last_fullsized":"2024-06-13T02:14:25.718159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:58:39.808001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739440+0000","last_change":"2024-06-13T02:12:40.324580+0000","last_active":"2024-06-13T02:14:26.739440+0000","last_peered":"2024-06-13T02:14:26.739440+0000","last_clean":"2024-06-13T02:14:26.739440+0000","last_became_active":"2024-06-13T02:12:40.323791+0000","last_became_peered":"2024-06-13T02:12:40.323791+0000","last_unstale":"2024-06-13T02:14:26.739440+0000","last_undegraded":"2024-06-13T02:14:26.739440+0000","last_fullsized":"2024-06-13T02:14:26.739440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:29:14.169270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715558+0000","last_change":"2024-06-13T02:12:54.602305+0000","last_active":"2024-06-13T02:14:25.715558+0000","last_peered":"2024-06-13T02:14:25.715558+0000","last_clean":"2024-06-13T02:14:25.715558+0000","last_became_active":"2024-06-13T02:12:54.601787+0000","last_became_peered":"2024-06-13T02:12:54.601787+0000","last_unstale":"2024-06-13T02:14:25.715558+0000","last_undegraded":"2024-06-13T02:14:25.715558+0000","last_fullsized":"2024-06-13T02:14:25.715558+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:16:34.970026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"98'1","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.474794+0000","last_change":"2024-06-13T02:12:35.808845+0000","last_active":"2024-06-13T02:14:26.474794+0000","last_peered":"2024-06-13T02:14:26.474794+0000","last_clean":"2024-06-13T02:14:26.474794+0000","last_became_active":"2024-06-13T02:12:35.808497+0000","last_became_peered":"2024-06-13T02:12:35.808497+0000","last_unstale":"2024-06-13T02:14:26.474794+0000","last_undegraded":"2024-06-13T02:14:26.474794+0000","last_fullsized":"2024-06-13T02:14:26.474794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:41:00.577762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716152+0000","last_change":"2024-06-13T02:12:40.322308+0000","last_active":"2024-06-13T02:14:25.716152+0000","last_peered":"2024-06-13T02:14:25.716152+0000","last_clean":"2024-06-13T02:14:25.716152+0000","last_became_active":"2024-06-13T02:12:40.321152+0000","last_became_peered":"2024-06-13T02:12:40.321152+0000","last_unstale":"2024-06-13T02:14:25.716152+0000","last_undegraded":"2024-06-13T02:14:25.716152+0000","last_fullsized":"2024-06-13T02:14:25.716152+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:50:15.740442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739073+0000","last_change":"2024-06-13T02:12:54.580648+0000","last_active":"2024-06-13T02:14:26.739073+0000","last_peered":"2024-06-13T02:14:26.739073+0000","last_clean":"2024-06-13T02:14:26.739073+0000","last_became_active":"2024-06-13T02:12:54.580207+0000","last_became_peered":"2024-06-13T02:12:54.580207+0000","last_unstale":"2024-06-13T02:14:26.739073+0000","last_undegraded":"2024-06-13T02:14:26.739073+0000","last_fullsized":"2024-06-13T02:14:26.739073+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:19:58.241236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"98'3","reported_seq":79,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:39.661942+0000","last_change":"2024-06-13T02:12:35.818195+0000","last_active":"2024-06-13T02:14:39.661942+0000","last_peered":"2024-06-13T02:14:39.661942+0000","last_clean":"2024-06-13T02:14:39.661942+0000","last_became_active":"2024-06-13T02:12:35.817707+0000","last_became_peered":"2024-06-13T02:12:35.817707+0000","last_unstale":"2024-06-13T02:14:39.661942+0000","last_undegraded":"2024-06-13T02:14:39.661942+0000","last_fullsized":"2024-06-13T02:14:39.661942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:24:34.940115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.737262+0000","last_change":"2024-06-13T02:12:40.306423+0000","last_active":"2024-06-13T02:14:26.737262+0000","last_peered":"2024-06-13T02:14:26.737262+0000","last_clean":"2024-06-13T02:14:26.737262+0000","last_became_active":"2024-06-13T02:12:40.306064+0000","last_became_peered":"2024-06-13T02:12:40.306064+0000","last_unstale":"2024-06-13T02:14:26.737262+0000","last_undegraded":"2024-06-13T02:14:26.737262+0000","last_fullsized":"2024-06-13T02:14:26.737262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:58:55.639602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.742681+0000","last_change":"2024-06-13T02:14:25.742041+0000","last_active":"2024-06-13T02:14:25.742681+0000","last_peered":"2024-06-13T02:14:25.742681+0000","last_clean":"2024-06-13T02:14:25.742681+0000","last_became_active":"2024-06-13T02:14:25.741497+0000","last_became_peered":"2024-06-13T02:14:25.741497+0000","last_unstale":"2024-06-13T02:14:25.742681+0000","last_undegraded":"2024-06-13T02:14:25.742681+0000","last_fullsized":"2024-06-13T02:14:25.742681+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:25:02.307080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.16","version":"98'2","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236818+0000","last_change":"2024-06-13T02:12:35.810437+0000","last_active":"2024-06-13T02:14:26.236818+0000","last_peered":"2024-06-13T02:14:26.236818+0000","last_clean":"2024-06-13T02:14:26.236818+0000","last_became_active":"2024-06-13T02:12:35.809679+0000","last_became_peered":"2024-06-13T02:12:35.809679+0000","last_unstale":"2024-06-13T02:14:26.236818+0000","last_undegraded":"2024-06-13T02:14:26.236818+0000","last_fullsized":"2024-06-13T02:14:26.236818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:12:27.644997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.718666+0000","last_change":"2024-06-13T02:12:40.306194+0000","last_active":"2024-06-13T02:14:25.718666+0000","last_peered":"2024-06-13T02:14:25.718666+0000","last_clean":"2024-06-13T02:14:25.718666+0000","last_became_active":"2024-06-13T02:12:40.304494+0000","last_became_peered":"2024-06-13T02:12:40.304494+0000","last_unstale":"2024-06-13T02:14:25.718666+0000","last_undegraded":"2024-06-13T02:14:25.718666+0000","last_fullsized":"2024-06-13T02:14:25.718666+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:59:58.186637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740297+0000","last_change":"2024-06-13T02:12:54.593655+0000","last_active":"2024-06-13T02:14:25.740297+0000","last_peered":"2024-06-13T02:14:25.740297+0000","last_clean":"2024-06-13T02:14:25.740297+0000","last_became_active":"2024-06-13T02:12:54.593256+0000","last_became_peered":"2024-06-13T02:12:54.593256+0000","last_unstale":"2024-06-13T02:14:25.740297+0000","last_undegraded":"2024-06-13T02:14:25.740297+0000","last_fullsized":"2024-06-13T02:14:25.740297+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:21:03.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"98'4","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475463+0000","last_change":"2024-06-13T02:12:36.302999+0000","last_active":"2024-06-13T02:14:26.475463+0000","last_peered":"2024-06-13T02:14:26.475463+0000","last_clean":"2024-06-13T02:14:26.475463+0000","last_became_active":"2024-06-13T02:12:36.302388+0000","last_became_peered":"2024-06-13T02:12:36.302388+0000","last_unstale":"2024-06-13T02:14:26.475463+0000","last_undegraded":"2024-06-13T02:14:26.475463+0000","last_fullsized":"2024-06-13T02:14:26.475463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:11:18.238090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.737096+0000","last_change":"2024-06-13T02:12:40.294857+0000","last_active":"2024-06-13T02:14:26.737096+0000","last_peered":"2024-06-13T02:14:26.737096+0000","last_clean":"2024-06-13T02:14:26.737096+0000","last_became_active":"2024-06-13T02:12:40.294524+0000","last_became_peered":"2024-06-13T02:12:40.294524+0000","last_unstale":"2024-06-13T02:14:26.737096+0000","last_undegraded":"2024-06-13T02:14:26.737096+0000","last_fullsized":"2024-06-13T02:14:26.737096+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:59:06.627284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716821+0000","last_change":"2024-06-13T02:12:54.589686+0000","last_active":"2024-06-13T02:14:25.716821+0000","last_peered":"2024-06-13T02:14:25.716821+0000","last_clean":"2024-06-13T02:14:25.716821+0000","last_became_active":"2024-06-13T02:12:54.589131+0000","last_became_peered":"2024-06-13T02:12:54.589131+0000","last_unstale":"2024-06-13T02:14:25.716821+0000","last_undegraded":"2024-06-13T02:14:25.716821+0000","last_fullsized":"2024-06-13T02:14:25.716821+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:11:18.443534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"100'34","reported_seq":151,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:40.663593+0000","last_change":"2024-06-13T02:12:35.809926+0000","last_active":"2024-06-13T02:14:40.663593+0000","last_peered":"2024-06-13T02:14:40.663593+0000","last_clean":"2024-06-13T02:14:40.663593+0000","last_became_active":"2024-06-13T02:12:35.809527+0000","last_became_peered":"2024-06-13T02:12:35.809527+0000","last_unstale":"2024-06-13T02:14:40.663593+0000","last_undegraded":"2024-06-13T02:14:40.663593+0000","last_fullsized":"2024-06-13T02:14:40.663593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:44:54.068664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64058,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":73,"num_read_kb":99,"num_write":35,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715765+0000","last_change":"2024-06-13T02:12:40.292129+0000","last_active":"2024-06-13T02:14:25.715765+0000","last_peered":"2024-06-13T02:14:25.715765+0000","last_clean":"2024-06-13T02:14:25.715765+0000","last_became_active":"2024-06-13T02:12:40.291741+0000","last_became_peered":"2024-06-13T02:12:40.291741+0000","last_unstale":"2024-06-13T02:14:25.715765+0000","last_undegraded":"2024-06-13T02:14:25.715765+0000","last_fullsized":"2024-06-13T02:14:25.715765+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:55:08.247903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475818+0000","last_change":"2024-06-13T02:12:54.602885+0000","last_active":"2024-06-13T02:14:26.475818+0000","last_peered":"2024-06-13T02:14:26.475818+0000","last_clean":"2024-06-13T02:14:26.475818+0000","last_became_active":"2024-06-13T02:12:54.602429+0000","last_became_peered":"2024-06-13T02:12:54.602429+0000","last_unstale":"2024-06-13T02:14:26.475818+0000","last_undegraded":"2024-06-13T02:14:26.475818+0000","last_fullsized":"2024-06-13T02:14:26.475818+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:01:36.267200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"98'6","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719261+0000","last_change":"2024-06-13T02:12:35.822449+0000","last_active":"2024-06-13T02:14:25.719261+0000","last_peered":"2024-06-13T02:14:25.719261+0000","last_clean":"2024-06-13T02:14:25.719261+0000","last_became_active":"2024-06-13T02:12:35.822170+0000","last_became_peered":"2024-06-13T02:12:35.822170+0000","last_unstale":"2024-06-13T02:14:25.719261+0000","last_undegraded":"2024-06-13T02:14:25.719261+0000","last_fullsized":"2024-06-13T02:14:25.719261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:06:26.710887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719136+0000","last_change":"2024-06-13T02:12:40.325286+0000","last_active":"2024-06-13T02:14:25.719136+0000","last_peered":"2024-06-13T02:14:25.719136+0000","last_clean":"2024-06-13T02:14:25.719136+0000","last_became_active":"2024-06-13T02:12:40.324941+0000","last_became_peered":"2024-06-13T02:12:40.324941+0000","last_unstale":"2024-06-13T02:14:25.719136+0000","last_undegraded":"2024-06-13T02:14:25.719136+0000","last_fullsized":"2024-06-13T02:14:25.719136+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:29:34.385381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716200+0000","last_change":"2024-06-13T02:12:54.603086+0000","last_active":"2024-06-13T02:14:25.716200+0000","last_peered":"2024-06-13T02:14:25.716200+0000","last_clean":"2024-06-13T02:14:25.716200+0000","last_became_active":"2024-06-13T02:12:54.602381+0000","last_became_peered":"2024-06-13T02:12:54.602381+0000","last_unstale":"2024-06-13T02:14:25.716200+0000","last_undegraded":"2024-06-13T02:14:25.716200+0000","last_fullsized":"2024-06-13T02:14:25.716200+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:07:25.115147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"98'3","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475335+0000","last_change":"2024-06-13T02:12:35.821433+0000","last_active":"2024-06-13T02:14:26.475335+0000","last_peered":"2024-06-13T02:14:26.475335+0000","last_clean":"2024-06-13T02:14:26.475335+0000","last_became_active":"2024-06-13T02:12:35.821107+0000","last_became_peered":"2024-06-13T02:12:35.821107+0000","last_unstale":"2024-06-13T02:14:26.475335+0000","last_undegraded":"2024-06-13T02:14:26.475335+0000","last_fullsized":"2024-06-13T02:14:26.475335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:46:22.488588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236481+0000","last_change":"2024-06-13T02:12:40.290897+0000","last_active":"2024-06-13T02:14:26.236481+0000","last_peered":"2024-06-13T02:14:26.236481+0000","last_clean":"2024-06-13T02:14:26.236481+0000","last_became_active":"2024-06-13T02:12:40.290486+0000","last_became_peered":"2024-06-13T02:12:40.290486+0000","last_unstale":"2024-06-13T02:14:26.236481+0000","last_undegraded":"2024-06-13T02:14:26.236481+0000","last_fullsized":"2024-06-13T02:14:26.236481+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:44:13.478952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.721308+0000","last_change":"2024-06-13T02:12:54.595490+0000","last_active":"2024-06-13T02:14:25.721308+0000","last_peered":"2024-06-13T02:14:25.721308+0000","last_clean":"2024-06-13T02:14:25.721308+0000","last_became_active":"2024-06-13T02:12:54.593765+0000","last_became_peered":"2024-06-13T02:12:54.593765+0000","last_unstale":"2024-06-13T02:14:25.721308+0000","last_undegraded":"2024-06-13T02:14:25.721308+0000","last_fullsized":"2024-06-13T02:14:25.721308+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:09:59.920255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"98'3","reported_seq":84,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:42.678343+0000","last_change":"2024-06-13T02:12:35.810179+0000","last_active":"2024-06-13T02:14:42.678343+0000","last_peered":"2024-06-13T02:14:42.678343+0000","last_clean":"2024-06-13T02:14:42.678343+0000","last_became_active":"2024-06-13T02:12:35.809778+0000","last_became_peered":"2024-06-13T02:12:35.809778+0000","last_unstale":"2024-06-13T02:14:42.678343+0000","last_undegraded":"2024-06-13T02:14:42.678343+0000","last_fullsized":"2024-06-13T02:14:42.678343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:35:53.804746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236387+0000","last_change":"2024-06-13T02:12:40.289957+0000","last_active":"2024-06-13T02:14:26.236387+0000","last_peered":"2024-06-13T02:14:26.236387+0000","last_clean":"2024-06-13T02:14:26.236387+0000","last_became_active":"2024-06-13T02:12:40.288169+0000","last_became_peered":"2024-06-13T02:12:40.288169+0000","last_unstale":"2024-06-13T02:14:26.236387+0000","last_undegraded":"2024-06-13T02:14:26.236387+0000","last_fullsized":"2024-06-13T02:14:26.236387+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:04:53.481002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720997+0000","last_change":"2024-06-13T02:12:54.607531+0000","last_active":"2024-06-13T02:14:25.720997+0000","last_peered":"2024-06-13T02:14:25.720997+0000","last_clean":"2024-06-13T02:14:25.720997+0000","last_became_active":"2024-06-13T02:12:54.606594+0000","last_became_peered":"2024-06-13T02:12:54.606594+0000","last_unstale":"2024-06-13T02:14:25.720997+0000","last_undegraded":"2024-06-13T02:14:25.720997+0000","last_fullsized":"2024-06-13T02:14:25.720997+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:17:46.394058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"98'15","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.735146+0000","last_change":"2024-06-13T02:14:25.734734+0000","last_active":"2024-06-13T02:14:25.735146+0000","last_peered":"2024-06-13T02:14:25.735146+0000","last_clean":"2024-06-13T02:14:25.735146+0000","last_became_active":"2024-06-13T02:14:25.722163+0000","last_became_peered":"2024-06-13T02:14:25.722163+0000","last_unstale":"2024-06-13T02:14:25.735146+0000","last_undegraded":"2024-06-13T02:14:25.735146+0000","last_fullsized":"2024-06-13T02:14:25.735146+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:09:15.684102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.474961+0000","last_change":"2024-06-13T02:13:25.875115+0000","last_active":"2024-06-13T02:14:26.474961+0000","last_peered":"2024-06-13T02:14:26.474961+0000","last_clean":"2024-06-13T02:14:26.474961+0000","last_became_active":"2024-06-13T02:13:25.874799+0000","last_became_peered":"2024-06-13T02:13:25.874799+0000","last_unstale":"2024-06-13T02:14:26.474961+0000","last_undegraded":"2024-06-13T02:14:26.474961+0000","last_fullsized":"2024-06-13T02:14:26.474961+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:31:30.747465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.474952+0000","last_change":"2024-06-13T02:12:54.594061+0000","last_active":"2024-06-13T02:14:26.474952+0000","last_peered":"2024-06-13T02:14:26.474952+0000","last_clean":"2024-06-13T02:14:26.474952+0000","last_became_active":"2024-06-13T02:12:54.593561+0000","last_became_peered":"2024-06-13T02:12:54.593561+0000","last_unstale":"2024-06-13T02:14:26.474952+0000","last_undegraded":"2024-06-13T02:14:26.474952+0000","last_fullsized":"2024-06-13T02:14:26.474952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:12:55.228857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"98'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716136+0000","last_change":"2024-06-13T02:12:35.808964+0000","last_active":"2024-06-13T02:14:25.716136+0000","last_peered":"2024-06-13T02:14:25.716136+0000","last_clean":"2024-06-13T02:14:25.716136+0000","last_became_active":"2024-06-13T02:12:35.808590+0000","last_became_peered":"2024-06-13T02:12:35.808590+0000","last_unstale":"2024-06-13T02:14:25.716136+0000","last_undegraded":"2024-06-13T02:14:25.716136+0000","last_fullsized":"2024-06-13T02:14:25.716136+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:44:23.646188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716770+0000","last_change":"2024-06-13T02:12:40.297467+0000","last_active":"2024-06-13T02:14:25.716770+0000","last_peered":"2024-06-13T02:14:25.716770+0000","last_clean":"2024-06-13T02:14:25.716770+0000","last_became_active":"2024-06-13T02:12:40.296951+0000","last_became_peered":"2024-06-13T02:12:40.296951+0000","last_unstale":"2024-06-13T02:14:25.716770+0000","last_undegraded":"2024-06-13T02:14:25.716770+0000","last_fullsized":"2024-06-13T02:14:25.716770+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:27:12.293916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715514+0000","last_change":"2024-06-13T02:12:54.661609+0000","last_active":"2024-06-13T02:14:25.715514+0000","last_peered":"2024-06-13T02:14:25.715514+0000","last_clean":"2024-06-13T02:14:25.715514+0000","last_became_active":"2024-06-13T02:12:54.661078+0000","last_became_peered":"2024-06-13T02:12:54.661078+0000","last_unstale":"2024-06-13T02:14:25.715514+0000","last_undegraded":"2024-06-13T02:14:25.715514+0000","last_fullsized":"2024-06-13T02:14:25.715514+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:55:43.134999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719821+0000","last_change":"2024-06-13T02:12:36.303569+0000","last_active":"2024-06-13T02:14:25.719821+0000","last_peered":"2024-06-13T02:14:25.719821+0000","last_clean":"2024-06-13T02:14:25.719821+0000","last_became_active":"2024-06-13T02:12:36.302949+0000","last_became_peered":"2024-06-13T02:12:36.302949+0000","last_unstale":"2024-06-13T02:14:25.719821+0000","last_undegraded":"2024-06-13T02:14:25.719821+0000","last_fullsized":"2024-06-13T02:14:25.719821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:11:16.245334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.107560+0000","last_change":"2024-06-13T02:12:40.317832+0000","last_active":"2024-06-13T02:14:26.107560+0000","last_peered":"2024-06-13T02:14:26.107560+0000","last_clean":"2024-06-13T02:14:26.107560+0000","last_became_active":"2024-06-13T02:12:40.317514+0000","last_became_peered":"2024-06-13T02:12:40.317514+0000","last_unstale":"2024-06-13T02:14:26.107560+0000","last_undegraded":"2024-06-13T02:14:26.107560+0000","last_fullsized":"2024-06-13T02:14:26.107560+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:40:06.049552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719733+0000","last_change":"2024-06-13T02:12:54.606149+0000","last_active":"2024-06-13T02:14:25.719733+0000","last_peered":"2024-06-13T02:14:25.719733+0000","last_clean":"2024-06-13T02:14:25.719733+0000","last_became_active":"2024-06-13T02:12:54.605683+0000","last_became_peered":"2024-06-13T02:12:54.605683+0000","last_unstale":"2024-06-13T02:14:25.719733+0000","last_undegraded":"2024-06-13T02:14:25.719733+0000","last_fullsized":"2024-06-13T02:14:25.719733+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:22:28.135821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"98'1","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236578+0000","last_change":"2024-06-13T02:12:35.817845+0000","last_active":"2024-06-13T02:14:26.236578+0000","last_peered":"2024-06-13T02:14:26.236578+0000","last_clean":"2024-06-13T02:14:26.236578+0000","last_became_active":"2024-06-13T02:12:35.817506+0000","last_became_peered":"2024-06-13T02:12:35.817506+0000","last_unstale":"2024-06-13T02:14:26.236578+0000","last_undegraded":"2024-06-13T02:14:26.236578+0000","last_fullsized":"2024-06-13T02:14:26.236578+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:06:54.346967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.107405+0000","last_change":"2024-06-13T02:13:25.537912+0000","last_active":"2024-06-13T02:14:26.107405+0000","last_peered":"2024-06-13T02:14:26.107405+0000","last_clean":"2024-06-13T02:14:26.107405+0000","last_became_active":"2024-06-13T02:13:25.537500+0000","last_became_peered":"2024-06-13T02:13:25.537500+0000","last_unstale":"2024-06-13T02:14:26.107405+0000","last_undegraded":"2024-06-13T02:14:26.107405+0000","last_fullsized":"2024-06-13T02:14:26.107405+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:03:11.884083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720506+0000","last_change":"2024-06-13T02:12:54.661763+0000","last_active":"2024-06-13T02:14:25.720506+0000","last_peered":"2024-06-13T02:14:25.720506+0000","last_clean":"2024-06-13T02:14:25.720506+0000","last_became_active":"2024-06-13T02:12:54.660898+0000","last_became_peered":"2024-06-13T02:12:54.660898+0000","last_unstale":"2024-06-13T02:14:25.720506+0000","last_undegraded":"2024-06-13T02:14:25.720506+0000","last_fullsized":"2024-06-13T02:14:25.720506+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:14:44.290726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475023+0000","last_change":"2024-06-13T02:12:40.299606+0000","last_active":"2024-06-13T02:14:26.475023+0000","last_peered":"2024-06-13T02:14:26.475023+0000","last_clean":"2024-06-13T02:14:26.475023+0000","last_became_active":"2024-06-13T02:12:40.299028+0000","last_became_peered":"2024-06-13T02:12:40.299028+0000","last_unstale":"2024-06-13T02:14:26.475023+0000","last_undegraded":"2024-06-13T02:14:26.475023+0000","last_fullsized":"2024-06-13T02:14:26.475023+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:09:48.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"98'4","reported_seq":83,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:42.677721+0000","last_change":"2024-06-13T02:12:36.305073+0000","last_active":"2024-06-13T02:14:42.677721+0000","last_peered":"2024-06-13T02:14:42.677721+0000","last_clean":"2024-06-13T02:14:42.677721+0000","last_became_active":"2024-06-13T02:12:36.300008+0000","last_became_peered":"2024-06-13T02:12:36.300008+0000","last_unstale":"2024-06-13T02:14:42.677721+0000","last_undegraded":"2024-06-13T02:14:42.677721+0000","last_fullsized":"2024-06-13T02:14:42.677721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:52.310699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"98'1","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236633+0000","last_change":"2024-06-13T02:12:54.590184+0000","last_active":"2024-06-13T02:14:26.236633+0000","last_peered":"2024-06-13T02:14:26.236633+0000","last_clean":"2024-06-13T02:14:26.236633+0000","last_became_active":"2024-06-13T02:12:54.589825+0000","last_became_peered":"2024-06-13T02:12:54.589825+0000","last_unstale":"2024-06-13T02:14:26.236633+0000","last_undegraded":"2024-06-13T02:14:26.236633+0000","last_fullsized":"2024-06-13T02:14:26.236633+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:24:46.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739541+0000","last_change":"2024-06-13T02:12:40.313765+0000","last_active":"2024-06-13T02:14:26.739541+0000","last_peered":"2024-06-13T02:14:26.739541+0000","last_clean":"2024-06-13T02:14:26.739541+0000","last_became_active":"2024-06-13T02:12:40.313426+0000","last_became_peered":"2024-06-13T02:12:40.313426+0000","last_unstale":"2024-06-13T02:14:26.739541+0000","last_undegraded":"2024-06-13T02:14:26.739541+0000","last_fullsized":"2024-06-13T02:14:26.739541+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:30:35.318939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"98'3","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740548+0000","last_change":"2024-06-13T02:12:35.817237+0000","last_active":"2024-06-13T02:14:25.740548+0000","last_peered":"2024-06-13T02:14:25.740548+0000","last_clean":"2024-06-13T02:14:25.740548+0000","last_became_active":"2024-06-13T02:12:35.816853+0000","last_became_peered":"2024-06-13T02:12:35.816853+0000","last_unstale":"2024-06-13T02:14:25.740548+0000","last_undegraded":"2024-06-13T02:14:25.740548+0000","last_fullsized":"2024-06-13T02:14:25.740548+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:19:23.502461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":378,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236179+0000","last_change":"2024-06-13T02:11:05.634471+0000","last_active":"2024-06-13T02:14:26.236179+0000","last_peered":"2024-06-13T02:14:26.236179+0000","last_clean":"2024-06-13T02:14:26.236179+0000","last_became_active":"2024-06-13T02:11:05.634064+0000","last_became_peered":"2024-06-13T02:11:05.634064+0000","last_unstale":"2024-06-13T02:14:26.236179+0000","last_undegraded":"2024-06-13T02:14:26.236179+0000","last_fullsized":"2024-06-13T02:14:26.236179+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:07:11.045097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:07:11.045097+0000","last_clean_scrub_stamp":"2024-06-13T02:07:11.045097+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:00:00.419953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.108628+0000","last_change":"2024-06-13T02:14:26.108149+0000","last_active":"2024-06-13T02:14:26.108628+0000","last_peered":"2024-06-13T02:14:26.108628+0000","last_clean":"2024-06-13T02:14:26.108628+0000","last_became_active":"2024-06-13T02:14:26.107707+0000","last_became_peered":"2024-06-13T02:14:26.107707+0000","last_unstale":"2024-06-13T02:14:26.108628+0000","last_undegraded":"2024-06-13T02:14:26.108628+0000","last_fullsized":"2024-06-13T02:14:26.108628+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:47:51.314059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.717535+0000","last_change":"2024-06-13T02:12:40.295770+0000","last_active":"2024-06-13T02:14:25.717535+0000","last_peered":"2024-06-13T02:14:25.717535+0000","last_clean":"2024-06-13T02:14:25.717535+0000","last_became_active":"2024-06-13T02:12:40.295361+0000","last_became_peered":"2024-06-13T02:12:40.295361+0000","last_unstale":"2024-06-13T02:14:25.717535+0000","last_undegraded":"2024-06-13T02:14:25.717535+0000","last_fullsized":"2024-06-13T02:14:25.717535+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:04:42.982908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"98'3","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236408+0000","last_change":"2024-06-13T02:12:35.808844+0000","last_active":"2024-06-13T02:14:26.236408+0000","last_peered":"2024-06-13T02:14:26.236408+0000","last_clean":"2024-06-13T02:14:26.236408+0000","last_became_active":"2024-06-13T02:12:35.808348+0000","last_became_peered":"2024-06-13T02:12:35.808348+0000","last_unstale":"2024-06-13T02:14:26.236408+0000","last_undegraded":"2024-06-13T02:14:26.236408+0000","last_fullsized":"2024-06-13T02:14:26.236408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:44:28.589169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716260+0000","last_change":"2024-06-13T02:12:54.605049+0000","last_active":"2024-06-13T02:14:25.716260+0000","last_peered":"2024-06-13T02:14:25.716260+0000","last_clean":"2024-06-13T02:14:25.716260+0000","last_became_active":"2024-06-13T02:12:54.604555+0000","last_became_peered":"2024-06-13T02:12:54.604555+0000","last_unstale":"2024-06-13T02:14:25.716260+0000","last_undegraded":"2024-06-13T02:14:25.716260+0000","last_fullsized":"2024-06-13T02:14:25.716260+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:19:58.615010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"98'1","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715890+0000","last_change":"2024-06-13T02:12:36.302966+0000","last_active":"2024-06-13T02:14:25.715890+0000","last_peered":"2024-06-13T02:14:25.715890+0000","last_clean":"2024-06-13T02:14:25.715890+0000","last_became_active":"2024-06-13T02:12:36.302529+0000","last_became_peered":"2024-06-13T02:12:36.302529+0000","last_unstale":"2024-06-13T02:14:25.715890+0000","last_undegraded":"2024-06-13T02:14:25.715890+0000","last_fullsized":"2024-06-13T02:14:25.715890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:50:01.955647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719964+0000","last_change":"2024-06-13T02:12:40.304742+0000","last_active":"2024-06-13T02:14:25.719964+0000","last_peered":"2024-06-13T02:14:25.719964+0000","last_clean":"2024-06-13T02:14:25.719964+0000","last_became_active":"2024-06-13T02:12:40.302152+0000","last_became_peered":"2024-06-13T02:12:40.302152+0000","last_unstale":"2024-06-13T02:14:25.719964+0000","last_undegraded":"2024-06-13T02:14:25.719964+0000","last_fullsized":"2024-06-13T02:14:25.719964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:22:02.146739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739411+0000","last_change":"2024-06-13T02:12:54.661661+0000","last_active":"2024-06-13T02:14:26.739411+0000","last_peered":"2024-06-13T02:14:26.739411+0000","last_clean":"2024-06-13T02:14:26.739411+0000","last_became_active":"2024-06-13T02:12:54.661177+0000","last_became_peered":"2024-06-13T02:12:54.661177+0000","last_unstale":"2024-06-13T02:14:26.739411+0000","last_undegraded":"2024-06-13T02:14:26.739411+0000","last_fullsized":"2024-06-13T02:14:26.739411+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:48:59.612164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"100'13","reported_seq":57,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:35.527112+0000","last_change":"2024-06-13T02:12:35.824975+0000","last_active":"2024-06-13T02:14:35.527112+0000","last_peered":"2024-06-13T02:14:35.527112+0000","last_clean":"2024-06-13T02:14:35.527112+0000","last_became_active":"2024-06-13T02:12:35.823019+0000","last_became_peered":"2024-06-13T02:12:35.823019+0000","last_unstale":"2024-06-13T02:14:35.527112+0000","last_undegraded":"2024-06-13T02:14:35.527112+0000","last_fullsized":"2024-06-13T02:14:35.527112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:53:53.693448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720524+0000","last_change":"2024-06-13T02:13:25.537457+0000","last_active":"2024-06-13T02:14:25.720524+0000","last_peered":"2024-06-13T02:14:25.720524+0000","last_clean":"2024-06-13T02:14:25.720524+0000","last_became_active":"2024-06-13T02:13:25.536943+0000","last_became_peered":"2024-06-13T02:13:25.536943+0000","last_unstale":"2024-06-13T02:14:25.720524+0000","last_undegraded":"2024-06-13T02:14:25.720524+0000","last_fullsized":"2024-06-13T02:14:25.720524+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:14:34.584058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719230+0000","last_change":"2024-06-13T02:12:54.580657+0000","last_active":"2024-06-13T02:14:25.719230+0000","last_peered":"2024-06-13T02:14:25.719230+0000","last_clean":"2024-06-13T02:14:25.719230+0000","last_became_active":"2024-06-13T02:12:54.580073+0000","last_became_peered":"2024-06-13T02:12:54.580073+0000","last_unstale":"2024-06-13T02:14:25.719230+0000","last_undegraded":"2024-06-13T02:14:25.719230+0000","last_fullsized":"2024-06-13T02:14:25.719230+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:53:07.707587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"98'4","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740606+0000","last_change":"2024-06-13T02:12:36.520262+0000","last_active":"2024-06-13T02:14:25.740606+0000","last_peered":"2024-06-13T02:14:25.740606+0000","last_clean":"2024-06-13T02:14:25.740606+0000","last_became_active":"2024-06-13T02:12:36.519937+0000","last_became_peered":"2024-06-13T02:12:36.519937+0000","last_unstale":"2024-06-13T02:14:25.740606+0000","last_undegraded":"2024-06-13T02:14:25.740606+0000","last_fullsized":"2024-06-13T02:14:25.740606+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:47:27.304345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.717313+0000","last_change":"2024-06-13T02:12:40.321399+0000","last_active":"2024-06-13T02:14:25.717313+0000","last_peered":"2024-06-13T02:14:25.717313+0000","last_clean":"2024-06-13T02:14:25.717313+0000","last_became_active":"2024-06-13T02:12:40.320977+0000","last_became_peered":"2024-06-13T02:12:40.320977+0000","last_unstale":"2024-06-13T02:14:25.717313+0000","last_undegraded":"2024-06-13T02:14:25.717313+0000","last_fullsized":"2024-06-13T02:14:25.717313+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:28:29.076010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740510+0000","last_change":"2024-06-13T02:12:54.661615+0000","last_active":"2024-06-13T02:14:25.740510+0000","last_peered":"2024-06-13T02:14:25.740510+0000","last_clean":"2024-06-13T02:14:25.740510+0000","last_became_active":"2024-06-13T02:12:54.661188+0000","last_became_peered":"2024-06-13T02:12:54.661188+0000","last_unstale":"2024-06-13T02:14:25.740510+0000","last_undegraded":"2024-06-13T02:14:25.740510+0000","last_fullsized":"2024-06-13T02:14:25.740510+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:18:40.083105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"98'2","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.736741+0000","last_change":"2024-06-13T02:12:36.298425+0000","last_active":"2024-06-13T02:14:26.736741+0000","last_peered":"2024-06-13T02:14:26.736741+0000","last_clean":"2024-06-13T02:14:26.736741+0000","last_became_active":"2024-06-13T02:12:36.298053+0000","last_became_peered":"2024-06-13T02:12:36.298053+0000","last_unstale":"2024-06-13T02:14:26.736741+0000","last_undegraded":"2024-06-13T02:14:26.736741+0000","last_fullsized":"2024-06-13T02:14:26.736741+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:22:22.374255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715094+0000","last_change":"2024-06-13T02:12:40.291775+0000","last_active":"2024-06-13T02:14:25.715094+0000","last_peered":"2024-06-13T02:14:25.715094+0000","last_clean":"2024-06-13T02:14:25.715094+0000","last_became_active":"2024-06-13T02:12:40.291401+0000","last_became_peered":"2024-06-13T02:12:40.291401+0000","last_unstale":"2024-06-13T02:14:25.715094+0000","last_undegraded":"2024-06-13T02:14:25.715094+0000","last_fullsized":"2024-06-13T02:14:25.715094+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:13:59.921799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720951+0000","last_change":"2024-06-13T02:12:54.592230+0000","last_active":"2024-06-13T02:14:25.720951+0000","last_peered":"2024-06-13T02:14:25.720951+0000","last_clean":"2024-06-13T02:14:25.720951+0000","last_became_active":"2024-06-13T02:12:54.591372+0000","last_became_peered":"2024-06-13T02:12:54.591372+0000","last_unstale":"2024-06-13T02:14:25.720951+0000","last_undegraded":"2024-06-13T02:14:25.720951+0000","last_fullsized":"2024-06-13T02:14:25.720951+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:36:19.684201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"98'3","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739466+0000","last_change":"2024-06-13T02:12:35.819005+0000","last_active":"2024-06-13T02:14:26.739466+0000","last_peered":"2024-06-13T02:14:26.739466+0000","last_clean":"2024-06-13T02:14:26.739466+0000","last_became_active":"2024-06-13T02:12:35.817956+0000","last_became_peered":"2024-06-13T02:12:35.817956+0000","last_unstale":"2024-06-13T02:14:26.739466+0000","last_undegraded":"2024-06-13T02:14:26.739466+0000","last_fullsized":"2024-06-13T02:14:26.739466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:58:32.303442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716914+0000","last_change":"2024-06-13T02:12:40.303970+0000","last_active":"2024-06-13T02:14:25.716914+0000","last_peered":"2024-06-13T02:14:25.716914+0000","last_clean":"2024-06-13T02:14:25.716914+0000","last_became_active":"2024-06-13T02:12:40.303610+0000","last_became_peered":"2024-06-13T02:12:40.303610+0000","last_unstale":"2024-06-13T02:14:25.716914+0000","last_undegraded":"2024-06-13T02:14:25.716914+0000","last_fullsized":"2024-06-13T02:14:25.716914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:33:20.479137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"100'1","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740868+0000","last_change":"2024-06-13T02:12:54.592039+0000","last_active":"2024-06-13T02:14:25.740868+0000","last_peered":"2024-06-13T02:14:25.740868+0000","last_clean":"2024-06-13T02:14:25.740868+0000","last_became_active":"2024-06-13T02:12:54.591555+0000","last_became_peered":"2024-06-13T02:12:54.591555+0000","last_unstale":"2024-06-13T02:14:25.740868+0000","last_undegraded":"2024-06-13T02:14:25.740868+0000","last_fullsized":"2024-06-13T02:14:25.740868+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:11:35.194690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"98'1","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716195+0000","last_change":"2024-06-13T02:13:25.533227+0000","last_active":"2024-06-13T02:14:25.716195+0000","last_peered":"2024-06-13T02:14:25.716195+0000","last_clean":"2024-06-13T02:14:25.716195+0000","last_became_active":"2024-06-13T02:13:25.532837+0000","last_became_peered":"2024-06-13T02:13:25.532837+0000","last_unstale":"2024-06-13T02:14:25.716195+0000","last_undegraded":"2024-06-13T02:14:25.716195+0000","last_fullsized":"2024-06-13T02:14:25.716195+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:57:01.228063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.740174+0000","last_change":"2024-06-13T02:12:40.321759+0000","last_active":"2024-06-13T02:14:26.740174+0000","last_peered":"2024-06-13T02:14:26.740174+0000","last_clean":"2024-06-13T02:14:26.740174+0000","last_became_active":"2024-06-13T02:12:40.319837+0000","last_became_peered":"2024-06-13T02:12:40.319837+0000","last_unstale":"2024-06-13T02:14:26.740174+0000","last_undegraded":"2024-06-13T02:14:26.740174+0000","last_fullsized":"2024-06-13T02:14:26.740174+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:11:42.641990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740362+0000","last_change":"2024-06-13T02:12:54.661591+0000","last_active":"2024-06-13T02:14:25.740362+0000","last_peered":"2024-06-13T02:14:25.740362+0000","last_clean":"2024-06-13T02:14:25.740362+0000","last_became_active":"2024-06-13T02:12:54.661105+0000","last_became_peered":"2024-06-13T02:12:54.661105+0000","last_unstale":"2024-06-13T02:14:25.740362+0000","last_undegraded":"2024-06-13T02:14:25.740362+0000","last_fullsized":"2024-06-13T02:14:25.740362+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:29:12.625195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"98'4","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715254+0000","last_change":"2024-06-13T02:12:35.810538+0000","last_active":"2024-06-13T02:14:25.715254+0000","last_peered":"2024-06-13T02:14:25.715254+0000","last_clean":"2024-06-13T02:14:25.715254+0000","last_became_active":"2024-06-13T02:12:35.810187+0000","last_became_peered":"2024-06-13T02:12:35.810187+0000","last_unstale":"2024-06-13T02:14:25.715254+0000","last_undegraded":"2024-06-13T02:14:25.715254+0000","last_fullsized":"2024-06-13T02:14:25.715254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:44:52.794144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236582+0000","last_change":"2024-06-13T02:12:40.291366+0000","last_active":"2024-06-13T02:14:26.236582+0000","last_peered":"2024-06-13T02:14:26.236582+0000","last_clean":"2024-06-13T02:14:26.236582+0000","last_became_active":"2024-06-13T02:12:40.291034+0000","last_became_peered":"2024-06-13T02:12:40.291034+0000","last_unstale":"2024-06-13T02:14:26.236582+0000","last_undegraded":"2024-06-13T02:14:26.236582+0000","last_fullsized":"2024-06-13T02:14:26.236582+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:20:04.277456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.736735+0000","last_change":"2024-06-13T02:12:54.602337+0000","last_active":"2024-06-13T02:14:26.736735+0000","last_peered":"2024-06-13T02:14:26.736735+0000","last_clean":"2024-06-13T02:14:26.736735+0000","last_became_active":"2024-06-13T02:12:54.601858+0000","last_became_peered":"2024-06-13T02:12:54.601858+0000","last_unstale":"2024-06-13T02:14:26.736735+0000","last_undegraded":"2024-06-13T02:14:26.736735+0000","last_fullsized":"2024-06-13T02:14:26.736735+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:16:53.478460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"98'3","reported_seq":19,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740284+0000","last_change":"2024-06-13T02:13:25.533798+0000","last_active":"2024-06-13T02:14:25.740284+0000","last_peered":"2024-06-13T02:14:25.740284+0000","last_clean":"2024-06-13T02:14:25.740284+0000","last_became_active":"2024-06-13T02:13:25.533439+0000","last_became_peered":"2024-06-13T02:13:25.533439+0000","last_unstale":"2024-06-13T02:14:25.740284+0000","last_undegraded":"2024-06-13T02:14:25.740284+0000","last_fullsized":"2024-06-13T02:14:25.740284+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:01:04.227804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236922+0000","last_change":"2024-06-13T02:12:40.295997+0000","last_active":"2024-06-13T02:14:26.236922+0000","last_peered":"2024-06-13T02:14:26.236922+0000","last_clean":"2024-06-13T02:14:26.236922+0000","last_became_active":"2024-06-13T02:12:40.295381+0000","last_became_peered":"2024-06-13T02:12:40.295381+0000","last_unstale":"2024-06-13T02:14:26.236922+0000","last_undegraded":"2024-06-13T02:14:26.236922+0000","last_fullsized":"2024-06-13T02:14:26.236922+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:32:58.777282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.713766+0000","last_change":"2024-06-13T02:12:54.598071+0000","last_active":"2024-06-13T02:14:25.713766+0000","last_peered":"2024-06-13T02:14:25.713766+0000","last_clean":"2024-06-13T02:14:25.713766+0000","last_became_active":"2024-06-13T02:12:54.597591+0000","last_became_peered":"2024-06-13T02:12:54.597591+0000","last_unstale":"2024-06-13T02:14:25.713766+0000","last_undegraded":"2024-06-13T02:14:25.713766+0000","last_fullsized":"2024-06-13T02:14:25.713766+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:27:51.141006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'1","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475627+0000","last_change":"2024-06-13T02:12:35.823187+0000","last_active":"2024-06-13T02:14:26.475627+0000","last_peered":"2024-06-13T02:14:26.475627+0000","last_clean":"2024-06-13T02:14:26.475627+0000","last_became_active":"2024-06-13T02:12:35.822793+0000","last_became_peered":"2024-06-13T02:12:35.822793+0000","last_unstale":"2024-06-13T02:14:26.475627+0000","last_undegraded":"2024-06-13T02:14:26.475627+0000","last_fullsized":"2024-06-13T02:14:26.475627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:22:58.133740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236541+0000","last_change":"2024-06-13T02:12:40.321013+0000","last_active":"2024-06-13T02:14:26.236541+0000","last_peered":"2024-06-13T02:14:26.236541+0000","last_clean":"2024-06-13T02:14:26.236541+0000","last_became_active":"2024-06-13T02:12:40.320696+0000","last_became_peered":"2024-06-13T02:12:40.320696+0000","last_unstale":"2024-06-13T02:14:26.236541+0000","last_undegraded":"2024-06-13T02:14:26.236541+0000","last_fullsized":"2024-06-13T02:14:26.236541+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:05:38.156687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.474573+0000","last_change":"2024-06-13T02:12:54.579717+0000","last_active":"2024-06-13T02:14:26.474573+0000","last_peered":"2024-06-13T02:14:26.474573+0000","last_clean":"2024-06-13T02:14:26.474573+0000","last_became_active":"2024-06-13T02:12:54.579285+0000","last_became_peered":"2024-06-13T02:12:54.579285+0000","last_unstale":"2024-06-13T02:14:26.474573+0000","last_undegraded":"2024-06-13T02:14:26.474573+0000","last_fullsized":"2024-06-13T02:14:26.474573+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:03:41.796709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.721115+0000","last_change":"2024-06-13T02:12:35.824481+0000","last_active":"2024-06-13T02:14:25.721115+0000","last_peered":"2024-06-13T02:14:25.721115+0000","last_clean":"2024-06-13T02:14:25.721115+0000","last_became_active":"2024-06-13T02:12:35.823934+0000","last_became_peered":"2024-06-13T02:12:35.823934+0000","last_unstale":"2024-06-13T02:14:25.721115+0000","last_undegraded":"2024-06-13T02:14:25.721115+0000","last_fullsized":"2024-06-13T02:14:25.721115+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:02:25.802124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236950+0000","last_change":"2024-06-13T02:12:40.289323+0000","last_active":"2024-06-13T02:14:26.236950+0000","last_peered":"2024-06-13T02:14:26.236950+0000","last_clean":"2024-06-13T02:14:26.236950+0000","last_became_active":"2024-06-13T02:12:40.288919+0000","last_became_peered":"2024-06-13T02:12:40.288919+0000","last_unstale":"2024-06-13T02:14:26.236950+0000","last_undegraded":"2024-06-13T02:14:26.236950+0000","last_fullsized":"2024-06-13T02:14:26.236950+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:02:51.344467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.717030+0000","last_change":"2024-06-13T02:12:40.294208+0000","last_active":"2024-06-13T02:14:25.717030+0000","last_peered":"2024-06-13T02:14:25.717030+0000","last_clean":"2024-06-13T02:14:25.717030+0000","last_became_active":"2024-06-13T02:12:40.293837+0000","last_became_peered":"2024-06-13T02:12:40.293837+0000","last_unstale":"2024-06-13T02:14:25.717030+0000","last_undegraded":"2024-06-13T02:14:25.717030+0000","last_fullsized":"2024-06-13T02:14:25.717030+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:32:46.328382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719398+0000","last_change":"2024-06-13T02:12:40.303315+0000","last_active":"2024-06-13T02:14:25.719398+0000","last_peered":"2024-06-13T02:14:25.719398+0000","last_clean":"2024-06-13T02:14:25.719398+0000","last_became_active":"2024-06-13T02:12:40.302937+0000","last_became_peered":"2024-06-13T02:12:40.302937+0000","last_unstale":"2024-06-13T02:14:25.719398+0000","last_undegraded":"2024-06-13T02:14:25.719398+0000","last_fullsized":"2024-06-13T02:14:25.719398+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:51:19.510819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.718446+0000","last_change":"2024-06-13T02:12:40.322013+0000","last_active":"2024-06-13T02:14:25.718446+0000","last_peered":"2024-06-13T02:14:25.718446+0000","last_clean":"2024-06-13T02:14:25.718446+0000","last_became_active":"2024-06-13T02:12:40.321695+0000","last_became_peered":"2024-06-13T02:12:40.321695+0000","last_unstale":"2024-06-13T02:14:25.718446+0000","last_undegraded":"2024-06-13T02:14:25.718446+0000","last_fullsized":"2024-06-13T02:14:25.718446+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:42:28.101373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716306+0000","last_change":"2024-06-13T02:12:40.306898+0000","last_active":"2024-06-13T02:14:25.716306+0000","last_peered":"2024-06-13T02:14:25.716306+0000","last_clean":"2024-06-13T02:14:25.716306+0000","last_became_active":"2024-06-13T02:12:40.306177+0000","last_became_peered":"2024-06-13T02:12:40.306177+0000","last_unstale":"2024-06-13T02:14:25.716306+0000","last_undegraded":"2024-06-13T02:14:25.716306+0000","last_fullsized":"2024-06-13T02:14:25.716306+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:11:22.747829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719980+0000","last_change":"2024-06-13T02:12:40.307681+0000","last_active":"2024-06-13T02:14:25.719980+0000","last_peered":"2024-06-13T02:14:25.719980+0000","last_clean":"2024-06-13T02:14:25.719980+0000","last_became_active":"2024-06-13T02:12:40.307310+0000","last_became_peered":"2024-06-13T02:12:40.307310+0000","last_unstale":"2024-06-13T02:14:25.719980+0000","last_undegraded":"2024-06-13T02:14:25.719980+0000","last_fullsized":"2024-06-13T02:14:25.719980+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:53:35.493392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716887+0000","last_change":"2024-06-13T02:12:40.293834+0000","last_active":"2024-06-13T02:14:25.716887+0000","last_peered":"2024-06-13T02:14:25.716887+0000","last_clean":"2024-06-13T02:14:25.716887+0000","last_became_active":"2024-06-13T02:12:40.293447+0000","last_became_peered":"2024-06-13T02:12:40.293447+0000","last_unstale":"2024-06-13T02:14:25.716887+0000","last_undegraded":"2024-06-13T02:14:25.716887+0000","last_fullsized":"2024-06-13T02:14:25.716887+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:26:36.375311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719355+0000","last_change":"2024-06-13T02:12:40.301005+0000","last_active":"2024-06-13T02:14:25.719355+0000","last_peered":"2024-06-13T02:14:25.719355+0000","last_clean":"2024-06-13T02:14:25.719355+0000","last_became_active":"2024-06-13T02:12:40.300628+0000","last_became_peered":"2024-06-13T02:12:40.300628+0000","last_unstale":"2024-06-13T02:14:25.719355+0000","last_undegraded":"2024-06-13T02:14:25.719355+0000","last_fullsized":"2024-06-13T02:14:25.719355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:08:42.472344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720395+0000","last_change":"2024-06-13T02:13:25.582315+0000","last_active":"2024-06-13T02:14:25.720395+0000","last_peered":"2024-06-13T02:14:25.720395+0000","last_clean":"2024-06-13T02:14:25.720395+0000","last_became_active":"2024-06-13T02:13:25.581900+0000","last_became_peered":"2024-06-13T02:13:25.581900+0000","last_unstale":"2024-06-13T02:14:25.720395+0000","last_undegraded":"2024-06-13T02:14:25.720395+0000","last_fullsized":"2024-06-13T02:14:25.720395+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:10:34.523785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236179+0000","last_change":"2024-06-13T02:13:25.535789+0000","last_active":"2024-06-13T02:14:26.236179+0000","last_peered":"2024-06-13T02:14:26.236179+0000","last_clean":"2024-06-13T02:14:26.236179+0000","last_became_active":"2024-06-13T02:13:25.535433+0000","last_became_peered":"2024-06-13T02:13:25.535433+0000","last_unstale":"2024-06-13T02:14:26.236179+0000","last_undegraded":"2024-06-13T02:14:26.236179+0000","last_fullsized":"2024-06-13T02:14:26.236179+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:42:48.200317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739598+0000","last_change":"2024-06-13T02:12:40.317353+0000","last_active":"2024-06-13T02:14:26.739598+0000","last_peered":"2024-06-13T02:14:26.739598+0000","last_clean":"2024-06-13T02:14:26.739598+0000","last_became_active":"2024-06-13T02:12:40.316957+0000","last_became_peered":"2024-06-13T02:12:40.316957+0000","last_unstale":"2024-06-13T02:14:26.739598+0000","last_undegraded":"2024-06-13T02:14:26.739598+0000","last_fullsized":"2024-06-13T02:14:26.739598+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:53:01.190200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.736981+0000","last_change":"2024-06-13T02:12:40.324827+0000","last_active":"2024-06-13T02:14:26.736981+0000","last_peered":"2024-06-13T02:14:26.736981+0000","last_clean":"2024-06-13T02:14:26.736981+0000","last_became_active":"2024-06-13T02:12:40.324436+0000","last_became_peered":"2024-06-13T02:12:40.324436+0000","last_unstale":"2024-06-13T02:14:26.736981+0000","last_undegraded":"2024-06-13T02:14:26.736981+0000","last_fullsized":"2024-06-13T02:14:26.736981+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:23:44.382731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719442+0000","last_change":"2024-06-13T02:12:40.308679+0000","last_active":"2024-06-13T02:14:25.719442+0000","last_peered":"2024-06-13T02:14:25.719442+0000","last_clean":"2024-06-13T02:14:25.719442+0000","last_became_active":"2024-06-13T02:12:40.308153+0000","last_became_peered":"2024-06-13T02:12:40.308153+0000","last_unstale":"2024-06-13T02:14:25.719442+0000","last_undegraded":"2024-06-13T02:14:25.719442+0000","last_fullsized":"2024-06-13T02:14:25.719442+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:19:53.976190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716580+0000","last_change":"2024-06-13T02:12:40.297489+0000","last_active":"2024-06-13T02:14:25.716580+0000","last_peered":"2024-06-13T02:14:25.716580+0000","last_clean":"2024-06-13T02:14:25.716580+0000","last_became_active":"2024-06-13T02:12:40.297026+0000","last_became_peered":"2024-06-13T02:12:40.297026+0000","last_unstale":"2024-06-13T02:14:25.716580+0000","last_undegraded":"2024-06-13T02:14:25.716580+0000","last_fullsized":"2024-06-13T02:14:25.716580+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:35:36.110972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67668,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":225,"num_read_kb":182,"num_write":171,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":203004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351017,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28152,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717000,"statfs":{"total":95995035648,"available":95966208000,"internally_reserved":0,"allocated":1155072,"data_stored":573205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612653,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28812,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716340,"statfs":{"total":95995035648,"available":95965532160,"internally_reserved":0,"allocated":1839104,"data_stored":1224419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776179,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1167360,"data_stored":577425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037818,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28144,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717008,"statfs":{"total":95995035648,"available":95966216192,"internally_reserved":0,"allocated":1155072,"data_stored":573137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299455,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28732,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716420,"statfs":{"total":95995035648,"available":95965614080,"internally_reserved":0,"allocated":1757184,"data_stored":1168767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462982,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36456,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708696,"statfs":{"total":95995035648,"available":95957704704,"internally_reserved":0,"allocated":1142784,"data_stored":568505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36516,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708636,"statfs":{"total":95995035648,"available":95957643264,"internally_reserved":0,"allocated":1208320,"data_stored":628208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738470,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1167360,"data_stored":569893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411420,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36540,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708612,"statfs":{"total":95995035648,"available":95957618688,"internally_reserved":0,"allocated":1232896,"data_stored":633241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149781,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32304,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712848,"statfs":{"total":95995035648,"available":95961956352,"internally_reserved":0,"allocated":1155072,"data_stored":568699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888145,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1159168,"data_stored":573737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724619,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37068,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708084,"statfs":{"total":95995035648,"available":95957078016,"internally_reserved":0,"allocated":1765376,"data_stored":1164355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T02:14:46.093 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph pg dump --format=json 2024-06-13T02:14:46.585 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:14:46.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:46 smithi002 ceph-mon[31960]: from='client.24743 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:14:46.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:46 smithi084 ceph-mon[36833]: from='client.24743 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:14:47.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:46 smithi175 ceph-mon[36977]: from='client.24743 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:14:47.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:47 smithi002 ceph-mon[31960]: pgmap v401: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-06-13T02:14:47.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:47 smithi084 ceph-mon[36833]: pgmap v401: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-06-13T02:14:48.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:47 smithi175 ceph-mon[36977]: pgmap v401: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-06-13T02:14:48.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.839+0000 7f0272200700 1 -- 172.21.15.2:0/1893210717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f026c074fe0 msgr2=0x7f026c10e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:48.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.839+0000 7f0272200700 1 --2- 172.21.15.2:0/1893210717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f026c074fe0 0x7f026c10e950 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f025400b0a0 tx=0x7f025400b3b0 comp rx=0 tx=0).stop 2024-06-13T02:14:48.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.839+0000 7f0272200700 1 -- 172.21.15.2:0/1893210717 shutdown_connections 2024-06-13T02:14:48.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.839+0000 7f0272200700 1 --2- 172.21.15.2:0/1893210717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c10ee90 0x7f026c111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:48.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.839+0000 7f0272200700 1 --2- 172.21.15.2:0/1893210717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c0746c0 0x7f026c074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:48.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.839+0000 7f0272200700 1 --2- 172.21.15.2:0/1893210717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f026c074fe0 0x7f026c10e950 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:48.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.839+0000 7f0272200700 1 -- 172.21.15.2:0/1893210717 >> 172.21.15.2:0/1893210717 conn(0x7f026c0795f0 msgr2=0x7f026c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:48.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.839+0000 7f0272200700 1 -- 172.21.15.2:0/1893210717 shutdown_connections 2024-06-13T02:14:48.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.839+0000 7f0272200700 1 -- 172.21.15.2:0/1893210717 wait complete. 2024-06-13T02:14:48.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.841+0000 7f0272200700 1 Processor -- start 2024-06-13T02:14:48.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.841+0000 7f0272200700 1 -- start start 2024-06-13T02:14:48.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.841+0000 7f0272200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f026c0746c0 0x7f026c19ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:48.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.841+0000 7f0272200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c074fe0 0x7f026c19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:48.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.841+0000 7f0272200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c10ee90 0x7f026c19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:48.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.841+0000 7f0272200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f026c114a10 con 0x7f026c0746c0 2024-06-13T02:14:48.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.841+0000 7f0272200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f026c114890 con 0x7f026c074fe0 2024-06-13T02:14:48.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.841+0000 7f0272200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f026c114b90 con 0x7f026c10ee90 2024-06-13T02:14:48.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.842+0000 7f026b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f026c0746c0 0x7f026c19ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:48.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.842+0000 7f026b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f026c0746c0 0x7f026c19ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49706/0 (socket says 172.21.15.2:49706) 2024-06-13T02:14:48.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.842+0000 7f026b400700 1 -- 172.21.15.2:0/3152065854 learned_addr learned my addr 172.21.15.2:0/3152065854 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:14:48.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.842+0000 7f026be00700 1 --2- 172.21.15.2:0/3152065854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c10ee90 0x7f026c19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:48.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.842+0000 7f0262a00700 1 --2- 172.21.15.2:0/3152065854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c074fe0 0x7f026c19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:48.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.842+0000 7f026b400700 1 -- 172.21.15.2:0/3152065854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c10ee90 msgr2=0x7f026c19f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.842+0000 7f026b400700 1 --2- 172.21.15.2:0/3152065854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c10ee90 0x7f026c19f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.842+0000 7f026b400700 1 -- 172.21.15.2:0/3152065854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c074fe0 msgr2=0x7f026c19b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.842+0000 7f026b400700 1 --2- 172.21.15.2:0/3152065854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c074fe0 0x7f026c19b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.842+0000 7f026b400700 1 -- 172.21.15.2:0/3152065854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026c19fe40 con 0x7f026c0746c0 2024-06-13T02:14:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.842+0000 7f0262a00700 1 --2- 172.21.15.2:0/3152065854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c074fe0 0x7f026c19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:14:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.843+0000 7f026b400700 1 --2- 172.21.15.2:0/3152065854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f026c0746c0 0x7f026c19ae80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f025c00d980 tx=0x7f025c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.843+0000 7f0268c00700 1 -- 172.21.15.2:0/3152065854 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c016070 con 0x7f026c0746c0 2024-06-13T02:14:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.843+0000 7f0272200700 1 -- 172.21.15.2:0/3152065854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026c1a0130 con 0x7f026c0746c0 2024-06-13T02:14:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.843+0000 7f0268c00700 1 -- 172.21.15.2:0/3152065854 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f025c004d10 con 0x7f026c0746c0 2024-06-13T02:14:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.843+0000 7f0268c00700 1 -- 172.21.15.2:0/3152065854 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c005670 con 0x7f026c0746c0 2024-06-13T02:14:48.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.843+0000 7f0272200700 1 -- 172.21.15.2:0/3152065854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026c1a79b0 con 0x7f026c0746c0 2024-06-13T02:14:48.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.845+0000 7f0272200700 1 -- 172.21.15.2:0/3152065854 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f026c069180 con 0x7f026c0746c0 2024-06-13T02:14:48.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.846+0000 7f0268c00700 1 -- 172.21.15.2:0/3152065854 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f025c004750 con 0x7f026c0746c0 2024-06-13T02:14:48.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.849+0000 7f0268c00700 1 --2- 172.21.15.2:0/3152065854 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f02500a2cb0 0x7f02500a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:48.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.849+0000 7f0268c00700 1 -- 172.21.15.2:0/3152065854 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f025c0cf390 con 0x7f026c0746c0 2024-06-13T02:14:48.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.849+0000 7f0262a00700 1 --2- 172.21.15.2:0/3152065854 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f02500a2cb0 0x7f02500a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:48.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.850+0000 7f0262a00700 1 --2- 172.21.15.2:0/3152065854 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f02500a2cb0 0x7f02500a5170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0254009fd0 tx=0x7f0254006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:48.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:48.854+0000 7f0268c00700 1 -- 172.21.15.2:0/3152065854 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f025c01f020 con 0x7f026c0746c0 2024-06-13T02:14:49.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:49.077+0000 7f0272200700 1 -- 172.21.15.2:0/3152065854 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f026c0628d0 con 0x7f02500a2cb0 2024-06-13T02:14:49.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:49.095+0000 7f0268c00700 1 -- 172.21.15.2:0/3152065854 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340511 (secure 0 0 0) 0x7f026c0628d0 con 0x7f02500a2cb0 2024-06-13T02:14:49.103 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:14:49.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:49.103+0000 7f0272200700 1 -- 172.21.15.2:0/3152065854 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f02500a2cb0 msgr2=0x7f02500a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:49.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:49.104+0000 7f0272200700 1 --2- 172.21.15.2:0/3152065854 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f02500a2cb0 0x7f02500a5170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0254009fd0 tx=0x7f0254006210 comp rx=0 tx=0).stop 2024-06-13T02:14:49.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:49.104+0000 7f0272200700 1 -- 172.21.15.2:0/3152065854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f026c0746c0 msgr2=0x7f026c19ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:49.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:49.104+0000 7f0272200700 1 --2- 172.21.15.2:0/3152065854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f026c0746c0 0x7f026c19ae80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f025c00d980 tx=0x7f025c00dc90 comp rx=0 tx=0).stop 2024-06-13T02:14:49.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:49.104+0000 7f0272200700 1 -- 172.21.15.2:0/3152065854 shutdown_connections 2024-06-13T02:14:49.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:49.104+0000 7f0272200700 1 --2- 172.21.15.2:0/3152065854 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f02500a2cb0 0x7f02500a5170 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:49.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:49.104+0000 7f0272200700 1 --2- 172.21.15.2:0/3152065854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f026c10ee90 0x7f026c19f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:49.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:49.104+0000 7f0272200700 1 --2- 172.21.15.2:0/3152065854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f026c0746c0 0x7f026c19ae80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:49.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:49.104+0000 7f0272200700 1 --2- 172.21.15.2:0/3152065854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f026c074fe0 0x7f026c19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:49.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:49.104+0000 7f0272200700 1 -- 172.21.15.2:0/3152065854 >> 172.21.15.2:0/3152065854 conn(0x7f026c0795f0 msgr2=0x7f026c0ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:49.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:49.104+0000 7f0272200700 1 -- 172.21.15.2:0/3152065854 shutdown_connections 2024-06-13T02:14:49.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:49.104+0000 7f0272200700 1 -- 172.21.15.2:0/3152065854 wait complete. 2024-06-13T02:14:49.107 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-06-13T02:14:49.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:49 smithi002 ceph-mon[31960]: pgmap v402: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 7 op/s 2024-06-13T02:14:49.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:49 smithi002 ceph-mon[31960]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:14:49.947 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":402,"stamp":"2024-06-13T02:14:48.489572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658270,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":386,"num_read_kb":316,"num_write":354,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":284,"ondisk_log_size":284,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377196,"kb_used_data":15536,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124564628,"statfs":{"total":1151940427776,"available":1151554179072,"internally_reserved":0,"allocated":15908864,"data_stored":8827856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9083,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":55,"num_write":8,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005855"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.717229+0000","last_change":"2024-06-13T02:12:40.307929+0000","last_active":"2024-06-13T02:14:25.717229+0000","last_peered":"2024-06-13T02:14:25.717229+0000","last_clean":"2024-06-13T02:14:25.717229+0000","last_became_active":"2024-06-13T02:12:40.307353+0000","last_became_peered":"2024-06-13T02:12:40.307353+0000","last_unstale":"2024-06-13T02:14:25.717229+0000","last_undegraded":"2024-06-13T02:14:25.717229+0000","last_fullsized":"2024-06-13T02:14:25.717229+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:43:19.850829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.717154+0000","last_change":"2024-06-13T02:12:40.304715+0000","last_active":"2024-06-13T02:14:25.717154+0000","last_peered":"2024-06-13T02:14:25.717154+0000","last_clean":"2024-06-13T02:14:25.717154+0000","last_became_active":"2024-06-13T02:12:40.304216+0000","last_became_peered":"2024-06-13T02:12:40.304216+0000","last_unstale":"2024-06-13T02:14:25.717154+0000","last_undegraded":"2024-06-13T02:14:25.717154+0000","last_fullsized":"2024-06-13T02:14:25.717154+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:39:02.340749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715506+0000","last_change":"2024-06-13T02:12:40.303576+0000","last_active":"2024-06-13T02:14:25.715506+0000","last_peered":"2024-06-13T02:14:25.715506+0000","last_clean":"2024-06-13T02:14:25.715506+0000","last_became_active":"2024-06-13T02:12:40.303225+0000","last_became_peered":"2024-06-13T02:12:40.303225+0000","last_unstale":"2024-06-13T02:14:25.715506+0000","last_undegraded":"2024-06-13T02:14:25.715506+0000","last_fullsized":"2024-06-13T02:14:25.715506+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:54:17.144856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740616+0000","last_change":"2024-06-13T02:12:40.298405+0000","last_active":"2024-06-13T02:14:25.740616+0000","last_peered":"2024-06-13T02:14:25.740616+0000","last_clean":"2024-06-13T02:14:25.740616+0000","last_became_active":"2024-06-13T02:12:40.297742+0000","last_became_peered":"2024-06-13T02:12:40.297742+0000","last_unstale":"2024-06-13T02:14:25.740616+0000","last_undegraded":"2024-06-13T02:14:25.740616+0000","last_fullsized":"2024-06-13T02:14:25.740616+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:23:12.417602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715337+0000","last_change":"2024-06-13T02:12:40.318679+0000","last_active":"2024-06-13T02:14:25.715337+0000","last_peered":"2024-06-13T02:14:25.715337+0000","last_clean":"2024-06-13T02:14:25.715337+0000","last_became_active":"2024-06-13T02:12:40.318313+0000","last_became_peered":"2024-06-13T02:12:40.318313+0000","last_unstale":"2024-06-13T02:14:25.715337+0000","last_undegraded":"2024-06-13T02:14:25.715337+0000","last_fullsized":"2024-06-13T02:14:25.715337+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:36:30.580012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.107486+0000","last_change":"2024-06-13T02:13:25.537913+0000","last_active":"2024-06-13T02:14:26.107486+0000","last_peered":"2024-06-13T02:14:26.107486+0000","last_clean":"2024-06-13T02:14:26.107486+0000","last_became_active":"2024-06-13T02:13:25.537509+0000","last_became_peered":"2024-06-13T02:13:25.537509+0000","last_unstale":"2024-06-13T02:14:26.107486+0000","last_undegraded":"2024-06-13T02:14:26.107486+0000","last_fullsized":"2024-06-13T02:14:26.107486+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:54:04.905051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236292+0000","last_change":"2024-06-13T02:12:40.304737+0000","last_active":"2024-06-13T02:14:26.236292+0000","last_peered":"2024-06-13T02:14:26.236292+0000","last_clean":"2024-06-13T02:14:26.236292+0000","last_became_active":"2024-06-13T02:12:40.304239+0000","last_became_peered":"2024-06-13T02:12:40.304239+0000","last_unstale":"2024-06-13T02:14:26.236292+0000","last_undegraded":"2024-06-13T02:14:26.236292+0000","last_fullsized":"2024-06-13T02:14:26.236292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:09:23.403816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.738965+0000","last_change":"2024-06-13T02:12:40.317542+0000","last_active":"2024-06-13T02:14:26.738965+0000","last_peered":"2024-06-13T02:14:26.738965+0000","last_clean":"2024-06-13T02:14:26.738965+0000","last_became_active":"2024-06-13T02:12:40.317140+0000","last_became_peered":"2024-06-13T02:12:40.317140+0000","last_unstale":"2024-06-13T02:14:26.738965+0000","last_undegraded":"2024-06-13T02:14:26.738965+0000","last_fullsized":"2024-06-13T02:14:26.738965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:01:19.812336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.737339+0000","last_change":"2024-06-13T02:12:40.295445+0000","last_active":"2024-06-13T02:14:26.737339+0000","last_peered":"2024-06-13T02:14:26.737339+0000","last_clean":"2024-06-13T02:14:26.737339+0000","last_became_active":"2024-06-13T02:12:40.293498+0000","last_became_peered":"2024-06-13T02:12:40.293498+0000","last_unstale":"2024-06-13T02:14:26.737339+0000","last_undegraded":"2024-06-13T02:14:26.737339+0000","last_fullsized":"2024-06-13T02:14:26.737339+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:43:48.487157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.107795+0000","last_change":"2024-06-13T02:12:40.294665+0000","last_active":"2024-06-13T02:14:26.107795+0000","last_peered":"2024-06-13T02:14:26.107795+0000","last_clean":"2024-06-13T02:14:26.107795+0000","last_became_active":"2024-06-13T02:12:40.294339+0000","last_became_peered":"2024-06-13T02:12:40.294339+0000","last_unstale":"2024-06-13T02:14:26.107795+0000","last_undegraded":"2024-06-13T02:14:26.107795+0000","last_fullsized":"2024-06-13T02:14:26.107795+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:15:58.703675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236765+0000","last_change":"2024-06-13T02:12:40.294867+0000","last_active":"2024-06-13T02:14:26.236765+0000","last_peered":"2024-06-13T02:14:26.236765+0000","last_clean":"2024-06-13T02:14:26.236765+0000","last_became_active":"2024-06-13T02:12:40.293665+0000","last_became_peered":"2024-06-13T02:12:40.293665+0000","last_unstale":"2024-06-13T02:14:26.236765+0000","last_undegraded":"2024-06-13T02:14:26.236765+0000","last_fullsized":"2024-06-13T02:14:26.236765+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:52:02.171738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740459+0000","last_change":"2024-06-13T02:12:40.296253+0000","last_active":"2024-06-13T02:14:25.740459+0000","last_peered":"2024-06-13T02:14:25.740459+0000","last_clean":"2024-06-13T02:14:25.740459+0000","last_became_active":"2024-06-13T02:12:40.295932+0000","last_became_peered":"2024-06-13T02:12:40.295932+0000","last_unstale":"2024-06-13T02:14:25.740459+0000","last_undegraded":"2024-06-13T02:14:25.740459+0000","last_fullsized":"2024-06-13T02:14:25.740459+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:41:07.044402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719184+0000","last_change":"2024-06-13T02:12:40.288976+0000","last_active":"2024-06-13T02:14:25.719184+0000","last_peered":"2024-06-13T02:14:25.719184+0000","last_clean":"2024-06-13T02:14:25.719184+0000","last_became_active":"2024-06-13T02:12:40.288629+0000","last_became_peered":"2024-06-13T02:12:40.288629+0000","last_unstale":"2024-06-13T02:14:25.719184+0000","last_undegraded":"2024-06-13T02:14:25.719184+0000","last_fullsized":"2024-06-13T02:14:25.719184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:10:49.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.713418+0000","last_change":"2024-06-13T02:12:40.304020+0000","last_active":"2024-06-13T02:14:25.713418+0000","last_peered":"2024-06-13T02:14:25.713418+0000","last_clean":"2024-06-13T02:14:25.713418+0000","last_became_active":"2024-06-13T02:12:40.303671+0000","last_became_peered":"2024-06-13T02:12:40.303671+0000","last_unstale":"2024-06-13T02:14:25.713418+0000","last_undegraded":"2024-06-13T02:14:25.713418+0000","last_fullsized":"2024-06-13T02:14:25.713418+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:28:15.907085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.713835+0000","last_change":"2024-06-13T02:12:40.309501+0000","last_active":"2024-06-13T02:14:25.713835+0000","last_peered":"2024-06-13T02:14:25.713835+0000","last_clean":"2024-06-13T02:14:25.713835+0000","last_became_active":"2024-06-13T02:12:40.304938+0000","last_became_peered":"2024-06-13T02:12:40.304938+0000","last_unstale":"2024-06-13T02:14:25.713835+0000","last_undegraded":"2024-06-13T02:14:25.713835+0000","last_fullsized":"2024-06-13T02:14:25.713835+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:59:56.164448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.736640+0000","last_change":"2024-06-13T02:12:40.306574+0000","last_active":"2024-06-13T02:14:26.736640+0000","last_peered":"2024-06-13T02:14:26.736640+0000","last_clean":"2024-06-13T02:14:26.736640+0000","last_became_active":"2024-06-13T02:12:40.306227+0000","last_became_peered":"2024-06-13T02:12:40.306227+0000","last_unstale":"2024-06-13T02:14:26.736640+0000","last_undegraded":"2024-06-13T02:14:26.736640+0000","last_fullsized":"2024-06-13T02:14:26.736640+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:55:23.456256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716876+0000","last_change":"2024-06-13T02:12:40.308291+0000","last_active":"2024-06-13T02:14:25.716876+0000","last_peered":"2024-06-13T02:14:25.716876+0000","last_clean":"2024-06-13T02:14:25.716876+0000","last_became_active":"2024-06-13T02:12:40.307626+0000","last_became_peered":"2024-06-13T02:12:40.307626+0000","last_unstale":"2024-06-13T02:14:25.716876+0000","last_undegraded":"2024-06-13T02:14:25.716876+0000","last_fullsized":"2024-06-13T02:14:25.716876+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:16:47.025364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.721186+0000","last_change":"2024-06-13T02:12:40.308249+0000","last_active":"2024-06-13T02:14:25.721186+0000","last_peered":"2024-06-13T02:14:25.721186+0000","last_clean":"2024-06-13T02:14:25.721186+0000","last_became_active":"2024-06-13T02:12:40.303871+0000","last_became_peered":"2024-06-13T02:12:40.303871+0000","last_unstale":"2024-06-13T02:14:25.721186+0000","last_undegraded":"2024-06-13T02:14:25.721186+0000","last_fullsized":"2024-06-13T02:14:25.721186+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:27:05.852927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719100+0000","last_change":"2024-06-13T02:12:40.320970+0000","last_active":"2024-06-13T02:14:25.719100+0000","last_peered":"2024-06-13T02:14:25.719100+0000","last_clean":"2024-06-13T02:14:25.719100+0000","last_became_active":"2024-06-13T02:12:40.320537+0000","last_became_peered":"2024-06-13T02:12:40.320537+0000","last_unstale":"2024-06-13T02:14:25.719100+0000","last_undegraded":"2024-06-13T02:14:25.719100+0000","last_fullsized":"2024-06-13T02:14:25.719100+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:39:44.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719530+0000","last_change":"2024-06-13T02:12:54.594504+0000","last_active":"2024-06-13T02:14:25.719530+0000","last_peered":"2024-06-13T02:14:25.719530+0000","last_clean":"2024-06-13T02:14:25.719530+0000","last_became_active":"2024-06-13T02:12:54.594083+0000","last_became_peered":"2024-06-13T02:12:54.594083+0000","last_unstale":"2024-06-13T02:14:25.719530+0000","last_undegraded":"2024-06-13T02:14:25.719530+0000","last_fullsized":"2024-06-13T02:14:25.719530+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:40:11.592477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"98'9","reported_seq":55,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720880+0000","last_change":"2024-06-13T02:12:35.820414+0000","last_active":"2024-06-13T02:14:25.720880+0000","last_peered":"2024-06-13T02:14:25.720880+0000","last_clean":"2024-06-13T02:14:25.720880+0000","last_became_active":"2024-06-13T02:12:35.819320+0000","last_became_peered":"2024-06-13T02:12:35.819320+0000","last_unstale":"2024-06-13T02:14:25.720880+0000","last_undegraded":"2024-06-13T02:14:25.720880+0000","last_fullsized":"2024-06-13T02:14:25.720880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:02:44.226482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.740666+0000","last_change":"2024-06-13T02:12:40.317221+0000","last_active":"2024-06-13T02:14:26.740666+0000","last_peered":"2024-06-13T02:14:26.740666+0000","last_clean":"2024-06-13T02:14:26.740666+0000","last_became_active":"2024-06-13T02:12:40.315069+0000","last_became_peered":"2024-06-13T02:12:40.315069+0000","last_unstale":"2024-06-13T02:14:26.740666+0000","last_undegraded":"2024-06-13T02:14:26.740666+0000","last_fullsized":"2024-06-13T02:14:26.740666+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:44:36.577914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740578+0000","last_change":"2024-06-13T02:12:54.600490+0000","last_active":"2024-06-13T02:14:25.740578+0000","last_peered":"2024-06-13T02:14:25.740578+0000","last_clean":"2024-06-13T02:14:25.740578+0000","last_became_active":"2024-06-13T02:12:54.600192+0000","last_became_peered":"2024-06-13T02:12:54.600192+0000","last_unstale":"2024-06-13T02:14:25.740578+0000","last_undegraded":"2024-06-13T02:14:25.740578+0000","last_fullsized":"2024-06-13T02:14:25.740578+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:46:10.782977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"98'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.741163+0000","last_change":"2024-06-13T02:12:36.306113+0000","last_active":"2024-06-13T02:14:26.741163+0000","last_peered":"2024-06-13T02:14:26.741163+0000","last_clean":"2024-06-13T02:14:26.741163+0000","last_became_active":"2024-06-13T02:12:36.298787+0000","last_became_peered":"2024-06-13T02:12:36.298787+0000","last_unstale":"2024-06-13T02:14:26.741163+0000","last_undegraded":"2024-06-13T02:14:26.741163+0000","last_fullsized":"2024-06-13T02:14:26.741163+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:29:00.902574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719775+0000","last_change":"2024-06-13T02:12:40.314925+0000","last_active":"2024-06-13T02:14:25.719775+0000","last_peered":"2024-06-13T02:14:25.719775+0000","last_clean":"2024-06-13T02:14:25.719775+0000","last_became_active":"2024-06-13T02:12:40.312668+0000","last_became_peered":"2024-06-13T02:12:40.312668+0000","last_unstale":"2024-06-13T02:14:25.719775+0000","last_undegraded":"2024-06-13T02:14:25.719775+0000","last_fullsized":"2024-06-13T02:14:25.719775+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:47:42.896414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740147+0000","last_change":"2024-06-13T02:12:54.593653+0000","last_active":"2024-06-13T02:14:25.740147+0000","last_peered":"2024-06-13T02:14:25.740147+0000","last_clean":"2024-06-13T02:14:25.740147+0000","last_became_active":"2024-06-13T02:12:54.593250+0000","last_became_peered":"2024-06-13T02:12:54.593250+0000","last_unstale":"2024-06-13T02:14:25.740147+0000","last_undegraded":"2024-06-13T02:14:25.740147+0000","last_fullsized":"2024-06-13T02:14:25.740147+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:29:45.233850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"98'4","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715988+0000","last_change":"2024-06-13T02:12:35.809925+0000","last_active":"2024-06-13T02:14:25.715988+0000","last_peered":"2024-06-13T02:14:25.715988+0000","last_clean":"2024-06-13T02:14:25.715988+0000","last_became_active":"2024-06-13T02:12:35.809536+0000","last_became_peered":"2024-06-13T02:12:35.809536+0000","last_unstale":"2024-06-13T02:14:25.715988+0000","last_undegraded":"2024-06-13T02:14:25.715988+0000","last_fullsized":"2024-06-13T02:14:25.715988+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:41:46.322004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.736981+0000","last_change":"2024-06-13T02:12:40.299911+0000","last_active":"2024-06-13T02:14:26.736981+0000","last_peered":"2024-06-13T02:14:26.736981+0000","last_clean":"2024-06-13T02:14:26.736981+0000","last_became_active":"2024-06-13T02:12:40.298762+0000","last_became_peered":"2024-06-13T02:12:40.298762+0000","last_unstale":"2024-06-13T02:14:26.736981+0000","last_undegraded":"2024-06-13T02:14:26.736981+0000","last_fullsized":"2024-06-13T02:14:26.736981+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:52:43.996050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740096+0000","last_change":"2024-06-13T02:12:54.602831+0000","last_active":"2024-06-13T02:14:25.740096+0000","last_peered":"2024-06-13T02:14:25.740096+0000","last_clean":"2024-06-13T02:14:25.740096+0000","last_became_active":"2024-06-13T02:12:54.602406+0000","last_became_peered":"2024-06-13T02:12:54.602406+0000","last_unstale":"2024-06-13T02:14:25.740096+0000","last_undegraded":"2024-06-13T02:14:25.740096+0000","last_fullsized":"2024-06-13T02:14:25.740096+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:01:02.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715642+0000","last_change":"2024-06-13T02:12:35.808961+0000","last_active":"2024-06-13T02:14:25.715642+0000","last_peered":"2024-06-13T02:14:25.715642+0000","last_clean":"2024-06-13T02:14:25.715642+0000","last_became_active":"2024-06-13T02:12:35.808277+0000","last_became_peered":"2024-06-13T02:12:35.808277+0000","last_unstale":"2024-06-13T02:14:25.715642+0000","last_undegraded":"2024-06-13T02:14:25.715642+0000","last_fullsized":"2024-06-13T02:14:25.715642+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:38:54.356186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475561+0000","last_change":"2024-06-13T02:12:40.295392+0000","last_active":"2024-06-13T02:14:26.475561+0000","last_peered":"2024-06-13T02:14:26.475561+0000","last_clean":"2024-06-13T02:14:26.475561+0000","last_became_active":"2024-06-13T02:12:40.295052+0000","last_became_peered":"2024-06-13T02:12:40.295052+0000","last_unstale":"2024-06-13T02:14:26.475561+0000","last_undegraded":"2024-06-13T02:14:26.475561+0000","last_fullsized":"2024-06-13T02:14:26.475561+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:12:38.728062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.718908+0000","last_change":"2024-06-13T02:12:54.582150+0000","last_active":"2024-06-13T02:14:25.718908+0000","last_peered":"2024-06-13T02:14:25.718908+0000","last_clean":"2024-06-13T02:14:25.718908+0000","last_became_active":"2024-06-13T02:12:54.581734+0000","last_became_peered":"2024-06-13T02:12:54.581734+0000","last_unstale":"2024-06-13T02:14:25.718908+0000","last_undegraded":"2024-06-13T02:14:25.718908+0000","last_fullsized":"2024-06-13T02:14:25.718908+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:34:28.143198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"98'5","reported_seq":90,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:46.672096+0000","last_change":"2024-06-13T02:12:35.810286+0000","last_active":"2024-06-13T02:14:46.672096+0000","last_peered":"2024-06-13T02:14:46.672096+0000","last_clean":"2024-06-13T02:14:46.672096+0000","last_became_active":"2024-06-13T02:12:35.809910+0000","last_became_peered":"2024-06-13T02:12:35.809910+0000","last_unstale":"2024-06-13T02:14:46.672096+0000","last_undegraded":"2024-06-13T02:14:46.672096+0000","last_fullsized":"2024-06-13T02:14:46.672096+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:09:10.438115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715364+0000","last_change":"2024-06-13T02:13:25.643735+0000","last_active":"2024-06-13T02:14:25.715364+0000","last_peered":"2024-06-13T02:14:25.715364+0000","last_clean":"2024-06-13T02:14:25.715364+0000","last_became_active":"2024-06-13T02:13:25.643406+0000","last_became_peered":"2024-06-13T02:13:25.643406+0000","last_unstale":"2024-06-13T02:14:25.715364+0000","last_undegraded":"2024-06-13T02:14:25.715364+0000","last_fullsized":"2024-06-13T02:14:25.715364+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:20:17.267712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.476695+0000","last_change":"2024-06-13T02:14:26.476695+0000","last_active":"2024-06-13T02:14:26.476695+0000","last_peered":"2024-06-13T02:14:26.476695+0000","last_clean":"2024-06-13T02:14:26.476695+0000","last_became_active":"2024-06-13T02:14:26.476129+0000","last_became_peered":"2024-06-13T02:14:26.476129+0000","last_unstale":"2024-06-13T02:14:26.476695+0000","last_undegraded":"2024-06-13T02:14:26.476695+0000","last_fullsized":"2024-06-13T02:14:26.476695+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:00:39.577682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,10,5],"acting":[2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"98'3","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.107437+0000","last_change":"2024-06-13T02:12:35.817613+0000","last_active":"2024-06-13T02:14:26.107437+0000","last_peered":"2024-06-13T02:14:26.107437+0000","last_clean":"2024-06-13T02:14:26.107437+0000","last_became_active":"2024-06-13T02:12:35.817217+0000","last_became_peered":"2024-06-13T02:12:35.817217+0000","last_unstale":"2024-06-13T02:14:26.107437+0000","last_undegraded":"2024-06-13T02:14:26.107437+0000","last_fullsized":"2024-06-13T02:14:26.107437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:40:06.195493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475526+0000","last_change":"2024-06-13T02:13:25.538088+0000","last_active":"2024-06-13T02:14:26.475526+0000","last_peered":"2024-06-13T02:14:26.475526+0000","last_clean":"2024-06-13T02:14:26.475526+0000","last_became_active":"2024-06-13T02:13:25.537693+0000","last_became_peered":"2024-06-13T02:13:25.537693+0000","last_unstale":"2024-06-13T02:14:26.475526+0000","last_undegraded":"2024-06-13T02:14:26.475526+0000","last_fullsized":"2024-06-13T02:14:26.475526+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:52:59.032383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":35,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.742320+0000","last_change":"2024-06-13T02:14:25.742320+0000","last_active":"2024-06-13T02:14:25.742320+0000","last_peered":"2024-06-13T02:14:25.742320+0000","last_clean":"2024-06-13T02:14:25.742320+0000","last_became_active":"2024-06-13T02:14:25.741736+0000","last_became_peered":"2024-06-13T02:14:25.741736+0000","last_unstale":"2024-06-13T02:14:25.742320+0000","last_undegraded":"2024-06-13T02:14:25.742320+0000","last_fullsized":"2024-06-13T02:14:25.742320+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:16:53.587795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"98'2","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.718159+0000","last_change":"2024-06-13T02:12:35.824235+0000","last_active":"2024-06-13T02:14:25.718159+0000","last_peered":"2024-06-13T02:14:25.718159+0000","last_clean":"2024-06-13T02:14:25.718159+0000","last_became_active":"2024-06-13T02:12:35.821506+0000","last_became_peered":"2024-06-13T02:12:35.821506+0000","last_unstale":"2024-06-13T02:14:25.718159+0000","last_undegraded":"2024-06-13T02:14:25.718159+0000","last_fullsized":"2024-06-13T02:14:25.718159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:58:39.808001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739440+0000","last_change":"2024-06-13T02:12:40.324580+0000","last_active":"2024-06-13T02:14:26.739440+0000","last_peered":"2024-06-13T02:14:26.739440+0000","last_clean":"2024-06-13T02:14:26.739440+0000","last_became_active":"2024-06-13T02:12:40.323791+0000","last_became_peered":"2024-06-13T02:12:40.323791+0000","last_unstale":"2024-06-13T02:14:26.739440+0000","last_undegraded":"2024-06-13T02:14:26.739440+0000","last_fullsized":"2024-06-13T02:14:26.739440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:29:14.169270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715558+0000","last_change":"2024-06-13T02:12:54.602305+0000","last_active":"2024-06-13T02:14:25.715558+0000","last_peered":"2024-06-13T02:14:25.715558+0000","last_clean":"2024-06-13T02:14:25.715558+0000","last_became_active":"2024-06-13T02:12:54.601787+0000","last_became_peered":"2024-06-13T02:12:54.601787+0000","last_unstale":"2024-06-13T02:14:25.715558+0000","last_undegraded":"2024-06-13T02:14:25.715558+0000","last_fullsized":"2024-06-13T02:14:25.715558+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:16:34.970026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"98'1","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.474794+0000","last_change":"2024-06-13T02:12:35.808845+0000","last_active":"2024-06-13T02:14:26.474794+0000","last_peered":"2024-06-13T02:14:26.474794+0000","last_clean":"2024-06-13T02:14:26.474794+0000","last_became_active":"2024-06-13T02:12:35.808497+0000","last_became_peered":"2024-06-13T02:12:35.808497+0000","last_unstale":"2024-06-13T02:14:26.474794+0000","last_undegraded":"2024-06-13T02:14:26.474794+0000","last_fullsized":"2024-06-13T02:14:26.474794+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:41:00.577762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716152+0000","last_change":"2024-06-13T02:12:40.322308+0000","last_active":"2024-06-13T02:14:25.716152+0000","last_peered":"2024-06-13T02:14:25.716152+0000","last_clean":"2024-06-13T02:14:25.716152+0000","last_became_active":"2024-06-13T02:12:40.321152+0000","last_became_peered":"2024-06-13T02:12:40.321152+0000","last_unstale":"2024-06-13T02:14:25.716152+0000","last_undegraded":"2024-06-13T02:14:25.716152+0000","last_fullsized":"2024-06-13T02:14:25.716152+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:50:15.740442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739073+0000","last_change":"2024-06-13T02:12:54.580648+0000","last_active":"2024-06-13T02:14:26.739073+0000","last_peered":"2024-06-13T02:14:26.739073+0000","last_clean":"2024-06-13T02:14:26.739073+0000","last_became_active":"2024-06-13T02:12:54.580207+0000","last_became_peered":"2024-06-13T02:12:54.580207+0000","last_unstale":"2024-06-13T02:14:26.739073+0000","last_undegraded":"2024-06-13T02:14:26.739073+0000","last_fullsized":"2024-06-13T02:14:26.739073+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:19:58.241236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"98'3","reported_seq":84,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:44.668963+0000","last_change":"2024-06-13T02:12:35.818195+0000","last_active":"2024-06-13T02:14:44.668963+0000","last_peered":"2024-06-13T02:14:44.668963+0000","last_clean":"2024-06-13T02:14:44.668963+0000","last_became_active":"2024-06-13T02:12:35.817707+0000","last_became_peered":"2024-06-13T02:12:35.817707+0000","last_unstale":"2024-06-13T02:14:44.668963+0000","last_undegraded":"2024-06-13T02:14:44.668963+0000","last_fullsized":"2024-06-13T02:14:44.668963+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:24:34.940115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.737262+0000","last_change":"2024-06-13T02:12:40.306423+0000","last_active":"2024-06-13T02:14:26.737262+0000","last_peered":"2024-06-13T02:14:26.737262+0000","last_clean":"2024-06-13T02:14:26.737262+0000","last_became_active":"2024-06-13T02:12:40.306064+0000","last_became_peered":"2024-06-13T02:12:40.306064+0000","last_unstale":"2024-06-13T02:14:26.737262+0000","last_undegraded":"2024-06-13T02:14:26.737262+0000","last_fullsized":"2024-06-13T02:14:26.737262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:58:55.639602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.742681+0000","last_change":"2024-06-13T02:14:25.742041+0000","last_active":"2024-06-13T02:14:25.742681+0000","last_peered":"2024-06-13T02:14:25.742681+0000","last_clean":"2024-06-13T02:14:25.742681+0000","last_became_active":"2024-06-13T02:14:25.741497+0000","last_became_peered":"2024-06-13T02:14:25.741497+0000","last_unstale":"2024-06-13T02:14:25.742681+0000","last_undegraded":"2024-06-13T02:14:25.742681+0000","last_fullsized":"2024-06-13T02:14:25.742681+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:25:02.307080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.16","version":"98'2","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236818+0000","last_change":"2024-06-13T02:12:35.810437+0000","last_active":"2024-06-13T02:14:26.236818+0000","last_peered":"2024-06-13T02:14:26.236818+0000","last_clean":"2024-06-13T02:14:26.236818+0000","last_became_active":"2024-06-13T02:12:35.809679+0000","last_became_peered":"2024-06-13T02:12:35.809679+0000","last_unstale":"2024-06-13T02:14:26.236818+0000","last_undegraded":"2024-06-13T02:14:26.236818+0000","last_fullsized":"2024-06-13T02:14:26.236818+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:12:27.644997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.718666+0000","last_change":"2024-06-13T02:12:40.306194+0000","last_active":"2024-06-13T02:14:25.718666+0000","last_peered":"2024-06-13T02:14:25.718666+0000","last_clean":"2024-06-13T02:14:25.718666+0000","last_became_active":"2024-06-13T02:12:40.304494+0000","last_became_peered":"2024-06-13T02:12:40.304494+0000","last_unstale":"2024-06-13T02:14:25.718666+0000","last_undegraded":"2024-06-13T02:14:25.718666+0000","last_fullsized":"2024-06-13T02:14:25.718666+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:59:58.186637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740297+0000","last_change":"2024-06-13T02:12:54.593655+0000","last_active":"2024-06-13T02:14:25.740297+0000","last_peered":"2024-06-13T02:14:25.740297+0000","last_clean":"2024-06-13T02:14:25.740297+0000","last_became_active":"2024-06-13T02:12:54.593256+0000","last_became_peered":"2024-06-13T02:12:54.593256+0000","last_unstale":"2024-06-13T02:14:25.740297+0000","last_undegraded":"2024-06-13T02:14:25.740297+0000","last_fullsized":"2024-06-13T02:14:25.740297+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:21:03.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"98'4","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475463+0000","last_change":"2024-06-13T02:12:36.302999+0000","last_active":"2024-06-13T02:14:26.475463+0000","last_peered":"2024-06-13T02:14:26.475463+0000","last_clean":"2024-06-13T02:14:26.475463+0000","last_became_active":"2024-06-13T02:12:36.302388+0000","last_became_peered":"2024-06-13T02:12:36.302388+0000","last_unstale":"2024-06-13T02:14:26.475463+0000","last_undegraded":"2024-06-13T02:14:26.475463+0000","last_fullsized":"2024-06-13T02:14:26.475463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:11:18.238090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.737096+0000","last_change":"2024-06-13T02:12:40.294857+0000","last_active":"2024-06-13T02:14:26.737096+0000","last_peered":"2024-06-13T02:14:26.737096+0000","last_clean":"2024-06-13T02:14:26.737096+0000","last_became_active":"2024-06-13T02:12:40.294524+0000","last_became_peered":"2024-06-13T02:12:40.294524+0000","last_unstale":"2024-06-13T02:14:26.737096+0000","last_undegraded":"2024-06-13T02:14:26.737096+0000","last_fullsized":"2024-06-13T02:14:26.737096+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:59:06.627284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716821+0000","last_change":"2024-06-13T02:12:54.589686+0000","last_active":"2024-06-13T02:14:25.716821+0000","last_peered":"2024-06-13T02:14:25.716821+0000","last_clean":"2024-06-13T02:14:25.716821+0000","last_became_active":"2024-06-13T02:12:54.589131+0000","last_became_peered":"2024-06-13T02:12:54.589131+0000","last_unstale":"2024-06-13T02:14:25.716821+0000","last_undegraded":"2024-06-13T02:14:25.716821+0000","last_fullsized":"2024-06-13T02:14:25.716821+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:11:18.443534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"100'34","reported_seq":161,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:45.670128+0000","last_change":"2024-06-13T02:12:35.809926+0000","last_active":"2024-06-13T02:14:45.670128+0000","last_peered":"2024-06-13T02:14:45.670128+0000","last_clean":"2024-06-13T02:14:45.670128+0000","last_became_active":"2024-06-13T02:12:35.809527+0000","last_became_peered":"2024-06-13T02:12:35.809527+0000","last_unstale":"2024-06-13T02:14:45.670128+0000","last_undegraded":"2024-06-13T02:14:45.670128+0000","last_fullsized":"2024-06-13T02:14:45.670128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:44:54.068664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64058,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":83,"num_read_kb":104,"num_write":35,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715765+0000","last_change":"2024-06-13T02:12:40.292129+0000","last_active":"2024-06-13T02:14:25.715765+0000","last_peered":"2024-06-13T02:14:25.715765+0000","last_clean":"2024-06-13T02:14:25.715765+0000","last_became_active":"2024-06-13T02:12:40.291741+0000","last_became_peered":"2024-06-13T02:12:40.291741+0000","last_unstale":"2024-06-13T02:14:25.715765+0000","last_undegraded":"2024-06-13T02:14:25.715765+0000","last_fullsized":"2024-06-13T02:14:25.715765+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:55:08.247903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475818+0000","last_change":"2024-06-13T02:12:54.602885+0000","last_active":"2024-06-13T02:14:26.475818+0000","last_peered":"2024-06-13T02:14:26.475818+0000","last_clean":"2024-06-13T02:14:26.475818+0000","last_became_active":"2024-06-13T02:12:54.602429+0000","last_became_peered":"2024-06-13T02:12:54.602429+0000","last_unstale":"2024-06-13T02:14:26.475818+0000","last_undegraded":"2024-06-13T02:14:26.475818+0000","last_fullsized":"2024-06-13T02:14:26.475818+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:01:36.267200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"98'6","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719261+0000","last_change":"2024-06-13T02:12:35.822449+0000","last_active":"2024-06-13T02:14:25.719261+0000","last_peered":"2024-06-13T02:14:25.719261+0000","last_clean":"2024-06-13T02:14:25.719261+0000","last_became_active":"2024-06-13T02:12:35.822170+0000","last_became_peered":"2024-06-13T02:12:35.822170+0000","last_unstale":"2024-06-13T02:14:25.719261+0000","last_undegraded":"2024-06-13T02:14:25.719261+0000","last_fullsized":"2024-06-13T02:14:25.719261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:06:26.710887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719136+0000","last_change":"2024-06-13T02:12:40.325286+0000","last_active":"2024-06-13T02:14:25.719136+0000","last_peered":"2024-06-13T02:14:25.719136+0000","last_clean":"2024-06-13T02:14:25.719136+0000","last_became_active":"2024-06-13T02:12:40.324941+0000","last_became_peered":"2024-06-13T02:12:40.324941+0000","last_unstale":"2024-06-13T02:14:25.719136+0000","last_undegraded":"2024-06-13T02:14:25.719136+0000","last_fullsized":"2024-06-13T02:14:25.719136+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:29:34.385381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716200+0000","last_change":"2024-06-13T02:12:54.603086+0000","last_active":"2024-06-13T02:14:25.716200+0000","last_peered":"2024-06-13T02:14:25.716200+0000","last_clean":"2024-06-13T02:14:25.716200+0000","last_became_active":"2024-06-13T02:12:54.602381+0000","last_became_peered":"2024-06-13T02:12:54.602381+0000","last_unstale":"2024-06-13T02:14:25.716200+0000","last_undegraded":"2024-06-13T02:14:25.716200+0000","last_fullsized":"2024-06-13T02:14:25.716200+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:07:25.115147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"98'3","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475335+0000","last_change":"2024-06-13T02:12:35.821433+0000","last_active":"2024-06-13T02:14:26.475335+0000","last_peered":"2024-06-13T02:14:26.475335+0000","last_clean":"2024-06-13T02:14:26.475335+0000","last_became_active":"2024-06-13T02:12:35.821107+0000","last_became_peered":"2024-06-13T02:12:35.821107+0000","last_unstale":"2024-06-13T02:14:26.475335+0000","last_undegraded":"2024-06-13T02:14:26.475335+0000","last_fullsized":"2024-06-13T02:14:26.475335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:46:22.488588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236481+0000","last_change":"2024-06-13T02:12:40.290897+0000","last_active":"2024-06-13T02:14:26.236481+0000","last_peered":"2024-06-13T02:14:26.236481+0000","last_clean":"2024-06-13T02:14:26.236481+0000","last_became_active":"2024-06-13T02:12:40.290486+0000","last_became_peered":"2024-06-13T02:12:40.290486+0000","last_unstale":"2024-06-13T02:14:26.236481+0000","last_undegraded":"2024-06-13T02:14:26.236481+0000","last_fullsized":"2024-06-13T02:14:26.236481+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:44:13.478952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.721308+0000","last_change":"2024-06-13T02:12:54.595490+0000","last_active":"2024-06-13T02:14:25.721308+0000","last_peered":"2024-06-13T02:14:25.721308+0000","last_clean":"2024-06-13T02:14:25.721308+0000","last_became_active":"2024-06-13T02:12:54.593765+0000","last_became_peered":"2024-06-13T02:12:54.593765+0000","last_unstale":"2024-06-13T02:14:25.721308+0000","last_undegraded":"2024-06-13T02:14:25.721308+0000","last_fullsized":"2024-06-13T02:14:25.721308+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:09:59.920255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"98'3","reported_seq":84,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:42.678343+0000","last_change":"2024-06-13T02:12:35.810179+0000","last_active":"2024-06-13T02:14:42.678343+0000","last_peered":"2024-06-13T02:14:42.678343+0000","last_clean":"2024-06-13T02:14:42.678343+0000","last_became_active":"2024-06-13T02:12:35.809778+0000","last_became_peered":"2024-06-13T02:12:35.809778+0000","last_unstale":"2024-06-13T02:14:42.678343+0000","last_undegraded":"2024-06-13T02:14:42.678343+0000","last_fullsized":"2024-06-13T02:14:42.678343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:35:53.804746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236387+0000","last_change":"2024-06-13T02:12:40.289957+0000","last_active":"2024-06-13T02:14:26.236387+0000","last_peered":"2024-06-13T02:14:26.236387+0000","last_clean":"2024-06-13T02:14:26.236387+0000","last_became_active":"2024-06-13T02:12:40.288169+0000","last_became_peered":"2024-06-13T02:12:40.288169+0000","last_unstale":"2024-06-13T02:14:26.236387+0000","last_undegraded":"2024-06-13T02:14:26.236387+0000","last_fullsized":"2024-06-13T02:14:26.236387+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:04:53.481002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720997+0000","last_change":"2024-06-13T02:12:54.607531+0000","last_active":"2024-06-13T02:14:25.720997+0000","last_peered":"2024-06-13T02:14:25.720997+0000","last_clean":"2024-06-13T02:14:25.720997+0000","last_became_active":"2024-06-13T02:12:54.606594+0000","last_became_peered":"2024-06-13T02:12:54.606594+0000","last_unstale":"2024-06-13T02:14:25.720997+0000","last_undegraded":"2024-06-13T02:14:25.720997+0000","last_fullsized":"2024-06-13T02:14:25.720997+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:17:46.394058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"98'15","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.735146+0000","last_change":"2024-06-13T02:14:25.734734+0000","last_active":"2024-06-13T02:14:25.735146+0000","last_peered":"2024-06-13T02:14:25.735146+0000","last_clean":"2024-06-13T02:14:25.735146+0000","last_became_active":"2024-06-13T02:14:25.722163+0000","last_became_peered":"2024-06-13T02:14:25.722163+0000","last_unstale":"2024-06-13T02:14:25.735146+0000","last_undegraded":"2024-06-13T02:14:25.735146+0000","last_fullsized":"2024-06-13T02:14:25.735146+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:09:15.684102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.474961+0000","last_change":"2024-06-13T02:13:25.875115+0000","last_active":"2024-06-13T02:14:26.474961+0000","last_peered":"2024-06-13T02:14:26.474961+0000","last_clean":"2024-06-13T02:14:26.474961+0000","last_became_active":"2024-06-13T02:13:25.874799+0000","last_became_peered":"2024-06-13T02:13:25.874799+0000","last_unstale":"2024-06-13T02:14:26.474961+0000","last_undegraded":"2024-06-13T02:14:26.474961+0000","last_fullsized":"2024-06-13T02:14:26.474961+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:31:30.747465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.474952+0000","last_change":"2024-06-13T02:12:54.594061+0000","last_active":"2024-06-13T02:14:26.474952+0000","last_peered":"2024-06-13T02:14:26.474952+0000","last_clean":"2024-06-13T02:14:26.474952+0000","last_became_active":"2024-06-13T02:12:54.593561+0000","last_became_peered":"2024-06-13T02:12:54.593561+0000","last_unstale":"2024-06-13T02:14:26.474952+0000","last_undegraded":"2024-06-13T02:14:26.474952+0000","last_fullsized":"2024-06-13T02:14:26.474952+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:12:55.228857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"98'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716136+0000","last_change":"2024-06-13T02:12:35.808964+0000","last_active":"2024-06-13T02:14:25.716136+0000","last_peered":"2024-06-13T02:14:25.716136+0000","last_clean":"2024-06-13T02:14:25.716136+0000","last_became_active":"2024-06-13T02:12:35.808590+0000","last_became_peered":"2024-06-13T02:12:35.808590+0000","last_unstale":"2024-06-13T02:14:25.716136+0000","last_undegraded":"2024-06-13T02:14:25.716136+0000","last_fullsized":"2024-06-13T02:14:25.716136+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:44:23.646188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716770+0000","last_change":"2024-06-13T02:12:40.297467+0000","last_active":"2024-06-13T02:14:25.716770+0000","last_peered":"2024-06-13T02:14:25.716770+0000","last_clean":"2024-06-13T02:14:25.716770+0000","last_became_active":"2024-06-13T02:12:40.296951+0000","last_became_peered":"2024-06-13T02:12:40.296951+0000","last_unstale":"2024-06-13T02:14:25.716770+0000","last_undegraded":"2024-06-13T02:14:25.716770+0000","last_fullsized":"2024-06-13T02:14:25.716770+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:27:12.293916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715514+0000","last_change":"2024-06-13T02:12:54.661609+0000","last_active":"2024-06-13T02:14:25.715514+0000","last_peered":"2024-06-13T02:14:25.715514+0000","last_clean":"2024-06-13T02:14:25.715514+0000","last_became_active":"2024-06-13T02:12:54.661078+0000","last_became_peered":"2024-06-13T02:12:54.661078+0000","last_unstale":"2024-06-13T02:14:25.715514+0000","last_undegraded":"2024-06-13T02:14:25.715514+0000","last_fullsized":"2024-06-13T02:14:25.715514+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:55:43.134999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719821+0000","last_change":"2024-06-13T02:12:36.303569+0000","last_active":"2024-06-13T02:14:25.719821+0000","last_peered":"2024-06-13T02:14:25.719821+0000","last_clean":"2024-06-13T02:14:25.719821+0000","last_became_active":"2024-06-13T02:12:36.302949+0000","last_became_peered":"2024-06-13T02:12:36.302949+0000","last_unstale":"2024-06-13T02:14:25.719821+0000","last_undegraded":"2024-06-13T02:14:25.719821+0000","last_fullsized":"2024-06-13T02:14:25.719821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:11:16.245334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.107621+0000","last_change":"2024-06-13T02:12:40.317832+0000","last_active":"2024-06-13T02:14:26.107621+0000","last_peered":"2024-06-13T02:14:26.107621+0000","last_clean":"2024-06-13T02:14:26.107621+0000","last_became_active":"2024-06-13T02:12:40.317514+0000","last_became_peered":"2024-06-13T02:12:40.317514+0000","last_unstale":"2024-06-13T02:14:26.107621+0000","last_undegraded":"2024-06-13T02:14:26.107621+0000","last_fullsized":"2024-06-13T02:14:26.107621+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:40:06.049552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719733+0000","last_change":"2024-06-13T02:12:54.606149+0000","last_active":"2024-06-13T02:14:25.719733+0000","last_peered":"2024-06-13T02:14:25.719733+0000","last_clean":"2024-06-13T02:14:25.719733+0000","last_became_active":"2024-06-13T02:12:54.605683+0000","last_became_peered":"2024-06-13T02:12:54.605683+0000","last_unstale":"2024-06-13T02:14:25.719733+0000","last_undegraded":"2024-06-13T02:14:25.719733+0000","last_fullsized":"2024-06-13T02:14:25.719733+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:22:28.135821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"98'1","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236578+0000","last_change":"2024-06-13T02:12:35.817845+0000","last_active":"2024-06-13T02:14:26.236578+0000","last_peered":"2024-06-13T02:14:26.236578+0000","last_clean":"2024-06-13T02:14:26.236578+0000","last_became_active":"2024-06-13T02:12:35.817506+0000","last_became_peered":"2024-06-13T02:12:35.817506+0000","last_unstale":"2024-06-13T02:14:26.236578+0000","last_undegraded":"2024-06-13T02:14:26.236578+0000","last_fullsized":"2024-06-13T02:14:26.236578+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:06:54.346967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.107575+0000","last_change":"2024-06-13T02:13:25.537912+0000","last_active":"2024-06-13T02:14:26.107575+0000","last_peered":"2024-06-13T02:14:26.107575+0000","last_clean":"2024-06-13T02:14:26.107575+0000","last_became_active":"2024-06-13T02:13:25.537500+0000","last_became_peered":"2024-06-13T02:13:25.537500+0000","last_unstale":"2024-06-13T02:14:26.107575+0000","last_undegraded":"2024-06-13T02:14:26.107575+0000","last_fullsized":"2024-06-13T02:14:26.107575+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:03:11.884083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720506+0000","last_change":"2024-06-13T02:12:54.661763+0000","last_active":"2024-06-13T02:14:25.720506+0000","last_peered":"2024-06-13T02:14:25.720506+0000","last_clean":"2024-06-13T02:14:25.720506+0000","last_became_active":"2024-06-13T02:12:54.660898+0000","last_became_peered":"2024-06-13T02:12:54.660898+0000","last_unstale":"2024-06-13T02:14:25.720506+0000","last_undegraded":"2024-06-13T02:14:25.720506+0000","last_fullsized":"2024-06-13T02:14:25.720506+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:14:44.290726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475023+0000","last_change":"2024-06-13T02:12:40.299606+0000","last_active":"2024-06-13T02:14:26.475023+0000","last_peered":"2024-06-13T02:14:26.475023+0000","last_clean":"2024-06-13T02:14:26.475023+0000","last_became_active":"2024-06-13T02:12:40.299028+0000","last_became_peered":"2024-06-13T02:12:40.299028+0000","last_unstale":"2024-06-13T02:14:26.475023+0000","last_undegraded":"2024-06-13T02:14:26.475023+0000","last_fullsized":"2024-06-13T02:14:26.475023+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:09:48.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"98'4","reported_seq":88,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:46.685372+0000","last_change":"2024-06-13T02:12:36.305073+0000","last_active":"2024-06-13T02:14:46.685372+0000","last_peered":"2024-06-13T02:14:46.685372+0000","last_clean":"2024-06-13T02:14:46.685372+0000","last_became_active":"2024-06-13T02:12:36.300008+0000","last_became_peered":"2024-06-13T02:12:36.300008+0000","last_unstale":"2024-06-13T02:14:46.685372+0000","last_undegraded":"2024-06-13T02:14:46.685372+0000","last_fullsized":"2024-06-13T02:14:46.685372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:52.310699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"98'1","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236633+0000","last_change":"2024-06-13T02:12:54.590184+0000","last_active":"2024-06-13T02:14:26.236633+0000","last_peered":"2024-06-13T02:14:26.236633+0000","last_clean":"2024-06-13T02:14:26.236633+0000","last_became_active":"2024-06-13T02:12:54.589825+0000","last_became_peered":"2024-06-13T02:12:54.589825+0000","last_unstale":"2024-06-13T02:14:26.236633+0000","last_undegraded":"2024-06-13T02:14:26.236633+0000","last_fullsized":"2024-06-13T02:14:26.236633+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:24:46.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739699+0000","last_change":"2024-06-13T02:12:40.313765+0000","last_active":"2024-06-13T02:14:26.739699+0000","last_peered":"2024-06-13T02:14:26.739699+0000","last_clean":"2024-06-13T02:14:26.739699+0000","last_became_active":"2024-06-13T02:12:40.313426+0000","last_became_peered":"2024-06-13T02:12:40.313426+0000","last_unstale":"2024-06-13T02:14:26.739699+0000","last_undegraded":"2024-06-13T02:14:26.739699+0000","last_fullsized":"2024-06-13T02:14:26.739699+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:30:35.318939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"98'3","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740548+0000","last_change":"2024-06-13T02:12:35.817237+0000","last_active":"2024-06-13T02:14:25.740548+0000","last_peered":"2024-06-13T02:14:25.740548+0000","last_clean":"2024-06-13T02:14:25.740548+0000","last_became_active":"2024-06-13T02:12:35.816853+0000","last_became_peered":"2024-06-13T02:12:35.816853+0000","last_unstale":"2024-06-13T02:14:25.740548+0000","last_undegraded":"2024-06-13T02:14:25.740548+0000","last_fullsized":"2024-06-13T02:14:25.740548+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:19:23.502461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":378,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236179+0000","last_change":"2024-06-13T02:11:05.634471+0000","last_active":"2024-06-13T02:14:26.236179+0000","last_peered":"2024-06-13T02:14:26.236179+0000","last_clean":"2024-06-13T02:14:26.236179+0000","last_became_active":"2024-06-13T02:11:05.634064+0000","last_became_peered":"2024-06-13T02:11:05.634064+0000","last_unstale":"2024-06-13T02:14:26.236179+0000","last_undegraded":"2024-06-13T02:14:26.236179+0000","last_fullsized":"2024-06-13T02:14:26.236179+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:07:11.045097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:07:11.045097+0000","last_clean_scrub_stamp":"2024-06-13T02:07:11.045097+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:00:00.419953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.108628+0000","last_change":"2024-06-13T02:14:26.108149+0000","last_active":"2024-06-13T02:14:26.108628+0000","last_peered":"2024-06-13T02:14:26.108628+0000","last_clean":"2024-06-13T02:14:26.108628+0000","last_became_active":"2024-06-13T02:14:26.107707+0000","last_became_peered":"2024-06-13T02:14:26.107707+0000","last_unstale":"2024-06-13T02:14:26.108628+0000","last_undegraded":"2024-06-13T02:14:26.108628+0000","last_fullsized":"2024-06-13T02:14:26.108628+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:47:51.314059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719863+0000","last_change":"2024-06-13T02:12:40.295770+0000","last_active":"2024-06-13T02:14:25.719863+0000","last_peered":"2024-06-13T02:14:25.719863+0000","last_clean":"2024-06-13T02:14:25.719863+0000","last_became_active":"2024-06-13T02:12:40.295361+0000","last_became_peered":"2024-06-13T02:12:40.295361+0000","last_unstale":"2024-06-13T02:14:25.719863+0000","last_undegraded":"2024-06-13T02:14:25.719863+0000","last_fullsized":"2024-06-13T02:14:25.719863+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:04:42.982908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"98'3","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236408+0000","last_change":"2024-06-13T02:12:35.808844+0000","last_active":"2024-06-13T02:14:26.236408+0000","last_peered":"2024-06-13T02:14:26.236408+0000","last_clean":"2024-06-13T02:14:26.236408+0000","last_became_active":"2024-06-13T02:12:35.808348+0000","last_became_peered":"2024-06-13T02:12:35.808348+0000","last_unstale":"2024-06-13T02:14:26.236408+0000","last_undegraded":"2024-06-13T02:14:26.236408+0000","last_fullsized":"2024-06-13T02:14:26.236408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:44:28.589169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716260+0000","last_change":"2024-06-13T02:12:54.605049+0000","last_active":"2024-06-13T02:14:25.716260+0000","last_peered":"2024-06-13T02:14:25.716260+0000","last_clean":"2024-06-13T02:14:25.716260+0000","last_became_active":"2024-06-13T02:12:54.604555+0000","last_became_peered":"2024-06-13T02:12:54.604555+0000","last_unstale":"2024-06-13T02:14:25.716260+0000","last_undegraded":"2024-06-13T02:14:25.716260+0000","last_fullsized":"2024-06-13T02:14:25.716260+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:19:58.615010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"98'1","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715890+0000","last_change":"2024-06-13T02:12:36.302966+0000","last_active":"2024-06-13T02:14:25.715890+0000","last_peered":"2024-06-13T02:14:25.715890+0000","last_clean":"2024-06-13T02:14:25.715890+0000","last_became_active":"2024-06-13T02:12:36.302529+0000","last_became_peered":"2024-06-13T02:12:36.302529+0000","last_unstale":"2024-06-13T02:14:25.715890+0000","last_undegraded":"2024-06-13T02:14:25.715890+0000","last_fullsized":"2024-06-13T02:14:25.715890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:50:01.955647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720020+0000","last_change":"2024-06-13T02:12:40.304742+0000","last_active":"2024-06-13T02:14:25.720020+0000","last_peered":"2024-06-13T02:14:25.720020+0000","last_clean":"2024-06-13T02:14:25.720020+0000","last_became_active":"2024-06-13T02:12:40.302152+0000","last_became_peered":"2024-06-13T02:12:40.302152+0000","last_unstale":"2024-06-13T02:14:25.720020+0000","last_undegraded":"2024-06-13T02:14:25.720020+0000","last_fullsized":"2024-06-13T02:14:25.720020+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:22:02.146739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739411+0000","last_change":"2024-06-13T02:12:54.661661+0000","last_active":"2024-06-13T02:14:26.739411+0000","last_peered":"2024-06-13T02:14:26.739411+0000","last_clean":"2024-06-13T02:14:26.739411+0000","last_became_active":"2024-06-13T02:12:54.661177+0000","last_became_peered":"2024-06-13T02:12:54.661177+0000","last_unstale":"2024-06-13T02:14:26.739411+0000","last_undegraded":"2024-06-13T02:14:26.739411+0000","last_fullsized":"2024-06-13T02:14:26.739411+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:48:59.612164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"100'13","reported_seq":58,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:39.526148+0000","last_change":"2024-06-13T02:12:35.824975+0000","last_active":"2024-06-13T02:14:39.526148+0000","last_peered":"2024-06-13T02:14:39.526148+0000","last_clean":"2024-06-13T02:14:39.526148+0000","last_became_active":"2024-06-13T02:12:35.823019+0000","last_became_peered":"2024-06-13T02:12:35.823019+0000","last_unstale":"2024-06-13T02:14:39.526148+0000","last_undegraded":"2024-06-13T02:14:39.526148+0000","last_fullsized":"2024-06-13T02:14:39.526148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:53:53.693448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720524+0000","last_change":"2024-06-13T02:13:25.537457+0000","last_active":"2024-06-13T02:14:25.720524+0000","last_peered":"2024-06-13T02:14:25.720524+0000","last_clean":"2024-06-13T02:14:25.720524+0000","last_became_active":"2024-06-13T02:13:25.536943+0000","last_became_peered":"2024-06-13T02:13:25.536943+0000","last_unstale":"2024-06-13T02:14:25.720524+0000","last_undegraded":"2024-06-13T02:14:25.720524+0000","last_fullsized":"2024-06-13T02:14:25.720524+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:14:34.584058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719230+0000","last_change":"2024-06-13T02:12:54.580657+0000","last_active":"2024-06-13T02:14:25.719230+0000","last_peered":"2024-06-13T02:14:25.719230+0000","last_clean":"2024-06-13T02:14:25.719230+0000","last_became_active":"2024-06-13T02:12:54.580073+0000","last_became_peered":"2024-06-13T02:12:54.580073+0000","last_unstale":"2024-06-13T02:14:25.719230+0000","last_undegraded":"2024-06-13T02:14:25.719230+0000","last_fullsized":"2024-06-13T02:14:25.719230+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:53:07.707587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"98'4","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740606+0000","last_change":"2024-06-13T02:12:36.520262+0000","last_active":"2024-06-13T02:14:25.740606+0000","last_peered":"2024-06-13T02:14:25.740606+0000","last_clean":"2024-06-13T02:14:25.740606+0000","last_became_active":"2024-06-13T02:12:36.519937+0000","last_became_peered":"2024-06-13T02:12:36.519937+0000","last_unstale":"2024-06-13T02:14:25.740606+0000","last_undegraded":"2024-06-13T02:14:25.740606+0000","last_fullsized":"2024-06-13T02:14:25.740606+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:47:27.304345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.717313+0000","last_change":"2024-06-13T02:12:40.321399+0000","last_active":"2024-06-13T02:14:25.717313+0000","last_peered":"2024-06-13T02:14:25.717313+0000","last_clean":"2024-06-13T02:14:25.717313+0000","last_became_active":"2024-06-13T02:12:40.320977+0000","last_became_peered":"2024-06-13T02:12:40.320977+0000","last_unstale":"2024-06-13T02:14:25.717313+0000","last_undegraded":"2024-06-13T02:14:25.717313+0000","last_fullsized":"2024-06-13T02:14:25.717313+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:28:29.076010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740510+0000","last_change":"2024-06-13T02:12:54.661615+0000","last_active":"2024-06-13T02:14:25.740510+0000","last_peered":"2024-06-13T02:14:25.740510+0000","last_clean":"2024-06-13T02:14:25.740510+0000","last_became_active":"2024-06-13T02:12:54.661188+0000","last_became_peered":"2024-06-13T02:12:54.661188+0000","last_unstale":"2024-06-13T02:14:25.740510+0000","last_undegraded":"2024-06-13T02:14:25.740510+0000","last_fullsized":"2024-06-13T02:14:25.740510+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:18:40.083105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"98'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.736935+0000","last_change":"2024-06-13T02:12:36.298425+0000","last_active":"2024-06-13T02:14:26.736935+0000","last_peered":"2024-06-13T02:14:26.736935+0000","last_clean":"2024-06-13T02:14:26.736935+0000","last_became_active":"2024-06-13T02:12:36.298053+0000","last_became_peered":"2024-06-13T02:12:36.298053+0000","last_unstale":"2024-06-13T02:14:26.736935+0000","last_undegraded":"2024-06-13T02:14:26.736935+0000","last_fullsized":"2024-06-13T02:14:26.736935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:22:22.374255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715094+0000","last_change":"2024-06-13T02:12:40.291775+0000","last_active":"2024-06-13T02:14:25.715094+0000","last_peered":"2024-06-13T02:14:25.715094+0000","last_clean":"2024-06-13T02:14:25.715094+0000","last_became_active":"2024-06-13T02:12:40.291401+0000","last_became_peered":"2024-06-13T02:12:40.291401+0000","last_unstale":"2024-06-13T02:14:25.715094+0000","last_undegraded":"2024-06-13T02:14:25.715094+0000","last_fullsized":"2024-06-13T02:14:25.715094+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:13:59.921799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720951+0000","last_change":"2024-06-13T02:12:54.592230+0000","last_active":"2024-06-13T02:14:25.720951+0000","last_peered":"2024-06-13T02:14:25.720951+0000","last_clean":"2024-06-13T02:14:25.720951+0000","last_became_active":"2024-06-13T02:12:54.591372+0000","last_became_peered":"2024-06-13T02:12:54.591372+0000","last_unstale":"2024-06-13T02:14:25.720951+0000","last_undegraded":"2024-06-13T02:14:25.720951+0000","last_fullsized":"2024-06-13T02:14:25.720951+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:36:19.684201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"98'3","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739621+0000","last_change":"2024-06-13T02:12:35.819005+0000","last_active":"2024-06-13T02:14:26.739621+0000","last_peered":"2024-06-13T02:14:26.739621+0000","last_clean":"2024-06-13T02:14:26.739621+0000","last_became_active":"2024-06-13T02:12:35.817956+0000","last_became_peered":"2024-06-13T02:12:35.817956+0000","last_unstale":"2024-06-13T02:14:26.739621+0000","last_undegraded":"2024-06-13T02:14:26.739621+0000","last_fullsized":"2024-06-13T02:14:26.739621+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:58:32.303442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716914+0000","last_change":"2024-06-13T02:12:40.303970+0000","last_active":"2024-06-13T02:14:25.716914+0000","last_peered":"2024-06-13T02:14:25.716914+0000","last_clean":"2024-06-13T02:14:25.716914+0000","last_became_active":"2024-06-13T02:12:40.303610+0000","last_became_peered":"2024-06-13T02:12:40.303610+0000","last_unstale":"2024-06-13T02:14:25.716914+0000","last_undegraded":"2024-06-13T02:14:25.716914+0000","last_fullsized":"2024-06-13T02:14:25.716914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:33:20.479137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"100'1","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740868+0000","last_change":"2024-06-13T02:12:54.592039+0000","last_active":"2024-06-13T02:14:25.740868+0000","last_peered":"2024-06-13T02:14:25.740868+0000","last_clean":"2024-06-13T02:14:25.740868+0000","last_became_active":"2024-06-13T02:12:54.591555+0000","last_became_peered":"2024-06-13T02:12:54.591555+0000","last_unstale":"2024-06-13T02:14:25.740868+0000","last_undegraded":"2024-06-13T02:14:25.740868+0000","last_fullsized":"2024-06-13T02:14:25.740868+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:11:35.194690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"98'1","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716195+0000","last_change":"2024-06-13T02:13:25.533227+0000","last_active":"2024-06-13T02:14:25.716195+0000","last_peered":"2024-06-13T02:14:25.716195+0000","last_clean":"2024-06-13T02:14:25.716195+0000","last_became_active":"2024-06-13T02:13:25.532837+0000","last_became_peered":"2024-06-13T02:13:25.532837+0000","last_unstale":"2024-06-13T02:14:25.716195+0000","last_undegraded":"2024-06-13T02:14:25.716195+0000","last_fullsized":"2024-06-13T02:14:25.716195+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:57:01.228063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.740174+0000","last_change":"2024-06-13T02:12:40.321759+0000","last_active":"2024-06-13T02:14:26.740174+0000","last_peered":"2024-06-13T02:14:26.740174+0000","last_clean":"2024-06-13T02:14:26.740174+0000","last_became_active":"2024-06-13T02:12:40.319837+0000","last_became_peered":"2024-06-13T02:12:40.319837+0000","last_unstale":"2024-06-13T02:14:26.740174+0000","last_undegraded":"2024-06-13T02:14:26.740174+0000","last_fullsized":"2024-06-13T02:14:26.740174+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:11:42.641990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740362+0000","last_change":"2024-06-13T02:12:54.661591+0000","last_active":"2024-06-13T02:14:25.740362+0000","last_peered":"2024-06-13T02:14:25.740362+0000","last_clean":"2024-06-13T02:14:25.740362+0000","last_became_active":"2024-06-13T02:12:54.661105+0000","last_became_peered":"2024-06-13T02:12:54.661105+0000","last_unstale":"2024-06-13T02:14:25.740362+0000","last_undegraded":"2024-06-13T02:14:25.740362+0000","last_fullsized":"2024-06-13T02:14:25.740362+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:29:12.625195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"98'4","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715254+0000","last_change":"2024-06-13T02:12:35.810538+0000","last_active":"2024-06-13T02:14:25.715254+0000","last_peered":"2024-06-13T02:14:25.715254+0000","last_clean":"2024-06-13T02:14:25.715254+0000","last_became_active":"2024-06-13T02:12:35.810187+0000","last_became_peered":"2024-06-13T02:12:35.810187+0000","last_unstale":"2024-06-13T02:14:25.715254+0000","last_undegraded":"2024-06-13T02:14:25.715254+0000","last_fullsized":"2024-06-13T02:14:25.715254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:44:52.794144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236582+0000","last_change":"2024-06-13T02:12:40.291366+0000","last_active":"2024-06-13T02:14:26.236582+0000","last_peered":"2024-06-13T02:14:26.236582+0000","last_clean":"2024-06-13T02:14:26.236582+0000","last_became_active":"2024-06-13T02:12:40.291034+0000","last_became_peered":"2024-06-13T02:12:40.291034+0000","last_unstale":"2024-06-13T02:14:26.236582+0000","last_undegraded":"2024-06-13T02:14:26.236582+0000","last_fullsized":"2024-06-13T02:14:26.236582+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:20:04.277456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.736735+0000","last_change":"2024-06-13T02:12:54.602337+0000","last_active":"2024-06-13T02:14:26.736735+0000","last_peered":"2024-06-13T02:14:26.736735+0000","last_clean":"2024-06-13T02:14:26.736735+0000","last_became_active":"2024-06-13T02:12:54.601858+0000","last_became_peered":"2024-06-13T02:12:54.601858+0000","last_unstale":"2024-06-13T02:14:26.736735+0000","last_undegraded":"2024-06-13T02:14:26.736735+0000","last_fullsized":"2024-06-13T02:14:26.736735+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:16:53.478460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"98'3","reported_seq":19,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740284+0000","last_change":"2024-06-13T02:13:25.533798+0000","last_active":"2024-06-13T02:14:25.740284+0000","last_peered":"2024-06-13T02:14:25.740284+0000","last_clean":"2024-06-13T02:14:25.740284+0000","last_became_active":"2024-06-13T02:13:25.533439+0000","last_became_peered":"2024-06-13T02:13:25.533439+0000","last_unstale":"2024-06-13T02:14:25.740284+0000","last_undegraded":"2024-06-13T02:14:25.740284+0000","last_fullsized":"2024-06-13T02:14:25.740284+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:01:04.227804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236922+0000","last_change":"2024-06-13T02:12:40.295997+0000","last_active":"2024-06-13T02:14:26.236922+0000","last_peered":"2024-06-13T02:14:26.236922+0000","last_clean":"2024-06-13T02:14:26.236922+0000","last_became_active":"2024-06-13T02:12:40.295381+0000","last_became_peered":"2024-06-13T02:12:40.295381+0000","last_unstale":"2024-06-13T02:14:26.236922+0000","last_undegraded":"2024-06-13T02:14:26.236922+0000","last_fullsized":"2024-06-13T02:14:26.236922+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:32:58.777282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.713766+0000","last_change":"2024-06-13T02:12:54.598071+0000","last_active":"2024-06-13T02:14:25.713766+0000","last_peered":"2024-06-13T02:14:25.713766+0000","last_clean":"2024-06-13T02:14:25.713766+0000","last_became_active":"2024-06-13T02:12:54.597591+0000","last_became_peered":"2024-06-13T02:12:54.597591+0000","last_unstale":"2024-06-13T02:14:25.713766+0000","last_undegraded":"2024-06-13T02:14:25.713766+0000","last_fullsized":"2024-06-13T02:14:25.713766+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:27:51.141006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'1","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475627+0000","last_change":"2024-06-13T02:12:35.823187+0000","last_active":"2024-06-13T02:14:26.475627+0000","last_peered":"2024-06-13T02:14:26.475627+0000","last_clean":"2024-06-13T02:14:26.475627+0000","last_became_active":"2024-06-13T02:12:35.822793+0000","last_became_peered":"2024-06-13T02:12:35.822793+0000","last_unstale":"2024-06-13T02:14:26.475627+0000","last_undegraded":"2024-06-13T02:14:26.475627+0000","last_fullsized":"2024-06-13T02:14:26.475627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:22:58.133740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236541+0000","last_change":"2024-06-13T02:12:40.321013+0000","last_active":"2024-06-13T02:14:26.236541+0000","last_peered":"2024-06-13T02:14:26.236541+0000","last_clean":"2024-06-13T02:14:26.236541+0000","last_became_active":"2024-06-13T02:12:40.320696+0000","last_became_peered":"2024-06-13T02:12:40.320696+0000","last_unstale":"2024-06-13T02:14:26.236541+0000","last_undegraded":"2024-06-13T02:14:26.236541+0000","last_fullsized":"2024-06-13T02:14:26.236541+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:05:38.156687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.474573+0000","last_change":"2024-06-13T02:12:54.579717+0000","last_active":"2024-06-13T02:14:26.474573+0000","last_peered":"2024-06-13T02:14:26.474573+0000","last_clean":"2024-06-13T02:14:26.474573+0000","last_became_active":"2024-06-13T02:12:54.579285+0000","last_became_peered":"2024-06-13T02:12:54.579285+0000","last_unstale":"2024-06-13T02:14:26.474573+0000","last_undegraded":"2024-06-13T02:14:26.474573+0000","last_fullsized":"2024-06-13T02:14:26.474573+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:03:41.796709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.721115+0000","last_change":"2024-06-13T02:12:35.824481+0000","last_active":"2024-06-13T02:14:25.721115+0000","last_peered":"2024-06-13T02:14:25.721115+0000","last_clean":"2024-06-13T02:14:25.721115+0000","last_became_active":"2024-06-13T02:12:35.823934+0000","last_became_peered":"2024-06-13T02:12:35.823934+0000","last_unstale":"2024-06-13T02:14:25.721115+0000","last_undegraded":"2024-06-13T02:14:25.721115+0000","last_fullsized":"2024-06-13T02:14:25.721115+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:02:25.802124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236950+0000","last_change":"2024-06-13T02:12:40.289323+0000","last_active":"2024-06-13T02:14:26.236950+0000","last_peered":"2024-06-13T02:14:26.236950+0000","last_clean":"2024-06-13T02:14:26.236950+0000","last_became_active":"2024-06-13T02:12:40.288919+0000","last_became_peered":"2024-06-13T02:12:40.288919+0000","last_unstale":"2024-06-13T02:14:26.236950+0000","last_undegraded":"2024-06-13T02:14:26.236950+0000","last_fullsized":"2024-06-13T02:14:26.236950+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:02:51.344467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.717078+0000","last_change":"2024-06-13T02:12:40.294208+0000","last_active":"2024-06-13T02:14:25.717078+0000","last_peered":"2024-06-13T02:14:25.717078+0000","last_clean":"2024-06-13T02:14:25.717078+0000","last_became_active":"2024-06-13T02:12:40.293837+0000","last_became_peered":"2024-06-13T02:12:40.293837+0000","last_unstale":"2024-06-13T02:14:25.717078+0000","last_undegraded":"2024-06-13T02:14:25.717078+0000","last_fullsized":"2024-06-13T02:14:25.717078+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:32:46.328382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719398+0000","last_change":"2024-06-13T02:12:40.303315+0000","last_active":"2024-06-13T02:14:25.719398+0000","last_peered":"2024-06-13T02:14:25.719398+0000","last_clean":"2024-06-13T02:14:25.719398+0000","last_became_active":"2024-06-13T02:12:40.302937+0000","last_became_peered":"2024-06-13T02:12:40.302937+0000","last_unstale":"2024-06-13T02:14:25.719398+0000","last_undegraded":"2024-06-13T02:14:25.719398+0000","last_fullsized":"2024-06-13T02:14:25.719398+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:51:19.510819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.718446+0000","last_change":"2024-06-13T02:12:40.322013+0000","last_active":"2024-06-13T02:14:25.718446+0000","last_peered":"2024-06-13T02:14:25.718446+0000","last_clean":"2024-06-13T02:14:25.718446+0000","last_became_active":"2024-06-13T02:12:40.321695+0000","last_became_peered":"2024-06-13T02:12:40.321695+0000","last_unstale":"2024-06-13T02:14:25.718446+0000","last_undegraded":"2024-06-13T02:14:25.718446+0000","last_fullsized":"2024-06-13T02:14:25.718446+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:42:28.101373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716495+0000","last_change":"2024-06-13T02:12:40.306898+0000","last_active":"2024-06-13T02:14:25.716495+0000","last_peered":"2024-06-13T02:14:25.716495+0000","last_clean":"2024-06-13T02:14:25.716495+0000","last_became_active":"2024-06-13T02:12:40.306177+0000","last_became_peered":"2024-06-13T02:12:40.306177+0000","last_unstale":"2024-06-13T02:14:25.716495+0000","last_undegraded":"2024-06-13T02:14:25.716495+0000","last_fullsized":"2024-06-13T02:14:25.716495+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:11:22.747829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719980+0000","last_change":"2024-06-13T02:12:40.307681+0000","last_active":"2024-06-13T02:14:25.719980+0000","last_peered":"2024-06-13T02:14:25.719980+0000","last_clean":"2024-06-13T02:14:25.719980+0000","last_became_active":"2024-06-13T02:12:40.307310+0000","last_became_peered":"2024-06-13T02:12:40.307310+0000","last_unstale":"2024-06-13T02:14:25.719980+0000","last_undegraded":"2024-06-13T02:14:25.719980+0000","last_fullsized":"2024-06-13T02:14:25.719980+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:53:35.493392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716887+0000","last_change":"2024-06-13T02:12:40.293834+0000","last_active":"2024-06-13T02:14:25.716887+0000","last_peered":"2024-06-13T02:14:25.716887+0000","last_clean":"2024-06-13T02:14:25.716887+0000","last_became_active":"2024-06-13T02:12:40.293447+0000","last_became_peered":"2024-06-13T02:12:40.293447+0000","last_unstale":"2024-06-13T02:14:25.716887+0000","last_undegraded":"2024-06-13T02:14:25.716887+0000","last_fullsized":"2024-06-13T02:14:25.716887+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:26:36.375311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719355+0000","last_change":"2024-06-13T02:12:40.301005+0000","last_active":"2024-06-13T02:14:25.719355+0000","last_peered":"2024-06-13T02:14:25.719355+0000","last_clean":"2024-06-13T02:14:25.719355+0000","last_became_active":"2024-06-13T02:12:40.300628+0000","last_became_peered":"2024-06-13T02:12:40.300628+0000","last_unstale":"2024-06-13T02:14:25.719355+0000","last_undegraded":"2024-06-13T02:14:25.719355+0000","last_fullsized":"2024-06-13T02:14:25.719355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:08:42.472344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720395+0000","last_change":"2024-06-13T02:13:25.582315+0000","last_active":"2024-06-13T02:14:25.720395+0000","last_peered":"2024-06-13T02:14:25.720395+0000","last_clean":"2024-06-13T02:14:25.720395+0000","last_became_active":"2024-06-13T02:13:25.581900+0000","last_became_peered":"2024-06-13T02:13:25.581900+0000","last_unstale":"2024-06-13T02:14:25.720395+0000","last_undegraded":"2024-06-13T02:14:25.720395+0000","last_fullsized":"2024-06-13T02:14:25.720395+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:10:34.523785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236179+0000","last_change":"2024-06-13T02:13:25.535789+0000","last_active":"2024-06-13T02:14:26.236179+0000","last_peered":"2024-06-13T02:14:26.236179+0000","last_clean":"2024-06-13T02:14:26.236179+0000","last_became_active":"2024-06-13T02:13:25.535433+0000","last_became_peered":"2024-06-13T02:13:25.535433+0000","last_unstale":"2024-06-13T02:14:26.236179+0000","last_undegraded":"2024-06-13T02:14:26.236179+0000","last_fullsized":"2024-06-13T02:14:26.236179+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:42:48.200317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739598+0000","last_change":"2024-06-13T02:12:40.317353+0000","last_active":"2024-06-13T02:14:26.739598+0000","last_peered":"2024-06-13T02:14:26.739598+0000","last_clean":"2024-06-13T02:14:26.739598+0000","last_became_active":"2024-06-13T02:12:40.316957+0000","last_became_peered":"2024-06-13T02:12:40.316957+0000","last_unstale":"2024-06-13T02:14:26.739598+0000","last_undegraded":"2024-06-13T02:14:26.739598+0000","last_fullsized":"2024-06-13T02:14:26.739598+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:53:01.190200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.736981+0000","last_change":"2024-06-13T02:12:40.324827+0000","last_active":"2024-06-13T02:14:26.736981+0000","last_peered":"2024-06-13T02:14:26.736981+0000","last_clean":"2024-06-13T02:14:26.736981+0000","last_became_active":"2024-06-13T02:12:40.324436+0000","last_became_peered":"2024-06-13T02:12:40.324436+0000","last_unstale":"2024-06-13T02:14:26.736981+0000","last_undegraded":"2024-06-13T02:14:26.736981+0000","last_fullsized":"2024-06-13T02:14:26.736981+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:23:44.382731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719442+0000","last_change":"2024-06-13T02:12:40.308679+0000","last_active":"2024-06-13T02:14:25.719442+0000","last_peered":"2024-06-13T02:14:25.719442+0000","last_clean":"2024-06-13T02:14:25.719442+0000","last_became_active":"2024-06-13T02:12:40.308153+0000","last_became_peered":"2024-06-13T02:12:40.308153+0000","last_unstale":"2024-06-13T02:14:25.719442+0000","last_undegraded":"2024-06-13T02:14:25.719442+0000","last_fullsized":"2024-06-13T02:14:25.719442+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:19:53.976190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716580+0000","last_change":"2024-06-13T02:12:40.297489+0000","last_active":"2024-06-13T02:14:25.716580+0000","last_peered":"2024-06-13T02:14:25.716580+0000","last_clean":"2024-06-13T02:14:25.716580+0000","last_became_active":"2024-06-13T02:12:40.297026+0000","last_became_peered":"2024-06-13T02:12:40.297026+0000","last_unstale":"2024-06-13T02:14:25.716580+0000","last_undegraded":"2024-06-13T02:14:25.716580+0000","last_fullsized":"2024-06-13T02:14:25.716580+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:35:36.110972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67668,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":250,"num_read_kb":197,"num_write":171,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":203004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351018,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28152,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717000,"statfs":{"total":95995035648,"available":95966208000,"internally_reserved":0,"allocated":1155072,"data_stored":573205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612654,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28812,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716340,"statfs":{"total":95995035648,"available":95965532160,"internally_reserved":0,"allocated":1839104,"data_stored":1224419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776180,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1167360,"data_stored":577425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037818,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28144,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717008,"statfs":{"total":95995035648,"available":95966216192,"internally_reserved":0,"allocated":1155072,"data_stored":573137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299456,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28732,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716420,"statfs":{"total":95995035648,"available":95965614080,"internally_reserved":0,"allocated":1757184,"data_stored":1168767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462983,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36456,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708696,"statfs":{"total":95995035648,"available":95957704704,"internally_reserved":0,"allocated":1142784,"data_stored":568505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36520,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708632,"statfs":{"total":95995035648,"available":95957639168,"internally_reserved":0,"allocated":1212416,"data_stored":632473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738471,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1167360,"data_stored":569893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411420,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36540,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708612,"statfs":{"total":95995035648,"available":95957618688,"internally_reserved":0,"allocated":1232896,"data_stored":633241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149782,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32304,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712848,"statfs":{"total":95995035648,"available":95961956352,"internally_reserved":0,"allocated":1155072,"data_stored":568699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888145,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1159168,"data_stored":573737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724620,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37068,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708084,"statfs":{"total":95995035648,"available":95957078016,"internally_reserved":0,"allocated":1765376,"data_stored":1164355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T02:14:49.952 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-13T02:14:49.953 INFO:tasks.cephadm:Setting up client nodes... 2024-06-13T02:14:49.953 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-06-13T02:14:49.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:49 smithi084 ceph-mon[36833]: pgmap v402: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 7 op/s 2024-06-13T02:14:49.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:49 smithi084 ceph-mon[36833]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:14:50.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:49 smithi175 ceph-mon[36977]: pgmap v402: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 7 op/s 2024-06-13T02:14:50.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:49 smithi175 ceph-mon[36977]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:14:50.447 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:14:51.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:51 smithi002 ceph-mon[31960]: pgmap v403: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-13T02:14:51.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:51 smithi084 ceph-mon[36833]: pgmap v403: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-13T02:14:52.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:51 smithi175 ceph-mon[36977]: pgmap v403: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-13T02:14:52.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.833+0000 7f6e72800700 1 -- 172.21.15.2:0/2568331385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e6c104720 msgr2=0x7f6e6c104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:52.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.833+0000 7f6e72800700 1 --2- 172.21.15.2:0/2568331385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e6c104720 0x7f6e6c104b40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c009990 tx=0x7f6e5c009ca0 comp rx=0 tx=0).stop 2024-06-13T02:14:52.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.833+0000 7f6e72800700 1 -- 172.21.15.2:0/2568331385 shutdown_connections 2024-06-13T02:14:52.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.833+0000 7f6e72800700 1 --2- 172.21.15.2:0/2568331385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e6c1062c0 0x7f6e6c10cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:52.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.833+0000 7f6e72800700 1 --2- 172.21.15.2:0/2568331385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e6c104720 0x7f6e6c104b40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:52.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.833+0000 7f6e72800700 1 --2- 172.21.15.2:0/2568331385 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e6c105920 0x7f6e6c105d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:52.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.833+0000 7f6e72800700 1 -- 172.21.15.2:0/2568331385 >> 172.21.15.2:0/2568331385 conn(0x7f6e6c0ffce0 msgr2=0x7f6e6c102100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:52.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.833+0000 7f6e72800700 1 -- 172.21.15.2:0/2568331385 shutdown_connections 2024-06-13T02:14:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.833+0000 7f6e72800700 1 -- 172.21.15.2:0/2568331385 wait complete. 2024-06-13T02:14:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.834+0000 7f6e72800700 1 Processor -- start 2024-06-13T02:14:52.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.835+0000 7f6e72800700 1 -- start start 2024-06-13T02:14:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.835+0000 7f6e72800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e6c104720 0x7f6e6c19a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.835+0000 7f6e72800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e6c105920 0x7f6e6c19adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.835+0000 7f6e72800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e6c1062c0 0x7f6e6c1a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.835+0000 7f6e72800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c110330 con 0x7f6e6c104720 2024-06-13T02:14:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.835+0000 7f6e72800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c1101b0 con 0x7f6e6c1062c0 2024-06-13T02:14:52.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.835+0000 7f6e72800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6c1104b0 con 0x7f6e6c105920 2024-06-13T02:14:52.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.836+0000 7f6e6aa00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e6c105920 0x7f6e6c19adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:52.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.836+0000 7f6e6b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e6c104720 0x7f6e6c19a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:52.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.836+0000 7f6e6aa00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e6c105920 0x7f6e6c19adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:33486/0 (socket says 172.21.15.2:33486) 2024-06-13T02:14:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.836+0000 7f6e6aa00700 1 -- 172.21.15.2:0/2909587776 learned_addr learned my addr 172.21.15.2:0/2909587776 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:14:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.836+0000 7f6e6be00700 1 --2- 172.21.15.2:0/2909587776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e6c1062c0 0x7f6e6c1a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.836+0000 7f6e6aa00700 1 -- 172.21.15.2:0/2909587776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e6c1062c0 msgr2=0x7f6e6c1a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.836+0000 7f6e6aa00700 1 --2- 172.21.15.2:0/2909587776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e6c1062c0 0x7f6e6c1a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.836+0000 7f6e6aa00700 1 -- 172.21.15.2:0/2909587776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e6c104720 msgr2=0x7f6e6c19a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.836+0000 7f6e6aa00700 1 --2- 172.21.15.2:0/2909587776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e6c104720 0x7f6e6c19a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.836+0000 7f6e6aa00700 1 -- 172.21.15.2:0/2909587776 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6c1a24e0 con 0x7f6e6c105920 2024-06-13T02:14:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.836+0000 7f6e6be00700 1 --2- 172.21.15.2:0/2909587776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e6c1062c0 0x7f6e6c1a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:14:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.837+0000 7f6e6aa00700 1 --2- 172.21.15.2:0/2909587776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e6c105920 0x7f6e6c19adc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800e9d0 tx=0x7f6e5800ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.837+0000 7f6e63e00700 1 -- 172.21.15.2:0/2909587776 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5800cbd0 con 0x7f6e6c105920 2024-06-13T02:14:52.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.837+0000 7f6e63e00700 1 -- 172.21.15.2:0/2909587776 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e5800ee60 con 0x7f6e6c105920 2024-06-13T02:14:52.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.837+0000 7f6e72800700 1 -- 172.21.15.2:0/2909587776 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e6c1a27d0 con 0x7f6e6c105920 2024-06-13T02:14:52.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.837+0000 7f6e63e00700 1 -- 172.21.15.2:0/2909587776 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e58018680 con 0x7f6e6c105920 2024-06-13T02:14:52.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.837+0000 7f6e72800700 1 -- 172.21.15.2:0/2909587776 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e6c1a2d60 con 0x7f6e6c105920 2024-06-13T02:14:52.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.838+0000 7f6e72800700 1 -- 172.21.15.2:0/2909587776 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e6c050a00 con 0x7f6e6c105920 2024-06-13T02:14:52.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.841+0000 7f6e63e00700 1 -- 172.21.15.2:0/2909587776 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f6e58010430 con 0x7f6e6c105920 2024-06-13T02:14:52.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.842+0000 7f6e63e00700 1 --2- 172.21.15.2:0/2909587776 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6e500a2de0 0x7f6e500a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:52.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.843+0000 7f6e63e00700 1 -- 172.21.15.2:0/2909587776 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f6e580cf7a0 con 0x7f6e6c105920 2024-06-13T02:14:52.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.843+0000 7f6e6b400700 1 --2- 172.21.15.2:0/2909587776 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6e500a2de0 0x7f6e500a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:52.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.844+0000 7f6e6b400700 1 --2- 172.21.15.2:0/2909587776 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6e500a2de0 0x7f6e500a52a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00b820 tx=0x7f6e5c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:52.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:52.847+0000 7f6e63e00700 1 -- 172.21.15.2:0/2909587776 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6e5809c150 con 0x7f6e6c105920 2024-06-13T02:14:53.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:53.170+0000 7f6e72800700 1 -- 172.21.15.2:0/2909587776 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f6e6c0630a0 con 0x7f6e6c105920 2024-06-13T02:14:53.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:53.178+0000 7f6e63e00700 1 -- 172.21.15.2:0/2909587776 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f6e5809ba50 con 0x7f6e6c105920 2024-06-13T02:14:53.179 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-06-13T02:14:53.179 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQAdVmpm0SJCChAADRTsRlb0knYzGQAmwgKhCA== 2024-06-13T02:14:53.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:53.182+0000 7f6e72800700 1 -- 172.21.15.2:0/2909587776 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6e500a2de0 msgr2=0x7f6e500a52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:53.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:53.182+0000 7f6e72800700 1 --2- 172.21.15.2:0/2909587776 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6e500a2de0 0x7f6e500a52a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00b820 tx=0x7f6e5c005fd0 comp rx=0 tx=0).stop 2024-06-13T02:14:53.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:53.182+0000 7f6e72800700 1 -- 172.21.15.2:0/2909587776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e6c105920 msgr2=0x7f6e6c19adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:53.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:53.182+0000 7f6e72800700 1 --2- 172.21.15.2:0/2909587776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e6c105920 0x7f6e6c19adc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800e9d0 tx=0x7f6e5800ece0 comp rx=0 tx=0).stop 2024-06-13T02:14:53.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:53.182+0000 7f6e72800700 1 -- 172.21.15.2:0/2909587776 shutdown_connections 2024-06-13T02:14:53.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:53.182+0000 7f6e72800700 1 --2- 172.21.15.2:0/2909587776 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6e500a2de0 0x7f6e500a52a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:53.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:53.182+0000 7f6e72800700 1 --2- 172.21.15.2:0/2909587776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6e6c1062c0 0x7f6e6c1a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:53.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:53.182+0000 7f6e72800700 1 --2- 172.21.15.2:0/2909587776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6e6c104720 0x7f6e6c19a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:53.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:53.182+0000 7f6e72800700 1 --2- 172.21.15.2:0/2909587776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e6c105920 0x7f6e6c19adc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:53.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:53.182+0000 7f6e72800700 1 -- 172.21.15.2:0/2909587776 >> 172.21.15.2:0/2909587776 conn(0x7f6e6c0ffce0 msgr2=0x7f6e6c108bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:53.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:53.183+0000 7f6e72800700 1 -- 172.21.15.2:0/2909587776 shutdown_connections 2024-06-13T02:14:53.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:53.183+0000 7f6e72800700 1 -- 172.21.15.2:0/2909587776 wait complete. 2024-06-13T02:14:53.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:53 smithi002 ceph-mon[31960]: pgmap v404: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-13T02:14:53.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:53 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2909587776' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-13T02:14:53.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:53 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-13T02:14:53.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:53 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-13T02:14:53.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:53 smithi084 ceph-mon[36833]: pgmap v404: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-13T02:14:53.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:53 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2909587776' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-13T02:14:53.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:53 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-13T02:14:53.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:53 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-13T02:14:53.973 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:14:53.973 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-06-13T02:14:53.973 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-13T02:14:54.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:53 smithi175 ceph-mon[36977]: pgmap v404: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-13T02:14:54.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:53 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2909587776' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-13T02:14:54.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:53 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-13T02:14:54.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:53 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-13T02:14:54.119 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-13T02:14:54.119 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-06-13T02:14:54.120 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph mgr dump --format=json 2024-06-13T02:14:54.644 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:14:55.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:55 smithi002 ceph-mon[31960]: pgmap v405: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:14:55.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:55 smithi084 ceph-mon[36833]: pgmap v405: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:14:56.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:55 smithi175 ceph-mon[36977]: pgmap v405: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:14:56.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.976+0000 7f4a8f000700 1 -- 172.21.15.2:0/1765238451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a881046a0 msgr2=0x7f4a88104b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:56.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.976+0000 7f4a8f000700 1 --2- 172.21.15.2:0/1765238451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a881046a0 0x7f4a88104b20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a70009990 tx=0x7f4a70009ca0 comp rx=0 tx=0).stop 2024-06-13T02:14:56.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.977+0000 7f4a8f000700 1 -- 172.21.15.2:0/1765238451 shutdown_connections 2024-06-13T02:14:56.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.977+0000 7f4a8f000700 1 --2- 172.21.15.2:0/1765238451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a88105060 0x7f4a88111570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:56.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.977+0000 7f4a8f000700 1 --2- 172.21.15.2:0/1765238451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a8810a6a0 0x7f4a8810aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:56.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.977+0000 7f4a8f000700 1 --2- 172.21.15.2:0/1765238451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a881046a0 0x7f4a88104b20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:56.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.977+0000 7f4a8f000700 1 -- 172.21.15.2:0/1765238451 >> 172.21.15.2:0/1765238451 conn(0x7f4a88100190 msgr2=0x7f4a881025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:56.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.977+0000 7f4a8f000700 1 -- 172.21.15.2:0/1765238451 shutdown_connections 2024-06-13T02:14:56.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.977+0000 7f4a8f000700 1 -- 172.21.15.2:0/1765238451 wait complete. 2024-06-13T02:14:56.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.978+0000 7f4a8f000700 1 Processor -- start 2024-06-13T02:14:56.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.978+0000 7f4a8f000700 1 -- start start 2024-06-13T02:14:56.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.978+0000 7f4a8f000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a881046a0 0x7f4a8819ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:56.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.978+0000 7f4a8f000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a88105060 0x7f4a8819b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:56.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.978+0000 7f4a8f000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a8810a6a0 0x7f4a8819f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:56.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.978+0000 7f4a8f000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4a881149d0 con 0x7f4a88105060 2024-06-13T02:14:56.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.978+0000 7f4a8f000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4a88114850 con 0x7f4a8810a6a0 2024-06-13T02:14:56.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.978+0000 7f4a8f000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4a88114b50 con 0x7f4a881046a0 2024-06-13T02:14:56.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.979+0000 7f4a7fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a88105060 0x7f4a8819b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:56.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.979+0000 7f4a7fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a88105060 0x7f4a8819b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40824/0 (socket says 172.21.15.2:40824) 2024-06-13T02:14:56.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.979+0000 7f4a7fe00700 1 -- 172.21.15.2:0/396933463 learned_addr learned my addr 172.21.15.2:0/396933463 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:14:56.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.979+0000 7f4a87e00700 1 --2- 172.21.15.2:0/396933463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a881046a0 0x7f4a8819ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:56.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.979+0000 7f4a8d000700 1 --2- 172.21.15.2:0/396933463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a8810a6a0 0x7f4a8819f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:56.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.979+0000 7f4a87e00700 1 -- 172.21.15.2:0/396933463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a8810a6a0 msgr2=0x7f4a8819f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:56.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.979+0000 7f4a87e00700 1 --2- 172.21.15.2:0/396933463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a8810a6a0 0x7f4a8819f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:56.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.979+0000 7f4a87e00700 1 -- 172.21.15.2:0/396933463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a88105060 msgr2=0x7f4a8819b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:56.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.979+0000 7f4a87e00700 1 --2- 172.21.15.2:0/396933463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a88105060 0x7f4a8819b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:56.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.979+0000 7f4a87e00700 1 -- 172.21.15.2:0/396933463 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8819fe90 con 0x7f4a881046a0 2024-06-13T02:14:56.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.979+0000 7f4a7fe00700 1 --2- 172.21.15.2:0/396933463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a88105060 0x7f4a8819b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:14:56.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.980+0000 7f4a87e00700 1 --2- 172.21.15.2:0/396933463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a881046a0 0x7f4a8819ae80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4a7800e9f0 tx=0x7f4a7800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:56.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.980+0000 7f4a85600700 1 -- 172.21.15.2:0/396933463 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7800cb70 con 0x7f4a881046a0 2024-06-13T02:14:56.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.980+0000 7f4a85600700 1 -- 172.21.15.2:0/396933463 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a7800ee90 con 0x7f4a881046a0 2024-06-13T02:14:56.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.980+0000 7f4a85600700 1 -- 172.21.15.2:0/396933463 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78003dc0 con 0x7f4a881046a0 2024-06-13T02:14:56.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.980+0000 7f4a8f000700 1 -- 172.21.15.2:0/396933463 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a881a0180 con 0x7f4a881046a0 2024-06-13T02:14:56.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.980+0000 7f4a8f000700 1 -- 172.21.15.2:0/396933463 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a881a7a00 con 0x7f4a881046a0 2024-06-13T02:14:56.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.981+0000 7f4a8f000700 1 -- 172.21.15.2:0/396933463 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a88069180 con 0x7f4a881046a0 2024-06-13T02:14:56.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.983+0000 7f4a85600700 1 -- 172.21.15.2:0/396933463 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f4a78003fa0 con 0x7f4a881046a0 2024-06-13T02:14:56.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.984+0000 7f4a85600700 1 --2- 172.21.15.2:0/396933463 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f4a6c0a2cb0 0x7f4a6c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:14:56.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.985+0000 7f4a85600700 1 -- 172.21.15.2:0/396933463 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f4a780cf700 con 0x7f4a881046a0 2024-06-13T02:14:56.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.985+0000 7f4a7fe00700 1 --2- 172.21.15.2:0/396933463 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f4a6c0a2cb0 0x7f4a6c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:14:56.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.986+0000 7f4a7fe00700 1 --2- 172.21.15.2:0/396933463 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f4a6c0a2cb0 0x7f4a6c0a5170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4a88109a80 tx=0x7f4a70009590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:14:56.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:56.989+0000 7f4a85600700 1 -- 172.21.15.2:0/396933463 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4a7809c0b0 con 0x7f4a881046a0 2024-06-13T02:14:57.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:57.285+0000 7f4a8f000700 1 -- 172.21.15.2:0/396933463 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4a8819c1e0 con 0x7f4a881046a0 2024-06-13T02:14:57.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:57.291+0000 7f4a85600700 1 -- 172.21.15.2:0/396933463 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263188 (secure 0 0 0) 0x7f4a7809b9b0 con 0x7f4a881046a0 2024-06-13T02:14:57.295 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:14:57.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:57.299+0000 7f4a8f000700 1 -- 172.21.15.2:0/396933463 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f4a6c0a2cb0 msgr2=0x7f4a6c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:57.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:57.299+0000 7f4a8f000700 1 --2- 172.21.15.2:0/396933463 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f4a6c0a2cb0 0x7f4a6c0a5170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4a88109a80 tx=0x7f4a70009590 comp rx=0 tx=0).stop 2024-06-13T02:14:57.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:57.299+0000 7f4a8f000700 1 -- 172.21.15.2:0/396933463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a881046a0 msgr2=0x7f4a8819ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:14:57.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:57.299+0000 7f4a8f000700 1 --2- 172.21.15.2:0/396933463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a881046a0 0x7f4a8819ae80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4a7800e9f0 tx=0x7f4a7800ed00 comp rx=0 tx=0).stop 2024-06-13T02:14:57.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:57.299+0000 7f4a8f000700 1 -- 172.21.15.2:0/396933463 shutdown_connections 2024-06-13T02:14:57.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:57.299+0000 7f4a8f000700 1 --2- 172.21.15.2:0/396933463 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f4a6c0a2cb0 0x7f4a6c0a5170 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:57.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:57.299+0000 7f4a8f000700 1 --2- 172.21.15.2:0/396933463 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a8810a6a0 0x7f4a8819f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:57.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:57.299+0000 7f4a8f000700 1 --2- 172.21.15.2:0/396933463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a881046a0 0x7f4a8819ae80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:57.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:57.299+0000 7f4a8f000700 1 --2- 172.21.15.2:0/396933463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a88105060 0x7f4a8819b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:14:57.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:57.299+0000 7f4a8f000700 1 -- 172.21.15.2:0/396933463 >> 172.21.15.2:0/396933463 conn(0x7f4a88100190 msgr2=0x7f4a881006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:14:57.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:57.300+0000 7f4a8f000700 1 -- 172.21.15.2:0/396933463 shutdown_connections 2024-06-13T02:14:57.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:14:57.300+0000 7f4a8f000700 1 -- 172.21.15.2:0/396933463 wait complete. 2024-06-13T02:14:57.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:57 smithi002 ceph-mon[31960]: pgmap v406: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:14:57.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:57 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/396933463' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-13T02:14:57.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:57 smithi084 ceph-mon[36833]: pgmap v406: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:14:57.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:57 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/396933463' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-13T02:14:58.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:57 smithi175 ceph-mon[36977]: pgmap v406: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:14:58.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:57 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/396933463' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-13T02:14:58.098 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":2988831869},{"type":"v1","addr":"172.21.15.2:6801","nonce":2988831869}]},"active_addr":"172.21.15.2:6801/2988831869","active_change":"2024-06-13T02:04:24.281415+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.2:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":544481430}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":968145683}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":1200045905}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3011421954}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":79158539}]}]} 2024-06-13T02:14:58.103 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-06-13T02:14:58.103 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-06-13T02:14:58.104 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T02:14:58.604 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:14:59.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:14:59 smithi002 ceph-mon[31960]: pgmap v407: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:14:59.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:14:59 smithi084 ceph-mon[36833]: pgmap v407: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:15:00.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:14:59 smithi175 ceph-mon[36977]: pgmap v407: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:15:00.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.912+0000 7fa35b400700 1 -- 172.21.15.2:0/3664232891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa35406ab10 msgr2=0x7fa35410f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:00.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.912+0000 7fa35b400700 1 --2- 172.21.15.2:0/3664232891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa35406ab10 0x7fa35410f320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0098f0 tx=0x7fa34c009c00 comp rx=0 tx=0).stop 2024-06-13T02:15:00.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.912+0000 7fa35b400700 1 -- 172.21.15.2:0/3664232891 shutdown_connections 2024-06-13T02:15:00.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.912+0000 7fa35b400700 1 --2- 172.21.15.2:0/3664232891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa35406ab10 0x7fa35410f320 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:00.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.912+0000 7fa35b400700 1 --2- 172.21.15.2:0/3664232891 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3541084e0 0x7fa3541088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:00.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.912+0000 7fa35b400700 1 --2- 172.21.15.2:0/3664232891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa35406a170 0x7fa35406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:00.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.912+0000 7fa35b400700 1 -- 172.21.15.2:0/3664232891 >> 172.21.15.2:0/3664232891 conn(0x7fa3540782c0 msgr2=0x7fa3540786d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:00.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.912+0000 7fa35b400700 1 -- 172.21.15.2:0/3664232891 shutdown_connections 2024-06-13T02:15:00.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.913+0000 7fa35b400700 1 -- 172.21.15.2:0/3664232891 wait complete. 2024-06-13T02:15:00.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.915+0000 7fa35b400700 1 Processor -- start 2024-06-13T02:15:00.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.915+0000 7fa35b400700 1 -- start start 2024-06-13T02:15:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.915+0000 7fa35b400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa35406a170 0x7fa35419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.915+0000 7fa35b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35406ab10 0x7fa35419edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.916+0000 7fa35b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3541084e0 0x7fa354198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.916+0000 7fa35b400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa3541127b0 con 0x7fa35406ab10 2024-06-13T02:15:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.916+0000 7fa35b400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa354112630 con 0x7fa3541084e0 2024-06-13T02:15:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.916+0000 7fa35b400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa354112930 con 0x7fa35406a170 2024-06-13T02:15:00.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.916+0000 7fa353e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35406ab10 0x7fa35419edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:00.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.916+0000 7fa353e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35406ab10 0x7fa35419edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40846/0 (socket says 172.21.15.2:40846) 2024-06-13T02:15:00.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.916+0000 7fa358a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa35406a170 0x7fa35419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.916+0000 7fa353e00700 1 -- 172.21.15.2:0/384983223 learned_addr learned my addr 172.21.15.2:0/384983223 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.916+0000 7fa359400700 1 --2- 172.21.15.2:0/384983223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3541084e0 0x7fa354198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.916+0000 7fa353e00700 1 -- 172.21.15.2:0/384983223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa35406a170 msgr2=0x7fa35419e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.916+0000 7fa353e00700 1 --2- 172.21.15.2:0/384983223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa35406a170 0x7fa35419e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.916+0000 7fa353e00700 1 -- 172.21.15.2:0/384983223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3541084e0 msgr2=0x7fa354198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.916+0000 7fa353e00700 1 --2- 172.21.15.2:0/384983223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3541084e0 0x7fa354198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.917+0000 7fa353e00700 1 -- 172.21.15.2:0/384983223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3541991b0 con 0x7fa35406ab10 2024-06-13T02:15:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.917+0000 7fa359400700 1 --2- 172.21.15.2:0/384983223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3541084e0 0x7fa354198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:15:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.917+0000 7fa358a00700 1 --2- 172.21.15.2:0/384983223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa35406a170 0x7fa35419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:15:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.917+0000 7fa353e00700 1 --2- 172.21.15.2:0/384983223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35406ab10 0x7fa35419edd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa34000e9c0 tx=0x7fa34000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.917+0000 7fa351600700 1 -- 172.21.15.2:0/384983223 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34000cbd0 con 0x7fa35406ab10 2024-06-13T02:15:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.917+0000 7fa35b400700 1 -- 172.21.15.2:0/384983223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3541994a0 con 0x7fa35406ab10 2024-06-13T02:15:00.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.917+0000 7fa351600700 1 -- 172.21.15.2:0/384983223 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa34000ee60 con 0x7fa35406ab10 2024-06-13T02:15:00.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.917+0000 7fa351600700 1 -- 172.21.15.2:0/384983223 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa340005630 con 0x7fa35406ab10 2024-06-13T02:15:00.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.918+0000 7fa35b400700 1 -- 172.21.15.2:0/384983223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa354101390 con 0x7fa35406ab10 2024-06-13T02:15:00.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.919+0000 7fa35b400700 1 -- 172.21.15.2:0/384983223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa354069180 con 0x7fa35406ab10 2024-06-13T02:15:00.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.921+0000 7fa351600700 1 -- 172.21.15.2:0/384983223 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fa340004750 con 0x7fa35406ab10 2024-06-13T02:15:00.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.922+0000 7fa351600700 1 --2- 172.21.15.2:0/384983223 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa33c0a2d30 0x7fa33c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:00.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.922+0000 7fa351600700 1 -- 172.21.15.2:0/384983223 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fa3400cf840 con 0x7fa35406ab10 2024-06-13T02:15:00.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.922+0000 7fa358a00700 1 --2- 172.21.15.2:0/384983223 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa33c0a2d30 0x7fa33c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:00.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.923+0000 7fa358a00700 1 --2- 172.21.15.2:0/384983223 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa33c0a2d30 0x7fa33c0a51f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa354199b90 tx=0x7fa34800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:00.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:00.927+0000 7fa351600700 1 -- 172.21.15.2:0/384983223 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa34009c1f0 con 0x7fa35406ab10 2024-06-13T02:15:01.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:01.158+0000 7fa35b400700 1 -- 172.21.15.2:0/384983223 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa354199fb0 con 0x7fa35406ab10 2024-06-13T02:15:01.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:01.163+0000 7fa351600700 1 -- 172.21.15.2:0/384983223 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+24854 (secure 0 0 0) 0x7fa354199fb0 con 0x7fa35406ab10 2024-06-13T02:15:01.165 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:15:01.165 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":100,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","created":"2024-06-13T02:03:16.412002+0000","modified":"2024-06-13T02:14:25.693752+0000","last_up_change":"2024-06-13T02:11:26.464184+0000","last_in_change":"2024-06-13T02:11:06.957351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T02:07:10.994857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T02:12:34.674172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T02:12:39.213985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T02:12:53.098590+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96b4d494-453c-48aa-b1e2-ee30dfa83e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6803","nonce":3254812126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6805","nonce":3254812126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6809","nonce":3254812126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6807","nonce":3254812126}]},"public_addr":"172.21.15.2:6803/3254812126","cluster_addr":"172.21.15.2:6805/3254812126","heartbeat_back_addr":"172.21.15.2:6809/3254812126","heartbeat_front_addr":"172.21.15.2:6807/3254812126","state":["exists","up"]},{"osd":1,"uuid":"856e86b6-9281-485b-a36b-2fe04de31329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6801","nonce":1593775403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6803","nonce":1593775403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6807","nonce":1593775403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6805","nonce":1593775403}]},"public_addr":"172.21.15.84:6801/1593775403","cluster_addr":"172.21.15.84:6803/1593775403","heartbeat_back_addr":"172.21.15.84:6807/1593775403","heartbeat_front_addr":"172.21.15.84:6805/1593775403","state":["exists","up"]},{"osd":2,"uuid":"8c9daa52-0dfb-471a-afb4-6eb0b908195a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6801","nonce":2174304558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6803","nonce":2174304558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6807","nonce":2174304558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6805","nonce":2174304558}]},"public_addr":"172.21.15.175:6801/2174304558","cluster_addr":"172.21.15.175:6803/2174304558","heartbeat_back_addr":"172.21.15.175:6807/2174304558","heartbeat_front_addr":"172.21.15.175:6805/2174304558","state":["exists","up"]},{"osd":3,"uuid":"2e747d36-4aa5-4c4c-918d-b8100980cc8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6811","nonce":3010864289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6813","nonce":3010864289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6817","nonce":3010864289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6815","nonce":3010864289}]},"public_addr":"172.21.15.2:6811/3010864289","cluster_addr":"172.21.15.2:6813/3010864289","heartbeat_back_addr":"172.21.15.2:6817/3010864289","heartbeat_front_addr":"172.21.15.2:6815/3010864289","state":["exists","up"]},{"osd":4,"uuid":"bd063fb2-1a65-4b18-898c-f80ddc2a1229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6809","nonce":2541323390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6811","nonce":2541323390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6815","nonce":2541323390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6813","nonce":2541323390}]},"public_addr":"172.21.15.84:6809/2541323390","cluster_addr":"172.21.15.84:6811/2541323390","heartbeat_back_addr":"172.21.15.84:6815/2541323390","heartbeat_front_addr":"172.21.15.84:6813/2541323390","state":["exists","up"]},{"osd":5,"uuid":"e0ea80fd-1bfe-4d2e-9733-ff442ec015b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6809","nonce":764262885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6811","nonce":764262885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6815","nonce":764262885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6813","nonce":764262885}]},"public_addr":"172.21.15.175:6809/764262885","cluster_addr":"172.21.15.175:6811/764262885","heartbeat_back_addr":"172.21.15.175:6815/764262885","heartbeat_front_addr":"172.21.15.175:6813/764262885","state":["exists","up"]},{"osd":6,"uuid":"1c204d74-5e48-4e2e-bb98-6a8d4974187c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6819","nonce":297321106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6821","nonce":297321106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6825","nonce":297321106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6823","nonce":297321106}]},"public_addr":"172.21.15.2:6819/297321106","cluster_addr":"172.21.15.2:6821/297321106","heartbeat_back_addr":"172.21.15.2:6825/297321106","heartbeat_front_addr":"172.21.15.2:6823/297321106","state":["exists","up"]},{"osd":7,"uuid":"1299bbb1-fbfb-4aba-be6b-6704691735f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6817","nonce":3873726653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6819","nonce":3873726653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6823","nonce":3873726653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6821","nonce":3873726653}]},"public_addr":"172.21.15.84:6817/3873726653","cluster_addr":"172.21.15.84:6819/3873726653","heartbeat_back_addr":"172.21.15.84:6823/3873726653","heartbeat_front_addr":"172.21.15.84:6821/3873726653","state":["exists","up"]},{"osd":8,"uuid":"9c3f2a92-d956-4246-bce9-620824d0da22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6817","nonce":2622818232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6819","nonce":2622818232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6823","nonce":2622818232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6821","nonce":2622818232}]},"public_addr":"172.21.15.175:6817/2622818232","cluster_addr":"172.21.15.175:6819/2622818232","heartbeat_back_addr":"172.21.15.175:6823/2622818232","heartbeat_front_addr":"172.21.15.175:6821/2622818232","state":["exists","up"]},{"osd":9,"uuid":"e9839f78-05c6-4b3f-bc14-cb771a03ff5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6827","nonce":1171735390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6829","nonce":1171735390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6833","nonce":1171735390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6831","nonce":1171735390}]},"public_addr":"172.21.15.2:6827/1171735390","cluster_addr":"172.21.15.2:6829/1171735390","heartbeat_back_addr":"172.21.15.2:6833/1171735390","heartbeat_front_addr":"172.21.15.2:6831/1171735390","state":["exists","up"]},{"osd":10,"uuid":"66719431-5ba9-4865-957b-f6582e607a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6825","nonce":4269523460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6827","nonce":4269523460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6831","nonce":4269523460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6829","nonce":4269523460}]},"public_addr":"172.21.15.84:6825/4269523460","cluster_addr":"172.21.15.84:6827/4269523460","heartbeat_back_addr":"172.21.15.84:6831/4269523460","heartbeat_front_addr":"172.21.15.84:6829/4269523460","state":["exists","up"]},{"osd":11,"uuid":"1ce6e6ee-6ff3-416f-b985-e3afe503093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6825","nonce":2762894732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6827","nonce":2762894732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6831","nonce":2762894732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6829","nonce":2762894732}]},"public_addr":"172.21.15.175:6825/2762894732","cluster_addr":"172.21.15.175:6827/2762894732","heartbeat_back_addr":"172.21.15.175:6831/2762894732","heartbeat_front_addr":"172.21.15.175:6829/2762894732","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:16.956638+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:42.268685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:06.272084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:39.696927+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:06.182991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:31.626603+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:05.247728+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:31.985114+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:57.474180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:31.988863+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:59.683056+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:11:24.493248+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6800/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3397168014":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/1789744365":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3831398703":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/3119270562":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/2163302458":"2024-06-14T02:03:50.073572+0000","172.21.15.2:6800/2830681579":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/1678672435":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6801/2830681579":"2024-06-14T02:03:50.073572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T02:15:01.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:01.166+0000 7fa35b400700 1 -- 172.21.15.2:0/384983223 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa33c0a2d30 msgr2=0x7fa33c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:01.166+0000 7fa35b400700 1 --2- 172.21.15.2:0/384983223 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa33c0a2d30 0x7fa33c0a51f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa354199b90 tx=0x7fa34800b040 comp rx=0 tx=0).stop 2024-06-13T02:15:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:01.166+0000 7fa35b400700 1 -- 172.21.15.2:0/384983223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35406ab10 msgr2=0x7fa35419edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:01.166+0000 7fa35b400700 1 --2- 172.21.15.2:0/384983223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35406ab10 0x7fa35419edd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa34000e9c0 tx=0x7fa34000ecd0 comp rx=0 tx=0).stop 2024-06-13T02:15:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:01.166+0000 7fa35b400700 1 -- 172.21.15.2:0/384983223 shutdown_connections 2024-06-13T02:15:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:01.166+0000 7fa35b400700 1 --2- 172.21.15.2:0/384983223 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fa33c0a2d30 0x7fa33c0a51f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:01.166+0000 7fa35b400700 1 --2- 172.21.15.2:0/384983223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3541084e0 0x7fa354198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:01.166+0000 7fa35b400700 1 --2- 172.21.15.2:0/384983223 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa35406a170 0x7fa35419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:01.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:01.166+0000 7fa35b400700 1 --2- 172.21.15.2:0/384983223 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa35406ab10 0x7fa35419edd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:01.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:01.166+0000 7fa35b400700 1 -- 172.21.15.2:0/384983223 >> 172.21.15.2:0/384983223 conn(0x7fa3540782c0 msgr2=0x7fa3540ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:01.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:01.166+0000 7fa35b400700 1 -- 172.21.15.2:0/384983223 shutdown_connections 2024-06-13T02:15:01.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:01.166+0000 7fa35b400700 1 -- 172.21.15.2:0/384983223 wait complete. 2024-06-13T02:15:01.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:01 smithi002 ceph-mon[31960]: pgmap v408: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:15:01.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:01 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/384983223' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:15:01.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:01 smithi084 ceph-mon[36833]: pgmap v408: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:15:01.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:01 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/384983223' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:15:02.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:01 smithi175 ceph-mon[36977]: pgmap v408: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:15:02.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:01 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/384983223' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:15:02.089 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-06-13T02:15:02.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T02:15:02.574 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:03.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:03 smithi002 ceph-mon[31960]: pgmap v409: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:15:03.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:03 smithi084 ceph-mon[36833]: pgmap v409: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:15:04.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:03 smithi175 ceph-mon[36977]: pgmap v409: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:15:04.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.916+0000 7f5eaee00700 1 -- 172.21.15.2:0/2290357514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8100a80 msgr2=0x7f5ea8100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:04.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.916+0000 7f5eaee00700 1 --2- 172.21.15.2:0/2290357514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8100a80 0x7f5ea8100f00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5e94009990 tx=0x7f5e94009ca0 comp rx=0 tx=0).stop 2024-06-13T02:15:04.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.916+0000 7f5eaee00700 1 -- 172.21.15.2:0/2290357514 shutdown_connections 2024-06-13T02:15:04.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.916+0000 7f5eaee00700 1 --2- 172.21.15.2:0/2290357514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ea8101440 0x7f5ea810f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:04.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.916+0000 7f5eaee00700 1 --2- 172.21.15.2:0/2290357514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea8108510 0x7f5ea81088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:04.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.916+0000 7f5eaee00700 1 --2- 172.21.15.2:0/2290357514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8100a80 0x7f5ea8100f00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:04.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.916+0000 7f5eaee00700 1 -- 172.21.15.2:0/2290357514 >> 172.21.15.2:0/2290357514 conn(0x7f5ea8077a00 msgr2=0x7f5ea80fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:04.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.916+0000 7f5eaee00700 1 -- 172.21.15.2:0/2290357514 shutdown_connections 2024-06-13T02:15:04.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.916+0000 7f5eaee00700 1 -- 172.21.15.2:0/2290357514 wait complete. 2024-06-13T02:15:04.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.918+0000 7f5eaee00700 1 Processor -- start 2024-06-13T02:15:04.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.918+0000 7f5eaee00700 1 -- start start 2024-06-13T02:15:04.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.919+0000 7f5eaee00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ea8100a80 0x7f5ea819e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:04.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.919+0000 7f5eaee00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea8101440 0x7f5ea819ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:04.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.919+0000 7f5eaee00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8108510 0x7f5ea8198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:04.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.919+0000 7f5eaee00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea81127c0 con 0x7f5ea8108510 2024-06-13T02:15:04.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.919+0000 7f5eaee00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea8112640 con 0x7f5ea8101440 2024-06-13T02:15:04.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.919+0000 7f5eaee00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea8112940 con 0x7f5ea8100a80 2024-06-13T02:15:04.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.919+0000 7f5eace00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8108510 0x7f5ea8198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:04.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.919+0000 7f5eace00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8108510 0x7f5ea8198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49688/0 (socket says 172.21.15.2:49688) 2024-06-13T02:15:04.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.919+0000 7f5eace00700 1 -- 172.21.15.2:0/479705480 learned_addr learned my addr 172.21.15.2:0/479705480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:04.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.919+0000 7f5ea7e00700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ea8100a80 0x7f5ea819e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:04.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.919+0000 7f5ea7400700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea8101440 0x7f5ea819ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:04.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.919+0000 7f5eace00700 1 -- 172.21.15.2:0/479705480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ea8100a80 msgr2=0x7f5ea819e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:04.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.920+0000 7f5eace00700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ea8100a80 0x7f5ea819e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:04.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.920+0000 7f5eace00700 1 -- 172.21.15.2:0/479705480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea8101440 msgr2=0x7f5ea819ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:04.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.920+0000 7f5eace00700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea8101440 0x7f5ea819ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:04.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.920+0000 7f5eace00700 1 -- 172.21.15.2:0/479705480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea8199200 con 0x7f5ea8108510 2024-06-13T02:15:04.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.920+0000 7f5ea7e00700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ea8100a80 0x7f5ea819e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:15:04.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.920+0000 7f5ea7400700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea8101440 0x7f5ea819ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:15:04.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.920+0000 7f5eace00700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8108510 0x7f5ea8198aa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000ef30 tx=0x7f5ea000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:04.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.920+0000 7f5ea4c00700 1 -- 172.21.15.2:0/479705480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00092e0 con 0x7f5ea8108510 2024-06-13T02:15:04.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.920+0000 7f5ea4c00700 1 -- 172.21.15.2:0/479705480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ea0004bb0 con 0x7f5ea8108510 2024-06-13T02:15:04.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.920+0000 7f5eaee00700 1 -- 172.21.15.2:0/479705480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea8199490 con 0x7f5ea8108510 2024-06-13T02:15:04.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.920+0000 7f5ea4c00700 1 -- 172.21.15.2:0/479705480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0004280 con 0x7f5ea8108510 2024-06-13T02:15:04.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.920+0000 7f5eaee00700 1 -- 172.21.15.2:0/479705480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea81a57b0 con 0x7f5ea8108510 2024-06-13T02:15:04.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.922+0000 7f5eaee00700 1 -- 172.21.15.2:0/479705480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea8069180 con 0x7f5ea8108510 2024-06-13T02:15:04.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.924+0000 7f5ea4c00700 1 -- 172.21.15.2:0/479705480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f5ea001b030 con 0x7f5ea8108510 2024-06-13T02:15:04.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.925+0000 7f5ea4c00700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f5e8c0a2d30 0x7f5e8c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:04.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.925+0000 7f5ea4c00700 1 -- 172.21.15.2:0/479705480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f5ea00cf080 con 0x7f5ea8108510 2024-06-13T02:15:04.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.925+0000 7f5ea7e00700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f5e8c0a2d30 0x7f5e8c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:04.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.926+0000 7f5ea7e00700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f5e8c0a2d30 0x7f5e8c0a51f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009680 tx=0x7f5e98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:04.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:04.930+0000 7f5ea4c00700 1 -- 172.21.15.2:0/479705480 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f5ea0022020 con 0x7f5ea8108510 2024-06-13T02:15:05.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:05.162+0000 7f5eaee00700 1 -- 172.21.15.2:0/479705480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ea802dca0 con 0x7f5ea8108510 2024-06-13T02:15:05.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:05.166+0000 7f5ea4c00700 1 -- 172.21.15.2:0/479705480 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+24854 (secure 0 0 0) 0x7f5ea0010040 con 0x7f5ea8108510 2024-06-13T02:15:05.169 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:15:05.169 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":100,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","created":"2024-06-13T02:03:16.412002+0000","modified":"2024-06-13T02:14:25.693752+0000","last_up_change":"2024-06-13T02:11:26.464184+0000","last_in_change":"2024-06-13T02:11:06.957351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T02:07:10.994857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T02:12:34.674172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T02:12:39.213985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T02:12:53.098590+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96b4d494-453c-48aa-b1e2-ee30dfa83e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6803","nonce":3254812126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6805","nonce":3254812126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6809","nonce":3254812126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6807","nonce":3254812126}]},"public_addr":"172.21.15.2:6803/3254812126","cluster_addr":"172.21.15.2:6805/3254812126","heartbeat_back_addr":"172.21.15.2:6809/3254812126","heartbeat_front_addr":"172.21.15.2:6807/3254812126","state":["exists","up"]},{"osd":1,"uuid":"856e86b6-9281-485b-a36b-2fe04de31329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6801","nonce":1593775403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6803","nonce":1593775403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6807","nonce":1593775403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6805","nonce":1593775403}]},"public_addr":"172.21.15.84:6801/1593775403","cluster_addr":"172.21.15.84:6803/1593775403","heartbeat_back_addr":"172.21.15.84:6807/1593775403","heartbeat_front_addr":"172.21.15.84:6805/1593775403","state":["exists","up"]},{"osd":2,"uuid":"8c9daa52-0dfb-471a-afb4-6eb0b908195a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6801","nonce":2174304558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6803","nonce":2174304558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6807","nonce":2174304558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6805","nonce":2174304558}]},"public_addr":"172.21.15.175:6801/2174304558","cluster_addr":"172.21.15.175:6803/2174304558","heartbeat_back_addr":"172.21.15.175:6807/2174304558","heartbeat_front_addr":"172.21.15.175:6805/2174304558","state":["exists","up"]},{"osd":3,"uuid":"2e747d36-4aa5-4c4c-918d-b8100980cc8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6811","nonce":3010864289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6813","nonce":3010864289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6817","nonce":3010864289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6815","nonce":3010864289}]},"public_addr":"172.21.15.2:6811/3010864289","cluster_addr":"172.21.15.2:6813/3010864289","heartbeat_back_addr":"172.21.15.2:6817/3010864289","heartbeat_front_addr":"172.21.15.2:6815/3010864289","state":["exists","up"]},{"osd":4,"uuid":"bd063fb2-1a65-4b18-898c-f80ddc2a1229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6809","nonce":2541323390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6811","nonce":2541323390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6815","nonce":2541323390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6813","nonce":2541323390}]},"public_addr":"172.21.15.84:6809/2541323390","cluster_addr":"172.21.15.84:6811/2541323390","heartbeat_back_addr":"172.21.15.84:6815/2541323390","heartbeat_front_addr":"172.21.15.84:6813/2541323390","state":["exists","up"]},{"osd":5,"uuid":"e0ea80fd-1bfe-4d2e-9733-ff442ec015b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6809","nonce":764262885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6811","nonce":764262885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6815","nonce":764262885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6813","nonce":764262885}]},"public_addr":"172.21.15.175:6809/764262885","cluster_addr":"172.21.15.175:6811/764262885","heartbeat_back_addr":"172.21.15.175:6815/764262885","heartbeat_front_addr":"172.21.15.175:6813/764262885","state":["exists","up"]},{"osd":6,"uuid":"1c204d74-5e48-4e2e-bb98-6a8d4974187c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6819","nonce":297321106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6821","nonce":297321106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6825","nonce":297321106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6823","nonce":297321106}]},"public_addr":"172.21.15.2:6819/297321106","cluster_addr":"172.21.15.2:6821/297321106","heartbeat_back_addr":"172.21.15.2:6825/297321106","heartbeat_front_addr":"172.21.15.2:6823/297321106","state":["exists","up"]},{"osd":7,"uuid":"1299bbb1-fbfb-4aba-be6b-6704691735f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6817","nonce":3873726653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6819","nonce":3873726653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6823","nonce":3873726653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6821","nonce":3873726653}]},"public_addr":"172.21.15.84:6817/3873726653","cluster_addr":"172.21.15.84:6819/3873726653","heartbeat_back_addr":"172.21.15.84:6823/3873726653","heartbeat_front_addr":"172.21.15.84:6821/3873726653","state":["exists","up"]},{"osd":8,"uuid":"9c3f2a92-d956-4246-bce9-620824d0da22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6817","nonce":2622818232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6819","nonce":2622818232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6823","nonce":2622818232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6821","nonce":2622818232}]},"public_addr":"172.21.15.175:6817/2622818232","cluster_addr":"172.21.15.175:6819/2622818232","heartbeat_back_addr":"172.21.15.175:6823/2622818232","heartbeat_front_addr":"172.21.15.175:6821/2622818232","state":["exists","up"]},{"osd":9,"uuid":"e9839f78-05c6-4b3f-bc14-cb771a03ff5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6827","nonce":1171735390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6829","nonce":1171735390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6833","nonce":1171735390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6831","nonce":1171735390}]},"public_addr":"172.21.15.2:6827/1171735390","cluster_addr":"172.21.15.2:6829/1171735390","heartbeat_back_addr":"172.21.15.2:6833/1171735390","heartbeat_front_addr":"172.21.15.2:6831/1171735390","state":["exists","up"]},{"osd":10,"uuid":"66719431-5ba9-4865-957b-f6582e607a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6825","nonce":4269523460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6827","nonce":4269523460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6831","nonce":4269523460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6829","nonce":4269523460}]},"public_addr":"172.21.15.84:6825/4269523460","cluster_addr":"172.21.15.84:6827/4269523460","heartbeat_back_addr":"172.21.15.84:6831/4269523460","heartbeat_front_addr":"172.21.15.84:6829/4269523460","state":["exists","up"]},{"osd":11,"uuid":"1ce6e6ee-6ff3-416f-b985-e3afe503093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6825","nonce":2762894732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6827","nonce":2762894732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6831","nonce":2762894732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6829","nonce":2762894732}]},"public_addr":"172.21.15.175:6825/2762894732","cluster_addr":"172.21.15.175:6827/2762894732","heartbeat_back_addr":"172.21.15.175:6831/2762894732","heartbeat_front_addr":"172.21.15.175:6829/2762894732","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:16.956638+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:42.268685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:06.272084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:39.696927+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:06.182991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:31.626603+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:05.247728+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:31.985114+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:57.474180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:31.988863+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:59.683056+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:11:24.493248+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6800/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3397168014":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/1789744365":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3831398703":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/3119270562":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/2163302458":"2024-06-14T02:03:50.073572+0000","172.21.15.2:6800/2830681579":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/1678672435":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6801/2830681579":"2024-06-14T02:03:50.073572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T02:15:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:05.169+0000 7f5eaee00700 1 -- 172.21.15.2:0/479705480 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f5e8c0a2d30 msgr2=0x7f5e8c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:05.169+0000 7f5eaee00700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f5e8c0a2d30 0x7f5e8c0a51f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009680 tx=0x7f5e98009260 comp rx=0 tx=0).stop 2024-06-13T02:15:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:05.169+0000 7f5eaee00700 1 -- 172.21.15.2:0/479705480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8108510 msgr2=0x7f5ea8198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:05.169+0000 7f5eaee00700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8108510 0x7f5ea8198aa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000ef30 tx=0x7f5ea000c3a0 comp rx=0 tx=0).stop 2024-06-13T02:15:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:05.170+0000 7f5eaee00700 1 -- 172.21.15.2:0/479705480 shutdown_connections 2024-06-13T02:15:05.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:05.170+0000 7f5eaee00700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f5e8c0a2d30 0x7f5e8c0a51f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:05.170+0000 7f5eaee00700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ea8108510 0x7f5ea8198aa0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:05.170+0000 7f5eaee00700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ea8100a80 0x7f5ea819e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:05.170+0000 7f5eaee00700 1 --2- 172.21.15.2:0/479705480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ea8101440 0x7f5ea819ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:05.170+0000 7f5eaee00700 1 -- 172.21.15.2:0/479705480 >> 172.21.15.2:0/479705480 conn(0x7f5ea8077a00 msgr2=0x7f5ea80ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:05.170+0000 7f5eaee00700 1 -- 172.21.15.2:0/479705480 shutdown_connections 2024-06-13T02:15:05.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:05.170+0000 7f5eaee00700 1 -- 172.21.15.2:0/479705480 wait complete. 2024-06-13T02:15:05.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:05 smithi002 ceph-mon[31960]: pgmap v410: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:15:05.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:05 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/479705480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:15:05.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:05 smithi084 ceph-mon[36833]: pgmap v410: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:15:05.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:05 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/479705480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:15:06.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-06-13T02:15:06.010 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-06-13T02:15:06.010 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-06-13T02:15:06.011 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-06-13T02:15:06.011 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-06-13T02:15:06.012 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-06-13T02:15:06.012 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-06-13T02:15:06.012 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-06-13T02:15:06.013 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-06-13T02:15:06.014 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-06-13T02:15:06.014 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-06-13T02:15:06.014 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-06-13T02:15:06.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:05 smithi175 ceph-mon[36977]: pgmap v410: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:15:06.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:05 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/479705480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:15:07.028 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:07.043 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:07.784 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:07.793 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:07.794 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:07.804 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:07.808 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:07.836 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:07 smithi002 ceph-mon[31960]: pgmap v411: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:15:07.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:07 smithi084 ceph-mon[36833]: pgmap v411: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:15:08.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:07 smithi175 ceph-mon[36977]: pgmap v411: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:15:08.636 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:08.637 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:09.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:09 smithi002 ceph-mon[31960]: pgmap v412: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:15:09.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:09 smithi084 ceph-mon[36833]: pgmap v412: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:15:10.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:09 smithi175 ceph-mon[36977]: pgmap v412: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:15:11.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:11 smithi002 ceph-mon[31960]: pgmap v413: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:15:11.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:11 smithi084 ceph-mon[36833]: pgmap v413: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:15:12.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:11 smithi175 ceph-mon[36977]: pgmap v413: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:15:13.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:13 smithi002 ceph-mon[31960]: pgmap v414: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:15:13.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:13 smithi084 ceph-mon[36833]: pgmap v414: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:15:14.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:13 smithi175 ceph-mon[36977]: pgmap v414: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:15:15.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:15 smithi002 ceph-mon[31960]: pgmap v415: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:15:15.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:15 smithi084 ceph-mon[36833]: pgmap v415: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:15:16.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:15 smithi175 ceph-mon[36977]: pgmap v415: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:15:16.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.610+0000 7fcd07e00700 1 -- 172.21.15.2:0/2558067175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd000746c0 msgr2=0x7fcd00074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.610+0000 7fcd07e00700 1 --2- 172.21.15.2:0/2558067175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd000746c0 0x7fcd00074aa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009990 tx=0x7fccf4009ca0 comp rx=0 tx=0).stop 2024-06-13T02:15:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.611+0000 7fcd07e00700 1 -- 172.21.15.2:0/2558067175 shutdown_connections 2024-06-13T02:15:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.611+0000 7fcd07e00700 1 --2- 172.21.15.2:0/2558067175 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd00113660 0x7fcd00115a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.611+0000 7fcd07e00700 1 --2- 172.21.15.2:0/2558067175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd000746c0 0x7fcd00074aa0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.611+0000 7fcd07e00700 1 --2- 172.21.15.2:0/2558067175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd00074fe0 0x7fcd00113120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.611+0000 7fcd07e00700 1 -- 172.21.15.2:0/2558067175 >> 172.21.15.2:0/2558067175 conn(0x7fcd000795f0 msgr2=0x7fcd00079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.611+0000 7fcd07e00700 1 -- 172.21.15.2:0/2558067175 shutdown_connections 2024-06-13T02:15:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.611+0000 7fcd07e00700 1 -- 172.21.15.2:0/2558067175 wait complete. 2024-06-13T02:15:16.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.612+0000 7fcd07e00700 1 Processor -- start 2024-06-13T02:15:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.612+0000 7fcd07e00700 1 -- start start 2024-06-13T02:15:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.613+0000 7fcd07e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd000746c0 0x7fcd0019f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.613+0000 7fcd07e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd00074fe0 0x7fcd0019f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.613+0000 7fcd07e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd00113660 0x7fcd001a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.613+0000 7fcd07e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcd00118e10 con 0x7fcd00074fe0 2024-06-13T02:15:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.613+0000 7fcd07e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcd00118c90 con 0x7fcd00113660 2024-06-13T02:15:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.613+0000 7fcd07e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcd00118f90 con 0x7fcd000746c0 2024-06-13T02:15:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.613+0000 7fcd04a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd00074fe0 0x7fcd0019f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.613+0000 7fcd05e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd00113660 0x7fcd001a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.613+0000 7fcd04a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd00074fe0 0x7fcd0019f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48204/0 (socket says 172.21.15.2:48204) 2024-06-13T02:15:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.613+0000 7fcd04a00700 1 -- 172.21.15.2:0/920801290 learned_addr learned my addr 172.21.15.2:0/920801290 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.613+0000 7fcd05400700 1 --2- 172.21.15.2:0/920801290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd000746c0 0x7fcd0019f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.614+0000 7fcd05e00700 1 -- 172.21.15.2:0/920801290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd000746c0 msgr2=0x7fcd0019f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:16.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.614+0000 7fcd05e00700 1 --2- 172.21.15.2:0/920801290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd000746c0 0x7fcd0019f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.614+0000 7fcd05e00700 1 -- 172.21.15.2:0/920801290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd00074fe0 msgr2=0x7fcd0019f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.614+0000 7fcd05e00700 1 --2- 172.21.15.2:0/920801290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd00074fe0 0x7fcd0019f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.614+0000 7fcd05e00700 1 -- 172.21.15.2:0/920801290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd001a43d0 con 0x7fcd00113660 2024-06-13T02:15:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.614+0000 7fcd04a00700 1 --2- 172.21.15.2:0/920801290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd00074fe0 0x7fcd0019f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:15:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.614+0000 7fcd05e00700 1 --2- 172.21.15.2:0/920801290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd00113660 0x7fcd001a3c90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fccf800ef90 tx=0x7fccf800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.614+0000 7fccfe000700 1 -- 172.21.15.2:0/920801290 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf80092e0 con 0x7fcd00113660 2024-06-13T02:15:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.614+0000 7fcd07e00700 1 -- 172.21.15.2:0/920801290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd001a4660 con 0x7fcd00113660 2024-06-13T02:15:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.615+0000 7fccfe000700 1 -- 172.21.15.2:0/920801290 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccf8004bb0 con 0x7fcd00113660 2024-06-13T02:15:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.615+0000 7fcd07e00700 1 -- 172.21.15.2:0/920801290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd001abf40 con 0x7fcd00113660 2024-06-13T02:15:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.615+0000 7fccfe000700 1 -- 172.21.15.2:0/920801290 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf8004020 con 0x7fcd00113660 2024-06-13T02:15:16.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.615+0000 7fcd07e00700 1 -- 172.21.15.2:0/920801290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcce0001030 con 0x7fcd00113660 2024-06-13T02:15:16.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.618+0000 7fccfe000700 1 -- 172.21.15.2:0/920801290 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fccf801b030 con 0x7fcd00113660 2024-06-13T02:15:16.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.619+0000 7fccfe000700 1 --2- 172.21.15.2:0/920801290 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcce80a2d30 0x7fcce80a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:16.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.619+0000 7fccfe000700 1 -- 172.21.15.2:0/920801290 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fccf80cf8d0 con 0x7fcd00113660 2024-06-13T02:15:16.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.620+0000 7fcd05400700 1 --2- 172.21.15.2:0/920801290 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcce80a2d30 0x7fcce80a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:16.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.620+0000 7fccfe000700 1 --2- 172.21.15.2:0/920801290 >> [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390] conn(0x7fcce80ae110 0x7fcce80b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:16.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.620+0000 7fccfe000700 1 -- 172.21.15.2:0/920801290 --> [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccf800be50 con 0x7fcce80ae110 2024-06-13T02:15:16.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.620+0000 7fccfe000700 1 -- 172.21.15.2:0/920801290 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fccf80cfc80 con 0x7fcd00113660 2024-06-13T02:15:16.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.620+0000 7fcd04a00700 1 --2- 172.21.15.2:0/920801290 >> [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390] conn(0x7fcce80ae110 0x7fcce80b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.620+0000 7fcd05400700 1 --2- 172.21.15.2:0/920801290 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcce80a2d30 0x7fcce80a51f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fccf400b2e0 tx=0x7fccf4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.621+0000 7fcd04a00700 1 --2- 172.21.15.2:0/920801290 >> [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390] conn(0x7fcce80ae110 0x7fcce80b05b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.622+0000 7fccfe000700 1 -- 172.21.15.2:0/920801290 <== osd.4 v2:172.21.15.84:6808/2541323390 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fccf800be50 con 0x7fcce80ae110 2024-06-13T02:15:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.641+0000 7fcd07e00700 1 -- 172.21.15.2:0/920801290 --> [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcce0002e60 con 0x7fcce80ae110 2024-06-13T02:15:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.642+0000 7fccfe000700 1 -- 172.21.15.2:0/920801290 <== osd.4 v2:172.21.15.84:6808/2541323390 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcce0002e60 con 0x7fcce80ae110 2024-06-13T02:15:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.642+0000 7fcd07e00700 1 -- 172.21.15.2:0/920801290 >> [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390] conn(0x7fcce80ae110 msgr2=0x7fcce80b05b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.642+0000 7fcd07e00700 1 --2- 172.21.15.2:0/920801290 >> [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390] conn(0x7fcce80ae110 0x7fcce80b05b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.642+0000 7fcd07e00700 1 -- 172.21.15.2:0/920801290 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcce80a2d30 msgr2=0x7fcce80a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.642+0000 7fcd07e00700 1 --2- 172.21.15.2:0/920801290 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcce80a2d30 0x7fcce80a51f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fccf400b2e0 tx=0x7fccf4005fd0 comp rx=0 tx=0).stop 2024-06-13T02:15:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.642+0000 7fcd07e00700 1 -- 172.21.15.2:0/920801290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd00113660 msgr2=0x7fcd001a3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.642+0000 7fcd07e00700 1 --2- 172.21.15.2:0/920801290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd00113660 0x7fcd001a3c90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fccf800ef90 tx=0x7fccf800c3a0 comp rx=0 tx=0).stop 2024-06-13T02:15:16.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.643+0000 7fcd05e00700 1 -- 172.21.15.2:0/920801290 reap_dead start 2024-06-13T02:15:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.643+0000 7fcd07e00700 1 -- 172.21.15.2:0/920801290 shutdown_connections 2024-06-13T02:15:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.643+0000 7fcd07e00700 1 -- 172.21.15.2:0/920801290 >> 172.21.15.2:0/920801290 conn(0x7fcd000795f0 msgr2=0x7fcd00112490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.643+0000 7fcd07e00700 1 -- 172.21.15.2:0/920801290 shutdown_connections 2024-06-13T02:15:16.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:16.643+0000 7fcd07e00700 1 -- 172.21.15.2:0/920801290 wait complete. 2024-06-13T02:15:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.664+0000 7f0379400700 1 -- 172.21.15.2:0/4039975574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0374102e50 msgr2=0x7f037410f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.664+0000 7f0379400700 1 --2- 172.21.15.2:0/4039975574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0374102e50 0x7f037410f310 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f036c00b0a0 tx=0x7f036c00b3b0 comp rx=0 tx=0).stop 2024-06-13T02:15:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.664+0000 7f0379400700 1 -- 172.21.15.2:0/4039975574 shutdown_connections 2024-06-13T02:15:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.664+0000 7f0379400700 1 --2- 172.21.15.2:0/4039975574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0374102e50 0x7f037410f310 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.664+0000 7f0379400700 1 --2- 172.21.15.2:0/4039975574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374108540 0x7f0374108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.664+0000 7f0379400700 1 --2- 172.21.15.2:0/4039975574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0374102490 0x7f0374102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.664+0000 7f0379400700 1 -- 172.21.15.2:0/4039975574 >> 172.21.15.2:0/4039975574 conn(0x7f03740fdf40 msgr2=0x7f0374100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:17.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.664+0000 7f0379400700 1 -- 172.21.15.2:0/4039975574 shutdown_connections 2024-06-13T02:15:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.664+0000 7f0379400700 1 -- 172.21.15.2:0/4039975574 wait complete. 2024-06-13T02:15:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.665+0000 7f0379400700 1 Processor -- start 2024-06-13T02:15:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.665+0000 7f0379400700 1 -- start start 2024-06-13T02:15:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.666+0000 7f0379400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374102490 0x7f0374074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.666+0000 7f0379400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0374102e50 0x7f0374074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.666+0000 7f0379400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0374108540 0x7f0374075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.666+0000 7f0379400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f03741127f0 con 0x7f0374102490 2024-06-13T02:15:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.666+0000 7f0379400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0374112670 con 0x7f0374102e50 2024-06-13T02:15:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.666+0000 7f0379400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0374112970 con 0x7f0374108540 2024-06-13T02:15:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.666+0000 7f0372800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374102490 0x7f0374074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.666+0000 7f0372800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374102490 0x7f0374074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48182/0 (socket says 172.21.15.2:48182) 2024-06-13T02:15:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.666+0000 7f0372800700 1 -- 172.21.15.2:0/4215718821 learned_addr learned my addr 172.21.15.2:0/4215718821 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.666+0000 7f0373200700 1 --2- 172.21.15.2:0/4215718821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0374108540 0x7f0374075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:17.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.666+0000 7f036be00700 1 --2- 172.21.15.2:0/4215718821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0374102e50 0x7f0374074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.667+0000 7f0373200700 1 -- 172.21.15.2:0/4215718821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0374102e50 msgr2=0x7f0374074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.667+0000 7f0373200700 1 --2- 172.21.15.2:0/4215718821 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0374102e50 0x7f0374074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.667+0000 7f0373200700 1 -- 172.21.15.2:0/4215718821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374102490 msgr2=0x7f0374074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.667+0000 7f0373200700 1 --2- 172.21.15.2:0/4215718821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374102490 0x7f0374074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.667+0000 7f0373200700 1 -- 172.21.15.2:0/4215718821 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03741ab4f0 con 0x7f0374108540 2024-06-13T02:15:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.667+0000 7f0372800700 1 --2- 172.21.15.2:0/4215718821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0374102490 0x7f0374074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:15:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.667+0000 7f0373200700 1 --2- 172.21.15.2:0/4215718821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0374108540 0x7f0374075210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f036c0062a0 tx=0x7f036c004c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.667+0000 7f036b400700 1 -- 172.21.15.2:0/4215718821 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c021070 con 0x7f0374108540 2024-06-13T02:15:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.667+0000 7f036b400700 1 -- 172.21.15.2:0/4215718821 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f036c003c00 con 0x7f0374108540 2024-06-13T02:15:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.667+0000 7f0379400700 1 -- 172.21.15.2:0/4215718821 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03741ab720 con 0x7f0374108540 2024-06-13T02:15:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.667+0000 7f036b400700 1 -- 172.21.15.2:0/4215718821 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c0045a0 con 0x7f0374108540 2024-06-13T02:15:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.667+0000 7f0379400700 1 -- 172.21.15.2:0/4215718821 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03741abc80 con 0x7f0374108540 2024-06-13T02:15:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.669+0000 7f0379400700 1 -- 172.21.15.2:0/4215718821 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f03740ffe60 con 0x7f0374108540 2024-06-13T02:15:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.670+0000 7f036b400700 1 -- 172.21.15.2:0/4215718821 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f036c004740 con 0x7f0374108540 2024-06-13T02:15:17.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.672+0000 7f036b400700 1 --2- 172.21.15.2:0/4215718821 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f03580a2d30 0x7f03580a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.672+0000 7f036b400700 1 -- 172.21.15.2:0/4215718821 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f036c00f020 con 0x7f0374108540 2024-06-13T02:15:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.672+0000 7f0372800700 1 --2- 172.21.15.2:0/4215718821 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f03580a2d30 0x7f03580a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.672+0000 7f036b400700 1 --2- 172.21.15.2:0/4215718821 >> [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558] conn(0x7f03580ae110 0x7f03580b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.672+0000 7f036b400700 1 -- 172.21.15.2:0/4215718821 --> [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f036c029e70 con 0x7f03580ae110 2024-06-13T02:15:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.672+0000 7f036b400700 1 -- 172.21.15.2:0/4215718821 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f036c0d7050 con 0x7f0374108540 2024-06-13T02:15:17.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.672+0000 7f036be00700 1 --2- 172.21.15.2:0/4215718821 >> [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558] conn(0x7f03580ae110 0x7f03580b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.673+0000 7f0372800700 1 --2- 172.21.15.2:0/4215718821 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f03580a2d30 0x7f03580a51f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0364011550 tx=0x7f0364009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.673+0000 7f036be00700 1 --2- 172.21.15.2:0/4215718821 >> [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558] conn(0x7f03580ae110 0x7f03580b05b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.674+0000 7f036b400700 1 -- 172.21.15.2:0/4215718821 <== osd.2 v2:172.21.15.175:6800/2174304558 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f036c029e70 con 0x7f03580ae110 2024-06-13T02:15:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.693+0000 7f0379400700 1 -- 172.21.15.2:0/4215718821 --> [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0374103bb0 con 0x7f03580ae110 2024-06-13T02:15:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.693+0000 7f036b400700 1 -- 172.21.15.2:0/4215718821 <== osd.2 v2:172.21.15.175:6800/2174304558 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0374103bb0 con 0x7f03580ae110 2024-06-13T02:15:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.694+0000 7f0379400700 1 -- 172.21.15.2:0/4215718821 >> [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558] conn(0x7f03580ae110 msgr2=0x7f03580b05b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.694+0000 7f0379400700 1 --2- 172.21.15.2:0/4215718821 >> [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558] conn(0x7f03580ae110 0x7f03580b05b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.695+0000 7f0379400700 1 -- 172.21.15.2:0/4215718821 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f03580a2d30 msgr2=0x7f03580a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.695+0000 7f0379400700 1 --2- 172.21.15.2:0/4215718821 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f03580a2d30 0x7f03580a51f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0364011550 tx=0x7f0364009260 comp rx=0 tx=0).stop 2024-06-13T02:15:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.695+0000 7f0379400700 1 -- 172.21.15.2:0/4215718821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0374108540 msgr2=0x7f0374075210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.695+0000 7f0379400700 1 --2- 172.21.15.2:0/4215718821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0374108540 0x7f0374075210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f036c0062a0 tx=0x7f036c004c60 comp rx=0 tx=0).stop 2024-06-13T02:15:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.695+0000 7f0373200700 1 -- 172.21.15.2:0/4215718821 reap_dead start 2024-06-13T02:15:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.695+0000 7f0379400700 1 -- 172.21.15.2:0/4215718821 shutdown_connections 2024-06-13T02:15:17.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.695+0000 7f0379400700 1 -- 172.21.15.2:0/4215718821 >> 172.21.15.2:0/4215718821 conn(0x7f03740fdf40 msgr2=0x7f03740ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.695+0000 7f0379400700 1 -- 172.21.15.2:0/4215718821 shutdown_connections 2024-06-13T02:15:17.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:14.695+0000 7f0379400700 1 -- 172.21.15.2:0/4215718821 wait complete. 2024-06-13T02:15:17.912 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:17 smithi002 ceph-mon[31960]: pgmap v416: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:15:17.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:17 smithi084 ceph-mon[36833]: pgmap v416: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:15:18.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:17 smithi175 ceph-mon[36977]: pgmap v416: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:15:19.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:19 smithi002 ceph-mon[31960]: pgmap v417: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:15:19.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:19 smithi084 ceph-mon[36833]: pgmap v417: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:15:19.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:19 smithi175 ceph-mon[36977]: pgmap v417: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:15:21.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:21 smithi002 ceph-mon[31960]: pgmap v418: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:15:21.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:21 smithi084 ceph-mon[36833]: pgmap v418: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:15:22.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:21 smithi175 ceph-mon[36977]: pgmap v418: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:15:22.229 INFO:teuthology.orchestra.run.smithi002.stdout:77309411427 2024-06-13T02:15:22.230 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-06-13T02:15:22.237 INFO:teuthology.orchestra.run.smithi002.stdout:146028888152 2024-06-13T02:15:22.238 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-06-13T02:15:23.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:23 smithi002 ceph-mon[31960]: pgmap v419: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:15:23.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.777+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2396014680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf0102740 msgr2=0x7f1cf0102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.777+0000 7f1cf4c00700 1 --2- 172.21.15.2:0/2396014680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf0102740 0x7f1cf0102b20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00099c0 tx=0x7f1ce0009cd0 comp rx=0 tx=0).stop 2024-06-13T02:15:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.777+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2396014680 shutdown_connections 2024-06-13T02:15:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.777+0000 7f1cf4c00700 1 --2- 172.21.15.2:0/2396014680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf0107840 0x7f1cf010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.777+0000 7f1cf4c00700 1 --2- 172.21.15.2:0/2396014680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf0102740 0x7f1cf0102b20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.777+0000 7f1cf4c00700 1 --2- 172.21.15.2:0/2396014680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cf01030f0 0x7f1cf0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.777+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2396014680 >> 172.21.15.2:0/2396014680 conn(0x7f1cf00795f0 msgr2=0x7f1cf0079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.777+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2396014680 shutdown_connections 2024-06-13T02:15:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.777+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2396014680 wait complete. 2024-06-13T02:15:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.778+0000 7f1cf4c00700 1 Processor -- start 2024-06-13T02:15:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.779+0000 7f1cf4c00700 1 -- start start 2024-06-13T02:15:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.779+0000 7f1cf4c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cf0102740 0x7f1cf019adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.779+0000 7f1cf4c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf01030f0 0x7f1cf019b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:23.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.779+0000 7f1cf4c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf0107840 0x7f1cf019f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.779+0000 7f1cf4c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf0112760 con 0x7f1cf0107840 2024-06-13T02:15:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.779+0000 7f1cf4c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf01125e0 con 0x7f1cf01030f0 2024-06-13T02:15:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.779+0000 7f1cf4c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf01128e0 con 0x7f1cf0102740 2024-06-13T02:15:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.779+0000 7f1cede00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cf0102740 0x7f1cf019adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.780+0000 7f1cee800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf0107840 0x7f1cf019f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.780+0000 7f1ced400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf01030f0 0x7f1cf019b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.780+0000 7f1cede00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cf0102740 0x7f1cf019adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:37188/0 (socket says 172.21.15.2:37188) 2024-06-13T02:15:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.780+0000 7f1cede00700 1 -- 172.21.15.2:0/2000058043 learned_addr learned my addr 172.21.15.2:0/2000058043 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.780+0000 7f1cede00700 1 -- 172.21.15.2:0/2000058043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf01030f0 msgr2=0x7f1cf019b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.780+0000 7f1cede00700 1 --2- 172.21.15.2:0/2000058043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1cf01030f0 0x7f1cf019b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.780+0000 7f1cede00700 1 -- 172.21.15.2:0/2000058043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf0107840 msgr2=0x7f1cf019f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.780+0000 7f1cede00700 1 --2- 172.21.15.2:0/2000058043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf0107840 0x7f1cf019f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.780+0000 7f1cede00700 1 -- 172.21.15.2:0/2000058043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf019fdc0 con 0x7f1cf0102740 2024-06-13T02:15:23.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.780+0000 7f1cee800700 1 --2- 172.21.15.2:0/2000058043 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1cf0107840 0x7f1cf019f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:15:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.780+0000 7f1cede00700 1 --2- 172.21.15.2:0/2000058043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cf0102740 0x7f1cf019adb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0006010 tx=0x7f1ce0003a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.781+0000 7f1ce6a00700 1 -- 172.21.15.2:0/2000058043 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0003680 con 0x7f1cf0102740 2024-06-13T02:15:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.781+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2000058043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf01a0050 con 0x7f1cf0102740 2024-06-13T02:15:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.781+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2000058043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf01a7930 con 0x7f1cf0102740 2024-06-13T02:15:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.781+0000 7f1ce6a00700 1 -- 172.21.15.2:0/2000058043 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ce00055a0 con 0x7f1cf0102740 2024-06-13T02:15:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.781+0000 7f1ce6a00700 1 -- 172.21.15.2:0/2000058043 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00173f0 con 0x7f1cf0102740 2024-06-13T02:15:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.782+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2000058043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1cf00759e0 con 0x7f1cf0102740 2024-06-13T02:15:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.784+0000 7f1ce6a00700 1 -- 172.21.15.2:0/2000058043 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f1ce000f460 con 0x7f1cf0102740 2024-06-13T02:15:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.785+0000 7f1ce6a00700 1 --2- 172.21.15.2:0/2000058043 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1cd40a2ed0 0x7f1cd40a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.786+0000 7f1ce6a00700 1 -- 172.21.15.2:0/2000058043 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f1ce00d0240 con 0x7f1cf0102740 2024-06-13T02:15:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.786+0000 7f1ced400700 1 --2- 172.21.15.2:0/2000058043 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1cd40a2ed0 0x7f1cd40a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:23.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.786+0000 7f1ce6a00700 1 --2- 172.21.15.2:0/2000058043 >> [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732] conn(0x7f1cd40ae2b0 0x7f1cd40b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.786+0000 7f1ce6a00700 1 -- 172.21.15.2:0/2000058043 --> [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ce002ce50 con 0x7f1cd40ae2b0 2024-06-13T02:15:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.786+0000 7f1ce6a00700 1 -- 172.21.15.2:0/2000058043 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f1ce00d7050 con 0x7f1cf0102740 2024-06-13T02:15:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.786+0000 7f1cee800700 1 --2- 172.21.15.2:0/2000058043 >> [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732] conn(0x7f1cd40ae2b0 0x7f1cd40b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.786+0000 7f1ced400700 1 --2- 172.21.15.2:0/2000058043 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1cd40a2ed0 0x7f1cd40a5390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1cf010f770 tx=0x7f1cdc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.787+0000 7f1cee800700 1 --2- 172.21.15.2:0/2000058043 >> [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732] conn(0x7f1cd40ae2b0 0x7f1cd40b0750 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.788+0000 7f1ce6a00700 1 -- 172.21.15.2:0/2000058043 <== osd.11 v2:172.21.15.175:6824/2762894732 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1ce002ce50 con 0x7f1cd40ae2b0 2024-06-13T02:15:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.807+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2000058043 --> [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1cf0103bd0 con 0x7f1cd40ae2b0 2024-06-13T02:15:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.808+0000 7f1ce6a00700 1 -- 172.21.15.2:0/2000058043 <== osd.11 v2:172.21.15.175:6824/2762894732 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1cf0103bd0 con 0x7f1cd40ae2b0 2024-06-13T02:15:23.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.808+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2000058043 >> [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732] conn(0x7f1cd40ae2b0 msgr2=0x7f1cd40b0750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.808+0000 7f1cf4c00700 1 --2- 172.21.15.2:0/2000058043 >> [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732] conn(0x7f1cd40ae2b0 0x7f1cd40b0750 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.808+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2000058043 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1cd40a2ed0 msgr2=0x7f1cd40a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.808+0000 7f1cf4c00700 1 --2- 172.21.15.2:0/2000058043 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1cd40a2ed0 0x7f1cd40a5390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1cf010f770 tx=0x7f1cdc009260 comp rx=0 tx=0).stop 2024-06-13T02:15:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.808+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2000058043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cf0102740 msgr2=0x7f1cf019adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.808+0000 7f1cf4c00700 1 --2- 172.21.15.2:0/2000058043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1cf0102740 0x7f1cf019adb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0006010 tx=0x7f1ce0003a90 comp rx=0 tx=0).stop 2024-06-13T02:15:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.808+0000 7f1cee800700 1 -- 172.21.15.2:0/2000058043 reap_dead start 2024-06-13T02:15:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.808+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2000058043 shutdown_connections 2024-06-13T02:15:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.808+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2000058043 >> 172.21.15.2:0/2000058043 conn(0x7f1cf00795f0 msgr2=0x7f1cf0108990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.808+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2000058043 shutdown_connections 2024-06-13T02:15:23.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:23.809+0000 7f1cf4c00700 1 -- 172.21.15.2:0/2000058043 wait complete. 2024-06-13T02:15:23.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:23 smithi084 ceph-mon[36833]: pgmap v419: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:15:24.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:23 smithi175 ceph-mon[36977]: pgmap v419: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:15:24.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.817+0000 7f5a55200700 1 -- 172.21.15.2:0/485055446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50101390 msgr2=0x7f5a50101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:24.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.817+0000 7f5a55200700 1 --2- 172.21.15.2:0/485055446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50101390 0x7f5a50101810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009990 tx=0x7f5a3c009ca0 comp rx=0 tx=0).stop 2024-06-13T02:15:24.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.818+0000 7f5a55200700 1 -- 172.21.15.2:0/485055446 shutdown_connections 2024-06-13T02:15:24.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.818+0000 7f5a55200700 1 --2- 172.21.15.2:0/485055446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a50101d50 0x7f5a5010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:24.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.818+0000 7f5a55200700 1 --2- 172.21.15.2:0/485055446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a50107400 0x7f5a501077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:24.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.818+0000 7f5a55200700 1 --2- 172.21.15.2:0/485055446 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50101390 0x7f5a50101810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:24.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.818+0000 7f5a55200700 1 -- 172.21.15.2:0/485055446 >> 172.21.15.2:0/485055446 conn(0x7f5a50078340 msgr2=0x7f5a50078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:24.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.818+0000 7f5a55200700 1 -- 172.21.15.2:0/485055446 shutdown_connections 2024-06-13T02:15:24.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.818+0000 7f5a55200700 1 -- 172.21.15.2:0/485055446 wait complete. 2024-06-13T02:15:24.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.819+0000 7f5a55200700 1 Processor -- start 2024-06-13T02:15:24.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.820+0000 7f5a55200700 1 -- start start 2024-06-13T02:15:24.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.820+0000 7f5a55200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50101390 0x7f5a50103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:24.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.820+0000 7f5a55200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a50101d50 0x7f5a501035b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:24.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.820+0000 7f5a55200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a50107400 0x7f5a50103af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:24.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.820+0000 7f5a55200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5a501116c0 con 0x7f5a50101390 2024-06-13T02:15:24.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.820+0000 7f5a55200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5a50111540 con 0x7f5a50101d50 2024-06-13T02:15:24.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.820+0000 7f5a55200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5a50111840 con 0x7f5a50107400 2024-06-13T02:15:24.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.821+0000 7f5a4de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50101390 0x7f5a50103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:24.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.821+0000 7f5a4de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50101390 0x7f5a50103070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33670/0 (socket says 172.21.15.2:33670) 2024-06-13T02:15:24.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.821+0000 7f5a4de00700 1 -- 172.21.15.2:0/2101980695 learned_addr learned my addr 172.21.15.2:0/2101980695 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:24.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.821+0000 7f5a4e800700 1 --2- 172.21.15.2:0/2101980695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a50107400 0x7f5a50103af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:24.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.821+0000 7f5a4d400700 1 --2- 172.21.15.2:0/2101980695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a50101d50 0x7f5a501035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:24.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.821+0000 7f5a4d400700 1 -- 172.21.15.2:0/2101980695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a50107400 msgr2=0x7f5a50103af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:24.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.821+0000 7f5a4d400700 1 --2- 172.21.15.2:0/2101980695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a50107400 0x7f5a50103af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:24.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.821+0000 7f5a4d400700 1 -- 172.21.15.2:0/2101980695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50101390 msgr2=0x7f5a50103070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:24.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.821+0000 7f5a4d400700 1 --2- 172.21.15.2:0/2101980695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a50101390 0x7f5a50103070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:24.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.821+0000 7f5a4d400700 1 -- 172.21.15.2:0/2101980695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a501a7190 con 0x7f5a50101d50 2024-06-13T02:15:24.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.822+0000 7f5a4d400700 1 --2- 172.21.15.2:0/2101980695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a50101d50 0x7f5a501035b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0098e0 tx=0x7f5a3c00b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:24.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.822+0000 7f5a46a00700 1 -- 172.21.15.2:0/2101980695 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c027070 con 0x7f5a50101d50 2024-06-13T02:15:24.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.822+0000 7f5a46a00700 1 -- 172.21.15.2:0/2101980695 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a3c003b60 con 0x7f5a50101d50 2024-06-13T02:15:24.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.822+0000 7f5a46a00700 1 -- 172.21.15.2:0/2101980695 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c022d50 con 0x7f5a50101d50 2024-06-13T02:15:24.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.822+0000 7f5a55200700 1 -- 172.21.15.2:0/2101980695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a501a7420 con 0x7f5a50101d50 2024-06-13T02:15:24.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.823+0000 7f5a55200700 1 -- 172.21.15.2:0/2101980695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a501a7820 con 0x7f5a50101d50 2024-06-13T02:15:24.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.824+0000 7f5a55200700 1 -- 172.21.15.2:0/2101980695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5a50105460 con 0x7f5a50101d50 2024-06-13T02:15:24.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.826+0000 7f5a46a00700 1 -- 172.21.15.2:0/2101980695 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f5a3c009d10 con 0x7f5a50101d50 2024-06-13T02:15:24.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.827+0000 7f5a46a00700 1 --2- 172.21.15.2:0/2101980695 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f5a340a2d30 0x7f5a340a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:24.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.828+0000 7f5a46a00700 1 -- 172.21.15.2:0/2101980695 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f5a3c0d0df0 con 0x7f5a50101d50 2024-06-13T02:15:24.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.828+0000 7f5a4de00700 1 --2- 172.21.15.2:0/2101980695 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f5a340a2d30 0x7f5a340a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:24.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.828+0000 7f5a46a00700 1 --2- 172.21.15.2:0/2101980695 >> [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232] conn(0x7f5a340ae110 0x7f5a340b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:24.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.828+0000 7f5a46a00700 1 -- 172.21.15.2:0/2101980695 --> [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a340b0c80 con 0x7f5a340ae110 2024-06-13T02:15:24.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.828+0000 7f5a46a00700 1 -- 172.21.15.2:0/2101980695 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f5a3c0d11a0 con 0x7f5a50101d50 2024-06-13T02:15:24.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.828+0000 7f5a4e800700 1 --2- 172.21.15.2:0/2101980695 >> [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232] conn(0x7f5a340ae110 0x7f5a340b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:24.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.829+0000 7f5a4de00700 1 --2- 172.21.15.2:0/2101980695 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f5a340a2d30 0x7f5a340a51f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009680 tx=0x7f5a40009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:24.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.829+0000 7f5a4e800700 1 --2- 172.21.15.2:0/2101980695 >> [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232] conn(0x7f5a340ae110 0x7f5a340b05b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:24.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.830+0000 7f5a46a00700 1 -- 172.21.15.2:0/2101980695 <== osd.8 v2:172.21.15.175:6816/2622818232 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5a340b0c80 con 0x7f5a340ae110 2024-06-13T02:15:24.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.849+0000 7f5a55200700 1 -- 172.21.15.2:0/2101980695 --> [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5a50102ab0 con 0x7f5a340ae110 2024-06-13T02:15:24.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.850+0000 7f5a46a00700 1 -- 172.21.15.2:0/2101980695 <== osd.8 v2:172.21.15.175:6816/2622818232 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5a50102ab0 con 0x7f5a340ae110 2024-06-13T02:15:24.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.851+0000 7f5a55200700 1 -- 172.21.15.2:0/2101980695 >> [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232] conn(0x7f5a340ae110 msgr2=0x7f5a340b05b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:24.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.851+0000 7f5a55200700 1 --2- 172.21.15.2:0/2101980695 >> [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232] conn(0x7f5a340ae110 0x7f5a340b05b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:24.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.851+0000 7f5a55200700 1 -- 172.21.15.2:0/2101980695 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f5a340a2d30 msgr2=0x7f5a340a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:24.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.851+0000 7f5a55200700 1 --2- 172.21.15.2:0/2101980695 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f5a340a2d30 0x7f5a340a51f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009680 tx=0x7f5a40009260 comp rx=0 tx=0).stop 2024-06-13T02:15:24.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.851+0000 7f5a55200700 1 -- 172.21.15.2:0/2101980695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a50101d50 msgr2=0x7f5a501035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:24.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.851+0000 7f5a55200700 1 --2- 172.21.15.2:0/2101980695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a50101d50 0x7f5a501035b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0098e0 tx=0x7f5a3c00b8a0 comp rx=0 tx=0).stop 2024-06-13T02:15:24.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.851+0000 7f5a4e800700 1 -- 172.21.15.2:0/2101980695 reap_dead start 2024-06-13T02:15:24.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.851+0000 7f5a55200700 1 -- 172.21.15.2:0/2101980695 shutdown_connections 2024-06-13T02:15:24.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.851+0000 7f5a55200700 1 -- 172.21.15.2:0/2101980695 >> 172.21.15.2:0/2101980695 conn(0x7f5a50078340 msgr2=0x7f5a50100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:24.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.851+0000 7f5a55200700 1 -- 172.21.15.2:0/2101980695 shutdown_connections 2024-06-13T02:15:24.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.851+0000 7f5a55200700 1 -- 172.21.15.2:0/2101980695 wait complete. 2024-06-13T02:15:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.888+0000 7f6ecda00700 1 -- 172.21.15.2:0/1391675447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec81030f0 msgr2=0x7f6ec8107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.888+0000 7f6ecda00700 1 --2- 172.21.15.2:0/1391675447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec81030f0 0x7f6ec8107110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00098f0 tx=0x7f6eb0009c00 comp rx=0 tx=0).stop 2024-06-13T02:15:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.888+0000 7f6ecda00700 1 -- 172.21.15.2:0/1391675447 shutdown_connections 2024-06-13T02:15:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.888+0000 7f6ecda00700 1 --2- 172.21.15.2:0/1391675447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ec8107840 0x7f6ec810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.888+0000 7f6ecda00700 1 --2- 172.21.15.2:0/1391675447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec8102740 0x7f6ec8102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.888+0000 7f6ecda00700 1 --2- 172.21.15.2:0/1391675447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec81030f0 0x7f6ec8107110 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.888+0000 7f6ecda00700 1 -- 172.21.15.2:0/1391675447 >> 172.21.15.2:0/1391675447 conn(0x7f6ec80795f0 msgr2=0x7f6ec8079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.888+0000 7f6ecda00700 1 -- 172.21.15.2:0/1391675447 shutdown_connections 2024-06-13T02:15:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.889+0000 7f6ecda00700 1 -- 172.21.15.2:0/1391675447 wait complete. 2024-06-13T02:15:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.890+0000 7f6ecda00700 1 Processor -- start 2024-06-13T02:15:24.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.890+0000 7f6ecda00700 1 -- start start 2024-06-13T02:15:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.891+0000 7f6ecda00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec8102740 0x7f6ec8074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.891+0000 7f6ecda00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec81030f0 0x7f6ec8074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.891+0000 7f6ecda00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ec8107840 0x7f6ec8075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.891+0000 7f6ecda00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec81127a0 con 0x7f6ec8107840 2024-06-13T02:15:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.891+0000 7f6ecda00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec8112620 con 0x7f6ec8102740 2024-06-13T02:15:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.891+0000 7f6ecda00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec8112920 con 0x7f6ec81030f0 2024-06-13T02:15:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.891+0000 7f6ebea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec8102740 0x7f6ec8074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.891+0000 7f6ebea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec8102740 0x7f6ec8074790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:41344/0 (socket says 172.21.15.2:41344) 2024-06-13T02:15:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.891+0000 7f6ebea00700 1 -- 172.21.15.2:0/2645946034 learned_addr learned my addr 172.21.15.2:0/2645946034 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.891+0000 7f6ec6a00700 1 --2- 172.21.15.2:0/2645946034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec81030f0 0x7f6ec8074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.891+0000 7f6ec7400700 1 --2- 172.21.15.2:0/2645946034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ec8107840 0x7f6ec8075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.892+0000 7f6ebea00700 1 -- 172.21.15.2:0/2645946034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec81030f0 msgr2=0x7f6ec8074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.892+0000 7f6ebea00700 1 --2- 172.21.15.2:0/2645946034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec81030f0 0x7f6ec8074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.892+0000 7f6ebea00700 1 -- 172.21.15.2:0/2645946034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ec8107840 msgr2=0x7f6ec8075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.892+0000 7f6ebea00700 1 --2- 172.21.15.2:0/2645946034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6ec8107840 0x7f6ec8075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:24.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.892+0000 7f6ebea00700 1 -- 172.21.15.2:0/2645946034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec81a71a0 con 0x7f6ec8102740 2024-06-13T02:15:24.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.892+0000 7f6ebea00700 1 --2- 172.21.15.2:0/2645946034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec8102740 0x7f6ec8074790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800e9a0 tx=0x7f6eb800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:24.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.892+0000 7f6ebfe00700 1 -- 172.21.15.2:0/2645946034 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800cbd0 con 0x7f6ec8102740 2024-06-13T02:15:24.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.892+0000 7f6ebfe00700 1 -- 172.21.15.2:0/2645946034 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6eb800cd70 con 0x7f6ec8102740 2024-06-13T02:15:24.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.892+0000 7f6ecda00700 1 -- 172.21.15.2:0/2645946034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec81a7490 con 0x7f6ec8102740 2024-06-13T02:15:24.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.892+0000 7f6ebfe00700 1 -- 172.21.15.2:0/2645946034 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8018750 con 0x7f6ec8102740 2024-06-13T02:15:24.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.893+0000 7f6ecda00700 1 -- 172.21.15.2:0/2645946034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec81a79f0 con 0x7f6ec8102740 2024-06-13T02:15:24.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.894+0000 7f6ecda00700 1 -- 172.21.15.2:0/2645946034 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ec8062c20 con 0x7f6ec8102740 2024-06-13T02:15:24.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.896+0000 7f6ebfe00700 1 -- 172.21.15.2:0/2645946034 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f6eb8010430 con 0x7f6ec8102740 2024-06-13T02:15:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.898+0000 7f6ebfe00700 1 --2- 172.21.15.2:0/2645946034 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6eac0a2d30 0x7f6eac0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.898+0000 7f6ebfe00700 1 -- 172.21.15.2:0/2645946034 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f6eb80cf880 con 0x7f6ec8102740 2024-06-13T02:15:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.898+0000 7f6ec6a00700 1 --2- 172.21.15.2:0/2645946034 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6eac0a2d30 0x7f6eac0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.898+0000 7f6ebfe00700 1 --2- 172.21.15.2:0/2645946034 >> [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126] conn(0x7f6eac0ae110 0x7f6eac0b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.898+0000 7f6ebfe00700 1 -- 172.21.15.2:0/2645946034 --> [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6eb801ee50 con 0x7f6eac0ae110 2024-06-13T02:15:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.898+0000 7f6ebfe00700 1 -- 172.21.15.2:0/2645946034 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f6eb80d42a0 con 0x7f6ec8102740 2024-06-13T02:15:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.899+0000 7f6ec7400700 1 --2- 172.21.15.2:0/2645946034 >> [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126] conn(0x7f6eac0ae110 0x7f6eac0b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.899+0000 7f6ec6a00700 1 --2- 172.21.15.2:0/2645946034 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6eac0a2d30 0x7f6eac0a51f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00098c0 tx=0x7f6eb001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.900+0000 7f6ec7400700 1 --2- 172.21.15.2:0/2645946034 >> [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126] conn(0x7f6eac0ae110 0x7f6eac0b05b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.901+0000 7f6ebfe00700 1 -- 172.21.15.2:0/2645946034 <== osd.0 v2:172.21.15.2:6802/3254812126 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6eb801ee50 con 0x7f6eac0ae110 2024-06-13T02:15:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.920+0000 7f6ecda00700 1 -- 172.21.15.2:0/2645946034 --> [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ec80630d0 con 0x7f6eac0ae110 2024-06-13T02:15:24.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.921+0000 7f6ebfe00700 1 -- 172.21.15.2:0/2645946034 <== osd.0 v2:172.21.15.2:6802/3254812126 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6ec80630d0 con 0x7f6eac0ae110 2024-06-13T02:15:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.922+0000 7f6ecda00700 1 -- 172.21.15.2:0/2645946034 >> [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126] conn(0x7f6eac0ae110 msgr2=0x7f6eac0b05b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.922+0000 7f6ecda00700 1 --2- 172.21.15.2:0/2645946034 >> [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126] conn(0x7f6eac0ae110 0x7f6eac0b05b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.922+0000 7f6ecda00700 1 -- 172.21.15.2:0/2645946034 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6eac0a2d30 msgr2=0x7f6eac0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.922+0000 7f6ecda00700 1 --2- 172.21.15.2:0/2645946034 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6eac0a2d30 0x7f6eac0a51f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00098c0 tx=0x7f6eb001a040 comp rx=0 tx=0).stop 2024-06-13T02:15:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.922+0000 7f6ecda00700 1 -- 172.21.15.2:0/2645946034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec8102740 msgr2=0x7f6ec8074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.922+0000 7f6ecda00700 1 --2- 172.21.15.2:0/2645946034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ec8102740 0x7f6ec8074790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800e9a0 tx=0x7f6eb800ecb0 comp rx=0 tx=0).stop 2024-06-13T02:15:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.922+0000 7f6ec7400700 1 -- 172.21.15.2:0/2645946034 reap_dead start 2024-06-13T02:15:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.922+0000 7f6ecda00700 1 -- 172.21.15.2:0/2645946034 shutdown_connections 2024-06-13T02:15:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.922+0000 7f6ecda00700 1 -- 172.21.15.2:0/2645946034 >> 172.21.15.2:0/2645946034 conn(0x7f6ec80795f0 msgr2=0x7f6ec81008a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.922+0000 7f6ecda00700 1 -- 172.21.15.2:0/2645946034 shutdown_connections 2024-06-13T02:15:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:24.922+0000 7f6ecda00700 1 -- 172.21.15.2:0/2645946034 wait complete. 2024-06-13T02:15:25.838 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:25 smithi002 ceph-mon[31960]: pgmap v420: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:15:25.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:25 smithi084 ceph-mon[36833]: pgmap v420: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:15:26.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:25 smithi175 ceph-mon[36977]: pgmap v420: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:15:27.102 INFO:teuthology.orchestra.run.smithi002.stdout:257698037827 2024-06-13T02:15:27.102 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-06-13T02:15:27.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.933+0000 7f1a0d000700 1 -- 172.21.15.2:0/2781687097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a08108ac0 msgr2=0x7f1a08108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:27.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.933+0000 7f1a0d000700 1 --2- 172.21.15.2:0/2781687097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a08108ac0 0x7f1a08108f40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f19f00098f0 tx=0x7f19f0009c00 comp rx=0 tx=0).stop 2024-06-13T02:15:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.933+0000 7f1a0d000700 1 -- 172.21.15.2:0/2781687097 shutdown_connections 2024-06-13T02:15:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.933+0000 7f1a0d000700 1 --2- 172.21.15.2:0/2781687097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a08109480 0x7f1a08115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.933+0000 7f1a0d000700 1 --2- 172.21.15.2:0/2781687097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a0810eac0 0x7f1a0810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.933+0000 7f1a0d000700 1 --2- 172.21.15.2:0/2781687097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a08108ac0 0x7f1a08108f40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.933+0000 7f1a0d000700 1 -- 172.21.15.2:0/2781687097 >> 172.21.15.2:0/2781687097 conn(0x7f1a08075c60 msgr2=0x7f1a081072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.934+0000 7f1a0d000700 1 -- 172.21.15.2:0/2781687097 shutdown_connections 2024-06-13T02:15:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.934+0000 7f1a0d000700 1 -- 172.21.15.2:0/2781687097 wait complete. 2024-06-13T02:15:27.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.935+0000 7f1a0d000700 1 Processor -- start 2024-06-13T02:15:27.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.935+0000 7f1a0d000700 1 -- start start 2024-06-13T02:15:27.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.935+0000 7f1a0d000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a08108ac0 0x7f1a0819f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:27.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.935+0000 7f1a0d000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a08109480 0x7f1a0819f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:27.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.935+0000 7f1a0d000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a0810eac0 0x7f1a081a3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:27.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.935+0000 7f1a0d000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1a08118e40 con 0x7f1a08109480 2024-06-13T02:15:27.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.935+0000 7f1a0d000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1a08118cc0 con 0x7f1a0810eac0 2024-06-13T02:15:27.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.935+0000 7f1a0d000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1a08118fc0 con 0x7f1a08108ac0 2024-06-13T02:15:27.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.936+0000 7f1a05e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a08108ac0 0x7f1a0819f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:27.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.936+0000 7f1a05e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a08108ac0 0x7f1a0819f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:37242/0 (socket says 172.21.15.2:37242) 2024-06-13T02:15:27.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.936+0000 7f1a05e00700 1 -- 172.21.15.2:0/1376149855 learned_addr learned my addr 172.21.15.2:0/1376149855 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:27.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.936+0000 7f19ffe00700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a08109480 0x7f1a0819f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:27.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.936+0000 7f1a06800700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a0810eac0 0x7f1a081a3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.936+0000 7f19ffe00700 1 -- 172.21.15.2:0/1376149855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a08108ac0 msgr2=0x7f1a0819f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.936+0000 7f19ffe00700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a08108ac0 0x7f1a0819f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.936+0000 7f19ffe00700 1 -- 172.21.15.2:0/1376149855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a0810eac0 msgr2=0x7f1a081a3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.936+0000 7f19ffe00700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a0810eac0 0x7f1a081a3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.936+0000 7f19ffe00700 1 -- 172.21.15.2:0/1376149855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a081a42a0 con 0x7f1a08109480 2024-06-13T02:15:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.936+0000 7f1a05e00700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a08108ac0 0x7f1a0819f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:15:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.936+0000 7f1a06800700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a0810eac0 0x7f1a081a3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:15:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.937+0000 7f19ffe00700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a08109480 0x7f1a0819f7d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19f0000c00 tx=0x7f19f000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.937+0000 7f19fea00700 1 -- 172.21.15.2:0/1376149855 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f0005040 con 0x7f1a08109480 2024-06-13T02:15:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.937+0000 7f19fea00700 1 -- 172.21.15.2:0/1376149855 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19f00056c0 con 0x7f1a08109480 2024-06-13T02:15:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.937+0000 7f19fea00700 1 -- 172.21.15.2:0/1376149855 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f0003a00 con 0x7f1a08109480 2024-06-13T02:15:27.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.937+0000 7f1a0d000700 1 -- 172.21.15.2:0/1376149855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a081a4530 con 0x7f1a08109480 2024-06-13T02:15:27.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.938+0000 7f1a0d000700 1 -- 172.21.15.2:0/1376149855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a081abe10 con 0x7f1a08109480 2024-06-13T02:15:27.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.939+0000 7f1a0d000700 1 -- 172.21.15.2:0/1376149855 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a081a49c0 con 0x7f1a08109480 2024-06-13T02:15:27.710 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:27 smithi002 ceph-mon[31960]: pgmap v421: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:15:27.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.941+0000 7f19fea00700 1 -- 172.21.15.2:0/1376149855 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f19f000b560 con 0x7f1a08109480 2024-06-13T02:15:27.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.942+0000 7f19fea00700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19ec0a2d30 0x7f19ec0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:27.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.943+0000 7f19fea00700 1 -- 172.21.15.2:0/1376149855 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f19f00d0890 con 0x7f1a08109480 2024-06-13T02:15:27.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.943+0000 7f1a05e00700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19ec0a2d30 0x7f19ec0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:27.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.943+0000 7f19fea00700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460] conn(0x7f19ec0adfe0 0x7f19ec0b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:27.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.943+0000 7f19fea00700 1 -- 172.21.15.2:0/1376149855 --> [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19f000b0b0 con 0x7f19ec0adfe0 2024-06-13T02:15:27.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.943+0000 7f19fea00700 1 -- 172.21.15.2:0/1376149855 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f19f00d0ce0 con 0x7f1a08109480 2024-06-13T02:15:27.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.943+0000 7f1a06800700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460] conn(0x7f19ec0adfe0 0x7f19ec0b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:27.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.944+0000 7f1a05e00700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19ec0a2d30 0x7f19ec0a51f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f19f8005950 tx=0x7f19f8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:27.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.944+0000 7f1a06800700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460] conn(0x7f19ec0adfe0 0x7f19ec0b0480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.945+0000 7f19fea00700 1 -- 172.21.15.2:0/1376149855 <== osd.10 v2:172.21.15.84:6824/4269523460 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f19f000b0b0 con 0x7f19ec0adfe0 2024-06-13T02:15:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.963+0000 7f1a0d000700 1 -- 172.21.15.2:0/1376149855 --> [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1a08062f40 con 0x7f19ec0adfe0 2024-06-13T02:15:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.964+0000 7f19fea00700 1 -- 172.21.15.2:0/1376149855 <== osd.10 v2:172.21.15.84:6824/4269523460 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1a08062f40 con 0x7f19ec0adfe0 2024-06-13T02:15:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.964+0000 7f1a0d000700 1 -- 172.21.15.2:0/1376149855 >> [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460] conn(0x7f19ec0adfe0 msgr2=0x7f19ec0b0480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.964+0000 7f1a0d000700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460] conn(0x7f19ec0adfe0 0x7f19ec0b0480 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.964+0000 7f1a0d000700 1 -- 172.21.15.2:0/1376149855 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19ec0a2d30 msgr2=0x7f19ec0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.964+0000 7f1a0d000700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f19ec0a2d30 0x7f19ec0a51f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f19f8005950 tx=0x7f19f8009310 comp rx=0 tx=0).stop 2024-06-13T02:15:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.964+0000 7f1a0d000700 1 -- 172.21.15.2:0/1376149855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a08109480 msgr2=0x7f1a0819f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.964+0000 7f1a0d000700 1 --2- 172.21.15.2:0/1376149855 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a08109480 0x7f1a0819f7d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19f0000c00 tx=0x7f19f000fa00 comp rx=0 tx=0).stop 2024-06-13T02:15:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.964+0000 7f1a06800700 1 -- 172.21.15.2:0/1376149855 reap_dead start 2024-06-13T02:15:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.964+0000 7f1a0d000700 1 -- 172.21.15.2:0/1376149855 shutdown_connections 2024-06-13T02:15:27.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.964+0000 7f1a0d000700 1 -- 172.21.15.2:0/1376149855 >> 172.21.15.2:0/1376149855 conn(0x7f1a08075c60 msgr2=0x7f1a080761e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:27.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.965+0000 7f1a0d000700 1 -- 172.21.15.2:0/1376149855 shutdown_connections 2024-06-13T02:15:27.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:26.965+0000 7f1a0d000700 1 -- 172.21.15.2:0/1376149855 wait complete. 2024-06-13T02:15:27.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:27 smithi084 ceph-mon[36833]: pgmap v421: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:15:28.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:27 smithi175 ceph-mon[36977]: pgmap v421: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:15:28.620 INFO:teuthology.orchestra.run.smithi002.stdout:313532612663 2024-06-13T02:15:28.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-06-13T02:15:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.317+0000 7fc04de00700 1 -- 172.21.15.2:0/3548977420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc048108500 msgr2=0x7fc0481088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.317+0000 7fc04de00700 1 --2- 172.21.15.2:0/3548977420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc048108500 0x7fc0481088e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc038009990 tx=0x7fc038009ca0 comp rx=0 tx=0).stop 2024-06-13T02:15:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.317+0000 7fc04de00700 1 -- 172.21.15.2:0/3548977420 shutdown_connections 2024-06-13T02:15:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.317+0000 7fc04de00700 1 --2- 172.21.15.2:0/3548977420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc04806ab30 0x7fc04810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.317+0000 7fc04de00700 1 --2- 172.21.15.2:0/3548977420 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc048108500 0x7fc0481088e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:28.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.317+0000 7fc04de00700 1 --2- 172.21.15.2:0/3548977420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc04806a170 0x7fc04806a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.317+0000 7fc04de00700 1 -- 172.21.15.2:0/3548977420 >> 172.21.15.2:0/3548977420 conn(0x7fc048078340 msgr2=0x7fc048078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.317+0000 7fc04de00700 1 -- 172.21.15.2:0/3548977420 shutdown_connections 2024-06-13T02:15:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.317+0000 7fc04de00700 1 -- 172.21.15.2:0/3548977420 wait complete. 2024-06-13T02:15:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.319+0000 7fc04de00700 1 Processor -- start 2024-06-13T02:15:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.319+0000 7fc04de00700 1 -- start start 2024-06-13T02:15:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.319+0000 7fc04de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc04806a170 0x7fc048103050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.319+0000 7fc04de00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc04806ab30 0x7fc048101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.320+0000 7fc04de00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc048108500 0x7fc048101ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.320+0000 7fc04de00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc0481127d0 con 0x7fc04806a170 2024-06-13T02:15:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.320+0000 7fc04de00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc048112650 con 0x7fc04806ab30 2024-06-13T02:15:28.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.320+0000 7fc04de00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc048112950 con 0x7fc048108500 2024-06-13T02:15:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.320+0000 7fc047400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc048108500 0x7fc048101ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.320+0000 7fc047400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc048108500 0x7fc048101ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:37260/0 (socket says 172.21.15.2:37260) 2024-06-13T02:15:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.320+0000 7fc047400700 1 -- 172.21.15.2:0/2986692592 learned_addr learned my addr 172.21.15.2:0/2986692592 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.320+0000 7fc046a00700 1 --2- 172.21.15.2:0/2986692592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc04806a170 0x7fc048103050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.320+0000 7fc046000700 1 --2- 172.21.15.2:0/2986692592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc04806ab30 0x7fc048101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.320+0000 7fc047400700 1 -- 172.21.15.2:0/2986692592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc04806ab30 msgr2=0x7fc048101460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.320+0000 7fc047400700 1 --2- 172.21.15.2:0/2986692592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc04806ab30 0x7fc048101460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.320+0000 7fc047400700 1 -- 172.21.15.2:0/2986692592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc04806a170 msgr2=0x7fc048103050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.320+0000 7fc047400700 1 --2- 172.21.15.2:0/2986692592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc04806a170 0x7fc048103050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.320+0000 7fc047400700 1 -- 172.21.15.2:0/2986692592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0481ab6b0 con 0x7fc048108500 2024-06-13T02:15:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.321+0000 7fc047400700 1 --2- 172.21.15.2:0/2986692592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc048108500 0x7fc048101ac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc04000ef30 tx=0x7fc04000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:28.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.321+0000 7fc04ca00700 1 -- 172.21.15.2:0/2986692592 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0400092e0 con 0x7fc048108500 2024-06-13T02:15:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.321+0000 7fc04ca00700 1 -- 172.21.15.2:0/2986692592 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc040004bb0 con 0x7fc048108500 2024-06-13T02:15:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.321+0000 7fc04de00700 1 -- 172.21.15.2:0/2986692592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0481ab8e0 con 0x7fc048108500 2024-06-13T02:15:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.321+0000 7fc04ca00700 1 -- 172.21.15.2:0/2986692592 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc040004280 con 0x7fc048108500 2024-06-13T02:15:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.321+0000 7fc04de00700 1 -- 172.21.15.2:0/2986692592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0481abdf0 con 0x7fc048108500 2024-06-13T02:15:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.322+0000 7fc04de00700 1 -- 172.21.15.2:0/2986692592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc048062b60 con 0x7fc048108500 2024-06-13T02:15:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.325+0000 7fc04ca00700 1 -- 172.21.15.2:0/2986692592 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fc04001b030 con 0x7fc048108500 2024-06-13T02:15:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.327+0000 7fc04ca00700 1 --2- 172.21.15.2:0/2986692592 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc02c0a2d30 0x7fc02c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.327+0000 7fc04ca00700 1 -- 172.21.15.2:0/2986692592 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fc0400cf9f0 con 0x7fc048108500 2024-06-13T02:15:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.327+0000 7fc046a00700 1 --2- 172.21.15.2:0/2986692592 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc02c0a2d30 0x7fc02c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.327+0000 7fc04ca00700 1 --2- 172.21.15.2:0/2986692592 >> [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653] conn(0x7fc02c0ae110 0x7fc02c0b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.327+0000 7fc04ca00700 1 -- 172.21.15.2:0/2986692592 --> [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc04001fe50 con 0x7fc02c0ae110 2024-06-13T02:15:28.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.327+0000 7fc04ca00700 1 -- 172.21.15.2:0/2986692592 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fc0400cfda0 con 0x7fc048108500 2024-06-13T02:15:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.328+0000 7fc046000700 1 --2- 172.21.15.2:0/2986692592 >> [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653] conn(0x7fc02c0ae110 0x7fc02c0b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.328+0000 7fc046a00700 1 --2- 172.21.15.2:0/2986692592 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc02c0a2d30 0x7fc02c0a51f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc038006010 tx=0x7fc03800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.328+0000 7fc046000700 1 --2- 172.21.15.2:0/2986692592 >> [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653] conn(0x7fc02c0ae110 0x7fc02c0b05b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.329+0000 7fc04ca00700 1 -- 172.21.15.2:0/2986692592 <== osd.7 v2:172.21.15.84:6816/3873726653 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc04001fe50 con 0x7fc02c0ae110 2024-06-13T02:15:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.348+0000 7fc04de00700 1 -- 172.21.15.2:0/2986692592 --> [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc048062f60 con 0x7fc02c0ae110 2024-06-13T02:15:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.349+0000 7fc04ca00700 1 -- 172.21.15.2:0/2986692592 <== osd.7 v2:172.21.15.84:6816/3873726653 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc048062f60 con 0x7fc02c0ae110 2024-06-13T02:15:28.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.349+0000 7fc04de00700 1 -- 172.21.15.2:0/2986692592 >> [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653] conn(0x7fc02c0ae110 msgr2=0x7fc02c0b05b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.349+0000 7fc04de00700 1 --2- 172.21.15.2:0/2986692592 >> [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653] conn(0x7fc02c0ae110 0x7fc02c0b05b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.349+0000 7fc04de00700 1 -- 172.21.15.2:0/2986692592 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc02c0a2d30 msgr2=0x7fc02c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.349+0000 7fc04de00700 1 --2- 172.21.15.2:0/2986692592 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc02c0a2d30 0x7fc02c0a51f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc038006010 tx=0x7fc03800b260 comp rx=0 tx=0).stop 2024-06-13T02:15:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.349+0000 7fc04de00700 1 -- 172.21.15.2:0/2986692592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc048108500 msgr2=0x7fc048101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.349+0000 7fc04de00700 1 --2- 172.21.15.2:0/2986692592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc048108500 0x7fc048101ac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc04000ef30 tx=0x7fc04000c3a0 comp rx=0 tx=0).stop 2024-06-13T02:15:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.349+0000 7fc047400700 1 -- 172.21.15.2:0/2986692592 reap_dead start 2024-06-13T02:15:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.349+0000 7fc04de00700 1 -- 172.21.15.2:0/2986692592 shutdown_connections 2024-06-13T02:15:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.350+0000 7fc04de00700 1 -- 172.21.15.2:0/2986692592 >> 172.21.15.2:0/2986692592 conn(0x7fc048078340 msgr2=0x7fc048100020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.350+0000 7fc04de00700 1 -- 172.21.15.2:0/2986692592 shutdown_connections 2024-06-13T02:15:28.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:28.350+0000 7fc04de00700 1 -- 172.21.15.2:0/2986692592 wait complete. 2024-06-13T02:15:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.473+0000 7f514ec00700 1 -- 172.21.15.2:0/343954707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f514806a170 msgr2=0x7f514806a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.473+0000 7f514ec00700 1 --2- 172.21.15.2:0/343954707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f514806a170 0x7f514806a5f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5134009990 tx=0x7f5134009ca0 comp rx=0 tx=0).stop 2024-06-13T02:15:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.473+0000 7f514ec00700 1 -- 172.21.15.2:0/343954707 shutdown_connections 2024-06-13T02:15:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.473+0000 7f514ec00700 1 --2- 172.21.15.2:0/343954707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f514806ab30 0x7f514810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.473+0000 7f514ec00700 1 --2- 172.21.15.2:0/343954707 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5148108500 0x7f51481088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.473+0000 7f514ec00700 1 --2- 172.21.15.2:0/343954707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f514806a170 0x7f514806a5f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.473+0000 7f514ec00700 1 -- 172.21.15.2:0/343954707 >> 172.21.15.2:0/343954707 conn(0x7f5148078340 msgr2=0x7f5148078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.473+0000 7f514ec00700 1 -- 172.21.15.2:0/343954707 shutdown_connections 2024-06-13T02:15:29.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.473+0000 7f514ec00700 1 -- 172.21.15.2:0/343954707 wait complete. 2024-06-13T02:15:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.474+0000 7f514ec00700 1 Processor -- start 2024-06-13T02:15:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.475+0000 7f514ec00700 1 -- start start 2024-06-13T02:15:29.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.475+0000 7f514ec00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f514806a170 0x7f514819aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.475+0000 7f514ec00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f514806ab30 0x7f514819b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.475+0000 7f514ec00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5148108500 0x7f514819f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.475+0000 7f514ec00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f51481127b0 con 0x7f5148108500 2024-06-13T02:15:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.475+0000 7f514ec00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5148112630 con 0x7f514806a170 2024-06-13T02:15:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.475+0000 7f514ec00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5148112930 con 0x7f514806ab30 2024-06-13T02:15:29.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.476+0000 7f5147e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f514806a170 0x7f514819aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.476+0000 7f5147e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f514806a170 0x7f514819aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:41432/0 (socket says 172.21.15.2:41432) 2024-06-13T02:15:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.476+0000 7f5147e00700 1 -- 172.21.15.2:0/3108757309 learned_addr learned my addr 172.21.15.2:0/3108757309 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.476+0000 7f514cc00700 1 --2- 172.21.15.2:0/3108757309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5148108500 0x7f514819f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.476+0000 7f5147400700 1 --2- 172.21.15.2:0/3108757309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f514806ab30 0x7f514819b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.476+0000 7f5147e00700 1 -- 172.21.15.2:0/3108757309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f514806ab30 msgr2=0x7f514819b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.476+0000 7f5147e00700 1 --2- 172.21.15.2:0/3108757309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f514806ab30 0x7f514819b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.476+0000 7f5147e00700 1 -- 172.21.15.2:0/3108757309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5148108500 msgr2=0x7f514819f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.476+0000 7f5147e00700 1 --2- 172.21.15.2:0/3108757309 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5148108500 0x7f514819f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.476+0000 7f5147e00700 1 -- 172.21.15.2:0/3108757309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514819fef0 con 0x7f514806a170 2024-06-13T02:15:29.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.476+0000 7f5147e00700 1 --2- 172.21.15.2:0/3108757309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f514806a170 0x7f514819aee0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f513800e9a0 tx=0x7f513800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.477+0000 7f5144c00700 1 -- 172.21.15.2:0/3108757309 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513800ca10 con 0x7f514806a170 2024-06-13T02:15:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.477+0000 7f5144c00700 1 -- 172.21.15.2:0/3108757309 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f513800cbb0 con 0x7f514806a170 2024-06-13T02:15:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.477+0000 7f5144c00700 1 -- 172.21.15.2:0/3108757309 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5138018680 con 0x7f514806a170 2024-06-13T02:15:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.477+0000 7f514ec00700 1 -- 172.21.15.2:0/3108757309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51481a01e0 con 0x7f514806a170 2024-06-13T02:15:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.477+0000 7f514ec00700 1 -- 172.21.15.2:0/3108757309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51481a7a60 con 0x7f514806a170 2024-06-13T02:15:29.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.478+0000 7f514ec00700 1 -- 172.21.15.2:0/3108757309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f514810e030 con 0x7f514806a170 2024-06-13T02:15:29.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.480+0000 7f5144c00700 1 -- 172.21.15.2:0/3108757309 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f5138010430 con 0x7f514806a170 2024-06-13T02:15:29.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.481+0000 7f5144c00700 1 --2- 172.21.15.2:0/3108757309 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f512c0a2d30 0x7f512c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.481+0000 7f5144c00700 1 -- 172.21.15.2:0/3108757309 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f51380cffa0 con 0x7f514806a170 2024-06-13T02:15:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.482+0000 7f5147400700 1 --2- 172.21.15.2:0/3108757309 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f512c0a2d30 0x7f512c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.482+0000 7f5144c00700 1 --2- 172.21.15.2:0/3108757309 >> [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106] conn(0x7f512c0ae110 0x7f512c0b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:29.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.482+0000 7f5144c00700 1 -- 172.21.15.2:0/3108757309 --> [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5138019ec0 con 0x7f512c0ae110 2024-06-13T02:15:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.482+0000 7f5144c00700 1 -- 172.21.15.2:0/3108757309 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f51380d0350 con 0x7f514806a170 2024-06-13T02:15:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.482+0000 7f514cc00700 1 --2- 172.21.15.2:0/3108757309 >> [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106] conn(0x7f512c0ae110 0x7f512c0b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.482+0000 7f5147400700 1 --2- 172.21.15.2:0/3108757309 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f512c0a2d30 0x7f512c0a51f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5148103420 tx=0x7f5134005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:29.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.483+0000 7f514cc00700 1 --2- 172.21.15.2:0/3108757309 >> [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106] conn(0x7f512c0ae110 0x7f512c0b05b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:29.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.484+0000 7f5144c00700 1 -- 172.21.15.2:0/3108757309 <== osd.6 v2:172.21.15.2:6818/297321106 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5138019ec0 con 0x7f512c0ae110 2024-06-13T02:15:29.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.502+0000 7f514ec00700 1 -- 172.21.15.2:0/3108757309 --> [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5148103bc0 con 0x7f512c0ae110 2024-06-13T02:15:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.503+0000 7f5144c00700 1 -- 172.21.15.2:0/3108757309 <== osd.6 v2:172.21.15.2:6818/297321106 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5148103bc0 con 0x7f512c0ae110 2024-06-13T02:15:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.503+0000 7f514ec00700 1 -- 172.21.15.2:0/3108757309 >> [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106] conn(0x7f512c0ae110 msgr2=0x7f512c0b05b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:29.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.503+0000 7f514ec00700 1 --2- 172.21.15.2:0/3108757309 >> [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106] conn(0x7f512c0ae110 0x7f512c0b05b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.503+0000 7f514ec00700 1 -- 172.21.15.2:0/3108757309 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f512c0a2d30 msgr2=0x7f512c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.503+0000 7f514ec00700 1 --2- 172.21.15.2:0/3108757309 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f512c0a2d30 0x7f512c0a51f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5148103420 tx=0x7f5134005fd0 comp rx=0 tx=0).stop 2024-06-13T02:15:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.503+0000 7f514ec00700 1 -- 172.21.15.2:0/3108757309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f514806a170 msgr2=0x7f514819aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.503+0000 7f514ec00700 1 --2- 172.21.15.2:0/3108757309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f514806a170 0x7f514819aee0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f513800e9a0 tx=0x7f513800ecb0 comp rx=0 tx=0).stop 2024-06-13T02:15:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.503+0000 7f514cc00700 1 -- 172.21.15.2:0/3108757309 reap_dead start 2024-06-13T02:15:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.504+0000 7f514ec00700 1 -- 172.21.15.2:0/3108757309 shutdown_connections 2024-06-13T02:15:29.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.504+0000 7f514ec00700 1 -- 172.21.15.2:0/3108757309 >> 172.21.15.2:0/3108757309 conn(0x7f5148078340 msgr2=0x7f514810d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:29.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.504+0000 7f514ec00700 1 -- 172.21.15.2:0/3108757309 shutdown_connections 2024-06-13T02:15:29.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.504+0000 7f514ec00700 1 -- 172.21.15.2:0/3108757309 wait complete. 2024-06-13T02:15:29.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:29 smithi002 ceph-mon[31960]: pgmap v422: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T02:15:29.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:29 smithi084 ceph-mon[36833]: pgmap v422: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T02:15:30.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:29 smithi175 ceph-mon[36977]: pgmap v422: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-06-13T02:15:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.206+0000 7fe2bba00700 1 -- 172.21.15.2:0/3995332014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b41024d0 msgr2=0x7fe2b4102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.206+0000 7fe2bba00700 1 --2- 172.21.15.2:0/3995332014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b41024d0 0x7fe2b4102950 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00099c0 tx=0x7fe2a0009cd0 comp rx=0 tx=0).stop 2024-06-13T02:15:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.206+0000 7fe2bba00700 1 -- 172.21.15.2:0/3995332014 shutdown_connections 2024-06-13T02:15:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.206+0000 7fe2bba00700 1 --2- 172.21.15.2:0/3995332014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2b4102e90 0x7fe2b410f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.206+0000 7fe2bba00700 1 --2- 172.21.15.2:0/3995332014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b4108580 0x7fe2b4108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.206+0000 7fe2bba00700 1 --2- 172.21.15.2:0/3995332014 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b41024d0 0x7fe2b4102950 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.206+0000 7fe2bba00700 1 -- 172.21.15.2:0/3995332014 >> 172.21.15.2:0/3995332014 conn(0x7fe2b40fdf60 msgr2=0x7fe2b4100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.207+0000 7fe2bba00700 1 -- 172.21.15.2:0/3995332014 shutdown_connections 2024-06-13T02:15:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.207+0000 7fe2bba00700 1 -- 172.21.15.2:0/3995332014 wait complete. 2024-06-13T02:15:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.208+0000 7fe2bba00700 1 Processor -- start 2024-06-13T02:15:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.208+0000 7fe2bba00700 1 -- start start 2024-06-13T02:15:30.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.209+0000 7fe2bba00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b41024d0 0x7fe2b419e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:30.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.209+0000 7fe2bba00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b4102e90 0x7fe2b419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:30.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.209+0000 7fe2bba00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2b4108580 0x7fe2b4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:30.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.209+0000 7fe2bba00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b4112820 con 0x7fe2b41024d0 2024-06-13T02:15:30.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.209+0000 7fe2bba00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41126a0 con 0x7fe2b4102e90 2024-06-13T02:15:30.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.209+0000 7fe2bba00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41129a0 con 0x7fe2b4108580 2024-06-13T02:15:30.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.209+0000 7fe2b9000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b41024d0 0x7fe2b419e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:30.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.209+0000 7fe2b9000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b41024d0 0x7fe2b419e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33744/0 (socket says 172.21.15.2:33744) 2024-06-13T02:15:30.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.209+0000 7fe2b9000700 1 -- 172.21.15.2:0/436777485 learned_addr learned my addr 172.21.15.2:0/436777485 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:30.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.209+0000 7fe2b3e00700 1 --2- 172.21.15.2:0/436777485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b4102e90 0x7fe2b419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:30.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.209+0000 7fe2b9a00700 1 --2- 172.21.15.2:0/436777485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2b4108580 0x7fe2b4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.210+0000 7fe2b3e00700 1 -- 172.21.15.2:0/436777485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2b4108580 msgr2=0x7fe2b4198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.210+0000 7fe2b3e00700 1 --2- 172.21.15.2:0/436777485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2b4108580 0x7fe2b4198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.210+0000 7fe2b3e00700 1 -- 172.21.15.2:0/436777485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b41024d0 msgr2=0x7fe2b419e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.210+0000 7fe2b3e00700 1 --2- 172.21.15.2:0/436777485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b41024d0 0x7fe2b419e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:30.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.210+0000 7fe2b3e00700 1 -- 172.21.15.2:0/436777485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b4199160 con 0x7fe2b4102e90 2024-06-13T02:15:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.210+0000 7fe2b9000700 1 --2- 172.21.15.2:0/436777485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe2b41024d0 0x7fe2b419e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:15:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.210+0000 7fe2b3e00700 1 --2- 172.21.15.2:0/436777485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b4102e90 0x7fe2b419ed30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00098e0 tx=0x7fe2a0003a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.210+0000 7fe2b1600700 1 -- 172.21.15.2:0/436777485 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0003680 con 0x7fe2b4102e90 2024-06-13T02:15:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.210+0000 7fe2b1600700 1 -- 172.21.15.2:0/436777485 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2a00055a0 con 0x7fe2b4102e90 2024-06-13T02:15:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.210+0000 7fe2bba00700 1 -- 172.21.15.2:0/436777485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b41993f0 con 0x7fe2b4102e90 2024-06-13T02:15:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.210+0000 7fe2b1600700 1 -- 172.21.15.2:0/436777485 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a000fc90 con 0x7fe2b4102e90 2024-06-13T02:15:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.211+0000 7fe2bba00700 1 -- 172.21.15.2:0/436777485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b41a56c0 con 0x7fe2b4102e90 2024-06-13T02:15:30.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.211+0000 7fe2bba00700 1 -- 172.21.15.2:0/436777485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe2b4062c20 con 0x7fe2b4102e90 2024-06-13T02:15:30.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.214+0000 7fe2b1600700 1 -- 172.21.15.2:0/436777485 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7fe2a000f460 con 0x7fe2b4102e90 2024-06-13T02:15:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.216+0000 7fe2b1600700 1 --2- 172.21.15.2:0/436777485 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fe29c0a2ed0 0x7fe29c0a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:30.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.216+0000 7fe2b1600700 1 -- 172.21.15.2:0/436777485 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fe2a00d0940 con 0x7fe2b4102e90 2024-06-13T02:15:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.216+0000 7fe2b9000700 1 --2- 172.21.15.2:0/436777485 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fe29c0a2ed0 0x7fe29c0a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.216+0000 7fe2b1600700 1 --2- 172.21.15.2:0/436777485 >> [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390] conn(0x7fe29c0ae180 0x7fe29c0b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.216+0000 7fe2b1600700 1 -- 172.21.15.2:0/436777485 --> [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2a0027e50 con 0x7fe29c0ae180 2024-06-13T02:15:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.216+0000 7fe2b1600700 1 -- 172.21.15.2:0/436777485 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fe2a00d0cf0 con 0x7fe2b4102e90 2024-06-13T02:15:30.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.216+0000 7fe2b9a00700 1 --2- 172.21.15.2:0/436777485 >> [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390] conn(0x7fe29c0ae180 0x7fe29c0b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:30.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.216+0000 7fe2b9000700 1 --2- 172.21.15.2:0/436777485 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fe29c0a2ed0 0x7fe29c0a5390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4107510 tx=0x7fe2a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:30.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.217+0000 7fe2b9a00700 1 --2- 172.21.15.2:0/436777485 >> [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390] conn(0x7fe29c0ae180 0x7fe29c0b0620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:30.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.218+0000 7fe2b1600700 1 -- 172.21.15.2:0/436777485 <== osd.9 v2:172.21.15.2:6826/1171735390 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe2a0027e50 con 0x7fe29c0ae180 2024-06-13T02:15:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.237+0000 7fe2bba00700 1 -- 172.21.15.2:0/436777485 --> [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe2b4063020 con 0x7fe29c0ae180 2024-06-13T02:15:30.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.237+0000 7fe2b1600700 1 -- 172.21.15.2:0/436777485 <== osd.9 v2:172.21.15.2:6826/1171735390 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe2b4063020 con 0x7fe29c0ae180 2024-06-13T02:15:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.237+0000 7fe2bba00700 1 -- 172.21.15.2:0/436777485 >> [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390] conn(0x7fe29c0ae180 msgr2=0x7fe29c0b0620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.237+0000 7fe2bba00700 1 --2- 172.21.15.2:0/436777485 >> [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390] conn(0x7fe29c0ae180 0x7fe29c0b0620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.238+0000 7fe2bba00700 1 -- 172.21.15.2:0/436777485 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fe29c0a2ed0 msgr2=0x7fe29c0a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.238+0000 7fe2bba00700 1 --2- 172.21.15.2:0/436777485 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fe29c0a2ed0 0x7fe29c0a5390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4107510 tx=0x7fe2a8009260 comp rx=0 tx=0).stop 2024-06-13T02:15:30.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.238+0000 7fe2bba00700 1 -- 172.21.15.2:0/436777485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b4102e90 msgr2=0x7fe2b419ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.238+0000 7fe2bba00700 1 --2- 172.21.15.2:0/436777485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2b4102e90 0x7fe2b419ed30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2a00098e0 tx=0x7fe2a0003a90 comp rx=0 tx=0).stop 2024-06-13T02:15:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.238+0000 7fe2b9a00700 1 -- 172.21.15.2:0/436777485 reap_dead start 2024-06-13T02:15:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.238+0000 7fe2bba00700 1 -- 172.21.15.2:0/436777485 shutdown_connections 2024-06-13T02:15:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.238+0000 7fe2bba00700 1 -- 172.21.15.2:0/436777485 >> 172.21.15.2:0/436777485 conn(0x7fe2b40fdf60 msgr2=0x7fe2b40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.238+0000 7fe2bba00700 1 -- 172.21.15.2:0/436777485 shutdown_connections 2024-06-13T02:15:30.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:30.238+0000 7fe2bba00700 1 -- 172.21.15.2:0/436777485 wait complete. 2024-06-13T02:15:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.373+0000 7f1432000700 1 -- 172.21.15.2:0/1241554786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f142c074fe0 msgr2=0x7f142c10e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:30.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.373+0000 7f1432000700 1 --2- 172.21.15.2:0/1241554786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f142c074fe0 0x7f142c10e950 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1418009990 tx=0x7f1418009ca0 comp rx=0 tx=0).stop 2024-06-13T02:15:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.373+0000 7f1432000700 1 -- 172.21.15.2:0/1241554786 shutdown_connections 2024-06-13T02:15:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.373+0000 7f1432000700 1 --2- 172.21.15.2:0/1241554786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f142c10ee90 0x7f142c111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.373+0000 7f1432000700 1 --2- 172.21.15.2:0/1241554786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f142c0746c0 0x7f142c074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.373+0000 7f1432000700 1 --2- 172.21.15.2:0/1241554786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f142c074fe0 0x7f142c10e950 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.373+0000 7f1432000700 1 -- 172.21.15.2:0/1241554786 >> 172.21.15.2:0/1241554786 conn(0x7f142c0795f0 msgr2=0x7f142c079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.373+0000 7f1432000700 1 -- 172.21.15.2:0/1241554786 shutdown_connections 2024-06-13T02:15:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.373+0000 7f1432000700 1 -- 172.21.15.2:0/1241554786 wait complete. 2024-06-13T02:15:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.375+0000 7f1432000700 1 Processor -- start 2024-06-13T02:15:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.375+0000 7f1432000700 1 -- start start 2024-06-13T02:15:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.376+0000 7f1432000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f142c0746c0 0x7f142c1025b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.376+0000 7f1432000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f142c074fe0 0x7f142c102af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.376+0000 7f1432000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f142c10ee90 0x7f142c103030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:30.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.376+0000 7f1432000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f142c1149a0 con 0x7f142c0746c0 2024-06-13T02:15:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.376+0000 7f1432000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f142c114820 con 0x7f142c10ee90 2024-06-13T02:15:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.376+0000 7f1432000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f142c114b20 con 0x7f142c074fe0 2024-06-13T02:15:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.376+0000 7f142b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f142c0746c0 0x7f142c1025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.376+0000 7f142b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f142c0746c0 0x7f142c1025b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33720/0 (socket says 172.21.15.2:33720) 2024-06-13T02:15:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.376+0000 7f142b400700 1 -- 172.21.15.2:0/3933115366 learned_addr learned my addr 172.21.15.2:0/3933115366 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.376+0000 7f142aa00700 1 --2- 172.21.15.2:0/3933115366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f142c074fe0 0x7f142c102af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.376+0000 7f142be00700 1 --2- 172.21.15.2:0/3933115366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f142c10ee90 0x7f142c103030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.377+0000 7f142b400700 1 -- 172.21.15.2:0/3933115366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f142c074fe0 msgr2=0x7f142c102af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.377+0000 7f142b400700 1 --2- 172.21.15.2:0/3933115366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f142c074fe0 0x7f142c102af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.377+0000 7f142b400700 1 -- 172.21.15.2:0/3933115366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f142c10ee90 msgr2=0x7f142c103030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:30.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.377+0000 7f142b400700 1 --2- 172.21.15.2:0/3933115366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f142c10ee90 0x7f142c103030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.377+0000 7f142b400700 1 -- 172.21.15.2:0/3933115366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142c1ab4c0 con 0x7f142c0746c0 2024-06-13T02:15:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.377+0000 7f142b400700 1 --2- 172.21.15.2:0/3933115366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f142c0746c0 0x7f142c1025b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f141c00e9a0 tx=0x7f141c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.377+0000 7f1423e00700 1 -- 172.21.15.2:0/3933115366 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c00ca10 con 0x7f142c0746c0 2024-06-13T02:15:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.377+0000 7f1423e00700 1 -- 172.21.15.2:0/3933115366 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f141c00cbb0 con 0x7f142c0746c0 2024-06-13T02:15:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.377+0000 7f1423e00700 1 -- 172.21.15.2:0/3933115366 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c018710 con 0x7f142c0746c0 2024-06-13T02:15:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.377+0000 7f1432000700 1 -- 172.21.15.2:0/3933115366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f142c1ab7b0 con 0x7f142c0746c0 2024-06-13T02:15:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.378+0000 7f1432000700 1 -- 172.21.15.2:0/3933115366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f142c1abd10 con 0x7f142c0746c0 2024-06-13T02:15:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.378+0000 7f1432000700 1 -- 172.21.15.2:0/3933115366 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f142c1000c0 con 0x7f142c0746c0 2024-06-13T02:15:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.381+0000 7f1423e00700 1 -- 172.21.15.2:0/3933115366 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f141c0188b0 con 0x7f142c0746c0 2024-06-13T02:15:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.383+0000 7f1423e00700 1 --2- 172.21.15.2:0/3933115366 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f14100a2d30 0x7f14100a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.384+0000 7f1423e00700 1 -- 172.21.15.2:0/3933115366 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f141c0cfb40 con 0x7f142c0746c0 2024-06-13T02:15:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.384+0000 7f142aa00700 1 --2- 172.21.15.2:0/3933115366 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f14100a2d30 0x7f14100a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:30.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.384+0000 7f1423e00700 1 --2- 172.21.15.2:0/3933115366 >> [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403] conn(0x7f14100ae110 0x7f14100b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.384+0000 7f1423e00700 1 -- 172.21.15.2:0/3933115366 --> [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f141c016ec0 con 0x7f14100ae110 2024-06-13T02:15:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.384+0000 7f1423e00700 1 -- 172.21.15.2:0/3933115366 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f141c0cff90 con 0x7f142c0746c0 2024-06-13T02:15:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.384+0000 7f142be00700 1 --2- 172.21.15.2:0/3933115366 >> [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403] conn(0x7f14100ae110 0x7f14100b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.384+0000 7f142aa00700 1 --2- 172.21.15.2:0/3933115366 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f14100a2d30 0x7f14100a51f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1418006010 tx=0x7f1418005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.385+0000 7f142be00700 1 --2- 172.21.15.2:0/3933115366 >> [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403] conn(0x7f14100ae110 0x7f14100b05b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.386+0000 7f1423e00700 1 -- 172.21.15.2:0/3933115366 <== osd.1 v2:172.21.15.84:6800/1593775403 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f141c016ec0 con 0x7f14100ae110 2024-06-13T02:15:30.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.404+0000 7f1432000700 1 -- 172.21.15.2:0/3933115366 --> [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f142c075db0 con 0x7f14100ae110 2024-06-13T02:15:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.404+0000 7f1423e00700 1 -- 172.21.15.2:0/3933115366 <== osd.1 v2:172.21.15.84:6800/1593775403 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f142c075db0 con 0x7f14100ae110 2024-06-13T02:15:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.405+0000 7f1432000700 1 -- 172.21.15.2:0/3933115366 >> [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403] conn(0x7f14100ae110 msgr2=0x7f14100b05b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.405+0000 7f1432000700 1 --2- 172.21.15.2:0/3933115366 >> [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403] conn(0x7f14100ae110 0x7f14100b05b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.405+0000 7f1432000700 1 -- 172.21.15.2:0/3933115366 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f14100a2d30 msgr2=0x7f14100a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.405+0000 7f1432000700 1 --2- 172.21.15.2:0/3933115366 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f14100a2d30 0x7f14100a51f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1418006010 tx=0x7f1418005960 comp rx=0 tx=0).stop 2024-06-13T02:15:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.405+0000 7f1432000700 1 -- 172.21.15.2:0/3933115366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f142c0746c0 msgr2=0x7f142c1025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.405+0000 7f1432000700 1 --2- 172.21.15.2:0/3933115366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f142c0746c0 0x7f142c1025b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f141c00e9a0 tx=0x7f141c00ecb0 comp rx=0 tx=0).stop 2024-06-13T02:15:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.405+0000 7f142be00700 1 -- 172.21.15.2:0/3933115366 reap_dead start 2024-06-13T02:15:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.406+0000 7f1432000700 1 -- 172.21.15.2:0/3933115366 shutdown_connections 2024-06-13T02:15:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.406+0000 7f1432000700 1 -- 172.21.15.2:0/3933115366 >> 172.21.15.2:0/3933115366 conn(0x7f142c0795f0 msgr2=0x7f142c0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.406+0000 7f1432000700 1 -- 172.21.15.2:0/3933115366 shutdown_connections 2024-06-13T02:15:30.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:29.406+0000 7f1432000700 1 -- 172.21.15.2:0/3933115366 wait complete. 2024-06-13T02:15:30.803 INFO:teuthology.orchestra.run.smithi002.stdout:347892351026 2024-06-13T02:15:30.804 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-06-13T02:15:31.628 INFO:teuthology.orchestra.run.smithi002.stdout:34359738479 2024-06-13T02:15:31.628 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-06-13T02:15:31.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:31 smithi002 ceph-mon[31960]: pgmap v423: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T02:15:31.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:31 smithi084 ceph-mon[36833]: pgmap v423: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T02:15:32.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:31 smithi175 ceph-mon[36977]: pgmap v423: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-13T02:15:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.687+0000 7f7d6b600700 1 -- 172.21.15.2:0/414862416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d64102ef0 msgr2=0x7f7d6410f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.687+0000 7f7d6b600700 1 --2- 172.21.15.2:0/414862416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d64102ef0 0x7f7d6410f3a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c00b0d0 tx=0x7f7d5c00b3e0 comp rx=0 tx=0).stop 2024-06-13T02:15:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.687+0000 7f7d6b600700 1 -- 172.21.15.2:0/414862416 shutdown_connections 2024-06-13T02:15:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.687+0000 7f7d6b600700 1 --2- 172.21.15.2:0/414862416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d64102ef0 0x7f7d6410f3a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.687+0000 7f7d6b600700 1 --2- 172.21.15.2:0/414862416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d641085d0 0x7f7d641089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.687+0000 7f7d6b600700 1 --2- 172.21.15.2:0/414862416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d64102530 0x7f7d641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.687+0000 7f7d6b600700 1 -- 172.21.15.2:0/414862416 >> 172.21.15.2:0/414862416 conn(0x7f7d64079640 msgr2=0x7f7d64079a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.687+0000 7f7d6b600700 1 -- 172.21.15.2:0/414862416 shutdown_connections 2024-06-13T02:15:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.687+0000 7f7d6b600700 1 -- 172.21.15.2:0/414862416 wait complete. 2024-06-13T02:15:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.688+0000 7f7d6b600700 1 Processor -- start 2024-06-13T02:15:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.688+0000 7f7d6b600700 1 -- start start 2024-06-13T02:15:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.689+0000 7f7d6b600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d64102530 0x7f7d6419ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.689+0000 7f7d6b600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d64102ef0 0x7f7d6419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.689+0000 7f7d6b600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d641085d0 0x7f7d6419f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.689+0000 7f7d6b600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7d64112820 con 0x7f7d64102530 2024-06-13T02:15:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.689+0000 7f7d6b600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7d641126a0 con 0x7f7d64102ef0 2024-06-13T02:15:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.689+0000 7f7d6b600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7d641129a0 con 0x7f7d641085d0 2024-06-13T02:15:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.689+0000 7f7d5be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d64102ef0 0x7f7d6419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.689+0000 7f7d5be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d64102ef0 0x7f7d6419b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:38584/0 (socket says 172.21.15.2:38584) 2024-06-13T02:15:32.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.689+0000 7f7d5be00700 1 -- 172.21.15.2:0/1616377845 learned_addr learned my addr 172.21.15.2:0/1616377845 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.689+0000 7f7d69600700 1 --2- 172.21.15.2:0/1616377845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d641085d0 0x7f7d6419f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.689+0000 7f7d68c00700 1 --2- 172.21.15.2:0/1616377845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d64102530 0x7f7d6419ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.690+0000 7f7d5be00700 1 -- 172.21.15.2:0/1616377845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d641085d0 msgr2=0x7f7d6419f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.690+0000 7f7d5be00700 1 --2- 172.21.15.2:0/1616377845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d641085d0 0x7f7d6419f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.690+0000 7f7d5be00700 1 -- 172.21.15.2:0/1616377845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d64102530 msgr2=0x7f7d6419ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.690+0000 7f7d5be00700 1 --2- 172.21.15.2:0/1616377845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d64102530 0x7f7d6419ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.690+0000 7f7d5be00700 1 -- 172.21.15.2:0/1616377845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6419fe60 con 0x7f7d64102ef0 2024-06-13T02:15:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.690+0000 7f7d68c00700 1 --2- 172.21.15.2:0/1616377845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d64102530 0x7f7d6419ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:15:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.690+0000 7f7d5be00700 1 --2- 172.21.15.2:0/1616377845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d64102ef0 0x7f7d6419b390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00e9c0 tx=0x7f7d4c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.690+0000 7f7d62000700 1 -- 172.21.15.2:0/1616377845 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c00cbd0 con 0x7f7d64102ef0 2024-06-13T02:15:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.690+0000 7f7d62000700 1 -- 172.21.15.2:0/1616377845 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d4c00cd70 con 0x7f7d64102ef0 2024-06-13T02:15:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.690+0000 7f7d62000700 1 -- 172.21.15.2:0/1616377845 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c010430 con 0x7f7d64102ef0 2024-06-13T02:15:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.691+0000 7f7d6b600700 1 -- 172.21.15.2:0/1616377845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d641a0150 con 0x7f7d64102ef0 2024-06-13T02:15:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.691+0000 7f7d6b600700 1 -- 172.21.15.2:0/1616377845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d641a79d0 con 0x7f7d64102ef0 2024-06-13T02:15:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.691+0000 7f7d6b600700 1 -- 172.21.15.2:0/1616377845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7d640762e0 con 0x7f7d64102ef0 2024-06-13T02:15:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.693+0000 7f7d62000700 1 -- 172.21.15.2:0/1616377845 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f7d4c004750 con 0x7f7d64102ef0 2024-06-13T02:15:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.695+0000 7f7d62000700 1 --2- 172.21.15.2:0/1616377845 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d480a2d30 0x7f7d480a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.695+0000 7f7d62000700 1 -- 172.21.15.2:0/1616377845 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f7d4c0cfc80 con 0x7f7d64102ef0 2024-06-13T02:15:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.695+0000 7f7d68c00700 1 --2- 172.21.15.2:0/1616377845 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d480a2d30 0x7f7d480a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.696+0000 7f7d62000700 1 --2- 172.21.15.2:0/1616377845 >> [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289] conn(0x7f7d480ae110 0x7f7d480b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.696+0000 7f7d62000700 1 -- 172.21.15.2:0/1616377845 --> [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d480b0c80 con 0x7f7d480ae110 2024-06-13T02:15:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.696+0000 7f7d62000700 1 -- 172.21.15.2:0/1616377845 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f7d4c0d0030 con 0x7f7d64102ef0 2024-06-13T02:15:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.696+0000 7f7d69600700 1 --2- 172.21.15.2:0/1616377845 >> [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289] conn(0x7f7d480ae110 0x7f7d480b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.696+0000 7f7d68c00700 1 --2- 172.21.15.2:0/1616377845 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d480a2d30 0x7f7d480a51f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009ca0 tx=0x7f7d54009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.697+0000 7f7d69600700 1 --2- 172.21.15.2:0/1616377845 >> [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289] conn(0x7f7d480ae110 0x7f7d480b05b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.698+0000 7f7d62000700 1 -- 172.21.15.2:0/1616377845 <== osd.3 v2:172.21.15.2:6810/3010864289 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7d480b0c80 con 0x7f7d480ae110 2024-06-13T02:15:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.716+0000 7f7d6b600700 1 -- 172.21.15.2:0/1616377845 --> [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7d64103c40 con 0x7f7d480ae110 2024-06-13T02:15:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.717+0000 7f7d62000700 1 -- 172.21.15.2:0/1616377845 <== osd.3 v2:172.21.15.2:6810/3010864289 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7d64103c40 con 0x7f7d480ae110 2024-06-13T02:15:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.717+0000 7f7d6b600700 1 -- 172.21.15.2:0/1616377845 >> [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289] conn(0x7f7d480ae110 msgr2=0x7f7d480b05b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.717+0000 7f7d6b600700 1 --2- 172.21.15.2:0/1616377845 >> [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289] conn(0x7f7d480ae110 0x7f7d480b05b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.718+0000 7f7d6b600700 1 -- 172.21.15.2:0/1616377845 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d480a2d30 msgr2=0x7f7d480a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.718+0000 7f7d6b600700 1 --2- 172.21.15.2:0/1616377845 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7d480a2d30 0x7f7d480a51f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009ca0 tx=0x7f7d54009260 comp rx=0 tx=0).stop 2024-06-13T02:15:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.718+0000 7f7d6b600700 1 -- 172.21.15.2:0/1616377845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d64102ef0 msgr2=0x7f7d6419b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.718+0000 7f7d6b600700 1 --2- 172.21.15.2:0/1616377845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d64102ef0 0x7f7d6419b390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00e9c0 tx=0x7f7d4c00ecd0 comp rx=0 tx=0).stop 2024-06-13T02:15:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.718+0000 7f7d69600700 1 -- 172.21.15.2:0/1616377845 reap_dead start 2024-06-13T02:15:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.718+0000 7f7d6b600700 1 -- 172.21.15.2:0/1616377845 shutdown_connections 2024-06-13T02:15:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.718+0000 7f7d6b600700 1 -- 172.21.15.2:0/1616377845 >> 172.21.15.2:0/1616377845 conn(0x7f7d64079640 msgr2=0x7f7d640748f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.718+0000 7f7d6b600700 1 -- 172.21.15.2:0/1616377845 shutdown_connections 2024-06-13T02:15:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:32.718+0000 7f7d6b600700 1 -- 172.21.15.2:0/1616377845 wait complete. 2024-06-13T02:15:33.452 INFO:teuthology.orchestra.run.smithi002.stdout:292057776190 2024-06-13T02:15:33.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-06-13T02:15:33.861 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:33 smithi002 ceph-mon[31960]: pgmap v424: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-06-13T02:15:33.926 INFO:teuthology.orchestra.run.smithi002.stdout:55834574956 2024-06-13T02:15:33.927 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-06-13T02:15:33.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:33 smithi084 ceph-mon[36833]: pgmap v424: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-06-13T02:15:34.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:33 smithi175 ceph-mon[36977]: pgmap v424: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-06-13T02:15:35.086 INFO:teuthology.orchestra.run.smithi002.stdout:201863462992 2024-06-13T02:15:35.086 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-06-13T02:15:35.257 INFO:teuthology.orchestra.run.smithi002.stdout:223338299465 2024-06-13T02:15:35.257 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-06-13T02:15:35.739 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:35.755 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:35.755 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:35.805 INFO:teuthology.orchestra.run.smithi002.stdout:111669149792 2024-06-13T02:15:35.806 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-06-13T02:15:35.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:35 smithi002 ceph-mon[31960]: pgmap v425: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:15:35.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:35 smithi084 ceph-mon[36833]: pgmap v425: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:15:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:35 smithi175 ceph-mon[36977]: pgmap v425: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:15:37.698 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:37 smithi002 ceph-mon[31960]: pgmap v426: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:15:37.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:37 smithi084 ceph-mon[36833]: pgmap v426: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:15:38.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:37 smithi175 ceph-mon[36977]: pgmap v426: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:15:38.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.775+0000 7f3365c00700 1 -- 172.21.15.2:0/4112186611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f336006a1a0 msgr2=0x7f336006a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:38.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.775+0000 7f3365c00700 1 --2- 172.21.15.2:0/4112186611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f336006a1a0 0x7f336006a580 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3350009990 tx=0x7f3350009ca0 comp rx=0 tx=0).stop 2024-06-13T02:15:38.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.775+0000 7f3365c00700 1 -- 172.21.15.2:0/4112186611 shutdown_connections 2024-06-13T02:15:38.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.775+0000 7f3365c00700 1 --2- 172.21.15.2:0/4112186611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f336010ef40 0x7f3360111330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:38.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.775+0000 7f3365c00700 1 --2- 172.21.15.2:0/4112186611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f336006a1a0 0x7f336006a580 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:38.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.775+0000 7f3365c00700 1 --2- 172.21.15.2:0/4112186611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f336006aac0 0x7f336010ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:38.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.775+0000 7f3365c00700 1 -- 172.21.15.2:0/4112186611 >> 172.21.15.2:0/4112186611 conn(0x7f3360078340 msgr2=0x7f3360078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:38.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.776+0000 7f3365c00700 1 -- 172.21.15.2:0/4112186611 shutdown_connections 2024-06-13T02:15:38.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.776+0000 7f3365c00700 1 -- 172.21.15.2:0/4112186611 wait complete. 2024-06-13T02:15:38.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.777+0000 7f3365c00700 1 Processor -- start 2024-06-13T02:15:38.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.777+0000 7f3365c00700 1 -- start start 2024-06-13T02:15:38.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.778+0000 7f3365c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f336006a1a0 0x7f336019af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:38.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.778+0000 7f3365c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f336006aac0 0x7f336019b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:38.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.778+0000 7f3365c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f336010ef40 0x7f336019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:38.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.778+0000 7f3365c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f33601149f0 con 0x7f336006aac0 2024-06-13T02:15:38.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.778+0000 7f3365c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3360114870 con 0x7f336010ef40 2024-06-13T02:15:38.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.778+0000 7f3365c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3360114b70 con 0x7f336006a1a0 2024-06-13T02:15:38.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.778+0000 7f335f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f336010ef40 0x7f336019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:38.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.778+0000 7f335ea00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f336006a1a0 0x7f336019af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:38.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.778+0000 7f335f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f336010ef40 0x7f336019f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:38610/0 (socket says 172.21.15.2:38610) 2024-06-13T02:15:38.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.778+0000 7f335ea00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f336006a1a0 0x7f336019af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:34786/0 (socket says 172.21.15.2:34786) 2024-06-13T02:15:38.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.778+0000 7f335f400700 1 -- 172.21.15.2:0/184499319 learned_addr learned my addr 172.21.15.2:0/184499319 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:38.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.778+0000 7f3357e00700 1 --2- 172.21.15.2:0/184499319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f336006aac0 0x7f336019b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:38.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.779+0000 7f335ea00700 1 -- 172.21.15.2:0/184499319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f336010ef40 msgr2=0x7f336019f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:38.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.779+0000 7f335ea00700 1 --2- 172.21.15.2:0/184499319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f336010ef40 0x7f336019f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:38.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.779+0000 7f335ea00700 1 -- 172.21.15.2:0/184499319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f336006aac0 msgr2=0x7f336019b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:38.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.779+0000 7f335ea00700 1 --2- 172.21.15.2:0/184499319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f336006aac0 0x7f336019b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:38.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.779+0000 7f335ea00700 1 -- 172.21.15.2:0/184499319 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336019ff50 con 0x7f336006a1a0 2024-06-13T02:15:38.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.779+0000 7f335ea00700 1 --2- 172.21.15.2:0/184499319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f336006a1a0 0x7f336019af40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f33500098e0 tx=0x7f33500038b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:38.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.779+0000 7f3357400700 1 -- 172.21.15.2:0/184499319 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3350027070 con 0x7f336006a1a0 2024-06-13T02:15:38.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.780+0000 7f3365c00700 1 -- 172.21.15.2:0/184499319 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33601a01e0 con 0x7f336006a1a0 2024-06-13T02:15:38.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.780+0000 7f3357400700 1 -- 172.21.15.2:0/184499319 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3350003e40 con 0x7f336006a1a0 2024-06-13T02:15:38.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.780+0000 7f3357400700 1 -- 172.21.15.2:0/184499319 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3350022c30 con 0x7f336006a1a0 2024-06-13T02:15:38.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.780+0000 7f3365c00700 1 -- 172.21.15.2:0/184499319 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33601a7ac0 con 0x7f336006a1a0 2024-06-13T02:15:38.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.781+0000 7f3365c00700 1 -- 172.21.15.2:0/184499319 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3360069180 con 0x7f336006a1a0 2024-06-13T02:15:38.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.783+0000 7f3357400700 1 -- 172.21.15.2:0/184499319 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f335002a070 con 0x7f336006a1a0 2024-06-13T02:15:38.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.785+0000 7f3357400700 1 --2- 172.21.15.2:0/184499319 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f33440a2d30 0x7f33440a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:38.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.785+0000 7f3357400700 1 -- 172.21.15.2:0/184499319 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f33500d0390 con 0x7f336006a1a0 2024-06-13T02:15:38.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.785+0000 7f3357e00700 1 --2- 172.21.15.2:0/184499319 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f33440a2d30 0x7f33440a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:38.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.786+0000 7f3357e00700 1 --2- 172.21.15.2:0/184499319 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f33440a2d30 0x7f33440a51f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3360102950 tx=0x7f334800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:38.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:38.789+0000 7f3357400700 1 -- 172.21.15.2:0/184499319 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f335005e850 con 0x7f336006a1a0 2024-06-13T02:15:39.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:39.028+0000 7f3365c00700 1 -- 172.21.15.2:0/184499319 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f336002dca0 con 0x7f336006a1a0 2024-06-13T02:15:39.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:39.029+0000 7f3357400700 1 -- 172.21.15.2:0/184499319 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3350013070 con 0x7f336006a1a0 2024-06-13T02:15:39.030 INFO:teuthology.orchestra.run.smithi002.stdout:77309411431 2024-06-13T02:15:39.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:39.032+0000 7f3365c00700 1 -- 172.21.15.2:0/184499319 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f33440a2d30 msgr2=0x7f33440a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:39.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:39.032+0000 7f3365c00700 1 --2- 172.21.15.2:0/184499319 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f33440a2d30 0x7f33440a51f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3360102950 tx=0x7f334800b410 comp rx=0 tx=0).stop 2024-06-13T02:15:39.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:39.032+0000 7f3365c00700 1 -- 172.21.15.2:0/184499319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f336006a1a0 msgr2=0x7f336019af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:39.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:39.032+0000 7f3365c00700 1 --2- 172.21.15.2:0/184499319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f336006a1a0 0x7f336019af40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f33500098e0 tx=0x7f33500038b0 comp rx=0 tx=0).stop 2024-06-13T02:15:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:39.033+0000 7f3365c00700 1 -- 172.21.15.2:0/184499319 shutdown_connections 2024-06-13T02:15:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:39.033+0000 7f3365c00700 1 --2- 172.21.15.2:0/184499319 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f33440a2d30 0x7f33440a51f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:39.033+0000 7f3365c00700 1 --2- 172.21.15.2:0/184499319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f336010ef40 0x7f336019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:39.033+0000 7f3365c00700 1 --2- 172.21.15.2:0/184499319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f336006a1a0 0x7f336019af40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:39.033+0000 7f3365c00700 1 --2- 172.21.15.2:0/184499319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f336006aac0 0x7f336019b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:39.033+0000 7f3365c00700 1 -- 172.21.15.2:0/184499319 >> 172.21.15.2:0/184499319 conn(0x7f3360078340 msgr2=0x7f3360110490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:39.033+0000 7f3365c00700 1 -- 172.21.15.2:0/184499319 shutdown_connections 2024-06-13T02:15:39.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:39.033+0000 7f3365c00700 1 -- 172.21.15.2:0/184499319 wait complete. 2024-06-13T02:15:39.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:39 smithi002 ceph-mon[31960]: pgmap v427: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-13T02:15:39.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:39 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/184499319' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-13T02:15:39.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:39 smithi084 ceph-mon[36833]: pgmap v427: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-13T02:15:39.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:39 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/184499319' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-13T02:15:40.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:39 smithi175 ceph-mon[36977]: pgmap v427: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-13T02:15:40.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:39 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/184499319' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-13T02:15:40.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.635+0000 7f3fab600700 1 -- 172.21.15.2:0/4121793674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fa410ee90 msgr2=0x7f3fa4111280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:40.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.635+0000 7f3fab600700 1 --2- 172.21.15.2:0/4121793674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fa410ee90 0x7f3fa4111280 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00b0a0 tx=0x7f3f9c00b3b0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.635+0000 7f3fab600700 1 -- 172.21.15.2:0/4121793674 shutdown_connections 2024-06-13T02:15:40.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.635+0000 7f3fab600700 1 --2- 172.21.15.2:0/4121793674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fa410ee90 0x7f3fa4111280 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.635+0000 7f3fab600700 1 --2- 172.21.15.2:0/4121793674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fa40746c0 0x7f3fa4074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.635+0000 7f3fab600700 1 --2- 172.21.15.2:0/4121793674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fa4074fe0 0x7f3fa410e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.635+0000 7f3fab600700 1 -- 172.21.15.2:0/4121793674 >> 172.21.15.2:0/4121793674 conn(0x7f3fa40795f0 msgr2=0x7f3fa4079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:40.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.635+0000 7f3fab600700 1 -- 172.21.15.2:0/4121793674 shutdown_connections 2024-06-13T02:15:40.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.635+0000 7f3fab600700 1 -- 172.21.15.2:0/4121793674 wait complete. 2024-06-13T02:15:40.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.636+0000 7f3fab600700 1 Processor -- start 2024-06-13T02:15:40.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.637+0000 7f3fab600700 1 -- start start 2024-06-13T02:15:40.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.637+0000 7f3fab600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fa40746c0 0x7f3fa419ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:40.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.637+0000 7f3fab600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fa4074fe0 0x7f3fa419b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:40.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.637+0000 7f3fab600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fa410ee90 0x7f3fa419f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.637+0000 7f3fab600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa41149d0 con 0x7f3fa4074fe0 2024-06-13T02:15:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.637+0000 7f3fab600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa4114850 con 0x7f3fa40746c0 2024-06-13T02:15:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.637+0000 7f3fab600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa4114b50 con 0x7f3fa410ee90 2024-06-13T02:15:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.637+0000 7f3fa8c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fa40746c0 0x7f3fa419ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.637+0000 7f3fa8c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fa40746c0 0x7f3fa419ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:38644/0 (socket says 172.21.15.2:38644) 2024-06-13T02:15:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.637+0000 7f3fa8c00700 1 -- 172.21.15.2:0/3238762972 learned_addr learned my addr 172.21.15.2:0/3238762972 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.637+0000 7f3fa3e00700 1 --2- 172.21.15.2:0/3238762972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fa4074fe0 0x7f3fa419b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.638+0000 7f3fa9600700 1 --2- 172.21.15.2:0/3238762972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fa410ee90 0x7f3fa419f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.638+0000 7f3fa8c00700 1 -- 172.21.15.2:0/3238762972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fa410ee90 msgr2=0x7f3fa419f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.638+0000 7f3fa8c00700 1 --2- 172.21.15.2:0/3238762972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fa410ee90 0x7f3fa419f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.638+0000 7f3fa8c00700 1 -- 172.21.15.2:0/3238762972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fa4074fe0 msgr2=0x7f3fa419b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.638+0000 7f3fa8c00700 1 --2- 172.21.15.2:0/3238762972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fa4074fe0 0x7f3fa419b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.638+0000 7f3fa8c00700 1 -- 172.21.15.2:0/3238762972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa419fe10 con 0x7f3fa40746c0 2024-06-13T02:15:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.638+0000 7f3fa8c00700 1 --2- 172.21.15.2:0/3238762972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fa40746c0 0x7f3fa419ae00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800d950 tx=0x7f3f9800dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.639+0000 7f3fa1600700 1 -- 172.21.15.2:0/3238762972 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98016070 con 0x7f3fa40746c0 2024-06-13T02:15:40.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.639+0000 7f3fa1600700 1 -- 172.21.15.2:0/3238762972 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f98009e20 con 0x7f3fa40746c0 2024-06-13T02:15:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.639+0000 7f3fa1600700 1 -- 172.21.15.2:0/3238762972 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9800f620 con 0x7f3fa40746c0 2024-06-13T02:15:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.639+0000 7f3fab600700 1 -- 172.21.15.2:0/3238762972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa41a0100 con 0x7f3fa40746c0 2024-06-13T02:15:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.639+0000 7f3fab600700 1 -- 172.21.15.2:0/3238762972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa41a7980 con 0x7f3fa40746c0 2024-06-13T02:15:40.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.640+0000 7f3fab600700 1 -- 172.21.15.2:0/3238762972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa4069180 con 0x7f3fa40746c0 2024-06-13T02:15:40.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.642+0000 7f3fa1600700 1 -- 172.21.15.2:0/3238762972 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f3f98019070 con 0x7f3fa40746c0 2024-06-13T02:15:40.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.643+0000 7f3fa1600700 1 --2- 172.21.15.2:0/3238762972 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3f8c0a2d30 0x7f3f8c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:40.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.643+0000 7f3fa1600700 1 -- 172.21.15.2:0/3238762972 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f3f980cf150 con 0x7f3fa40746c0 2024-06-13T02:15:40.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.644+0000 7f3fa3e00700 1 --2- 172.21.15.2:0/3238762972 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3f8c0a2d30 0x7f3f8c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:40.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.645+0000 7f3fa3e00700 1 --2- 172.21.15.2:0/3238762972 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3f8c0a2d30 0x7f3f8c0a51f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3fa41109e0 tx=0x7f3f90009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:40.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.648+0000 7f3fa1600700 1 -- 172.21.15.2:0/3238762972 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3f9809bb00 con 0x7f3fa40746c0 2024-06-13T02:15:40.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.512+0000 7f916d000700 1 -- 172.21.15.2:0/53361296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f916810ed20 msgr2=0x7f9168111110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:40.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.512+0000 7f916d000700 1 --2- 172.21.15.2:0/53361296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f916810ed20 0x7f9168111110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f916000b0a0 tx=0x7f916000b3b0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.512+0000 7f916d000700 1 -- 172.21.15.2:0/53361296 shutdown_connections 2024-06-13T02:15:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.512+0000 7f916d000700 1 --2- 172.21.15.2:0/53361296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f916810ed20 0x7f9168111110 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.512+0000 7f916d000700 1 --2- 172.21.15.2:0/53361296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9168101170 0x7f9168101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.512+0000 7f916d000700 1 --2- 172.21.15.2:0/53361296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9168101b20 0x7f916810e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.512+0000 7f916d000700 1 -- 172.21.15.2:0/53361296 >> 172.21.15.2:0/53361296 conn(0x7f91680fcdb0 msgr2=0x7f91680ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.513+0000 7f916d000700 1 -- 172.21.15.2:0/53361296 shutdown_connections 2024-06-13T02:15:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.513+0000 7f916d000700 1 -- 172.21.15.2:0/53361296 wait complete. 2024-06-13T02:15:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.514+0000 7f916d000700 1 Processor -- start 2024-06-13T02:15:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.514+0000 7f916d000700 1 -- start start 2024-06-13T02:15:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.515+0000 7f916d000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9168101170 0x7f91681a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.515+0000 7f916d000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9168101b20 0x7f91681a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.515+0000 7f916d000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f916810ed20 0x7f916819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.515+0000 7f916d000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f91681148f0 con 0x7f916810ed20 2024-06-13T02:15:40.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.515+0000 7f916d000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9168114770 con 0x7f9168101b20 2024-06-13T02:15:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.515+0000 7f916d000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9168114a70 con 0x7f9168101170 2024-06-13T02:15:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.515+0000 7f9167400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9168101170 0x7f91681a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.515+0000 7f9167400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9168101170 0x7f91681a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:34800/0 (socket says 172.21.15.2:34800) 2024-06-13T02:15:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.515+0000 7f9167400700 1 -- 172.21.15.2:0/3748677294 learned_addr learned my addr 172.21.15.2:0/3748677294 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.515+0000 7f9167e00700 1 --2- 172.21.15.2:0/3748677294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f916810ed20 0x7f916819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.515+0000 7f9166a00700 1 --2- 172.21.15.2:0/3748677294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9168101b20 0x7f91681a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.516+0000 7f9167400700 1 -- 172.21.15.2:0/3748677294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9168101b20 msgr2=0x7f91681a0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.516+0000 7f9167400700 1 --2- 172.21.15.2:0/3748677294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9168101b20 0x7f91681a0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.516+0000 7f9167400700 1 -- 172.21.15.2:0/3748677294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f916810ed20 msgr2=0x7f916819ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.516+0000 7f9167400700 1 --2- 172.21.15.2:0/3748677294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f916810ed20 0x7f916819ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.516+0000 7f9167400700 1 -- 172.21.15.2:0/3748677294 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916819b3f0 con 0x7f9168101170 2024-06-13T02:15:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.516+0000 7f9167400700 1 --2- 172.21.15.2:0/3748677294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9168101170 0x7f91681a0a40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f915800eb30 tx=0x7f915800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.516+0000 7f915fe00700 1 -- 172.21.15.2:0/3748677294 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915800cbd0 con 0x7f9168101170 2024-06-13T02:15:40.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.516+0000 7f915fe00700 1 -- 172.21.15.2:0/3748677294 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9158004500 con 0x7f9168101170 2024-06-13T02:15:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.516+0000 7f915fe00700 1 -- 172.21.15.2:0/3748677294 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158010430 con 0x7f9168101170 2024-06-13T02:15:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.516+0000 7f916d000700 1 -- 172.21.15.2:0/3748677294 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f916819b6e0 con 0x7f9168101170 2024-06-13T02:15:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.517+0000 7f916d000700 1 -- 172.21.15.2:0/3748677294 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91681a79c0 con 0x7f9168101170 2024-06-13T02:15:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.517+0000 7f916d000700 1 -- 172.21.15.2:0/3748677294 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f91681101c0 con 0x7f9168101170 2024-06-13T02:15:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.520+0000 7f915fe00700 1 -- 172.21.15.2:0/3748677294 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f9158003f00 con 0x7f9168101170 2024-06-13T02:15:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.521+0000 7f915fe00700 1 --2- 172.21.15.2:0/3748677294 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f914c0a2d30 0x7f914c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.522+0000 7f915fe00700 1 -- 172.21.15.2:0/3748677294 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f91580cfba0 con 0x7f9168101170 2024-06-13T02:15:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.522+0000 7f9166a00700 1 --2- 172.21.15.2:0/3748677294 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f914c0a2d30 0x7f914c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.522+0000 7f915fe00700 1 --2- 172.21.15.2:0/3748677294 >> [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885] conn(0x7f914c0ae110 0x7f914c0b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.522+0000 7f915fe00700 1 -- 172.21.15.2:0/3748677294 --> [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f915801aec0 con 0x7f914c0ae110 2024-06-13T02:15:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.522+0000 7f915fe00700 1 -- 172.21.15.2:0/3748677294 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f91580cff50 con 0x7f9168101170 2024-06-13T02:15:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.522+0000 7f9167e00700 1 --2- 172.21.15.2:0/3748677294 >> [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885] conn(0x7f914c0ae110 0x7f914c0b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:40.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.523+0000 7f9166a00700 1 --2- 172.21.15.2:0/3748677294 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f914c0a2d30 0x7f914c0a51f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f916819c260 tx=0x7f9154009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.523+0000 7f9167e00700 1 --2- 172.21.15.2:0/3748677294 >> [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885] conn(0x7f914c0ae110 0x7f914c0b05b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.524+0000 7f915fe00700 1 -- 172.21.15.2:0/3748677294 <== osd.5 v2:172.21.15.175:6808/764262885 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f915801aec0 con 0x7f914c0ae110 2024-06-13T02:15:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.543+0000 7f916d000700 1 -- 172.21.15.2:0/3748677294 --> [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f916806a9f0 con 0x7f914c0ae110 2024-06-13T02:15:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.543+0000 7f915fe00700 1 -- 172.21.15.2:0/3748677294 <== osd.5 v2:172.21.15.175:6808/764262885 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f916806a9f0 con 0x7f914c0ae110 2024-06-13T02:15:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.544+0000 7f916d000700 1 -- 172.21.15.2:0/3748677294 >> [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885] conn(0x7f914c0ae110 msgr2=0x7f914c0b05b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.544+0000 7f916d000700 1 --2- 172.21.15.2:0/3748677294 >> [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885] conn(0x7f914c0ae110 0x7f914c0b05b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.544+0000 7f916d000700 1 -- 172.21.15.2:0/3748677294 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f914c0a2d30 msgr2=0x7f914c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.544+0000 7f916d000700 1 --2- 172.21.15.2:0/3748677294 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f914c0a2d30 0x7f914c0a51f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f916819c260 tx=0x7f9154009260 comp rx=0 tx=0).stop 2024-06-13T02:15:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.544+0000 7f916d000700 1 -- 172.21.15.2:0/3748677294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9168101170 msgr2=0x7f91681a0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.544+0000 7f916d000700 1 --2- 172.21.15.2:0/3748677294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9168101170 0x7f91681a0a40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f915800eb30 tx=0x7f915800ee40 comp rx=0 tx=0).stop 2024-06-13T02:15:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.544+0000 7f9167e00700 1 -- 172.21.15.2:0/3748677294 reap_dead start 2024-06-13T02:15:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.544+0000 7f916d000700 1 -- 172.21.15.2:0/3748677294 shutdown_connections 2024-06-13T02:15:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.544+0000 7f916d000700 1 -- 172.21.15.2:0/3748677294 >> 172.21.15.2:0/3748677294 conn(0x7f91680fcdb0 msgr2=0x7f9168102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.545+0000 7f916d000700 1 -- 172.21.15.2:0/3748677294 shutdown_connections 2024-06-13T02:15:40.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.545+0000 7f916d000700 1 -- 172.21.15.2:0/3748677294 wait complete. 2024-06-13T02:15:40.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.885+0000 7f3fab600700 1 -- 172.21.15.2:0/3238762972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3fa41a7c50 con 0x7f3fa40746c0 2024-06-13T02:15:40.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.886+0000 7f3fa1600700 1 -- 172.21.15.2:0/3238762972 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3f9809b400 con 0x7f3fa40746c0 2024-06-13T02:15:40.886 INFO:teuthology.orchestra.run.smithi002.stdout:146028888157 2024-06-13T02:15:40.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.889+0000 7f3fab600700 1 -- 172.21.15.2:0/3238762972 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3f8c0a2d30 msgr2=0x7f3f8c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:40.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.889+0000 7f3fab600700 1 --2- 172.21.15.2:0/3238762972 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3f8c0a2d30 0x7f3f8c0a51f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3fa41109e0 tx=0x7f3f90009260 comp rx=0 tx=0).stop 2024-06-13T02:15:40.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.889+0000 7f3fab600700 1 -- 172.21.15.2:0/3238762972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fa40746c0 msgr2=0x7f3fa419ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:40.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.889+0000 7f3fab600700 1 --2- 172.21.15.2:0/3238762972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fa40746c0 0x7f3fa419ae00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800d950 tx=0x7f3f9800dc60 comp rx=0 tx=0).stop 2024-06-13T02:15:40.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.889+0000 7f3fab600700 1 -- 172.21.15.2:0/3238762972 shutdown_connections 2024-06-13T02:15:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.889+0000 7f3fab600700 1 --2- 172.21.15.2:0/3238762972 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3f8c0a2d30 0x7f3f8c0a51f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.889+0000 7f3fab600700 1 --2- 172.21.15.2:0/3238762972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fa410ee90 0x7f3fa419f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.889+0000 7f3fab600700 1 --2- 172.21.15.2:0/3238762972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3fa40746c0 0x7f3fa419ae00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.889+0000 7f3fab600700 1 --2- 172.21.15.2:0/3238762972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3fa4074fe0 0x7f3fa419b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.889+0000 7f3fab600700 1 -- 172.21.15.2:0/3238762972 >> 172.21.15.2:0/3238762972 conn(0x7f3fa40795f0 msgr2=0x7f3fa40ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.889+0000 7f3fab600700 1 -- 172.21.15.2:0/3238762972 shutdown_connections 2024-06-13T02:15:40.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:40.890+0000 7f3fab600700 1 -- 172.21.15.2:0/3238762972 wait complete. 2024-06-13T02:15:41.640 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411427 got 77309411431 for osd.2 2024-06-13T02:15:41.640 DEBUG:teuthology.parallel:result is None 2024-06-13T02:15:41.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:41 smithi002 ceph-mon[31960]: pgmap v428: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-06-13T02:15:41.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:41 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3238762972' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-13T02:15:41.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:41 smithi084 ceph-mon[36833]: pgmap v428: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-06-13T02:15:41.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:41 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3238762972' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-13T02:15:42.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:41 smithi175 ceph-mon[36977]: pgmap v428: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-06-13T02:15:42.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:41 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3238762972' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-13T02:15:42.188 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888152 got 146028888157 for osd.4 2024-06-13T02:15:42.188 DEBUG:teuthology.parallel:result is None 2024-06-13T02:15:42.297 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:42.303 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:42.867 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:15:42.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:15:42.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:15:42.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:15:42.868 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:42 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:15:42.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:15:42.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:15:42.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:15:42.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:15:42.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:42 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:15:43.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:15:43.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:15:43.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:15:43.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:15:43.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:42 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:15:43.233 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:43.519 INFO:teuthology.orchestra.run.smithi002.stdout:167503724631 2024-06-13T02:15:43.519 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-06-13T02:15:43.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:43 smithi002 ceph-mon[31960]: pgmap v429: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-06-13T02:15:43.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:43 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:15:43.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:43 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:15:43.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:43 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:15:43.934 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:43 smithi175 ceph-mon[36977]: pgmap v429: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-06-13T02:15:43.934 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:43 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:15:43.934 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:43 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:15:43.934 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:43 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:15:43.968 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:43.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:43 smithi084 ceph-mon[36833]: pgmap v429: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-06-13T02:15:43.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:43 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:15:43.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:43 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:15:43.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:43 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:15:45.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.025+0000 7f6c3ca00700 1 -- 172.21.15.2:0/1618968034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c38105060 msgr2=0x7f6c38111570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:45.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.025+0000 7f6c3ca00700 1 --2- 172.21.15.2:0/1618968034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c38105060 0x7f6c38111570 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000b0a0 tx=0x7f6c3000b3b0 comp rx=0 tx=0).stop 2024-06-13T02:15:45.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.025+0000 7f6c3ca00700 1 -- 172.21.15.2:0/1618968034 shutdown_connections 2024-06-13T02:15:45.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.025+0000 7f6c3ca00700 1 --2- 172.21.15.2:0/1618968034 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c38105060 0x7f6c38111570 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:45.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.025+0000 7f6c3ca00700 1 --2- 172.21.15.2:0/1618968034 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c3810a6a0 0x7f6c3810aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:45.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.025+0000 7f6c3ca00700 1 --2- 172.21.15.2:0/1618968034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c381046a0 0x7f6c38104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:45.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.025+0000 7f6c3ca00700 1 -- 172.21.15.2:0/1618968034 >> 172.21.15.2:0/1618968034 conn(0x7f6c38100170 msgr2=0x7f6c38102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:45.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.025+0000 7f6c3ca00700 1 -- 172.21.15.2:0/1618968034 shutdown_connections 2024-06-13T02:15:45.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.025+0000 7f6c3ca00700 1 -- 172.21.15.2:0/1618968034 wait complete. 2024-06-13T02:15:45.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.026+0000 7f6c3ca00700 1 Processor -- start 2024-06-13T02:15:45.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.027+0000 7f6c3ca00700 1 -- start start 2024-06-13T02:15:45.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.027+0000 7f6c3ca00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c381046a0 0x7f6c3819ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:45.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.027+0000 7f6c3ca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c38105060 0x7f6c3819b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:45.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.027+0000 7f6c3ca00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c3810a6a0 0x7f6c3819f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:45.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.027+0000 7f6c3ca00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38114a40 con 0x7f6c381046a0 2024-06-13T02:15:45.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.027+0000 7f6c3ca00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381148c0 con 0x7f6c38105060 2024-06-13T02:15:45.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.027+0000 7f6c3ca00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38114bc0 con 0x7f6c3810a6a0 2024-06-13T02:15:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.028+0000 7f6c35e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c381046a0 0x7f6c3819ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.028+0000 7f6c35e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c381046a0 0x7f6c3819ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36900/0 (socket says 172.21.15.2:36900) 2024-06-13T02:15:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.028+0000 7f6c35e00700 1 -- 172.21.15.2:0/353103219 learned_addr learned my addr 172.21.15.2:0/353103219 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.028+0000 7f6c2d400700 1 --2- 172.21.15.2:0/353103219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c38105060 0x7f6c3819b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:45.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.028+0000 7f6c35e00700 1 -- 172.21.15.2:0/353103219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c3810a6a0 msgr2=0x7f6c3819f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:45.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.028+0000 7f6c35e00700 1 --2- 172.21.15.2:0/353103219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c3810a6a0 0x7f6c3819f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:45.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.028+0000 7f6c35e00700 1 -- 172.21.15.2:0/353103219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c38105060 msgr2=0x7f6c3819b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:45.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.028+0000 7f6c35e00700 1 --2- 172.21.15.2:0/353103219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c38105060 0x7f6c3819b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:45.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.028+0000 7f6c35e00700 1 -- 172.21.15.2:0/353103219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3819fe80 con 0x7f6c381046a0 2024-06-13T02:15:45.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.028+0000 7f6c35e00700 1 --2- 172.21.15.2:0/353103219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c381046a0 0x7f6c3819ae70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800e9a0 tx=0x7f6c2800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:45.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.029+0000 7f6c2f400700 1 -- 172.21.15.2:0/353103219 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2800cbd0 con 0x7f6c381046a0 2024-06-13T02:15:45.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.029+0000 7f6c3ca00700 1 -- 172.21.15.2:0/353103219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c381a0170 con 0x7f6c381046a0 2024-06-13T02:15:45.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.029+0000 7f6c2f400700 1 -- 172.21.15.2:0/353103219 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c2800cd70 con 0x7f6c381046a0 2024-06-13T02:15:45.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.029+0000 7f6c2f400700 1 -- 172.21.15.2:0/353103219 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28018750 con 0x7f6c381046a0 2024-06-13T02:15:45.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.029+0000 7f6c3ca00700 1 -- 172.21.15.2:0/353103219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c381a79f0 con 0x7f6c381046a0 2024-06-13T02:15:45.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.030+0000 7f6c3ca00700 1 -- 172.21.15.2:0/353103219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c38069180 con 0x7f6c381046a0 2024-06-13T02:15:45.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.032+0000 7f6c2f400700 1 -- 172.21.15.2:0/353103219 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f6c28010430 con 0x7f6c381046a0 2024-06-13T02:15:45.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.034+0000 7f6c2f400700 1 --2- 172.21.15.2:0/353103219 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6c1c0a2d30 0x7f6c1c0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:45.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.034+0000 7f6c2f400700 1 -- 172.21.15.2:0/353103219 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f6c280cf7e0 con 0x7f6c381046a0 2024-06-13T02:15:45.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.034+0000 7f6c2d400700 1 --2- 172.21.15.2:0/353103219 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6c1c0a2d30 0x7f6c1c0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:45.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.035+0000 7f6c2d400700 1 --2- 172.21.15.2:0/353103219 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6c1c0a2d30 0x7f6c1c0a51f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6c38109cf0 tx=0x7f6c20009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:45.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.039+0000 7f6c2f400700 1 -- 172.21.15.2:0/353103219 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6c2809c190 con 0x7f6c381046a0 2024-06-13T02:15:45.117 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:45.117 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:45.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.296+0000 7f6c3ca00700 1 -- 172.21.15.2:0/353103219 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f6c3802dca0 con 0x7f6c381046a0 2024-06-13T02:15:45.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.297+0000 7f6c2f400700 1 -- 172.21.15.2:0/353103219 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6c2809ba90 con 0x7f6c381046a0 2024-06-13T02:15:45.298 INFO:teuthology.orchestra.run.smithi002.stdout:257698037831 2024-06-13T02:15:45.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.301+0000 7f6c3ca00700 1 -- 172.21.15.2:0/353103219 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6c1c0a2d30 msgr2=0x7f6c1c0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:45.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.301+0000 7f6c3ca00700 1 --2- 172.21.15.2:0/353103219 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6c1c0a2d30 0x7f6c1c0a51f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6c38109cf0 tx=0x7f6c20009260 comp rx=0 tx=0).stop 2024-06-13T02:15:45.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.301+0000 7f6c3ca00700 1 -- 172.21.15.2:0/353103219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c381046a0 msgr2=0x7f6c3819ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:45.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.301+0000 7f6c3ca00700 1 --2- 172.21.15.2:0/353103219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c381046a0 0x7f6c3819ae70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800e9a0 tx=0x7f6c2800ecb0 comp rx=0 tx=0).stop 2024-06-13T02:15:45.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.301+0000 7f6c3ca00700 1 -- 172.21.15.2:0/353103219 shutdown_connections 2024-06-13T02:15:45.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.301+0000 7f6c3ca00700 1 --2- 172.21.15.2:0/353103219 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6c1c0a2d30 0x7f6c1c0a51f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:45.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.301+0000 7f6c3ca00700 1 --2- 172.21.15.2:0/353103219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c3810a6a0 0x7f6c3819f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:45.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.301+0000 7f6c3ca00700 1 --2- 172.21.15.2:0/353103219 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c381046a0 0x7f6c3819ae70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:45.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.301+0000 7f6c3ca00700 1 --2- 172.21.15.2:0/353103219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6c38105060 0x7f6c3819b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:45.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.301+0000 7f6c3ca00700 1 -- 172.21.15.2:0/353103219 >> 172.21.15.2:0/353103219 conn(0x7f6c38100170 msgr2=0x7f6c381006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:45.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.301+0000 7f6c3ca00700 1 -- 172.21.15.2:0/353103219 shutdown_connections 2024-06-13T02:15:45.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:45.301+0000 7f6c3ca00700 1 -- 172.21.15.2:0/353103219 wait complete. 2024-06-13T02:15:45.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:45 smithi002 ceph-mon[31960]: pgmap v430: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-06-13T02:15:45.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:45 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/353103219' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-13T02:15:45.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:45 smithi084 ceph-mon[36833]: pgmap v430: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-06-13T02:15:45.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:45 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/353103219' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-13T02:15:46.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:45 smithi175 ceph-mon[36977]: pgmap v430: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-06-13T02:15:46.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:45 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/353103219' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-13T02:15:46.510 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:47.766 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:47 smithi002 ceph-mon[31960]: pgmap v431: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:15:47.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:47 smithi084 ceph-mon[36833]: pgmap v431: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:15:48.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:47 smithi175 ceph-mon[36977]: pgmap v431: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:15:48.129 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037827 got 257698037831 for osd.8 2024-06-13T02:15:48.129 DEBUG:teuthology.parallel:result is None 2024-06-13T02:15:48.805 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:49.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:49 smithi002 ceph-mon[31960]: pgmap v432: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:15:49.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:49 smithi084 ceph-mon[36833]: pgmap v432: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:15:50.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:49 smithi175 ceph-mon[36977]: pgmap v432: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:15:51.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:51 smithi084 ceph-mon[36833]: pgmap v433: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:15:52.028 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:51 smithi002 ceph-mon[31960]: pgmap v433: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:15:52.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:51 smithi175 ceph-mon[36977]: pgmap v433: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:15:53.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.584+0000 7f0530c00700 1 -- 172.21.15.2:0/2988820465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c0751e0 msgr2=0x7f052c10e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:53.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.584+0000 7f0530c00700 1 --2- 172.21.15.2:0/2988820465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c0751e0 0x7f052c10e6a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0518009990 tx=0x7f0518009ca0 comp rx=0 tx=0).stop 2024-06-13T02:15:53.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.584+0000 7f0530c00700 1 -- 172.21.15.2:0/2988820465 shutdown_connections 2024-06-13T02:15:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.584+0000 7f0530c00700 1 --2- 172.21.15.2:0/2988820465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f052c10ebe0 0x7f052c111050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.584+0000 7f0530c00700 1 --2- 172.21.15.2:0/2988820465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f052c0748c0 0x7f052c074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.584+0000 7f0530c00700 1 --2- 172.21.15.2:0/2988820465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c0751e0 0x7f052c10e6a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.584+0000 7f0530c00700 1 -- 172.21.15.2:0/2988820465 >> 172.21.15.2:0/2988820465 conn(0x7f052c0fde70 msgr2=0x7f052c100290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.584+0000 7f0530c00700 1 -- 172.21.15.2:0/2988820465 shutdown_connections 2024-06-13T02:15:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.584+0000 7f0530c00700 1 -- 172.21.15.2:0/2988820465 wait complete. 2024-06-13T02:15:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.585+0000 7f0530c00700 1 Processor -- start 2024-06-13T02:15:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.585+0000 7f0530c00700 1 -- start start 2024-06-13T02:15:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.586+0000 7f0530c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c0748c0 0x7f052c19ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.586+0000 7f0530c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f052c0751e0 0x7f052c19b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.586+0000 7f0530c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f052c10ebe0 0x7f052c19f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.586+0000 7f0530c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f052c1148f0 con 0x7f052c0751e0 2024-06-13T02:15:53.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.586+0000 7f0530c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f052c114770 con 0x7f052c0748c0 2024-06-13T02:15:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.586+0000 7f0530c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f052c114a70 con 0x7f052c10ebe0 2024-06-13T02:15:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.586+0000 7f052b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c0748c0 0x7f052c19ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.586+0000 7f052aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f052c0751e0 0x7f052c19b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.586+0000 7f052b400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c0748c0 0x7f052c19ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:34318/0 (socket says 172.21.15.2:34318) 2024-06-13T02:15:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.586+0000 7f052b400700 1 -- 172.21.15.2:0/4044529492 learned_addr learned my addr 172.21.15.2:0/4044529492 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.586+0000 7f052be00700 1 --2- 172.21.15.2:0/4044529492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f052c10ebe0 0x7f052c19f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.587+0000 7f052b400700 1 -- 172.21.15.2:0/4044529492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f052c10ebe0 msgr2=0x7f052c19f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.587+0000 7f052b400700 1 --2- 172.21.15.2:0/4044529492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f052c10ebe0 0x7f052c19f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.587+0000 7f052b400700 1 -- 172.21.15.2:0/4044529492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f052c0751e0 msgr2=0x7f052c19b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.587+0000 7f052b400700 1 --2- 172.21.15.2:0/4044529492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f052c0751e0 0x7f052c19b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.587+0000 7f052b400700 1 -- 172.21.15.2:0/4044529492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052c19fd60 con 0x7f052c0748c0 2024-06-13T02:15:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.587+0000 7f052b400700 1 --2- 172.21.15.2:0/4044529492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c0748c0 0x7f052c19ada0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f051c00eb30 tx=0x7f051c00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.587+0000 7f0523e00700 1 -- 172.21.15.2:0/4044529492 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c00cbd0 con 0x7f052c0748c0 2024-06-13T02:15:53.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.587+0000 7f0523e00700 1 -- 172.21.15.2:0/4044529492 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f051c004500 con 0x7f052c0748c0 2024-06-13T02:15:53.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.587+0000 7f0523e00700 1 -- 172.21.15.2:0/4044529492 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051c010430 con 0x7f052c0748c0 2024-06-13T02:15:53.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.587+0000 7f0530c00700 1 -- 172.21.15.2:0/4044529492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f052c1a0050 con 0x7f052c0748c0 2024-06-13T02:15:53.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.587+0000 7f0530c00700 1 -- 172.21.15.2:0/4044529492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f052c1a78d0 con 0x7f052c0748c0 2024-06-13T02:15:53.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.589+0000 7f0530c00700 1 -- 172.21.15.2:0/4044529492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f052c069180 con 0x7f052c0748c0 2024-06-13T02:15:53.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.591+0000 7f0523e00700 1 -- 172.21.15.2:0/4044529492 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f051c043b10 con 0x7f052c0748c0 2024-06-13T02:15:53.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.592+0000 7f0523e00700 1 --2- 172.21.15.2:0/4044529492 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f05100a2d30 0x7f05100a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:53.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.592+0000 7f0523e00700 1 -- 172.21.15.2:0/4044529492 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f051c0cf8e0 con 0x7f052c0748c0 2024-06-13T02:15:53.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.593+0000 7f052aa00700 1 --2- 172.21.15.2:0/4044529492 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f05100a2d30 0x7f05100a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:53.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.593+0000 7f052aa00700 1 --2- 172.21.15.2:0/4044529492 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f05100a2d30 0x7f05100a51f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f051800b2e0 tx=0x7f0518005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:53.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.595+0000 7f0523e00700 1 -- 172.21.15.2:0/4044529492 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f051c09c290 con 0x7f052c0748c0 2024-06-13T02:15:53.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.826+0000 7f0530c00700 1 -- 172.21.15.2:0/4044529492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f052c19c0b0 con 0x7f052c0748c0 2024-06-13T02:15:53.828 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:53 smithi002 ceph-mon[31960]: pgmap v434: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:15:53.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.827+0000 7f0523e00700 1 -- 172.21.15.2:0/4044529492 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f051c09bb90 con 0x7f052c0748c0 2024-06-13T02:15:53.829 INFO:teuthology.orchestra.run.smithi002.stdout:292057776194 2024-06-13T02:15:53.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.831+0000 7f0530c00700 1 -- 172.21.15.2:0/4044529492 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f05100a2d30 msgr2=0x7f05100a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:53.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.831+0000 7f0530c00700 1 --2- 172.21.15.2:0/4044529492 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f05100a2d30 0x7f05100a51f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f051800b2e0 tx=0x7f0518005960 comp rx=0 tx=0).stop 2024-06-13T02:15:53.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.831+0000 7f0530c00700 1 -- 172.21.15.2:0/4044529492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c0748c0 msgr2=0x7f052c19ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:53.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.832+0000 7f0530c00700 1 --2- 172.21.15.2:0/4044529492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c0748c0 0x7f052c19ada0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f051c00eb30 tx=0x7f051c00ee40 comp rx=0 tx=0).stop 2024-06-13T02:15:53.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.832+0000 7f0530c00700 1 -- 172.21.15.2:0/4044529492 shutdown_connections 2024-06-13T02:15:53.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.832+0000 7f0530c00700 1 --2- 172.21.15.2:0/4044529492 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f05100a2d30 0x7f05100a51f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:53.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.832+0000 7f0530c00700 1 --2- 172.21.15.2:0/4044529492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f052c10ebe0 0x7f052c19f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:53.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.832+0000 7f0530c00700 1 --2- 172.21.15.2:0/4044529492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f052c0748c0 0x7f052c19ada0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:53.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.832+0000 7f0530c00700 1 --2- 172.21.15.2:0/4044529492 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f052c0751e0 0x7f052c19b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:53.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.832+0000 7f0530c00700 1 -- 172.21.15.2:0/4044529492 >> 172.21.15.2:0/4044529492 conn(0x7f052c0fde70 msgr2=0x7f052c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:53.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.832+0000 7f0530c00700 1 -- 172.21.15.2:0/4044529492 shutdown_connections 2024-06-13T02:15:53.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:53.832+0000 7f0530c00700 1 -- 172.21.15.2:0/4044529492 wait complete. 2024-06-13T02:15:53.969 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:53 smithi084 ceph-mon[36833]: pgmap v434: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:15:54.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:53 smithi175 ceph-mon[36977]: pgmap v434: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:15:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.481+0000 7f96dc800700 1 -- 172.21.15.2:0/3147788146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96d4074fe0 msgr2=0x7f96d410e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.482+0000 7f96dc800700 1 --2- 172.21.15.2:0/3147788146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96d4074fe0 0x7f96d410e950 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f96c40098f0 tx=0x7f96c4009c00 comp rx=0 tx=0).stop 2024-06-13T02:15:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.482+0000 7f96dc800700 1 -- 172.21.15.2:0/3147788146 shutdown_connections 2024-06-13T02:15:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.482+0000 7f96dc800700 1 --2- 172.21.15.2:0/3147788146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d410ee90 0x7f96d4111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.482+0000 7f96dc800700 1 --2- 172.21.15.2:0/3147788146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d40746c0 0x7f96d4074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.482+0000 7f96dc800700 1 --2- 172.21.15.2:0/3147788146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96d4074fe0 0x7f96d410e950 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.482+0000 7f96dc800700 1 -- 172.21.15.2:0/3147788146 >> 172.21.15.2:0/3147788146 conn(0x7f96d4079530 msgr2=0x7f96d4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.482+0000 7f96dc800700 1 -- 172.21.15.2:0/3147788146 shutdown_connections 2024-06-13T02:15:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.482+0000 7f96dc800700 1 -- 172.21.15.2:0/3147788146 wait complete. 2024-06-13T02:15:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.483+0000 7f96dc800700 1 Processor -- start 2024-06-13T02:15:54.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.483+0000 7f96dc800700 1 -- start start 2024-06-13T02:15:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.483+0000 7f96dc800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96d40746c0 0x7f96d419af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.483+0000 7f96dc800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d4074fe0 0x7f96d419b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.483+0000 7f96dc800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d410ee90 0x7f96d419f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.483+0000 7f96dc800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f96d4114980 con 0x7f96d4074fe0 2024-06-13T02:15:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.483+0000 7f96dc800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f96d4114800 con 0x7f96d40746c0 2024-06-13T02:15:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.483+0000 7f96dc800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96d4114b00 con 0x7f96d410ee90 2024-06-13T02:15:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.484+0000 7f96d9400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d4074fe0 0x7f96d419b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.484+0000 7f96d9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96d40746c0 0x7f96d419af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.484+0000 7f96da800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d410ee90 0x7f96d419f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.484+0000 7f96d9400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d4074fe0 0x7f96d419b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51650/0 (socket says 172.21.15.2:51650) 2024-06-13T02:15:54.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.484+0000 7f96d9400700 1 -- 172.21.15.2:0/1511792139 learned_addr learned my addr 172.21.15.2:0/1511792139 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.484+0000 7f96da800700 1 -- 172.21.15.2:0/1511792139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96d40746c0 msgr2=0x7f96d419af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.484+0000 7f96da800700 1 --2- 172.21.15.2:0/1511792139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96d40746c0 0x7f96d419af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.484+0000 7f96da800700 1 -- 172.21.15.2:0/1511792139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d4074fe0 msgr2=0x7f96d419b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.484+0000 7f96da800700 1 --2- 172.21.15.2:0/1511792139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d4074fe0 0x7f96d419b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.484+0000 7f96da800700 1 -- 172.21.15.2:0/1511792139 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d419fef0 con 0x7f96d410ee90 2024-06-13T02:15:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.484+0000 7f96d9e00700 1 --2- 172.21.15.2:0/1511792139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96d40746c0 0x7f96d419af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:15:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.484+0000 7f96da800700 1 --2- 172.21.15.2:0/1511792139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d410ee90 0x7f96d419f7b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f96d000ef90 tx=0x7f96d000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.485+0000 7f96cea00700 1 -- 172.21.15.2:0/1511792139 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d00092e0 con 0x7f96d410ee90 2024-06-13T02:15:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.485+0000 7f96cea00700 1 -- 172.21.15.2:0/1511792139 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96d0004bb0 con 0x7f96d410ee90 2024-06-13T02:15:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.485+0000 7f96dc800700 1 -- 172.21.15.2:0/1511792139 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d41a0180 con 0x7f96d410ee90 2024-06-13T02:15:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.485+0000 7f96cea00700 1 -- 172.21.15.2:0/1511792139 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0004080 con 0x7f96d410ee90 2024-06-13T02:15:54.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.485+0000 7f96dc800700 1 -- 172.21.15.2:0/1511792139 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d41a7a60 con 0x7f96d410ee90 2024-06-13T02:15:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.486+0000 7f96dc800700 1 -- 172.21.15.2:0/1511792139 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d4069180 con 0x7f96d410ee90 2024-06-13T02:15:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.488+0000 7f96cea00700 1 -- 172.21.15.2:0/1511792139 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f96d001b030 con 0x7f96d410ee90 2024-06-13T02:15:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.489+0000 7f96cea00700 1 --2- 172.21.15.2:0/1511792139 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f96bc0a2cb0 0x7f96bc0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.490+0000 7f96cea00700 1 -- 172.21.15.2:0/1511792139 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f96d00ceff0 con 0x7f96d410ee90 2024-06-13T02:15:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.490+0000 7f96d9e00700 1 --2- 172.21.15.2:0/1511792139 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f96bc0a2cb0 0x7f96bc0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.490+0000 7f96d9e00700 1 --2- 172.21.15.2:0/1511792139 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f96bc0a2cb0 0x7f96bc0a5170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f96c8011490 tx=0x7f96c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:54.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.494+0000 7f96cea00700 1 -- 172.21.15.2:0/1511792139 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f96d0022020 con 0x7f96d410ee90 2024-06-13T02:15:54.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.733+0000 7f96dc800700 1 -- 172.21.15.2:0/1511792139 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f96d402dca0 con 0x7f96d410ee90 2024-06-13T02:15:54.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.734+0000 7f96cea00700 1 -- 172.21.15.2:0/1511792139 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f96d0010040 con 0x7f96d410ee90 2024-06-13T02:15:54.736 INFO:teuthology.orchestra.run.smithi002.stdout:223338299470 2024-06-13T02:15:54.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.737+0000 7f96dc800700 1 -- 172.21.15.2:0/1511792139 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f96bc0a2cb0 msgr2=0x7f96bc0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:54.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.737+0000 7f96dc800700 1 --2- 172.21.15.2:0/1511792139 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f96bc0a2cb0 0x7f96bc0a5170 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f96c8011490 tx=0x7f96c8009260 comp rx=0 tx=0).stop 2024-06-13T02:15:54.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.737+0000 7f96dc800700 1 -- 172.21.15.2:0/1511792139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d410ee90 msgr2=0x7f96d419f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:54.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.737+0000 7f96dc800700 1 --2- 172.21.15.2:0/1511792139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d410ee90 0x7f96d419f7b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f96d000ef90 tx=0x7f96d000c3a0 comp rx=0 tx=0).stop 2024-06-13T02:15:54.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.737+0000 7f96dc800700 1 -- 172.21.15.2:0/1511792139 shutdown_connections 2024-06-13T02:15:54.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.737+0000 7f96dc800700 1 --2- 172.21.15.2:0/1511792139 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f96bc0a2cb0 0x7f96bc0a5170 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.737+0000 7f96dc800700 1 --2- 172.21.15.2:0/1511792139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d410ee90 0x7f96d419f7b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.737+0000 7f96dc800700 1 --2- 172.21.15.2:0/1511792139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96d40746c0 0x7f96d419af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.737+0000 7f96dc800700 1 --2- 172.21.15.2:0/1511792139 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d4074fe0 0x7f96d419b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.737+0000 7f96dc800700 1 -- 172.21.15.2:0/1511792139 >> 172.21.15.2:0/1511792139 conn(0x7f96d4079530 msgr2=0x7f96d41009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.738+0000 7f96dc800700 1 -- 172.21.15.2:0/1511792139 shutdown_connections 2024-06-13T02:15:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:54.738+0000 7f96dc800700 1 -- 172.21.15.2:0/1511792139 wait complete. 2024-06-13T02:15:54.887 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:54 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/4044529492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-13T02:15:54.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:54 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/4044529492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-13T02:15:55.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:54 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/4044529492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-13T02:15:55.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.603+0000 7f3c89e00700 1 -- 172.21.15.2:0/2478770447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c8410eac0 msgr2=0x7f3c8410eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:55.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.603+0000 7f3c89e00700 1 --2- 172.21.15.2:0/2478770447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c8410eac0 0x7f3c8410eea0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3c740098f0 tx=0x7f3c74009c00 comp rx=0 tx=0).stop 2024-06-13T02:15:55.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.603+0000 7f3c89e00700 1 -- 172.21.15.2:0/2478770447 shutdown_connections 2024-06-13T02:15:55.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.603+0000 7f3c89e00700 1 --2- 172.21.15.2:0/2478770447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c84109480 0x7f3c84115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:55.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.603+0000 7f3c89e00700 1 --2- 172.21.15.2:0/2478770447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c8410eac0 0x7f3c8410eea0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:55.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.603+0000 7f3c89e00700 1 --2- 172.21.15.2:0/2478770447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c84108ac0 0x7f3c84108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:55.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.603+0000 7f3c89e00700 1 -- 172.21.15.2:0/2478770447 >> 172.21.15.2:0/2478770447 conn(0x7f3c84075c60 msgr2=0x7f3c841072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:55.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.603+0000 7f3c89e00700 1 -- 172.21.15.2:0/2478770447 shutdown_connections 2024-06-13T02:15:55.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.603+0000 7f3c89e00700 1 -- 172.21.15.2:0/2478770447 wait complete. 2024-06-13T02:15:55.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.605+0000 7f3c89e00700 1 Processor -- start 2024-06-13T02:15:55.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.605+0000 7f3c89e00700 1 -- start start 2024-06-13T02:15:55.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.605+0000 7f3c89e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c84108ac0 0x7f3c8419f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:55.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.605+0000 7f3c89e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c84109480 0x7f3c8419f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:55.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.605+0000 7f3c89e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c8410eac0 0x7f3c841a3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:55.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.606+0000 7f3c89e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3c84118e40 con 0x7f3c84108ac0 2024-06-13T02:15:55.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.606+0000 7f3c89e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3c84118cc0 con 0x7f3c84109480 2024-06-13T02:15:55.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.606+0000 7f3c89e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3c84118fc0 con 0x7f3c8410eac0 2024-06-13T02:15:55.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.606+0000 7f3c7be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c84109480 0x7f3c8419f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:55.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.606+0000 7f3c82a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c84108ac0 0x7f3c8419f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:55.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.606+0000 7f3c7be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c84109480 0x7f3c8419f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:34348/0 (socket says 172.21.15.2:34348) 2024-06-13T02:15:55.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.606+0000 7f3c7be00700 1 -- 172.21.15.2:0/1650075980 learned_addr learned my addr 172.21.15.2:0/1650075980 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:55.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.606+0000 7f3c83400700 1 --2- 172.21.15.2:0/1650075980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c8410eac0 0x7f3c841a3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:55.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.606+0000 7f3c7be00700 1 -- 172.21.15.2:0/1650075980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c8410eac0 msgr2=0x7f3c841a3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:55.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.606+0000 7f3c7be00700 1 --2- 172.21.15.2:0/1650075980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c8410eac0 0x7f3c841a3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:55.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.606+0000 7f3c7be00700 1 -- 172.21.15.2:0/1650075980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c84108ac0 msgr2=0x7f3c8419f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:55.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.606+0000 7f3c7be00700 1 --2- 172.21.15.2:0/1650075980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c84108ac0 0x7f3c8419f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:55.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.606+0000 7f3c7be00700 1 -- 172.21.15.2:0/1650075980 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c841a42e0 con 0x7f3c84109480 2024-06-13T02:15:55.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.607+0000 7f3c7be00700 1 --2- 172.21.15.2:0/1650075980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c84109480 0x7f3c8419f810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00e9a0 tx=0x7f3c6c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:55.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.607+0000 7f3c88a00700 1 -- 172.21.15.2:0/1650075980 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00ca10 con 0x7f3c84109480 2024-06-13T02:15:55.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.607+0000 7f3c88a00700 1 -- 172.21.15.2:0/1650075980 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c6c00cbb0 con 0x7f3c84109480 2024-06-13T02:15:55.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.607+0000 7f3c88a00700 1 -- 172.21.15.2:0/1650075980 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c018680 con 0x7f3c84109480 2024-06-13T02:15:55.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.607+0000 7f3c89e00700 1 -- 172.21.15.2:0/1650075980 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c841a45d0 con 0x7f3c84109480 2024-06-13T02:15:55.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.607+0000 7f3c89e00700 1 -- 172.21.15.2:0/1650075980 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c841abe50 con 0x7f3c84109480 2024-06-13T02:15:55.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.608+0000 7f3c89e00700 1 -- 172.21.15.2:0/1650075980 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c84069180 con 0x7f3c84109480 2024-06-13T02:15:55.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.610+0000 7f3c88a00700 1 -- 172.21.15.2:0/1650075980 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 17) ==== 137883+0+0 (secure 0 0 0) 0x7f3c6c010430 con 0x7f3c84109480 2024-06-13T02:15:55.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.612+0000 7f3c88a00700 1 --2- 172.21.15.2:0/1650075980 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3c680a2cb0 0x7f3c680a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:55.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.612+0000 7f3c88a00700 1 -- 172.21.15.2:0/1650075980 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f3c6c0cf860 con 0x7f3c84109480 2024-06-13T02:15:55.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.612+0000 7f3c82a00700 1 --2- 172.21.15.2:0/1650075980 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3c680a2cb0 0x7f3c680a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:55.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.613+0000 7f3c82a00700 1 --2- 172.21.15.2:0/1650075980 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3c680a2cb0 0x7f3c680a5170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3c74009810 tx=0x7f3c74019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:55.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.616+0000 7f3c88a00700 1 -- 172.21.15.2:0/1650075980 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3c6c09c210 con 0x7f3c84109480 2024-06-13T02:15:55.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.674+0000 7f3c88a00700 1 -- 172.21.15.2:0/1650075980 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f3c6c098180 con 0x7f3c84109480 2024-06-13T02:15:55.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.869+0000 7f3c89e00700 1 -- 172.21.15.2:0/1650075980 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f3c8402dca0 con 0x7f3c84109480 2024-06-13T02:15:55.870 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:55 smithi002 ceph-mon[31960]: pgmap v435: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:15:55.871 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:55 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1511792139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-13T02:15:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.869+0000 7f3c88a00700 1 -- 172.21.15.2:0/1650075980 <== mon.2 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3c6c086f20 con 0x7f3c84109480 2024-06-13T02:15:55.871 INFO:teuthology.orchestra.run.smithi002.stdout:347892351032 2024-06-13T02:15:55.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.874+0000 7f3c89e00700 1 -- 172.21.15.2:0/1650075980 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3c680a2cb0 msgr2=0x7f3c680a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:55.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.874+0000 7f3c89e00700 1 --2- 172.21.15.2:0/1650075980 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3c680a2cb0 0x7f3c680a5170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3c74009810 tx=0x7f3c74019040 comp rx=0 tx=0).stop 2024-06-13T02:15:55.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.874+0000 7f3c89e00700 1 -- 172.21.15.2:0/1650075980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c84109480 msgr2=0x7f3c8419f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:55.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.874+0000 7f3c89e00700 1 --2- 172.21.15.2:0/1650075980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c84109480 0x7f3c8419f810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c00e9a0 tx=0x7f3c6c00ecb0 comp rx=0 tx=0).stop 2024-06-13T02:15:55.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.874+0000 7f3c89e00700 1 -- 172.21.15.2:0/1650075980 shutdown_connections 2024-06-13T02:15:55.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.874+0000 7f3c89e00700 1 --2- 172.21.15.2:0/1650075980 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3c680a2cb0 0x7f3c680a5170 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:55.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.874+0000 7f3c89e00700 1 --2- 172.21.15.2:0/1650075980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c8410eac0 0x7f3c841a3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:55.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.874+0000 7f3c89e00700 1 --2- 172.21.15.2:0/1650075980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c84108ac0 0x7f3c8419f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:55.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.874+0000 7f3c89e00700 1 --2- 172.21.15.2:0/1650075980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c84109480 0x7f3c8419f810 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:55.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.874+0000 7f3c89e00700 1 -- 172.21.15.2:0/1650075980 >> 172.21.15.2:0/1650075980 conn(0x7f3c84075c60 msgr2=0x7f3c84076280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:55.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.874+0000 7f3c89e00700 1 -- 172.21.15.2:0/1650075980 shutdown_connections 2024-06-13T02:15:55.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:55.875+0000 7f3c89e00700 1 -- 172.21.15.2:0/1650075980 wait complete. 2024-06-13T02:15:55.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:55 smithi084 ceph-mon[36833]: pgmap v435: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:15:55.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:55 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1511792139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-13T02:15:56.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:55 smithi175 ceph-mon[36977]: pgmap v435: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:15:56.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:55 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1511792139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-13T02:15:56.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.422+0000 7f333f200700 1 -- 172.21.15.2:0/3816755079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3338108ac0 msgr2=0x7f3338108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:56.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.422+0000 7f333f200700 1 --2- 172.21.15.2:0/3816755079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3338108ac0 0x7f3338108f40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3320009990 tx=0x7f3320009ca0 comp rx=0 tx=0).stop 2024-06-13T02:15:56.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.423+0000 7f333f200700 1 -- 172.21.15.2:0/3816755079 shutdown_connections 2024-06-13T02:15:56.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.423+0000 7f333f200700 1 --2- 172.21.15.2:0/3816755079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3338109480 0x7f3338115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:56.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.423+0000 7f333f200700 1 --2- 172.21.15.2:0/3816755079 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f333810eac0 0x7f333810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:56.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.423+0000 7f333f200700 1 --2- 172.21.15.2:0/3816755079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3338108ac0 0x7f3338108f40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:56.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.423+0000 7f333f200700 1 -- 172.21.15.2:0/3816755079 >> 172.21.15.2:0/3816755079 conn(0x7f3338075c60 msgr2=0x7f33381072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:56.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.423+0000 7f333f200700 1 -- 172.21.15.2:0/3816755079 shutdown_connections 2024-06-13T02:15:56.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.423+0000 7f333f200700 1 -- 172.21.15.2:0/3816755079 wait complete. 2024-06-13T02:15:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.425+0000 7f333f200700 1 Processor -- start 2024-06-13T02:15:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.425+0000 7f333f200700 1 -- start start 2024-06-13T02:15:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.425+0000 7f333f200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3338108ac0 0x7f333819f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.425+0000 7f333f200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3338109480 0x7f333819f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:56.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.425+0000 7f333f200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f333810eac0 0x7f33381a3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:56.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.425+0000 7f333f200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3338118e50 con 0x7f3338108ac0 2024-06-13T02:15:56.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.425+0000 7f333f200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3338118cd0 con 0x7f333810eac0 2024-06-13T02:15:56.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.425+0000 7f333f200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3338118fd0 con 0x7f3338109480 2024-06-13T02:15:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.426+0000 7f3337e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3338108ac0 0x7f333819f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.426+0000 7f333d200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f333810eac0 0x7f33381a3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.426+0000 7f3337e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3338108ac0 0x7f333819f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51692/0 (socket says 172.21.15.2:51692) 2024-06-13T02:15:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.426+0000 7f3337e00700 1 -- 172.21.15.2:0/252628572 learned_addr learned my addr 172.21.15.2:0/252628572 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.426+0000 7f333d200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f333810eac0 0x7f33381a3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:34362/0 (socket says 172.21.15.2:34362) 2024-06-13T02:15:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.426+0000 7f332fe00700 1 --2- 172.21.15.2:0/252628572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3338109480 0x7f333819f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.426+0000 7f333d200700 1 -- 172.21.15.2:0/252628572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3338109480 msgr2=0x7f333819f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.426+0000 7f333d200700 1 --2- 172.21.15.2:0/252628572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3338109480 0x7f333819f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.426+0000 7f333d200700 1 -- 172.21.15.2:0/252628572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3338108ac0 msgr2=0x7f333819f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.426+0000 7f333d200700 1 --2- 172.21.15.2:0/252628572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3338108ac0 0x7f333819f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.426+0000 7f333d200700 1 -- 172.21.15.2:0/252628572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33381a4230 con 0x7f333810eac0 2024-06-13T02:15:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.426+0000 7f3337e00700 1 --2- 172.21.15.2:0/252628572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3338108ac0 0x7f333819f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:15:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.426+0000 7f333d200700 1 --2- 172.21.15.2:0/252628572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f333810eac0 0x7f33381a3af0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f333000efc0 tx=0x7f333000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.427+0000 7f3335600700 1 -- 172.21.15.2:0/252628572 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33300092e0 con 0x7f333810eac0 2024-06-13T02:15:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.427+0000 7f333f200700 1 -- 172.21.15.2:0/252628572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33381a44c0 con 0x7f333810eac0 2024-06-13T02:15:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.427+0000 7f3335600700 1 -- 172.21.15.2:0/252628572 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3330004bb0 con 0x7f333810eac0 2024-06-13T02:15:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.427+0000 7f3335600700 1 -- 172.21.15.2:0/252628572 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330004280 con 0x7f333810eac0 2024-06-13T02:15:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.427+0000 7f333f200700 1 -- 172.21.15.2:0/252628572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33381abda0 con 0x7f333810eac0 2024-06-13T02:15:56.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.428+0000 7f333f200700 1 -- 172.21.15.2:0/252628572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3338069180 con 0x7f333810eac0 2024-06-13T02:15:56.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.430+0000 7f3335600700 1 -- 172.21.15.2:0/252628572 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f333001b030 con 0x7f333810eac0 2024-06-13T02:15:56.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.431+0000 7f3335600700 1 --2- 172.21.15.2:0/252628572 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f331c0a2c20 0x7f331c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:56.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.432+0000 7f3335600700 1 -- 172.21.15.2:0/252628572 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f33300cef90 con 0x7f333810eac0 2024-06-13T02:15:56.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.432+0000 7f3337e00700 1 --2- 172.21.15.2:0/252628572 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f331c0a2c20 0x7f331c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:56.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.433+0000 7f3337e00700 1 --2- 172.21.15.2:0/252628572 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f331c0a2c20 0x7f331c0a50e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3328011550 tx=0x7f3328009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:56.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.436+0000 7f3335600700 1 -- 172.21.15.2:0/252628572 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3330022020 con 0x7f333810eac0 2024-06-13T02:15:56.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.681+0000 7f333f200700 1 -- 172.21.15.2:0/252628572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f333802dca0 con 0x7f333810eac0 2024-06-13T02:15:56.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:56 smithi002 ceph-mon[31960]: mgrmap e18: x(active, since 11m), standbys: y, z 2024-06-13T02:15:56.683 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:56 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1650075980' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-13T02:15:56.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.681+0000 7f3335600700 1 -- 172.21.15.2:0/252628572 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3330010040 con 0x7f333810eac0 2024-06-13T02:15:56.683 INFO:teuthology.orchestra.run.smithi002.stdout:201863462997 2024-06-13T02:15:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.684+0000 7f333f200700 1 -- 172.21.15.2:0/252628572 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f331c0a2c20 msgr2=0x7f331c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.684+0000 7f333f200700 1 --2- 172.21.15.2:0/252628572 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f331c0a2c20 0x7f331c0a50e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3328011550 tx=0x7f3328009260 comp rx=0 tx=0).stop 2024-06-13T02:15:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.684+0000 7f333f200700 1 -- 172.21.15.2:0/252628572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f333810eac0 msgr2=0x7f33381a3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.684+0000 7f333f200700 1 --2- 172.21.15.2:0/252628572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f333810eac0 0x7f33381a3af0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f333000efc0 tx=0x7f333000c3a0 comp rx=0 tx=0).stop 2024-06-13T02:15:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.685+0000 7f333f200700 1 -- 172.21.15.2:0/252628572 shutdown_connections 2024-06-13T02:15:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.685+0000 7f333f200700 1 --2- 172.21.15.2:0/252628572 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f331c0a2c20 0x7f331c0a50e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.685+0000 7f333f200700 1 --2- 172.21.15.2:0/252628572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f333810eac0 0x7f33381a3af0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:56.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.685+0000 7f333f200700 1 --2- 172.21.15.2:0/252628572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3338108ac0 0x7f333819f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:56.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.685+0000 7f333f200700 1 --2- 172.21.15.2:0/252628572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3338109480 0x7f333819f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:56.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.685+0000 7f333f200700 1 -- 172.21.15.2:0/252628572 >> 172.21.15.2:0/252628572 conn(0x7f3338075c60 msgr2=0x7f3338076280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:56.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.685+0000 7f333f200700 1 -- 172.21.15.2:0/252628572 shutdown_connections 2024-06-13T02:15:56.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:56.685+0000 7f333f200700 1 -- 172.21.15.2:0/252628572 wait complete. 2024-06-13T02:15:56.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:56 smithi084 ceph-mon[36833]: mgrmap e18: x(active, since 11m), standbys: y, z 2024-06-13T02:15:56.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:56 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1650075980' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-13T02:15:57.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:56 smithi175 ceph-mon[36977]: mgrmap e18: x(active, since 11m), standbys: y, z 2024-06-13T02:15:57.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:56 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1650075980' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-13T02:15:57.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.530+0000 7f706ea00700 1 -- 172.21.15.2:0/2792628117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7068109480 msgr2=0x7f7068115990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:57.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.530+0000 7f706ea00700 1 --2- 172.21.15.2:0/2792628117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7068109480 0x7f7068115990 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f706000b0a0 tx=0x7f706000b3b0 comp rx=0 tx=0).stop 2024-06-13T02:15:57.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.530+0000 7f706ea00700 1 -- 172.21.15.2:0/2792628117 shutdown_connections 2024-06-13T02:15:57.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.530+0000 7f706ea00700 1 --2- 172.21.15.2:0/2792628117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7068109480 0x7f7068115990 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:57.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.530+0000 7f706ea00700 1 --2- 172.21.15.2:0/2792628117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f706810eac0 0x7f706810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:57.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.530+0000 7f706ea00700 1 --2- 172.21.15.2:0/2792628117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7068108ac0 0x7f7068108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:57.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.531+0000 7f706ea00700 1 -- 172.21.15.2:0/2792628117 >> 172.21.15.2:0/2792628117 conn(0x7f7068075c60 msgr2=0x7f70681072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:57.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.531+0000 7f706ea00700 1 -- 172.21.15.2:0/2792628117 shutdown_connections 2024-06-13T02:15:57.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.531+0000 7f706ea00700 1 -- 172.21.15.2:0/2792628117 wait complete. 2024-06-13T02:15:57.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.532+0000 7f706ea00700 1 Processor -- start 2024-06-13T02:15:57.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.532+0000 7f706ea00700 1 -- start start 2024-06-13T02:15:57.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.532+0000 7f706ea00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7068108ac0 0x7f706819f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:57.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.532+0000 7f706ea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7068109480 0x7f706819f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:57.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.532+0000 7f706ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706810eac0 0x7f70681a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:57.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.532+0000 7f706ea00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7068118e50 con 0x7f7068109480 2024-06-13T02:15:57.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.532+0000 7f706ea00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7068118cd0 con 0x7f706810eac0 2024-06-13T02:15:57.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.532+0000 7f706ea00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7068118fd0 con 0x7f7068108ac0 2024-06-13T02:15:57.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.533+0000 7f7067e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7068108ac0 0x7f706819f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:57.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.533+0000 7f705fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7068109480 0x7f706819f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:57.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.533+0000 7f7067e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7068108ac0 0x7f706819f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:43312/0 (socket says 172.21.15.2:43312) 2024-06-13T02:15:57.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.533+0000 7f7067e00700 1 -- 172.21.15.2:0/3351450441 learned_addr learned my addr 172.21.15.2:0/3351450441 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:57.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.533+0000 7f706ca00700 1 --2- 172.21.15.2:0/3351450441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706810eac0 0x7f70681a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:57.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.533+0000 7f7067e00700 1 -- 172.21.15.2:0/3351450441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706810eac0 msgr2=0x7f70681a3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:57.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.533+0000 7f7067e00700 1 --2- 172.21.15.2:0/3351450441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706810eac0 0x7f70681a3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:57.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.533+0000 7f7067e00700 1 -- 172.21.15.2:0/3351450441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7068109480 msgr2=0x7f706819f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:57.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.533+0000 7f7067e00700 1 --2- 172.21.15.2:0/3351450441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7068109480 0x7f706819f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:57.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.533+0000 7f7067e00700 1 -- 172.21.15.2:0/3351450441 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70681a41a0 con 0x7f7068108ac0 2024-06-13T02:15:57.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.533+0000 7f706ca00700 1 --2- 172.21.15.2:0/3351450441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706810eac0 0x7f70681a3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:15:57.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.534+0000 7f7067e00700 1 --2- 172.21.15.2:0/3351450441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7068108ac0 0x7f706819f1e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f705800e9a0 tx=0x7f705800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:57.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.534+0000 7f7065600700 1 -- 172.21.15.2:0/3351450441 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705800ca10 con 0x7f7068108ac0 2024-06-13T02:15:57.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.534+0000 7f706ea00700 1 -- 172.21.15.2:0/3351450441 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70681a4490 con 0x7f7068108ac0 2024-06-13T02:15:57.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.534+0000 7f706ea00700 1 -- 172.21.15.2:0/3351450441 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70681abd10 con 0x7f7068108ac0 2024-06-13T02:15:57.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.534+0000 7f7065600700 1 -- 172.21.15.2:0/3351450441 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f705800cbb0 con 0x7f7068108ac0 2024-06-13T02:15:57.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.534+0000 7f7065600700 1 -- 172.21.15.2:0/3351450441 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7058018680 con 0x7f7068108ac0 2024-06-13T02:15:57.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.535+0000 7f706ea00700 1 -- 172.21.15.2:0/3351450441 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7044005330 con 0x7f7068108ac0 2024-06-13T02:15:57.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.537+0000 7f7065600700 1 -- 172.21.15.2:0/3351450441 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f7058018820 con 0x7f7068108ac0 2024-06-13T02:15:57.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.539+0000 7f7065600700 1 --2- 172.21.15.2:0/3351450441 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f704c0a2c20 0x7f704c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:57.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.539+0000 7f7065600700 1 -- 172.21.15.2:0/3351450441 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f70580cf610 con 0x7f7068108ac0 2024-06-13T02:15:57.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.539+0000 7f705fe00700 1 --2- 172.21.15.2:0/3351450441 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f704c0a2c20 0x7f704c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:57.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.541+0000 7f705fe00700 1 --2- 172.21.15.2:0/3351450441 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f704c0a2c20 0x7f704c0a50e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f70680779f0 tx=0x7f7050009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:57.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.541+0000 7f7065600700 1 -- 172.21.15.2:0/3351450441 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f705809c120 con 0x7f7068108ac0 2024-06-13T02:15:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.779+0000 7f706ea00700 1 -- 172.21.15.2:0/3351450441 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f70440058f0 con 0x7f7068108ac0 2024-06-13T02:15:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.780+0000 7f7065600700 1 -- 172.21.15.2:0/3351450441 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f705809ba20 con 0x7f7068108ac0 2024-06-13T02:15:57.781 INFO:teuthology.orchestra.run.smithi002.stdout:111669149796 2024-06-13T02:15:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.783+0000 7f706ea00700 1 -- 172.21.15.2:0/3351450441 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f704c0a2c20 msgr2=0x7f704c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.783+0000 7f706ea00700 1 --2- 172.21.15.2:0/3351450441 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f704c0a2c20 0x7f704c0a50e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f70680779f0 tx=0x7f7050009260 comp rx=0 tx=0).stop 2024-06-13T02:15:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.783+0000 7f706ea00700 1 -- 172.21.15.2:0/3351450441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7068108ac0 msgr2=0x7f706819f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:57.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.783+0000 7f706ea00700 1 --2- 172.21.15.2:0/3351450441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7068108ac0 0x7f706819f1e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f705800e9a0 tx=0x7f705800ecb0 comp rx=0 tx=0).stop 2024-06-13T02:15:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.783+0000 7f706ea00700 1 -- 172.21.15.2:0/3351450441 shutdown_connections 2024-06-13T02:15:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.783+0000 7f706ea00700 1 --2- 172.21.15.2:0/3351450441 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f704c0a2c20 0x7f704c0a50e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.783+0000 7f706ea00700 1 --2- 172.21.15.2:0/3351450441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706810eac0 0x7f70681a3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.783+0000 7f706ea00700 1 --2- 172.21.15.2:0/3351450441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7068108ac0 0x7f706819f1e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.783+0000 7f706ea00700 1 --2- 172.21.15.2:0/3351450441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7068109480 0x7f706819f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.783+0000 7f706ea00700 1 -- 172.21.15.2:0/3351450441 >> 172.21.15.2:0/3351450441 conn(0x7f7068075c60 msgr2=0x7f70680760e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.783+0000 7f706ea00700 1 -- 172.21.15.2:0/3351450441 shutdown_connections 2024-06-13T02:15:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:57.783+0000 7f706ea00700 1 -- 172.21.15.2:0/3351450441 wait complete. 2024-06-13T02:15:57.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:57 smithi084 ceph-mon[36833]: pgmap v436: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-06-13T02:15:57.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:57 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/252628572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-13T02:15:58.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:57 smithi175 ceph-mon[36977]: pgmap v436: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-06-13T02:15:58.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:57 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/252628572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-13T02:15:58.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:57 smithi002 ceph-mon[31960]: pgmap v436: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-06-13T02:15:58.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:57 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/252628572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-13T02:15:58.396 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299465 got 223338299470 for osd.7 2024-06-13T02:15:58.397 DEBUG:teuthology.parallel:result is None 2024-06-13T02:15:58.540 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892351026 got 347892351032 for osd.11 2024-06-13T02:15:58.540 DEBUG:teuthology.parallel:result is None 2024-06-13T02:15:58.632 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:15:58.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:58 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3351450441' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-13T02:15:59.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:58 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3351450441' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-13T02:15:59.043 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:58 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3351450441' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-13T02:15:59.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.205+0000 7f31e2e00700 1 -- 172.21.15.2:0/930360710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31dc074fe0 msgr2=0x7f31dc113120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:59.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.205+0000 7f31e2e00700 1 --2- 172.21.15.2:0/930360710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31dc074fe0 0x7f31dc113120 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009990 tx=0x7f31c8009ca0 comp rx=0 tx=0).stop 2024-06-13T02:15:59.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.205+0000 7f31e2e00700 1 -- 172.21.15.2:0/930360710 shutdown_connections 2024-06-13T02:15:59.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.205+0000 7f31e2e00700 1 --2- 172.21.15.2:0/930360710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31dc113660 0x7f31dc115a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:59.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.205+0000 7f31e2e00700 1 --2- 172.21.15.2:0/930360710 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc0746c0 0x7f31dc074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.205+0000 7f31e2e00700 1 --2- 172.21.15.2:0/930360710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31dc074fe0 0x7f31dc113120 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.205+0000 7f31e2e00700 1 -- 172.21.15.2:0/930360710 >> 172.21.15.2:0/930360710 conn(0x7f31dc0795f0 msgr2=0x7f31dc079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.205+0000 7f31e2e00700 1 -- 172.21.15.2:0/930360710 shutdown_connections 2024-06-13T02:15:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.205+0000 7f31e2e00700 1 -- 172.21.15.2:0/930360710 wait complete. 2024-06-13T02:15:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.207+0000 7f31e2e00700 1 Processor -- start 2024-06-13T02:15:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.207+0000 7f31e2e00700 1 -- start start 2024-06-13T02:15:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.207+0000 7f31e2e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31dc0746c0 0x7f31dc19f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.207+0000 7f31e2e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc074fe0 0x7f31dc19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.207+0000 7f31e2e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31dc113660 0x7f31dc1a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.207+0000 7f31e2e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc118df0 con 0x7f31dc113660 2024-06-13T02:15:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.207+0000 7f31e2e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc118c70 con 0x7f31dc074fe0 2024-06-13T02:15:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.207+0000 7f31e2e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc118f70 con 0x7f31dc0746c0 2024-06-13T02:15:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.207+0000 7f31dbe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31dc0746c0 0x7f31dc19f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:59.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.207+0000 7f31dbe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31dc0746c0 0x7f31dc19f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:43328/0 (socket says 172.21.15.2:43328) 2024-06-13T02:15:59.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.208+0000 7f31dbe00700 1 -- 172.21.15.2:0/1033147203 learned_addr learned my addr 172.21.15.2:0/1033147203 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:15:59.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.208+0000 7f31db400700 1 --2- 172.21.15.2:0/1033147203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc074fe0 0x7f31dc19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:59.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.208+0000 7f31e0e00700 1 --2- 172.21.15.2:0/1033147203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31dc113660 0x7f31dc1a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:59.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.208+0000 7f31dbe00700 1 -- 172.21.15.2:0/1033147203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc074fe0 msgr2=0x7f31dc19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:59.698 INFO:teuthology.orchestra.run.smithi002.stdout:313532612669 2024-06-13T02:15:59.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.208+0000 7f31dbe00700 1 --2- 172.21.15.2:0/1033147203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc074fe0 0x7f31dc19f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.208+0000 7f31dbe00700 1 -- 172.21.15.2:0/1033147203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31dc113660 msgr2=0x7f31dc1a3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.208+0000 7f31dbe00700 1 --2- 172.21.15.2:0/1033147203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31dc113660 0x7f31dc1a3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.208+0000 7f31dbe00700 1 -- 172.21.15.2:0/1033147203 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31dc1a42f0 con 0x7f31dc0746c0 2024-06-13T02:15:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.208+0000 7f31e0e00700 1 --2- 172.21.15.2:0/1033147203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31dc113660 0x7f31dc1a3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:15:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.208+0000 7f31dbe00700 1 --2- 172.21.15.2:0/1033147203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31dc0746c0 0x7f31dc19f2e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00e9a0 tx=0x7f31cc00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.209+0000 7f31d8c00700 1 -- 172.21.15.2:0/1033147203 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00ca10 con 0x7f31dc0746c0 2024-06-13T02:15:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.209+0000 7f31d8c00700 1 -- 172.21.15.2:0/1033147203 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31cc00cbb0 con 0x7f31dc0746c0 2024-06-13T02:15:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.209+0000 7f31e2e00700 1 -- 172.21.15.2:0/1033147203 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31dc1a45e0 con 0x7f31dc0746c0 2024-06-13T02:15:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.209+0000 7f31d8c00700 1 -- 172.21.15.2:0/1033147203 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc018680 con 0x7f31dc0746c0 2024-06-13T02:15:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.209+0000 7f31e2e00700 1 -- 172.21.15.2:0/1033147203 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31dc1abe60 con 0x7f31dc0746c0 2024-06-13T02:15:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.210+0000 7f31e2e00700 1 -- 172.21.15.2:0/1033147203 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31dc069180 con 0x7f31dc0746c0 2024-06-13T02:15:59.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.212+0000 7f31d8c00700 1 -- 172.21.15.2:0/1033147203 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f31cc010430 con 0x7f31dc0746c0 2024-06-13T02:15:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.214+0000 7f31d8c00700 1 --2- 172.21.15.2:0/1033147203 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f31c00a2ca0 0x7f31c00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:15:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.214+0000 7f31d8c00700 1 -- 172.21.15.2:0/1033147203 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f31cc0cfab0 con 0x7f31dc0746c0 2024-06-13T02:15:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.214+0000 7f31db400700 1 --2- 172.21.15.2:0/1033147203 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f31c00a2ca0 0x7f31c00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:15:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.215+0000 7f31db400700 1 --2- 172.21.15.2:0/1033147203 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f31c00a2ca0 0x7f31c00a5160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f31dc10ffe0 tx=0x7f31c800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:15:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.216+0000 7f31d8c00700 1 -- 172.21.15.2:0/1033147203 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f31cc09c5c0 con 0x7f31dc0746c0 2024-06-13T02:15:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.454+0000 7f31e2e00700 1 -- 172.21.15.2:0/1033147203 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f31dc1ac090 con 0x7f31dc0746c0 2024-06-13T02:15:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.455+0000 7f31d8c00700 1 -- 172.21.15.2:0/1033147203 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f31cc09bec0 con 0x7f31dc0746c0 2024-06-13T02:15:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.458+0000 7f31e2e00700 1 -- 172.21.15.2:0/1033147203 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f31c00a2ca0 msgr2=0x7f31c00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.458+0000 7f31e2e00700 1 --2- 172.21.15.2:0/1033147203 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f31c00a2ca0 0x7f31c00a5160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f31dc10ffe0 tx=0x7f31c800b260 comp rx=0 tx=0).stop 2024-06-13T02:15:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.458+0000 7f31e2e00700 1 -- 172.21.15.2:0/1033147203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31dc0746c0 msgr2=0x7f31dc19f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:15:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.458+0000 7f31e2e00700 1 --2- 172.21.15.2:0/1033147203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31dc0746c0 0x7f31dc19f2e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00e9a0 tx=0x7f31cc00ecb0 comp rx=0 tx=0).stop 2024-06-13T02:15:59.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.458+0000 7f31e2e00700 1 -- 172.21.15.2:0/1033147203 shutdown_connections 2024-06-13T02:15:59.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.458+0000 7f31e2e00700 1 --2- 172.21.15.2:0/1033147203 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f31c00a2ca0 0x7f31c00a5160 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:59.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.458+0000 7f31e2e00700 1 --2- 172.21.15.2:0/1033147203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31dc113660 0x7f31dc1a3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:59.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.458+0000 7f31e2e00700 1 --2- 172.21.15.2:0/1033147203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31dc0746c0 0x7f31dc19f2e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:59.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.458+0000 7f31e2e00700 1 --2- 172.21.15.2:0/1033147203 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc074fe0 0x7f31dc19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:15:59.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.458+0000 7f31e2e00700 1 -- 172.21.15.2:0/1033147203 >> 172.21.15.2:0/1033147203 conn(0x7f31dc0795f0 msgr2=0x7f31dc112430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:15:59.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.458+0000 7f31e2e00700 1 -- 172.21.15.2:0/1033147203 shutdown_connections 2024-06-13T02:15:59.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:15:59.458+0000 7f31e2e00700 1 -- 172.21.15.2:0/1033147203 wait complete. 2024-06-13T02:15:59.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:59 smithi002 ceph-mon[31960]: pgmap v437: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T02:15:59.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:15:59 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1033147203' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-13T02:15:59.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:59 smithi084 ceph-mon[36833]: pgmap v437: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T02:15:59.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:15:59 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1033147203' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-13T02:16:00.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:59 smithi175 ceph-mon[36977]: pgmap v437: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T02:16:00.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:15:59 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1033147203' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-13T02:16:01.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.535+0000 7fb45d600700 1 -- 172.21.15.2:0/3002119325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb458074fe0 msgr2=0x7fb45810e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.535+0000 7fb45d600700 1 --2- 172.21.15.2:0/3002119325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb458074fe0 0x7fb45810e950 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb444009990 tx=0x7fb444009ca0 comp rx=0 tx=0).stop 2024-06-13T02:16:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.535+0000 7fb45d600700 1 -- 172.21.15.2:0/3002119325 shutdown_connections 2024-06-13T02:16:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.535+0000 7fb45d600700 1 --2- 172.21.15.2:0/3002119325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45810ee90 0x7fb458111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.535+0000 7fb45d600700 1 --2- 172.21.15.2:0/3002119325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4580746c0 0x7fb458074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.535+0000 7fb45d600700 1 --2- 172.21.15.2:0/3002119325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb458074fe0 0x7fb45810e950 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.535+0000 7fb45d600700 1 -- 172.21.15.2:0/3002119325 >> 172.21.15.2:0/3002119325 conn(0x7fb4580795f0 msgr2=0x7fb458079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.535+0000 7fb45d600700 1 -- 172.21.15.2:0/3002119325 shutdown_connections 2024-06-13T02:16:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.535+0000 7fb45d600700 1 -- 172.21.15.2:0/3002119325 wait complete. 2024-06-13T02:16:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.537+0000 7fb45d600700 1 Processor -- start 2024-06-13T02:16:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.537+0000 7fb45d600700 1 -- start start 2024-06-13T02:16:01.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.537+0000 7fb45d600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4580746c0 0x7fb45819ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.537+0000 7fb45d600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb458074fe0 0x7fb45819b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.537+0000 7fb45d600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45810ee90 0x7fb45819f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.537+0000 7fb45d600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb4581149c0 con 0x7fb4580746c0 2024-06-13T02:16:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.537+0000 7fb45d600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb458114840 con 0x7fb458074fe0 2024-06-13T02:16:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.537+0000 7fb45d600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb458114b40 con 0x7fb45810ee90 2024-06-13T02:16:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.538+0000 7fb456a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4580746c0 0x7fb45819ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.538+0000 7fb456000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb458074fe0 0x7fb45819b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.538+0000 7fb456a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4580746c0 0x7fb45819ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51762/0 (socket says 172.21.15.2:51762) 2024-06-13T02:16:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.538+0000 7fb456000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb458074fe0 0x7fb45819b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:34410/0 (socket says 172.21.15.2:34410) 2024-06-13T02:16:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.538+0000 7fb456a00700 1 -- 172.21.15.2:0/1695906696 learned_addr learned my addr 172.21.15.2:0/1695906696 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.538+0000 7fb457400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45810ee90 0x7fb45819f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:01.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.538+0000 7fb456000700 1 -- 172.21.15.2:0/1695906696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45810ee90 msgr2=0x7fb45819f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.538+0000 7fb456000700 1 --2- 172.21.15.2:0/1695906696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45810ee90 0x7fb45819f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.538+0000 7fb456000700 1 -- 172.21.15.2:0/1695906696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4580746c0 msgr2=0x7fb45819ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.538+0000 7fb456000700 1 --2- 172.21.15.2:0/1695906696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4580746c0 0x7fb45819ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.538+0000 7fb456000700 1 -- 172.21.15.2:0/1695906696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45819fe10 con 0x7fb458074fe0 2024-06-13T02:16:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.539+0000 7fb456000700 1 --2- 172.21.15.2:0/1695906696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb458074fe0 0x7fb45819b390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb4440059d0 tx=0x7fb44400bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.539+0000 7fb44f400700 1 -- 172.21.15.2:0/1695906696 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444027070 con 0x7fb458074fe0 2024-06-13T02:16:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.539+0000 7fb45d600700 1 -- 172.21.15.2:0/1695906696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4581a00a0 con 0x7fb458074fe0 2024-06-13T02:16:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.539+0000 7fb44f400700 1 -- 172.21.15.2:0/1695906696 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb444003d70 con 0x7fb458074fe0 2024-06-13T02:16:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.539+0000 7fb44f400700 1 -- 172.21.15.2:0/1695906696 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44400f460 con 0x7fb458074fe0 2024-06-13T02:16:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.539+0000 7fb45d600700 1 -- 172.21.15.2:0/1695906696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4581a7980 con 0x7fb458074fe0 2024-06-13T02:16:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.540+0000 7fb45d600700 1 -- 172.21.15.2:0/1695906696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb458075db0 con 0x7fb458074fe0 2024-06-13T02:16:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.542+0000 7fb44f400700 1 -- 172.21.15.2:0/1695906696 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fb44402a070 con 0x7fb458074fe0 2024-06-13T02:16:01.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.544+0000 7fb44f400700 1 --2- 172.21.15.2:0/1695906696 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb43c0a2c20 0x7fb43c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.544+0000 7fb44f400700 1 -- 172.21.15.2:0/1695906696 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fb4440d03d0 con 0x7fb458074fe0 2024-06-13T02:16:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.544+0000 7fb456a00700 1 --2- 172.21.15.2:0/1695906696 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb43c0a2c20 0x7fb43c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.545+0000 7fb456a00700 1 --2- 172.21.15.2:0/1695906696 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb43c0a2c20 0x7fb43c0a50e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb448009d20 tx=0x7fb448009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.548+0000 7fb44f400700 1 -- 172.21.15.2:0/1695906696 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb44405e850 con 0x7fb458074fe0 2024-06-13T02:16:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.782+0000 7fb45d600700 1 -- 172.21.15.2:0/1695906696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb45802dca0 con 0x7fb458074fe0 2024-06-13T02:16:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.782+0000 7fb44f400700 1 -- 172.21.15.2:0/1695906696 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb444013070 con 0x7fb458074fe0 2024-06-13T02:16:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.785+0000 7fb45d600700 1 -- 172.21.15.2:0/1695906696 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb43c0a2c20 msgr2=0x7fb43c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.785+0000 7fb45d600700 1 --2- 172.21.15.2:0/1695906696 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb43c0a2c20 0x7fb43c0a50e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb448009d20 tx=0x7fb448009260 comp rx=0 tx=0).stop 2024-06-13T02:16:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.785+0000 7fb45d600700 1 -- 172.21.15.2:0/1695906696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb458074fe0 msgr2=0x7fb45819b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.785+0000 7fb45d600700 1 --2- 172.21.15.2:0/1695906696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb458074fe0 0x7fb45819b390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb4440059d0 tx=0x7fb44400bab0 comp rx=0 tx=0).stop 2024-06-13T02:16:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.786+0000 7fb45d600700 1 -- 172.21.15.2:0/1695906696 shutdown_connections 2024-06-13T02:16:01.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.786+0000 7fb45d600700 1 --2- 172.21.15.2:0/1695906696 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb43c0a2c20 0x7fb43c0a50e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:01.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.786+0000 7fb45d600700 1 --2- 172.21.15.2:0/1695906696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb45810ee90 0x7fb45819f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:01.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.786+0000 7fb45d600700 1 --2- 172.21.15.2:0/1695906696 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4580746c0 0x7fb45819ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:01.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.786+0000 7fb45d600700 1 --2- 172.21.15.2:0/1695906696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb458074fe0 0x7fb45819b390 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:01.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.786+0000 7fb45d600700 1 -- 172.21.15.2:0/1695906696 >> 172.21.15.2:0/1695906696 conn(0x7fb4580795f0 msgr2=0x7fb4580ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:01.115 INFO:teuthology.orchestra.run.smithi002.stdout:55834574963 2024-06-13T02:16:01.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.786+0000 7fb45d600700 1 -- 172.21.15.2:0/1695906696 shutdown_connections 2024-06-13T02:16:01.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:00.786+0000 7fb45d600700 1 -- 172.21.15.2:0/1695906696 wait complete. 2024-06-13T02:16:01.306 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462992 got 201863462997 for osd.6 2024-06-13T02:16:01.307 DEBUG:teuthology.parallel:result is None 2024-06-13T02:16:01.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:01 smithi002 ceph-mon[31960]: pgmap v438: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-13T02:16:01.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:01 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1695906696' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-13T02:16:01.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:01 smithi084 ceph-mon[36833]: pgmap v438: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-13T02:16:01.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:01 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1695906696' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-13T02:16:02.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:01 smithi175 ceph-mon[36977]: pgmap v438: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-13T02:16:02.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:01 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1695906696' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-13T02:16:02.082 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776190 got 292057776194 for osd.9 2024-06-13T02:16:02.082 DEBUG:teuthology.parallel:result is None 2024-06-13T02:16:02.878 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574956 got 55834574963 for osd.1 2024-06-13T02:16:02.878 DEBUG:teuthology.parallel:result is None 2024-06-13T02:16:03.339 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149792 got 111669149796 for osd.3 2024-06-13T02:16:03.339 DEBUG:teuthology.parallel:result is None 2024-06-13T02:16:03.701 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612663 got 313532612669 for osd.10 2024-06-13T02:16:03.702 DEBUG:teuthology.parallel:result is None 2024-06-13T02:16:03.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:03 smithi084 ceph-mon[36833]: pgmap v439: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-13T02:16:03.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:03 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3864718976' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-13T02:16:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.436+0000 7fd6a9200700 1 -- 172.21.15.2:0/771048422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a41045c0 msgr2=0x7fd6a4104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.436+0000 7fd6a9200700 1 --2- 172.21.15.2:0/771048422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a41045c0 0x7fd6a4104a40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd6900099c0 tx=0x7fd690009cd0 comp rx=0 tx=0).stop 2024-06-13T02:16:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.436+0000 7fd6a9200700 1 -- 172.21.15.2:0/771048422 shutdown_connections 2024-06-13T02:16:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.436+0000 7fd6a9200700 1 --2- 172.21.15.2:0/771048422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a4104f80 0x7fd6a4111440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.436+0000 7fd6a9200700 1 --2- 172.21.15.2:0/771048422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6a410a670 0x7fd6a410aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.436+0000 7fd6a9200700 1 --2- 172.21.15.2:0/771048422 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a41045c0 0x7fd6a4104a40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.436+0000 7fd6a9200700 1 -- 172.21.15.2:0/771048422 >> 172.21.15.2:0/771048422 conn(0x7fd6a41000d0 msgr2=0x7fd6a41024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.436+0000 7fd6a9200700 1 -- 172.21.15.2:0/771048422 shutdown_connections 2024-06-13T02:16:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.436+0000 7fd6a9200700 1 -- 172.21.15.2:0/771048422 wait complete. 2024-06-13T02:16:04.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.437+0000 7fd6a9200700 1 Processor -- start 2024-06-13T02:16:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.438+0000 7fd6a9200700 1 -- start start 2024-06-13T02:16:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.438+0000 7fd6a9200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6a41045c0 0x7fd6a41a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.438+0000 7fd6a9200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a4104f80 0x7fd6a41a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.438+0000 7fd6a9200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a410a670 0x7fd6a419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.438+0000 7fd6a9200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4114910 con 0x7fd6a41045c0 2024-06-13T02:16:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.438+0000 7fd6a9200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4114790 con 0x7fd6a4104f80 2024-06-13T02:16:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.438+0000 7fd6a9200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4114a90 con 0x7fd6a410a670 2024-06-13T02:16:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.439+0000 7fd6a3400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6a41045c0 0x7fd6a41a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.439+0000 7fd6a3400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6a41045c0 0x7fd6a41a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43310/0 (socket says 172.21.15.2:43310) 2024-06-13T02:16:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.439+0000 7fd6a3400700 1 -- 172.21.15.2:0/3864718976 learned_addr learned my addr 172.21.15.2:0/3864718976 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.439+0000 7fd6a2a00700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a4104f80 0x7fd6a41a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.439+0000 7fd6a3e00700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a410a670 0x7fd6a419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:04.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.439+0000 7fd6a2a00700 1 -- 172.21.15.2:0/3864718976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a410a670 msgr2=0x7fd6a419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.439+0000 7fd6a2a00700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a410a670 0x7fd6a419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.439+0000 7fd6a2a00700 1 -- 172.21.15.2:0/3864718976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6a41045c0 msgr2=0x7fd6a41a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.439+0000 7fd6a2a00700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6a41045c0 0x7fd6a41a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.439+0000 7fd6a2a00700 1 -- 172.21.15.2:0/3864718976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a419b3f0 con 0x7fd6a4104f80 2024-06-13T02:16:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.439+0000 7fd6a3e00700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a410a670 0x7fd6a419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:16:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.439+0000 7fd6a3400700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6a41045c0 0x7fd6a41a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:16:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.440+0000 7fd6a2a00700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a4104f80 0x7fd6a41a0f80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd6900098e0 tx=0x7fd690003a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.440+0000 7fd69be00700 1 -- 172.21.15.2:0/3864718976 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690003680 con 0x7fd6a4104f80 2024-06-13T02:16:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.440+0000 7fd6a9200700 1 -- 172.21.15.2:0/3864718976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a419b680 con 0x7fd6a4104f80 2024-06-13T02:16:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.440+0000 7fd69be00700 1 -- 172.21.15.2:0/3864718976 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6900055a0 con 0x7fd6a4104f80 2024-06-13T02:16:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.440+0000 7fd69be00700 1 -- 172.21.15.2:0/3864718976 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69000fce0 con 0x7fd6a4104f80 2024-06-13T02:16:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.440+0000 7fd6a9200700 1 -- 172.21.15.2:0/3864718976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a41a79c0 con 0x7fd6a4104f80 2024-06-13T02:16:04.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.441+0000 7fd6a9200700 1 -- 172.21.15.2:0/3864718976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a419b9e0 con 0x7fd6a4104f80 2024-06-13T02:16:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.443+0000 7fd69be00700 1 -- 172.21.15.2:0/3864718976 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fd69000f460 con 0x7fd6a4104f80 2024-06-13T02:16:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.445+0000 7fd69be00700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd6880a2e40 0x7fd6880a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.445+0000 7fd69be00700 1 -- 172.21.15.2:0/3864718976 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fd6900d0200 con 0x7fd6a4104f80 2024-06-13T02:16:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.445+0000 7fd6a3400700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd6880a2e40 0x7fd6880a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.446+0000 7fd6a3400700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd6880a2e40 0x7fd6880a5300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd694011550 tx=0x7fd694009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.447+0000 7fd69be00700 1 -- 172.21.15.2:0/3864718976 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd690013070 con 0x7fd6a4104f80 2024-06-13T02:16:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.682+0000 7fd6a9200700 1 -- 172.21.15.2:0/3864718976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd6a4069180 con 0x7fd6a4104f80 2024-06-13T02:16:04.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.682+0000 7fd69be00700 1 -- 172.21.15.2:0/3864718976 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd69009cda0 con 0x7fd6a4104f80 2024-06-13T02:16:04.008 INFO:teuthology.orchestra.run.smithi002.stdout:34359738487 2024-06-13T02:16:04.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.685+0000 7fd6a9200700 1 -- 172.21.15.2:0/3864718976 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd6880a2e40 msgr2=0x7fd6880a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:04.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.685+0000 7fd6a9200700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd6880a2e40 0x7fd6880a5300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd694011550 tx=0x7fd694009260 comp rx=0 tx=0).stop 2024-06-13T02:16:04.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.685+0000 7fd6a9200700 1 -- 172.21.15.2:0/3864718976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a4104f80 msgr2=0x7fd6a41a0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:04.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.685+0000 7fd6a9200700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a4104f80 0x7fd6a41a0f80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd6900098e0 tx=0x7fd690003a90 comp rx=0 tx=0).stop 2024-06-13T02:16:04.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.686+0000 7fd6a9200700 1 -- 172.21.15.2:0/3864718976 shutdown_connections 2024-06-13T02:16:04.009 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:03 smithi002 ceph-mon[31960]: pgmap v439: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-13T02:16:04.009 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:03 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3864718976' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-13T02:16:04.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.686+0000 7fd6a9200700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd6880a2e40 0x7fd6880a5300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:04.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.686+0000 7fd6a9200700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a410a670 0x7fd6a419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:04.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.686+0000 7fd6a9200700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd6a41045c0 0x7fd6a41a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:04.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.686+0000 7fd6a9200700 1 --2- 172.21.15.2:0/3864718976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6a4104f80 0x7fd6a41a0f80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:04.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.686+0000 7fd6a9200700 1 -- 172.21.15.2:0/3864718976 >> 172.21.15.2:0/3864718976 conn(0x7fd6a41000d0 msgr2=0x7fd6a4101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:04.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.686+0000 7fd6a9200700 1 -- 172.21.15.2:0/3864718976 shutdown_connections 2024-06-13T02:16:04.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:03.687+0000 7fd6a9200700 1 -- 172.21.15.2:0/3864718976 wait complete. 2024-06-13T02:16:04.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:03 smithi175 ceph-mon[36977]: pgmap v439: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-13T02:16:04.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:03 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3864718976' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-13T02:16:04.744 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738479 got 34359738487 for osd.0 2024-06-13T02:16:04.744 DEBUG:teuthology.parallel:result is None 2024-06-13T02:16:05.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.437+0000 7f2f2d600700 1 -- 172.21.15.2:0/4160885465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f28102fb0 msgr2=0x7f2f28107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:05.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.437+0000 7f2f2d600700 1 --2- 172.21.15.2:0/4160885465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f28102fb0 0x7f2f28107000 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2f140099c0 tx=0x7f2f14009cd0 comp rx=0 tx=0).stop 2024-06-13T02:16:05.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.437+0000 7f2f2d600700 1 -- 172.21.15.2:0/4160885465 shutdown_connections 2024-06-13T02:16:05.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.437+0000 7f2f2d600700 1 --2- 172.21.15.2:0/4160885465 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f281076e0 0x7f2f2810f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:05.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.437+0000 7f2f2d600700 1 --2- 172.21.15.2:0/4160885465 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28102600 0x7f2f281029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:05.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.437+0000 7f2f2d600700 1 --2- 172.21.15.2:0/4160885465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f28102fb0 0x7f2f28107000 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:05.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.437+0000 7f2f2d600700 1 -- 172.21.15.2:0/4160885465 >> 172.21.15.2:0/4160885465 conn(0x7f2f280fdeb0 msgr2=0x7f2f281002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:05.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.437+0000 7f2f2d600700 1 -- 172.21.15.2:0/4160885465 shutdown_connections 2024-06-13T02:16:05.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.438+0000 7f2f2d600700 1 -- 172.21.15.2:0/4160885465 wait complete. 2024-06-13T02:16:05.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.439+0000 7f2f2d600700 1 Processor -- start 2024-06-13T02:16:05.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.439+0000 7f2f2d600700 1 -- start start 2024-06-13T02:16:05.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.439+0000 7f2f2d600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28102600 0x7f2f2819e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:05.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.439+0000 7f2f2d600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f28102fb0 0x7f2f2819edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:05.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.439+0000 7f2f2d600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f281076e0 0x7f2f28198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:05.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.439+0000 7f2f2d600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f281126f0 con 0x7f2f281076e0 2024-06-13T02:16:05.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.439+0000 7f2f2d600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2f28112570 con 0x7f2f28102600 2024-06-13T02:16:05.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.439+0000 7f2f2d600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2f28112870 con 0x7f2f28102fb0 2024-06-13T02:16:05.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.440+0000 7f2f27e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28102600 0x7f2f2819e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:05.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.440+0000 7f2f2cc00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f281076e0 0x7f2f28198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:05.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.440+0000 7f2f27e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28102600 0x7f2f2819e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:52750/0 (socket says 172.21.15.2:52750) 2024-06-13T02:16:05.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.440+0000 7f2f27e00700 1 -- 172.21.15.2:0/806453914 learned_addr learned my addr 172.21.15.2:0/806453914 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:05.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.440+0000 7f2f27400700 1 --2- 172.21.15.2:0/806453914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f28102fb0 0x7f2f2819edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:05.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.440+0000 7f2f27e00700 1 -- 172.21.15.2:0/806453914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f28102fb0 msgr2=0x7f2f2819edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:05.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.440+0000 7f2f27e00700 1 --2- 172.21.15.2:0/806453914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f28102fb0 0x7f2f2819edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:05.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.440+0000 7f2f27e00700 1 -- 172.21.15.2:0/806453914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f281076e0 msgr2=0x7f2f28198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:05.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.440+0000 7f2f27e00700 1 --2- 172.21.15.2:0/806453914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f281076e0 0x7f2f28198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:05.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.440+0000 7f2f27e00700 1 -- 172.21.15.2:0/806453914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f28199190 con 0x7f2f28102600 2024-06-13T02:16:05.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.440+0000 7f2f27e00700 1 --2- 172.21.15.2:0/806453914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28102600 0x7f2f2819e870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800e9a0 tx=0x7f2f1800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:05.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.441+0000 7f2f24c00700 1 -- 172.21.15.2:0/806453914 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800ca10 con 0x7f2f28102600 2024-06-13T02:16:05.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.441+0000 7f2f2d600700 1 -- 172.21.15.2:0/806453914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f28199480 con 0x7f2f28102600 2024-06-13T02:16:05.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.441+0000 7f2f24c00700 1 -- 172.21.15.2:0/806453914 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f1800cbb0 con 0x7f2f28102600 2024-06-13T02:16:05.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.441+0000 7f2f24c00700 1 -- 172.21.15.2:0/806453914 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18018680 con 0x7f2f28102600 2024-06-13T02:16:05.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.441+0000 7f2f2d600700 1 -- 172.21.15.2:0/806453914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f281a5740 con 0x7f2f28102600 2024-06-13T02:16:05.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.442+0000 7f2f2d600700 1 -- 172.21.15.2:0/806453914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f28069180 con 0x7f2f28102600 2024-06-13T02:16:05.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.444+0000 7f2f24c00700 1 -- 172.21.15.2:0/806453914 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f2f18010430 con 0x7f2f28102600 2024-06-13T02:16:05.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.445+0000 7f2f24c00700 1 --2- 172.21.15.2:0/806453914 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2f0c0a2ca0 0x7f2f0c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:05.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.446+0000 7f2f24c00700 1 -- 172.21.15.2:0/806453914 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f2f180cf610 con 0x7f2f28102600 2024-06-13T02:16:05.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.446+0000 7f2f27400700 1 --2- 172.21.15.2:0/806453914 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2f0c0a2ca0 0x7f2f0c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:05.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.447+0000 7f2f27400700 1 --2- 172.21.15.2:0/806453914 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2f0c0a2ca0 0x7f2f0c0a5160 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2f14000c00 tx=0x7f2f14005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:05.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.450+0000 7f2f24c00700 1 -- 172.21.15.2:0/806453914 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2f1809c120 con 0x7f2f28102600 2024-06-13T02:16:05.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.685+0000 7f2f2d600700 1 -- 172.21.15.2:0/806453914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2f2802dca0 con 0x7f2f28102600 2024-06-13T02:16:05.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.686+0000 7f2f24c00700 1 -- 172.21.15.2:0/806453914 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2f1809ba20 con 0x7f2f28102600 2024-06-13T02:16:05.688 INFO:teuthology.orchestra.run.smithi002.stdout:167503724636 2024-06-13T02:16:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.689+0000 7f2f2d600700 1 -- 172.21.15.2:0/806453914 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2f0c0a2ca0 msgr2=0x7f2f0c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.689+0000 7f2f2d600700 1 --2- 172.21.15.2:0/806453914 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2f0c0a2ca0 0x7f2f0c0a5160 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2f14000c00 tx=0x7f2f14005fb0 comp rx=0 tx=0).stop 2024-06-13T02:16:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.689+0000 7f2f2d600700 1 -- 172.21.15.2:0/806453914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28102600 msgr2=0x7f2f2819e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.689+0000 7f2f2d600700 1 --2- 172.21.15.2:0/806453914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28102600 0x7f2f2819e870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800e9a0 tx=0x7f2f1800ecb0 comp rx=0 tx=0).stop 2024-06-13T02:16:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.689+0000 7f2f2d600700 1 -- 172.21.15.2:0/806453914 shutdown_connections 2024-06-13T02:16:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.689+0000 7f2f2d600700 1 --2- 172.21.15.2:0/806453914 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2f0c0a2ca0 0x7f2f0c0a5160 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:05.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.689+0000 7f2f2d600700 1 --2- 172.21.15.2:0/806453914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f281076e0 0x7f2f28198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.689+0000 7f2f2d600700 1 --2- 172.21.15.2:0/806453914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28102600 0x7f2f2819e870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.689+0000 7f2f2d600700 1 --2- 172.21.15.2:0/806453914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f28102fb0 0x7f2f2819edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.689+0000 7f2f2d600700 1 -- 172.21.15.2:0/806453914 >> 172.21.15.2:0/806453914 conn(0x7f2f280fdeb0 msgr2=0x7f2f281001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.689+0000 7f2f2d600700 1 -- 172.21.15.2:0/806453914 shutdown_connections 2024-06-13T02:16:05.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:05.690+0000 7f2f2d600700 1 -- 172.21.15.2:0/806453914 wait complete. 2024-06-13T02:16:05.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:05 smithi084 ceph-mon[36833]: pgmap v440: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-13T02:16:05.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:05 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/806453914' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-13T02:16:06.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:05 smithi175 ceph-mon[36977]: pgmap v440: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-13T02:16:06.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:05 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/806453914' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-13T02:16:06.084 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:05 smithi002 ceph-mon[31960]: pgmap v440: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-13T02:16:06.085 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:05 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/806453914' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-13T02:16:06.493 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724631 got 167503724636 for osd.5 2024-06-13T02:16:06.493 DEBUG:teuthology.parallel:result is None 2024-06-13T02:16:06.493 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-13T02:16:06.494 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph pg dump --format=json 2024-06-13T02:16:06.985 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:16:07.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:07 smithi002 ceph-mon[31960]: pgmap v441: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-13T02:16:07.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:07 smithi084 ceph-mon[36833]: pgmap v441: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-13T02:16:08.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:07 smithi175 ceph-mon[36977]: pgmap v441: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-13T02:16:09.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.179+0000 7fecd0a00700 1 -- 172.21.15.2:0/2274239835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc10ca00 msgr2=0x7feccc10eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:09.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.179+0000 7fecd0a00700 1 --2- 172.21.15.2:0/2274239835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc10ca00 0x7feccc10eec0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fecc400b0a0 tx=0x7fecc400b3b0 comp rx=0 tx=0).stop 2024-06-13T02:16:09.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.179+0000 7fecd0a00700 1 -- 172.21.15.2:0/2274239835 shutdown_connections 2024-06-13T02:16:09.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.179+0000 7fecd0a00700 1 --2- 172.21.15.2:0/2274239835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc10ca00 0x7feccc10eec0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:09.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.179+0000 7fecd0a00700 1 --2- 172.21.15.2:0/2274239835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feccc1035d0 0x7feccc1039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:09.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.179+0000 7fecd0a00700 1 --2- 172.21.15.2:0/2274239835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feccc103ef0 0x7feccc10c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:09.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.179+0000 7fecd0a00700 1 -- 172.21.15.2:0/2274239835 >> 172.21.15.2:0/2274239835 conn(0x7feccc0fce20 msgr2=0x7feccc0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:09.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.179+0000 7fecd0a00700 1 -- 172.21.15.2:0/2274239835 shutdown_connections 2024-06-13T02:16:09.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.180+0000 7fecd0a00700 1 -- 172.21.15.2:0/2274239835 wait complete. 2024-06-13T02:16:09.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.181+0000 7fecd0a00700 1 Processor -- start 2024-06-13T02:16:09.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.181+0000 7fecd0a00700 1 -- start start 2024-06-13T02:16:09.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.181+0000 7fecd0a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feccc1035d0 0x7feccc19ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:09.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.181+0000 7fecd0a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feccc103ef0 0x7feccc19b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:09.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.181+0000 7fecd0a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc10ca00 0x7feccc19f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:09.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.181+0000 7fecd0a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7feccc112750 con 0x7feccc10ca00 2024-06-13T02:16:09.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.181+0000 7fecd0a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1125d0 con 0x7feccc1035d0 2024-06-13T02:16:09.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.181+0000 7fecd0a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feccc1128d0 con 0x7feccc103ef0 2024-06-13T02:16:09.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.182+0000 7fecc9e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feccc103ef0 0x7feccc19b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:09.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.182+0000 7fecc9e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feccc103ef0 0x7feccc19b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:48492/0 (socket says 172.21.15.2:48492) 2024-06-13T02:16:09.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.182+0000 7fecc9e00700 1 -- 172.21.15.2:0/245133112 learned_addr learned my addr 172.21.15.2:0/245133112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:09.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.182+0000 7fecca800700 1 --2- 172.21.15.2:0/245133112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feccc1035d0 0x7feccc19ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:09.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.182+0000 7feccb200700 1 --2- 172.21.15.2:0/245133112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc10ca00 0x7feccc19f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:09.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.182+0000 7fecc9e00700 1 -- 172.21.15.2:0/245133112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feccc1035d0 msgr2=0x7feccc19ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:09.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.182+0000 7fecc9e00700 1 --2- 172.21.15.2:0/245133112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feccc1035d0 0x7feccc19ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:09.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.182+0000 7fecc9e00700 1 -- 172.21.15.2:0/245133112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc10ca00 msgr2=0x7feccc19f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:09.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.182+0000 7fecc9e00700 1 --2- 172.21.15.2:0/245133112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc10ca00 0x7feccc19f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:09.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.182+0000 7fecc9e00700 1 -- 172.21.15.2:0/245133112 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc19fd40 con 0x7feccc103ef0 2024-06-13T02:16:09.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.182+0000 7fecc9e00700 1 --2- 172.21.15.2:0/245133112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feccc103ef0 0x7feccc19b270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00e9c0 tx=0x7fecbc00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:09.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.183+0000 7fecc3400700 1 -- 172.21.15.2:0/245133112 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc004a30 con 0x7feccc103ef0 2024-06-13T02:16:09.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.183+0000 7fecc3400700 1 -- 172.21.15.2:0/245133112 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecbc00cca0 con 0x7feccc103ef0 2024-06-13T02:16:09.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.183+0000 7fecc3400700 1 -- 172.21.15.2:0/245133112 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc005610 con 0x7feccc103ef0 2024-06-13T02:16:09.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.183+0000 7fecd0a00700 1 -- 172.21.15.2:0/245133112 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feccc1a0030 con 0x7feccc103ef0 2024-06-13T02:16:09.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.183+0000 7fecd0a00700 1 -- 172.21.15.2:0/245133112 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feccc1a78b0 con 0x7feccc103ef0 2024-06-13T02:16:09.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.184+0000 7fecd0a00700 1 -- 172.21.15.2:0/245133112 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feccc069180 con 0x7feccc103ef0 2024-06-13T02:16:09.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.186+0000 7fecc3400700 1 -- 172.21.15.2:0/245133112 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fecbc00c7c0 con 0x7feccc103ef0 2024-06-13T02:16:09.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.187+0000 7fecc3400700 1 --2- 172.21.15.2:0/245133112 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fecb00a2c20 0x7fecb00a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:09.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.188+0000 7fecc3400700 1 -- 172.21.15.2:0/245133112 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fecbc0cf500 con 0x7feccc103ef0 2024-06-13T02:16:09.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.188+0000 7fecca800700 1 --2- 172.21.15.2:0/245133112 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fecb00a2c20 0x7fecb00a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:09.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.188+0000 7fecca800700 1 --2- 172.21.15.2:0/245133112 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fecb00a2c20 0x7fecb00a50e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009c60 tx=0x7fecb4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:09.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.192+0000 7fecc3400700 1 -- 172.21.15.2:0/245133112 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fecbc09c010 con 0x7feccc103ef0 2024-06-13T02:16:09.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.418+0000 7fecd0a00700 1 -- 172.21.15.2:0/245133112 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feccc0628d0 con 0x7fecb00a2c20 2024-06-13T02:16:09.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.447+0000 7fecc3400700 1 -- 172.21.15.2:0/245133112 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340691 (secure 0 0 0) 0x7feccc0628d0 con 0x7fecb00a2c20 2024-06-13T02:16:09.455 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:16:09.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.454+0000 7fecd0a00700 1 -- 172.21.15.2:0/245133112 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fecb00a2c20 msgr2=0x7fecb00a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:09.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.454+0000 7fecd0a00700 1 --2- 172.21.15.2:0/245133112 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fecb00a2c20 0x7fecb00a50e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009c60 tx=0x7fecb4009260 comp rx=0 tx=0).stop 2024-06-13T02:16:09.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.454+0000 7fecd0a00700 1 -- 172.21.15.2:0/245133112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feccc103ef0 msgr2=0x7feccc19b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:09.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.454+0000 7fecd0a00700 1 --2- 172.21.15.2:0/245133112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feccc103ef0 0x7feccc19b270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00e9c0 tx=0x7fecbc00ecd0 comp rx=0 tx=0).stop 2024-06-13T02:16:09.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.454+0000 7fecd0a00700 1 -- 172.21.15.2:0/245133112 shutdown_connections 2024-06-13T02:16:09.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.454+0000 7fecd0a00700 1 --2- 172.21.15.2:0/245133112 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fecb00a2c20 0x7fecb00a50e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:09.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.454+0000 7fecd0a00700 1 --2- 172.21.15.2:0/245133112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feccc10ca00 0x7feccc19f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:09.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.454+0000 7fecd0a00700 1 --2- 172.21.15.2:0/245133112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feccc1035d0 0x7feccc19ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:09.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.454+0000 7fecd0a00700 1 --2- 172.21.15.2:0/245133112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feccc103ef0 0x7feccc19b270 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:09.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.454+0000 7fecd0a00700 1 -- 172.21.15.2:0/245133112 >> 172.21.15.2:0/245133112 conn(0x7feccc0fce20 msgr2=0x7feccc0fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:09.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.455+0000 7fecd0a00700 1 -- 172.21.15.2:0/245133112 shutdown_connections 2024-06-13T02:16:09.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:09.455+0000 7fecd0a00700 1 -- 172.21.15.2:0/245133112 wait complete. 2024-06-13T02:16:09.459 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-06-13T02:16:09.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:09 smithi084 ceph-mon[36833]: pgmap v442: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T02:16:10.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:09 smithi175 ceph-mon[36977]: pgmap v442: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T02:16:10.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:09 smithi002 ceph-mon[31960]: pgmap v442: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T02:16:10.361 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2024-06-13T02:16:08.526837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658519,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":866,"num_read_kb":557,"num_write":359,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":788,"ondisk_log_size":788,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377168,"kb_used_data":15536,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124564656,"statfs":{"total":1151940427776,"available":1151554207744,"internally_reserved":0,"allocated":15908864,"data_stored":8828603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005036"},"pg_stats":[{"pgid":"3.3f","version":"100'8","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.471848+0000","last_change":"2024-06-13T02:12:40.307929+0000","last_active":"2024-06-13T02:15:54.471848+0000","last_peered":"2024-06-13T02:15:54.471848+0000","last_clean":"2024-06-13T02:15:54.471848+0000","last_became_active":"2024-06-13T02:12:40.307353+0000","last_became_peered":"2024-06-13T02:12:40.307353+0000","last_unstale":"2024-06-13T02:15:54.471848+0000","last_undegraded":"2024-06-13T02:15:54.471848+0000","last_fullsized":"2024-06-13T02:15:54.471848+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:43:19.850829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"100'4","reported_seq":43,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.473403+0000","last_change":"2024-06-13T02:12:40.304715+0000","last_active":"2024-06-13T02:15:54.473403+0000","last_peered":"2024-06-13T02:15:54.473403+0000","last_clean":"2024-06-13T02:15:54.473403+0000","last_became_active":"2024-06-13T02:12:40.304216+0000","last_became_peered":"2024-06-13T02:12:40.304216+0000","last_unstale":"2024-06-13T02:15:54.473403+0000","last_undegraded":"2024-06-13T02:15:54.473403+0000","last_fullsized":"2024-06-13T02:15:54.473403+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:39:02.340749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.467766+0000","last_change":"2024-06-13T02:12:40.303576+0000","last_active":"2024-06-13T02:15:54.467766+0000","last_peered":"2024-06-13T02:15:54.467766+0000","last_clean":"2024-06-13T02:15:54.467766+0000","last_became_active":"2024-06-13T02:12:40.303225+0000","last_became_peered":"2024-06-13T02:12:40.303225+0000","last_unstale":"2024-06-13T02:15:54.467766+0000","last_undegraded":"2024-06-13T02:15:54.467766+0000","last_fullsized":"2024-06-13T02:15:54.467766+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:54:17.144856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"100'8","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.437110+0000","last_change":"2024-06-13T02:12:40.298405+0000","last_active":"2024-06-13T02:15:54.437110+0000","last_peered":"2024-06-13T02:15:54.437110+0000","last_clean":"2024-06-13T02:15:54.437110+0000","last_became_active":"2024-06-13T02:12:40.297742+0000","last_became_peered":"2024-06-13T02:12:40.297742+0000","last_unstale":"2024-06-13T02:15:54.437110+0000","last_undegraded":"2024-06-13T02:15:54.437110+0000","last_fullsized":"2024-06-13T02:15:54.437110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:23:12.417602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"100'4","reported_seq":43,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.446732+0000","last_change":"2024-06-13T02:12:40.318679+0000","last_active":"2024-06-13T02:15:54.446732+0000","last_peered":"2024-06-13T02:15:54.446732+0000","last_clean":"2024-06-13T02:15:54.446732+0000","last_became_active":"2024-06-13T02:12:40.318313+0000","last_became_peered":"2024-06-13T02:12:40.318313+0000","last_unstale":"2024-06-13T02:15:54.446732+0000","last_undegraded":"2024-06-13T02:15:54.446732+0000","last_fullsized":"2024-06-13T02:15:54.446732+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:36:30.580012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"100'6","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.454623+0000","last_change":"2024-06-13T02:13:25.537913+0000","last_active":"2024-06-13T02:15:54.454623+0000","last_peered":"2024-06-13T02:15:54.454623+0000","last_clean":"2024-06-13T02:15:54.454623+0000","last_became_active":"2024-06-13T02:13:25.537509+0000","last_became_peered":"2024-06-13T02:13:25.537509+0000","last_unstale":"2024-06-13T02:15:54.454623+0000","last_undegraded":"2024-06-13T02:15:54.454623+0000","last_fullsized":"2024-06-13T02:15:54.454623+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:54:04.905051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"100'5","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.455319+0000","last_change":"2024-06-13T02:12:40.304737+0000","last_active":"2024-06-13T02:15:54.455319+0000","last_peered":"2024-06-13T02:15:54.455319+0000","last_clean":"2024-06-13T02:15:54.455319+0000","last_became_active":"2024-06-13T02:12:40.304239+0000","last_became_peered":"2024-06-13T02:12:40.304239+0000","last_unstale":"2024-06-13T02:15:54.455319+0000","last_undegraded":"2024-06-13T02:15:54.455319+0000","last_fullsized":"2024-06-13T02:15:54.455319+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:09:23.403816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"100'9","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.461597+0000","last_change":"2024-06-13T02:12:40.317542+0000","last_active":"2024-06-13T02:15:54.461597+0000","last_peered":"2024-06-13T02:15:54.461597+0000","last_clean":"2024-06-13T02:15:54.461597+0000","last_became_active":"2024-06-13T02:12:40.317140+0000","last_became_peered":"2024-06-13T02:12:40.317140+0000","last_unstale":"2024-06-13T02:15:54.461597+0000","last_undegraded":"2024-06-13T02:15:54.461597+0000","last_fullsized":"2024-06-13T02:15:54.461597+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:01:19.812336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"100'11","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.449773+0000","last_change":"2024-06-13T02:12:40.295445+0000","last_active":"2024-06-13T02:15:54.449773+0000","last_peered":"2024-06-13T02:15:54.449773+0000","last_clean":"2024-06-13T02:15:54.449773+0000","last_became_active":"2024-06-13T02:12:40.293498+0000","last_became_peered":"2024-06-13T02:12:40.293498+0000","last_unstale":"2024-06-13T02:15:54.449773+0000","last_undegraded":"2024-06-13T02:15:54.449773+0000","last_fullsized":"2024-06-13T02:15:54.449773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:43:48.487157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"100'16","reported_seq":55,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.441734+0000","last_change":"2024-06-13T02:12:40.294665+0000","last_active":"2024-06-13T02:15:54.441734+0000","last_peered":"2024-06-13T02:15:54.441734+0000","last_clean":"2024-06-13T02:15:54.441734+0000","last_became_active":"2024-06-13T02:12:40.294339+0000","last_became_peered":"2024-06-13T02:12:40.294339+0000","last_unstale":"2024-06-13T02:15:54.441734+0000","last_undegraded":"2024-06-13T02:15:54.441734+0000","last_fullsized":"2024-06-13T02:15:54.441734+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:15:58.703675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"100'6","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448626+0000","last_change":"2024-06-13T02:12:40.294867+0000","last_active":"2024-06-13T02:15:54.448626+0000","last_peered":"2024-06-13T02:15:54.448626+0000","last_clean":"2024-06-13T02:15:54.448626+0000","last_became_active":"2024-06-13T02:12:40.293665+0000","last_became_peered":"2024-06-13T02:12:40.293665+0000","last_unstale":"2024-06-13T02:15:54.448626+0000","last_undegraded":"2024-06-13T02:15:54.448626+0000","last_fullsized":"2024-06-13T02:15:54.448626+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:52:02.171738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.427834+0000","last_change":"2024-06-13T02:12:40.296253+0000","last_active":"2024-06-13T02:15:54.427834+0000","last_peered":"2024-06-13T02:15:54.427834+0000","last_clean":"2024-06-13T02:15:54.427834+0000","last_became_active":"2024-06-13T02:12:40.295932+0000","last_became_peered":"2024-06-13T02:12:40.295932+0000","last_unstale":"2024-06-13T02:15:54.427834+0000","last_undegraded":"2024-06-13T02:15:54.427834+0000","last_fullsized":"2024-06-13T02:15:54.427834+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:41:07.044402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"100'10","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.457758+0000","last_change":"2024-06-13T02:12:40.288976+0000","last_active":"2024-06-13T02:15:54.457758+0000","last_peered":"2024-06-13T02:15:54.457758+0000","last_clean":"2024-06-13T02:15:54.457758+0000","last_became_active":"2024-06-13T02:12:40.288629+0000","last_became_peered":"2024-06-13T02:12:40.288629+0000","last_unstale":"2024-06-13T02:15:54.457758+0000","last_undegraded":"2024-06-13T02:15:54.457758+0000","last_fullsized":"2024-06-13T02:15:54.457758+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:10:49.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.469822+0000","last_change":"2024-06-13T02:12:40.304020+0000","last_active":"2024-06-13T02:15:54.469822+0000","last_peered":"2024-06-13T02:15:54.469822+0000","last_clean":"2024-06-13T02:15:54.469822+0000","last_became_active":"2024-06-13T02:12:40.303671+0000","last_became_peered":"2024-06-13T02:12:40.303671+0000","last_unstale":"2024-06-13T02:15:54.469822+0000","last_undegraded":"2024-06-13T02:15:54.469822+0000","last_fullsized":"2024-06-13T02:15:54.469822+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:28:15.907085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.473383+0000","last_change":"2024-06-13T02:12:40.309501+0000","last_active":"2024-06-13T02:15:54.473383+0000","last_peered":"2024-06-13T02:15:54.473383+0000","last_clean":"2024-06-13T02:15:54.473383+0000","last_became_active":"2024-06-13T02:12:40.304938+0000","last_became_peered":"2024-06-13T02:12:40.304938+0000","last_unstale":"2024-06-13T02:15:54.473383+0000","last_undegraded":"2024-06-13T02:15:54.473383+0000","last_fullsized":"2024-06-13T02:15:54.473383+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:59:56.164448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"100'9","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.458896+0000","last_change":"2024-06-13T02:12:40.306574+0000","last_active":"2024-06-13T02:15:54.458896+0000","last_peered":"2024-06-13T02:15:54.458896+0000","last_clean":"2024-06-13T02:15:54.458896+0000","last_became_active":"2024-06-13T02:12:40.306227+0000","last_became_peered":"2024-06-13T02:12:40.306227+0000","last_unstale":"2024-06-13T02:15:54.458896+0000","last_undegraded":"2024-06-13T02:15:54.458896+0000","last_fullsized":"2024-06-13T02:15:54.458896+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:55:23.456256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"100'8","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.472149+0000","last_change":"2024-06-13T02:12:40.308291+0000","last_active":"2024-06-13T02:15:54.472149+0000","last_peered":"2024-06-13T02:15:54.472149+0000","last_clean":"2024-06-13T02:15:54.472149+0000","last_became_active":"2024-06-13T02:12:40.307626+0000","last_became_peered":"2024-06-13T02:12:40.307626+0000","last_unstale":"2024-06-13T02:15:54.472149+0000","last_undegraded":"2024-06-13T02:15:54.472149+0000","last_fullsized":"2024-06-13T02:15:54.472149+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:16:47.025364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"100'10","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.453755+0000","last_change":"2024-06-13T02:12:40.308249+0000","last_active":"2024-06-13T02:15:54.453755+0000","last_peered":"2024-06-13T02:15:54.453755+0000","last_clean":"2024-06-13T02:15:54.453755+0000","last_became_active":"2024-06-13T02:12:40.303871+0000","last_became_peered":"2024-06-13T02:12:40.303871+0000","last_unstale":"2024-06-13T02:15:54.453755+0000","last_undegraded":"2024-06-13T02:15:54.453755+0000","last_fullsized":"2024-06-13T02:15:54.453755+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:27:05.852927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.458445+0000","last_change":"2024-06-13T02:12:40.320970+0000","last_active":"2024-06-13T02:15:54.458445+0000","last_peered":"2024-06-13T02:15:54.458445+0000","last_clean":"2024-06-13T02:15:54.458445+0000","last_became_active":"2024-06-13T02:12:40.320537+0000","last_became_peered":"2024-06-13T02:12:40.320537+0000","last_unstale":"2024-06-13T02:15:54.458445+0000","last_undegraded":"2024-06-13T02:15:54.458445+0000","last_fullsized":"2024-06-13T02:15:54.458445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:39:44.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719589+0000","last_change":"2024-06-13T02:12:54.594504+0000","last_active":"2024-06-13T02:14:25.719589+0000","last_peered":"2024-06-13T02:14:25.719589+0000","last_clean":"2024-06-13T02:14:25.719589+0000","last_became_active":"2024-06-13T02:12:54.594083+0000","last_became_peered":"2024-06-13T02:12:54.594083+0000","last_unstale":"2024-06-13T02:14:25.719589+0000","last_undegraded":"2024-06-13T02:14:25.719589+0000","last_fullsized":"2024-06-13T02:14:25.719589+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:40:11.592477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"98'9","reported_seq":55,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720880+0000","last_change":"2024-06-13T02:12:35.820414+0000","last_active":"2024-06-13T02:14:25.720880+0000","last_peered":"2024-06-13T02:14:25.720880+0000","last_clean":"2024-06-13T02:14:25.720880+0000","last_became_active":"2024-06-13T02:12:35.819320+0000","last_became_peered":"2024-06-13T02:12:35.819320+0000","last_unstale":"2024-06-13T02:14:25.720880+0000","last_undegraded":"2024-06-13T02:14:25.720880+0000","last_fullsized":"2024-06-13T02:14:25.720880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:02:44.226482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"100'5","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.441976+0000","last_change":"2024-06-13T02:12:40.317221+0000","last_active":"2024-06-13T02:15:54.441976+0000","last_peered":"2024-06-13T02:15:54.441976+0000","last_clean":"2024-06-13T02:15:54.441976+0000","last_became_active":"2024-06-13T02:12:40.315069+0000","last_became_peered":"2024-06-13T02:12:40.315069+0000","last_unstale":"2024-06-13T02:15:54.441976+0000","last_undegraded":"2024-06-13T02:15:54.441976+0000","last_fullsized":"2024-06-13T02:15:54.441976+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:44:36.577914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740631+0000","last_change":"2024-06-13T02:12:54.600490+0000","last_active":"2024-06-13T02:14:25.740631+0000","last_peered":"2024-06-13T02:14:25.740631+0000","last_clean":"2024-06-13T02:14:25.740631+0000","last_became_active":"2024-06-13T02:12:54.600192+0000","last_became_peered":"2024-06-13T02:12:54.600192+0000","last_unstale":"2024-06-13T02:14:25.740631+0000","last_undegraded":"2024-06-13T02:14:25.740631+0000","last_fullsized":"2024-06-13T02:14:25.740631+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:46:10.782977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"98'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.741163+0000","last_change":"2024-06-13T02:12:36.306113+0000","last_active":"2024-06-13T02:14:26.741163+0000","last_peered":"2024-06-13T02:14:26.741163+0000","last_clean":"2024-06-13T02:14:26.741163+0000","last_became_active":"2024-06-13T02:12:36.298787+0000","last_became_peered":"2024-06-13T02:12:36.298787+0000","last_unstale":"2024-06-13T02:14:26.741163+0000","last_undegraded":"2024-06-13T02:14:26.741163+0000","last_fullsized":"2024-06-13T02:14:26.741163+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:29:00.902574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"100'6","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.474292+0000","last_change":"2024-06-13T02:12:40.314925+0000","last_active":"2024-06-13T02:15:54.474292+0000","last_peered":"2024-06-13T02:15:54.474292+0000","last_clean":"2024-06-13T02:15:54.474292+0000","last_became_active":"2024-06-13T02:12:40.312668+0000","last_became_peered":"2024-06-13T02:12:40.312668+0000","last_unstale":"2024-06-13T02:15:54.474292+0000","last_undegraded":"2024-06-13T02:15:54.474292+0000","last_fullsized":"2024-06-13T02:15:54.474292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:47:42.896414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740226+0000","last_change":"2024-06-13T02:12:54.593653+0000","last_active":"2024-06-13T02:14:25.740226+0000","last_peered":"2024-06-13T02:14:25.740226+0000","last_clean":"2024-06-13T02:14:25.740226+0000","last_became_active":"2024-06-13T02:12:54.593250+0000","last_became_peered":"2024-06-13T02:12:54.593250+0000","last_unstale":"2024-06-13T02:14:25.740226+0000","last_undegraded":"2024-06-13T02:14:25.740226+0000","last_fullsized":"2024-06-13T02:14:25.740226+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:29:45.233850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"98'4","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716043+0000","last_change":"2024-06-13T02:12:35.809925+0000","last_active":"2024-06-13T02:14:25.716043+0000","last_peered":"2024-06-13T02:14:25.716043+0000","last_clean":"2024-06-13T02:14:25.716043+0000","last_became_active":"2024-06-13T02:12:35.809536+0000","last_became_peered":"2024-06-13T02:12:35.809536+0000","last_unstale":"2024-06-13T02:14:25.716043+0000","last_undegraded":"2024-06-13T02:14:25.716043+0000","last_fullsized":"2024-06-13T02:14:25.716043+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:41:46.322004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"100'9","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.451762+0000","last_change":"2024-06-13T02:12:40.299911+0000","last_active":"2024-06-13T02:15:54.451762+0000","last_peered":"2024-06-13T02:15:54.451762+0000","last_clean":"2024-06-13T02:15:54.451762+0000","last_became_active":"2024-06-13T02:12:40.298762+0000","last_became_peered":"2024-06-13T02:12:40.298762+0000","last_unstale":"2024-06-13T02:15:54.451762+0000","last_undegraded":"2024-06-13T02:15:54.451762+0000","last_fullsized":"2024-06-13T02:15:54.451762+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:52:43.996050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740162+0000","last_change":"2024-06-13T02:12:54.602831+0000","last_active":"2024-06-13T02:14:25.740162+0000","last_peered":"2024-06-13T02:14:25.740162+0000","last_clean":"2024-06-13T02:14:25.740162+0000","last_became_active":"2024-06-13T02:12:54.602406+0000","last_became_peered":"2024-06-13T02:12:54.602406+0000","last_unstale":"2024-06-13T02:14:25.740162+0000","last_undegraded":"2024-06-13T02:14:25.740162+0000","last_fullsized":"2024-06-13T02:14:25.740162+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:01:02.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715757+0000","last_change":"2024-06-13T02:12:35.808961+0000","last_active":"2024-06-13T02:14:25.715757+0000","last_peered":"2024-06-13T02:14:25.715757+0000","last_clean":"2024-06-13T02:14:25.715757+0000","last_became_active":"2024-06-13T02:12:35.808277+0000","last_became_peered":"2024-06-13T02:12:35.808277+0000","last_unstale":"2024-06-13T02:14:25.715757+0000","last_undegraded":"2024-06-13T02:14:25.715757+0000","last_fullsized":"2024-06-13T02:14:25.715757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:38:54.356186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"100'15","reported_seq":54,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.445780+0000","last_change":"2024-06-13T02:12:40.295392+0000","last_active":"2024-06-13T02:15:54.445780+0000","last_peered":"2024-06-13T02:15:54.445780+0000","last_clean":"2024-06-13T02:15:54.445780+0000","last_became_active":"2024-06-13T02:12:40.295052+0000","last_became_peered":"2024-06-13T02:12:40.295052+0000","last_unstale":"2024-06-13T02:15:54.445780+0000","last_undegraded":"2024-06-13T02:15:54.445780+0000","last_fullsized":"2024-06-13T02:15:54.445780+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:12:38.728062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719337+0000","last_change":"2024-06-13T02:12:54.582150+0000","last_active":"2024-06-13T02:14:25.719337+0000","last_peered":"2024-06-13T02:14:25.719337+0000","last_clean":"2024-06-13T02:14:25.719337+0000","last_became_active":"2024-06-13T02:12:54.581734+0000","last_became_peered":"2024-06-13T02:12:54.581734+0000","last_unstale":"2024-06-13T02:14:25.719337+0000","last_undegraded":"2024-06-13T02:14:25.719337+0000","last_fullsized":"2024-06-13T02:14:25.719337+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:34:28.143198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"98'5","reported_seq":171,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:16:06.783027+0000","last_change":"2024-06-13T02:12:35.810286+0000","last_active":"2024-06-13T02:16:06.783027+0000","last_peered":"2024-06-13T02:16:06.783027+0000","last_clean":"2024-06-13T02:16:06.783027+0000","last_became_active":"2024-06-13T02:12:35.809910+0000","last_became_peered":"2024-06-13T02:12:35.809910+0000","last_unstale":"2024-06-13T02:16:06.783027+0000","last_undegraded":"2024-06-13T02:16:06.783027+0000","last_fullsized":"2024-06-13T02:16:06.783027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:09:10.438115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"100'7","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.447557+0000","last_change":"2024-06-13T02:13:25.643735+0000","last_active":"2024-06-13T02:15:54.447557+0000","last_peered":"2024-06-13T02:15:54.447557+0000","last_clean":"2024-06-13T02:15:54.447557+0000","last_became_active":"2024-06-13T02:13:25.643406+0000","last_became_peered":"2024-06-13T02:13:25.643406+0000","last_unstale":"2024-06-13T02:15:54.447557+0000","last_undegraded":"2024-06-13T02:15:54.447557+0000","last_fullsized":"2024-06-13T02:15:54.447557+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:20:17.267712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.477220+0000","last_change":"2024-06-13T02:14:26.476695+0000","last_active":"2024-06-13T02:14:26.477220+0000","last_peered":"2024-06-13T02:14:26.477220+0000","last_clean":"2024-06-13T02:14:26.477220+0000","last_became_active":"2024-06-13T02:14:26.476129+0000","last_became_peered":"2024-06-13T02:14:26.476129+0000","last_unstale":"2024-06-13T02:14:26.477220+0000","last_undegraded":"2024-06-13T02:14:26.477220+0000","last_fullsized":"2024-06-13T02:14:26.477220+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:00:39.577682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,10,5],"acting":[2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"98'3","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.107556+0000","last_change":"2024-06-13T02:12:35.817613+0000","last_active":"2024-06-13T02:14:26.107556+0000","last_peered":"2024-06-13T02:14:26.107556+0000","last_clean":"2024-06-13T02:14:26.107556+0000","last_became_active":"2024-06-13T02:12:35.817217+0000","last_became_peered":"2024-06-13T02:12:35.817217+0000","last_unstale":"2024-06-13T02:14:26.107556+0000","last_undegraded":"2024-06-13T02:14:26.107556+0000","last_fullsized":"2024-06-13T02:14:26.107556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:40:06.195493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"100'8","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.442541+0000","last_change":"2024-06-13T02:13:25.538088+0000","last_active":"2024-06-13T02:15:54.442541+0000","last_peered":"2024-06-13T02:15:54.442541+0000","last_clean":"2024-06-13T02:15:54.442541+0000","last_became_active":"2024-06-13T02:13:25.537693+0000","last_became_peered":"2024-06-13T02:13:25.537693+0000","last_unstale":"2024-06-13T02:15:54.442541+0000","last_undegraded":"2024-06-13T02:15:54.442541+0000","last_fullsized":"2024-06-13T02:15:54.442541+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:52:59.032383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.742782+0000","last_change":"2024-06-13T02:14:25.742320+0000","last_active":"2024-06-13T02:14:25.742782+0000","last_peered":"2024-06-13T02:14:25.742782+0000","last_clean":"2024-06-13T02:14:25.742782+0000","last_became_active":"2024-06-13T02:14:25.741736+0000","last_became_peered":"2024-06-13T02:14:25.741736+0000","last_unstale":"2024-06-13T02:14:25.742782+0000","last_undegraded":"2024-06-13T02:14:25.742782+0000","last_fullsized":"2024-06-13T02:14:25.742782+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:16:53.587795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"98'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.718292+0000","last_change":"2024-06-13T02:12:35.824235+0000","last_active":"2024-06-13T02:14:25.718292+0000","last_peered":"2024-06-13T02:14:25.718292+0000","last_clean":"2024-06-13T02:14:25.718292+0000","last_became_active":"2024-06-13T02:12:35.821506+0000","last_became_peered":"2024-06-13T02:12:35.821506+0000","last_unstale":"2024-06-13T02:14:25.718292+0000","last_undegraded":"2024-06-13T02:14:25.718292+0000","last_fullsized":"2024-06-13T02:14:25.718292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:58:39.808001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"100'8","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.461451+0000","last_change":"2024-06-13T02:12:40.324580+0000","last_active":"2024-06-13T02:15:54.461451+0000","last_peered":"2024-06-13T02:15:54.461451+0000","last_clean":"2024-06-13T02:15:54.461451+0000","last_became_active":"2024-06-13T02:12:40.323791+0000","last_became_peered":"2024-06-13T02:12:40.323791+0000","last_unstale":"2024-06-13T02:15:54.461451+0000","last_undegraded":"2024-06-13T02:15:54.461451+0000","last_fullsized":"2024-06-13T02:15:54.461451+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:29:14.169270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716794+0000","last_change":"2024-06-13T02:12:54.602305+0000","last_active":"2024-06-13T02:14:25.716794+0000","last_peered":"2024-06-13T02:14:25.716794+0000","last_clean":"2024-06-13T02:14:25.716794+0000","last_became_active":"2024-06-13T02:12:54.601787+0000","last_became_peered":"2024-06-13T02:12:54.601787+0000","last_unstale":"2024-06-13T02:14:25.716794+0000","last_undegraded":"2024-06-13T02:14:25.716794+0000","last_fullsized":"2024-06-13T02:14:25.716794+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:16:34.970026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"98'1","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.474856+0000","last_change":"2024-06-13T02:12:35.808845+0000","last_active":"2024-06-13T02:14:26.474856+0000","last_peered":"2024-06-13T02:14:26.474856+0000","last_clean":"2024-06-13T02:14:26.474856+0000","last_became_active":"2024-06-13T02:12:35.808497+0000","last_became_peered":"2024-06-13T02:12:35.808497+0000","last_unstale":"2024-06-13T02:14:26.474856+0000","last_undegraded":"2024-06-13T02:14:26.474856+0000","last_fullsized":"2024-06-13T02:14:26.474856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:41:00.577762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"100'11","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.460671+0000","last_change":"2024-06-13T02:12:40.322308+0000","last_active":"2024-06-13T02:15:54.460671+0000","last_peered":"2024-06-13T02:15:54.460671+0000","last_clean":"2024-06-13T02:15:54.460671+0000","last_became_active":"2024-06-13T02:12:40.321152+0000","last_became_peered":"2024-06-13T02:12:40.321152+0000","last_unstale":"2024-06-13T02:15:54.460671+0000","last_undegraded":"2024-06-13T02:15:54.460671+0000","last_fullsized":"2024-06-13T02:15:54.460671+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:50:15.740442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739243+0000","last_change":"2024-06-13T02:12:54.580648+0000","last_active":"2024-06-13T02:14:26.739243+0000","last_peered":"2024-06-13T02:14:26.739243+0000","last_clean":"2024-06-13T02:14:26.739243+0000","last_became_active":"2024-06-13T02:12:54.580207+0000","last_became_peered":"2024-06-13T02:12:54.580207+0000","last_unstale":"2024-06-13T02:14:26.739243+0000","last_undegraded":"2024-06-13T02:14:26.739243+0000","last_fullsized":"2024-06-13T02:14:26.739243+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:19:58.241236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"98'3","reported_seq":165,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:16:04.779598+0000","last_change":"2024-06-13T02:12:35.818195+0000","last_active":"2024-06-13T02:16:04.779598+0000","last_peered":"2024-06-13T02:16:04.779598+0000","last_clean":"2024-06-13T02:16:04.779598+0000","last_became_active":"2024-06-13T02:12:35.817707+0000","last_became_peered":"2024-06-13T02:12:35.817707+0000","last_unstale":"2024-06-13T02:16:04.779598+0000","last_undegraded":"2024-06-13T02:16:04.779598+0000","last_fullsized":"2024-06-13T02:16:04.779598+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:24:34.940115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"100'10","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.453726+0000","last_change":"2024-06-13T02:12:40.306423+0000","last_active":"2024-06-13T02:15:54.453726+0000","last_peered":"2024-06-13T02:15:54.453726+0000","last_clean":"2024-06-13T02:15:54.453726+0000","last_became_active":"2024-06-13T02:12:40.306064+0000","last_became_peered":"2024-06-13T02:12:40.306064+0000","last_unstale":"2024-06-13T02:15:54.453726+0000","last_undegraded":"2024-06-13T02:15:54.453726+0000","last_fullsized":"2024-06-13T02:15:54.453726+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:58:55.639602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.742681+0000","last_change":"2024-06-13T02:14:25.742041+0000","last_active":"2024-06-13T02:14:25.742681+0000","last_peered":"2024-06-13T02:14:25.742681+0000","last_clean":"2024-06-13T02:14:25.742681+0000","last_became_active":"2024-06-13T02:14:25.741497+0000","last_became_peered":"2024-06-13T02:14:25.741497+0000","last_unstale":"2024-06-13T02:14:25.742681+0000","last_undegraded":"2024-06-13T02:14:25.742681+0000","last_fullsized":"2024-06-13T02:14:25.742681+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:25:02.307080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.16","version":"98'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236887+0000","last_change":"2024-06-13T02:12:35.810437+0000","last_active":"2024-06-13T02:14:26.236887+0000","last_peered":"2024-06-13T02:14:26.236887+0000","last_clean":"2024-06-13T02:14:26.236887+0000","last_became_active":"2024-06-13T02:12:35.809679+0000","last_became_peered":"2024-06-13T02:12:35.809679+0000","last_unstale":"2024-06-13T02:14:26.236887+0000","last_undegraded":"2024-06-13T02:14:26.236887+0000","last_fullsized":"2024-06-13T02:14:26.236887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:12:27.644997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"100'9","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.474108+0000","last_change":"2024-06-13T02:12:40.306194+0000","last_active":"2024-06-13T02:15:54.474108+0000","last_peered":"2024-06-13T02:15:54.474108+0000","last_clean":"2024-06-13T02:15:54.474108+0000","last_became_active":"2024-06-13T02:12:40.304494+0000","last_became_peered":"2024-06-13T02:12:40.304494+0000","last_unstale":"2024-06-13T02:15:54.474108+0000","last_undegraded":"2024-06-13T02:15:54.474108+0000","last_fullsized":"2024-06-13T02:15:54.474108+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:59:58.186637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740373+0000","last_change":"2024-06-13T02:12:54.593655+0000","last_active":"2024-06-13T02:14:25.740373+0000","last_peered":"2024-06-13T02:14:25.740373+0000","last_clean":"2024-06-13T02:14:25.740373+0000","last_became_active":"2024-06-13T02:12:54.593256+0000","last_became_peered":"2024-06-13T02:12:54.593256+0000","last_unstale":"2024-06-13T02:14:25.740373+0000","last_undegraded":"2024-06-13T02:14:25.740373+0000","last_fullsized":"2024-06-13T02:14:25.740373+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:21:03.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"98'4","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475552+0000","last_change":"2024-06-13T02:12:36.302999+0000","last_active":"2024-06-13T02:14:26.475552+0000","last_peered":"2024-06-13T02:14:26.475552+0000","last_clean":"2024-06-13T02:14:26.475552+0000","last_became_active":"2024-06-13T02:12:36.302388+0000","last_became_peered":"2024-06-13T02:12:36.302388+0000","last_unstale":"2024-06-13T02:14:26.475552+0000","last_undegraded":"2024-06-13T02:14:26.475552+0000","last_fullsized":"2024-06-13T02:14:26.475552+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:11:18.238090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"100'11","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.449426+0000","last_change":"2024-06-13T02:12:40.294857+0000","last_active":"2024-06-13T02:15:54.449426+0000","last_peered":"2024-06-13T02:15:54.449426+0000","last_clean":"2024-06-13T02:15:54.449426+0000","last_became_active":"2024-06-13T02:12:40.294524+0000","last_became_peered":"2024-06-13T02:12:40.294524+0000","last_unstale":"2024-06-13T02:15:54.449426+0000","last_undegraded":"2024-06-13T02:15:54.449426+0000","last_fullsized":"2024-06-13T02:15:54.449426+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:59:06.627284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716973+0000","last_change":"2024-06-13T02:12:54.589686+0000","last_active":"2024-06-13T02:14:25.716973+0000","last_peered":"2024-06-13T02:14:25.716973+0000","last_clean":"2024-06-13T02:14:25.716973+0000","last_became_active":"2024-06-13T02:12:54.589131+0000","last_became_peered":"2024-06-13T02:12:54.589131+0000","last_unstale":"2024-06-13T02:14:25.716973+0000","last_undegraded":"2024-06-13T02:14:25.716973+0000","last_fullsized":"2024-06-13T02:14:25.716973+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:11:18.443534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"100'37","reported_seq":326,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:16:05.780759+0000","last_change":"2024-06-13T02:12:35.809926+0000","last_active":"2024-06-13T02:16:05.780759+0000","last_peered":"2024-06-13T02:16:05.780759+0000","last_clean":"2024-06-13T02:16:05.780759+0000","last_became_active":"2024-06-13T02:12:35.809527+0000","last_became_peered":"2024-06-13T02:12:35.809527+0000","last_unstale":"2024-06-13T02:16:05.780759+0000","last_undegraded":"2024-06-13T02:16:05.780759+0000","last_fullsized":"2024-06-13T02:16:05.780759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:44:54.068664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64307,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":244,"num_read_kb":185,"num_write":38,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"100'6","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.444949+0000","last_change":"2024-06-13T02:12:40.292129+0000","last_active":"2024-06-13T02:15:54.444949+0000","last_peered":"2024-06-13T02:15:54.444949+0000","last_clean":"2024-06-13T02:15:54.444949+0000","last_became_active":"2024-06-13T02:12:40.291741+0000","last_became_peered":"2024-06-13T02:12:40.291741+0000","last_unstale":"2024-06-13T02:15:54.444949+0000","last_undegraded":"2024-06-13T02:15:54.444949+0000","last_fullsized":"2024-06-13T02:15:54.444949+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:55:08.247903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475897+0000","last_change":"2024-06-13T02:12:54.602885+0000","last_active":"2024-06-13T02:14:26.475897+0000","last_peered":"2024-06-13T02:14:26.475897+0000","last_clean":"2024-06-13T02:14:26.475897+0000","last_became_active":"2024-06-13T02:12:54.602429+0000","last_became_peered":"2024-06-13T02:12:54.602429+0000","last_unstale":"2024-06-13T02:14:26.475897+0000","last_undegraded":"2024-06-13T02:14:26.475897+0000","last_fullsized":"2024-06-13T02:14:26.475897+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:01:36.267200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"98'6","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719320+0000","last_change":"2024-06-13T02:12:35.822449+0000","last_active":"2024-06-13T02:14:25.719320+0000","last_peered":"2024-06-13T02:14:25.719320+0000","last_clean":"2024-06-13T02:14:25.719320+0000","last_became_active":"2024-06-13T02:12:35.822170+0000","last_became_peered":"2024-06-13T02:12:35.822170+0000","last_unstale":"2024-06-13T02:14:25.719320+0000","last_undegraded":"2024-06-13T02:14:25.719320+0000","last_fullsized":"2024-06-13T02:14:25.719320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:06:26.710887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"100'9","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.461789+0000","last_change":"2024-06-13T02:12:40.325286+0000","last_active":"2024-06-13T02:15:54.461789+0000","last_peered":"2024-06-13T02:15:54.461789+0000","last_clean":"2024-06-13T02:15:54.461789+0000","last_became_active":"2024-06-13T02:12:40.324941+0000","last_became_peered":"2024-06-13T02:12:40.324941+0000","last_unstale":"2024-06-13T02:15:54.461789+0000","last_undegraded":"2024-06-13T02:15:54.461789+0000","last_fullsized":"2024-06-13T02:15:54.461789+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:29:34.385381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716269+0000","last_change":"2024-06-13T02:12:54.603086+0000","last_active":"2024-06-13T02:14:25.716269+0000","last_peered":"2024-06-13T02:14:25.716269+0000","last_clean":"2024-06-13T02:14:25.716269+0000","last_became_active":"2024-06-13T02:12:54.602381+0000","last_became_peered":"2024-06-13T02:12:54.602381+0000","last_unstale":"2024-06-13T02:14:25.716269+0000","last_undegraded":"2024-06-13T02:14:25.716269+0000","last_fullsized":"2024-06-13T02:14:25.716269+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:07:25.115147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"98'3","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475434+0000","last_change":"2024-06-13T02:12:35.821433+0000","last_active":"2024-06-13T02:14:26.475434+0000","last_peered":"2024-06-13T02:14:26.475434+0000","last_clean":"2024-06-13T02:14:26.475434+0000","last_became_active":"2024-06-13T02:12:35.821107+0000","last_became_peered":"2024-06-13T02:12:35.821107+0000","last_unstale":"2024-06-13T02:14:26.475434+0000","last_undegraded":"2024-06-13T02:14:26.475434+0000","last_fullsized":"2024-06-13T02:14:26.475434+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:46:22.488588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"100'15","reported_seq":54,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.452712+0000","last_change":"2024-06-13T02:12:40.290897+0000","last_active":"2024-06-13T02:15:54.452712+0000","last_peered":"2024-06-13T02:15:54.452712+0000","last_clean":"2024-06-13T02:15:54.452712+0000","last_became_active":"2024-06-13T02:12:40.290486+0000","last_became_peered":"2024-06-13T02:12:40.290486+0000","last_unstale":"2024-06-13T02:15:54.452712+0000","last_undegraded":"2024-06-13T02:15:54.452712+0000","last_fullsized":"2024-06-13T02:15:54.452712+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:44:13.478952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.721387+0000","last_change":"2024-06-13T02:12:54.595490+0000","last_active":"2024-06-13T02:14:25.721387+0000","last_peered":"2024-06-13T02:14:25.721387+0000","last_clean":"2024-06-13T02:14:25.721387+0000","last_became_active":"2024-06-13T02:12:54.593765+0000","last_became_peered":"2024-06-13T02:12:54.593765+0000","last_unstale":"2024-06-13T02:14:25.721387+0000","last_undegraded":"2024-06-13T02:14:25.721387+0000","last_fullsized":"2024-06-13T02:14:25.721387+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:09:59.920255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"98'3","reported_seq":164,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:16:01.825084+0000","last_change":"2024-06-13T02:12:35.810179+0000","last_active":"2024-06-13T02:16:01.825084+0000","last_peered":"2024-06-13T02:16:01.825084+0000","last_clean":"2024-06-13T02:16:01.825084+0000","last_became_active":"2024-06-13T02:12:35.809778+0000","last_became_peered":"2024-06-13T02:12:35.809778+0000","last_unstale":"2024-06-13T02:16:01.825084+0000","last_undegraded":"2024-06-13T02:16:01.825084+0000","last_fullsized":"2024-06-13T02:16:01.825084+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:35:53.804746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"100'6","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448906+0000","last_change":"2024-06-13T02:12:40.289957+0000","last_active":"2024-06-13T02:15:54.448906+0000","last_peered":"2024-06-13T02:15:54.448906+0000","last_clean":"2024-06-13T02:15:54.448906+0000","last_became_active":"2024-06-13T02:12:40.288169+0000","last_became_peered":"2024-06-13T02:12:40.288169+0000","last_unstale":"2024-06-13T02:15:54.448906+0000","last_undegraded":"2024-06-13T02:15:54.448906+0000","last_fullsized":"2024-06-13T02:15:54.448906+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:04:53.481002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.721050+0000","last_change":"2024-06-13T02:12:54.607531+0000","last_active":"2024-06-13T02:14:25.721050+0000","last_peered":"2024-06-13T02:14:25.721050+0000","last_clean":"2024-06-13T02:14:25.721050+0000","last_became_active":"2024-06-13T02:12:54.606594+0000","last_became_peered":"2024-06-13T02:12:54.606594+0000","last_unstale":"2024-06-13T02:14:25.721050+0000","last_undegraded":"2024-06-13T02:14:25.721050+0000","last_fullsized":"2024-06-13T02:14:25.721050+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:17:46.394058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"98'15","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.735146+0000","last_change":"2024-06-13T02:14:25.734734+0000","last_active":"2024-06-13T02:14:25.735146+0000","last_peered":"2024-06-13T02:14:25.735146+0000","last_clean":"2024-06-13T02:14:25.735146+0000","last_became_active":"2024-06-13T02:14:25.722163+0000","last_became_peered":"2024-06-13T02:14:25.722163+0000","last_unstale":"2024-06-13T02:14:25.735146+0000","last_undegraded":"2024-06-13T02:14:25.735146+0000","last_fullsized":"2024-06-13T02:14:25.735146+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:09:15.684102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"100'6","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448374+0000","last_change":"2024-06-13T02:13:25.875115+0000","last_active":"2024-06-13T02:15:54.448374+0000","last_peered":"2024-06-13T02:15:54.448374+0000","last_clean":"2024-06-13T02:15:54.448374+0000","last_became_active":"2024-06-13T02:13:25.874799+0000","last_became_peered":"2024-06-13T02:13:25.874799+0000","last_unstale":"2024-06-13T02:15:54.448374+0000","last_undegraded":"2024-06-13T02:15:54.448374+0000","last_fullsized":"2024-06-13T02:15:54.448374+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:31:30.747465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475013+0000","last_change":"2024-06-13T02:12:54.594061+0000","last_active":"2024-06-13T02:14:26.475013+0000","last_peered":"2024-06-13T02:14:26.475013+0000","last_clean":"2024-06-13T02:14:26.475013+0000","last_became_active":"2024-06-13T02:12:54.593561+0000","last_became_peered":"2024-06-13T02:12:54.593561+0000","last_unstale":"2024-06-13T02:14:26.475013+0000","last_undegraded":"2024-06-13T02:14:26.475013+0000","last_fullsized":"2024-06-13T02:14:26.475013+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:12:55.228857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"98'2","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716188+0000","last_change":"2024-06-13T02:12:35.808964+0000","last_active":"2024-06-13T02:14:25.716188+0000","last_peered":"2024-06-13T02:14:25.716188+0000","last_clean":"2024-06-13T02:14:25.716188+0000","last_became_active":"2024-06-13T02:12:35.808590+0000","last_became_peered":"2024-06-13T02:12:35.808590+0000","last_unstale":"2024-06-13T02:14:25.716188+0000","last_undegraded":"2024-06-13T02:14:25.716188+0000","last_fullsized":"2024-06-13T02:14:25.716188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:44:23.646188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"100'5","reported_seq":42,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.447622+0000","last_change":"2024-06-13T02:12:40.297467+0000","last_active":"2024-06-13T02:15:54.447622+0000","last_peered":"2024-06-13T02:15:54.447622+0000","last_clean":"2024-06-13T02:15:54.447622+0000","last_became_active":"2024-06-13T02:12:40.296951+0000","last_became_peered":"2024-06-13T02:12:40.296951+0000","last_unstale":"2024-06-13T02:15:54.447622+0000","last_undegraded":"2024-06-13T02:15:54.447622+0000","last_fullsized":"2024-06-13T02:15:54.447622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:27:12.293916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715748+0000","last_change":"2024-06-13T02:12:54.661609+0000","last_active":"2024-06-13T02:14:25.715748+0000","last_peered":"2024-06-13T02:14:25.715748+0000","last_clean":"2024-06-13T02:14:25.715748+0000","last_became_active":"2024-06-13T02:12:54.661078+0000","last_became_peered":"2024-06-13T02:12:54.661078+0000","last_unstale":"2024-06-13T02:14:25.715748+0000","last_undegraded":"2024-06-13T02:14:25.715748+0000","last_fullsized":"2024-06-13T02:14:25.715748+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:55:43.134999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719821+0000","last_change":"2024-06-13T02:12:36.303569+0000","last_active":"2024-06-13T02:14:25.719821+0000","last_peered":"2024-06-13T02:14:25.719821+0000","last_clean":"2024-06-13T02:14:25.719821+0000","last_became_active":"2024-06-13T02:12:36.302949+0000","last_became_peered":"2024-06-13T02:12:36.302949+0000","last_unstale":"2024-06-13T02:14:25.719821+0000","last_undegraded":"2024-06-13T02:14:25.719821+0000","last_fullsized":"2024-06-13T02:14:25.719821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:11:16.245334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"100'4","reported_seq":43,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448468+0000","last_change":"2024-06-13T02:12:40.317832+0000","last_active":"2024-06-13T02:15:54.448468+0000","last_peered":"2024-06-13T02:15:54.448468+0000","last_clean":"2024-06-13T02:15:54.448468+0000","last_became_active":"2024-06-13T02:12:40.317514+0000","last_became_peered":"2024-06-13T02:12:40.317514+0000","last_unstale":"2024-06-13T02:15:54.448468+0000","last_undegraded":"2024-06-13T02:15:54.448468+0000","last_fullsized":"2024-06-13T02:15:54.448468+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:40:06.049552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719845+0000","last_change":"2024-06-13T02:12:54.606149+0000","last_active":"2024-06-13T02:14:25.719845+0000","last_peered":"2024-06-13T02:14:25.719845+0000","last_clean":"2024-06-13T02:14:25.719845+0000","last_became_active":"2024-06-13T02:12:54.605683+0000","last_became_peered":"2024-06-13T02:12:54.605683+0000","last_unstale":"2024-06-13T02:14:25.719845+0000","last_undegraded":"2024-06-13T02:14:25.719845+0000","last_fullsized":"2024-06-13T02:14:25.719845+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:22:28.135821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"98'1","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236578+0000","last_change":"2024-06-13T02:12:35.817845+0000","last_active":"2024-06-13T02:14:26.236578+0000","last_peered":"2024-06-13T02:14:26.236578+0000","last_clean":"2024-06-13T02:14:26.236578+0000","last_became_active":"2024-06-13T02:12:35.817506+0000","last_became_peered":"2024-06-13T02:12:35.817506+0000","last_unstale":"2024-06-13T02:14:26.236578+0000","last_undegraded":"2024-06-13T02:14:26.236578+0000","last_fullsized":"2024-06-13T02:14:26.236578+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:06:54.346967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"100'7","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.474786+0000","last_change":"2024-06-13T02:13:25.537912+0000","last_active":"2024-06-13T02:15:54.474786+0000","last_peered":"2024-06-13T02:15:54.474786+0000","last_clean":"2024-06-13T02:15:54.474786+0000","last_became_active":"2024-06-13T02:13:25.537500+0000","last_became_peered":"2024-06-13T02:13:25.537500+0000","last_unstale":"2024-06-13T02:15:54.474786+0000","last_undegraded":"2024-06-13T02:15:54.474786+0000","last_fullsized":"2024-06-13T02:15:54.474786+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:03:11.884083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720569+0000","last_change":"2024-06-13T02:12:54.661763+0000","last_active":"2024-06-13T02:14:25.720569+0000","last_peered":"2024-06-13T02:14:25.720569+0000","last_clean":"2024-06-13T02:14:25.720569+0000","last_became_active":"2024-06-13T02:12:54.660898+0000","last_became_peered":"2024-06-13T02:12:54.660898+0000","last_unstale":"2024-06-13T02:14:25.720569+0000","last_undegraded":"2024-06-13T02:14:25.720569+0000","last_fullsized":"2024-06-13T02:14:25.720569+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:14:44.290726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"100'8","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.444343+0000","last_change":"2024-06-13T02:12:40.299606+0000","last_active":"2024-06-13T02:15:54.444343+0000","last_peered":"2024-06-13T02:15:54.444343+0000","last_clean":"2024-06-13T02:15:54.444343+0000","last_became_active":"2024-06-13T02:12:40.299028+0000","last_became_peered":"2024-06-13T02:12:40.299028+0000","last_unstale":"2024-06-13T02:15:54.444343+0000","last_undegraded":"2024-06-13T02:15:54.444343+0000","last_fullsized":"2024-06-13T02:15:54.444343+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:09:48.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"98'4","reported_seq":168,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:16:06.834459+0000","last_change":"2024-06-13T02:12:36.305073+0000","last_active":"2024-06-13T02:16:06.834459+0000","last_peered":"2024-06-13T02:16:06.834459+0000","last_clean":"2024-06-13T02:16:06.834459+0000","last_became_active":"2024-06-13T02:12:36.300008+0000","last_became_peered":"2024-06-13T02:12:36.300008+0000","last_unstale":"2024-06-13T02:16:06.834459+0000","last_undegraded":"2024-06-13T02:16:06.834459+0000","last_fullsized":"2024-06-13T02:16:06.834459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:52.310699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"98'1","reported_seq":30,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236678+0000","last_change":"2024-06-13T02:12:54.590184+0000","last_active":"2024-06-13T02:14:26.236678+0000","last_peered":"2024-06-13T02:14:26.236678+0000","last_clean":"2024-06-13T02:14:26.236678+0000","last_became_active":"2024-06-13T02:12:54.589825+0000","last_became_peered":"2024-06-13T02:12:54.589825+0000","last_unstale":"2024-06-13T02:14:26.236678+0000","last_undegraded":"2024-06-13T02:14:26.236678+0000","last_fullsized":"2024-06-13T02:14:26.236678+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:24:46.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"100'8","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448985+0000","last_change":"2024-06-13T02:12:40.313765+0000","last_active":"2024-06-13T02:15:54.448985+0000","last_peered":"2024-06-13T02:15:54.448985+0000","last_clean":"2024-06-13T02:15:54.448985+0000","last_became_active":"2024-06-13T02:12:40.313426+0000","last_became_peered":"2024-06-13T02:12:40.313426+0000","last_unstale":"2024-06-13T02:15:54.448985+0000","last_undegraded":"2024-06-13T02:15:54.448985+0000","last_fullsized":"2024-06-13T02:15:54.448985+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:30:35.318939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"98'3","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740548+0000","last_change":"2024-06-13T02:12:35.817237+0000","last_active":"2024-06-13T02:14:25.740548+0000","last_peered":"2024-06-13T02:14:25.740548+0000","last_clean":"2024-06-13T02:14:25.740548+0000","last_became_active":"2024-06-13T02:12:35.816853+0000","last_became_peered":"2024-06-13T02:12:35.816853+0000","last_unstale":"2024-06-13T02:14:25.740548+0000","last_undegraded":"2024-06-13T02:14:25.740548+0000","last_fullsized":"2024-06-13T02:14:25.740548+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:19:23.502461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":379,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236247+0000","last_change":"2024-06-13T02:11:05.634471+0000","last_active":"2024-06-13T02:14:26.236247+0000","last_peered":"2024-06-13T02:14:26.236247+0000","last_clean":"2024-06-13T02:14:26.236247+0000","last_became_active":"2024-06-13T02:11:05.634064+0000","last_became_peered":"2024-06-13T02:11:05.634064+0000","last_unstale":"2024-06-13T02:14:26.236247+0000","last_undegraded":"2024-06-13T02:14:26.236247+0000","last_fullsized":"2024-06-13T02:14:26.236247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:07:11.045097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:07:11.045097+0000","last_clean_scrub_stamp":"2024-06-13T02:07:11.045097+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:00:00.419953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.108628+0000","last_change":"2024-06-13T02:14:26.108149+0000","last_active":"2024-06-13T02:14:26.108628+0000","last_peered":"2024-06-13T02:14:26.108628+0000","last_clean":"2024-06-13T02:14:26.108628+0000","last_became_active":"2024-06-13T02:14:26.107707+0000","last_became_peered":"2024-06-13T02:14:26.107707+0000","last_unstale":"2024-06-13T02:14:26.108628+0000","last_undegraded":"2024-06-13T02:14:26.108628+0000","last_fullsized":"2024-06-13T02:14:26.108628+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:47:51.314059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"100'5","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.451532+0000","last_change":"2024-06-13T02:12:40.295770+0000","last_active":"2024-06-13T02:15:54.451532+0000","last_peered":"2024-06-13T02:15:54.451532+0000","last_clean":"2024-06-13T02:15:54.451532+0000","last_became_active":"2024-06-13T02:12:40.295361+0000","last_became_peered":"2024-06-13T02:12:40.295361+0000","last_unstale":"2024-06-13T02:15:54.451532+0000","last_undegraded":"2024-06-13T02:15:54.451532+0000","last_fullsized":"2024-06-13T02:15:54.451532+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:04:42.982908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"98'3","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236408+0000","last_change":"2024-06-13T02:12:35.808844+0000","last_active":"2024-06-13T02:14:26.236408+0000","last_peered":"2024-06-13T02:14:26.236408+0000","last_clean":"2024-06-13T02:14:26.236408+0000","last_became_active":"2024-06-13T02:12:35.808348+0000","last_became_peered":"2024-06-13T02:12:35.808348+0000","last_unstale":"2024-06-13T02:14:26.236408+0000","last_undegraded":"2024-06-13T02:14:26.236408+0000","last_fullsized":"2024-06-13T02:14:26.236408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:44:28.589169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716319+0000","last_change":"2024-06-13T02:12:54.605049+0000","last_active":"2024-06-13T02:14:25.716319+0000","last_peered":"2024-06-13T02:14:25.716319+0000","last_clean":"2024-06-13T02:14:25.716319+0000","last_became_active":"2024-06-13T02:12:54.604555+0000","last_became_peered":"2024-06-13T02:12:54.604555+0000","last_unstale":"2024-06-13T02:14:25.716319+0000","last_undegraded":"2024-06-13T02:14:25.716319+0000","last_fullsized":"2024-06-13T02:14:25.716319+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:19:58.615010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"98'1","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715890+0000","last_change":"2024-06-13T02:12:36.302966+0000","last_active":"2024-06-13T02:14:25.715890+0000","last_peered":"2024-06-13T02:14:25.715890+0000","last_clean":"2024-06-13T02:14:25.715890+0000","last_became_active":"2024-06-13T02:12:36.302529+0000","last_became_peered":"2024-06-13T02:12:36.302529+0000","last_unstale":"2024-06-13T02:14:25.715890+0000","last_undegraded":"2024-06-13T02:14:25.715890+0000","last_fullsized":"2024-06-13T02:14:25.715890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:50:01.955647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"100'9","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.456215+0000","last_change":"2024-06-13T02:12:40.304742+0000","last_active":"2024-06-13T02:15:54.456215+0000","last_peered":"2024-06-13T02:15:54.456215+0000","last_clean":"2024-06-13T02:15:54.456215+0000","last_became_active":"2024-06-13T02:12:40.302152+0000","last_became_peered":"2024-06-13T02:12:40.302152+0000","last_unstale":"2024-06-13T02:15:54.456215+0000","last_undegraded":"2024-06-13T02:15:54.456215+0000","last_fullsized":"2024-06-13T02:15:54.456215+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:22:02.146739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739569+0000","last_change":"2024-06-13T02:12:54.661661+0000","last_active":"2024-06-13T02:14:26.739569+0000","last_peered":"2024-06-13T02:14:26.739569+0000","last_clean":"2024-06-13T02:14:26.739569+0000","last_became_active":"2024-06-13T02:12:54.661177+0000","last_became_peered":"2024-06-13T02:12:54.661177+0000","last_unstale":"2024-06-13T02:14:26.739569+0000","last_undegraded":"2024-06-13T02:14:26.739569+0000","last_fullsized":"2024-06-13T02:14:26.739569+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:48:59.612164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"100'14","reported_seq":59,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:44.873777+0000","last_change":"2024-06-13T02:12:35.824975+0000","last_active":"2024-06-13T02:14:44.873777+0000","last_peered":"2024-06-13T02:14:44.873777+0000","last_clean":"2024-06-13T02:14:44.873777+0000","last_became_active":"2024-06-13T02:12:35.823019+0000","last_became_peered":"2024-06-13T02:12:35.823019+0000","last_unstale":"2024-06-13T02:14:44.873777+0000","last_undegraded":"2024-06-13T02:14:44.873777+0000","last_fullsized":"2024-06-13T02:14:44.873777+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:53:53.693448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"100'5","reported_seq":21,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448763+0000","last_change":"2024-06-13T02:13:25.537457+0000","last_active":"2024-06-13T02:15:54.448763+0000","last_peered":"2024-06-13T02:15:54.448763+0000","last_clean":"2024-06-13T02:15:54.448763+0000","last_became_active":"2024-06-13T02:13:25.536943+0000","last_became_peered":"2024-06-13T02:13:25.536943+0000","last_unstale":"2024-06-13T02:15:54.448763+0000","last_undegraded":"2024-06-13T02:15:54.448763+0000","last_fullsized":"2024-06-13T02:15:54.448763+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:14:34.584058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719528+0000","last_change":"2024-06-13T02:12:54.580657+0000","last_active":"2024-06-13T02:14:25.719528+0000","last_peered":"2024-06-13T02:14:25.719528+0000","last_clean":"2024-06-13T02:14:25.719528+0000","last_became_active":"2024-06-13T02:12:54.580073+0000","last_became_peered":"2024-06-13T02:12:54.580073+0000","last_unstale":"2024-06-13T02:14:25.719528+0000","last_undegraded":"2024-06-13T02:14:25.719528+0000","last_fullsized":"2024-06-13T02:14:25.719528+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:53:07.707587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"98'4","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740664+0000","last_change":"2024-06-13T02:12:36.520262+0000","last_active":"2024-06-13T02:14:25.740664+0000","last_peered":"2024-06-13T02:14:25.740664+0000","last_clean":"2024-06-13T02:14:25.740664+0000","last_became_active":"2024-06-13T02:12:36.519937+0000","last_became_peered":"2024-06-13T02:12:36.519937+0000","last_unstale":"2024-06-13T02:14:25.740664+0000","last_undegraded":"2024-06-13T02:14:25.740664+0000","last_fullsized":"2024-06-13T02:14:25.740664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:47:27.304345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.472079+0000","last_change":"2024-06-13T02:12:40.321399+0000","last_active":"2024-06-13T02:15:54.472079+0000","last_peered":"2024-06-13T02:15:54.472079+0000","last_clean":"2024-06-13T02:15:54.472079+0000","last_became_active":"2024-06-13T02:12:40.320977+0000","last_became_peered":"2024-06-13T02:12:40.320977+0000","last_unstale":"2024-06-13T02:15:54.472079+0000","last_undegraded":"2024-06-13T02:15:54.472079+0000","last_fullsized":"2024-06-13T02:15:54.472079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:28:29.076010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740573+0000","last_change":"2024-06-13T02:12:54.661615+0000","last_active":"2024-06-13T02:14:25.740573+0000","last_peered":"2024-06-13T02:14:25.740573+0000","last_clean":"2024-06-13T02:14:25.740573+0000","last_became_active":"2024-06-13T02:12:54.661188+0000","last_became_peered":"2024-06-13T02:12:54.661188+0000","last_unstale":"2024-06-13T02:14:25.740573+0000","last_undegraded":"2024-06-13T02:14:25.740573+0000","last_fullsized":"2024-06-13T02:14:25.740573+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:18:40.083105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"98'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.736935+0000","last_change":"2024-06-13T02:12:36.298425+0000","last_active":"2024-06-13T02:14:26.736935+0000","last_peered":"2024-06-13T02:14:26.736935+0000","last_clean":"2024-06-13T02:14:26.736935+0000","last_became_active":"2024-06-13T02:12:36.298053+0000","last_became_peered":"2024-06-13T02:12:36.298053+0000","last_unstale":"2024-06-13T02:14:26.736935+0000","last_undegraded":"2024-06-13T02:14:26.736935+0000","last_fullsized":"2024-06-13T02:14:26.736935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:22:22.374255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"100'2","reported_seq":41,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.421461+0000","last_change":"2024-06-13T02:12:40.291775+0000","last_active":"2024-06-13T02:15:54.421461+0000","last_peered":"2024-06-13T02:15:54.421461+0000","last_clean":"2024-06-13T02:15:54.421461+0000","last_became_active":"2024-06-13T02:12:40.291401+0000","last_became_peered":"2024-06-13T02:12:40.291401+0000","last_unstale":"2024-06-13T02:15:54.421461+0000","last_undegraded":"2024-06-13T02:15:54.421461+0000","last_fullsized":"2024-06-13T02:15:54.421461+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:13:59.921799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.721013+0000","last_change":"2024-06-13T02:12:54.592230+0000","last_active":"2024-06-13T02:14:25.721013+0000","last_peered":"2024-06-13T02:14:25.721013+0000","last_clean":"2024-06-13T02:14:25.721013+0000","last_became_active":"2024-06-13T02:12:54.591372+0000","last_became_peered":"2024-06-13T02:12:54.591372+0000","last_unstale":"2024-06-13T02:14:25.721013+0000","last_undegraded":"2024-06-13T02:14:25.721013+0000","last_fullsized":"2024-06-13T02:14:25.721013+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:36:19.684201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"98'3","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739621+0000","last_change":"2024-06-13T02:12:35.819005+0000","last_active":"2024-06-13T02:14:26.739621+0000","last_peered":"2024-06-13T02:14:26.739621+0000","last_clean":"2024-06-13T02:14:26.739621+0000","last_became_active":"2024-06-13T02:12:35.817956+0000","last_became_peered":"2024-06-13T02:12:35.817956+0000","last_unstale":"2024-06-13T02:14:26.739621+0000","last_undegraded":"2024-06-13T02:14:26.739621+0000","last_fullsized":"2024-06-13T02:14:26.739621+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:58:32.303442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"100'9","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.463019+0000","last_change":"2024-06-13T02:12:40.303970+0000","last_active":"2024-06-13T02:15:54.463019+0000","last_peered":"2024-06-13T02:15:54.463019+0000","last_clean":"2024-06-13T02:15:54.463019+0000","last_became_active":"2024-06-13T02:12:40.303610+0000","last_became_peered":"2024-06-13T02:12:40.303610+0000","last_unstale":"2024-06-13T02:15:54.463019+0000","last_undegraded":"2024-06-13T02:15:54.463019+0000","last_fullsized":"2024-06-13T02:15:54.463019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:33:20.479137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"100'1","reported_seq":30,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:29.244424+0000","last_change":"2024-06-13T02:12:54.592039+0000","last_active":"2024-06-13T02:14:29.244424+0000","last_peered":"2024-06-13T02:14:29.244424+0000","last_clean":"2024-06-13T02:14:29.244424+0000","last_became_active":"2024-06-13T02:12:54.591555+0000","last_became_peered":"2024-06-13T02:12:54.591555+0000","last_unstale":"2024-06-13T02:14:29.244424+0000","last_undegraded":"2024-06-13T02:14:29.244424+0000","last_fullsized":"2024-06-13T02:14:29.244424+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:11:35.194690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"98'1","reported_seq":17,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716440+0000","last_change":"2024-06-13T02:13:25.533227+0000","last_active":"2024-06-13T02:14:25.716440+0000","last_peered":"2024-06-13T02:14:25.716440+0000","last_clean":"2024-06-13T02:14:25.716440+0000","last_became_active":"2024-06-13T02:13:25.532837+0000","last_became_peered":"2024-06-13T02:13:25.532837+0000","last_unstale":"2024-06-13T02:14:25.716440+0000","last_undegraded":"2024-06-13T02:14:25.716440+0000","last_fullsized":"2024-06-13T02:14:25.716440+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:57:01.228063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"100'8","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.463803+0000","last_change":"2024-06-13T02:12:40.321759+0000","last_active":"2024-06-13T02:15:54.463803+0000","last_peered":"2024-06-13T02:15:54.463803+0000","last_clean":"2024-06-13T02:15:54.463803+0000","last_became_active":"2024-06-13T02:12:40.319837+0000","last_became_peered":"2024-06-13T02:12:40.319837+0000","last_unstale":"2024-06-13T02:15:54.463803+0000","last_undegraded":"2024-06-13T02:15:54.463803+0000","last_fullsized":"2024-06-13T02:15:54.463803+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:11:42.641990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740439+0000","last_change":"2024-06-13T02:12:54.661591+0000","last_active":"2024-06-13T02:14:25.740439+0000","last_peered":"2024-06-13T02:14:25.740439+0000","last_clean":"2024-06-13T02:14:25.740439+0000","last_became_active":"2024-06-13T02:12:54.661105+0000","last_became_peered":"2024-06-13T02:12:54.661105+0000","last_unstale":"2024-06-13T02:14:25.740439+0000","last_undegraded":"2024-06-13T02:14:25.740439+0000","last_fullsized":"2024-06-13T02:14:25.740439+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:29:12.625195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"98'4","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715315+0000","last_change":"2024-06-13T02:12:35.810538+0000","last_active":"2024-06-13T02:14:25.715315+0000","last_peered":"2024-06-13T02:14:25.715315+0000","last_clean":"2024-06-13T02:14:25.715315+0000","last_became_active":"2024-06-13T02:12:35.810187+0000","last_became_peered":"2024-06-13T02:12:35.810187+0000","last_unstale":"2024-06-13T02:14:25.715315+0000","last_undegraded":"2024-06-13T02:14:25.715315+0000","last_fullsized":"2024-06-13T02:14:25.715315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:44:52.794144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"100'5","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.451619+0000","last_change":"2024-06-13T02:12:40.291366+0000","last_active":"2024-06-13T02:15:54.451619+0000","last_peered":"2024-06-13T02:15:54.451619+0000","last_clean":"2024-06-13T02:15:54.451619+0000","last_became_active":"2024-06-13T02:12:40.291034+0000","last_became_peered":"2024-06-13T02:12:40.291034+0000","last_unstale":"2024-06-13T02:15:54.451619+0000","last_undegraded":"2024-06-13T02:15:54.451619+0000","last_fullsized":"2024-06-13T02:15:54.451619+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:20:04.277456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.736836+0000","last_change":"2024-06-13T02:12:54.602337+0000","last_active":"2024-06-13T02:14:26.736836+0000","last_peered":"2024-06-13T02:14:26.736836+0000","last_clean":"2024-06-13T02:14:26.736836+0000","last_became_active":"2024-06-13T02:12:54.601858+0000","last_became_peered":"2024-06-13T02:12:54.601858+0000","last_unstale":"2024-06-13T02:14:26.736836+0000","last_undegraded":"2024-06-13T02:14:26.736836+0000","last_fullsized":"2024-06-13T02:14:26.736836+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:16:53.478460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"98'3","reported_seq":20,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740375+0000","last_change":"2024-06-13T02:13:25.533798+0000","last_active":"2024-06-13T02:14:25.740375+0000","last_peered":"2024-06-13T02:14:25.740375+0000","last_clean":"2024-06-13T02:14:25.740375+0000","last_became_active":"2024-06-13T02:13:25.533439+0000","last_became_peered":"2024-06-13T02:13:25.533439+0000","last_unstale":"2024-06-13T02:14:25.740375+0000","last_undegraded":"2024-06-13T02:14:25.740375+0000","last_fullsized":"2024-06-13T02:14:25.740375+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:01:04.227804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448850+0000","last_change":"2024-06-13T02:12:40.295997+0000","last_active":"2024-06-13T02:15:54.448850+0000","last_peered":"2024-06-13T02:15:54.448850+0000","last_clean":"2024-06-13T02:15:54.448850+0000","last_became_active":"2024-06-13T02:12:40.295381+0000","last_became_peered":"2024-06-13T02:12:40.295381+0000","last_unstale":"2024-06-13T02:15:54.448850+0000","last_undegraded":"2024-06-13T02:15:54.448850+0000","last_fullsized":"2024-06-13T02:15:54.448850+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:32:58.777282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.713899+0000","last_change":"2024-06-13T02:12:54.598071+0000","last_active":"2024-06-13T02:14:25.713899+0000","last_peered":"2024-06-13T02:14:25.713899+0000","last_clean":"2024-06-13T02:14:25.713899+0000","last_became_active":"2024-06-13T02:12:54.597591+0000","last_became_peered":"2024-06-13T02:12:54.597591+0000","last_unstale":"2024-06-13T02:14:25.713899+0000","last_undegraded":"2024-06-13T02:14:25.713899+0000","last_fullsized":"2024-06-13T02:14:25.713899+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:27:51.141006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'1","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475699+0000","last_change":"2024-06-13T02:12:35.823187+0000","last_active":"2024-06-13T02:14:26.475699+0000","last_peered":"2024-06-13T02:14:26.475699+0000","last_clean":"2024-06-13T02:14:26.475699+0000","last_became_active":"2024-06-13T02:12:35.822793+0000","last_became_peered":"2024-06-13T02:12:35.822793+0000","last_unstale":"2024-06-13T02:14:26.475699+0000","last_undegraded":"2024-06-13T02:14:26.475699+0000","last_fullsized":"2024-06-13T02:14:26.475699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:22:58.133740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"100'6","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.454003+0000","last_change":"2024-06-13T02:12:40.321013+0000","last_active":"2024-06-13T02:15:54.454003+0000","last_peered":"2024-06-13T02:15:54.454003+0000","last_clean":"2024-06-13T02:15:54.454003+0000","last_became_active":"2024-06-13T02:12:40.320696+0000","last_became_peered":"2024-06-13T02:12:40.320696+0000","last_unstale":"2024-06-13T02:15:54.454003+0000","last_undegraded":"2024-06-13T02:15:54.454003+0000","last_fullsized":"2024-06-13T02:15:54.454003+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:05:38.156687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.474650+0000","last_change":"2024-06-13T02:12:54.579717+0000","last_active":"2024-06-13T02:14:26.474650+0000","last_peered":"2024-06-13T02:14:26.474650+0000","last_clean":"2024-06-13T02:14:26.474650+0000","last_became_active":"2024-06-13T02:12:54.579285+0000","last_became_peered":"2024-06-13T02:12:54.579285+0000","last_unstale":"2024-06-13T02:14:26.474650+0000","last_undegraded":"2024-06-13T02:14:26.474650+0000","last_fullsized":"2024-06-13T02:14:26.474650+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:03:41.796709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.721170+0000","last_change":"2024-06-13T02:12:35.824481+0000","last_active":"2024-06-13T02:14:25.721170+0000","last_peered":"2024-06-13T02:14:25.721170+0000","last_clean":"2024-06-13T02:14:25.721170+0000","last_became_active":"2024-06-13T02:12:35.823934+0000","last_became_peered":"2024-06-13T02:12:35.823934+0000","last_unstale":"2024-06-13T02:14:25.721170+0000","last_undegraded":"2024-06-13T02:14:25.721170+0000","last_fullsized":"2024-06-13T02:14:25.721170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:02:25.802124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"100'9","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.447638+0000","last_change":"2024-06-13T02:12:40.289323+0000","last_active":"2024-06-13T02:15:54.447638+0000","last_peered":"2024-06-13T02:15:54.447638+0000","last_clean":"2024-06-13T02:15:54.447638+0000","last_became_active":"2024-06-13T02:12:40.288919+0000","last_became_peered":"2024-06-13T02:12:40.288919+0000","last_unstale":"2024-06-13T02:15:54.447638+0000","last_undegraded":"2024-06-13T02:15:54.447638+0000","last_fullsized":"2024-06-13T02:15:54.447638+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:02:51.344467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"100'9","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448009+0000","last_change":"2024-06-13T02:12:40.294208+0000","last_active":"2024-06-13T02:15:54.448009+0000","last_peered":"2024-06-13T02:15:54.448009+0000","last_clean":"2024-06-13T02:15:54.448009+0000","last_became_active":"2024-06-13T02:12:40.293837+0000","last_became_peered":"2024-06-13T02:12:40.293837+0000","last_unstale":"2024-06-13T02:15:54.448009+0000","last_undegraded":"2024-06-13T02:15:54.448009+0000","last_fullsized":"2024-06-13T02:15:54.448009+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:32:46.328382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"100'12","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.438664+0000","last_change":"2024-06-13T02:12:40.303315+0000","last_active":"2024-06-13T02:15:54.438664+0000","last_peered":"2024-06-13T02:15:54.438664+0000","last_clean":"2024-06-13T02:15:54.438664+0000","last_became_active":"2024-06-13T02:12:40.302937+0000","last_became_peered":"2024-06-13T02:12:40.302937+0000","last_unstale":"2024-06-13T02:15:54.438664+0000","last_undegraded":"2024-06-13T02:15:54.438664+0000","last_fullsized":"2024-06-13T02:15:54.438664+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:51:19.510819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"100'8","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.465418+0000","last_change":"2024-06-13T02:12:40.322013+0000","last_active":"2024-06-13T02:15:54.465418+0000","last_peered":"2024-06-13T02:15:54.465418+0000","last_clean":"2024-06-13T02:15:54.465418+0000","last_became_active":"2024-06-13T02:12:40.321695+0000","last_became_peered":"2024-06-13T02:12:40.321695+0000","last_unstale":"2024-06-13T02:15:54.465418+0000","last_undegraded":"2024-06-13T02:15:54.465418+0000","last_fullsized":"2024-06-13T02:15:54.465418+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:42:28.101373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.471261+0000","last_change":"2024-06-13T02:12:40.306898+0000","last_active":"2024-06-13T02:15:54.471261+0000","last_peered":"2024-06-13T02:15:54.471261+0000","last_clean":"2024-06-13T02:15:54.471261+0000","last_became_active":"2024-06-13T02:12:40.306177+0000","last_became_peered":"2024-06-13T02:12:40.306177+0000","last_unstale":"2024-06-13T02:15:54.471261+0000","last_undegraded":"2024-06-13T02:15:54.471261+0000","last_fullsized":"2024-06-13T02:15:54.471261+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:11:22.747829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"100'4","reported_seq":43,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.464297+0000","last_change":"2024-06-13T02:12:40.307681+0000","last_active":"2024-06-13T02:15:54.464297+0000","last_peered":"2024-06-13T02:15:54.464297+0000","last_clean":"2024-06-13T02:15:54.464297+0000","last_became_active":"2024-06-13T02:12:40.307310+0000","last_became_peered":"2024-06-13T02:12:40.307310+0000","last_unstale":"2024-06-13T02:15:54.464297+0000","last_undegraded":"2024-06-13T02:15:54.464297+0000","last_fullsized":"2024-06-13T02:15:54.464297+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:53:35.493392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"100'6","reported_seq":43,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.447299+0000","last_change":"2024-06-13T02:12:40.293834+0000","last_active":"2024-06-13T02:15:54.447299+0000","last_peered":"2024-06-13T02:15:54.447299+0000","last_clean":"2024-06-13T02:15:54.447299+0000","last_became_active":"2024-06-13T02:12:40.293447+0000","last_became_peered":"2024-06-13T02:12:40.293447+0000","last_unstale":"2024-06-13T02:15:54.447299+0000","last_undegraded":"2024-06-13T02:15:54.447299+0000","last_fullsized":"2024-06-13T02:15:54.447299+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:26:36.375311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"100'15","reported_seq":54,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.445927+0000","last_change":"2024-06-13T02:12:40.301005+0000","last_active":"2024-06-13T02:15:54.445927+0000","last_peered":"2024-06-13T02:15:54.445927+0000","last_clean":"2024-06-13T02:15:54.445927+0000","last_became_active":"2024-06-13T02:12:40.300628+0000","last_became_peered":"2024-06-13T02:12:40.300628+0000","last_unstale":"2024-06-13T02:15:54.445927+0000","last_undegraded":"2024-06-13T02:15:54.445927+0000","last_fullsized":"2024-06-13T02:15:54.445927+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:08:42.472344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"100'2","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.431525+0000","last_change":"2024-06-13T02:13:25.582315+0000","last_active":"2024-06-13T02:15:54.431525+0000","last_peered":"2024-06-13T02:15:54.431525+0000","last_clean":"2024-06-13T02:15:54.431525+0000","last_became_active":"2024-06-13T02:13:25.581900+0000","last_became_peered":"2024-06-13T02:13:25.581900+0000","last_unstale":"2024-06-13T02:15:54.431525+0000","last_undegraded":"2024-06-13T02:15:54.431525+0000","last_fullsized":"2024-06-13T02:15:54.431525+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:10:34.523785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"100'6","reported_seq":22,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.461047+0000","last_change":"2024-06-13T02:13:25.535789+0000","last_active":"2024-06-13T02:15:54.461047+0000","last_peered":"2024-06-13T02:15:54.461047+0000","last_clean":"2024-06-13T02:15:54.461047+0000","last_became_active":"2024-06-13T02:13:25.535433+0000","last_became_peered":"2024-06-13T02:13:25.535433+0000","last_unstale":"2024-06-13T02:15:54.461047+0000","last_undegraded":"2024-06-13T02:15:54.461047+0000","last_fullsized":"2024-06-13T02:15:54.461047+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:42:48.200317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"100'8","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.456114+0000","last_change":"2024-06-13T02:12:40.317353+0000","last_active":"2024-06-13T02:15:54.456114+0000","last_peered":"2024-06-13T02:15:54.456114+0000","last_clean":"2024-06-13T02:15:54.456114+0000","last_became_active":"2024-06-13T02:12:40.316957+0000","last_became_peered":"2024-06-13T02:12:40.316957+0000","last_unstale":"2024-06-13T02:15:54.456114+0000","last_undegraded":"2024-06-13T02:15:54.456114+0000","last_fullsized":"2024-06-13T02:15:54.456114+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:53:01.190200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"100'10","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.458826+0000","last_change":"2024-06-13T02:12:40.324827+0000","last_active":"2024-06-13T02:15:54.458826+0000","last_peered":"2024-06-13T02:15:54.458826+0000","last_clean":"2024-06-13T02:15:54.458826+0000","last_became_active":"2024-06-13T02:12:40.324436+0000","last_became_peered":"2024-06-13T02:12:40.324436+0000","last_unstale":"2024-06-13T02:15:54.458826+0000","last_undegraded":"2024-06-13T02:15:54.458826+0000","last_fullsized":"2024-06-13T02:15:54.458826+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:23:44.382731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"100'11","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.475362+0000","last_change":"2024-06-13T02:12:40.308679+0000","last_active":"2024-06-13T02:15:54.475362+0000","last_peered":"2024-06-13T02:15:54.475362+0000","last_clean":"2024-06-13T02:15:54.475362+0000","last_became_active":"2024-06-13T02:12:40.308153+0000","last_became_peered":"2024-06-13T02:12:40.308153+0000","last_unstale":"2024-06-13T02:15:54.475362+0000","last_undegraded":"2024-06-13T02:15:54.475362+0000","last_fullsized":"2024-06-13T02:15:54.475362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:19:53.976190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"100'8","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.441380+0000","last_change":"2024-06-13T02:12:40.297489+0000","last_active":"2024-06-13T02:15:54.441380+0000","last_peered":"2024-06-13T02:15:54.441380+0000","last_clean":"2024-06-13T02:15:54.441380+0000","last_became_active":"2024-06-13T02:12:40.297026+0000","last_became_peered":"2024-06-13T02:12:40.297026+0000","last_unstale":"2024-06-13T02:15:54.441380+0000","last_undegraded":"2024-06-13T02:15:54.441380+0000","last_fullsized":"2024-06-13T02:15:54.441380+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:35:36.110972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67917,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":730,"num_read_kb":438,"num_write":176,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":203751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351035,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28144,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717008,"statfs":{"total":95995035648,"available":95966216192,"internally_reserved":0,"allocated":1155072,"data_stored":573205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612671,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28812,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716340,"statfs":{"total":95995035648,"available":95965532160,"internally_reserved":0,"allocated":1839104,"data_stored":1224668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776197,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1167360,"data_stored":577425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037835,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28144,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717008,"statfs":{"total":95995035648,"available":95966216192,"internally_reserved":0,"allocated":1155072,"data_stored":573137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299473,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28732,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716420,"statfs":{"total":95995035648,"available":95965614080,"internally_reserved":0,"allocated":1757184,"data_stored":1168767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863463000,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36452,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708700,"statfs":{"total":95995035648,"available":95957708800,"internally_reserved":0,"allocated":1142784,"data_stored":568505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574964,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36520,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708632,"statfs":{"total":95995035648,"available":95957639168,"internally_reserved":0,"allocated":1212416,"data_stored":632722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738488,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1167360,"data_stored":569893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411437,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36540,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708612,"statfs":{"total":95995035648,"available":95957618688,"internally_reserved":0,"allocated":1232896,"data_stored":633490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149799,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32304,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712848,"statfs":{"total":95995035648,"available":95961956352,"internally_reserved":0,"allocated":1155072,"data_stored":568699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888162,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1159168,"data_stored":573737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724637,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37060,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708092,"statfs":{"total":95995035648,"available":95957086208,"internally_reserved":0,"allocated":1765376,"data_stored":1164355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T02:16:10.367 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph pg dump --format=json 2024-06-13T02:16:10.880 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:16:10.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:10 smithi084 ceph-mon[36833]: from='client.24910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:16:11.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:10 smithi175 ceph-mon[36977]: from='client.24910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:16:11.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:10 smithi002 ceph-mon[31960]: from='client.24910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:16:11.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:11 smithi084 ceph-mon[36833]: pgmap v443: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:16:12.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:11 smithi175 ceph-mon[36977]: pgmap v443: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:16:12.108 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:11 smithi002 ceph-mon[31960]: pgmap v443: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:16:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.168+0000 7fd05f800700 1 -- 172.21.15.2:0/1102128167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058107450 msgr2=0x7fd058107830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.168+0000 7fd05f800700 1 --2- 172.21.15.2:0/1102128167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058107450 0x7fd058107830 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009990 tx=0x7fd04c009ca0 comp rx=0 tx=0).stop 2024-06-13T02:16:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.168+0000 7fd05f800700 1 -- 172.21.15.2:0/1102128167 shutdown_connections 2024-06-13T02:16:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.168+0000 7fd05f800700 1 --2- 172.21.15.2:0/1102128167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd058102ee0 0x7fd05810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.168+0000 7fd05f800700 1 --2- 172.21.15.2:0/1102128167 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058107450 0x7fd058107830 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.168+0000 7fd05f800700 1 --2- 172.21.15.2:0/1102128167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd058102540 0x7fd0581029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.168+0000 7fd05f800700 1 -- 172.21.15.2:0/1102128167 >> 172.21.15.2:0/1102128167 conn(0x7fd0580795f0 msgr2=0x7fd058079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.168+0000 7fd05f800700 1 -- 172.21.15.2:0/1102128167 shutdown_connections 2024-06-13T02:16:13.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.168+0000 7fd05f800700 1 -- 172.21.15.2:0/1102128167 wait complete. 2024-06-13T02:16:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.169+0000 7fd05f800700 1 Processor -- start 2024-06-13T02:16:13.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.169+0000 7fd05f800700 1 -- start start 2024-06-13T02:16:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.170+0000 7fd05f800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd058102540 0x7fd058074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.170+0000 7fd05f800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058102ee0 0x7fd058074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.170+0000 7fd05f800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd058107450 0x7fd058075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.170+0000 7fd05f800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd058112840 con 0x7fd058102ee0 2024-06-13T02:16:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.170+0000 7fd05f800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd0581126c0 con 0x7fd058107450 2024-06-13T02:16:13.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.170+0000 7fd05f800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd0581129c0 con 0x7fd058102540 2024-06-13T02:16:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.170+0000 7fd057e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058102ee0 0x7fd058074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.170+0000 7fd05ce00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd058102540 0x7fd058074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.170+0000 7fd057e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058102ee0 0x7fd058074cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38780/0 (socket says 172.21.15.2:38780) 2024-06-13T02:16:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.170+0000 7fd057e00700 1 -- 172.21.15.2:0/461807222 learned_addr learned my addr 172.21.15.2:0/461807222 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.171+0000 7fd05d800700 1 --2- 172.21.15.2:0/461807222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd058107450 0x7fd058075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.171+0000 7fd05ce00700 1 -- 172.21.15.2:0/461807222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd058107450 msgr2=0x7fd058075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:13.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.171+0000 7fd05ce00700 1 --2- 172.21.15.2:0/461807222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd058107450 0x7fd058075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.171+0000 7fd05ce00700 1 -- 172.21.15.2:0/461807222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058102ee0 msgr2=0x7fd058074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.171+0000 7fd05ce00700 1 --2- 172.21.15.2:0/461807222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058102ee0 0x7fd058074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.171+0000 7fd05ce00700 1 -- 172.21.15.2:0/461807222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0581a71e0 con 0x7fd058102540 2024-06-13T02:16:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.171+0000 7fd05ce00700 1 --2- 172.21.15.2:0/461807222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd058102540 0x7fd058074790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0098e0 tx=0x7fd04c00b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.172+0000 7fd055600700 1 -- 172.21.15.2:0/461807222 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c027070 con 0x7fd058102540 2024-06-13T02:16:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.172+0000 7fd055600700 1 -- 172.21.15.2:0/461807222 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd04c003b60 con 0x7fd058102540 2024-06-13T02:16:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.172+0000 7fd05f800700 1 -- 172.21.15.2:0/461807222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0581a7470 con 0x7fd058102540 2024-06-13T02:16:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.172+0000 7fd055600700 1 -- 172.21.15.2:0/461807222 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c022d50 con 0x7fd058102540 2024-06-13T02:16:13.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.172+0000 7fd05f800700 1 -- 172.21.15.2:0/461807222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0581a7920 con 0x7fd058102540 2024-06-13T02:16:13.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.173+0000 7fd05f800700 1 -- 172.21.15.2:0/461807222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05810aa80 con 0x7fd058102540 2024-06-13T02:16:13.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.175+0000 7fd055600700 1 -- 172.21.15.2:0/461807222 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fd04c02a070 con 0x7fd058102540 2024-06-13T02:16:13.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.177+0000 7fd055600700 1 --2- 172.21.15.2:0/461807222 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd0400a2ca0 0x7fd0400a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:13.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.177+0000 7fd055600700 1 -- 172.21.15.2:0/461807222 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fd04c0d0a90 con 0x7fd058102540 2024-06-13T02:16:13.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.177+0000 7fd057e00700 1 --2- 172.21.15.2:0/461807222 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd0400a2ca0 0x7fd0400a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:13.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.178+0000 7fd057e00700 1 --2- 172.21.15.2:0/461807222 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd0400a2ca0 0x7fd0400a5160 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd0581089d0 tx=0x7fd044009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:13.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.179+0000 7fd055600700 1 -- 172.21.15.2:0/461807222 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd04c031020 con 0x7fd058102540 2024-06-13T02:16:13.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.407+0000 7fd05f800700 1 -- 172.21.15.2:0/461807222 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0580628d0 con 0x7fd0400a2ca0 2024-06-13T02:16:13.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.418+0000 7fd055600700 1 -- 172.21.15.2:0/461807222 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340689 (secure 0 0 0) 0x7fd0580628d0 con 0x7fd0400a2ca0 2024-06-13T02:16:13.423 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:16:13.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.427+0000 7fd05f800700 1 -- 172.21.15.2:0/461807222 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd0400a2ca0 msgr2=0x7fd0400a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:13.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.427+0000 7fd05f800700 1 --2- 172.21.15.2:0/461807222 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd0400a2ca0 0x7fd0400a5160 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd0581089d0 tx=0x7fd044009260 comp rx=0 tx=0).stop 2024-06-13T02:16:13.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.427+0000 7fd05f800700 1 -- 172.21.15.2:0/461807222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd058102540 msgr2=0x7fd058074790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:13.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.427+0000 7fd05f800700 1 --2- 172.21.15.2:0/461807222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd058102540 0x7fd058074790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0098e0 tx=0x7fd04c00b8a0 comp rx=0 tx=0).stop 2024-06-13T02:16:13.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.427+0000 7fd05f800700 1 -- 172.21.15.2:0/461807222 shutdown_connections 2024-06-13T02:16:13.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.427+0000 7fd05f800700 1 --2- 172.21.15.2:0/461807222 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd0400a2ca0 0x7fd0400a5160 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:13.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.427+0000 7fd05f800700 1 --2- 172.21.15.2:0/461807222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd058107450 0x7fd058075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:13.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.427+0000 7fd05f800700 1 --2- 172.21.15.2:0/461807222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd058102540 0x7fd058074790 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:13.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.427+0000 7fd05f800700 1 --2- 172.21.15.2:0/461807222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd058102ee0 0x7fd058074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:13.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.427+0000 7fd05f800700 1 -- 172.21.15.2:0/461807222 >> 172.21.15.2:0/461807222 conn(0x7fd0580795f0 msgr2=0x7fd0581004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:13.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.428+0000 7fd05f800700 1 -- 172.21.15.2:0/461807222 shutdown_connections 2024-06-13T02:16:13.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:13.428+0000 7fd05f800700 1 -- 172.21.15.2:0/461807222 wait complete. 2024-06-13T02:16:13.430 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-06-13T02:16:13.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:13 smithi084 ceph-mon[36833]: pgmap v444: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:16:14.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:13 smithi175 ceph-mon[36977]: pgmap v444: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:16:14.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:13 smithi002 ceph-mon[31960]: pgmap v444: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:16:14.277 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2024-06-13T02:16:12.529082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658519,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":886,"num_read_kb":567,"num_write":359,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1180848,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":788,"ondisk_log_size":788,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377168,"kb_used_data":15536,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124564656,"statfs":{"total":1151940427776,"available":1151554207744,"internally_reserved":0,"allocated":15908864,"data_stored":8828603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005690"},"pg_stats":[{"pgid":"3.3f","version":"100'8","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.471848+0000","last_change":"2024-06-13T02:12:40.307929+0000","last_active":"2024-06-13T02:15:54.471848+0000","last_peered":"2024-06-13T02:15:54.471848+0000","last_clean":"2024-06-13T02:15:54.471848+0000","last_became_active":"2024-06-13T02:12:40.307353+0000","last_became_peered":"2024-06-13T02:12:40.307353+0000","last_unstale":"2024-06-13T02:15:54.471848+0000","last_undegraded":"2024-06-13T02:15:54.471848+0000","last_fullsized":"2024-06-13T02:15:54.471848+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:43:19.850829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"100'4","reported_seq":43,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.473403+0000","last_change":"2024-06-13T02:12:40.304715+0000","last_active":"2024-06-13T02:15:54.473403+0000","last_peered":"2024-06-13T02:15:54.473403+0000","last_clean":"2024-06-13T02:15:54.473403+0000","last_became_active":"2024-06-13T02:12:40.304216+0000","last_became_peered":"2024-06-13T02:12:40.304216+0000","last_unstale":"2024-06-13T02:15:54.473403+0000","last_undegraded":"2024-06-13T02:15:54.473403+0000","last_fullsized":"2024-06-13T02:15:54.473403+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:39:02.340749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.467766+0000","last_change":"2024-06-13T02:12:40.303576+0000","last_active":"2024-06-13T02:15:54.467766+0000","last_peered":"2024-06-13T02:15:54.467766+0000","last_clean":"2024-06-13T02:15:54.467766+0000","last_became_active":"2024-06-13T02:12:40.303225+0000","last_became_peered":"2024-06-13T02:12:40.303225+0000","last_unstale":"2024-06-13T02:15:54.467766+0000","last_undegraded":"2024-06-13T02:15:54.467766+0000","last_fullsized":"2024-06-13T02:15:54.467766+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:54:17.144856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"100'8","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.437110+0000","last_change":"2024-06-13T02:12:40.298405+0000","last_active":"2024-06-13T02:15:54.437110+0000","last_peered":"2024-06-13T02:15:54.437110+0000","last_clean":"2024-06-13T02:15:54.437110+0000","last_became_active":"2024-06-13T02:12:40.297742+0000","last_became_peered":"2024-06-13T02:12:40.297742+0000","last_unstale":"2024-06-13T02:15:54.437110+0000","last_undegraded":"2024-06-13T02:15:54.437110+0000","last_fullsized":"2024-06-13T02:15:54.437110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:23:12.417602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"100'4","reported_seq":43,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.446732+0000","last_change":"2024-06-13T02:12:40.318679+0000","last_active":"2024-06-13T02:15:54.446732+0000","last_peered":"2024-06-13T02:15:54.446732+0000","last_clean":"2024-06-13T02:15:54.446732+0000","last_became_active":"2024-06-13T02:12:40.318313+0000","last_became_peered":"2024-06-13T02:12:40.318313+0000","last_unstale":"2024-06-13T02:15:54.446732+0000","last_undegraded":"2024-06-13T02:15:54.446732+0000","last_fullsized":"2024-06-13T02:15:54.446732+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:36:30.580012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"100'6","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.454623+0000","last_change":"2024-06-13T02:13:25.537913+0000","last_active":"2024-06-13T02:15:54.454623+0000","last_peered":"2024-06-13T02:15:54.454623+0000","last_clean":"2024-06-13T02:15:54.454623+0000","last_became_active":"2024-06-13T02:13:25.537509+0000","last_became_peered":"2024-06-13T02:13:25.537509+0000","last_unstale":"2024-06-13T02:15:54.454623+0000","last_undegraded":"2024-06-13T02:15:54.454623+0000","last_fullsized":"2024-06-13T02:15:54.454623+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:54:04.905051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"100'5","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.455319+0000","last_change":"2024-06-13T02:12:40.304737+0000","last_active":"2024-06-13T02:15:54.455319+0000","last_peered":"2024-06-13T02:15:54.455319+0000","last_clean":"2024-06-13T02:15:54.455319+0000","last_became_active":"2024-06-13T02:12:40.304239+0000","last_became_peered":"2024-06-13T02:12:40.304239+0000","last_unstale":"2024-06-13T02:15:54.455319+0000","last_undegraded":"2024-06-13T02:15:54.455319+0000","last_fullsized":"2024-06-13T02:15:54.455319+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:09:23.403816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"100'9","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.461597+0000","last_change":"2024-06-13T02:12:40.317542+0000","last_active":"2024-06-13T02:15:54.461597+0000","last_peered":"2024-06-13T02:15:54.461597+0000","last_clean":"2024-06-13T02:15:54.461597+0000","last_became_active":"2024-06-13T02:12:40.317140+0000","last_became_peered":"2024-06-13T02:12:40.317140+0000","last_unstale":"2024-06-13T02:15:54.461597+0000","last_undegraded":"2024-06-13T02:15:54.461597+0000","last_fullsized":"2024-06-13T02:15:54.461597+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:01:19.812336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"100'11","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.449773+0000","last_change":"2024-06-13T02:12:40.295445+0000","last_active":"2024-06-13T02:15:54.449773+0000","last_peered":"2024-06-13T02:15:54.449773+0000","last_clean":"2024-06-13T02:15:54.449773+0000","last_became_active":"2024-06-13T02:12:40.293498+0000","last_became_peered":"2024-06-13T02:12:40.293498+0000","last_unstale":"2024-06-13T02:15:54.449773+0000","last_undegraded":"2024-06-13T02:15:54.449773+0000","last_fullsized":"2024-06-13T02:15:54.449773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:43:48.487157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"100'16","reported_seq":55,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.441734+0000","last_change":"2024-06-13T02:12:40.294665+0000","last_active":"2024-06-13T02:15:54.441734+0000","last_peered":"2024-06-13T02:15:54.441734+0000","last_clean":"2024-06-13T02:15:54.441734+0000","last_became_active":"2024-06-13T02:12:40.294339+0000","last_became_peered":"2024-06-13T02:12:40.294339+0000","last_unstale":"2024-06-13T02:15:54.441734+0000","last_undegraded":"2024-06-13T02:15:54.441734+0000","last_fullsized":"2024-06-13T02:15:54.441734+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:15:58.703675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"100'6","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448626+0000","last_change":"2024-06-13T02:12:40.294867+0000","last_active":"2024-06-13T02:15:54.448626+0000","last_peered":"2024-06-13T02:15:54.448626+0000","last_clean":"2024-06-13T02:15:54.448626+0000","last_became_active":"2024-06-13T02:12:40.293665+0000","last_became_peered":"2024-06-13T02:12:40.293665+0000","last_unstale":"2024-06-13T02:15:54.448626+0000","last_undegraded":"2024-06-13T02:15:54.448626+0000","last_fullsized":"2024-06-13T02:15:54.448626+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:52:02.171738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.427834+0000","last_change":"2024-06-13T02:12:40.296253+0000","last_active":"2024-06-13T02:15:54.427834+0000","last_peered":"2024-06-13T02:15:54.427834+0000","last_clean":"2024-06-13T02:15:54.427834+0000","last_became_active":"2024-06-13T02:12:40.295932+0000","last_became_peered":"2024-06-13T02:12:40.295932+0000","last_unstale":"2024-06-13T02:15:54.427834+0000","last_undegraded":"2024-06-13T02:15:54.427834+0000","last_fullsized":"2024-06-13T02:15:54.427834+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:41:07.044402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"100'10","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.457758+0000","last_change":"2024-06-13T02:12:40.288976+0000","last_active":"2024-06-13T02:15:54.457758+0000","last_peered":"2024-06-13T02:15:54.457758+0000","last_clean":"2024-06-13T02:15:54.457758+0000","last_became_active":"2024-06-13T02:12:40.288629+0000","last_became_peered":"2024-06-13T02:12:40.288629+0000","last_unstale":"2024-06-13T02:15:54.457758+0000","last_undegraded":"2024-06-13T02:15:54.457758+0000","last_fullsized":"2024-06-13T02:15:54.457758+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:10:49.673042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.469822+0000","last_change":"2024-06-13T02:12:40.304020+0000","last_active":"2024-06-13T02:15:54.469822+0000","last_peered":"2024-06-13T02:15:54.469822+0000","last_clean":"2024-06-13T02:15:54.469822+0000","last_became_active":"2024-06-13T02:12:40.303671+0000","last_became_peered":"2024-06-13T02:12:40.303671+0000","last_unstale":"2024-06-13T02:15:54.469822+0000","last_undegraded":"2024-06-13T02:15:54.469822+0000","last_fullsized":"2024-06-13T02:15:54.469822+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:28:15.907085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.473383+0000","last_change":"2024-06-13T02:12:40.309501+0000","last_active":"2024-06-13T02:15:54.473383+0000","last_peered":"2024-06-13T02:15:54.473383+0000","last_clean":"2024-06-13T02:15:54.473383+0000","last_became_active":"2024-06-13T02:12:40.304938+0000","last_became_peered":"2024-06-13T02:12:40.304938+0000","last_unstale":"2024-06-13T02:15:54.473383+0000","last_undegraded":"2024-06-13T02:15:54.473383+0000","last_fullsized":"2024-06-13T02:15:54.473383+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:59:56.164448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"100'9","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.458896+0000","last_change":"2024-06-13T02:12:40.306574+0000","last_active":"2024-06-13T02:15:54.458896+0000","last_peered":"2024-06-13T02:15:54.458896+0000","last_clean":"2024-06-13T02:15:54.458896+0000","last_became_active":"2024-06-13T02:12:40.306227+0000","last_became_peered":"2024-06-13T02:12:40.306227+0000","last_unstale":"2024-06-13T02:15:54.458896+0000","last_undegraded":"2024-06-13T02:15:54.458896+0000","last_fullsized":"2024-06-13T02:15:54.458896+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:55:23.456256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"100'8","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.472149+0000","last_change":"2024-06-13T02:12:40.308291+0000","last_active":"2024-06-13T02:15:54.472149+0000","last_peered":"2024-06-13T02:15:54.472149+0000","last_clean":"2024-06-13T02:15:54.472149+0000","last_became_active":"2024-06-13T02:12:40.307626+0000","last_became_peered":"2024-06-13T02:12:40.307626+0000","last_unstale":"2024-06-13T02:15:54.472149+0000","last_undegraded":"2024-06-13T02:15:54.472149+0000","last_fullsized":"2024-06-13T02:15:54.472149+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:16:47.025364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"100'10","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.453755+0000","last_change":"2024-06-13T02:12:40.308249+0000","last_active":"2024-06-13T02:15:54.453755+0000","last_peered":"2024-06-13T02:15:54.453755+0000","last_clean":"2024-06-13T02:15:54.453755+0000","last_became_active":"2024-06-13T02:12:40.303871+0000","last_became_peered":"2024-06-13T02:12:40.303871+0000","last_unstale":"2024-06-13T02:15:54.453755+0000","last_undegraded":"2024-06-13T02:15:54.453755+0000","last_fullsized":"2024-06-13T02:15:54.453755+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:27:05.852927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.458445+0000","last_change":"2024-06-13T02:12:40.320970+0000","last_active":"2024-06-13T02:15:54.458445+0000","last_peered":"2024-06-13T02:15:54.458445+0000","last_clean":"2024-06-13T02:15:54.458445+0000","last_became_active":"2024-06-13T02:12:40.320537+0000","last_became_peered":"2024-06-13T02:12:40.320537+0000","last_unstale":"2024-06-13T02:15:54.458445+0000","last_undegraded":"2024-06-13T02:15:54.458445+0000","last_fullsized":"2024-06-13T02:15:54.458445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:39:44.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719589+0000","last_change":"2024-06-13T02:12:54.594504+0000","last_active":"2024-06-13T02:14:25.719589+0000","last_peered":"2024-06-13T02:14:25.719589+0000","last_clean":"2024-06-13T02:14:25.719589+0000","last_became_active":"2024-06-13T02:12:54.594083+0000","last_became_peered":"2024-06-13T02:12:54.594083+0000","last_unstale":"2024-06-13T02:14:25.719589+0000","last_undegraded":"2024-06-13T02:14:25.719589+0000","last_fullsized":"2024-06-13T02:14:25.719589+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:40:11.592477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"98'9","reported_seq":55,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720880+0000","last_change":"2024-06-13T02:12:35.820414+0000","last_active":"2024-06-13T02:14:25.720880+0000","last_peered":"2024-06-13T02:14:25.720880+0000","last_clean":"2024-06-13T02:14:25.720880+0000","last_became_active":"2024-06-13T02:12:35.819320+0000","last_became_peered":"2024-06-13T02:12:35.819320+0000","last_unstale":"2024-06-13T02:14:25.720880+0000","last_undegraded":"2024-06-13T02:14:25.720880+0000","last_fullsized":"2024-06-13T02:14:25.720880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:02:44.226482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"100'5","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.441976+0000","last_change":"2024-06-13T02:12:40.317221+0000","last_active":"2024-06-13T02:15:54.441976+0000","last_peered":"2024-06-13T02:15:54.441976+0000","last_clean":"2024-06-13T02:15:54.441976+0000","last_became_active":"2024-06-13T02:12:40.315069+0000","last_became_peered":"2024-06-13T02:12:40.315069+0000","last_unstale":"2024-06-13T02:15:54.441976+0000","last_undegraded":"2024-06-13T02:15:54.441976+0000","last_fullsized":"2024-06-13T02:15:54.441976+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:44:36.577914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740631+0000","last_change":"2024-06-13T02:12:54.600490+0000","last_active":"2024-06-13T02:14:25.740631+0000","last_peered":"2024-06-13T02:14:25.740631+0000","last_clean":"2024-06-13T02:14:25.740631+0000","last_became_active":"2024-06-13T02:12:54.600192+0000","last_became_peered":"2024-06-13T02:12:54.600192+0000","last_unstale":"2024-06-13T02:14:25.740631+0000","last_undegraded":"2024-06-13T02:14:25.740631+0000","last_fullsized":"2024-06-13T02:14:25.740631+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:46:10.782977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"98'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.741163+0000","last_change":"2024-06-13T02:12:36.306113+0000","last_active":"2024-06-13T02:14:26.741163+0000","last_peered":"2024-06-13T02:14:26.741163+0000","last_clean":"2024-06-13T02:14:26.741163+0000","last_became_active":"2024-06-13T02:12:36.298787+0000","last_became_peered":"2024-06-13T02:12:36.298787+0000","last_unstale":"2024-06-13T02:14:26.741163+0000","last_undegraded":"2024-06-13T02:14:26.741163+0000","last_fullsized":"2024-06-13T02:14:26.741163+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:29:00.902574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"100'6","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.474292+0000","last_change":"2024-06-13T02:12:40.314925+0000","last_active":"2024-06-13T02:15:54.474292+0000","last_peered":"2024-06-13T02:15:54.474292+0000","last_clean":"2024-06-13T02:15:54.474292+0000","last_became_active":"2024-06-13T02:12:40.312668+0000","last_became_peered":"2024-06-13T02:12:40.312668+0000","last_unstale":"2024-06-13T02:15:54.474292+0000","last_undegraded":"2024-06-13T02:15:54.474292+0000","last_fullsized":"2024-06-13T02:15:54.474292+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:47:42.896414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740226+0000","last_change":"2024-06-13T02:12:54.593653+0000","last_active":"2024-06-13T02:14:25.740226+0000","last_peered":"2024-06-13T02:14:25.740226+0000","last_clean":"2024-06-13T02:14:25.740226+0000","last_became_active":"2024-06-13T02:12:54.593250+0000","last_became_peered":"2024-06-13T02:12:54.593250+0000","last_unstale":"2024-06-13T02:14:25.740226+0000","last_undegraded":"2024-06-13T02:14:25.740226+0000","last_fullsized":"2024-06-13T02:14:25.740226+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:29:45.233850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"98'4","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716043+0000","last_change":"2024-06-13T02:12:35.809925+0000","last_active":"2024-06-13T02:14:25.716043+0000","last_peered":"2024-06-13T02:14:25.716043+0000","last_clean":"2024-06-13T02:14:25.716043+0000","last_became_active":"2024-06-13T02:12:35.809536+0000","last_became_peered":"2024-06-13T02:12:35.809536+0000","last_unstale":"2024-06-13T02:14:25.716043+0000","last_undegraded":"2024-06-13T02:14:25.716043+0000","last_fullsized":"2024-06-13T02:14:25.716043+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:41:46.322004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"100'9","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.451762+0000","last_change":"2024-06-13T02:12:40.299911+0000","last_active":"2024-06-13T02:15:54.451762+0000","last_peered":"2024-06-13T02:15:54.451762+0000","last_clean":"2024-06-13T02:15:54.451762+0000","last_became_active":"2024-06-13T02:12:40.298762+0000","last_became_peered":"2024-06-13T02:12:40.298762+0000","last_unstale":"2024-06-13T02:15:54.451762+0000","last_undegraded":"2024-06-13T02:15:54.451762+0000","last_fullsized":"2024-06-13T02:15:54.451762+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:52:43.996050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740162+0000","last_change":"2024-06-13T02:12:54.602831+0000","last_active":"2024-06-13T02:14:25.740162+0000","last_peered":"2024-06-13T02:14:25.740162+0000","last_clean":"2024-06-13T02:14:25.740162+0000","last_became_active":"2024-06-13T02:12:54.602406+0000","last_became_peered":"2024-06-13T02:12:54.602406+0000","last_unstale":"2024-06-13T02:14:25.740162+0000","last_undegraded":"2024-06-13T02:14:25.740162+0000","last_fullsized":"2024-06-13T02:14:25.740162+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:01:02.041340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715757+0000","last_change":"2024-06-13T02:12:35.808961+0000","last_active":"2024-06-13T02:14:25.715757+0000","last_peered":"2024-06-13T02:14:25.715757+0000","last_clean":"2024-06-13T02:14:25.715757+0000","last_became_active":"2024-06-13T02:12:35.808277+0000","last_became_peered":"2024-06-13T02:12:35.808277+0000","last_unstale":"2024-06-13T02:14:25.715757+0000","last_undegraded":"2024-06-13T02:14:25.715757+0000","last_fullsized":"2024-06-13T02:14:25.715757+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:38:54.356186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"100'15","reported_seq":54,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.445780+0000","last_change":"2024-06-13T02:12:40.295392+0000","last_active":"2024-06-13T02:15:54.445780+0000","last_peered":"2024-06-13T02:15:54.445780+0000","last_clean":"2024-06-13T02:15:54.445780+0000","last_became_active":"2024-06-13T02:12:40.295052+0000","last_became_peered":"2024-06-13T02:12:40.295052+0000","last_unstale":"2024-06-13T02:15:54.445780+0000","last_undegraded":"2024-06-13T02:15:54.445780+0000","last_fullsized":"2024-06-13T02:15:54.445780+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:12:38.728062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719337+0000","last_change":"2024-06-13T02:12:54.582150+0000","last_active":"2024-06-13T02:14:25.719337+0000","last_peered":"2024-06-13T02:14:25.719337+0000","last_clean":"2024-06-13T02:14:25.719337+0000","last_became_active":"2024-06-13T02:12:54.581734+0000","last_became_peered":"2024-06-13T02:12:54.581734+0000","last_unstale":"2024-06-13T02:14:25.719337+0000","last_undegraded":"2024-06-13T02:14:25.719337+0000","last_fullsized":"2024-06-13T02:14:25.719337+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:34:28.143198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"98'5","reported_seq":171,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:16:06.783027+0000","last_change":"2024-06-13T02:12:35.810286+0000","last_active":"2024-06-13T02:16:06.783027+0000","last_peered":"2024-06-13T02:16:06.783027+0000","last_clean":"2024-06-13T02:16:06.783027+0000","last_became_active":"2024-06-13T02:12:35.809910+0000","last_became_peered":"2024-06-13T02:12:35.809910+0000","last_unstale":"2024-06-13T02:16:06.783027+0000","last_undegraded":"2024-06-13T02:16:06.783027+0000","last_fullsized":"2024-06-13T02:16:06.783027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:09:10.438115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"100'7","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.447557+0000","last_change":"2024-06-13T02:13:25.643735+0000","last_active":"2024-06-13T02:15:54.447557+0000","last_peered":"2024-06-13T02:15:54.447557+0000","last_clean":"2024-06-13T02:15:54.447557+0000","last_became_active":"2024-06-13T02:13:25.643406+0000","last_became_peered":"2024-06-13T02:13:25.643406+0000","last_unstale":"2024-06-13T02:15:54.447557+0000","last_undegraded":"2024-06-13T02:15:54.447557+0000","last_fullsized":"2024-06-13T02:15:54.447557+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:20:17.267712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.477220+0000","last_change":"2024-06-13T02:14:26.476695+0000","last_active":"2024-06-13T02:14:26.477220+0000","last_peered":"2024-06-13T02:14:26.477220+0000","last_clean":"2024-06-13T02:14:26.477220+0000","last_became_active":"2024-06-13T02:14:26.476129+0000","last_became_peered":"2024-06-13T02:14:26.476129+0000","last_unstale":"2024-06-13T02:14:26.477220+0000","last_undegraded":"2024-06-13T02:14:26.477220+0000","last_fullsized":"2024-06-13T02:14:26.477220+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:00:39.577682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,10,5],"acting":[2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"98'3","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.107556+0000","last_change":"2024-06-13T02:12:35.817613+0000","last_active":"2024-06-13T02:14:26.107556+0000","last_peered":"2024-06-13T02:14:26.107556+0000","last_clean":"2024-06-13T02:14:26.107556+0000","last_became_active":"2024-06-13T02:12:35.817217+0000","last_became_peered":"2024-06-13T02:12:35.817217+0000","last_unstale":"2024-06-13T02:14:26.107556+0000","last_undegraded":"2024-06-13T02:14:26.107556+0000","last_fullsized":"2024-06-13T02:14:26.107556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:40:06.195493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"100'8","reported_seq":53,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.442541+0000","last_change":"2024-06-13T02:13:25.538088+0000","last_active":"2024-06-13T02:15:54.442541+0000","last_peered":"2024-06-13T02:15:54.442541+0000","last_clean":"2024-06-13T02:15:54.442541+0000","last_became_active":"2024-06-13T02:13:25.537693+0000","last_became_peered":"2024-06-13T02:13:25.537693+0000","last_unstale":"2024-06-13T02:15:54.442541+0000","last_undegraded":"2024-06-13T02:15:54.442541+0000","last_fullsized":"2024-06-13T02:15:54.442541+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:52:59.032383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.742782+0000","last_change":"2024-06-13T02:14:25.742320+0000","last_active":"2024-06-13T02:14:25.742782+0000","last_peered":"2024-06-13T02:14:25.742782+0000","last_clean":"2024-06-13T02:14:25.742782+0000","last_became_active":"2024-06-13T02:14:25.741736+0000","last_became_peered":"2024-06-13T02:14:25.741736+0000","last_unstale":"2024-06-13T02:14:25.742782+0000","last_undegraded":"2024-06-13T02:14:25.742782+0000","last_fullsized":"2024-06-13T02:14:25.742782+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:16:53.587795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"98'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.718292+0000","last_change":"2024-06-13T02:12:35.824235+0000","last_active":"2024-06-13T02:14:25.718292+0000","last_peered":"2024-06-13T02:14:25.718292+0000","last_clean":"2024-06-13T02:14:25.718292+0000","last_became_active":"2024-06-13T02:12:35.821506+0000","last_became_peered":"2024-06-13T02:12:35.821506+0000","last_unstale":"2024-06-13T02:14:25.718292+0000","last_undegraded":"2024-06-13T02:14:25.718292+0000","last_fullsized":"2024-06-13T02:14:25.718292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:58:39.808001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"100'8","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.461451+0000","last_change":"2024-06-13T02:12:40.324580+0000","last_active":"2024-06-13T02:15:54.461451+0000","last_peered":"2024-06-13T02:15:54.461451+0000","last_clean":"2024-06-13T02:15:54.461451+0000","last_became_active":"2024-06-13T02:12:40.323791+0000","last_became_peered":"2024-06-13T02:12:40.323791+0000","last_unstale":"2024-06-13T02:15:54.461451+0000","last_undegraded":"2024-06-13T02:15:54.461451+0000","last_fullsized":"2024-06-13T02:15:54.461451+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:29:14.169270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716794+0000","last_change":"2024-06-13T02:12:54.602305+0000","last_active":"2024-06-13T02:14:25.716794+0000","last_peered":"2024-06-13T02:14:25.716794+0000","last_clean":"2024-06-13T02:14:25.716794+0000","last_became_active":"2024-06-13T02:12:54.601787+0000","last_became_peered":"2024-06-13T02:12:54.601787+0000","last_unstale":"2024-06-13T02:14:25.716794+0000","last_undegraded":"2024-06-13T02:14:25.716794+0000","last_fullsized":"2024-06-13T02:14:25.716794+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:16:34.970026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"98'1","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.474856+0000","last_change":"2024-06-13T02:12:35.808845+0000","last_active":"2024-06-13T02:14:26.474856+0000","last_peered":"2024-06-13T02:14:26.474856+0000","last_clean":"2024-06-13T02:14:26.474856+0000","last_became_active":"2024-06-13T02:12:35.808497+0000","last_became_peered":"2024-06-13T02:12:35.808497+0000","last_unstale":"2024-06-13T02:14:26.474856+0000","last_undegraded":"2024-06-13T02:14:26.474856+0000","last_fullsized":"2024-06-13T02:14:26.474856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:41:00.577762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"100'11","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.460671+0000","last_change":"2024-06-13T02:12:40.322308+0000","last_active":"2024-06-13T02:15:54.460671+0000","last_peered":"2024-06-13T02:15:54.460671+0000","last_clean":"2024-06-13T02:15:54.460671+0000","last_became_active":"2024-06-13T02:12:40.321152+0000","last_became_peered":"2024-06-13T02:12:40.321152+0000","last_unstale":"2024-06-13T02:15:54.460671+0000","last_undegraded":"2024-06-13T02:15:54.460671+0000","last_fullsized":"2024-06-13T02:15:54.460671+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:50:15.740442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739243+0000","last_change":"2024-06-13T02:12:54.580648+0000","last_active":"2024-06-13T02:14:26.739243+0000","last_peered":"2024-06-13T02:14:26.739243+0000","last_clean":"2024-06-13T02:14:26.739243+0000","last_became_active":"2024-06-13T02:12:54.580207+0000","last_became_peered":"2024-06-13T02:12:54.580207+0000","last_unstale":"2024-06-13T02:14:26.739243+0000","last_undegraded":"2024-06-13T02:14:26.739243+0000","last_fullsized":"2024-06-13T02:14:26.739243+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:19:58.241236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"98'3","reported_seq":170,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:16:09.786542+0000","last_change":"2024-06-13T02:12:35.818195+0000","last_active":"2024-06-13T02:16:09.786542+0000","last_peered":"2024-06-13T02:16:09.786542+0000","last_clean":"2024-06-13T02:16:09.786542+0000","last_became_active":"2024-06-13T02:12:35.817707+0000","last_became_peered":"2024-06-13T02:12:35.817707+0000","last_unstale":"2024-06-13T02:16:09.786542+0000","last_undegraded":"2024-06-13T02:16:09.786542+0000","last_fullsized":"2024-06-13T02:16:09.786542+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:24:34.940115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"100'10","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.453726+0000","last_change":"2024-06-13T02:12:40.306423+0000","last_active":"2024-06-13T02:15:54.453726+0000","last_peered":"2024-06-13T02:15:54.453726+0000","last_clean":"2024-06-13T02:15:54.453726+0000","last_became_active":"2024-06-13T02:12:40.306064+0000","last_became_peered":"2024-06-13T02:12:40.306064+0000","last_unstale":"2024-06-13T02:15:54.453726+0000","last_undegraded":"2024-06-13T02:15:54.453726+0000","last_fullsized":"2024-06-13T02:15:54.453726+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:58:55.639602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.742681+0000","last_change":"2024-06-13T02:14:25.742041+0000","last_active":"2024-06-13T02:14:25.742681+0000","last_peered":"2024-06-13T02:14:25.742681+0000","last_clean":"2024-06-13T02:14:25.742681+0000","last_became_active":"2024-06-13T02:14:25.741497+0000","last_became_peered":"2024-06-13T02:14:25.741497+0000","last_unstale":"2024-06-13T02:14:25.742681+0000","last_undegraded":"2024-06-13T02:14:25.742681+0000","last_fullsized":"2024-06-13T02:14:25.742681+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:25:02.307080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.16","version":"98'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236887+0000","last_change":"2024-06-13T02:12:35.810437+0000","last_active":"2024-06-13T02:14:26.236887+0000","last_peered":"2024-06-13T02:14:26.236887+0000","last_clean":"2024-06-13T02:14:26.236887+0000","last_became_active":"2024-06-13T02:12:35.809679+0000","last_became_peered":"2024-06-13T02:12:35.809679+0000","last_unstale":"2024-06-13T02:14:26.236887+0000","last_undegraded":"2024-06-13T02:14:26.236887+0000","last_fullsized":"2024-06-13T02:14:26.236887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:12:27.644997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"100'9","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.474108+0000","last_change":"2024-06-13T02:12:40.306194+0000","last_active":"2024-06-13T02:15:54.474108+0000","last_peered":"2024-06-13T02:15:54.474108+0000","last_clean":"2024-06-13T02:15:54.474108+0000","last_became_active":"2024-06-13T02:12:40.304494+0000","last_became_peered":"2024-06-13T02:12:40.304494+0000","last_unstale":"2024-06-13T02:15:54.474108+0000","last_undegraded":"2024-06-13T02:15:54.474108+0000","last_fullsized":"2024-06-13T02:15:54.474108+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:59:58.186637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740373+0000","last_change":"2024-06-13T02:12:54.593655+0000","last_active":"2024-06-13T02:14:25.740373+0000","last_peered":"2024-06-13T02:14:25.740373+0000","last_clean":"2024-06-13T02:14:25.740373+0000","last_became_active":"2024-06-13T02:12:54.593256+0000","last_became_peered":"2024-06-13T02:12:54.593256+0000","last_unstale":"2024-06-13T02:14:25.740373+0000","last_undegraded":"2024-06-13T02:14:25.740373+0000","last_fullsized":"2024-06-13T02:14:25.740373+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:21:03.318689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"98'4","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475552+0000","last_change":"2024-06-13T02:12:36.302999+0000","last_active":"2024-06-13T02:14:26.475552+0000","last_peered":"2024-06-13T02:14:26.475552+0000","last_clean":"2024-06-13T02:14:26.475552+0000","last_became_active":"2024-06-13T02:12:36.302388+0000","last_became_peered":"2024-06-13T02:12:36.302388+0000","last_unstale":"2024-06-13T02:14:26.475552+0000","last_undegraded":"2024-06-13T02:14:26.475552+0000","last_fullsized":"2024-06-13T02:14:26.475552+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:11:18.238090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"100'11","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.449426+0000","last_change":"2024-06-13T02:12:40.294857+0000","last_active":"2024-06-13T02:15:54.449426+0000","last_peered":"2024-06-13T02:15:54.449426+0000","last_clean":"2024-06-13T02:15:54.449426+0000","last_became_active":"2024-06-13T02:12:40.294524+0000","last_became_peered":"2024-06-13T02:12:40.294524+0000","last_unstale":"2024-06-13T02:15:54.449426+0000","last_undegraded":"2024-06-13T02:15:54.449426+0000","last_fullsized":"2024-06-13T02:15:54.449426+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:59:06.627284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716973+0000","last_change":"2024-06-13T02:12:54.589686+0000","last_active":"2024-06-13T02:14:25.716973+0000","last_peered":"2024-06-13T02:14:25.716973+0000","last_clean":"2024-06-13T02:14:25.716973+0000","last_became_active":"2024-06-13T02:12:54.589131+0000","last_became_peered":"2024-06-13T02:12:54.589131+0000","last_unstale":"2024-06-13T02:14:25.716973+0000","last_undegraded":"2024-06-13T02:14:25.716973+0000","last_fullsized":"2024-06-13T02:14:25.716973+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:11:18.443534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"100'37","reported_seq":336,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:16:10.787965+0000","last_change":"2024-06-13T02:12:35.809926+0000","last_active":"2024-06-13T02:16:10.787965+0000","last_peered":"2024-06-13T02:16:10.787965+0000","last_clean":"2024-06-13T02:16:10.787965+0000","last_became_active":"2024-06-13T02:12:35.809527+0000","last_became_peered":"2024-06-13T02:12:35.809527+0000","last_unstale":"2024-06-13T02:16:10.787965+0000","last_undegraded":"2024-06-13T02:16:10.787965+0000","last_fullsized":"2024-06-13T02:16:10.787965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:44:54.068664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64307,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":254,"num_read_kb":190,"num_write":38,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"100'6","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.444949+0000","last_change":"2024-06-13T02:12:40.292129+0000","last_active":"2024-06-13T02:15:54.444949+0000","last_peered":"2024-06-13T02:15:54.444949+0000","last_clean":"2024-06-13T02:15:54.444949+0000","last_became_active":"2024-06-13T02:12:40.291741+0000","last_became_peered":"2024-06-13T02:12:40.291741+0000","last_unstale":"2024-06-13T02:15:54.444949+0000","last_undegraded":"2024-06-13T02:15:54.444949+0000","last_fullsized":"2024-06-13T02:15:54.444949+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:55:08.247903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475897+0000","last_change":"2024-06-13T02:12:54.602885+0000","last_active":"2024-06-13T02:14:26.475897+0000","last_peered":"2024-06-13T02:14:26.475897+0000","last_clean":"2024-06-13T02:14:26.475897+0000","last_became_active":"2024-06-13T02:12:54.602429+0000","last_became_peered":"2024-06-13T02:12:54.602429+0000","last_unstale":"2024-06-13T02:14:26.475897+0000","last_undegraded":"2024-06-13T02:14:26.475897+0000","last_fullsized":"2024-06-13T02:14:26.475897+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:01:36.267200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"98'6","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719320+0000","last_change":"2024-06-13T02:12:35.822449+0000","last_active":"2024-06-13T02:14:25.719320+0000","last_peered":"2024-06-13T02:14:25.719320+0000","last_clean":"2024-06-13T02:14:25.719320+0000","last_became_active":"2024-06-13T02:12:35.822170+0000","last_became_peered":"2024-06-13T02:12:35.822170+0000","last_unstale":"2024-06-13T02:14:25.719320+0000","last_undegraded":"2024-06-13T02:14:25.719320+0000","last_fullsized":"2024-06-13T02:14:25.719320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:06:26.710887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"100'9","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.461789+0000","last_change":"2024-06-13T02:12:40.325286+0000","last_active":"2024-06-13T02:15:54.461789+0000","last_peered":"2024-06-13T02:15:54.461789+0000","last_clean":"2024-06-13T02:15:54.461789+0000","last_became_active":"2024-06-13T02:12:40.324941+0000","last_became_peered":"2024-06-13T02:12:40.324941+0000","last_unstale":"2024-06-13T02:15:54.461789+0000","last_undegraded":"2024-06-13T02:15:54.461789+0000","last_fullsized":"2024-06-13T02:15:54.461789+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:29:34.385381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716269+0000","last_change":"2024-06-13T02:12:54.603086+0000","last_active":"2024-06-13T02:14:25.716269+0000","last_peered":"2024-06-13T02:14:25.716269+0000","last_clean":"2024-06-13T02:14:25.716269+0000","last_became_active":"2024-06-13T02:12:54.602381+0000","last_became_peered":"2024-06-13T02:12:54.602381+0000","last_unstale":"2024-06-13T02:14:25.716269+0000","last_undegraded":"2024-06-13T02:14:25.716269+0000","last_fullsized":"2024-06-13T02:14:25.716269+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:07:25.115147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"98'3","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475434+0000","last_change":"2024-06-13T02:12:35.821433+0000","last_active":"2024-06-13T02:14:26.475434+0000","last_peered":"2024-06-13T02:14:26.475434+0000","last_clean":"2024-06-13T02:14:26.475434+0000","last_became_active":"2024-06-13T02:12:35.821107+0000","last_became_peered":"2024-06-13T02:12:35.821107+0000","last_unstale":"2024-06-13T02:14:26.475434+0000","last_undegraded":"2024-06-13T02:14:26.475434+0000","last_fullsized":"2024-06-13T02:14:26.475434+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:46:22.488588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"100'15","reported_seq":54,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.452712+0000","last_change":"2024-06-13T02:12:40.290897+0000","last_active":"2024-06-13T02:15:54.452712+0000","last_peered":"2024-06-13T02:15:54.452712+0000","last_clean":"2024-06-13T02:15:54.452712+0000","last_became_active":"2024-06-13T02:12:40.290486+0000","last_became_peered":"2024-06-13T02:12:40.290486+0000","last_unstale":"2024-06-13T02:15:54.452712+0000","last_undegraded":"2024-06-13T02:15:54.452712+0000","last_fullsized":"2024-06-13T02:15:54.452712+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:44:13.478952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.721387+0000","last_change":"2024-06-13T02:12:54.595490+0000","last_active":"2024-06-13T02:14:25.721387+0000","last_peered":"2024-06-13T02:14:25.721387+0000","last_clean":"2024-06-13T02:14:25.721387+0000","last_became_active":"2024-06-13T02:12:54.593765+0000","last_became_peered":"2024-06-13T02:12:54.593765+0000","last_unstale":"2024-06-13T02:14:25.721387+0000","last_undegraded":"2024-06-13T02:14:25.721387+0000","last_fullsized":"2024-06-13T02:14:25.721387+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:09:59.920255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"98'3","reported_seq":169,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:16:06.835065+0000","last_change":"2024-06-13T02:12:35.810179+0000","last_active":"2024-06-13T02:16:06.835065+0000","last_peered":"2024-06-13T02:16:06.835065+0000","last_clean":"2024-06-13T02:16:06.835065+0000","last_became_active":"2024-06-13T02:12:35.809778+0000","last_became_peered":"2024-06-13T02:12:35.809778+0000","last_unstale":"2024-06-13T02:16:06.835065+0000","last_undegraded":"2024-06-13T02:16:06.835065+0000","last_fullsized":"2024-06-13T02:16:06.835065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:35:53.804746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"100'6","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448906+0000","last_change":"2024-06-13T02:12:40.289957+0000","last_active":"2024-06-13T02:15:54.448906+0000","last_peered":"2024-06-13T02:15:54.448906+0000","last_clean":"2024-06-13T02:15:54.448906+0000","last_became_active":"2024-06-13T02:12:40.288169+0000","last_became_peered":"2024-06-13T02:12:40.288169+0000","last_unstale":"2024-06-13T02:15:54.448906+0000","last_undegraded":"2024-06-13T02:15:54.448906+0000","last_fullsized":"2024-06-13T02:15:54.448906+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:04:53.481002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.721050+0000","last_change":"2024-06-13T02:12:54.607531+0000","last_active":"2024-06-13T02:14:25.721050+0000","last_peered":"2024-06-13T02:14:25.721050+0000","last_clean":"2024-06-13T02:14:25.721050+0000","last_became_active":"2024-06-13T02:12:54.606594+0000","last_became_peered":"2024-06-13T02:12:54.606594+0000","last_unstale":"2024-06-13T02:14:25.721050+0000","last_undegraded":"2024-06-13T02:14:25.721050+0000","last_fullsized":"2024-06-13T02:14:25.721050+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:17:46.394058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"98'15","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.735146+0000","last_change":"2024-06-13T02:14:25.734734+0000","last_active":"2024-06-13T02:14:25.735146+0000","last_peered":"2024-06-13T02:14:25.735146+0000","last_clean":"2024-06-13T02:14:25.735146+0000","last_became_active":"2024-06-13T02:14:25.722163+0000","last_became_peered":"2024-06-13T02:14:25.722163+0000","last_unstale":"2024-06-13T02:14:25.735146+0000","last_undegraded":"2024-06-13T02:14:25.735146+0000","last_fullsized":"2024-06-13T02:14:25.735146+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:09:15.684102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"100'6","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448374+0000","last_change":"2024-06-13T02:13:25.875115+0000","last_active":"2024-06-13T02:15:54.448374+0000","last_peered":"2024-06-13T02:15:54.448374+0000","last_clean":"2024-06-13T02:15:54.448374+0000","last_became_active":"2024-06-13T02:13:25.874799+0000","last_became_peered":"2024-06-13T02:13:25.874799+0000","last_unstale":"2024-06-13T02:15:54.448374+0000","last_undegraded":"2024-06-13T02:15:54.448374+0000","last_fullsized":"2024-06-13T02:15:54.448374+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:31:30.747465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475013+0000","last_change":"2024-06-13T02:12:54.594061+0000","last_active":"2024-06-13T02:14:26.475013+0000","last_peered":"2024-06-13T02:14:26.475013+0000","last_clean":"2024-06-13T02:14:26.475013+0000","last_became_active":"2024-06-13T02:12:54.593561+0000","last_became_peered":"2024-06-13T02:12:54.593561+0000","last_unstale":"2024-06-13T02:14:26.475013+0000","last_undegraded":"2024-06-13T02:14:26.475013+0000","last_fullsized":"2024-06-13T02:14:26.475013+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:12:55.228857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"98'2","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716188+0000","last_change":"2024-06-13T02:12:35.808964+0000","last_active":"2024-06-13T02:14:25.716188+0000","last_peered":"2024-06-13T02:14:25.716188+0000","last_clean":"2024-06-13T02:14:25.716188+0000","last_became_active":"2024-06-13T02:12:35.808590+0000","last_became_peered":"2024-06-13T02:12:35.808590+0000","last_unstale":"2024-06-13T02:14:25.716188+0000","last_undegraded":"2024-06-13T02:14:25.716188+0000","last_fullsized":"2024-06-13T02:14:25.716188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:44:23.646188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"100'5","reported_seq":42,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.447622+0000","last_change":"2024-06-13T02:12:40.297467+0000","last_active":"2024-06-13T02:15:54.447622+0000","last_peered":"2024-06-13T02:15:54.447622+0000","last_clean":"2024-06-13T02:15:54.447622+0000","last_became_active":"2024-06-13T02:12:40.296951+0000","last_became_peered":"2024-06-13T02:12:40.296951+0000","last_unstale":"2024-06-13T02:15:54.447622+0000","last_undegraded":"2024-06-13T02:15:54.447622+0000","last_fullsized":"2024-06-13T02:15:54.447622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T02:27:12.293916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715748+0000","last_change":"2024-06-13T02:12:54.661609+0000","last_active":"2024-06-13T02:14:25.715748+0000","last_peered":"2024-06-13T02:14:25.715748+0000","last_clean":"2024-06-13T02:14:25.715748+0000","last_became_active":"2024-06-13T02:12:54.661078+0000","last_became_peered":"2024-06-13T02:12:54.661078+0000","last_unstale":"2024-06-13T02:14:25.715748+0000","last_undegraded":"2024-06-13T02:14:25.715748+0000","last_fullsized":"2024-06-13T02:14:25.715748+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:55:43.134999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719821+0000","last_change":"2024-06-13T02:12:36.303569+0000","last_active":"2024-06-13T02:14:25.719821+0000","last_peered":"2024-06-13T02:14:25.719821+0000","last_clean":"2024-06-13T02:14:25.719821+0000","last_became_active":"2024-06-13T02:12:36.302949+0000","last_became_peered":"2024-06-13T02:12:36.302949+0000","last_unstale":"2024-06-13T02:14:25.719821+0000","last_undegraded":"2024-06-13T02:14:25.719821+0000","last_fullsized":"2024-06-13T02:14:25.719821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:11:16.245334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"100'4","reported_seq":43,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448468+0000","last_change":"2024-06-13T02:12:40.317832+0000","last_active":"2024-06-13T02:15:54.448468+0000","last_peered":"2024-06-13T02:15:54.448468+0000","last_clean":"2024-06-13T02:15:54.448468+0000","last_became_active":"2024-06-13T02:12:40.317514+0000","last_became_peered":"2024-06-13T02:12:40.317514+0000","last_unstale":"2024-06-13T02:15:54.448468+0000","last_undegraded":"2024-06-13T02:15:54.448468+0000","last_fullsized":"2024-06-13T02:15:54.448468+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:40:06.049552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719845+0000","last_change":"2024-06-13T02:12:54.606149+0000","last_active":"2024-06-13T02:14:25.719845+0000","last_peered":"2024-06-13T02:14:25.719845+0000","last_clean":"2024-06-13T02:14:25.719845+0000","last_became_active":"2024-06-13T02:12:54.605683+0000","last_became_peered":"2024-06-13T02:12:54.605683+0000","last_unstale":"2024-06-13T02:14:25.719845+0000","last_undegraded":"2024-06-13T02:14:25.719845+0000","last_fullsized":"2024-06-13T02:14:25.719845+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:22:28.135821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"98'1","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236578+0000","last_change":"2024-06-13T02:12:35.817845+0000","last_active":"2024-06-13T02:14:26.236578+0000","last_peered":"2024-06-13T02:14:26.236578+0000","last_clean":"2024-06-13T02:14:26.236578+0000","last_became_active":"2024-06-13T02:12:35.817506+0000","last_became_peered":"2024-06-13T02:12:35.817506+0000","last_unstale":"2024-06-13T02:14:26.236578+0000","last_undegraded":"2024-06-13T02:14:26.236578+0000","last_fullsized":"2024-06-13T02:14:26.236578+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:06:54.346967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"100'7","reported_seq":52,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.474786+0000","last_change":"2024-06-13T02:13:25.537912+0000","last_active":"2024-06-13T02:15:54.474786+0000","last_peered":"2024-06-13T02:15:54.474786+0000","last_clean":"2024-06-13T02:15:54.474786+0000","last_became_active":"2024-06-13T02:13:25.537500+0000","last_became_peered":"2024-06-13T02:13:25.537500+0000","last_unstale":"2024-06-13T02:15:54.474786+0000","last_undegraded":"2024-06-13T02:15:54.474786+0000","last_fullsized":"2024-06-13T02:15:54.474786+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:03:11.884083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.720569+0000","last_change":"2024-06-13T02:12:54.661763+0000","last_active":"2024-06-13T02:14:25.720569+0000","last_peered":"2024-06-13T02:14:25.720569+0000","last_clean":"2024-06-13T02:14:25.720569+0000","last_became_active":"2024-06-13T02:12:54.660898+0000","last_became_peered":"2024-06-13T02:12:54.660898+0000","last_unstale":"2024-06-13T02:14:25.720569+0000","last_undegraded":"2024-06-13T02:14:25.720569+0000","last_fullsized":"2024-06-13T02:14:25.720569+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:14:44.290726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"100'8","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.444343+0000","last_change":"2024-06-13T02:12:40.299606+0000","last_active":"2024-06-13T02:15:54.444343+0000","last_peered":"2024-06-13T02:15:54.444343+0000","last_clean":"2024-06-13T02:15:54.444343+0000","last_became_active":"2024-06-13T02:12:40.299028+0000","last_became_peered":"2024-06-13T02:12:40.299028+0000","last_unstale":"2024-06-13T02:15:54.444343+0000","last_undegraded":"2024-06-13T02:15:54.444343+0000","last_fullsized":"2024-06-13T02:15:54.444343+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:09:48.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"98'4","reported_seq":168,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:16:06.834459+0000","last_change":"2024-06-13T02:12:36.305073+0000","last_active":"2024-06-13T02:16:06.834459+0000","last_peered":"2024-06-13T02:16:06.834459+0000","last_clean":"2024-06-13T02:16:06.834459+0000","last_became_active":"2024-06-13T02:12:36.300008+0000","last_became_peered":"2024-06-13T02:12:36.300008+0000","last_unstale":"2024-06-13T02:16:06.834459+0000","last_undegraded":"2024-06-13T02:16:06.834459+0000","last_fullsized":"2024-06-13T02:16:06.834459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:42:52.310699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"98'1","reported_seq":30,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236678+0000","last_change":"2024-06-13T02:12:54.590184+0000","last_active":"2024-06-13T02:14:26.236678+0000","last_peered":"2024-06-13T02:14:26.236678+0000","last_clean":"2024-06-13T02:14:26.236678+0000","last_became_active":"2024-06-13T02:12:54.589825+0000","last_became_peered":"2024-06-13T02:12:54.589825+0000","last_unstale":"2024-06-13T02:14:26.236678+0000","last_undegraded":"2024-06-13T02:14:26.236678+0000","last_fullsized":"2024-06-13T02:14:26.236678+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:24:46.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"100'8","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448985+0000","last_change":"2024-06-13T02:12:40.313765+0000","last_active":"2024-06-13T02:15:54.448985+0000","last_peered":"2024-06-13T02:15:54.448985+0000","last_clean":"2024-06-13T02:15:54.448985+0000","last_became_active":"2024-06-13T02:12:40.313426+0000","last_became_peered":"2024-06-13T02:12:40.313426+0000","last_unstale":"2024-06-13T02:15:54.448985+0000","last_undegraded":"2024-06-13T02:15:54.448985+0000","last_fullsized":"2024-06-13T02:15:54.448985+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:30:35.318939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"98'3","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740548+0000","last_change":"2024-06-13T02:12:35.817237+0000","last_active":"2024-06-13T02:14:25.740548+0000","last_peered":"2024-06-13T02:14:25.740548+0000","last_clean":"2024-06-13T02:14:25.740548+0000","last_became_active":"2024-06-13T02:12:35.816853+0000","last_became_peered":"2024-06-13T02:12:35.816853+0000","last_unstale":"2024-06-13T02:14:25.740548+0000","last_undegraded":"2024-06-13T02:14:25.740548+0000","last_fullsized":"2024-06-13T02:14:25.740548+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:19:23.502461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":379,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236247+0000","last_change":"2024-06-13T02:11:05.634471+0000","last_active":"2024-06-13T02:14:26.236247+0000","last_peered":"2024-06-13T02:14:26.236247+0000","last_clean":"2024-06-13T02:14:26.236247+0000","last_became_active":"2024-06-13T02:11:05.634064+0000","last_became_peered":"2024-06-13T02:11:05.634064+0000","last_unstale":"2024-06-13T02:14:26.236247+0000","last_undegraded":"2024-06-13T02:14:26.236247+0000","last_fullsized":"2024-06-13T02:14:26.236247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:07:11.045097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:07:11.045097+0000","last_clean_scrub_stamp":"2024-06-13T02:07:11.045097+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:00:00.419953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.108628+0000","last_change":"2024-06-13T02:14:26.108149+0000","last_active":"2024-06-13T02:14:26.108628+0000","last_peered":"2024-06-13T02:14:26.108628+0000","last_clean":"2024-06-13T02:14:26.108628+0000","last_became_active":"2024-06-13T02:14:26.107707+0000","last_became_peered":"2024-06-13T02:14:26.107707+0000","last_unstale":"2024-06-13T02:14:26.108628+0000","last_undegraded":"2024-06-13T02:14:26.108628+0000","last_fullsized":"2024-06-13T02:14:26.108628+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:47:51.314059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"100'5","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.451532+0000","last_change":"2024-06-13T02:12:40.295770+0000","last_active":"2024-06-13T02:15:54.451532+0000","last_peered":"2024-06-13T02:15:54.451532+0000","last_clean":"2024-06-13T02:15:54.451532+0000","last_became_active":"2024-06-13T02:12:40.295361+0000","last_became_peered":"2024-06-13T02:12:40.295361+0000","last_unstale":"2024-06-13T02:15:54.451532+0000","last_undegraded":"2024-06-13T02:15:54.451532+0000","last_fullsized":"2024-06-13T02:15:54.451532+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:04:42.982908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"98'3","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.236408+0000","last_change":"2024-06-13T02:12:35.808844+0000","last_active":"2024-06-13T02:14:26.236408+0000","last_peered":"2024-06-13T02:14:26.236408+0000","last_clean":"2024-06-13T02:14:26.236408+0000","last_became_active":"2024-06-13T02:12:35.808348+0000","last_became_peered":"2024-06-13T02:12:35.808348+0000","last_unstale":"2024-06-13T02:14:26.236408+0000","last_undegraded":"2024-06-13T02:14:26.236408+0000","last_fullsized":"2024-06-13T02:14:26.236408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:44:28.589169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716319+0000","last_change":"2024-06-13T02:12:54.605049+0000","last_active":"2024-06-13T02:14:25.716319+0000","last_peered":"2024-06-13T02:14:25.716319+0000","last_clean":"2024-06-13T02:14:25.716319+0000","last_became_active":"2024-06-13T02:12:54.604555+0000","last_became_peered":"2024-06-13T02:12:54.604555+0000","last_unstale":"2024-06-13T02:14:25.716319+0000","last_undegraded":"2024-06-13T02:14:25.716319+0000","last_fullsized":"2024-06-13T02:14:25.716319+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:19:58.615010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"98'1","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715890+0000","last_change":"2024-06-13T02:12:36.302966+0000","last_active":"2024-06-13T02:14:25.715890+0000","last_peered":"2024-06-13T02:14:25.715890+0000","last_clean":"2024-06-13T02:14:25.715890+0000","last_became_active":"2024-06-13T02:12:36.302529+0000","last_became_peered":"2024-06-13T02:12:36.302529+0000","last_unstale":"2024-06-13T02:14:25.715890+0000","last_undegraded":"2024-06-13T02:14:25.715890+0000","last_fullsized":"2024-06-13T02:14:25.715890+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:50:01.955647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"100'9","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.456215+0000","last_change":"2024-06-13T02:12:40.304742+0000","last_active":"2024-06-13T02:15:54.456215+0000","last_peered":"2024-06-13T02:15:54.456215+0000","last_clean":"2024-06-13T02:15:54.456215+0000","last_became_active":"2024-06-13T02:12:40.302152+0000","last_became_peered":"2024-06-13T02:12:40.302152+0000","last_unstale":"2024-06-13T02:15:54.456215+0000","last_undegraded":"2024-06-13T02:15:54.456215+0000","last_fullsized":"2024-06-13T02:15:54.456215+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:22:02.146739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739569+0000","last_change":"2024-06-13T02:12:54.661661+0000","last_active":"2024-06-13T02:14:26.739569+0000","last_peered":"2024-06-13T02:14:26.739569+0000","last_clean":"2024-06-13T02:14:26.739569+0000","last_became_active":"2024-06-13T02:12:54.661177+0000","last_became_peered":"2024-06-13T02:12:54.661177+0000","last_unstale":"2024-06-13T02:14:26.739569+0000","last_undegraded":"2024-06-13T02:14:26.739569+0000","last_fullsized":"2024-06-13T02:14:26.739569+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:48:59.612164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"100'14","reported_seq":59,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:44.873777+0000","last_change":"2024-06-13T02:12:35.824975+0000","last_active":"2024-06-13T02:14:44.873777+0000","last_peered":"2024-06-13T02:14:44.873777+0000","last_clean":"2024-06-13T02:14:44.873777+0000","last_became_active":"2024-06-13T02:12:35.823019+0000","last_became_peered":"2024-06-13T02:12:35.823019+0000","last_unstale":"2024-06-13T02:14:44.873777+0000","last_undegraded":"2024-06-13T02:14:44.873777+0000","last_fullsized":"2024-06-13T02:14:44.873777+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:53:53.693448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"100'5","reported_seq":21,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448763+0000","last_change":"2024-06-13T02:13:25.537457+0000","last_active":"2024-06-13T02:15:54.448763+0000","last_peered":"2024-06-13T02:15:54.448763+0000","last_clean":"2024-06-13T02:15:54.448763+0000","last_became_active":"2024-06-13T02:13:25.536943+0000","last_became_peered":"2024-06-13T02:13:25.536943+0000","last_unstale":"2024-06-13T02:15:54.448763+0000","last_undegraded":"2024-06-13T02:15:54.448763+0000","last_fullsized":"2024-06-13T02:15:54.448763+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:14:34.584058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.719528+0000","last_change":"2024-06-13T02:12:54.580657+0000","last_active":"2024-06-13T02:14:25.719528+0000","last_peered":"2024-06-13T02:14:25.719528+0000","last_clean":"2024-06-13T02:14:25.719528+0000","last_became_active":"2024-06-13T02:12:54.580073+0000","last_became_peered":"2024-06-13T02:12:54.580073+0000","last_unstale":"2024-06-13T02:14:25.719528+0000","last_undegraded":"2024-06-13T02:14:25.719528+0000","last_fullsized":"2024-06-13T02:14:25.719528+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:53:07.707587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"98'4","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740664+0000","last_change":"2024-06-13T02:12:36.520262+0000","last_active":"2024-06-13T02:14:25.740664+0000","last_peered":"2024-06-13T02:14:25.740664+0000","last_clean":"2024-06-13T02:14:25.740664+0000","last_became_active":"2024-06-13T02:12:36.519937+0000","last_became_peered":"2024-06-13T02:12:36.519937+0000","last_unstale":"2024-06-13T02:14:25.740664+0000","last_undegraded":"2024-06-13T02:14:25.740664+0000","last_fullsized":"2024-06-13T02:14:25.740664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:47:27.304345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.472079+0000","last_change":"2024-06-13T02:12:40.321399+0000","last_active":"2024-06-13T02:15:54.472079+0000","last_peered":"2024-06-13T02:15:54.472079+0000","last_clean":"2024-06-13T02:15:54.472079+0000","last_became_active":"2024-06-13T02:12:40.320977+0000","last_became_peered":"2024-06-13T02:12:40.320977+0000","last_unstale":"2024-06-13T02:15:54.472079+0000","last_undegraded":"2024-06-13T02:15:54.472079+0000","last_fullsized":"2024-06-13T02:15:54.472079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:28:29.076010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740573+0000","last_change":"2024-06-13T02:12:54.661615+0000","last_active":"2024-06-13T02:14:25.740573+0000","last_peered":"2024-06-13T02:14:25.740573+0000","last_clean":"2024-06-13T02:14:25.740573+0000","last_became_active":"2024-06-13T02:12:54.661188+0000","last_became_peered":"2024-06-13T02:12:54.661188+0000","last_unstale":"2024-06-13T02:14:25.740573+0000","last_undegraded":"2024-06-13T02:14:25.740573+0000","last_fullsized":"2024-06-13T02:14:25.740573+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:18:40.083105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"98'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.736935+0000","last_change":"2024-06-13T02:12:36.298425+0000","last_active":"2024-06-13T02:14:26.736935+0000","last_peered":"2024-06-13T02:14:26.736935+0000","last_clean":"2024-06-13T02:14:26.736935+0000","last_became_active":"2024-06-13T02:12:36.298053+0000","last_became_peered":"2024-06-13T02:12:36.298053+0000","last_unstale":"2024-06-13T02:14:26.736935+0000","last_undegraded":"2024-06-13T02:14:26.736935+0000","last_fullsized":"2024-06-13T02:14:26.736935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:22:22.374255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"100'2","reported_seq":41,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.421461+0000","last_change":"2024-06-13T02:12:40.291775+0000","last_active":"2024-06-13T02:15:54.421461+0000","last_peered":"2024-06-13T02:15:54.421461+0000","last_clean":"2024-06-13T02:15:54.421461+0000","last_became_active":"2024-06-13T02:12:40.291401+0000","last_became_peered":"2024-06-13T02:12:40.291401+0000","last_unstale":"2024-06-13T02:15:54.421461+0000","last_undegraded":"2024-06-13T02:15:54.421461+0000","last_fullsized":"2024-06-13T02:15:54.421461+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:13:59.921799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.721013+0000","last_change":"2024-06-13T02:12:54.592230+0000","last_active":"2024-06-13T02:14:25.721013+0000","last_peered":"2024-06-13T02:14:25.721013+0000","last_clean":"2024-06-13T02:14:25.721013+0000","last_became_active":"2024-06-13T02:12:54.591372+0000","last_became_peered":"2024-06-13T02:12:54.591372+0000","last_unstale":"2024-06-13T02:14:25.721013+0000","last_undegraded":"2024-06-13T02:14:25.721013+0000","last_fullsized":"2024-06-13T02:14:25.721013+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:36:19.684201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"98'3","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.739621+0000","last_change":"2024-06-13T02:12:35.819005+0000","last_active":"2024-06-13T02:14:26.739621+0000","last_peered":"2024-06-13T02:14:26.739621+0000","last_clean":"2024-06-13T02:14:26.739621+0000","last_became_active":"2024-06-13T02:12:35.817956+0000","last_became_peered":"2024-06-13T02:12:35.817956+0000","last_unstale":"2024-06-13T02:14:26.739621+0000","last_undegraded":"2024-06-13T02:14:26.739621+0000","last_fullsized":"2024-06-13T02:14:26.739621+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:58:32.303442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"100'9","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.463019+0000","last_change":"2024-06-13T02:12:40.303970+0000","last_active":"2024-06-13T02:15:54.463019+0000","last_peered":"2024-06-13T02:15:54.463019+0000","last_clean":"2024-06-13T02:15:54.463019+0000","last_became_active":"2024-06-13T02:12:40.303610+0000","last_became_peered":"2024-06-13T02:12:40.303610+0000","last_unstale":"2024-06-13T02:15:54.463019+0000","last_undegraded":"2024-06-13T02:15:54.463019+0000","last_fullsized":"2024-06-13T02:15:54.463019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:33:20.479137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"100'1","reported_seq":30,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:29.244424+0000","last_change":"2024-06-13T02:12:54.592039+0000","last_active":"2024-06-13T02:14:29.244424+0000","last_peered":"2024-06-13T02:14:29.244424+0000","last_clean":"2024-06-13T02:14:29.244424+0000","last_became_active":"2024-06-13T02:12:54.591555+0000","last_became_peered":"2024-06-13T02:12:54.591555+0000","last_unstale":"2024-06-13T02:14:29.244424+0000","last_undegraded":"2024-06-13T02:14:29.244424+0000","last_fullsized":"2024-06-13T02:14:29.244424+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:11:35.194690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"98'1","reported_seq":17,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.716440+0000","last_change":"2024-06-13T02:13:25.533227+0000","last_active":"2024-06-13T02:14:25.716440+0000","last_peered":"2024-06-13T02:14:25.716440+0000","last_clean":"2024-06-13T02:14:25.716440+0000","last_became_active":"2024-06-13T02:13:25.532837+0000","last_became_peered":"2024-06-13T02:13:25.532837+0000","last_unstale":"2024-06-13T02:14:25.716440+0000","last_undegraded":"2024-06-13T02:14:25.716440+0000","last_fullsized":"2024-06-13T02:14:25.716440+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T12:57:01.228063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"100'8","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.463803+0000","last_change":"2024-06-13T02:12:40.321759+0000","last_active":"2024-06-13T02:15:54.463803+0000","last_peered":"2024-06-13T02:15:54.463803+0000","last_clean":"2024-06-13T02:15:54.463803+0000","last_became_active":"2024-06-13T02:12:40.319837+0000","last_became_peered":"2024-06-13T02:12:40.319837+0000","last_unstale":"2024-06-13T02:15:54.463803+0000","last_undegraded":"2024-06-13T02:15:54.463803+0000","last_fullsized":"2024-06-13T02:15:54.463803+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T07:11:42.641990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740439+0000","last_change":"2024-06-13T02:12:54.661591+0000","last_active":"2024-06-13T02:14:25.740439+0000","last_peered":"2024-06-13T02:14:25.740439+0000","last_clean":"2024-06-13T02:14:25.740439+0000","last_became_active":"2024-06-13T02:12:54.661105+0000","last_became_peered":"2024-06-13T02:12:54.661105+0000","last_unstale":"2024-06-13T02:14:25.740439+0000","last_undegraded":"2024-06-13T02:14:25.740439+0000","last_fullsized":"2024-06-13T02:14:25.740439+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:29:12.625195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"98'4","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.715315+0000","last_change":"2024-06-13T02:12:35.810538+0000","last_active":"2024-06-13T02:14:25.715315+0000","last_peered":"2024-06-13T02:14:25.715315+0000","last_clean":"2024-06-13T02:14:25.715315+0000","last_became_active":"2024-06-13T02:12:35.810187+0000","last_became_peered":"2024-06-13T02:12:35.810187+0000","last_unstale":"2024-06-13T02:14:25.715315+0000","last_undegraded":"2024-06-13T02:14:25.715315+0000","last_fullsized":"2024-06-13T02:14:25.715315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:44:52.794144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"100'5","reported_seq":44,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.451619+0000","last_change":"2024-06-13T02:12:40.291366+0000","last_active":"2024-06-13T02:15:54.451619+0000","last_peered":"2024-06-13T02:15:54.451619+0000","last_clean":"2024-06-13T02:15:54.451619+0000","last_became_active":"2024-06-13T02:12:40.291034+0000","last_became_peered":"2024-06-13T02:12:40.291034+0000","last_unstale":"2024-06-13T02:15:54.451619+0000","last_undegraded":"2024-06-13T02:15:54.451619+0000","last_fullsized":"2024-06-13T02:15:54.451619+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:20:04.277456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.736836+0000","last_change":"2024-06-13T02:12:54.602337+0000","last_active":"2024-06-13T02:14:26.736836+0000","last_peered":"2024-06-13T02:14:26.736836+0000","last_clean":"2024-06-13T02:14:26.736836+0000","last_became_active":"2024-06-13T02:12:54.601858+0000","last_became_peered":"2024-06-13T02:12:54.601858+0000","last_unstale":"2024-06-13T02:14:26.736836+0000","last_undegraded":"2024-06-13T02:14:26.736836+0000","last_fullsized":"2024-06-13T02:14:26.736836+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:16:53.478460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"98'3","reported_seq":20,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.740375+0000","last_change":"2024-06-13T02:13:25.533798+0000","last_active":"2024-06-13T02:14:25.740375+0000","last_peered":"2024-06-13T02:14:25.740375+0000","last_clean":"2024-06-13T02:14:25.740375+0000","last_became_active":"2024-06-13T02:13:25.533439+0000","last_became_peered":"2024-06-13T02:13:25.533439+0000","last_unstale":"2024-06-13T02:14:25.740375+0000","last_undegraded":"2024-06-13T02:14:25.740375+0000","last_fullsized":"2024-06-13T02:14:25.740375+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T05:01:04.227804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448850+0000","last_change":"2024-06-13T02:12:40.295997+0000","last_active":"2024-06-13T02:15:54.448850+0000","last_peered":"2024-06-13T02:15:54.448850+0000","last_clean":"2024-06-13T02:15:54.448850+0000","last_became_active":"2024-06-13T02:12:40.295381+0000","last_became_peered":"2024-06-13T02:12:40.295381+0000","last_unstale":"2024-06-13T02:15:54.448850+0000","last_undegraded":"2024-06-13T02:15:54.448850+0000","last_fullsized":"2024-06-13T02:15:54.448850+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:32:58.777282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.713899+0000","last_change":"2024-06-13T02:12:54.598071+0000","last_active":"2024-06-13T02:14:25.713899+0000","last_peered":"2024-06-13T02:14:25.713899+0000","last_clean":"2024-06-13T02:14:25.713899+0000","last_became_active":"2024-06-13T02:12:54.597591+0000","last_became_peered":"2024-06-13T02:12:54.597591+0000","last_unstale":"2024-06-13T02:14:25.713899+0000","last_undegraded":"2024-06-13T02:14:25.713899+0000","last_fullsized":"2024-06-13T02:14:25.713899+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:27:51.141006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'1","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.475699+0000","last_change":"2024-06-13T02:12:35.823187+0000","last_active":"2024-06-13T02:14:26.475699+0000","last_peered":"2024-06-13T02:14:26.475699+0000","last_clean":"2024-06-13T02:14:26.475699+0000","last_became_active":"2024-06-13T02:12:35.822793+0000","last_became_peered":"2024-06-13T02:12:35.822793+0000","last_unstale":"2024-06-13T02:14:26.475699+0000","last_undegraded":"2024-06-13T02:14:26.475699+0000","last_fullsized":"2024-06-13T02:14:26.475699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:22:58.133740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"100'6","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.454003+0000","last_change":"2024-06-13T02:12:40.321013+0000","last_active":"2024-06-13T02:15:54.454003+0000","last_peered":"2024-06-13T02:15:54.454003+0000","last_clean":"2024-06-13T02:15:54.454003+0000","last_became_active":"2024-06-13T02:12:40.320696+0000","last_became_peered":"2024-06-13T02:12:40.320696+0000","last_unstale":"2024-06-13T02:15:54.454003+0000","last_undegraded":"2024-06-13T02:15:54.454003+0000","last_fullsized":"2024-06-13T02:15:54.454003+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:05:38.156687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:26.474650+0000","last_change":"2024-06-13T02:12:54.579717+0000","last_active":"2024-06-13T02:14:26.474650+0000","last_peered":"2024-06-13T02:14:26.474650+0000","last_clean":"2024-06-13T02:14:26.474650+0000","last_became_active":"2024-06-13T02:12:54.579285+0000","last_became_peered":"2024-06-13T02:12:54.579285+0000","last_unstale":"2024-06-13T02:14:26.474650+0000","last_undegraded":"2024-06-13T02:14:26.474650+0000","last_fullsized":"2024-06-13T02:14:26.474650+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:53.531243+0000","last_clean_scrub_stamp":"2024-06-13T02:12:53.531243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:03:41.796709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'2","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:14:25.721170+0000","last_change":"2024-06-13T02:12:35.824481+0000","last_active":"2024-06-13T02:14:25.721170+0000","last_peered":"2024-06-13T02:14:25.721170+0000","last_clean":"2024-06-13T02:14:25.721170+0000","last_became_active":"2024-06-13T02:12:35.823934+0000","last_became_peered":"2024-06-13T02:12:35.823934+0000","last_unstale":"2024-06-13T02:14:25.721170+0000","last_undegraded":"2024-06-13T02:14:25.721170+0000","last_fullsized":"2024-06-13T02:14:25.721170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:34.768612+0000","last_clean_scrub_stamp":"2024-06-13T02:12:34.768612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:02:25.802124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"100'9","reported_seq":48,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.447638+0000","last_change":"2024-06-13T02:12:40.289323+0000","last_active":"2024-06-13T02:15:54.447638+0000","last_peered":"2024-06-13T02:15:54.447638+0000","last_clean":"2024-06-13T02:15:54.447638+0000","last_became_active":"2024-06-13T02:12:40.288919+0000","last_became_peered":"2024-06-13T02:12:40.288919+0000","last_unstale":"2024-06-13T02:15:54.447638+0000","last_undegraded":"2024-06-13T02:15:54.447638+0000","last_fullsized":"2024-06-13T02:15:54.447638+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:02:51.344467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"100'9","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.448009+0000","last_change":"2024-06-13T02:12:40.294208+0000","last_active":"2024-06-13T02:15:54.448009+0000","last_peered":"2024-06-13T02:15:54.448009+0000","last_clean":"2024-06-13T02:15:54.448009+0000","last_became_active":"2024-06-13T02:12:40.293837+0000","last_became_peered":"2024-06-13T02:12:40.293837+0000","last_unstale":"2024-06-13T02:15:54.448009+0000","last_undegraded":"2024-06-13T02:15:54.448009+0000","last_fullsized":"2024-06-13T02:15:54.448009+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T10:32:46.328382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"100'12","reported_seq":51,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.438664+0000","last_change":"2024-06-13T02:12:40.303315+0000","last_active":"2024-06-13T02:15:54.438664+0000","last_peered":"2024-06-13T02:15:54.438664+0000","last_clean":"2024-06-13T02:15:54.438664+0000","last_became_active":"2024-06-13T02:12:40.302937+0000","last_became_peered":"2024-06-13T02:12:40.302937+0000","last_unstale":"2024-06-13T02:15:54.438664+0000","last_undegraded":"2024-06-13T02:15:54.438664+0000","last_fullsized":"2024-06-13T02:15:54.438664+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:51:19.510819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"100'8","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.465418+0000","last_change":"2024-06-13T02:12:40.322013+0000","last_active":"2024-06-13T02:15:54.465418+0000","last_peered":"2024-06-13T02:15:54.465418+0000","last_clean":"2024-06-13T02:15:54.465418+0000","last_became_active":"2024-06-13T02:12:40.321695+0000","last_became_peered":"2024-06-13T02:12:40.321695+0000","last_unstale":"2024-06-13T02:15:54.465418+0000","last_undegraded":"2024-06-13T02:15:54.465418+0000","last_fullsized":"2024-06-13T02:15:54.465418+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T13:42:28.101373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"100'7","reported_seq":46,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.471261+0000","last_change":"2024-06-13T02:12:40.306898+0000","last_active":"2024-06-13T02:15:54.471261+0000","last_peered":"2024-06-13T02:15:54.471261+0000","last_clean":"2024-06-13T02:15:54.471261+0000","last_became_active":"2024-06-13T02:12:40.306177+0000","last_became_peered":"2024-06-13T02:12:40.306177+0000","last_unstale":"2024-06-13T02:15:54.471261+0000","last_undegraded":"2024-06-13T02:15:54.471261+0000","last_fullsized":"2024-06-13T02:15:54.471261+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T14:11:22.747829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"100'4","reported_seq":43,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.464297+0000","last_change":"2024-06-13T02:12:40.307681+0000","last_active":"2024-06-13T02:15:54.464297+0000","last_peered":"2024-06-13T02:15:54.464297+0000","last_clean":"2024-06-13T02:15:54.464297+0000","last_became_active":"2024-06-13T02:12:40.307310+0000","last_became_peered":"2024-06-13T02:12:40.307310+0000","last_unstale":"2024-06-13T02:15:54.464297+0000","last_undegraded":"2024-06-13T02:15:54.464297+0000","last_fullsized":"2024-06-13T02:15:54.464297+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:53:35.493392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"100'6","reported_seq":43,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.447299+0000","last_change":"2024-06-13T02:12:40.293834+0000","last_active":"2024-06-13T02:15:54.447299+0000","last_peered":"2024-06-13T02:15:54.447299+0000","last_clean":"2024-06-13T02:15:54.447299+0000","last_became_active":"2024-06-13T02:12:40.293447+0000","last_became_peered":"2024-06-13T02:12:40.293447+0000","last_unstale":"2024-06-13T02:15:54.447299+0000","last_undegraded":"2024-06-13T02:15:54.447299+0000","last_fullsized":"2024-06-13T02:15:54.447299+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:26:36.375311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"100'15","reported_seq":54,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.445927+0000","last_change":"2024-06-13T02:12:40.301005+0000","last_active":"2024-06-13T02:15:54.445927+0000","last_peered":"2024-06-13T02:15:54.445927+0000","last_clean":"2024-06-13T02:15:54.445927+0000","last_became_active":"2024-06-13T02:12:40.300628+0000","last_became_peered":"2024-06-13T02:12:40.300628+0000","last_unstale":"2024-06-13T02:15:54.445927+0000","last_undegraded":"2024-06-13T02:15:54.445927+0000","last_fullsized":"2024-06-13T02:15:54.445927+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T03:08:42.472344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"100'2","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.431525+0000","last_change":"2024-06-13T02:13:25.582315+0000","last_active":"2024-06-13T02:15:54.431525+0000","last_peered":"2024-06-13T02:15:54.431525+0000","last_clean":"2024-06-13T02:15:54.431525+0000","last_became_active":"2024-06-13T02:13:25.581900+0000","last_became_peered":"2024-06-13T02:13:25.581900+0000","last_unstale":"2024-06-13T02:15:54.431525+0000","last_undegraded":"2024-06-13T02:15:54.431525+0000","last_fullsized":"2024-06-13T02:15:54.431525+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T11:10:34.523785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"100'6","reported_seq":22,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.461047+0000","last_change":"2024-06-13T02:13:25.535789+0000","last_active":"2024-06-13T02:15:54.461047+0000","last_peered":"2024-06-13T02:15:54.461047+0000","last_clean":"2024-06-13T02:15:54.461047+0000","last_became_active":"2024-06-13T02:13:25.535433+0000","last_became_peered":"2024-06-13T02:13:25.535433+0000","last_unstale":"2024-06-13T02:15:54.461047+0000","last_undegraded":"2024-06-13T02:15:54.461047+0000","last_fullsized":"2024-06-13T02:15:54.461047+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T08:42:48.200317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"100'8","reported_seq":47,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.456114+0000","last_change":"2024-06-13T02:12:40.317353+0000","last_active":"2024-06-13T02:15:54.456114+0000","last_peered":"2024-06-13T02:15:54.456114+0000","last_clean":"2024-06-13T02:15:54.456114+0000","last_became_active":"2024-06-13T02:12:40.316957+0000","last_became_peered":"2024-06-13T02:12:40.316957+0000","last_unstale":"2024-06-13T02:15:54.456114+0000","last_undegraded":"2024-06-13T02:15:54.456114+0000","last_fullsized":"2024-06-13T02:15:54.456114+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T04:53:01.190200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"100'10","reported_seq":49,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.458826+0000","last_change":"2024-06-13T02:12:40.324827+0000","last_active":"2024-06-13T02:15:54.458826+0000","last_peered":"2024-06-13T02:15:54.458826+0000","last_clean":"2024-06-13T02:15:54.458826+0000","last_became_active":"2024-06-13T02:12:40.324436+0000","last_became_peered":"2024-06-13T02:12:40.324436+0000","last_unstale":"2024-06-13T02:15:54.458826+0000","last_undegraded":"2024-06-13T02:15:54.458826+0000","last_fullsized":"2024-06-13T02:15:54.458826+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T09:23:44.382731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"100'11","reported_seq":50,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.475362+0000","last_change":"2024-06-13T02:12:40.308679+0000","last_active":"2024-06-13T02:15:54.475362+0000","last_peered":"2024-06-13T02:15:54.475362+0000","last_clean":"2024-06-13T02:15:54.475362+0000","last_became_active":"2024-06-13T02:12:40.308153+0000","last_became_peered":"2024-06-13T02:12:40.308153+0000","last_unstale":"2024-06-13T02:15:54.475362+0000","last_undegraded":"2024-06-13T02:15:54.475362+0000","last_fullsized":"2024-06-13T02:15:54.475362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:19:53.976190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"100'8","reported_seq":45,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-06-13T02:15:54.441380+0000","last_change":"2024-06-13T02:12:40.297489+0000","last_active":"2024-06-13T02:15:54.441380+0000","last_peered":"2024-06-13T02:15:54.441380+0000","last_clean":"2024-06-13T02:15:54.441380+0000","last_became_active":"2024-06-13T02:12:40.297026+0000","last_became_peered":"2024-06-13T02:12:40.297026+0000","last_unstale":"2024-06-13T02:15:54.441380+0000","last_undegraded":"2024-06-13T02:15:54.441380+0000","last_fullsized":"2024-06-13T02:15:54.441380+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-13T02:12:39.264252+0000","last_clean_scrub_stamp":"2024-06-13T02:12:39.264252+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-14T06:35:36.110972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67917,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":750,"num_read_kb":448,"num_write":176,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":203751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351036,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28144,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717008,"statfs":{"total":95995035648,"available":95966216192,"internally_reserved":0,"allocated":1155072,"data_stored":573205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612672,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28812,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716340,"statfs":{"total":95995035648,"available":95965532160,"internally_reserved":0,"allocated":1839104,"data_stored":1224668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776198,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1167360,"data_stored":577425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037836,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28144,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717008,"statfs":{"total":95995035648,"available":95966216192,"internally_reserved":0,"allocated":1155072,"data_stored":573137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299473,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28732,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716420,"statfs":{"total":95995035648,"available":95965614080,"internally_reserved":0,"allocated":1757184,"data_stored":1168767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863463000,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36452,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708700,"statfs":{"total":95995035648,"available":95957708800,"internally_reserved":0,"allocated":1142784,"data_stored":568505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36520,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708632,"statfs":{"total":95995035648,"available":95957639168,"internally_reserved":0,"allocated":1212416,"data_stored":632722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738489,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1167360,"data_stored":569893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411438,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36540,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708612,"statfs":{"total":95995035648,"available":95957618688,"internally_reserved":0,"allocated":1232896,"data_stored":633490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149800,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32304,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712848,"statfs":{"total":95995035648,"available":95961956352,"internally_reserved":0,"allocated":1155072,"data_stored":568699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888163,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1159168,"data_stored":573737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724637,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37060,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708092,"statfs":{"total":95995035648,"available":95957086208,"internally_reserved":0,"allocated":1765376,"data_stored":1164355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-13T02:16:14.282 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-13T02:16:14.282 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-13T02:16:14.282 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-06-13T02:16:14.282 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph health --format=json 2024-06-13T02:16:14.802 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:16:14.981 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:14 smithi002 ceph-mon[31960]: from='client.24916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:16:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:14 smithi175 ceph-mon[36977]: from='client.24916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:16:15.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:14 smithi084 ceph-mon[36833]: from='client.24916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-13T02:16:15.984 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:15 smithi002 ceph-mon[31960]: pgmap v445: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:16:16.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:15 smithi175 ceph-mon[36977]: pgmap v445: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:16:16.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:15 smithi084 ceph-mon[36833]: pgmap v445: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:16:17.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.135+0000 7f31d6800700 1 -- 172.21.15.2:0/989310568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d0108500 msgr2=0x7f31d01088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:17.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.135+0000 7f31d6800700 1 --2- 172.21.15.2:0/989310568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d0108500 0x7f31d01088e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009990 tx=0x7f31c0009ca0 comp rx=0 tx=0).stop 2024-06-13T02:16:17.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.135+0000 7f31d6800700 1 -- 172.21.15.2:0/989310568 shutdown_connections 2024-06-13T02:16:17.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.135+0000 7f31d6800700 1 --2- 172.21.15.2:0/989310568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d006ab30 0x7f31d010f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:17.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.135+0000 7f31d6800700 1 --2- 172.21.15.2:0/989310568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d0108500 0x7f31d01088e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:17.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.135+0000 7f31d6800700 1 --2- 172.21.15.2:0/989310568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d006a170 0x7f31d006a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:17.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.135+0000 7f31d6800700 1 -- 172.21.15.2:0/989310568 >> 172.21.15.2:0/989310568 conn(0x7f31d0078340 msgr2=0x7f31d0078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:17.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.135+0000 7f31d6800700 1 -- 172.21.15.2:0/989310568 shutdown_connections 2024-06-13T02:16:17.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.135+0000 7f31d6800700 1 -- 172.21.15.2:0/989310568 wait complete. 2024-06-13T02:16:17.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.136+0000 7f31d6800700 1 Processor -- start 2024-06-13T02:16:17.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.136+0000 7f31d6800700 1 -- start start 2024-06-13T02:16:17.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.137+0000 7f31d6800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d006a170 0x7f31d019af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:17.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.137+0000 7f31d6800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d006ab30 0x7f31d019b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:17.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.137+0000 7f31d6800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d0108500 0x7f31d019f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:17.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.137+0000 7f31d6800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0112780 con 0x7f31d006a170 2024-06-13T02:16:17.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.137+0000 7f31d6800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0112600 con 0x7f31d006ab30 2024-06-13T02:16:17.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.137+0000 7f31d6800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0112900 con 0x7f31d0108500 2024-06-13T02:16:17.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.137+0000 7f31cf400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d006a170 0x7f31d019af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:17.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.137+0000 7f31cf400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d006a170 0x7f31d019af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38800/0 (socket says 172.21.15.2:38800) 2024-06-13T02:16:17.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.137+0000 7f31c6a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d006ab30 0x7f31d019b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:17.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.137+0000 7f31cf400700 1 -- 172.21.15.2:0/4141504054 learned_addr learned my addr 172.21.15.2:0/4141504054 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:17.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.137+0000 7f31cfe00700 1 --2- 172.21.15.2:0/4141504054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d0108500 0x7f31d019f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:17.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.138+0000 7f31c6a00700 1 -- 172.21.15.2:0/4141504054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d0108500 msgr2=0x7f31d019f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:17.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.138+0000 7f31c6a00700 1 --2- 172.21.15.2:0/4141504054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d0108500 0x7f31d019f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:17.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.138+0000 7f31c6a00700 1 -- 172.21.15.2:0/4141504054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d006a170 msgr2=0x7f31d019af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:17.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.138+0000 7f31c6a00700 1 --2- 172.21.15.2:0/4141504054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d006a170 0x7f31d019af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:17.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.138+0000 7f31c6a00700 1 -- 172.21.15.2:0/4141504054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d019fec0 con 0x7f31d006ab30 2024-06-13T02:16:17.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.138+0000 7f31c6a00700 1 --2- 172.21.15.2:0/4141504054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d006ab30 0x7f31d019b440 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f31b800e9f0 tx=0x7f31b800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:17.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.138+0000 7f31ccc00700 1 -- 172.21.15.2:0/4141504054 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b800c9c0 con 0x7f31d006ab30 2024-06-13T02:16:17.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.138+0000 7f31ccc00700 1 -- 172.21.15.2:0/4141504054 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31b800cb60 con 0x7f31d006ab30 2024-06-13T02:16:17.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.138+0000 7f31d6800700 1 -- 172.21.15.2:0/4141504054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d01a01b0 con 0x7f31d006ab30 2024-06-13T02:16:17.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.138+0000 7f31ccc00700 1 -- 172.21.15.2:0/4141504054 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8018680 con 0x7f31d006ab30 2024-06-13T02:16:17.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.138+0000 7f31d6800700 1 -- 172.21.15.2:0/4141504054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d01a7a30 con 0x7f31d006ab30 2024-06-13T02:16:17.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.139+0000 7f31d6800700 1 -- 172.21.15.2:0/4141504054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d0069180 con 0x7f31d006ab30 2024-06-13T02:16:17.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.142+0000 7f31ccc00700 1 -- 172.21.15.2:0/4141504054 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f31b8010430 con 0x7f31d006ab30 2024-06-13T02:16:17.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.143+0000 7f31ccc00700 1 --2- 172.21.15.2:0/4141504054 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f31b40a2c20 0x7f31b40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:17.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.143+0000 7f31ccc00700 1 -- 172.21.15.2:0/4141504054 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f31b80cf8e0 con 0x7f31d006ab30 2024-06-13T02:16:17.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.143+0000 7f31cf400700 1 --2- 172.21.15.2:0/4141504054 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f31b40a2c20 0x7f31b40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:17.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.144+0000 7f31cf400700 1 --2- 172.21.15.2:0/4141504054 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f31b40a2c20 0x7f31b40a50e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f31c0006010 tx=0x7f31c0009590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:17.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.145+0000 7f31ccc00700 1 -- 172.21.15.2:0/4141504054 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f31b809c3f0 con 0x7f31d006ab30 2024-06-13T02:16:17.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.427+0000 7f31d6800700 1 -- 172.21.15.2:0/4141504054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f31d01a7c00 con 0x7f31d006ab30 2024-06-13T02:16:17.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.428+0000 7f31ccc00700 1 -- 172.21.15.2:0/4141504054 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f31b809bcf0 con 0x7f31d006ab30 2024-06-13T02:16:17.429 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:16:17.429 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-13T02:16:17.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.431+0000 7f31d6800700 1 -- 172.21.15.2:0/4141504054 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f31b40a2c20 msgr2=0x7f31b40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:17.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.431+0000 7f31d6800700 1 --2- 172.21.15.2:0/4141504054 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f31b40a2c20 0x7f31b40a50e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f31c0006010 tx=0x7f31c0009590 comp rx=0 tx=0).stop 2024-06-13T02:16:17.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.431+0000 7f31d6800700 1 -- 172.21.15.2:0/4141504054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d006ab30 msgr2=0x7f31d019b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:17.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.431+0000 7f31d6800700 1 --2- 172.21.15.2:0/4141504054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d006ab30 0x7f31d019b440 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f31b800e9f0 tx=0x7f31b800ed00 comp rx=0 tx=0).stop 2024-06-13T02:16:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.431+0000 7f31d6800700 1 -- 172.21.15.2:0/4141504054 shutdown_connections 2024-06-13T02:16:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.431+0000 7f31d6800700 1 --2- 172.21.15.2:0/4141504054 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f31b40a2c20 0x7f31b40a50e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.431+0000 7f31d6800700 1 --2- 172.21.15.2:0/4141504054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d0108500 0x7f31d019f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.431+0000 7f31d6800700 1 --2- 172.21.15.2:0/4141504054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31d006a170 0x7f31d019af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.431+0000 7f31d6800700 1 --2- 172.21.15.2:0/4141504054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31d006ab30 0x7f31d019b440 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:17.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.431+0000 7f31d6800700 1 -- 172.21.15.2:0/4141504054 >> 172.21.15.2:0/4141504054 conn(0x7f31d0078340 msgr2=0x7f31d00ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.432+0000 7f31d6800700 1 -- 172.21.15.2:0/4141504054 shutdown_connections 2024-06-13T02:16:17.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:17.432+0000 7f31d6800700 1 -- 172.21.15.2:0/4141504054 wait complete. 2024-06-13T02:16:18.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:17 smithi175 ceph-mon[36977]: pgmap v446: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:16:18.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:17 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/4141504054' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-13T02:16:18.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:17 smithi002 ceph-mon[31960]: pgmap v446: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:16:18.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:17 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/4141504054' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-13T02:16:18.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:17 smithi084 ceph-mon[36833]: pgmap v446: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:16:18.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:17 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/4141504054' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-13T02:16:18.249 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-06-13T02:16:18.250 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:16:18.733 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:16:20.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:19 smithi175 ceph-mon[36977]: pgmap v447: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:16:20.073 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:19 smithi002 ceph-mon[31960]: pgmap v447: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:16:20.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:19 smithi084 ceph-mon[36833]: pgmap v447: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:16:21.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.018+0000 7fb99be00700 1 -- 172.21.15.2:0/3293180934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb99c1076e0 msgr2=0x7fb99c10f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.018+0000 7fb99be00700 1 --2- 172.21.15.2:0/3293180934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb99c1076e0 0x7fb99c10f2b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb9940099c0 tx=0x7fb994009cd0 comp rx=0 tx=0).stop 2024-06-13T02:16:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.018+0000 7fb99be00700 1 -- 172.21.15.2:0/3293180934 shutdown_connections 2024-06-13T02:16:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.018+0000 7fb99be00700 1 --2- 172.21.15.2:0/3293180934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb99c1076e0 0x7fb99c10f2b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.018+0000 7fb99be00700 1 --2- 172.21.15.2:0/3293180934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c102600 0x7fb99c1029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.018+0000 7fb99be00700 1 --2- 172.21.15.2:0/3293180934 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb99c102fb0 0x7fb99c107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.018+0000 7fb99be00700 1 -- 172.21.15.2:0/3293180934 >> 172.21.15.2:0/3293180934 conn(0x7fb99c0fdeb0 msgr2=0x7fb99c1002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.018+0000 7fb99be00700 1 -- 172.21.15.2:0/3293180934 shutdown_connections 2024-06-13T02:16:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.018+0000 7fb99be00700 1 -- 172.21.15.2:0/3293180934 wait complete. 2024-06-13T02:16:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.019+0000 7fb99be00700 1 Processor -- start 2024-06-13T02:16:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.019+0000 7fb99be00700 1 -- start start 2024-06-13T02:16:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.020+0000 7fb99be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb99c102600 0x7fb99c19ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.020+0000 7fb99be00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb99c102fb0 0x7fb99c19b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.020+0000 7fb99be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c1076e0 0x7fb99c19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.020+0000 7fb99be00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c112740 con 0x7fb99c1076e0 2024-06-13T02:16:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.020+0000 7fb99be00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1125c0 con 0x7fb99c102600 2024-06-13T02:16:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.020+0000 7fb99be00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1128c0 con 0x7fb99c102fb0 2024-06-13T02:16:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.020+0000 7fb99b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c1076e0 0x7fb99c19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.020+0000 7fb99aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb99c102600 0x7fb99c19ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.020+0000 7fb99a000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb99c102fb0 0x7fb99c19b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.020+0000 7fb99aa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb99c102600 0x7fb99c19ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:48830/0 (socket says 172.21.15.2:48830) 2024-06-13T02:16:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.020+0000 7fb99aa00700 1 -- 172.21.15.2:0/241377872 learned_addr learned my addr 172.21.15.2:0/241377872 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.020+0000 7fb99aa00700 1 -- 172.21.15.2:0/241377872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb99c102fb0 msgr2=0x7fb99c19b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.020+0000 7fb99aa00700 1 --2- 172.21.15.2:0/241377872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb99c102fb0 0x7fb99c19b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.021+0000 7fb99aa00700 1 -- 172.21.15.2:0/241377872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c1076e0 msgr2=0x7fb99c19f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.021+0000 7fb99aa00700 1 --2- 172.21.15.2:0/241377872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c1076e0 0x7fb99c19f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.021+0000 7fb99aa00700 1 -- 172.21.15.2:0/241377872 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c19fd80 con 0x7fb99c102600 2024-06-13T02:16:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.021+0000 7fb99aa00700 1 --2- 172.21.15.2:0/241377872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb99c102600 0x7fb99c19ad70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00ef10 tx=0x7fb98c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.021+0000 7fb993400700 1 -- 172.21.15.2:0/241377872 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c00c9c0 con 0x7fb99c102600 2024-06-13T02:16:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.021+0000 7fb993400700 1 -- 172.21.15.2:0/241377872 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb98c019070 con 0x7fb99c102600 2024-06-13T02:16:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.021+0000 7fb993400700 1 -- 172.21.15.2:0/241377872 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c007e60 con 0x7fb99c102600 2024-06-13T02:16:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.021+0000 7fb99be00700 1 -- 172.21.15.2:0/241377872 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99c1a0010 con 0x7fb99c102600 2024-06-13T02:16:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.021+0000 7fb99be00700 1 -- 172.21.15.2:0/241377872 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99c1a78f0 con 0x7fb99c102600 2024-06-13T02:16:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.023+0000 7fb99be00700 1 -- 172.21.15.2:0/241377872 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb99c069180 con 0x7fb99c102600 2024-06-13T02:16:21.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.024+0000 7fb993400700 1 -- 172.21.15.2:0/241377872 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fb98c012050 con 0x7fb99c102600 2024-06-13T02:16:21.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.026+0000 7fb993400700 1 --2- 172.21.15.2:0/241377872 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb9800a2c20 0x7fb9800a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:21.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.026+0000 7fb993400700 1 -- 172.21.15.2:0/241377872 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fb98c0cf410 con 0x7fb99c102600 2024-06-13T02:16:21.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.026+0000 7fb99a000700 1 --2- 172.21.15.2:0/241377872 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb9800a2c20 0x7fb9800a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:21.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.027+0000 7fb99a000700 1 --2- 172.21.15.2:0/241377872 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb9800a2c20 0x7fb9800a50e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb99c101930 tx=0x7fb988009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:21.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.030+0000 7fb993400700 1 -- 172.21.15.2:0/241377872 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb98c010040 con 0x7fb99c102600 2024-06-13T02:16:21.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.308+0000 7fb99be00700 1 -- 172.21.15.2:0/241377872 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb99c1a7ac0 con 0x7fb99c102600 2024-06-13T02:16:21.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.310+0000 7fb993400700 1 -- 172.21.15.2:0/241377872 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11857 (secure 0 0 0) 0x7fb98c09bf20 con 0x7fb99c102600 2024-06-13T02:16:21.311 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:16:21.311 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3458450195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3458450195},{"type":"v1","addr":"172.21.15.2:6841","nonce":3458450195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1709394731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1709394731},{"type":"v1","addr":"172.21.15.175:6835","nonce":1709394731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T02:12:43.063161+0000","modified":"2024-06-13T02:14:13.553770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24503,"mds_2":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/2403775181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2403775181},{"type":"v1","addr":"172.21.15.84:6835","nonce":2403775181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/1446546569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1446546569},{"type":"v1","addr":"172.21.15.175:6837","nonce":1446546569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/2537381027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2537381027},{"type":"v1","addr":"172.21.15.84:6837","nonce":2537381027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/2743442301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":2743442301},{"type":"v1","addr":"172.21.15.175:6839","nonce":2743442301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":29,"addr":"172.21.15.2:6839/3208917373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3208917373},{"type":"v1","addr":"172.21.15.2:6839","nonce":3208917373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6839/541041266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":541041266},{"type":"v1","addr":"172.21.15.84:6839","nonce":541041266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24503,24527,24490]},"id":1}]} 2024-06-13T02:16:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.314+0000 7fb99be00700 1 -- 172.21.15.2:0/241377872 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb9800a2c20 msgr2=0x7fb9800a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.314+0000 7fb99be00700 1 --2- 172.21.15.2:0/241377872 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb9800a2c20 0x7fb9800a50e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb99c101930 tx=0x7fb988009260 comp rx=0 tx=0).stop 2024-06-13T02:16:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.314+0000 7fb99be00700 1 -- 172.21.15.2:0/241377872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb99c102600 msgr2=0x7fb99c19ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:21.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.314+0000 7fb99be00700 1 --2- 172.21.15.2:0/241377872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb99c102600 0x7fb99c19ad70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00ef10 tx=0x7fb98c00c3a0 comp rx=0 tx=0).stop 2024-06-13T02:16:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.314+0000 7fb99be00700 1 -- 172.21.15.2:0/241377872 shutdown_connections 2024-06-13T02:16:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.314+0000 7fb99be00700 1 --2- 172.21.15.2:0/241377872 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb9800a2c20 0x7fb9800a50e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.314+0000 7fb99be00700 1 --2- 172.21.15.2:0/241377872 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb99c1076e0 0x7fb99c19f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.314+0000 7fb99be00700 1 --2- 172.21.15.2:0/241377872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb99c102600 0x7fb99c19ad70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.314+0000 7fb99be00700 1 --2- 172.21.15.2:0/241377872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb99c102fb0 0x7fb99c19b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.314+0000 7fb99be00700 1 -- 172.21.15.2:0/241377872 >> 172.21.15.2:0/241377872 conn(0x7fb99c0fdeb0 msgr2=0x7fb99c10dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.314+0000 7fb99be00700 1 -- 172.21.15.2:0/241377872 shutdown_connections 2024-06-13T02:16:21.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:21.314+0000 7fb99be00700 1 -- 172.21.15.2:0/241377872 wait complete. 2024-06-13T02:16:21.316 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-06-13T02:16:22.023 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:21 smithi084 ceph-mon[36833]: pgmap v448: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:16:22.023 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:21 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/241377872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:16:22.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:21 smithi175 ceph-mon[36977]: pgmap v448: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:16:22.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:21 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/241377872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:16:22.057 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:21 smithi002 ceph-mon[31960]: pgmap v448: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:16:22.057 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:21 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/241377872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:16:22.123 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:16:22.591 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:16:23.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:23 smithi002 ceph-mon[31960]: pgmap v449: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:16:24.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:23 smithi175 ceph-mon[36977]: pgmap v449: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:16:24.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:23 smithi084 ceph-mon[36833]: pgmap v449: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:16:24.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.805+0000 7fab36e00700 1 -- 172.21.15.2:0/984842441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab30102fd0 msgr2=0x7fab30107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:24.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.805+0000 7fab36e00700 1 --2- 172.21.15.2:0/984842441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab30102fd0 0x7fab30107020 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0099c0 tx=0x7fab1c009cd0 comp rx=0 tx=0).stop 2024-06-13T02:16:24.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.805+0000 7fab36e00700 1 -- 172.21.15.2:0/984842441 shutdown_connections 2024-06-13T02:16:24.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.805+0000 7fab36e00700 1 --2- 172.21.15.2:0/984842441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab30107700 0x7fab3010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:24.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.805+0000 7fab36e00700 1 --2- 172.21.15.2:0/984842441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab30102620 0x7fab30102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:24.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.806+0000 7fab36e00700 1 --2- 172.21.15.2:0/984842441 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab30102fd0 0x7fab30107020 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:24.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.806+0000 7fab36e00700 1 -- 172.21.15.2:0/984842441 >> 172.21.15.2:0/984842441 conn(0x7fab300fdf10 msgr2=0x7fab30100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:24.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.806+0000 7fab36e00700 1 -- 172.21.15.2:0/984842441 shutdown_connections 2024-06-13T02:16:24.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.806+0000 7fab36e00700 1 -- 172.21.15.2:0/984842441 wait complete. 2024-06-13T02:16:24.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.807+0000 7fab36e00700 1 Processor -- start 2024-06-13T02:16:24.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.807+0000 7fab36e00700 1 -- start start 2024-06-13T02:16:24.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.807+0000 7fab36e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab30102620 0x7fab3019ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:24.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.807+0000 7fab36e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab30102fd0 0x7fab3019b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:24.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.807+0000 7fab36e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab30107700 0x7fab3019f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:24.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.808+0000 7fab36e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fab30112730 con 0x7fab30102620 2024-06-13T02:16:24.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.808+0000 7fab36e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fab301125b0 con 0x7fab30107700 2024-06-13T02:16:24.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.808+0000 7fab36e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fab301128b0 con 0x7fab30102fd0 2024-06-13T02:16:24.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.808+0000 7fab35000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab30102fd0 0x7fab3019b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:24.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.808+0000 7fab35a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab30102620 0x7fab3019ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:24.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.808+0000 7fab35000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab30102fd0 0x7fab3019b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:59168/0 (socket says 172.21.15.2:59168) 2024-06-13T02:16:24.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.808+0000 7fab35000700 1 -- 172.21.15.2:0/2502079136 learned_addr learned my addr 172.21.15.2:0/2502079136 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:24.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.808+0000 7fab36400700 1 --2- 172.21.15.2:0/2502079136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab30107700 0x7fab3019f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:24.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.808+0000 7fab35000700 1 -- 172.21.15.2:0/2502079136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab30107700 msgr2=0x7fab3019f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:24.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.808+0000 7fab35000700 1 --2- 172.21.15.2:0/2502079136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab30107700 0x7fab3019f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:24.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.808+0000 7fab35000700 1 -- 172.21.15.2:0/2502079136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab30102620 msgr2=0x7fab3019ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:24.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.808+0000 7fab35000700 1 --2- 172.21.15.2:0/2502079136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab30102620 0x7fab3019ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:24.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.808+0000 7fab35000700 1 -- 172.21.15.2:0/2502079136 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3019fe50 con 0x7fab30102fd0 2024-06-13T02:16:24.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.809+0000 7fab35000700 1 --2- 172.21.15.2:0/2502079136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab30102fd0 0x7fab3019b380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fab1c00fa00 tx=0x7fab1c00fa30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:24.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.809+0000 7fab2e000700 1 -- 172.21.15.2:0/2502079136 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1c027070 con 0x7fab30102fd0 2024-06-13T02:16:24.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.809+0000 7fab2e000700 1 -- 172.21.15.2:0/2502079136 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab1c003680 con 0x7fab30102fd0 2024-06-13T02:16:24.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.809+0000 7fab2e000700 1 -- 172.21.15.2:0/2502079136 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1c0173f0 con 0x7fab30102fd0 2024-06-13T02:16:24.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.809+0000 7fab36e00700 1 -- 172.21.15.2:0/2502079136 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab301a00e0 con 0x7fab30102fd0 2024-06-13T02:16:24.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.809+0000 7fab36e00700 1 -- 172.21.15.2:0/2502079136 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab301a79c0 con 0x7fab30102fd0 2024-06-13T02:16:24.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.811+0000 7fab36e00700 1 -- 172.21.15.2:0/2502079136 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab30069180 con 0x7fab30102fd0 2024-06-13T02:16:24.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.812+0000 7fab2e000700 1 -- 172.21.15.2:0/2502079136 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fab1c02a070 con 0x7fab30102fd0 2024-06-13T02:16:24.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.814+0000 7fab2e000700 1 --2- 172.21.15.2:0/2502079136 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fab180a2c20 0x7fab180a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:24.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.815+0000 7fab2e000700 1 -- 172.21.15.2:0/2502079136 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fab1c0cffe0 con 0x7fab30102fd0 2024-06-13T02:16:24.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.815+0000 7fab35a00700 1 --2- 172.21.15.2:0/2502079136 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fab180a2c20 0x7fab180a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:24.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.816+0000 7fab35a00700 1 --2- 172.21.15.2:0/2502079136 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fab180a2c20 0x7fab180a50e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fab24007be0 tx=0x7fab240073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:24.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:24.818+0000 7fab2e000700 1 -- 172.21.15.2:0/2502079136 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fab1c05e850 con 0x7fab30102fd0 2024-06-13T02:16:25.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:25.101+0000 7fab36e00700 1 -- 172.21.15.2:0/2502079136 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab301a7b90 con 0x7fab30102fd0 2024-06-13T02:16:25.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:25.102+0000 7fab2e000700 1 -- 172.21.15.2:0/2502079136 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11857 (secure 0 0 0) 0x7fab1c013070 con 0x7fab30102fd0 2024-06-13T02:16:25.103 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:16:25.103 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3458450195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3458450195},{"type":"v1","addr":"172.21.15.2:6841","nonce":3458450195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1709394731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1709394731},{"type":"v1","addr":"172.21.15.175:6835","nonce":1709394731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T02:12:43.063161+0000","modified":"2024-06-13T02:14:13.553770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24503,"mds_2":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/2403775181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2403775181},{"type":"v1","addr":"172.21.15.84:6835","nonce":2403775181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/1446546569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1446546569},{"type":"v1","addr":"172.21.15.175:6837","nonce":1446546569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/2537381027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2537381027},{"type":"v1","addr":"172.21.15.84:6837","nonce":2537381027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/2743442301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":2743442301},{"type":"v1","addr":"172.21.15.175:6839","nonce":2743442301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":29,"addr":"172.21.15.2:6839/3208917373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3208917373},{"type":"v1","addr":"172.21.15.2:6839","nonce":3208917373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6839/541041266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":541041266},{"type":"v1","addr":"172.21.15.84:6839","nonce":541041266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24503,24527,24490]},"id":1}]} 2024-06-13T02:16:25.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:25.106+0000 7fab36e00700 1 -- 172.21.15.2:0/2502079136 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fab180a2c20 msgr2=0x7fab180a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:25.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:25.106+0000 7fab36e00700 1 --2- 172.21.15.2:0/2502079136 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fab180a2c20 0x7fab180a50e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fab24007be0 tx=0x7fab240073d0 comp rx=0 tx=0).stop 2024-06-13T02:16:25.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:25.106+0000 7fab36e00700 1 -- 172.21.15.2:0/2502079136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab30102fd0 msgr2=0x7fab3019b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:25.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:25.106+0000 7fab36e00700 1 --2- 172.21.15.2:0/2502079136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab30102fd0 0x7fab3019b380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fab1c00fa00 tx=0x7fab1c00fa30 comp rx=0 tx=0).stop 2024-06-13T02:16:25.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:25.106+0000 7fab36e00700 1 -- 172.21.15.2:0/2502079136 shutdown_connections 2024-06-13T02:16:25.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:25.106+0000 7fab36e00700 1 --2- 172.21.15.2:0/2502079136 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fab180a2c20 0x7fab180a50e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:25.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:25.106+0000 7fab36e00700 1 --2- 172.21.15.2:0/2502079136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab30107700 0x7fab3019f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:25.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:25.106+0000 7fab36e00700 1 --2- 172.21.15.2:0/2502079136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fab30102620 0x7fab3019ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:25.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:25.106+0000 7fab36e00700 1 --2- 172.21.15.2:0/2502079136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab30102fd0 0x7fab3019b380 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:25.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:25.106+0000 7fab36e00700 1 -- 172.21.15.2:0/2502079136 >> 172.21.15.2:0/2502079136 conn(0x7fab300fdf10 msgr2=0x7fab3010efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:25.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:25.106+0000 7fab36e00700 1 -- 172.21.15.2:0/2502079136 shutdown_connections 2024-06-13T02:16:25.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:25.106+0000 7fab36e00700 1 -- 172.21.15.2:0/2502079136 wait complete. 2024-06-13T02:16:25.108 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-06-13T02:16:25.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:25 smithi002 ceph-mon[31960]: pgmap v450: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:16:25.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:25 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2502079136' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:16:26.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:25 smithi175 ceph-mon[36977]: pgmap v450: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:16:26.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:25 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2502079136' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:16:26.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T02:16:26.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:25 smithi084 ceph-mon[36833]: pgmap v450: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:16:26.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:25 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2502079136' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:16:26.567 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:16:28.015 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:27 smithi002 ceph-mon[31960]: pgmap v451: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:16:28.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:27 smithi175 ceph-mon[36977]: pgmap v451: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:16:28.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:27 smithi084 ceph-mon[36833]: pgmap v451: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:16:28.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.832+0000 7f1f77200700 1 -- 172.21.15.2:0/1966352800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f78102600 msgr2=0x7f1f781029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:28.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.832+0000 7f1f77200700 1 --2- 172.21.15.2:0/1966352800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f78102600 0x7f1f781029e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1f680099c0 tx=0x7f1f68009cd0 comp rx=0 tx=0).stop 2024-06-13T02:16:28.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.832+0000 7f1f77200700 1 -- 172.21.15.2:0/1966352800 shutdown_connections 2024-06-13T02:16:28.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.832+0000 7f1f77200700 1 --2- 172.21.15.2:0/1966352800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f781076e0 0x7f1f7810f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:28.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.832+0000 7f1f77200700 1 --2- 172.21.15.2:0/1966352800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f78102600 0x7f1f781029e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:28.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.832+0000 7f1f77200700 1 --2- 172.21.15.2:0/1966352800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f78102fb0 0x7f1f78107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:28.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.832+0000 7f1f77200700 1 -- 172.21.15.2:0/1966352800 >> 172.21.15.2:0/1966352800 conn(0x7f1f780fde70 msgr2=0x7f1f78100290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:28.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.832+0000 7f1f77200700 1 -- 172.21.15.2:0/1966352800 shutdown_connections 2024-06-13T02:16:28.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.832+0000 7f1f77200700 1 -- 172.21.15.2:0/1966352800 wait complete. 2024-06-13T02:16:28.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.833+0000 7f1f77200700 1 Processor -- start 2024-06-13T02:16:28.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.833+0000 7f1f77200700 1 -- start start 2024-06-13T02:16:28.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.834+0000 7f1f77200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f78102600 0x7f1f78074790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:28.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.834+0000 7f1f77200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f78102fb0 0x7f1f78074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:28.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.834+0000 7f1f77200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f781076e0 0x7f1f78075210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:28.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.834+0000 7f1f77200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1f781126c0 con 0x7f1f781076e0 2024-06-13T02:16:28.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.834+0000 7f1f77200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f78112540 con 0x7f1f78102600 2024-06-13T02:16:28.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.834+0000 7f1f77200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1f78112840 con 0x7f1f78102fb0 2024-06-13T02:16:28.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.834+0000 7f1f76800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f781076e0 0x7f1f78075210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:28.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.834+0000 7f1f75400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f78102fb0 0x7f1f78074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:28.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.834+0000 7f1f76800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f781076e0 0x7f1f78075210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52952/0 (socket says 172.21.15.2:52952) 2024-06-13T02:16:28.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.834+0000 7f1f75e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f78102600 0x7f1f78074790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:28.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.834+0000 7f1f76800700 1 -- 172.21.15.2:0/3663631430 learned_addr learned my addr 172.21.15.2:0/3663631430 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:28.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.835+0000 7f1f75400700 1 -- 172.21.15.2:0/3663631430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f78102600 msgr2=0x7f1f78074790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:28.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.835+0000 7f1f75400700 1 --2- 172.21.15.2:0/3663631430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f78102600 0x7f1f78074790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:28.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.835+0000 7f1f75400700 1 -- 172.21.15.2:0/3663631430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f781076e0 msgr2=0x7f1f78075210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:28.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.835+0000 7f1f75400700 1 --2- 172.21.15.2:0/3663631430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f781076e0 0x7f1f78075210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:28.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.835+0000 7f1f75400700 1 -- 172.21.15.2:0/3663631430 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f781a7070 con 0x7f1f78102fb0 2024-06-13T02:16:28.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.835+0000 7f1f76800700 1 --2- 172.21.15.2:0/3663631430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f781076e0 0x7f1f78075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:16:28.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.835+0000 7f1f75400700 1 --2- 172.21.15.2:0/3663631430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f78102fb0 0x7f1f78074cd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1f78069cf0 tx=0x7f1f6400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:28.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.835+0000 7f1f6ea00700 1 -- 172.21.15.2:0/3663631430 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64016070 con 0x7f1f78102fb0 2024-06-13T02:16:28.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.835+0000 7f1f77200700 1 -- 172.21.15.2:0/3663631430 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f781a7360 con 0x7f1f78102fb0 2024-06-13T02:16:28.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.835+0000 7f1f6ea00700 1 -- 172.21.15.2:0/3663631430 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f6400fd70 con 0x7f1f78102fb0 2024-06-13T02:16:28.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.835+0000 7f1f6ea00700 1 -- 172.21.15.2:0/3663631430 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400e3b0 con 0x7f1f78102fb0 2024-06-13T02:16:28.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.836+0000 7f1f77200700 1 -- 172.21.15.2:0/3663631430 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f781a78f0 con 0x7f1f78102fb0 2024-06-13T02:16:28.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.837+0000 7f1f77200700 1 -- 172.21.15.2:0/3663631430 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f78069180 con 0x7f1f78102fb0 2024-06-13T02:16:28.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.839+0000 7f1f6ea00700 1 -- 172.21.15.2:0/3663631430 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f1f64019070 con 0x7f1f78102fb0 2024-06-13T02:16:28.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.841+0000 7f1f6ea00700 1 --2- 172.21.15.2:0/3663631430 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1f5c0a2ca0 0x7f1f5c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:28.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.841+0000 7f1f6ea00700 1 -- 172.21.15.2:0/3663631430 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f1f640cee10 con 0x7f1f78102fb0 2024-06-13T02:16:28.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.841+0000 7f1f75e00700 1 --2- 172.21.15.2:0/3663631430 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1f5c0a2ca0 0x7f1f5c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:28.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.842+0000 7f1f75e00700 1 --2- 172.21.15.2:0/3663631430 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1f5c0a2ca0 0x7f1f5c0a5160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1f68000c00 tx=0x7f1f68005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:28.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:28.846+0000 7f1f6ea00700 1 -- 172.21.15.2:0/3663631430 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1f640d2030 con 0x7f1f78102fb0 2024-06-13T02:16:29.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:29.072+0000 7f1f77200700 1 -- 172.21.15.2:0/3663631430 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f78075c70 con 0x7f1f78102fb0 2024-06-13T02:16:29.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:29.074+0000 7f1f6ea00700 1 -- 172.21.15.2:0/3663631430 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+24854 (secure 0 0 0) 0x7f1f6409b920 con 0x7f1f78102fb0 2024-06-13T02:16:29.075 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:16:29.075 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":100,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","created":"2024-06-13T02:03:16.412002+0000","modified":"2024-06-13T02:14:25.693752+0000","last_up_change":"2024-06-13T02:11:26.464184+0000","last_in_change":"2024-06-13T02:11:06.957351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T02:07:10.994857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T02:12:34.674172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T02:12:39.213985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T02:12:53.098590+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96b4d494-453c-48aa-b1e2-ee30dfa83e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6803","nonce":3254812126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6805","nonce":3254812126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6809","nonce":3254812126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6807","nonce":3254812126}]},"public_addr":"172.21.15.2:6803/3254812126","cluster_addr":"172.21.15.2:6805/3254812126","heartbeat_back_addr":"172.21.15.2:6809/3254812126","heartbeat_front_addr":"172.21.15.2:6807/3254812126","state":["exists","up"]},{"osd":1,"uuid":"856e86b6-9281-485b-a36b-2fe04de31329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6801","nonce":1593775403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6803","nonce":1593775403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6807","nonce":1593775403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6805","nonce":1593775403}]},"public_addr":"172.21.15.84:6801/1593775403","cluster_addr":"172.21.15.84:6803/1593775403","heartbeat_back_addr":"172.21.15.84:6807/1593775403","heartbeat_front_addr":"172.21.15.84:6805/1593775403","state":["exists","up"]},{"osd":2,"uuid":"8c9daa52-0dfb-471a-afb4-6eb0b908195a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6801","nonce":2174304558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6803","nonce":2174304558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6807","nonce":2174304558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6805","nonce":2174304558}]},"public_addr":"172.21.15.175:6801/2174304558","cluster_addr":"172.21.15.175:6803/2174304558","heartbeat_back_addr":"172.21.15.175:6807/2174304558","heartbeat_front_addr":"172.21.15.175:6805/2174304558","state":["exists","up"]},{"osd":3,"uuid":"2e747d36-4aa5-4c4c-918d-b8100980cc8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6811","nonce":3010864289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6813","nonce":3010864289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6817","nonce":3010864289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6815","nonce":3010864289}]},"public_addr":"172.21.15.2:6811/3010864289","cluster_addr":"172.21.15.2:6813/3010864289","heartbeat_back_addr":"172.21.15.2:6817/3010864289","heartbeat_front_addr":"172.21.15.2:6815/3010864289","state":["exists","up"]},{"osd":4,"uuid":"bd063fb2-1a65-4b18-898c-f80ddc2a1229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6809","nonce":2541323390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6811","nonce":2541323390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6815","nonce":2541323390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6813","nonce":2541323390}]},"public_addr":"172.21.15.84:6809/2541323390","cluster_addr":"172.21.15.84:6811/2541323390","heartbeat_back_addr":"172.21.15.84:6815/2541323390","heartbeat_front_addr":"172.21.15.84:6813/2541323390","state":["exists","up"]},{"osd":5,"uuid":"e0ea80fd-1bfe-4d2e-9733-ff442ec015b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6809","nonce":764262885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6811","nonce":764262885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6815","nonce":764262885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6813","nonce":764262885}]},"public_addr":"172.21.15.175:6809/764262885","cluster_addr":"172.21.15.175:6811/764262885","heartbeat_back_addr":"172.21.15.175:6815/764262885","heartbeat_front_addr":"172.21.15.175:6813/764262885","state":["exists","up"]},{"osd":6,"uuid":"1c204d74-5e48-4e2e-bb98-6a8d4974187c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6819","nonce":297321106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6821","nonce":297321106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6825","nonce":297321106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6823","nonce":297321106}]},"public_addr":"172.21.15.2:6819/297321106","cluster_addr":"172.21.15.2:6821/297321106","heartbeat_back_addr":"172.21.15.2:6825/297321106","heartbeat_front_addr":"172.21.15.2:6823/297321106","state":["exists","up"]},{"osd":7,"uuid":"1299bbb1-fbfb-4aba-be6b-6704691735f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6817","nonce":3873726653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6819","nonce":3873726653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6823","nonce":3873726653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6821","nonce":3873726653}]},"public_addr":"172.21.15.84:6817/3873726653","cluster_addr":"172.21.15.84:6819/3873726653","heartbeat_back_addr":"172.21.15.84:6823/3873726653","heartbeat_front_addr":"172.21.15.84:6821/3873726653","state":["exists","up"]},{"osd":8,"uuid":"9c3f2a92-d956-4246-bce9-620824d0da22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6817","nonce":2622818232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6819","nonce":2622818232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6823","nonce":2622818232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6821","nonce":2622818232}]},"public_addr":"172.21.15.175:6817/2622818232","cluster_addr":"172.21.15.175:6819/2622818232","heartbeat_back_addr":"172.21.15.175:6823/2622818232","heartbeat_front_addr":"172.21.15.175:6821/2622818232","state":["exists","up"]},{"osd":9,"uuid":"e9839f78-05c6-4b3f-bc14-cb771a03ff5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6827","nonce":1171735390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6829","nonce":1171735390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6833","nonce":1171735390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6831","nonce":1171735390}]},"public_addr":"172.21.15.2:6827/1171735390","cluster_addr":"172.21.15.2:6829/1171735390","heartbeat_back_addr":"172.21.15.2:6833/1171735390","heartbeat_front_addr":"172.21.15.2:6831/1171735390","state":["exists","up"]},{"osd":10,"uuid":"66719431-5ba9-4865-957b-f6582e607a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6825","nonce":4269523460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6827","nonce":4269523460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6831","nonce":4269523460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6829","nonce":4269523460}]},"public_addr":"172.21.15.84:6825/4269523460","cluster_addr":"172.21.15.84:6827/4269523460","heartbeat_back_addr":"172.21.15.84:6831/4269523460","heartbeat_front_addr":"172.21.15.84:6829/4269523460","state":["exists","up"]},{"osd":11,"uuid":"1ce6e6ee-6ff3-416f-b985-e3afe503093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6825","nonce":2762894732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6827","nonce":2762894732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6831","nonce":2762894732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6829","nonce":2762894732}]},"public_addr":"172.21.15.175:6825/2762894732","cluster_addr":"172.21.15.175:6827/2762894732","heartbeat_back_addr":"172.21.15.175:6831/2762894732","heartbeat_front_addr":"172.21.15.175:6829/2762894732","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:16.956638+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:42.268685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:06.272084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:39.696927+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:06.182991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:31.626603+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:05.247728+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:31.985114+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:57.474180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:31.988863+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:59.683056+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:11:24.493248+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6800/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3397168014":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/1789744365":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3831398703":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/3119270562":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/2163302458":"2024-06-14T02:03:50.073572+0000","172.21.15.2:6800/2830681579":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/1678672435":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6801/2830681579":"2024-06-14T02:03:50.073572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T02:16:29.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:29.077+0000 7f1f77200700 1 -- 172.21.15.2:0/3663631430 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1f5c0a2ca0 msgr2=0x7f1f5c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:29.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:29.077+0000 7f1f77200700 1 --2- 172.21.15.2:0/3663631430 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1f5c0a2ca0 0x7f1f5c0a5160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1f68000c00 tx=0x7f1f68005fb0 comp rx=0 tx=0).stop 2024-06-13T02:16:29.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:29.077+0000 7f1f77200700 1 -- 172.21.15.2:0/3663631430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f78102fb0 msgr2=0x7f1f78074cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:29.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:29.077+0000 7f1f77200700 1 --2- 172.21.15.2:0/3663631430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f78102fb0 0x7f1f78074cd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1f78069cf0 tx=0x7f1f6400dc30 comp rx=0 tx=0).stop 2024-06-13T02:16:29.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:29.077+0000 7f1f77200700 1 -- 172.21.15.2:0/3663631430 shutdown_connections 2024-06-13T02:16:29.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:29.077+0000 7f1f77200700 1 --2- 172.21.15.2:0/3663631430 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f1f5c0a2ca0 0x7f1f5c0a5160 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:29.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:29.077+0000 7f1f77200700 1 --2- 172.21.15.2:0/3663631430 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1f781076e0 0x7f1f78075210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:29.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:29.077+0000 7f1f77200700 1 --2- 172.21.15.2:0/3663631430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f78102600 0x7f1f78074790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:29.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:29.077+0000 7f1f77200700 1 --2- 172.21.15.2:0/3663631430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f78102fb0 0x7f1f78074cd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:29.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:29.077+0000 7f1f77200700 1 -- 172.21.15.2:0/3663631430 >> 172.21.15.2:0/3663631430 conn(0x7f1f780fde70 msgr2=0x7f1f781001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:29.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:29.077+0000 7f1f77200700 1 -- 172.21.15.2:0/3663631430 shutdown_connections 2024-06-13T02:16:29.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:29.077+0000 7f1f77200700 1 -- 172.21.15.2:0/3663631430 wait complete. 2024-06-13T02:16:29.984 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:16:30.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:29 smithi175 ceph-mon[36977]: pgmap v452: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:16:30.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:29 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3663631430' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:16:30.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:29 smithi002 ceph-mon[31960]: pgmap v452: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:16:30.059 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:29 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3663631430' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:16:30.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:29 smithi084 ceph-mon[36833]: pgmap v452: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:16:30.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:29 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3663631430' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:16:30.447 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:16:31.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:31 smithi002 ceph-mon[31960]: pgmap v453: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:16:32.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:31 smithi175 ceph-mon[36977]: pgmap v453: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:16:32.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:31 smithi084 ceph-mon[36833]: pgmap v453: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:16:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.870+0000 7f9edb200700 1 -- 172.21.15.2:0/3165290816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9edc06b610 msgr2=0x7f9edc107090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.870+0000 7f9edb200700 1 --2- 172.21.15.2:0/3165290816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9edc06b610 0x7f9edc107090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009990 tx=0x7f9ec4009ca0 comp rx=0 tx=0).stop 2024-06-13T02:16:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.870+0000 7f9edb200700 1 -- 172.21.15.2:0/3165290816 shutdown_connections 2024-06-13T02:16:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.870+0000 7f9edb200700 1 --2- 172.21.15.2:0/3165290816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9edc1077c0 0x7f9edc10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:32.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.870+0000 7f9edb200700 1 --2- 172.21.15.2:0/3165290816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9edc06ac60 0x7f9edc06b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.870+0000 7f9edb200700 1 --2- 172.21.15.2:0/3165290816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9edc06b610 0x7f9edc107090 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.870+0000 7f9edb200700 1 -- 172.21.15.2:0/3165290816 >> 172.21.15.2:0/3165290816 conn(0x7f9edc0781d0 msgr2=0x7f9edc0785e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.870+0000 7f9edb200700 1 -- 172.21.15.2:0/3165290816 shutdown_connections 2024-06-13T02:16:32.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.870+0000 7f9edb200700 1 -- 172.21.15.2:0/3165290816 wait complete. 2024-06-13T02:16:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.872+0000 7f9edb200700 1 Processor -- start 2024-06-13T02:16:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.872+0000 7f9edb200700 1 -- start start 2024-06-13T02:16:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.872+0000 7f9edb200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9edc06ac60 0x7f9edc101620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.872+0000 7f9edb200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9edc06b610 0x7f9edc101b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.872+0000 7f9edb200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9edc1077c0 0x7f9edc1020a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.872+0000 7f9edb200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc112720 con 0x7f9edc06b610 2024-06-13T02:16:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.872+0000 7f9edb200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc1125a0 con 0x7f9edc06ac60 2024-06-13T02:16:32.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.872+0000 7f9edb200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc1128a0 con 0x7f9edc1077c0 2024-06-13T02:16:32.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.873+0000 7f9ed3e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9edc06b610 0x7f9edc101b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:32.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.873+0000 7f9ed9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9edc06ac60 0x7f9edc101620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.873+0000 7f9ed9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9edc06ac60 0x7f9edc101620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:56724/0 (socket says 172.21.15.2:56724) 2024-06-13T02:16:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.873+0000 7f9ed9e00700 1 -- 172.21.15.2:0/174852904 learned_addr learned my addr 172.21.15.2:0/174852904 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.873+0000 7f9eda800700 1 --2- 172.21.15.2:0/174852904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9edc1077c0 0x7f9edc1020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.873+0000 7f9ed9e00700 1 -- 172.21.15.2:0/174852904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9edc1077c0 msgr2=0x7f9edc1020a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.873+0000 7f9ed9e00700 1 --2- 172.21.15.2:0/174852904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9edc1077c0 0x7f9edc1020a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.873+0000 7f9ed9e00700 1 -- 172.21.15.2:0/174852904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9edc06b610 msgr2=0x7f9edc101b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.873+0000 7f9ed9e00700 1 --2- 172.21.15.2:0/174852904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9edc06b610 0x7f9edc101b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.873+0000 7f9ed9e00700 1 -- 172.21.15.2:0/174852904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc1a70c0 con 0x7f9edc06ac60 2024-06-13T02:16:32.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.874+0000 7f9ed9e00700 1 --2- 172.21.15.2:0/174852904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9edc06ac60 0x7f9edc101620 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00e9c0 tx=0x7f9ecc00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.874+0000 7f9ed2a00700 1 -- 172.21.15.2:0/174852904 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00cbd0 con 0x7f9edc06ac60 2024-06-13T02:16:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.874+0000 7f9ed2a00700 1 -- 172.21.15.2:0/174852904 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ecc00ee60 con 0x7f9edc06ac60 2024-06-13T02:16:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.874+0000 7f9edb200700 1 -- 172.21.15.2:0/174852904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc1a73b0 con 0x7f9edc06ac60 2024-06-13T02:16:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.874+0000 7f9ed2a00700 1 -- 172.21.15.2:0/174852904 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc005630 con 0x7f9edc06ac60 2024-06-13T02:16:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.874+0000 7f9edb200700 1 -- 172.21.15.2:0/174852904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc1a78c0 con 0x7f9edc06ac60 2024-06-13T02:16:32.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.875+0000 7f9edb200700 1 -- 172.21.15.2:0/174852904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc10a950 con 0x7f9edc06ac60 2024-06-13T02:16:32.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.877+0000 7f9ed2a00700 1 -- 172.21.15.2:0/174852904 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f9ecc004750 con 0x7f9edc06ac60 2024-06-13T02:16:32.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.878+0000 7f9ed2a00700 1 --2- 172.21.15.2:0/174852904 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9ec00a2ca0 0x7f9ec00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.879+0000 7f9ed2a00700 1 -- 172.21.15.2:0/174852904 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f9ecc0cf6b0 con 0x7f9edc06ac60 2024-06-13T02:16:32.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.879+0000 7f9ed3e00700 1 --2- 172.21.15.2:0/174852904 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9ec00a2ca0 0x7f9ec00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:32.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.880+0000 7f9ed3e00700 1 --2- 172.21.15.2:0/174852904 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9ec00a2ca0 0x7f9ec00a5160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400b2e0 tx=0x7f9ec4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:32.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:32.883+0000 7f9ed2a00700 1 -- 172.21.15.2:0/174852904 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9ecc09c1c0 con 0x7f9edc06ac60 2024-06-13T02:16:33.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:33.158+0000 7f9edb200700 1 -- 172.21.15.2:0/174852904 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9edc069180 con 0x7f9edc06ac60 2024-06-13T02:16:33.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:33.160+0000 7f9ed2a00700 1 -- 172.21.15.2:0/174852904 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11857 (secure 0 0 0) 0x7f9ecc09bac0 con 0x7f9edc06ac60 2024-06-13T02:16:33.161 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:16:33.162 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3458450195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3458450195},{"type":"v1","addr":"172.21.15.2:6841","nonce":3458450195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1709394731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1709394731},{"type":"v1","addr":"172.21.15.175:6835","nonce":1709394731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T02:12:43.063161+0000","modified":"2024-06-13T02:14:13.553770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24503,"mds_2":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/2403775181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2403775181},{"type":"v1","addr":"172.21.15.84:6835","nonce":2403775181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/1446546569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1446546569},{"type":"v1","addr":"172.21.15.175:6837","nonce":1446546569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/2537381027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2537381027},{"type":"v1","addr":"172.21.15.84:6837","nonce":2537381027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/2743442301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":2743442301},{"type":"v1","addr":"172.21.15.175:6839","nonce":2743442301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":29,"addr":"172.21.15.2:6839/3208917373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3208917373},{"type":"v1","addr":"172.21.15.2:6839","nonce":3208917373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6839/541041266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":541041266},{"type":"v1","addr":"172.21.15.84:6839","nonce":541041266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24503,24527,24490]},"id":1}]} 2024-06-13T02:16:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:33.163+0000 7f9edb200700 1 -- 172.21.15.2:0/174852904 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9ec00a2ca0 msgr2=0x7f9ec00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:33.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:33.163+0000 7f9edb200700 1 --2- 172.21.15.2:0/174852904 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9ec00a2ca0 0x7f9ec00a5160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400b2e0 tx=0x7f9ec4005fd0 comp rx=0 tx=0).stop 2024-06-13T02:16:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:33.163+0000 7f9edb200700 1 -- 172.21.15.2:0/174852904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9edc06ac60 msgr2=0x7f9edc101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:33.163+0000 7f9edb200700 1 --2- 172.21.15.2:0/174852904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9edc06ac60 0x7f9edc101620 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00e9c0 tx=0x7f9ecc00ecd0 comp rx=0 tx=0).stop 2024-06-13T02:16:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:33.163+0000 7f9edb200700 1 -- 172.21.15.2:0/174852904 shutdown_connections 2024-06-13T02:16:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:33.163+0000 7f9edb200700 1 --2- 172.21.15.2:0/174852904 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9ec00a2ca0 0x7f9ec00a5160 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:33.163+0000 7f9edb200700 1 --2- 172.21.15.2:0/174852904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9edc1077c0 0x7f9edc1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:33.163+0000 7f9edb200700 1 --2- 172.21.15.2:0/174852904 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9edc06ac60 0x7f9edc101620 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:33.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:33.163+0000 7f9edb200700 1 --2- 172.21.15.2:0/174852904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9edc06b610 0x7f9edc101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:33.163+0000 7f9edb200700 1 -- 172.21.15.2:0/174852904 >> 172.21.15.2:0/174852904 conn(0x7f9edc0781d0 msgr2=0x7f9edc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:33.163+0000 7f9edb200700 1 -- 172.21.15.2:0/174852904 shutdown_connections 2024-06-13T02:16:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:33.163+0000 7f9edb200700 1 -- 172.21.15.2:0/174852904 wait complete. 2024-06-13T02:16:33.166 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-06-13T02:16:33.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:33 smithi002 ceph-mon[31960]: pgmap v454: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:16:33.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:33 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/174852904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:16:34.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:33 smithi175 ceph-mon[36977]: pgmap v454: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:16:34.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:33 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/174852904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:16:34.179 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-13T02:12:43.063161+0000', 'modified': '2024-06-13T02:14:13.553770+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24527, 'mds_1': 24503, 'mds_2': 24490}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24473': {'gid': 24473, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.84:6835/2403775181', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 2403775181}, {'type': 'v1', 'addr': '172.21.15.84:6835', 'nonce': 2403775181}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6837/1446546569', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 1446546569}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1446546569}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.84:6837/2537381027', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 2537381027}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 2537381027}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 31, 'addr': '172.21.15.175:6839/2743442301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 2743442301}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 2743442301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24503': {'gid': 24503, 'name': 'g', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 29, 'addr': '172.21.15.2:6839/3208917373', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6838', 'nonce': 3208917373}, {'type': 'v1', 'addr': '172.21.15.2:6839', 'nonce': 3208917373}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24527': {'gid': 24527, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.84:6839/541041266', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6838', 'nonce': 541041266}, {'type': 'v1', 'addr': '172.21.15.84:6839', 'nonce': 541041266}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24527, 'qdb_cluster': [24503, 24527, 24490]} 2024-06-13T02:16:34.179 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-06-13T02:16:34.179 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell mds.i status 2024-06-13T02:16:34.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:33 smithi084 ceph-mon[36833]: pgmap v454: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:16:34.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:33 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/174852904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:16:34.667 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:16:36.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:35 smithi175 ceph-mon[36977]: pgmap v455: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:16:36.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:35 smithi002 ceph-mon[31960]: pgmap v455: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:16:36.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:35 smithi084 ceph-mon[36833]: pgmap v455: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:16:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.048+0000 7ff44c400700 1 -- 172.21.15.2:0/2767526181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff444074fe0 msgr2=0x7ff44410e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.048+0000 7ff44c400700 1 --2- 172.21.15.2:0/2767526181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff444074fe0 0x7ff44410e950 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff4300098f0 tx=0x7ff430009c00 comp rx=0 tx=0).stop 2024-06-13T02:16:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.049+0000 7ff44c400700 1 -- 172.21.15.2:0/2767526181 shutdown_connections 2024-06-13T02:16:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.049+0000 7ff44c400700 1 --2- 172.21.15.2:0/2767526181 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff44410ee90 0x7ff444111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.049+0000 7ff44c400700 1 --2- 172.21.15.2:0/2767526181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4440746c0 0x7ff444074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.049+0000 7ff44c400700 1 --2- 172.21.15.2:0/2767526181 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff444074fe0 0x7ff44410e950 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.049+0000 7ff44c400700 1 -- 172.21.15.2:0/2767526181 >> 172.21.15.2:0/2767526181 conn(0x7ff4440795f0 msgr2=0x7ff444079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.049+0000 7ff44c400700 1 -- 172.21.15.2:0/2767526181 shutdown_connections 2024-06-13T02:16:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.049+0000 7ff44c400700 1 -- 172.21.15.2:0/2767526181 wait complete. 2024-06-13T02:16:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.050+0000 7ff44c400700 1 Processor -- start 2024-06-13T02:16:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.050+0000 7ff44c400700 1 -- start start 2024-06-13T02:16:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.050+0000 7ff44c400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4440746c0 0x7ff44419aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.050+0000 7ff44c400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff444074fe0 0x7ff44419b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.051+0000 7ff44c400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff44410ee90 0x7ff44419f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.051+0000 7ff44c400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff444114a10 con 0x7ff4440746c0 2024-06-13T02:16:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.051+0000 7ff44c400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff444114890 con 0x7ff44410ee90 2024-06-13T02:16:37.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.051+0000 7ff44c400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff444114b90 con 0x7ff444074fe0 2024-06-13T02:16:37.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.051+0000 7ff449a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4440746c0 0x7ff44419aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.051+0000 7ff44a400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff44410ee90 0x7ff44419f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.051+0000 7ff449a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4440746c0 0x7ff44419aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48864/0 (socket says 172.21.15.2:48864) 2024-06-13T02:16:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.051+0000 7ff449000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff444074fe0 0x7ff44419b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.051+0000 7ff449a00700 1 -- 172.21.15.2:0/1828982908 learned_addr learned my addr 172.21.15.2:0/1828982908 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.052+0000 7ff449000700 1 -- 172.21.15.2:0/1828982908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff44410ee90 msgr2=0x7ff44419f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.052+0000 7ff449000700 1 --2- 172.21.15.2:0/1828982908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff44410ee90 0x7ff44419f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.052+0000 7ff449000700 1 -- 172.21.15.2:0/1828982908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4440746c0 msgr2=0x7ff44419aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.052+0000 7ff449000700 1 --2- 172.21.15.2:0/1828982908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4440746c0 0x7ff44419aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.052+0000 7ff449000700 1 -- 172.21.15.2:0/1828982908 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff44419feb0 con 0x7ff444074fe0 2024-06-13T02:16:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.052+0000 7ff44a400700 1 --2- 172.21.15.2:0/1828982908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff44410ee90 0x7ff44419f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:16:37.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.052+0000 7ff449a00700 1 --2- 172.21.15.2:0/1828982908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4440746c0 0x7ff44419aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:16:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.052+0000 7ff449000700 1 --2- 172.21.15.2:0/1828982908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff444074fe0 0x7ff44419b3e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff430000c00 tx=0x7ff43000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.053+0000 7ff442000700 1 -- 172.21.15.2:0/1828982908 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430005040 con 0x7ff444074fe0 2024-06-13T02:16:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.053+0000 7ff442000700 1 -- 172.21.15.2:0/1828982908 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4300056c0 con 0x7ff444074fe0 2024-06-13T02:16:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.053+0000 7ff442000700 1 -- 172.21.15.2:0/1828982908 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430003a00 con 0x7ff444074fe0 2024-06-13T02:16:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.053+0000 7ff44c400700 1 -- 172.21.15.2:0/1828982908 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4441a0140 con 0x7ff444074fe0 2024-06-13T02:16:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.053+0000 7ff44c400700 1 -- 172.21.15.2:0/1828982908 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4441a7a20 con 0x7ff444074fe0 2024-06-13T02:16:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.056+0000 7ff442000700 1 -- 172.21.15.2:0/1828982908 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff43000b560 con 0x7ff444074fe0 2024-06-13T02:16:37.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.057+0000 7ff456cceb80 1 Processor -- start 2024-06-13T02:16:37.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.057+0000 7ff456cceb80 1 -- start start 2024-06-13T02:16:37.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.058+0000 7ff442000700 1 --2- 172.21.15.2:0/1828982908 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff42c0a2c20 0x7ff42c0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.058+0000 7ff456cceb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95bde4df0 0x55d95be68020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.058+0000 7ff456cceb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95be68560 0x55d95be689e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.058+0000 7ff442000700 1 -- 172.21.15.2:0/1828982908 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7ff4300d0300 con 0x7ff444074fe0 2024-06-13T02:16:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.058+0000 7ff456cceb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 0x55d95be756a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.058+0000 7ff456cceb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d95bd779c0 con 0x55d95be732b0 2024-06-13T02:16:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.058+0000 7ff456cceb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d95bdbaab0 con 0x55d95be68560 2024-06-13T02:16:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.058+0000 7ff456cceb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d95bd758a0 con 0x55d95bde4df0 2024-06-13T02:16:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.058+0000 7ff44a400700 1 --2- 172.21.15.2:0/1828982908 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff42c0a2c20 0x7ff42c0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.058+0000 7ff449000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95be68560 0x55d95be689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.058+0000 7ff449a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95bde4df0 0x55d95be68020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.058+0000 7ff449000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95be68560 0x55d95be689e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:56746/0 (socket says 172.21.15.2:56746) 2024-06-13T02:16:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.058+0000 7ff449000700 1 -- 172.21.15.2:0/1433128478 learned_addr learned my addr 172.21.15.2:0/1433128478 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.059+0000 7ff44a400700 1 --2- 172.21.15.2:0/1433128478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 0x55d95be756a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.059+0000 7ff449000700 1 -- 172.21.15.2:0/1433128478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95bde4df0 msgr2=0x55d95be68020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.059+0000 7ff449000700 1 --2- 172.21.15.2:0/1433128478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95bde4df0 0x55d95be68020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.059+0000 7ff449000700 1 -- 172.21.15.2:0/1433128478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 msgr2=0x55d95be756a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.059+0000 7ff449000700 1 --2- 172.21.15.2:0/1433128478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 0x55d95be756a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.059+0000 7ff449000700 1 -- 172.21.15.2:0/1433128478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d95bd62f40 con 0x55d95be68560 2024-06-13T02:16:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.059+0000 7ff449000700 1 --2- 172.21.15.2:0/1433128478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95be68560 0x55d95be689e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff4300a4e50 tx=0x7ff43009c640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1122cfc5446272d2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.059+0000 7ff44a400700 1 --2- 172.21.15.2:0/1828982908 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff42c0a2c20 0x7ff42c0a50e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009fd0 tx=0x7ff43c0099e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.059+0000 7ff436a00700 1 -- 172.21.15.2:0/1433128478 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430021380 con 0x55d95be68560 2024-06-13T02:16:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.059+0000 7ff436a00700 1 -- 172.21.15.2:0/1433128478 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff43009cea0 con 0x55d95be68560 2024-06-13T02:16:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.060+0000 7ff436a00700 1 -- 172.21.15.2:0/1433128478 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43009ab30 con 0x55d95be68560 2024-06-13T02:16:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.060+0000 7ff456cceb80 1 -- 172.21.15.2:0/1433128478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95be68560 msgr2=0x55d95be689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.060+0000 7ff456cceb80 1 --2- 172.21.15.2:0/1433128478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95be68560 0x55d95be689e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff4300a4e50 tx=0x7ff43009c640 comp rx=0 tx=0).stop 2024-06-13T02:16:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.060+0000 7ff456cceb80 1 -- 172.21.15.2:0/1433128478 shutdown_connections 2024-06-13T02:16:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.060+0000 7ff456cceb80 1 --2- 172.21.15.2:0/1433128478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 0x55d95be756a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.060+0000 7ff456cceb80 1 --2- 172.21.15.2:0/1433128478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95bde4df0 0x55d95be68020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.060+0000 7ff456cceb80 1 --2- 172.21.15.2:0/1433128478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95be68560 0x55d95be689e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.060+0000 7ff456cceb80 1 -- 172.21.15.2:0/1433128478 >> 172.21.15.2:0/1433128478 conn(0x55d95bd95120 msgr2=0x55d95be64460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.061+0000 7ff456cceb80 1 -- 172.21.15.2:0/1433128478 shutdown_connections 2024-06-13T02:16:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.061+0000 7ff456cceb80 1 -- 172.21.15.2:0/1433128478 wait complete. 2024-06-13T02:16:37.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.061+0000 7ff456cceb80 1 -- start start 2024-06-13T02:16:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.061+0000 7ff456cceb80 1 Processor -- start 2024-06-13T02:16:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.062+0000 7ff456cceb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95bde4df0 0x55d95be729f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.062+0000 7ff456cceb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95be68560 0x55d95be6fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.062+0000 7ff456cceb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 0x55d95be70230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.062+0000 7ff456cceb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d95bd56f10 con 0x55d95be732b0 2024-06-13T02:16:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.062+0000 7ff456cceb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d95bdb6a70 con 0x55d95bde4df0 2024-06-13T02:16:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.062+0000 7ff456cceb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d95be75d20 con 0x55d95be68560 2024-06-13T02:16:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.062+0000 7ff456cceb80 10 client.0 _ll_register_callbacks cb 0x55d95bd546d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:16:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.062+0000 7ff449a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95bde4df0 0x55d95be729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.062+0000 7ff449a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95bde4df0 0x55d95be729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:56748/0 (socket says 172.21.15.2:56748) 2024-06-13T02:16:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.062+0000 7ff449a00700 1 -- 172.21.15.2:0/1739492612 learned_addr learned my addr 172.21.15.2:0/1739492612 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.062+0000 7ff449000700 1 --2- 172.21.15.2:0/1739492612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95be68560 0x55d95be6fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.062+0000 7ff44a400700 1 --2- 172.21.15.2:0/1739492612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 0x55d95be70230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.063+0000 7ff449a00700 1 -- 172.21.15.2:0/1739492612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95be68560 msgr2=0x55d95be6fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.063+0000 7ff449a00700 1 --2- 172.21.15.2:0/1739492612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95be68560 0x55d95be6fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.063+0000 7ff449a00700 1 -- 172.21.15.2:0/1739492612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 msgr2=0x55d95be70230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.063+0000 7ff449a00700 1 --2- 172.21.15.2:0/1739492612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 0x55d95be70230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.063+0000 7ff449a00700 1 -- 172.21.15.2:0/1739492612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d95bd09880 con 0x55d95bde4df0 2024-06-13T02:16:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.063+0000 7ff449a00700 1 --2- 172.21.15.2:0/1739492612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95bde4df0 0x55d95be729f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff438012d20 tx=0x7ff43800f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=552b21523086374f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.063+0000 7ff42b400700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:16:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.063+0000 7ff42b400700 1 -- 172.21.15.2:0/1739492612 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43800fc30 con 0x55d95bde4df0 2024-06-13T02:16:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.063+0000 7ff456cceb80 1 -- 172.21.15.2:0/1739492612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff43009cea0 con 0x55d95bde4df0 2024-06-13T02:16:37.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.063+0000 7ff42b400700 1 -- 172.21.15.2:0/1739492612 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7ff43800fdd0 con 0x55d95bde4df0 2024-06-13T02:16:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.064+0000 7ff42b400700 1 -- 172.21.15.2:0/1739492612 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff438010430 con 0x55d95bde4df0 2024-06-13T02:16:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.064+0000 7ff456cceb80 10 client.24971 fetch_fsmap learned FSMap version 26 2024-06-13T02:16:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.064+0000 7ff456cceb80 1 -- 172.21.15.2:0/1739492612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d95be80440 con 0x55d95bde4df0 2024-06-13T02:16:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.064+0000 7ff42b400700 1 -- 172.21.15.2:0/1739492612 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff43009cea0 con 0x55d95bde4df0 2024-06-13T02:16:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.064+0000 7ff42b400700 1 -- 172.21.15.2:0/1739492612 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff43801c750 con 0x55d95bde4df0 2024-06-13T02:16:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.064+0000 7ff456cceb80 10 client.24971 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T02:16:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.064+0000 7ff456cceb80 10 client.24971 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-13T02:16:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.064+0000 7ff456cceb80 20 client.24971 populate_metadata read hostname 'smithi002' 2024-06-13T02:16:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.064+0000 7ff456cceb80 1 --2- 172.21.15.2:0/1739492612 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55d95be82ac0 0x55d95be83f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.064+0000 7ff456cceb80 4 client.24971 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:16:37.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.064+0000 7ff456cceb80 1 -- 172.21.15.2:0/1739492612 --> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d95bdc7fb0 con 0x55d95be82ac0 2024-06-13T02:16:37.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.065+0000 7ff449000700 1 --2- 172.21.15.2:0/1739492612 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55d95be82ac0 0x55d95be83f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.065+0000 7ff449000700 1 --2- 172.21.15.2:0/1739492612 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55d95be82ac0 0x55d95be83f30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e793e8dea0eeeb7e server_cookie=ddb593a0810b41cd in_seq=0 out_seq=0 2024-06-13T02:16:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.065+0000 7ff42b400700 10 client.24971 ms_handle_connect on v2:172.21.15.175:6838/2743442301 2024-06-13T02:16:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.066+0000 7ff42b400700 1 -- 172.21.15.2:0/1739492612 <== mds.2 v2:172.21.15.175:6838/2743442301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d95bdc7fb0 con 0x55d95be82ac0 2024-06-13T02:16:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.066+0000 7ff42b400700 10 client.24971 handle_command_reply: tid=0 2024-06-13T02:16:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.066+0000 7ff456cceb80 1 client.24971 shutdown 2024-06-13T02:16:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.067+0000 7ff456cceb80 1 -- 172.21.15.2:0/1739492612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95bde4df0 msgr2=0x55d95be729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.067+0000 7ff456cceb80 1 --2- 172.21.15.2:0/1739492612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95bde4df0 0x55d95be729f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff438012d20 tx=0x7ff43800f6a0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.067+0000 7ff456cceb80 1 -- 172.21.15.2:0/1739492612 shutdown_connections 2024-06-13T02:16:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.067+0000 7ff456cceb80 1 --2- 172.21.15.2:0/1739492612 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55d95be82ac0 0x55d95be83f30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.067+0000 7ff456cceb80 1 --2- 172.21.15.2:0/1739492612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 0x55d95be70230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.067+0000 7ff456cceb80 1 --2- 172.21.15.2:0/1739492612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95bde4df0 0x55d95be729f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.067+0000 7ff42b400700 0 client.24971 ms_handle_reset on v2:172.21.15.175:6838/2743442301 2024-06-13T02:16:37.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.067+0000 7ff456cceb80 1 --2- 172.21.15.2:0/1739492612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95be68560 0x55d95be6fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.067+0000 7ff456cceb80 1 -- 172.21.15.2:0/1739492612 >> 172.21.15.2:0/1739492612 conn(0x55d95bd95120 msgr2=0x55d95be636f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:37.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.067+0000 7ff456cceb80 1 -- 172.21.15.2:0/1739492612 shutdown_connections 2024-06-13T02:16:37.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.067+0000 7ff456cceb80 1 -- 172.21.15.2:0/1739492612 wait complete. 2024-06-13T02:16:37.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.067+0000 7ff456cceb80 20 client.24971 trim_cache size 0 max 16384 2024-06-13T02:16:37.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.091+0000 7ff456cceb80 1 Processor -- start 2024-06-13T02:16:37.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.091+0000 7ff456cceb80 1 -- start start 2024-06-13T02:16:37.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.091+0000 7ff456cceb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95bde4df0 0x55d95be63570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.091+0000 7ff456cceb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be68560 0x55d95be746a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.091+0000 7ff456cceb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95be732b0 0x55d95be6af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.091+0000 7ff456cceb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d95be82270 con 0x55d95be68560 2024-06-13T02:16:37.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.091+0000 7ff456cceb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d95be82940 con 0x55d95bde4df0 2024-06-13T02:16:37.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.091+0000 7ff456cceb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d95be83010 con 0x55d95be732b0 2024-06-13T02:16:37.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.092+0000 7ff449000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be68560 0x55d95be746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.092+0000 7ff449000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be68560 0x55d95be746a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48896/0 (socket says 172.21.15.2:48896) 2024-06-13T02:16:37.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.092+0000 7ff449000700 1 -- 172.21.15.2:0/1427534818 learned_addr learned my addr 172.21.15.2:0/1427534818 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:37.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.092+0000 7ff449a00700 1 --2- 172.21.15.2:0/1427534818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95bde4df0 0x55d95be63570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.092+0000 7ff44a400700 1 --2- 172.21.15.2:0/1427534818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95be732b0 0x55d95be6af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.092+0000 7ff449000700 1 -- 172.21.15.2:0/1427534818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95be732b0 msgr2=0x55d95be6af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:37.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.092+0000 7ff449000700 1 --2- 172.21.15.2:0/1427534818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95be732b0 0x55d95be6af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.092+0000 7ff449000700 1 -- 172.21.15.2:0/1427534818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95bde4df0 msgr2=0x55d95be63570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.092+0000 7ff449000700 1 --2- 172.21.15.2:0/1427534818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95bde4df0 0x55d95be63570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.092+0000 7ff449000700 1 -- 172.21.15.2:0/1427534818 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d95be75d20 con 0x55d95be68560 2024-06-13T02:16:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.093+0000 7ff449000700 1 --2- 172.21.15.2:0/1427534818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be68560 0x55d95be746a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff4300a4e50 tx=0x7ff430019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811ad7608dfaf35e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.093+0000 7ff436000700 1 -- 172.21.15.2:0/1427534818 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430021380 con 0x55d95be68560 2024-06-13T02:16:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.093+0000 7ff436000700 1 -- 172.21.15.2:0/1427534818 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff43009cea0 con 0x55d95be68560 2024-06-13T02:16:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.093+0000 7ff436000700 1 -- 172.21.15.2:0/1427534818 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430098e10 con 0x55d95be68560 2024-06-13T02:16:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.094+0000 7ff456cceb80 1 -- 172.21.15.2:0/1427534818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be68560 msgr2=0x55d95be746a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.094+0000 7ff456cceb80 1 --2- 172.21.15.2:0/1427534818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be68560 0x55d95be746a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff4300a4e50 tx=0x7ff430019040 comp rx=0 tx=0).stop 2024-06-13T02:16:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.094+0000 7ff456cceb80 1 -- 172.21.15.2:0/1427534818 shutdown_connections 2024-06-13T02:16:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.094+0000 7ff456cceb80 1 --2- 172.21.15.2:0/1427534818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95be732b0 0x55d95be6af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.094+0000 7ff456cceb80 1 --2- 172.21.15.2:0/1427534818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95bde4df0 0x55d95be63570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.094+0000 7ff456cceb80 1 --2- 172.21.15.2:0/1427534818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be68560 0x55d95be746a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.094+0000 7ff456cceb80 1 -- 172.21.15.2:0/1427534818 >> 172.21.15.2:0/1427534818 conn(0x55d95bd95120 msgr2=0x55d95be62e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:37.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.094+0000 7ff456cceb80 1 -- 172.21.15.2:0/1427534818 shutdown_connections 2024-06-13T02:16:37.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.094+0000 7ff456cceb80 1 -- 172.21.15.2:0/1427534818 wait complete. 2024-06-13T02:16:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.094+0000 7ff456cceb80 1 -- start start 2024-06-13T02:16:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.095+0000 7ff456cceb80 1 Processor -- start 2024-06-13T02:16:37.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.095+0000 7ff456cceb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95bde4df0 0x55d95be71b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.095+0000 7ff456cceb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95be68560 0x55d95be720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.095+0000 7ff456cceb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 0x55d95be725e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.095+0000 7ff456cceb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d95be83db0 con 0x55d95be732b0 2024-06-13T02:16:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.095+0000 7ff456cceb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d95be836e0 con 0x55d95be68560 2024-06-13T02:16:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.095+0000 7ff456cceb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d95be84480 con 0x55d95bde4df0 2024-06-13T02:16:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.095+0000 7ff456cceb80 10 client.0 _ll_register_callbacks cb 0x55d95bd546d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:16:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.096+0000 7ff44a400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 0x55d95be725e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.096+0000 7ff44a400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 0x55d95be725e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48902/0 (socket says 172.21.15.2:48902) 2024-06-13T02:16:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.096+0000 7ff449000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95be68560 0x55d95be720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.096+0000 7ff449a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95bde4df0 0x55d95be71b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.096+0000 7ff44a400700 1 -- 172.21.15.2:0/934379088 learned_addr learned my addr 172.21.15.2:0/934379088 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:37.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.096+0000 7ff449000700 1 -- 172.21.15.2:0/934379088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95bde4df0 msgr2=0x55d95be71b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.096+0000 7ff449000700 1 --2- 172.21.15.2:0/934379088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95bde4df0 0x55d95be71b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.096+0000 7ff449000700 1 -- 172.21.15.2:0/934379088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 msgr2=0x55d95be725e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.096+0000 7ff449000700 1 --2- 172.21.15.2:0/934379088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 0x55d95be725e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.096+0000 7ff449000700 1 -- 172.21.15.2:0/934379088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d95be89730 con 0x55d95be68560 2024-06-13T02:16:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.096+0000 7ff449a00700 1 --2- 172.21.15.2:0/934379088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95bde4df0 0x55d95be71b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:16:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.096+0000 7ff449000700 1 --2- 172.21.15.2:0/934379088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95be68560 0x55d95be720a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55d95be84d70 tx=0x7ff4300d01b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a64d46041d2d00ee server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.096+0000 7ff42b400700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:16:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.097+0000 7ff42b400700 1 -- 172.21.15.2:0/934379088 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43009c7a0 con 0x55d95be68560 2024-06-13T02:16:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.097+0000 7ff42b400700 1 -- 172.21.15.2:0/934379088 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7ff43009aaa0 con 0x55d95be68560 2024-06-13T02:16:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.097+0000 7ff456cceb80 1 -- 172.21.15.2:0/934379088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff43009cea0 con 0x55d95be68560 2024-06-13T02:16:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.097+0000 7ff42b400700 1 -- 172.21.15.2:0/934379088 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff430021380 con 0x55d95be68560 2024-06-13T02:16:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.097+0000 7ff456cceb80 10 client.24977 fetch_fsmap learned FSMap version 26 2024-06-13T02:16:37.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.097+0000 7ff456cceb80 1 -- 172.21.15.2:0/934379088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d95beee530 con 0x55d95be68560 2024-06-13T02:16:37.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.097+0000 7ff42b400700 1 -- 172.21.15.2:0/934379088 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff43009cea0 con 0x55d95be68560 2024-06-13T02:16:37.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.097+0000 7ff42b400700 1 -- 172.21.15.2:0/934379088 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff4300a1ce0 con 0x55d95be68560 2024-06-13T02:16:37.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.098+0000 7ff456cceb80 10 client.24977 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T02:16:37.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.098+0000 7ff456cceb80 10 client.24977 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-13T02:16:37.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.098+0000 7ff456cceb80 20 client.24977 populate_metadata read hostname 'smithi002' 2024-06-13T02:16:37.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.098+0000 7ff456cceb80 1 --2- 172.21.15.2:0/934379088 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55d95bef2a30 0x55d95bef1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:37.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.098+0000 7ff456cceb80 4 client.24977 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T02:16:37.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.098+0000 7ff456cceb80 1 -- 172.21.15.2:0/934379088 --> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] -- command(tid 0: {"prefix": "status"}) -- 0x55d95bdc2530 con 0x55d95bef2a30 2024-06-13T02:16:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.098+0000 7ff449a00700 1 --2- 172.21.15.2:0/934379088 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55d95bef2a30 0x55d95bef1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff42b400700 10 client.24977 ms_handle_connect on v2:172.21.15.175:6838/2743442301 2024-06-13T02:16:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff449a00700 1 --2- 172.21.15.2:0/934379088 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55d95bef2a30 0x55d95bef1740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f578864f21950dc3 server_cookie=d18c5c5265d44ec8 in_seq=0 out_seq=0 2024-06-13T02:16:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff42b400700 1 -- 172.21.15.2:0/934379088 <== mds.2 v2:172.21.15.175:6838/2743442301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55d95bdc2530 con 0x55d95bef2a30 2024-06-13T02:16:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff42b400700 10 client.24977 handle_command_reply: tid=0 2024-06-13T02:16:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff456cceb80 1 client.24977 shutdown 2024-06-13T02:16:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff456cceb80 1 -- 172.21.15.2:0/934379088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95be68560 msgr2=0x55d95be720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff456cceb80 1 --2- 172.21.15.2:0/934379088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95be68560 0x55d95be720a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55d95be84d70 tx=0x7ff4300d01b0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff456cceb80 1 -- 172.21.15.2:0/934379088 shutdown_connections 2024-06-13T02:16:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff456cceb80 1 --2- 172.21.15.2:0/934379088 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55d95bef2a30 0x55d95bef1740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff456cceb80 1 --2- 172.21.15.2:0/934379088 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d95be732b0 0x55d95be725e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff456cceb80 1 --2- 172.21.15.2:0/934379088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d95bde4df0 0x55d95be71b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff42b400700 0 client.24977 ms_handle_reset on v2:172.21.15.175:6838/2743442301 2024-06-13T02:16:37.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff456cceb80 1 --2- 172.21.15.2:0/934379088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d95be68560 0x55d95be720a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff456cceb80 1 -- 172.21.15.2:0/934379088 >> 172.21.15.2:0/934379088 conn(0x55d95bd95120 msgr2=0x55d95be62e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:37.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff456cceb80 1 -- 172.21.15.2:0/934379088 shutdown_connections 2024-06-13T02:16:37.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff456cceb80 1 -- 172.21.15.2:0/934379088 wait complete. 2024-06-13T02:16:37.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.099+0000 7ff456cceb80 20 client.24977 trim_cache size 0 max 16384 2024-06-13T02:16:37.104 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T02:16:37.104 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "efed8ab4-2928-11ef-bc9c-c7b262605968", 2024-06-13T02:16:37.104 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 2, 2024-06-13T02:16:37.104 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24490, 2024-06-13T02:16:37.104 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-06-13T02:16:37.104 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-06-13T02:16:37.104 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-06-13T02:16:37.105 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 151.52018990400001, 2024-06-13T02:16:37.105 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 26, 2024-06-13T02:16:37.105 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 100, 2024-06-13T02:16:37.105 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 98, 2024-06-13T02:16:37.105 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 269.12223890299998 2024-06-13T02:16:37.105 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T02:16:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.100+0000 7ff44c400700 1 -- 172.21.15.2:0/1828982908 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff42c0a2c20 msgr2=0x7ff42c0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:37.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.100+0000 7ff44c400700 1 --2- 172.21.15.2:0/1828982908 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff42c0a2c20 0x7ff42c0a50e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009fd0 tx=0x7ff43c0099e0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.100+0000 7ff44c400700 1 -- 172.21.15.2:0/1828982908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff444074fe0 msgr2=0x7ff44419b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:37.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.100+0000 7ff44c400700 1 --2- 172.21.15.2:0/1828982908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff444074fe0 0x7ff44419b3e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff430000c00 tx=0x7ff43000fa00 comp rx=0 tx=0).stop 2024-06-13T02:16:37.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.100+0000 7ff44c400700 1 -- 172.21.15.2:0/1828982908 shutdown_connections 2024-06-13T02:16:37.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.100+0000 7ff44c400700 1 --2- 172.21.15.2:0/1828982908 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff42c0a2c20 0x7ff42c0a50e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.100+0000 7ff44c400700 1 --2- 172.21.15.2:0/1828982908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff44410ee90 0x7ff44419f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.100+0000 7ff44c400700 1 --2- 172.21.15.2:0/1828982908 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4440746c0 0x7ff44419aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.100+0000 7ff44c400700 1 --2- 172.21.15.2:0/1828982908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff444074fe0 0x7ff44419b3e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:37.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.100+0000 7ff44c400700 1 -- 172.21.15.2:0/1828982908 >> 172.21.15.2:0/1828982908 conn(0x7ff4440795f0 msgr2=0x7ff4440ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:37.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.101+0000 7ff44c400700 1 -- 172.21.15.2:0/1828982908 shutdown_connections 2024-06-13T02:16:37.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:37.101+0000 7ff44c400700 1 -- 172.21.15.2:0/1828982908 wait complete. 2024-06-13T02:16:37.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:37 smithi002 ceph-mon[31960]: pgmap v456: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:16:38.074 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell mds.g status 2024-06-13T02:16:38.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:37 smithi084 ceph-mon[36833]: pgmap v456: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:16:38.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:37 smithi175 ceph-mon[36977]: pgmap v456: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:16:38.573 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:16:40.079 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:39 smithi002 ceph-mon[31960]: pgmap v457: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:16:40.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:39 smithi084 ceph-mon[36833]: pgmap v457: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:16:40.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:39 smithi175 ceph-mon[36977]: pgmap v457: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:16:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.972+0000 7fb687000700 1 -- 172.21.15.2:0/1520096048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb68010a6d0 msgr2=0x7fb68010aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.972+0000 7fb687000700 1 --2- 172.21.15.2:0/1520096048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb68010a6d0 0x7fb68010aab0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb670009990 tx=0x7fb670009ca0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.972+0000 7fb687000700 1 -- 172.21.15.2:0/1520096048 shutdown_connections 2024-06-13T02:16:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.972+0000 7fb687000700 1 --2- 172.21.15.2:0/1520096048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680105090 0x7fb6801115a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.972+0000 7fb687000700 1 --2- 172.21.15.2:0/1520096048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb68010a6d0 0x7fb68010aab0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.972+0000 7fb687000700 1 --2- 172.21.15.2:0/1520096048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6801046d0 0x7fb680104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.972+0000 7fb687000700 1 -- 172.21.15.2:0/1520096048 >> 172.21.15.2:0/1520096048 conn(0x7fb6801001c0 msgr2=0x7fb6801025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:40.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.972+0000 7fb687000700 1 -- 172.21.15.2:0/1520096048 shutdown_connections 2024-06-13T02:16:40.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.972+0000 7fb687000700 1 -- 172.21.15.2:0/1520096048 wait complete. 2024-06-13T02:16:40.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.973+0000 7fb687000700 1 Processor -- start 2024-06-13T02:16:40.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.974+0000 7fb687000700 1 -- start start 2024-06-13T02:16:40.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.974+0000 7fb687000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6801046d0 0x7fb68019ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:40.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.974+0000 7fb687000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680105090 0x7fb68019b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.974+0000 7fb687000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb68010a6d0 0x7fb68019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.974+0000 7fb687000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb680114a60 con 0x7fb68010a6d0 2024-06-13T02:16:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.974+0000 7fb687000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb6801148e0 con 0x7fb680105090 2024-06-13T02:16:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.974+0000 7fb687000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb680114be0 con 0x7fb6801046d0 2024-06-13T02:16:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.974+0000 7fb685000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb68010a6d0 0x7fb68019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.974+0000 7fb67f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680105090 0x7fb68019b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.974+0000 7fb67f400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680105090 0x7fb68019b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:56792/0 (socket says 172.21.15.2:56792) 2024-06-13T02:16:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.974+0000 7fb685000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb68010a6d0 0x7fb68019f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48918/0 (socket says 172.21.15.2:48918) 2024-06-13T02:16:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.974+0000 7fb685000700 1 -- 172.21.15.2:0/1299713054 learned_addr learned my addr 172.21.15.2:0/1299713054 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.974+0000 7fb67fe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6801046d0 0x7fb68019ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.975+0000 7fb67f400700 1 -- 172.21.15.2:0/1299713054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6801046d0 msgr2=0x7fb68019ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:40.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.975+0000 7fb67f400700 1 --2- 172.21.15.2:0/1299713054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6801046d0 0x7fb68019ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.975+0000 7fb67f400700 1 -- 172.21.15.2:0/1299713054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb68010a6d0 msgr2=0x7fb68019f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.975+0000 7fb67f400700 1 --2- 172.21.15.2:0/1299713054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb68010a6d0 0x7fb68019f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.975+0000 7fb67f400700 1 -- 172.21.15.2:0/1299713054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68019fe80 con 0x7fb680105090 2024-06-13T02:16:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.975+0000 7fb685000700 1 --2- 172.21.15.2:0/1299713054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb68010a6d0 0x7fb68019f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:16:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.975+0000 7fb67f400700 1 --2- 172.21.15.2:0/1299713054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680105090 0x7fb68019b3b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00e9f0 tx=0x7fb66c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.975+0000 7fb67cc00700 1 -- 172.21.15.2:0/1299713054 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c00c9c0 con 0x7fb680105090 2024-06-13T02:16:40.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.975+0000 7fb67cc00700 1 -- 172.21.15.2:0/1299713054 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb66c00cb60 con 0x7fb680105090 2024-06-13T02:16:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.976+0000 7fb687000700 1 -- 172.21.15.2:0/1299713054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6801a0170 con 0x7fb680105090 2024-06-13T02:16:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.976+0000 7fb67cc00700 1 -- 172.21.15.2:0/1299713054 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c018680 con 0x7fb680105090 2024-06-13T02:16:40.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.976+0000 7fb687000700 1 -- 172.21.15.2:0/1299713054 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6801a79f0 con 0x7fb680105090 2024-06-13T02:16:40.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.979+0000 7fb67cc00700 1 -- 172.21.15.2:0/1299713054 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fb66c010430 con 0x7fb680105090 2024-06-13T02:16:40.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.980+0000 7fb691965b80 1 Processor -- start 2024-06-13T02:16:40.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.981+0000 7fb691965b80 1 -- start start 2024-06-13T02:16:40.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.981+0000 7fb691965b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4f6b40 0x5651fe4f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:40.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.981+0000 7fb691965b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f7460 0x5651fe4f0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:40.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.981+0000 7fb691965b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f11f0 0x5651fe4f1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:40.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.981+0000 7fb691965b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5651fe3ff9c0 con 0x5651fe4f11f0 2024-06-13T02:16:40.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.981+0000 7fb691965b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5651fe442ab0 con 0x5651fe4f6b40 2024-06-13T02:16:40.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.981+0000 7fb691965b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5651fe3fd8a0 con 0x5651fe4f7460 2024-06-13T02:16:40.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.981+0000 7fb67fe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f7460 0x5651fe4f0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:40.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.981+0000 7fb67f400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f11f0 0x5651fe4f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:40.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.982+0000 7fb67fe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f7460 0x5651fe4f0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:37216/0 (socket says 172.21.15.2:37216) 2024-06-13T02:16:40.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.982+0000 7fb67fe00700 1 -- 172.21.15.2:0/872960709 learned_addr learned my addr 172.21.15.2:0/872960709 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:40.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.982+0000 7fb67cc00700 1 --2- 172.21.15.2:0/1299713054 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb6640a2c20 0x7fb6640a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:40.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.982+0000 7fb685000700 1 --2- 172.21.15.2:0/872960709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4f6b40 0x5651fe4f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:40.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.982+0000 7fb67cc00700 1 -- 172.21.15.2:0/1299713054 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fb66c0cf5a0 con 0x7fb680105090 2024-06-13T02:16:40.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.982+0000 7fb685000700 1 --2- 172.21.15.2:0/1299713054 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb6640a2c20 0x7fb6640a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:40.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.982+0000 7fb67fe00700 1 -- 172.21.15.2:0/872960709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4f6b40 msgr2=0x5651fe4f6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:40.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.982+0000 7fb67fe00700 1 --2- 172.21.15.2:0/872960709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4f6b40 0x5651fe4f6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.982+0000 7fb67fe00700 1 -- 172.21.15.2:0/872960709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f11f0 msgr2=0x5651fe4f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:40.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.982+0000 7fb67fe00700 1 --2- 172.21.15.2:0/872960709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f11f0 0x5651fe4f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.982+0000 7fb67fe00700 1 -- 172.21.15.2:0/872960709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651fe3eaf40 con 0x5651fe4f7460 2024-06-13T02:16:40.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.983+0000 7fb67fe00700 1 --2- 172.21.15.2:0/872960709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f7460 0x5651fe4f0cb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb6700096e0 tx=0x7fb670009710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55d4cb41b386e5b8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:40.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.983+0000 7fb685000700 1 --2- 172.21.15.2:0/1299713054 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb6640a2c20 0x7fb6640a50e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb678009d30 tx=0x7fb67800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:40.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.983+0000 7fb675600700 1 -- 172.21.15.2:0/872960709 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb670027070 con 0x5651fe4f7460 2024-06-13T02:16:40.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.983+0000 7fb675600700 1 -- 172.21.15.2:0/872960709 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb67000bd10 con 0x5651fe4f7460 2024-06-13T02:16:40.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.983+0000 7fb675600700 1 -- 172.21.15.2:0/872960709 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb670003b50 con 0x5651fe4f7460 2024-06-13T02:16:40.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.984+0000 7fb691965b80 1 -- 172.21.15.2:0/872960709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f7460 msgr2=0x5651fe4f0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:40.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.984+0000 7fb691965b80 1 --2- 172.21.15.2:0/872960709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f7460 0x5651fe4f0cb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb6700096e0 tx=0x7fb670009710 comp rx=0 tx=0).stop 2024-06-13T02:16:40.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.984+0000 7fb691965b80 1 -- 172.21.15.2:0/872960709 shutdown_connections 2024-06-13T02:16:40.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.984+0000 7fb691965b80 1 --2- 172.21.15.2:0/872960709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f11f0 0x5651fe4f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.984+0000 7fb691965b80 1 --2- 172.21.15.2:0/872960709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4f6b40 0x5651fe4f6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.984+0000 7fb691965b80 1 --2- 172.21.15.2:0/872960709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f7460 0x5651fe4f0cb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.984+0000 7fb691965b80 1 -- 172.21.15.2:0/872960709 >> 172.21.15.2:0/872960709 conn(0x5651fe41d120 msgr2=0x5651fe4ebfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:40.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.984+0000 7fb691965b80 1 -- 172.21.15.2:0/872960709 shutdown_connections 2024-06-13T02:16:40.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.984+0000 7fb691965b80 1 -- 172.21.15.2:0/872960709 wait complete. 2024-06-13T02:16:40.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.985+0000 7fb691965b80 1 -- start start 2024-06-13T02:16:40.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.985+0000 7fb691965b80 1 Processor -- start 2024-06-13T02:16:40.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.986+0000 7fb691965b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f11f0 0x5651fe4fd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:40.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.986+0000 7fb691965b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f6b40 0x5651fe4fa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:40.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.986+0000 7fb691965b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4f7460 0x5651fe4fa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:40.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.986+0000 7fb691965b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5651fe3def10 con 0x5651fe4f6b40 2024-06-13T02:16:40.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.986+0000 7fb691965b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5651fe43ea70 con 0x5651fe4f7460 2024-06-13T02:16:40.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.986+0000 7fb691965b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5651fe4fdde0 con 0x5651fe4f11f0 2024-06-13T02:16:40.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.986+0000 7fb691965b80 10 client.0 _ll_register_callbacks cb 0x5651fe3d8330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:16:40.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.986+0000 7fb67f400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f6b40 0x5651fe4fa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:40.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.986+0000 7fb67fe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f11f0 0x5651fe4fd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:40.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.986+0000 7fb67fe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f11f0 0x5651fe4fd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:37232/0 (socket says 172.21.15.2:37232) 2024-06-13T02:16:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.986+0000 7fb67fe00700 1 -- 172.21.15.2:0/2095141299 learned_addr learned my addr 172.21.15.2:0/2095141299 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.986+0000 7fb685000700 1 --2- 172.21.15.2:0/2095141299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4f7460 0x5651fe4fa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.987+0000 7fb67f400700 1 -- 172.21.15.2:0/2095141299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f11f0 msgr2=0x5651fe4fd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.987+0000 7fb67f400700 1 --2- 172.21.15.2:0/2095141299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f11f0 0x5651fe4fd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.987+0000 7fb67f400700 1 -- 172.21.15.2:0/2095141299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4f7460 msgr2=0x5651fe4fa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.987+0000 7fb67f400700 1 --2- 172.21.15.2:0/2095141299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4f7460 0x5651fe4fa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.987+0000 7fb67f400700 1 -- 172.21.15.2:0/2095141299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651fe391880 con 0x5651fe4f6b40 2024-06-13T02:16:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.987+0000 7fb67fe00700 1 --2- 172.21.15.2:0/2095141299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f11f0 0x5651fe4fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:16:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.987+0000 7fb67f400700 1 --2- 172.21.15.2:0/2095141299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f6b40 0x5651fe4fa460 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb66c098380 tx=0x7fb66c0d2f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea14757722099ba4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.987+0000 7fb66a000700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:16:40.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.987+0000 7fb66a000700 1 -- 172.21.15.2:0/2095141299 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c09b4f0 con 0x5651fe4f6b40 2024-06-13T02:16:40.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.987+0000 7fb66a000700 1 -- 172.21.15.2:0/2095141299 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fb66c09bc10 con 0x5651fe4f6b40 2024-06-13T02:16:40.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.987+0000 7fb691965b80 1 -- 172.21.15.2:0/2095141299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb67000bd10 con 0x5651fe4f6b40 2024-06-13T02:16:40.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.988+0000 7fb66a000700 1 -- 172.21.15.2:0/2095141299 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb66c09b310 con 0x5651fe4f6b40 2024-06-13T02:16:40.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.988+0000 7fb691965b80 10 client.14868 fetch_fsmap learned FSMap version 26 2024-06-13T02:16:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.988+0000 7fb691965b80 1 -- 172.21.15.2:0/2095141299 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5651fe508580 con 0x5651fe4f6b40 2024-06-13T02:16:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.988+0000 7fb66a000700 1 -- 172.21.15.2:0/2095141299 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb67000bd10 con 0x5651fe4f6b40 2024-06-13T02:16:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.988+0000 7fb66a000700 1 -- 172.21.15.2:0/2095141299 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb66c09cce0 con 0x5651fe4f6b40 2024-06-13T02:16:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.988+0000 7fb691965b80 10 client.14868 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T02:16:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.988+0000 7fb691965b80 10 client.14868 resolve_mds: resolved name 'g' to daemon mds.g 2024-06-13T02:16:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.988+0000 7fb691965b80 20 client.14868 populate_metadata read hostname 'smithi002' 2024-06-13T02:16:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.988+0000 7fb691965b80 1 --2- 172.21.15.2:0/2095141299 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x5651fe50ab60 0x5651fe50bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.988+0000 7fb691965b80 4 client.14868 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:16:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.988+0000 7fb691965b80 1 -- 172.21.15.2:0/2095141299 --> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651fe44ffb0 con 0x5651fe50ab60 2024-06-13T02:16:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.989+0000 7fb67fe00700 1 --2- 172.21.15.2:0/2095141299 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x5651fe50ab60 0x5651fe50bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.989+0000 7fb67fe00700 1 --2- 172.21.15.2:0/2095141299 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x5651fe50ab60 0x5651fe50bfd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a5f9f706e3af450 server_cookie=7a19c9df7dc37e98 in_seq=0 out_seq=0 2024-06-13T02:16:40.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.989+0000 7fb66a000700 10 client.14868 ms_handle_connect on v2:172.21.15.2:6838/3208917373 2024-06-13T02:16:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.990+0000 7fb66a000700 1 -- 172.21.15.2:0/2095141299 <== mds.1 v2:172.21.15.2:6838/3208917373 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5651fe44ffb0 con 0x5651fe50ab60 2024-06-13T02:16:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.990+0000 7fb66a000700 10 client.14868 handle_command_reply: tid=0 2024-06-13T02:16:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.991+0000 7fb691965b80 1 client.14868 shutdown 2024-06-13T02:16:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.991+0000 7fb691965b80 1 -- 172.21.15.2:0/2095141299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f6b40 msgr2=0x5651fe4fa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.991+0000 7fb691965b80 1 --2- 172.21.15.2:0/2095141299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f6b40 0x5651fe4fa460 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb66c098380 tx=0x7fb66c0d2f90 comp rx=0 tx=0).stop 2024-06-13T02:16:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.991+0000 7fb691965b80 1 -- 172.21.15.2:0/2095141299 shutdown_connections 2024-06-13T02:16:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.991+0000 7fb691965b80 1 --2- 172.21.15.2:0/2095141299 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x5651fe50ab60 0x5651fe50bfd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.991+0000 7fb66a000700 0 client.14868 ms_handle_reset on v2:172.21.15.2:6838/3208917373 2024-06-13T02:16:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.991+0000 7fb691965b80 1 --2- 172.21.15.2:0/2095141299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4f7460 0x5651fe4fa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.991+0000 7fb691965b80 1 --2- 172.21.15.2:0/2095141299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f11f0 0x5651fe4fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.991+0000 7fb691965b80 1 --2- 172.21.15.2:0/2095141299 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f6b40 0x5651fe4fa460 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.991+0000 7fb691965b80 1 -- 172.21.15.2:0/2095141299 >> 172.21.15.2:0/2095141299 conn(0x5651fe41d120 msgr2=0x5651fe4e5740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.991+0000 7fb691965b80 1 -- 172.21.15.2:0/2095141299 shutdown_connections 2024-06-13T02:16:40.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.991+0000 7fb691965b80 1 -- 172.21.15.2:0/2095141299 wait complete. 2024-06-13T02:16:40.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:40.991+0000 7fb691965b80 20 client.14868 trim_cache size 0 max 16384 2024-06-13T02:16:41.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.015+0000 7fb691965b80 1 Processor -- start 2024-06-13T02:16:41.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.015+0000 7fb691965b80 1 -- start start 2024-06-13T02:16:41.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.015+0000 7fb691965b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f11f0 0x5651fe4f0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:41.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.015+0000 7fb691965b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4f6b40 0x5651fe4e60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:41.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.015+0000 7fb691965b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f7460 0x5651fe4fcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:41.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.015+0000 7fb691965b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5651fe50a310 con 0x5651fe4f7460 2024-06-13T02:16:41.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.015+0000 7fb691965b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5651fe50a9e0 con 0x5651fe4f6b40 2024-06-13T02:16:41.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.015+0000 7fb691965b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5651fe50b0b0 con 0x5651fe4f11f0 2024-06-13T02:16:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.016+0000 7fb67fe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f11f0 0x5651fe4f0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.016+0000 7fb685000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f7460 0x5651fe4fcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.016+0000 7fb67fe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f11f0 0x5651fe4f0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:37242/0 (socket says 172.21.15.2:37242) 2024-06-13T02:16:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.016+0000 7fb67fe00700 1 -- 172.21.15.2:0/1640258334 learned_addr learned my addr 172.21.15.2:0/1640258334 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.016+0000 7fb67f400700 1 --2- 172.21.15.2:0/1640258334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4f6b40 0x5651fe4e60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.016+0000 7fb67fe00700 1 -- 172.21.15.2:0/1640258334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4f6b40 msgr2=0x5651fe4e60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.016+0000 7fb67fe00700 1 --2- 172.21.15.2:0/1640258334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4f6b40 0x5651fe4e60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.016+0000 7fb67fe00700 1 -- 172.21.15.2:0/1640258334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f7460 msgr2=0x5651fe4fcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:41.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.016+0000 7fb67fe00700 1 --2- 172.21.15.2:0/1640258334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f7460 0x5651fe4fcca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.016+0000 7fb67fe00700 1 -- 172.21.15.2:0/1640258334 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651fe4f89f0 con 0x5651fe4f11f0 2024-06-13T02:16:41.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.016+0000 7fb67fe00700 1 --2- 172.21.15.2:0/1640258334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f11f0 0x5651fe4f0cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb670009290 tx=0x7fb670009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e366435810093ad4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:41.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.017+0000 7fb674c00700 1 -- 172.21.15.2:0/1640258334 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb670027040 con 0x5651fe4f11f0 2024-06-13T02:16:41.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.017+0000 7fb674c00700 1 -- 172.21.15.2:0/1640258334 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb670033070 con 0x5651fe4f11f0 2024-06-13T02:16:41.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.017+0000 7fb674c00700 1 -- 172.21.15.2:0/1640258334 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb670003bd0 con 0x5651fe4f11f0 2024-06-13T02:16:41.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.017+0000 7fb691965b80 1 -- 172.21.15.2:0/1640258334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f11f0 msgr2=0x5651fe4f0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:41.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.017+0000 7fb691965b80 1 --2- 172.21.15.2:0/1640258334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f11f0 0x5651fe4f0cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb670009290 tx=0x7fb670009310 comp rx=0 tx=0).stop 2024-06-13T02:16:41.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.018+0000 7fb691965b80 1 -- 172.21.15.2:0/1640258334 shutdown_connections 2024-06-13T02:16:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.018+0000 7fb691965b80 1 --2- 172.21.15.2:0/1640258334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f7460 0x5651fe4fcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.018+0000 7fb691965b80 1 --2- 172.21.15.2:0/1640258334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f11f0 0x5651fe4f0cb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.018+0000 7fb691965b80 1 --2- 172.21.15.2:0/1640258334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4f6b40 0x5651fe4e60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.018+0000 7fb691965b80 1 -- 172.21.15.2:0/1640258334 >> 172.21.15.2:0/1640258334 conn(0x5651fe41d120 msgr2=0x5651fe4f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.018+0000 7fb691965b80 1 -- 172.21.15.2:0/1640258334 shutdown_connections 2024-06-13T02:16:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.018+0000 7fb691965b80 1 -- 172.21.15.2:0/1640258334 wait complete. 2024-06-13T02:16:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.018+0000 7fb691965b80 1 -- start start 2024-06-13T02:16:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.018+0000 7fb691965b80 1 Processor -- start 2024-06-13T02:16:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.019+0000 7fb691965b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f6b40 0x5651fe515bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.019+0000 7fb691965b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f7460 0x5651fe4fc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.019+0000 7fb691965b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4fc5d0 0x5651fe4fca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.019+0000 7fb691965b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5651fe50be50 con 0x5651fe4f6b40 2024-06-13T02:16:41.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.019+0000 7fb691965b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5651fe50b780 con 0x5651fe4fc5d0 2024-06-13T02:16:41.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.019+0000 7fb691965b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5651fe50c520 con 0x5651fe4f7460 2024-06-13T02:16:41.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.019+0000 7fb691965b80 10 client.0 _ll_register_callbacks cb 0x5651fe3d8330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:16:41.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.019+0000 7fb67fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f6b40 0x5651fe515bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:41.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.019+0000 7fb685000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4fc5d0 0x5651fe4fca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.019+0000 7fb685000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4fc5d0 0x5651fe4fca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:56826/0 (socket says 172.21.15.2:56826) 2024-06-13T02:16:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.019+0000 7fb685000700 1 -- 172.21.15.2:0/1360430648 learned_addr learned my addr 172.21.15.2:0/1360430648 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.019+0000 7fb67f400700 1 --2- 172.21.15.2:0/1360430648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f7460 0x5651fe4fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.020+0000 7fb685000700 1 -- 172.21.15.2:0/1360430648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f7460 msgr2=0x5651fe4fc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.020+0000 7fb685000700 1 --2- 172.21.15.2:0/1360430648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f7460 0x5651fe4fc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.020+0000 7fb685000700 1 -- 172.21.15.2:0/1360430648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f6b40 msgr2=0x5651fe515bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.020+0000 7fb685000700 1 --2- 172.21.15.2:0/1360430648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f6b40 0x5651fe515bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.020+0000 7fb685000700 1 -- 172.21.15.2:0/1360430648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651fe513810 con 0x5651fe4fc5d0 2024-06-13T02:16:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.020+0000 7fb67fe00700 1 --2- 172.21.15.2:0/1360430648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f6b40 0x5651fe515bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:16:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.020+0000 7fb685000700 1 --2- 172.21.15.2:0/1360430648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4fc5d0 0x5651fe4fca50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb67800ed80 tx=0x7fb678004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e419a1fd0d65488 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:41.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.020+0000 7fb66a000700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:16:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.021+0000 7fb66a000700 1 -- 172.21.15.2:0/1360430648 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67801c030 con 0x5651fe4fc5d0 2024-06-13T02:16:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.021+0000 7fb691965b80 1 -- 172.21.15.2:0/1360430648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb670033070 con 0x5651fe4fc5d0 2024-06-13T02:16:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.021+0000 7fb66a000700 1 -- 172.21.15.2:0/1360430648 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fb678018b60 con 0x5651fe4fc5d0 2024-06-13T02:16:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.021+0000 7fb66a000700 1 -- 172.21.15.2:0/1360430648 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb678036050 con 0x5651fe4fc5d0 2024-06-13T02:16:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.021+0000 7fb691965b80 10 client.24995 fetch_fsmap learned FSMap version 26 2024-06-13T02:16:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.021+0000 7fb691965b80 1 -- 172.21.15.2:0/1360430648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5651fe576870 con 0x5651fe4fc5d0 2024-06-13T02:16:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.021+0000 7fb66a000700 1 -- 172.21.15.2:0/1360430648 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb670033070 con 0x5651fe4fc5d0 2024-06-13T02:16:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.021+0000 7fb66a000700 1 -- 172.21.15.2:0/1360430648 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb678022040 con 0x5651fe4fc5d0 2024-06-13T02:16:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.022+0000 7fb691965b80 10 client.24995 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T02:16:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.022+0000 7fb691965b80 10 client.24995 resolve_mds: resolved name 'g' to daemon mds.g 2024-06-13T02:16:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.022+0000 7fb691965b80 20 client.24995 populate_metadata read hostname 'smithi002' 2024-06-13T02:16:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.022+0000 7fb691965b80 1 --2- 172.21.15.2:0/1360430648 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x5651fe57b4a0 0x5651fe57a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.022+0000 7fb691965b80 4 client.24995 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T02:16:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.022+0000 7fb691965b80 1 -- 172.21.15.2:0/1360430648 --> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] -- command(tid 0: {"prefix": "status"}) -- 0x5651fe44a530 con 0x5651fe57b4a0 2024-06-13T02:16:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.022+0000 7fb67fe00700 1 --2- 172.21.15.2:0/1360430648 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x5651fe57b4a0 0x5651fe57a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb67fe00700 1 --2- 172.21.15.2:0/1360430648 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x5651fe57b4a0 0x5651fe57a1b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3d3dcc3fd3628c9e server_cookie=ddb832e9d94fe98f in_seq=0 out_seq=0 2024-06-13T02:16:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb66a000700 10 client.24995 ms_handle_connect on v2:172.21.15.2:6838/3208917373 2024-06-13T02:16:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb66a000700 1 -- 172.21.15.2:0/1360430648 <== mds.1 v2:172.21.15.2:6838/3208917373 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x5651fe44a530 con 0x5651fe57b4a0 2024-06-13T02:16:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb66a000700 10 client.24995 handle_command_reply: tid=0 2024-06-13T02:16:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb691965b80 1 client.24995 shutdown 2024-06-13T02:16:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb691965b80 1 -- 172.21.15.2:0/1360430648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4fc5d0 msgr2=0x5651fe4fca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb691965b80 1 --2- 172.21.15.2:0/1360430648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4fc5d0 0x5651fe4fca50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb67800ed80 tx=0x7fb678004ad0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb691965b80 1 -- 172.21.15.2:0/1360430648 shutdown_connections 2024-06-13T02:16:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb691965b80 1 --2- 172.21.15.2:0/1360430648 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x5651fe57b4a0 0x5651fe57a1b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb691965b80 1 --2- 172.21.15.2:0/1360430648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651fe4fc5d0 0x5651fe4fca50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb691965b80 1 --2- 172.21.15.2:0/1360430648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5651fe4f6b40 0x5651fe515bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb691965b80 1 --2- 172.21.15.2:0/1360430648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5651fe4f7460 0x5651fe4fc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb66a000700 0 client.24995 ms_handle_reset on v2:172.21.15.2:6838/3208917373 2024-06-13T02:16:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb691965b80 1 -- 172.21.15.2:0/1360430648 >> 172.21.15.2:0/1360430648 conn(0x5651fe41d120 msgr2=0x5651fe4f8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb691965b80 1 -- 172.21.15.2:0/1360430648 shutdown_connections 2024-06-13T02:16:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.023+0000 7fb691965b80 1 -- 172.21.15.2:0/1360430648 wait complete. 2024-06-13T02:16:41.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.024+0000 7fb691965b80 20 client.24995 trim_cache size 0 max 16384 2024-06-13T02:16:41.028 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T02:16:41.029 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "efed8ab4-2928-11ef-bc9c-c7b262605968", 2024-06-13T02:16:41.029 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2024-06-13T02:16:41.029 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24503, 2024-06-13T02:16:41.029 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-06-13T02:16:41.029 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-06-13T02:16:41.029 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-06-13T02:16:41.029 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 156.454911856, 2024-06-13T02:16:41.029 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 26, 2024-06-13T02:16:41.029 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 100, 2024-06-13T02:16:41.029 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 98, 2024-06-13T02:16:41.029 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 268.17941903000002 2024-06-13T02:16:41.029 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T02:16:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.024+0000 7fb687000700 1 -- 172.21.15.2:0/1299713054 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb6640a2c20 msgr2=0x7fb6640a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.024+0000 7fb687000700 1 --2- 172.21.15.2:0/1299713054 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb6640a2c20 0x7fb6640a50e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb678009d30 tx=0x7fb67800b040 comp rx=0 tx=0).stop 2024-06-13T02:16:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.024+0000 7fb687000700 1 -- 172.21.15.2:0/1299713054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680105090 msgr2=0x7fb68019b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.024+0000 7fb687000700 1 --2- 172.21.15.2:0/1299713054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680105090 0x7fb68019b3b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00e9f0 tx=0x7fb66c00ed00 comp rx=0 tx=0).stop 2024-06-13T02:16:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.025+0000 7fb687000700 1 -- 172.21.15.2:0/1299713054 shutdown_connections 2024-06-13T02:16:41.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.025+0000 7fb687000700 1 --2- 172.21.15.2:0/1299713054 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb6640a2c20 0x7fb6640a50e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.025+0000 7fb687000700 1 --2- 172.21.15.2:0/1299713054 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb68010a6d0 0x7fb68019f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.025+0000 7fb687000700 1 --2- 172.21.15.2:0/1299713054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6801046d0 0x7fb68019ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.025+0000 7fb687000700 1 --2- 172.21.15.2:0/1299713054 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680105090 0x7fb68019b3b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.025+0000 7fb687000700 1 -- 172.21.15.2:0/1299713054 >> 172.21.15.2:0/1299713054 conn(0x7fb6801001c0 msgr2=0x7fb680100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.025+0000 7fb687000700 1 -- 172.21.15.2:0/1299713054 shutdown_connections 2024-06-13T02:16:41.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:41.025+0000 7fb687000700 1 -- 172.21.15.2:0/1299713054 wait complete. 2024-06-13T02:16:41.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:41 smithi002 ceph-mon[31960]: pgmap v458: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:16:42.110 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell mds.b status 2024-06-13T02:16:42.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:41 smithi084 ceph-mon[36833]: pgmap v458: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:16:42.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:41 smithi175 ceph-mon[36977]: pgmap v458: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:16:42.577 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:16:44.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:43 smithi002 ceph-mon[31960]: pgmap v459: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:16:44.041 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:43 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:16:44.084 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:43 smithi175 ceph-mon[36977]: pgmap v459: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:16:44.085 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:43 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:16:44.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:43 smithi084 ceph-mon[36833]: pgmap v459: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:16:44.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:43 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:16:44.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.866+0000 7fbfebe00700 1 -- 172.21.15.2:0/694372218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfe4108500 msgr2=0x7fbfe41088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:44.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.866+0000 7fbfebe00700 1 --2- 172.21.15.2:0/694372218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfe4108500 0x7fbfe41088e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbfd80098f0 tx=0x7fbfd8009c00 comp rx=0 tx=0).stop 2024-06-13T02:16:44.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.866+0000 7fbfebe00700 1 -- 172.21.15.2:0/694372218 shutdown_connections 2024-06-13T02:16:44.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.866+0000 7fbfebe00700 1 --2- 172.21.15.2:0/694372218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfe406ab30 0x7fbfe410f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.866+0000 7fbfebe00700 1 --2- 172.21.15.2:0/694372218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfe4108500 0x7fbfe41088e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.866+0000 7fbfebe00700 1 --2- 172.21.15.2:0/694372218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfe406a170 0x7fbfe406a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.866+0000 7fbfebe00700 1 -- 172.21.15.2:0/694372218 >> 172.21.15.2:0/694372218 conn(0x7fbfe4078340 msgr2=0x7fbfe4078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:44.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.867+0000 7fbfebe00700 1 -- 172.21.15.2:0/694372218 shutdown_connections 2024-06-13T02:16:44.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.867+0000 7fbfebe00700 1 -- 172.21.15.2:0/694372218 wait complete. 2024-06-13T02:16:44.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.868+0000 7fbfebe00700 1 Processor -- start 2024-06-13T02:16:44.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.868+0000 7fbfebe00700 1 -- start start 2024-06-13T02:16:44.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.868+0000 7fbfebe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfe406a170 0x7fbfe419ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.868+0000 7fbfebe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfe406ab30 0x7fbfe419b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.868+0000 7fbfebe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfe4108500 0x7fbfe419f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.868+0000 7fbfebe00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe4112760 con 0x7fbfe406ab30 2024-06-13T02:16:44.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.868+0000 7fbfebe00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe41125e0 con 0x7fbfe4108500 2024-06-13T02:16:44.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.868+0000 7fbfebe00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe41128e0 con 0x7fbfe406a170 2024-06-13T02:16:44.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.869+0000 7fbfe9400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfe406a170 0x7fbfe419ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.869+0000 7fbfe8a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfe406ab30 0x7fbfe419b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.869+0000 7fbfe9400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfe406a170 0x7fbfe419ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:39232/0 (socket says 172.21.15.2:39232) 2024-06-13T02:16:44.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.869+0000 7fbfe9400700 1 -- 172.21.15.2:0/415562380 learned_addr learned my addr 172.21.15.2:0/415562380 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:44.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.869+0000 7fbfe9e00700 1 --2- 172.21.15.2:0/415562380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfe4108500 0x7fbfe419f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.869+0000 7fbfe9400700 1 -- 172.21.15.2:0/415562380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfe4108500 msgr2=0x7fbfe419f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:44.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.869+0000 7fbfe9400700 1 --2- 172.21.15.2:0/415562380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfe4108500 0x7fbfe419f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.869+0000 7fbfe9400700 1 -- 172.21.15.2:0/415562380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfe406ab30 msgr2=0x7fbfe419b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:44.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.869+0000 7fbfe9400700 1 --2- 172.21.15.2:0/415562380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfe406ab30 0x7fbfe419b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.869+0000 7fbfe9400700 1 -- 172.21.15.2:0/415562380 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe419fe70 con 0x7fbfe406a170 2024-06-13T02:16:44.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.869+0000 7fbfe9e00700 1 --2- 172.21.15.2:0/415562380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfe4108500 0x7fbfe419f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:16:44.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.870+0000 7fbfe9400700 1 --2- 172.21.15.2:0/415562380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfe406a170 0x7fbfe419ae60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009230 tx=0x7fbfd800fa70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:44.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.870+0000 7fbfe2000700 1 -- 172.21.15.2:0/415562380 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8005180 con 0x7fbfe406a170 2024-06-13T02:16:44.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.870+0000 7fbfe2000700 1 -- 172.21.15.2:0/415562380 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfd800b560 con 0x7fbfe406a170 2024-06-13T02:16:44.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.870+0000 7fbfe2000700 1 -- 172.21.15.2:0/415562380 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8003a70 con 0x7fbfe406a170 2024-06-13T02:16:44.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.870+0000 7fbfebe00700 1 -- 172.21.15.2:0/415562380 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe41a0100 con 0x7fbfe406a170 2024-06-13T02:16:44.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.870+0000 7fbfebe00700 1 -- 172.21.15.2:0/415562380 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe41a79e0 con 0x7fbfe406a170 2024-06-13T02:16:44.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.873+0000 7fbfe2000700 1 -- 172.21.15.2:0/415562380 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fbfd8029060 con 0x7fbfe406a170 2024-06-13T02:16:44.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.875+0000 7fbff6851b80 1 Processor -- start 2024-06-13T02:16:44.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.875+0000 7fbff6851b80 1 -- start start 2024-06-13T02:16:44.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.875+0000 7fbfe2000700 1 --2- 172.21.15.2:0/415562380 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fbfcc0a2ca0 0x7fbfcc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.875+0000 7fbfe2000700 1 -- 172.21.15.2:0/415562380 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fbfd80cfcc0 con 0x7fbfe406a170 2024-06-13T02:16:44.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.875+0000 7fbff6851b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72eddd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.875+0000 7fbff6851b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 0x55f72eddd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.875+0000 7fbff6851b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 0x55f72edea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.875+0000 7fbff6851b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f72ecec9c0 con 0x55f72ed59df0 2024-06-13T02:16:44.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.875+0000 7fbff6851b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f72ed2fab0 con 0x55f72eddd560 2024-06-13T02:16:44.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.875+0000 7fbff6851b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f72ecea8a0 con 0x55f72ede82b0 2024-06-13T02:16:44.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.875+0000 7fbfe9e00700 1 --2- 172.21.15.2:0/415562380 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fbfcc0a2ca0 0x7fbfcc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.876+0000 7fbfe9400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72eddd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.876+0000 7fbfe9400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72eddd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53718/0 (socket says 172.21.15.2:53718) 2024-06-13T02:16:44.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.876+0000 7fbfe9400700 1 -- 172.21.15.2:0/444341514 learned_addr learned my addr 172.21.15.2:0/444341514 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:44.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.876+0000 7fbfe9e00700 1 --2- 172.21.15.2:0/444341514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 0x55f72edea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.876+0000 7fbfe9400700 1 -- 172.21.15.2:0/444341514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 msgr2=0x55f72edea6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.876+0000 7fbfe9400700 1 --2- 172.21.15.2:0/444341514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 0x55f72edea6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.876+0000 7fbfe9400700 1 -- 172.21.15.2:0/444341514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 msgr2=0x55f72eddd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.876+0000 7fbfe9400700 1 --2- 172.21.15.2:0/444341514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 0x55f72eddd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.876+0000 7fbfe9400700 1 -- 172.21.15.2:0/444341514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f72ecd7f40 con 0x55f72ed59df0 2024-06-13T02:16:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.877+0000 7fbfe9e00700 1 --2- 172.21.15.2:0/415562380 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fbfcc0a2ca0 0x7fbfcc0a5160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc004230 tx=0x7fbfdc0045f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.877+0000 7fbfe9400700 1 --2- 172.21.15.2:0/444341514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72eddd020 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbfd809c0f0 tx=0x7fbfd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9df5907055b117 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.877+0000 7fbfd6a00700 1 -- 172.21.15.2:0/444341514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80b5070 con 0x55f72ed59df0 2024-06-13T02:16:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.877+0000 7fbfd6a00700 1 -- 172.21.15.2:0/444341514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfd80a4d40 con 0x55f72ed59df0 2024-06-13T02:16:44.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.877+0000 7fbfd6a00700 1 -- 172.21.15.2:0/444341514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80a0170 con 0x55f72ed59df0 2024-06-13T02:16:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.878+0000 7fbff6851b80 1 -- 172.21.15.2:0/444341514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 msgr2=0x55f72eddd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.878+0000 7fbff6851b80 1 --2- 172.21.15.2:0/444341514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72eddd020 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbfd809c0f0 tx=0x7fbfd8009c00 comp rx=0 tx=0).stop 2024-06-13T02:16:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.878+0000 7fbff6851b80 1 -- 172.21.15.2:0/444341514 shutdown_connections 2024-06-13T02:16:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.878+0000 7fbff6851b80 1 --2- 172.21.15.2:0/444341514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 0x55f72edea6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.878+0000 7fbff6851b80 1 --2- 172.21.15.2:0/444341514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72eddd020 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.878+0000 7fbff6851b80 1 --2- 172.21.15.2:0/444341514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 0x55f72eddd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.878+0000 7fbff6851b80 1 -- 172.21.15.2:0/444341514 >> 172.21.15.2:0/444341514 conn(0x55f72ed0a120 msgr2=0x55f72edd9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:44.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.878+0000 7fbff6851b80 1 -- 172.21.15.2:0/444341514 shutdown_connections 2024-06-13T02:16:44.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.878+0000 7fbff6851b80 1 -- 172.21.15.2:0/444341514 wait complete. 2024-06-13T02:16:44.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.879+0000 7fbff6851b80 1 -- start start 2024-06-13T02:16:44.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.879+0000 7fbff6851b80 1 Processor -- start 2024-06-13T02:16:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbff6851b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72ed59df0 0x55f72ede7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbff6851b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72eddd560 0x55f72ede4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbff6851b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ede82b0 0x55f72ede52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbff6851b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f72eccbf10 con 0x55f72ede82b0 2024-06-13T02:16:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbff6851b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f72ed2ba70 con 0x55f72ed59df0 2024-06-13T02:16:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbff6851b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f72edead20 con 0x55f72eddd560 2024-06-13T02:16:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbff6851b80 10 client.0 _ll_register_callbacks cb 0x55f72ecc96d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:16:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbfe9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ede82b0 0x55f72ede52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbfe9400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72ed59df0 0x55f72ede7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbfe9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ede82b0 0x55f72ede52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53724/0 (socket says 172.21.15.2:53724) 2024-06-13T02:16:44.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbfe9e00700 1 -- 172.21.15.2:0/2731866268 learned_addr learned my addr 172.21.15.2:0/2731866268 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:44.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbfe8a00700 1 --2- 172.21.15.2:0/2731866268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72eddd560 0x55f72ede4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbfe9e00700 1 -- 172.21.15.2:0/2731866268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72eddd560 msgr2=0x55f72ede4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:44.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbfe9e00700 1 --2- 172.21.15.2:0/2731866268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72eddd560 0x55f72ede4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbfe9e00700 1 -- 172.21.15.2:0/2731866268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72ed59df0 msgr2=0x55f72ede7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:44.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.880+0000 7fbfe9e00700 1 --2- 172.21.15.2:0/2731866268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72ed59df0 0x55f72ede7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.881+0000 7fbfe9e00700 1 -- 172.21.15.2:0/2731866268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f72ec7e880 con 0x55f72ede82b0 2024-06-13T02:16:44.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.881+0000 7fbfe9400700 1 --2- 172.21.15.2:0/2731866268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72ed59df0 0x55f72ede7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:16:44.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.881+0000 7fbfe9e00700 1 --2- 172.21.15.2:0/2731866268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ede82b0 0x55f72ede52d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00efa0 tx=0x7fbfdc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3b7ff059ac64e4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:44.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.881+0000 7fbfcb400700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:16:44.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.881+0000 7fbfcb400700 1 -- 172.21.15.2:0/2731866268 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc028020 con 0x55f72ede82b0 2024-06-13T02:16:44.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.881+0000 7fbff6851b80 1 -- 172.21.15.2:0/2731866268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfd80a4d40 con 0x55f72ede82b0 2024-06-13T02:16:44.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.881+0000 7fbfcb400700 1 -- 172.21.15.2:0/2731866268 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fbfdc024620 con 0x55f72ede82b0 2024-06-13T02:16:44.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.882+0000 7fbfcb400700 1 -- 172.21.15.2:0/2731866268 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbfdc033050 con 0x55f72ede82b0 2024-06-13T02:16:44.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.882+0000 7fbff6851b80 10 client.14886 fetch_fsmap learned FSMap version 26 2024-06-13T02:16:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.882+0000 7fbff6851b80 1 -- 172.21.15.2:0/2731866268 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f72edfdc90 con 0x55f72ede82b0 2024-06-13T02:16:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.882+0000 7fbfcb400700 1 -- 172.21.15.2:0/2731866268 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfd80a4d40 con 0x55f72ede82b0 2024-06-13T02:16:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.882+0000 7fbfcb400700 1 -- 172.21.15.2:0/2731866268 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fbfdc018930 con 0x55f72ede82b0 2024-06-13T02:16:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.883+0000 7fbff6851b80 10 client.14886 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T02:16:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.883+0000 7fbff6851b80 10 client.14886 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T02:16:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.883+0000 7fbff6851b80 20 client.14886 populate_metadata read hostname 'smithi002' 2024-06-13T02:16:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.883+0000 7fbff6851b80 1 --2- 172.21.15.2:0/2731866268 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f72ee00360 0x55f72ee017d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.883+0000 7fbff6851b80 4 client.14886 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:16:44.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.883+0000 7fbff6851b80 1 -- 172.21.15.2:0/2731866268 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f72ed3cfb0 con 0x55f72ee00360 2024-06-13T02:16:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.883+0000 7fbfe9400700 1 --2- 172.21.15.2:0/2731866268 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f72ee00360 0x55f72ee017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.884+0000 7fbfe9400700 1 --2- 172.21.15.2:0/2731866268 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f72ee00360 0x55f72ee017d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a288653cc7639f4 server_cookie=899c64cccecc214f in_seq=0 out_seq=0 2024-06-13T02:16:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.884+0000 7fbfcb400700 10 client.14886 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:16:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.885+0000 7fbfcb400700 1 -- 172.21.15.2:0/2731866268 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f72ed3cfb0 con 0x55f72ee00360 2024-06-13T02:16:44.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.885+0000 7fbfcb400700 10 client.14886 handle_command_reply: tid=0 2024-06-13T02:16:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.885+0000 7fbff6851b80 1 client.14886 shutdown 2024-06-13T02:16:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.886+0000 7fbff6851b80 1 -- 172.21.15.2:0/2731866268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ede82b0 msgr2=0x55f72ede52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.886+0000 7fbff6851b80 1 --2- 172.21.15.2:0/2731866268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ede82b0 0x55f72ede52d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00efa0 tx=0x7fbfdc004b40 comp rx=0 tx=0).stop 2024-06-13T02:16:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.886+0000 7fbff6851b80 1 -- 172.21.15.2:0/2731866268 shutdown_connections 2024-06-13T02:16:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.886+0000 7fbff6851b80 1 --2- 172.21.15.2:0/2731866268 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f72ee00360 0x55f72ee017d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.886+0000 7fbff6851b80 1 --2- 172.21.15.2:0/2731866268 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ede82b0 0x55f72ede52d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.886+0000 7fbff6851b80 1 --2- 172.21.15.2:0/2731866268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72ed59df0 0x55f72ede7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.886+0000 7fbff6851b80 1 --2- 172.21.15.2:0/2731866268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72eddd560 0x55f72ede4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.886+0000 7fbff6851b80 1 -- 172.21.15.2:0/2731866268 >> 172.21.15.2:0/2731866268 conn(0x55f72ed0a120 msgr2=0x55f72edd86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.886+0000 7fbfcb400700 0 client.14886 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:16:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.887+0000 7fbff6851b80 1 -- 172.21.15.2:0/2731866268 shutdown_connections 2024-06-13T02:16:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.887+0000 7fbff6851b80 1 -- 172.21.15.2:0/2731866268 wait complete. 2024-06-13T02:16:44.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.887+0000 7fbff6851b80 20 client.14886 trim_cache size 0 max 16384 2024-06-13T02:16:44.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.912+0000 7fbff6851b80 1 Processor -- start 2024-06-13T02:16:44.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.913+0000 7fbff6851b80 1 -- start start 2024-06-13T02:16:44.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.913+0000 7fbff6851b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72edd8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.913+0000 7fbff6851b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 0x55f72ede96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.913+0000 7fbff6851b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 0x55f72ede9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.913+0000 7fbff6851b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f72edffb10 con 0x55f72ed59df0 2024-06-13T02:16:44.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.913+0000 7fbff6851b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f72ee001e0 con 0x55f72eddd560 2024-06-13T02:16:44.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.913+0000 7fbff6851b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f72ee008b0 con 0x55f72ede82b0 2024-06-13T02:16:44.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.913+0000 7fbfe9400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72edd8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.913+0000 7fbfe8a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 0x55f72ede96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.913+0000 7fbfe8a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 0x55f72ede96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:59232/0 (socket says 172.21.15.2:59232) 2024-06-13T02:16:44.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.913+0000 7fbfe8a00700 1 -- 172.21.15.2:0/2774126159 learned_addr learned my addr 172.21.15.2:0/2774126159 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:44.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.913+0000 7fbfe9e00700 1 --2- 172.21.15.2:0/2774126159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 0x55f72ede9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.914+0000 7fbfe8a00700 1 -- 172.21.15.2:0/2774126159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 msgr2=0x55f72ede9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.914+0000 7fbfe8a00700 1 --2- 172.21.15.2:0/2774126159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 0x55f72ede9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.914+0000 7fbfe8a00700 1 -- 172.21.15.2:0/2774126159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 msgr2=0x55f72edd8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.914+0000 7fbfe8a00700 1 --2- 172.21.15.2:0/2774126159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72edd8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.914+0000 7fbfe8a00700 1 -- 172.21.15.2:0/2774126159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f72ede5cd0 con 0x55f72eddd560 2024-06-13T02:16:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.914+0000 7fbfe9e00700 1 --2- 172.21.15.2:0/2774126159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 0x55f72ede9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:16:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.914+0000 7fbfe9400700 1 --2- 172.21.15.2:0/2774126159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72edd8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:16:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.914+0000 7fbfe8a00700 1 --2- 172.21.15.2:0/2774126159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 0x55f72ede96a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4103490 tx=0x7fbfd0009ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e1c9b5cd7c7ed9c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.914+0000 7fbfd6000700 1 -- 172.21.15.2:0/2774126159 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00120d0 con 0x55f72eddd560 2024-06-13T02:16:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.914+0000 7fbfd6000700 1 -- 172.21.15.2:0/2774126159 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfd0012270 con 0x55f72eddd560 2024-06-13T02:16:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.914+0000 7fbfd6000700 1 -- 172.21.15.2:0/2774126159 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0005280 con 0x55f72eddd560 2024-06-13T02:16:44.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.915+0000 7fbff6851b80 1 -- 172.21.15.2:0/2774126159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 msgr2=0x55f72ede96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:44.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.915+0000 7fbff6851b80 1 --2- 172.21.15.2:0/2774126159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 0x55f72ede96a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4103490 tx=0x7fbfd0009ee0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.915+0000 7fbff6851b80 1 -- 172.21.15.2:0/2774126159 shutdown_connections 2024-06-13T02:16:44.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.915+0000 7fbff6851b80 1 --2- 172.21.15.2:0/2774126159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 0x55f72ede9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.915+0000 7fbff6851b80 1 --2- 172.21.15.2:0/2774126159 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72edd8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.915+0000 7fbff6851b80 1 --2- 172.21.15.2:0/2774126159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 0x55f72ede96a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.915+0000 7fbff6851b80 1 -- 172.21.15.2:0/2774126159 >> 172.21.15.2:0/2774126159 conn(0x55f72ed0a120 msgr2=0x55f72edd7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:44.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.915+0000 7fbff6851b80 1 -- 172.21.15.2:0/2774126159 shutdown_connections 2024-06-13T02:16:44.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.916+0000 7fbff6851b80 1 -- 172.21.15.2:0/2774126159 wait complete. 2024-06-13T02:16:44.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.916+0000 7fbff6851b80 1 -- start start 2024-06-13T02:16:44.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.916+0000 7fbff6851b80 1 Processor -- start 2024-06-13T02:16:44.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbff6851b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72ee0b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbff6851b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 0x55f72ede1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbff6851b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 0x55f72ede23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbff6851b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f72ee01650 con 0x55f72ed59df0 2024-06-13T02:16:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbff6851b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f72ee00f80 con 0x55f72eddd560 2024-06-13T02:16:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbff6851b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f72ee01d20 con 0x55f72ede82b0 2024-06-13T02:16:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbff6851b80 10 client.0 _ll_register_callbacks cb 0x55f72ecc96d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:16:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbfe9400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72ee0b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbfe8a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 0x55f72ede1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbfe9400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72ee0b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53738/0 (socket says 172.21.15.2:53738) 2024-06-13T02:16:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbfe9400700 1 -- 172.21.15.2:0/1962905314 learned_addr learned my addr 172.21.15.2:0/1962905314 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbfe9e00700 1 --2- 172.21.15.2:0/1962905314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 0x55f72ede23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbfe8a00700 1 -- 172.21.15.2:0/1962905314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 msgr2=0x55f72ede23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:44.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbfe8a00700 1 --2- 172.21.15.2:0/1962905314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 0x55f72ede23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbfe8a00700 1 -- 172.21.15.2:0/1962905314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 msgr2=0x55f72ee0b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:16:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbfe8a00700 1 --2- 172.21.15.2:0/1962905314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72ee0b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.917+0000 7fbfe8a00700 1 -- 172.21.15.2:0/1962905314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f72ee09030 con 0x55f72eddd560 2024-06-13T02:16:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.918+0000 7fbfe8a00700 1 --2- 172.21.15.2:0/1962905314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 0x55f72ede1cb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55f72ed2b690 tx=0x7fbfd0012b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f78b49f0d51d82b8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.918+0000 7fbfcb400700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:16:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.918+0000 7fbfcb400700 1 -- 172.21.15.2:0/1962905314 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00120d0 con 0x55f72eddd560 2024-06-13T02:16:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.918+0000 7fbff6851b80 1 -- 172.21.15.2:0/1962905314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfd0012270 con 0x55f72eddd560 2024-06-13T02:16:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.918+0000 7fbfcb400700 1 -- 172.21.15.2:0/1962905314 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fbfd0004030 con 0x55f72eddd560 2024-06-13T02:16:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.918+0000 7fbfcb400700 1 -- 172.21.15.2:0/1962905314 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbfd0004230 con 0x55f72eddd560 2024-06-13T02:16:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.918+0000 7fbff6851b80 10 client.25010 fetch_fsmap learned FSMap version 26 2024-06-13T02:16:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.918+0000 7fbff6851b80 1 -- 172.21.15.2:0/1962905314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f72ee6bde0 con 0x55f72eddd560 2024-06-13T02:16:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.919+0000 7fbfcb400700 1 -- 172.21.15.2:0/1962905314 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfd0012270 con 0x55f72eddd560 2024-06-13T02:16:44.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.919+0000 7fbfcb400700 1 -- 172.21.15.2:0/1962905314 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fbfd0004ed0 con 0x55f72eddd560 2024-06-13T02:16:44.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.919+0000 7fbff6851b80 10 client.25010 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T02:16:44.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.919+0000 7fbff6851b80 10 client.25010 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T02:16:44.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.919+0000 7fbff6851b80 20 client.25010 populate_metadata read hostname 'smithi002' 2024-06-13T02:16:44.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.919+0000 7fbff6851b80 1 --2- 172.21.15.2:0/1962905314 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f72ee707e0 0x55f72ee6f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:44.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.919+0000 7fbff6851b80 4 client.25010 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T02:16:44.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.919+0000 7fbff6851b80 1 -- 172.21.15.2:0/1962905314 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "status"}) -- 0x55f72ed37530 con 0x55f72ee707e0 2024-06-13T02:16:44.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.919+0000 7fbfe9400700 1 --2- 172.21.15.2:0/1962905314 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f72ee707e0 0x55f72ee6f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:44.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.920+0000 7fbfe9400700 1 --2- 172.21.15.2:0/1962905314 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f72ee707e0 0x55f72ee6f4f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c0bd57fa9aea29c server_cookie=71f7f754d53fbab8 in_seq=0 out_seq=0 2024-06-13T02:16:44.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.920+0000 7fbfcb400700 10 client.25010 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:16:44.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.920+0000 7fbfcb400700 1 -- 172.21.15.2:0/1962905314 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55f72ed37530 con 0x55f72ee707e0 2024-06-13T02:16:44.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.920+0000 7fbfcb400700 10 client.25010 handle_command_reply: tid=0 2024-06-13T02:16:44.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.920+0000 7fbff6851b80 1 client.25010 shutdown 2024-06-13T02:16:44.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.920+0000 7fbff6851b80 1 -- 172.21.15.2:0/1962905314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 msgr2=0x55f72ede1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:44.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.920+0000 7fbff6851b80 1 --2- 172.21.15.2:0/1962905314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 0x55f72ede1cb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55f72ed2b690 tx=0x7fbfd0012b30 comp rx=0 tx=0).stop 2024-06-13T02:16:44.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.921+0000 7fbff6851b80 1 -- 172.21.15.2:0/1962905314 shutdown_connections 2024-06-13T02:16:44.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.921+0000 7fbff6851b80 1 --2- 172.21.15.2:0/1962905314 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f72ee707e0 0x55f72ee6f4f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.921+0000 7fbff6851b80 1 --2- 172.21.15.2:0/1962905314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f72ede82b0 0x55f72ede23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.921+0000 7fbff6851b80 1 --2- 172.21.15.2:0/1962905314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f72ed59df0 0x55f72ee0b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.921+0000 7fbff6851b80 1 --2- 172.21.15.2:0/1962905314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f72eddd560 0x55f72ede1cb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.921+0000 7fbfcb400700 0 client.25010 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:16:44.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.921+0000 7fbff6851b80 1 -- 172.21.15.2:0/1962905314 >> 172.21.15.2:0/1962905314 conn(0x55f72ed0a120 msgr2=0x55f72edd86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:44.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.921+0000 7fbff6851b80 1 -- 172.21.15.2:0/1962905314 shutdown_connections 2024-06-13T02:16:44.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.921+0000 7fbff6851b80 1 -- 172.21.15.2:0/1962905314 wait complete. 2024-06-13T02:16:44.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.921+0000 7fbff6851b80 20 client.25010 trim_cache size 0 max 16384 2024-06-13T02:16:44.926 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T02:16:44.926 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "efed8ab4-2928-11ef-bc9c-c7b262605968", 2024-06-13T02:16:44.926 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-06-13T02:16:44.926 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24527, 2024-06-13T02:16:44.926 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-06-13T02:16:44.926 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-06-13T02:16:44.926 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-06-13T02:16:44.926 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 241.41765382599999, 2024-06-13T02:16:44.926 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 26, 2024-06-13T02:16:44.926 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 100, 2024-06-13T02:16:44.927 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 98, 2024-06-13T02:16:44.927 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 264.95538650200001 2024-06-13T02:16:44.927 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T02:16:44.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.922+0000 7fbfebe00700 1 -- 172.21.15.2:0/415562380 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fbfcc0a2ca0 msgr2=0x7fbfcc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:44.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.922+0000 7fbfebe00700 1 --2- 172.21.15.2:0/415562380 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fbfcc0a2ca0 0x7fbfcc0a5160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc004230 tx=0x7fbfdc0045f0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.922+0000 7fbfebe00700 1 -- 172.21.15.2:0/415562380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfe406a170 msgr2=0x7fbfe419ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:44.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.922+0000 7fbfebe00700 1 --2- 172.21.15.2:0/415562380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfe406a170 0x7fbfe419ae60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009230 tx=0x7fbfd800fa70 comp rx=0 tx=0).stop 2024-06-13T02:16:44.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.922+0000 7fbfebe00700 1 -- 172.21.15.2:0/415562380 shutdown_connections 2024-06-13T02:16:44.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.922+0000 7fbfebe00700 1 --2- 172.21.15.2:0/415562380 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fbfcc0a2ca0 0x7fbfcc0a5160 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.922+0000 7fbfebe00700 1 --2- 172.21.15.2:0/415562380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfe4108500 0x7fbfe419f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.922+0000 7fbfebe00700 1 --2- 172.21.15.2:0/415562380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfe406a170 0x7fbfe419ae60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.922+0000 7fbfebe00700 1 --2- 172.21.15.2:0/415562380 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfe406ab30 0x7fbfe419b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:44.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.922+0000 7fbfebe00700 1 -- 172.21.15.2:0/415562380 >> 172.21.15.2:0/415562380 conn(0x7fbfe4078340 msgr2=0x7fbfe410d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:44.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.922+0000 7fbfebe00700 1 -- 172.21.15.2:0/415562380 shutdown_connections 2024-06-13T02:16:44.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:44.922+0000 7fbfebe00700 1 -- 172.21.15.2:0/415562380 wait complete. 2024-06-13T02:16:45.894 INFO:tasks.cephadm:Setup complete, yielding 2024-06-13T02:16:45.895 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-13T02:16:45.907 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T02:16:45.908 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- bash -c 'ceph orch status' 2024-06-13T02:16:46.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:45 smithi002 ceph-mon[31960]: pgmap v460: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:16:46.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:16:46.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:16:46.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:45 smithi002 ceph-mon[31960]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:16:46.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:45 smithi084 ceph-mon[36833]: pgmap v460: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:16:46.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:16:46.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:16:46.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:45 smithi084 ceph-mon[36833]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:16:46.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:45 smithi175 ceph-mon[36977]: pgmap v460: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:16:46.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:16:46.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:16:46.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:45 smithi175 ceph-mon[36977]: from='mgr.14152 172.21.15.2:0/2634016784' entity='mgr.x' 2024-06-13T02:16:46.382 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:16:48.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:47 smithi002 ceph-mon[31960]: pgmap v461: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:16:48.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:47 smithi084 ceph-mon[36833]: pgmap v461: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:16:48.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:47 smithi175 ceph-mon[36977]: pgmap v461: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:16:48.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.737+0000 7ff2d4e00700 1 -- 172.21.15.2:0/1361370810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d0104730 msgr2=0x7ff2d0104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:48.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.737+0000 7ff2d4e00700 1 --2- 172.21.15.2:0/1361370810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d0104730 0x7ff2d0104b50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00099c0 tx=0x7ff2c0009cd0 comp rx=0 tx=0).stop 2024-06-13T02:16:48.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.737+0000 7ff2d4e00700 1 -- 172.21.15.2:0/1361370810 shutdown_connections 2024-06-13T02:16:48.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.737+0000 7ff2d4e00700 1 --2- 172.21.15.2:0/1361370810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2d01062d0 0x7ff2d010cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:48.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.737+0000 7ff2d4e00700 1 --2- 172.21.15.2:0/1361370810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d0104730 0x7ff2d0104b50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:48.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.737+0000 7ff2d4e00700 1 --2- 172.21.15.2:0/1361370810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d0105930 0x7ff2d0105d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:48.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.737+0000 7ff2d4e00700 1 -- 172.21.15.2:0/1361370810 >> 172.21.15.2:0/1361370810 conn(0x7ff2d00ffcf0 msgr2=0x7ff2d0102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:48.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.737+0000 7ff2d4e00700 1 -- 172.21.15.2:0/1361370810 shutdown_connections 2024-06-13T02:16:48.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.738+0000 7ff2d4e00700 1 -- 172.21.15.2:0/1361370810 wait complete. 2024-06-13T02:16:48.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.739+0000 7ff2d4e00700 1 Processor -- start 2024-06-13T02:16:48.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.739+0000 7ff2d4e00700 1 -- start start 2024-06-13T02:16:48.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.740+0000 7ff2d4e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2d0104730 0x7ff2d019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:48.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.740+0000 7ff2d4e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d0105930 0x7ff2d019ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:48.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.740+0000 7ff2d4e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d01062d0 0x7ff2d01a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:48.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.740+0000 7ff2d4e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d0110340 con 0x7ff2d0105930 2024-06-13T02:16:48.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.740+0000 7ff2d4e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d01101c0 con 0x7ff2d0104730 2024-06-13T02:16:48.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.740+0000 7ff2d4e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d01104c0 con 0x7ff2d01062d0 2024-06-13T02:16:48.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.740+0000 7ff2cd400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d0105930 0x7ff2d019ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:48.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.740+0000 7ff2cd400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d0105930 0x7ff2d019ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53762/0 (socket says 172.21.15.2:53762) 2024-06-13T02:16:48.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.740+0000 7ff2cd400700 1 -- 172.21.15.2:0/12353869 learned_addr learned my addr 172.21.15.2:0/12353869 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:48.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.740+0000 7ff2cde00700 1 --2- 172.21.15.2:0/12353869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2d0104730 0x7ff2d019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:48.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.740+0000 7ff2ce800700 1 --2- 172.21.15.2:0/12353869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d01062d0 0x7ff2d01a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:48.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.741+0000 7ff2cd400700 1 -- 172.21.15.2:0/12353869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d01062d0 msgr2=0x7ff2d01a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:48.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.741+0000 7ff2cd400700 1 --2- 172.21.15.2:0/12353869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d01062d0 0x7ff2d01a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:48.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.741+0000 7ff2cd400700 1 -- 172.21.15.2:0/12353869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2d0104730 msgr2=0x7ff2d019a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:48.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.741+0000 7ff2cd400700 1 --2- 172.21.15.2:0/12353869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2d0104730 0x7ff2d019a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:48.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.741+0000 7ff2cd400700 1 -- 172.21.15.2:0/12353869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d01a2590 con 0x7ff2d0105930 2024-06-13T02:16:48.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.741+0000 7ff2cde00700 1 --2- 172.21.15.2:0/12353869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2d0104730 0x7ff2d019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:16:48.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.741+0000 7ff2cd400700 1 --2- 172.21.15.2:0/12353869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d0105930 0x7ff2d019ae70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00d980 tx=0x7ff2bc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:48.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.741+0000 7ff2c6a00700 1 -- 172.21.15.2:0/12353869 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc016070 con 0x7ff2d0105930 2024-06-13T02:16:48.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.741+0000 7ff2c6a00700 1 -- 172.21.15.2:0/12353869 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2bc009db0 con 0x7ff2d0105930 2024-06-13T02:16:48.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.741+0000 7ff2d4e00700 1 -- 172.21.15.2:0/12353869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d01a2880 con 0x7ff2d0105930 2024-06-13T02:16:48.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.741+0000 7ff2c6a00700 1 -- 172.21.15.2:0/12353869 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00f3c0 con 0x7ff2d0105930 2024-06-13T02:16:48.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.742+0000 7ff2d4e00700 1 -- 172.21.15.2:0/12353869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d01a2dc0 con 0x7ff2d0105930 2024-06-13T02:16:48.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.743+0000 7ff2d4e00700 1 -- 172.21.15.2:0/12353869 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d0069180 con 0x7ff2d0105930 2024-06-13T02:16:48.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.746+0000 7ff2c6a00700 1 -- 172.21.15.2:0/12353869 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7ff2bc019070 con 0x7ff2d0105930 2024-06-13T02:16:48.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.747+0000 7ff2c6a00700 1 --2- 172.21.15.2:0/12353869 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff2b40a2c20 0x7ff2b40a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:48.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.747+0000 7ff2c6a00700 1 -- 172.21.15.2:0/12353869 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7ff2bc0ce910 con 0x7ff2d0105930 2024-06-13T02:16:48.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.748+0000 7ff2cde00700 1 --2- 172.21.15.2:0/12353869 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff2b40a2c20 0x7ff2b40a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:48.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.748+0000 7ff2cde00700 1 --2- 172.21.15.2:0/12353869 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff2b40a2c20 0x7ff2b40a50e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000b580 tx=0x7ff2c0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:48.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:48.752+0000 7ff2c6a00700 1 -- 172.21.15.2:0/12353869 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff2bc09b480 con 0x7ff2d0105930 2024-06-13T02:16:49.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:49.000+0000 7ff2d4e00700 1 -- 172.21.15.2:0/12353869 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7ff2d00628d0 con 0x7ff2b40a2c20 2024-06-13T02:16:49.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:49.003+0000 7ff2c6a00700 1 -- 172.21.15.2:0/12353869 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7ff2d00628d0 con 0x7ff2b40a2c20 2024-06-13T02:16:49.004 INFO:teuthology.orchestra.run.smithi002.stdout:Backend: cephadm 2024-06-13T02:16:49.004 INFO:teuthology.orchestra.run.smithi002.stdout:Available: Yes 2024-06-13T02:16:49.004 INFO:teuthology.orchestra.run.smithi002.stdout:Paused: No 2024-06-13T02:16:49.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:49.006+0000 7ff2d4e00700 1 -- 172.21.15.2:0/12353869 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff2b40a2c20 msgr2=0x7ff2b40a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:49.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:49.006+0000 7ff2d4e00700 1 --2- 172.21.15.2:0/12353869 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff2b40a2c20 0x7ff2b40a50e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000b580 tx=0x7ff2c0005fb0 comp rx=0 tx=0).stop 2024-06-13T02:16:49.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:49.006+0000 7ff2d4e00700 1 -- 172.21.15.2:0/12353869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d0105930 msgr2=0x7ff2d019ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:49.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:49.006+0000 7ff2d4e00700 1 --2- 172.21.15.2:0/12353869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d0105930 0x7ff2d019ae70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00d980 tx=0x7ff2bc00dc90 comp rx=0 tx=0).stop 2024-06-13T02:16:49.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:49.006+0000 7ff2d4e00700 1 -- 172.21.15.2:0/12353869 shutdown_connections 2024-06-13T02:16:49.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:49.006+0000 7ff2d4e00700 1 --2- 172.21.15.2:0/12353869 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7ff2b40a2c20 0x7ff2b40a50e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:49.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:49.006+0000 7ff2d4e00700 1 --2- 172.21.15.2:0/12353869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d01062d0 0x7ff2d01a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:49.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:49.006+0000 7ff2d4e00700 1 --2- 172.21.15.2:0/12353869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2d0104730 0x7ff2d019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:49.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:49.006+0000 7ff2d4e00700 1 --2- 172.21.15.2:0/12353869 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2d0105930 0x7ff2d019ae70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:49.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:49.006+0000 7ff2d4e00700 1 -- 172.21.15.2:0/12353869 >> 172.21.15.2:0/12353869 conn(0x7ff2d00ffcf0 msgr2=0x7ff2d0108c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:49.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:49.006+0000 7ff2d4e00700 1 -- 172.21.15.2:0/12353869 shutdown_connections 2024-06-13T02:16:49.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:49.006+0000 7ff2d4e00700 1 -- 172.21.15.2:0/12353869 wait complete. 2024-06-13T02:16:49.894 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- bash -c 'ceph orch ps' 2024-06-13T02:16:50.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:49 smithi002 ceph-mon[31960]: pgmap v462: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:16:50.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:49 smithi002 ceph-mon[31960]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:16:50.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:49 smithi084 ceph-mon[36833]: pgmap v462: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:16:50.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:49 smithi084 ceph-mon[36833]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:16:50.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:49 smithi175 ceph-mon[36977]: pgmap v462: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:16:50.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:49 smithi175 ceph-mon[36977]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:16:50.363 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:16:52.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:51 smithi002 ceph-mon[31960]: pgmap v463: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:16:52.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:51 smithi084 ceph-mon[36833]: pgmap v463: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:16:52.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:51 smithi175 ceph-mon[36977]: pgmap v463: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:16:52.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.776+0000 7f9bdd000700 1 -- 172.21.15.2:0/3938321301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bd8103700 msgr2=0x7f9bd8103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:52.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.776+0000 7f9bdd000700 1 --2- 172.21.15.2:0/3938321301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bd8103700 0x7f9bd8103b60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00099c0 tx=0x7f9bc0009cd0 comp rx=0 tx=0).stop 2024-06-13T02:16:52.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.776+0000 7f9bdd000700 1 -- 172.21.15.2:0/3938321301 shutdown_connections 2024-06-13T02:16:52.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.776+0000 7f9bdd000700 1 --2- 172.21.15.2:0/3938321301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd81040a0 0x7f9bd810a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:52.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.776+0000 7f9bdd000700 1 --2- 172.21.15.2:0/3938321301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd8102500 0x7f9bd8102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:52.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.776+0000 7f9bdd000700 1 --2- 172.21.15.2:0/3938321301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bd8103700 0x7f9bd8103b60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:52.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.776+0000 7f9bdd000700 1 -- 172.21.15.2:0/3938321301 >> 172.21.15.2:0/3938321301 conn(0x7f9bd80fda60 msgr2=0x7f9bd80ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:52.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.776+0000 7f9bdd000700 1 -- 172.21.15.2:0/3938321301 shutdown_connections 2024-06-13T02:16:52.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.777+0000 7f9bdd000700 1 -- 172.21.15.2:0/3938321301 wait complete. 2024-06-13T02:16:52.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.778+0000 7f9bdd000700 1 Processor -- start 2024-06-13T02:16:52.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.778+0000 7f9bdd000700 1 -- start start 2024-06-13T02:16:52.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.779+0000 7f9bdd000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bd8102500 0x7f9bd819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:52.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.779+0000 7f9bdd000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd8103700 0x7f9bd819af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:52.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.779+0000 7f9bdd000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd81040a0 0x7f9bd81a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:52.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.779+0000 7f9bdd000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd810e190 con 0x7f9bd81040a0 2024-06-13T02:16:52.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.779+0000 7f9bdd000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd810e010 con 0x7f9bd8102500 2024-06-13T02:16:52.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.779+0000 7f9bdd000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd810e310 con 0x7f9bd8103700 2024-06-13T02:16:52.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.779+0000 7f9bd5e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bd8102500 0x7f9bd819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.779+0000 7f9bd5e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bd8102500 0x7f9bd819a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:56568/0 (socket says 172.21.15.2:56568) 2024-06-13T02:16:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.779+0000 7f9bd5e00700 1 -- 172.21.15.2:0/820697038 learned_addr learned my addr 172.21.15.2:0/820697038 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.779+0000 7f9bd6800700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd81040a0 0x7f9bd81a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.780+0000 7f9bcfe00700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd8103700 0x7f9bd819af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.780+0000 7f9bd5e00700 1 -- 172.21.15.2:0/820697038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd8103700 msgr2=0x7f9bd819af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.780+0000 7f9bd5e00700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd8103700 0x7f9bd819af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.780+0000 7f9bd5e00700 1 -- 172.21.15.2:0/820697038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd81040a0 msgr2=0x7f9bd81a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.780+0000 7f9bd5e00700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd81040a0 0x7f9bd81a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.780+0000 7f9bd5e00700 1 -- 172.21.15.2:0/820697038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd81a2620 con 0x7f9bd8102500 2024-06-13T02:16:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.780+0000 7f9bcfe00700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd8103700 0x7f9bd819af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:16:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.780+0000 7f9bd6800700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd81040a0 0x7f9bd81a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:16:52.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.780+0000 7f9bd5e00700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bd8102500 0x7f9bd819a9c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800efc0 tx=0x7f9bc800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:52.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.780+0000 7f9bcea00700 1 -- 172.21.15.2:0/820697038 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc80092e0 con 0x7f9bd8102500 2024-06-13T02:16:52.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.780+0000 7f9bcea00700 1 -- 172.21.15.2:0/820697038 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bc8003a00 con 0x7f9bd8102500 2024-06-13T02:16:52.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.780+0000 7f9bdd000700 1 -- 172.21.15.2:0/820697038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd81a28b0 con 0x7f9bd8102500 2024-06-13T02:16:52.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.781+0000 7f9bcea00700 1 -- 172.21.15.2:0/820697038 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8004720 con 0x7f9bd8102500 2024-06-13T02:16:52.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.781+0000 7f9bdd000700 1 -- 172.21.15.2:0/820697038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd81a2ec0 con 0x7f9bd8102500 2024-06-13T02:16:52.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.782+0000 7f9bdd000700 1 -- 172.21.15.2:0/820697038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd8069180 con 0x7f9bd8102500 2024-06-13T02:16:52.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.785+0000 7f9bcea00700 1 -- 172.21.15.2:0/820697038 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f9bc801b030 con 0x7f9bd8102500 2024-06-13T02:16:52.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.786+0000 7f9bcea00700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9bbc0a2ca0 0x7f9bbc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:52.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.786+0000 7f9bcea00700 1 -- 172.21.15.2:0/820697038 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f9bc80cf400 con 0x7f9bd8102500 2024-06-13T02:16:52.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.786+0000 7f9bcfe00700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9bbc0a2ca0 0x7f9bbc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:52.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.787+0000 7f9bcfe00700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9bbc0a2ca0 0x7f9bbc0a5160 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00038c0 tx=0x7f9bc0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:52.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:52.791+0000 7f9bcea00700 1 -- 172.21.15.2:0/820697038 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9bc8022020 con 0x7f9bd8102500 2024-06-13T02:16:53.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:53.035+0000 7f9bdd000700 1 -- 172.21.15.2:0/820697038 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9bd8075de0 con 0x7f9bbc0a2ca0 2024-06-13T02:16:53.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:53.052+0000 7f9bcea00700 1 -- 172.21.15.2:0/820697038 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f9bd8075de0 con 0x7f9bbc0a2ca0 2024-06-13T02:16:53.054 INFO:teuthology.orchestra.run.smithi002.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-13T02:16:53.054 INFO:teuthology.orchestra.run.smithi002.stdout:mds.a smithi002 running (4m) 2m ago 4m 12.8M - 19.0.0-2946-g3d89accf b045ac545f82 50d50d5421cc 2024-06-13T02:16:53.054 INFO:teuthology.orchestra.run.smithi002.stdout:mds.b smithi084 running (4m) 2m ago 4m 28.2M - 19.0.0-2946-g3d89accf b045ac545f82 3724c4a3dab6 2024-06-13T02:16:53.054 INFO:teuthology.orchestra.run.smithi002.stdout:mds.c smithi175 running (4m) 2m ago 4m 15.4M - 19.0.0-2946-g3d89accf b045ac545f82 3615c7f1e0b8 2024-06-13T02:16:53.054 INFO:teuthology.orchestra.run.smithi002.stdout:mds.d smithi002 running (4m) 2m ago 4m 13.0M - 19.0.0-2946-g3d89accf b045ac545f82 17bbf1178978 2024-06-13T02:16:53.055 INFO:teuthology.orchestra.run.smithi002.stdout:mds.e smithi084 running (4m) 2m ago 4m 15.4M - 19.0.0-2946-g3d89accf b045ac545f82 630007b14c2a 2024-06-13T02:16:53.055 INFO:teuthology.orchestra.run.smithi002.stdout:mds.f smithi175 running (4m) 2m ago 4m 13.6M - 19.0.0-2946-g3d89accf b045ac545f82 e81e240329d3 2024-06-13T02:16:53.055 INFO:teuthology.orchestra.run.smithi002.stdout:mds.g smithi002 running (4m) 2m ago 4m 15.9M - 19.0.0-2946-g3d89accf b045ac545f82 2504394209ed 2024-06-13T02:16:53.055 INFO:teuthology.orchestra.run.smithi002.stdout:mds.h smithi084 running (4m) 2m ago 4m 19.5M - 19.0.0-2946-g3d89accf b045ac545f82 fe5b048a23b1 2024-06-13T02:16:53.055 INFO:teuthology.orchestra.run.smithi002.stdout:mds.i smithi175 running (4m) 2m ago 4m 17.3M - 19.0.0-2946-g3d89accf b045ac545f82 722ce890b289 2024-06-13T02:16:53.055 INFO:teuthology.orchestra.run.smithi002.stdout:mds.j smithi002 running (5m) 2m ago 5m 12.9M - 19.0.0-2946-g3d89accf b045ac545f82 6db8fa3c9f76 2024-06-13T02:16:53.055 INFO:teuthology.orchestra.run.smithi002.stdout:mds.k smithi084 running (5m) 2m ago 5m 14.6M - 19.0.0-2946-g3d89accf b045ac545f82 320cc84d5724 2024-06-13T02:16:53.055 INFO:teuthology.orchestra.run.smithi002.stdout:mds.l smithi175 running (5m) 2m ago 5m 13.5M - 19.0.0-2946-g3d89accf b045ac545f82 3508dacb2051 2024-06-13T02:16:53.055 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.x smithi002 *:9283,8765 running (13m) 2m ago 13m 516M - 19.0.0-2946-g3d89accf b045ac545f82 f6a644014735 2024-06-13T02:16:53.055 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.y smithi084 *:8443,8765 running (11m) 2m ago 11m 457M - 19.0.0-2946-g3d89accf b045ac545f82 e34ef6cf1c8c 2024-06-13T02:16:53.055 INFO:teuthology.orchestra.run.smithi002.stdout:mgr.z smithi175 *:8443,8765 running (11m) 2m ago 11m 456M - 19.0.0-2946-g3d89accf b045ac545f82 bd62bf3c6000 2024-06-13T02:16:53.055 INFO:teuthology.orchestra.run.smithi002.stdout:mon.a smithi002 running (13m) 2m ago 13m 49.8M 2048M 19.0.0-2946-g3d89accf b045ac545f82 9c465d8cf57b 2024-06-13T02:16:53.056 INFO:teuthology.orchestra.run.smithi002.stdout:mon.b smithi084 running (11m) 2m ago 11m 42.7M 2048M 19.0.0-2946-g3d89accf b045ac545f82 c2faadf1f335 2024-06-13T02:16:53.056 INFO:teuthology.orchestra.run.smithi002.stdout:mon.c smithi175 running (11m) 2m ago 11m 42.5M 2048M 19.0.0-2946-g3d89accf b045ac545f82 bc7859d03952 2024-06-13T02:16:53.056 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 smithi002 running (10m) 2m ago 10m 45.1M 4273M 19.0.0-2946-g3d89accf b045ac545f82 37f49700b4f9 2024-06-13T02:16:53.056 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 smithi084 running (10m) 2m ago 10m 57.5M 4272M 19.0.0-2946-g3d89accf b045ac545f82 2eb0166143de 2024-06-13T02:16:53.056 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 smithi175 running (9m) 2m ago 9m 55.8M 4272M 19.0.0-2946-g3d89accf b045ac545f82 aeecf4f465b2 2024-06-13T02:16:53.056 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 smithi002 running (9m) 2m ago 9m 51.8M 4273M 19.0.0-2946-g3d89accf b045ac545f82 f279c9c14452 2024-06-13T02:16:53.056 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 smithi084 running (8m) 2m ago 8m 44.1M 4272M 19.0.0-2946-g3d89accf b045ac545f82 5e0a5bbbe394 2024-06-13T02:16:53.056 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 smithi175 running (8m) 2m ago 8m 55.3M 4272M 19.0.0-2946-g3d89accf b045ac545f82 dcb3f24f5a7b 2024-06-13T02:16:53.056 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 smithi002 running (7m) 2m ago 7m 47.8M 4273M 19.0.0-2946-g3d89accf b045ac545f82 92f058762d2b 2024-06-13T02:16:53.056 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 smithi084 running (7m) 2m ago 7m 43.6M 4272M 19.0.0-2946-g3d89accf b045ac545f82 62f4a9303907 2024-06-13T02:16:53.056 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 smithi175 running (7m) 2m ago 7m 46.6M 4272M 19.0.0-2946-g3d89accf b045ac545f82 da219d68e192 2024-06-13T02:16:53.056 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 smithi002 running (6m) 2m ago 6m 41.7M 4273M 19.0.0-2946-g3d89accf b045ac545f82 01b3692abf9c 2024-06-13T02:16:53.056 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 smithi084 running (5m) 2m ago 5m 44.3M 4272M 19.0.0-2946-g3d89accf b045ac545f82 d62a54f3fe8d 2024-06-13T02:16:53.057 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 smithi175 running (5m) 2m ago 5m 42.2M 4272M 19.0.0-2946-g3d89accf b045ac545f82 86a577b1819d 2024-06-13T02:16:53.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:53.055+0000 7f9bdd000700 1 -- 172.21.15.2:0/820697038 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9bbc0a2ca0 msgr2=0x7f9bbc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:53.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:53.055+0000 7f9bdd000700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9bbc0a2ca0 0x7f9bbc0a5160 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00038c0 tx=0x7f9bc0000bc0 comp rx=0 tx=0).stop 2024-06-13T02:16:53.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:53.055+0000 7f9bdd000700 1 -- 172.21.15.2:0/820697038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bd8102500 msgr2=0x7f9bd819a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:53.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:53.055+0000 7f9bdd000700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bd8102500 0x7f9bd819a9c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800efc0 tx=0x7f9bc800c3a0 comp rx=0 tx=0).stop 2024-06-13T02:16:53.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:53.055+0000 7f9bdd000700 1 -- 172.21.15.2:0/820697038 shutdown_connections 2024-06-13T02:16:53.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:53.055+0000 7f9bdd000700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9bbc0a2ca0 0x7f9bbc0a5160 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:53.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:53.055+0000 7f9bdd000700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9bd81040a0 0x7f9bd81a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:53.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:53.056+0000 7f9bdd000700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bd8102500 0x7f9bd819a9c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:53.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:53.056+0000 7f9bdd000700 1 --2- 172.21.15.2:0/820697038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd8103700 0x7f9bd819af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:53.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:53.056+0000 7f9bdd000700 1 -- 172.21.15.2:0/820697038 >> 172.21.15.2:0/820697038 conn(0x7f9bd80fda60 msgr2=0x7f9bd80746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:53.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:53.056+0000 7f9bdd000700 1 -- 172.21.15.2:0/820697038 shutdown_connections 2024-06-13T02:16:53.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:53.056+0000 7f9bdd000700 1 -- 172.21.15.2:0/820697038 wait complete. 2024-06-13T02:16:54.011 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- bash -c 'ceph orch ls' 2024-06-13T02:16:54.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:53 smithi002 ceph-mon[31960]: pgmap v464: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:16:54.086 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:53 smithi002 ceph-mon[31960]: from='client.25022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:16:54.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:53 smithi084 ceph-mon[36833]: pgmap v464: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:16:54.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:53 smithi084 ceph-mon[36833]: from='client.25022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:16:54.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:53 smithi175 ceph-mon[36977]: pgmap v464: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:16:54.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:53 smithi175 ceph-mon[36977]: from='client.25022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:16:54.483 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:16:56.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:55 smithi002 ceph-mon[31960]: pgmap v465: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:16:56.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:55 smithi084 ceph-mon[36833]: pgmap v465: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:16:56.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:55 smithi175 ceph-mon[36977]: pgmap v465: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:16:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.897+0000 7f3ad8800700 1 -- 172.21.15.2:0/4272656803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ad0074e90 msgr2=0x7f3ad0075310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.897+0000 7f3ad8800700 1 --2- 172.21.15.2:0/4272656803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ad0074e90 0x7f3ad0075310 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3ac00098f0 tx=0x7f3ac0009c00 comp rx=0 tx=0).stop 2024-06-13T02:16:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.898+0000 7f3ad8800700 1 -- 172.21.15.2:0/4272656803 shutdown_connections 2024-06-13T02:16:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.898+0000 7f3ad8800700 1 --2- 172.21.15.2:0/4272656803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad010a3d0 0x7f3ad010c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.898+0000 7f3ad8800700 1 --2- 172.21.15.2:0/4272656803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ad0076460 0x7f3ad00748c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.898+0000 7f3ad8800700 1 --2- 172.21.15.2:0/4272656803 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ad0074e90 0x7f3ad0075310 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.898+0000 7f3ad8800700 1 -- 172.21.15.2:0/4272656803 >> 172.21.15.2:0/4272656803 conn(0x7f3ad00fda90 msgr2=0x7f3ad00ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.898+0000 7f3ad8800700 1 -- 172.21.15.2:0/4272656803 shutdown_connections 2024-06-13T02:16:56.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.898+0000 7f3ad8800700 1 -- 172.21.15.2:0/4272656803 wait complete. 2024-06-13T02:16:56.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.900+0000 7f3ad8800700 1 Processor -- start 2024-06-13T02:16:56.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.900+0000 7f3ad8800700 1 -- start start 2024-06-13T02:16:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.900+0000 7f3ad8800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad0074e90 0x7f3ad019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad8800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ad0076460 0x7f3ad019ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad8800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ad010a3d0 0x7f3ad01a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad8800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad0110300 con 0x7f3ad0074e90 2024-06-13T02:16:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad8800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad0110180 con 0x7f3ad0076460 2024-06-13T02:16:56.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad8800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad0110480 con 0x7f3ad010a3d0 2024-06-13T02:16:56.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad5e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad0074e90 0x7f3ad019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:56.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad5e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad0074e90 0x7f3ad019a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38226/0 (socket says 172.21.15.2:38226) 2024-06-13T02:16:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad5e00700 1 -- 172.21.15.2:0/4135056611 learned_addr learned my addr 172.21.15.2:0/4135056611 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:16:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad5400700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ad0076460 0x7f3ad019ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad6800700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ad010a3d0 0x7f3ad01a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad5400700 1 -- 172.21.15.2:0/4135056611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ad010a3d0 msgr2=0x7f3ad01a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad5400700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ad010a3d0 0x7f3ad01a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad5400700 1 -- 172.21.15.2:0/4135056611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad0074e90 msgr2=0x7f3ad019a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad5400700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad0074e90 0x7f3ad019a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad5400700 1 -- 172.21.15.2:0/4135056611 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad01a25b0 con 0x7f3ad0076460 2024-06-13T02:16:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad6800700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ad010a3d0 0x7f3ad01a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:16:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.901+0000 7f3ad5e00700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad0074e90 0x7f3ad019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:16:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.902+0000 7f3ad5400700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ad0076460 0x7f3ad019ae90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009230 tx=0x7f3ac0005250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.902+0000 7f3acaa00700 1 -- 172.21.15.2:0/4135056611 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000f950 con 0x7f3ad0076460 2024-06-13T02:16:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.902+0000 7f3acaa00700 1 -- 172.21.15.2:0/4135056611 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ac000ba40 con 0x7f3ad0076460 2024-06-13T02:16:56.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.902+0000 7f3ad8800700 1 -- 172.21.15.2:0/4135056611 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad01a2840 con 0x7f3ad0076460 2024-06-13T02:16:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.902+0000 7f3acaa00700 1 -- 172.21.15.2:0/4135056611 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0003c00 con 0x7f3ad0076460 2024-06-13T02:16:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.902+0000 7f3ad8800700 1 -- 172.21.15.2:0/4135056611 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad01a2cf0 con 0x7f3ad0076460 2024-06-13T02:16:56.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.903+0000 7f3ad8800700 1 -- 172.21.15.2:0/4135056611 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad0069180 con 0x7f3ad0076460 2024-06-13T02:16:56.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.905+0000 7f3acaa00700 1 -- 172.21.15.2:0/4135056611 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f3ac00054d0 con 0x7f3ad0076460 2024-06-13T02:16:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.906+0000 7f3acaa00700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3ab80a2e40 0x7f3ab80a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:16:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.907+0000 7f3acaa00700 1 -- 172.21.15.2:0/4135056611 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f3ac00d02d0 con 0x7f3ad0076460 2024-06-13T02:16:56.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.907+0000 7f3ad5e00700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3ab80a2e40 0x7f3ab80a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:16:56.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.908+0000 7f3ad5e00700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3ab80a2e40 0x7f3ab80a5300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4011590 tx=0x7f3ac4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:16:56.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:56.911+0000 7f3acaa00700 1 -- 172.21.15.2:0/4135056611 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f3ac0013030 con 0x7f3ad0076460 2024-06-13T02:16:57.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:57.149+0000 7f3ad8800700 1 -- 172.21.15.2:0/4135056611 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f3ad00628d0 con 0x7f3ab80a2e40 2024-06-13T02:16:57.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:57.165+0000 7f3acaa00700 1 -- 172.21.15.2:0/4135056611 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f3ad00628d0 con 0x7f3ab80a2e40 2024-06-13T02:16:57.167 INFO:teuthology.orchestra.run.smithi002.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-06-13T02:16:57.167 INFO:teuthology.orchestra.run.smithi002.stdout:mds.all 12/12 2m ago 5m smithi002=a;smithi002=d;smithi002=g;smithi002=j;smithi084=b;smithi084=e;smithi084=h;smithi084=k;smithi175=c;smithi175=f;smithi175=i;smithi175=l;count:12 2024-06-13T02:16:57.167 INFO:teuthology.orchestra.run.smithi002.stdout:mgr 3/3 2m ago 11m smithi002=x;smithi084=y;smithi175=z;count:3 2024-06-13T02:16:57.167 INFO:teuthology.orchestra.run.smithi002.stdout:mon 3/3 2m ago 11m smithi002:172.21.15.2=a;smithi084:172.21.15.84=b;smithi175:172.21.15.175=c;count:3 2024-06-13T02:16:57.167 INFO:teuthology.orchestra.run.smithi002.stdout:osd 12 2m ago - 2024-06-13T02:16:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:57.168+0000 7f3ad8800700 1 -- 172.21.15.2:0/4135056611 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3ab80a2e40 msgr2=0x7f3ab80a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:57.168+0000 7f3ad8800700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3ab80a2e40 0x7f3ab80a5300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4011590 tx=0x7f3ac4009260 comp rx=0 tx=0).stop 2024-06-13T02:16:57.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:57.168+0000 7f3ad8800700 1 -- 172.21.15.2:0/4135056611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ad0076460 msgr2=0x7f3ad019ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:16:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:57.168+0000 7f3ad8800700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ad0076460 0x7f3ad019ae90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0009230 tx=0x7f3ac0005250 comp rx=0 tx=0).stop 2024-06-13T02:16:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:57.169+0000 7f3ad8800700 1 -- 172.21.15.2:0/4135056611 shutdown_connections 2024-06-13T02:16:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:57.169+0000 7f3ad8800700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f3ab80a2e40 0x7f3ab80a5300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:57.169+0000 7f3ad8800700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ad010a3d0 0x7f3ad01a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:57.169+0000 7f3ad8800700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad0074e90 0x7f3ad019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:57.169+0000 7f3ad8800700 1 --2- 172.21.15.2:0/4135056611 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ad0076460 0x7f3ad019ae90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:16:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:57.169+0000 7f3ad8800700 1 -- 172.21.15.2:0/4135056611 >> 172.21.15.2:0/4135056611 conn(0x7f3ad00fda90 msgr2=0x7f3ad0106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:16:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:57.169+0000 7f3ad8800700 1 -- 172.21.15.2:0/4135056611 shutdown_connections 2024-06-13T02:16:57.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:16:57.169+0000 7f3ad8800700 1 -- 172.21.15.2:0/4135056611 wait complete. 2024-06-13T02:16:58.025 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- bash -c 'ceph orch host ls' 2024-06-13T02:16:58.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:57 smithi002 ceph-mon[31960]: pgmap v466: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:16:58.099 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:57 smithi002 ceph-mon[31960]: from='client.25028 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:16:58.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:57 smithi084 ceph-mon[36833]: pgmap v466: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:16:58.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:57 smithi084 ceph-mon[36833]: from='client.25028 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:16:58.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:57 smithi175 ceph-mon[36977]: pgmap v466: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:16:58.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:57 smithi175 ceph-mon[36977]: from='client.25028 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:16:58.506 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:17:00.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:16:59 smithi002 ceph-mon[31960]: pgmap v467: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:17:00.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:16:59 smithi084 ceph-mon[36833]: pgmap v467: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:17:00.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:16:59 smithi175 ceph-mon[36977]: pgmap v467: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:17:00.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.937+0000 7f6a96e00700 1 -- 172.21.15.2:0/3473280224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a90108b30 msgr2=0x7f6a90108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:00.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.937+0000 7f6a96e00700 1 --2- 172.21.15.2:0/3473280224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a90108b30 0x7f6a90108f50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6a800099c0 tx=0x7f6a80009cd0 comp rx=0 tx=0).stop 2024-06-13T02:17:00.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.937+0000 7f6a96e00700 1 -- 172.21.15.2:0/3473280224 shutdown_connections 2024-06-13T02:17:00.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.937+0000 7f6a96e00700 1 --2- 172.21.15.2:0/3473280224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a9010a6d0 0x7f6a90110f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:00.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.937+0000 7f6a96e00700 1 --2- 172.21.15.2:0/3473280224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a90108b30 0x7f6a90108f50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:00.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.937+0000 7f6a96e00700 1 --2- 172.21.15.2:0/3473280224 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a90109d30 0x7f6a9010a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:00.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.937+0000 7f6a96e00700 1 -- 172.21.15.2:0/3473280224 >> 172.21.15.2:0/3473280224 conn(0x7f6a90077b00 msgr2=0x7f6a90079f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:00.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.937+0000 7f6a96e00700 1 -- 172.21.15.2:0/3473280224 shutdown_connections 2024-06-13T02:17:00.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.937+0000 7f6a96e00700 1 -- 172.21.15.2:0/3473280224 wait complete. 2024-06-13T02:17:00.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.939+0000 7f6a96e00700 1 Processor -- start 2024-06-13T02:17:00.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.939+0000 7f6a96e00700 1 -- start start 2024-06-13T02:17:00.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.939+0000 7f6a96e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a90108b30 0x7f6a9019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:00.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.939+0000 7f6a96e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a90109d30 0x7f6a9019f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:00.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.939+0000 7f6a96e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a9010a6d0 0x7f6a901a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:00.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.939+0000 7f6a96e00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6a901146f0 con 0x7f6a9010a6d0 2024-06-13T02:17:00.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.939+0000 7f6a96e00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6a90114570 con 0x7f6a90109d30 2024-06-13T02:17:00.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.939+0000 7f6a96e00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6a90114870 con 0x7f6a90108b30 2024-06-13T02:17:00.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.940+0000 7f6a8fe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a90108b30 0x7f6a9019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:00.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.940+0000 7f6a94e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a9010a6d0 0x7f6a901a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:00.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.940+0000 7f6a8fe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a90108b30 0x7f6a9019ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:49948/0 (socket says 172.21.15.2:49948) 2024-06-13T02:17:00.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.940+0000 7f6a8fe00700 1 -- 172.21.15.2:0/2567370931 learned_addr learned my addr 172.21.15.2:0/2567370931 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:00.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.940+0000 7f6a87e00700 1 --2- 172.21.15.2:0/2567370931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a90109d30 0x7f6a9019f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:00.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.940+0000 7f6a94e00700 1 -- 172.21.15.2:0/2567370931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a90108b30 msgr2=0x7f6a9019ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:00.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.940+0000 7f6a94e00700 1 --2- 172.21.15.2:0/2567370931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a90108b30 0x7f6a9019ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:00.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.940+0000 7f6a94e00700 1 -- 172.21.15.2:0/2567370931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a90109d30 msgr2=0x7f6a9019f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:00.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.940+0000 7f6a94e00700 1 --2- 172.21.15.2:0/2567370931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a90109d30 0x7f6a9019f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:00.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.940+0000 7f6a94e00700 1 -- 172.21.15.2:0/2567370931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a901a6970 con 0x7f6a9010a6d0 2024-06-13T02:17:00.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.941+0000 7f6a94e00700 1 --2- 172.21.15.2:0/2567370931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a9010a6d0 0x7f6a901a62a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800efb0 tx=0x7f6a8800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:00.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.941+0000 7f6a8d600700 1 -- 172.21.15.2:0/2567370931 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88003a00 con 0x7f6a9010a6d0 2024-06-13T02:17:00.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.941+0000 7f6a8d600700 1 -- 172.21.15.2:0/2567370931 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a88003ba0 con 0x7f6a9010a6d0 2024-06-13T02:17:00.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.941+0000 7f6a96e00700 1 -- 172.21.15.2:0/2567370931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a901a6c60 con 0x7f6a9010a6d0 2024-06-13T02:17:00.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.941+0000 7f6a8d600700 1 -- 172.21.15.2:0/2567370931 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88004850 con 0x7f6a9010a6d0 2024-06-13T02:17:00.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.941+0000 7f6a96e00700 1 -- 172.21.15.2:0/2567370931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a901a7150 con 0x7f6a9010a6d0 2024-06-13T02:17:00.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.942+0000 7f6a96e00700 1 -- 172.21.15.2:0/2567370931 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a90069180 con 0x7f6a9010a6d0 2024-06-13T02:17:00.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.945+0000 7f6a8d600700 1 -- 172.21.15.2:0/2567370931 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f6a88012050 con 0x7f6a9010a6d0 2024-06-13T02:17:00.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.946+0000 7f6a8d600700 1 --2- 172.21.15.2:0/2567370931 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6a740a2c20 0x7f6a740a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:00.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.946+0000 7f6a8d600700 1 -- 172.21.15.2:0/2567370931 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f6a880cefa0 con 0x7f6a9010a6d0 2024-06-13T02:17:00.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.946+0000 7f6a8fe00700 1 --2- 172.21.15.2:0/2567370931 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6a740a2c20 0x7f6a740a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:00.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.947+0000 7f6a8fe00700 1 --2- 172.21.15.2:0/2567370931 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6a740a2c20 0x7f6a740a50e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6a80000c00 tx=0x7f6a80005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:00.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:00.949+0000 7f6a8d600700 1 -- 172.21.15.2:0/2567370931 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6a88022060 con 0x7f6a9010a6d0 2024-06-13T02:17:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:01.186+0000 7f6a96e00700 1 -- 172.21.15.2:0/2567370931 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f6a900628d0 con 0x7f6a740a2c20 2024-06-13T02:17:01.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:01.188+0000 7f6a8d600700 1 -- 172.21.15.2:0/2567370931 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f6a900628d0 con 0x7f6a740a2c20 2024-06-13T02:17:01.190 INFO:teuthology.orchestra.run.smithi002.stdout:HOST ADDR LABELS STATUS 2024-06-13T02:17:01.190 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 172.21.15.2 2024-06-13T02:17:01.191 INFO:teuthology.orchestra.run.smithi002.stdout:smithi084 172.21.15.84 2024-06-13T02:17:01.191 INFO:teuthology.orchestra.run.smithi002.stdout:smithi175 172.21.15.175 2024-06-13T02:17:01.191 INFO:teuthology.orchestra.run.smithi002.stdout:3 hosts in cluster 2024-06-13T02:17:01.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:01.192+0000 7f6a96e00700 1 -- 172.21.15.2:0/2567370931 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6a740a2c20 msgr2=0x7f6a740a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:01.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:01.192+0000 7f6a96e00700 1 --2- 172.21.15.2:0/2567370931 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6a740a2c20 0x7f6a740a50e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6a80000c00 tx=0x7f6a80005fb0 comp rx=0 tx=0).stop 2024-06-13T02:17:01.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:01.192+0000 7f6a96e00700 1 -- 172.21.15.2:0/2567370931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a9010a6d0 msgr2=0x7f6a901a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:01.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:01.192+0000 7f6a96e00700 1 --2- 172.21.15.2:0/2567370931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a9010a6d0 0x7f6a901a62a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800efb0 tx=0x7f6a8800c3a0 comp rx=0 tx=0).stop 2024-06-13T02:17:01.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:01.193+0000 7f6a96e00700 1 -- 172.21.15.2:0/2567370931 shutdown_connections 2024-06-13T02:17:01.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:01.193+0000 7f6a96e00700 1 --2- 172.21.15.2:0/2567370931 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f6a740a2c20 0x7f6a740a50e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:01.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:01.193+0000 7f6a96e00700 1 --2- 172.21.15.2:0/2567370931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a9010a6d0 0x7f6a901a62a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:01.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:01.193+0000 7f6a96e00700 1 --2- 172.21.15.2:0/2567370931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a90108b30 0x7f6a9019ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:01.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:01.193+0000 7f6a96e00700 1 --2- 172.21.15.2:0/2567370931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6a90109d30 0x7f6a9019f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:01.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:01.193+0000 7f6a96e00700 1 -- 172.21.15.2:0/2567370931 >> 172.21.15.2:0/2567370931 conn(0x7f6a90077b00 msgr2=0x7f6a9010d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:01.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:01.193+0000 7f6a96e00700 1 -- 172.21.15.2:0/2567370931 shutdown_connections 2024-06-13T02:17:01.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:01.193+0000 7f6a96e00700 1 -- 172.21.15.2:0/2567370931 wait complete. 2024-06-13T02:17:01.847 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:01 smithi002 ceph-mon[31960]: pgmap v468: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:17:01.847 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:01 smithi002 ceph-mon[31960]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:02.142 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- bash -c 'ceph orch device ls' 2024-06-13T02:17:02.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:01 smithi084 ceph-mon[36833]: pgmap v468: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:17:02.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:01 smithi084 ceph-mon[36833]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:02.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:01 smithi175 ceph-mon[36977]: pgmap v468: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:17:02.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:01 smithi175 ceph-mon[36977]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:02.624 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:17:04.028 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:03 smithi002 ceph-mon[31960]: pgmap v469: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:17:04.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:03 smithi084 ceph-mon[36833]: pgmap v469: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:17:04.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:03 smithi175 ceph-mon[36977]: pgmap v469: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:17:04.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.931+0000 7fc848800700 1 -- 172.21.15.2:0/287702616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc84010a6d0 msgr2=0x7fc840110f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:04.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.931+0000 7fc848800700 1 --2- 172.21.15.2:0/287702616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc84010a6d0 0x7fc840110f80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00b0d0 tx=0x7fc83c00b3e0 comp rx=0 tx=0).stop 2024-06-13T02:17:04.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.932+0000 7fc848800700 1 -- 172.21.15.2:0/287702616 shutdown_connections 2024-06-13T02:17:04.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.932+0000 7fc848800700 1 --2- 172.21.15.2:0/287702616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc84010a6d0 0x7fc840110f80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:04.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.932+0000 7fc848800700 1 --2- 172.21.15.2:0/287702616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc840108b30 0x7fc840108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:04.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.932+0000 7fc848800700 1 --2- 172.21.15.2:0/287702616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc840109d30 0x7fc84010a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:04.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.932+0000 7fc848800700 1 -- 172.21.15.2:0/287702616 >> 172.21.15.2:0/287702616 conn(0x7fc840077b00 msgr2=0x7fc840079f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:04.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.932+0000 7fc848800700 1 -- 172.21.15.2:0/287702616 shutdown_connections 2024-06-13T02:17:04.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.932+0000 7fc848800700 1 -- 172.21.15.2:0/287702616 wait complete. 2024-06-13T02:17:04.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.933+0000 7fc848800700 1 Processor -- start 2024-06-13T02:17:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.933+0000 7fc848800700 1 -- start start 2024-06-13T02:17:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.933+0000 7fc848800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc840108b30 0x7fc84019ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc848800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc840109d30 0x7fc84019f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc848800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc84010a6d0 0x7fc8401a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc848800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc840114770 con 0x7fc84010a6d0 2024-06-13T02:17:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc848800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc8401145f0 con 0x7fc840108b30 2024-06-13T02:17:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc848800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8401148f0 con 0x7fc840109d30 2024-06-13T02:17:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc846800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc84010a6d0 0x7fc8401a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc845e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc840108b30 0x7fc84019ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc846800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc84010a6d0 0x7fc8401a6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54916/0 (socket says 172.21.15.2:54916) 2024-06-13T02:17:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc846800700 1 -- 172.21.15.2:0/173961884 learned_addr learned my addr 172.21.15.2:0/173961884 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc845e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc840108b30 0x7fc84019ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:42054/0 (socket says 172.21.15.2:42054) 2024-06-13T02:17:04.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc845400700 1 --2- 172.21.15.2:0/173961884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc840109d30 0x7fc84019f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc845e00700 1 -- 172.21.15.2:0/173961884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc840109d30 msgr2=0x7fc84019f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc845e00700 1 --2- 172.21.15.2:0/173961884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc840109d30 0x7fc84019f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc845e00700 1 -- 172.21.15.2:0/173961884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc84010a6d0 msgr2=0x7fc8401a6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc845e00700 1 --2- 172.21.15.2:0/173961884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc84010a6d0 0x7fc8401a6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc845e00700 1 -- 172.21.15.2:0/173961884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8401a6910 con 0x7fc840108b30 2024-06-13T02:17:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.934+0000 7fc846800700 1 --2- 172.21.15.2:0/173961884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc84010a6d0 0x7fc8401a6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.935+0000 7fc845e00700 1 --2- 172.21.15.2:0/173961884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc840108b30 0x7fc84019ec90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc83400e9c0 tx=0x7fc83400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.935+0000 7fc83aa00700 1 -- 172.21.15.2:0/173961884 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834004220 con 0x7fc840108b30 2024-06-13T02:17:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.935+0000 7fc848800700 1 -- 172.21.15.2:0/173961884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8401a6c00 con 0x7fc840108b30 2024-06-13T02:17:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.935+0000 7fc83aa00700 1 -- 172.21.15.2:0/173961884 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8340043c0 con 0x7fc840108b30 2024-06-13T02:17:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.935+0000 7fc83aa00700 1 -- 172.21.15.2:0/173961884 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc834003cc0 con 0x7fc840108b30 2024-06-13T02:17:04.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.935+0000 7fc848800700 1 -- 172.21.15.2:0/173961884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8401a7190 con 0x7fc840108b30 2024-06-13T02:17:04.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.936+0000 7fc848800700 1 -- 172.21.15.2:0/173961884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc840069180 con 0x7fc840108b30 2024-06-13T02:17:04.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.938+0000 7fc83aa00700 1 -- 172.21.15.2:0/173961884 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fc834043ae0 con 0x7fc840108b30 2024-06-13T02:17:04.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.940+0000 7fc83aa00700 1 --2- 172.21.15.2:0/173961884 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc8280a2ca0 0x7fc8280a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:04.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.940+0000 7fc83aa00700 1 -- 172.21.15.2:0/173961884 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fc8340cf610 con 0x7fc840108b30 2024-06-13T02:17:04.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.940+0000 7fc845400700 1 --2- 172.21.15.2:0/173961884 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc8280a2ca0 0x7fc8280a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:04.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.941+0000 7fc845400700 1 --2- 172.21.15.2:0/173961884 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc8280a2ca0 0x7fc8280a5160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc8401a01a0 tx=0x7fc830009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:04.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:04.942+0000 7fc83aa00700 1 -- 172.21.15.2:0/173961884 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc8340203e0 con 0x7fc840108b30 2024-06-13T02:17:05.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:05.179+0000 7fc848800700 1 -- 172.21.15.2:0/173961884 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fc8400628d0 con 0x7fc8280a2ca0 2024-06-13T02:17:05.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:05.182+0000 7fc83aa00700 1 -- 172.21.15.2:0/173961884 <== mgr.14152 v2:172.21.15.2:6800/2988831869 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fc8400628d0 con 0x7fc8280a2ca0 2024-06-13T02:17:05.183 INFO:teuthology.orchestra.run.smithi002.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-06-13T02:17:05.183 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EV480DGN 447G No 6m ago Has a FileSystem, LVM detected 2024-06-13T02:17:05.183 INFO:teuthology.orchestra.run.smithi002.stdout:smithi084 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WF400BGN 372G No 6m ago Has a FileSystem, LVM detected 2024-06-13T02:17:05.183 INFO:teuthology.orchestra.run.smithi002.stdout:smithi175 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300M0400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-06-13T02:17:05.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:05.185+0000 7fc848800700 1 -- 172.21.15.2:0/173961884 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc8280a2ca0 msgr2=0x7fc8280a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:05.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:05.185+0000 7fc848800700 1 --2- 172.21.15.2:0/173961884 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc8280a2ca0 0x7fc8280a5160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc8401a01a0 tx=0x7fc830009260 comp rx=0 tx=0).stop 2024-06-13T02:17:05.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:05.185+0000 7fc848800700 1 -- 172.21.15.2:0/173961884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc840108b30 msgr2=0x7fc84019ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:05.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:05.185+0000 7fc848800700 1 --2- 172.21.15.2:0/173961884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc840108b30 0x7fc84019ec90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc83400e9c0 tx=0x7fc83400ecd0 comp rx=0 tx=0).stop 2024-06-13T02:17:05.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:05.185+0000 7fc848800700 1 -- 172.21.15.2:0/173961884 shutdown_connections 2024-06-13T02:17:05.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:05.185+0000 7fc848800700 1 --2- 172.21.15.2:0/173961884 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc8280a2ca0 0x7fc8280a5160 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:05.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:05.185+0000 7fc848800700 1 --2- 172.21.15.2:0/173961884 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc84010a6d0 0x7fc8401a6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:05.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:05.185+0000 7fc848800700 1 --2- 172.21.15.2:0/173961884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc840108b30 0x7fc84019ec90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:05.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:05.185+0000 7fc848800700 1 --2- 172.21.15.2:0/173961884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc840109d30 0x7fc84019f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:05.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:05.185+0000 7fc848800700 1 -- 172.21.15.2:0/173961884 >> 172.21.15.2:0/173961884 conn(0x7fc840077b00 msgr2=0x7fc84010cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:05.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:05.186+0000 7fc848800700 1 -- 172.21.15.2:0/173961884 shutdown_connections 2024-06-13T02:17:05.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:05.186+0000 7fc848800700 1 -- 172.21.15.2:0/173961884 wait complete. 2024-06-13T02:17:06.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:05 smithi002 ceph-mon[31960]: pgmap v470: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:17:06.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:05 smithi002 ceph-mon[31960]: from='client.25040 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:06.153 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-13T02:17:06.163 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T02:17:06.163 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- bash -c 'ceph fs dump' 2024-06-13T02:17:06.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:05 smithi084 ceph-mon[36833]: pgmap v470: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:17:06.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:05 smithi084 ceph-mon[36833]: from='client.25040 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:06.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:05 smithi175 ceph-mon[36977]: pgmap v470: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:17:06.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:05 smithi175 ceph-mon[36977]: from='client.25040 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:06.625 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:17:08.113 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:07 smithi002 ceph-mon[31960]: pgmap v471: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:17:08.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:07 smithi084 ceph-mon[36833]: pgmap v471: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:17:08.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:07 smithi175 ceph-mon[36977]: pgmap v471: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:17:09.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.004+0000 7f33d6600700 1 -- 172.21.15.2:0/3432193890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33d010a6d0 msgr2=0x7f33d0110f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:09.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.004+0000 7f33d6600700 1 --2- 172.21.15.2:0/3432193890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33d010a6d0 0x7f33d0110f80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009fc0 tx=0x7f33c800b330 comp rx=0 tx=0).stop 2024-06-13T02:17:09.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.004+0000 7f33d6600700 1 -- 172.21.15.2:0/3432193890 shutdown_connections 2024-06-13T02:17:09.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.004+0000 7f33d6600700 1 --2- 172.21.15.2:0/3432193890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33d010a6d0 0x7f33d0110f80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:09.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.004+0000 7f33d6600700 1 --2- 172.21.15.2:0/3432193890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33d0108b30 0x7f33d0108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:09.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.004+0000 7f33d6600700 1 --2- 172.21.15.2:0/3432193890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d0109d30 0x7f33d010a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:09.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.004+0000 7f33d6600700 1 -- 172.21.15.2:0/3432193890 >> 172.21.15.2:0/3432193890 conn(0x7f33d0077b00 msgr2=0x7f33d0079f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:09.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.004+0000 7f33d6600700 1 -- 172.21.15.2:0/3432193890 shutdown_connections 2024-06-13T02:17:09.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.004+0000 7f33d6600700 1 -- 172.21.15.2:0/3432193890 wait complete. 2024-06-13T02:17:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.005+0000 7f33d6600700 1 Processor -- start 2024-06-13T02:17:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.005+0000 7f33d6600700 1 -- start start 2024-06-13T02:17:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.006+0000 7f33d6600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d0108b30 0x7f33d019eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.006+0000 7f33d6600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33d0109d30 0x7f33d019f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:09.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.006+0000 7f33d6600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33d010a6d0 0x7f33d01a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.006+0000 7f33d6600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f33d0114750 con 0x7f33d0108b30 2024-06-13T02:17:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.006+0000 7f33d6600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f33d01145d0 con 0x7f33d0109d30 2024-06-13T02:17:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.006+0000 7f33d6600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f33d01148d0 con 0x7f33d010a6d0 2024-06-13T02:17:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.006+0000 7f33cf400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d0108b30 0x7f33d019eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.006+0000 7f33cf400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d0108b30 0x7f33d019eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54936/0 (socket says 172.21.15.2:54936) 2024-06-13T02:17:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.006+0000 7f33cf400700 1 -- 172.21.15.2:0/3092215182 learned_addr learned my addr 172.21.15.2:0/3092215182 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.006+0000 7f33c6a00700 1 --2- 172.21.15.2:0/3092215182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33d0109d30 0x7f33d019f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.007+0000 7f33cfe00700 1 --2- 172.21.15.2:0/3092215182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33d010a6d0 0x7f33d01a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.007+0000 7f33cf400700 1 -- 172.21.15.2:0/3092215182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33d010a6d0 msgr2=0x7f33d01a6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.007+0000 7f33cf400700 1 --2- 172.21.15.2:0/3092215182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33d010a6d0 0x7f33d01a6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.007+0000 7f33cf400700 1 -- 172.21.15.2:0/3092215182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33d0109d30 msgr2=0x7f33d019f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.007+0000 7f33cf400700 1 --2- 172.21.15.2:0/3092215182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33d0109d30 0x7f33d019f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.007+0000 7f33cf400700 1 -- 172.21.15.2:0/3092215182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d01a6920 con 0x7f33d0108b30 2024-06-13T02:17:09.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.007+0000 7f33cf400700 1 --2- 172.21.15.2:0/3092215182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d0108b30 0x7f33d019eca0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f33c000e970 tx=0x7f33c000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:09.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.007+0000 7f33ccc00700 1 -- 172.21.15.2:0/3092215182 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c000cbd0 con 0x7f33d0108b30 2024-06-13T02:17:09.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.007+0000 7f33ccc00700 1 -- 172.21.15.2:0/3092215182 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33c0004500 con 0x7f33d0108b30 2024-06-13T02:17:09.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.008+0000 7f33ccc00700 1 -- 172.21.15.2:0/3092215182 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c0003e00 con 0x7f33d0108b30 2024-06-13T02:17:09.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.008+0000 7f33d6600700 1 -- 172.21.15.2:0/3092215182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d01a6c10 con 0x7f33d0108b30 2024-06-13T02:17:09.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.008+0000 7f33d6600700 1 -- 172.21.15.2:0/3092215182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d01a7100 con 0x7f33d0108b30 2024-06-13T02:17:09.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.009+0000 7f33d6600700 1 -- 172.21.15.2:0/3092215182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33d0069180 con 0x7f33d0108b30 2024-06-13T02:17:09.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.011+0000 7f33ccc00700 1 -- 172.21.15.2:0/3092215182 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f33c0003fe0 con 0x7f33d0108b30 2024-06-13T02:17:09.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.013+0000 7f33ccc00700 1 --2- 172.21.15.2:0/3092215182 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f33b40a2ca0 0x7f33b40a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:09.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.013+0000 7f33ccc00700 1 -- 172.21.15.2:0/3092215182 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f33c00cf7d0 con 0x7f33d0108b30 2024-06-13T02:17:09.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.013+0000 7f33c6a00700 1 --2- 172.21.15.2:0/3092215182 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f33b40a2ca0 0x7f33b40a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:09.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.014+0000 7f33c6a00700 1 --2- 172.21.15.2:0/3092215182 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f33b40a2ca0 0x7f33b40a5160 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f33d01a01b0 tx=0x7f33b8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:09.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.016+0000 7f33ccc00700 1 -- 172.21.15.2:0/3092215182 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f33c009c370 con 0x7f33d0108b30 2024-06-13T02:17:09.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.296+0000 7f33d6600700 1 -- 172.21.15.2:0/3092215182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f33d002ddd0 con 0x7f33d0108b30 2024-06-13T02:17:09.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.297+0000 7f33ccc00700 1 -- 172.21.15.2:0/3092215182 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+3042 (secure 0 0 0) 0x7f33c00a2070 con 0x7f33d0108b30 2024-06-13T02:17:09.299 INFO:teuthology.orchestra.run.smithi002.stdout:e26 2024-06-13T02:17:09.299 INFO:teuthology.orchestra.run.smithi002.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-13T02:17:09.299 INFO:teuthology.orchestra.run.smithi002.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-13T02:17:09.299 INFO:teuthology.orchestra.run.smithi002.stdout:legacy client fscid: 1 2024-06-13T02:17:09.299 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:17:09.299 INFO:teuthology.orchestra.run.smithi002.stdout:Filesystem 'cephfs' (1) 2024-06-13T02:17:09.299 INFO:teuthology.orchestra.run.smithi002.stdout:fs_name cephfs 2024-06-13T02:17:09.299 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 26 2024-06-13T02:17:09.299 INFO:teuthology.orchestra.run.smithi002.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-06-13T02:17:09.300 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-06-13T02:12:43.063161+0000 2024-06-13T02:17:09.300 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-06-13T02:14:13.553770+0000 2024-06-13T02:17:09.300 INFO:teuthology.orchestra.run.smithi002.stdout:tableserver 0 2024-06-13T02:17:09.300 INFO:teuthology.orchestra.run.smithi002.stdout:root 0 2024-06-13T02:17:09.300 INFO:teuthology.orchestra.run.smithi002.stdout:session_timeout 300 2024-06-13T02:17:09.300 INFO:teuthology.orchestra.run.smithi002.stdout:session_autoclose 300 2024-06-13T02:17:09.300 INFO:teuthology.orchestra.run.smithi002.stdout:max_file_size 1099511627776 2024-06-13T02:17:09.300 INFO:teuthology.orchestra.run.smithi002.stdout:max_xattr_size 65536 2024-06-13T02:17:09.300 INFO:teuthology.orchestra.run.smithi002.stdout:required_client_features {} 2024-06-13T02:17:09.300 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure 0 2024-06-13T02:17:09.300 INFO:teuthology.orchestra.run.smithi002.stdout:last_failure_osd_epoch 0 2024-06-13T02:17:09.300 INFO:teuthology.orchestra.run.smithi002.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-13T02:17:09.300 INFO:teuthology.orchestra.run.smithi002.stdout:max_mds 3 2024-06-13T02:17:09.301 INFO:teuthology.orchestra.run.smithi002.stdout:in 0,1,2 2024-06-13T02:17:09.301 INFO:teuthology.orchestra.run.smithi002.stdout:up {0=24527,1=24503,2=24490} 2024-06-13T02:17:09.301 INFO:teuthology.orchestra.run.smithi002.stdout:failed 2024-06-13T02:17:09.301 INFO:teuthology.orchestra.run.smithi002.stdout:damaged 2024-06-13T02:17:09.301 INFO:teuthology.orchestra.run.smithi002.stdout:stopped 2024-06-13T02:17:09.301 INFO:teuthology.orchestra.run.smithi002.stdout:data_pools [3,4] 2024-06-13T02:17:09.301 INFO:teuthology.orchestra.run.smithi002.stdout:metadata_pool 2 2024-06-13T02:17:09.301 INFO:teuthology.orchestra.run.smithi002.stdout:inline_data disabled 2024-06-13T02:17:09.301 INFO:teuthology.orchestra.run.smithi002.stdout:balancer 2024-06-13T02:17:09.301 INFO:teuthology.orchestra.run.smithi002.stdout:bal_rank_mask -1 2024-06-13T02:17:09.301 INFO:teuthology.orchestra.run.smithi002.stdout:standby_count_wanted 0 2024-06-13T02:17:09.301 INFO:teuthology.orchestra.run.smithi002.stdout:qdb_cluster leader: 24527 members: 24503,24527,24490 2024-06-13T02:17:09.301 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b{0:24527} state up:active seq 7 addr [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T02:17:09.302 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.h{0:24488} state up:standby-replay seq 1 addr [v2:172.21.15.84:6836/2537381027,v1:172.21.15.84:6837/2537381027] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T02:17:09.302 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.g{1:24503} state up:active seq 29 addr [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T02:17:09.302 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c{1:24475} state up:standby-replay seq 1 addr [v2:172.21.15.175:6836/1446546569,v1:172.21.15.175:6837/1446546569] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T02:17:09.302 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.i{2:24490} state up:active seq 31 addr [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T02:17:09.302 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.e{2:24473} state up:standby-replay seq 1 addr [v2:172.21.15.84:6834/2403775181,v1:172.21.15.84:6835/2403775181] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T02:17:09.302 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:17:09.302 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:17:09.302 INFO:teuthology.orchestra.run.smithi002.stdout:Standby daemons: 2024-06-13T02:17:09.302 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:17:09.302 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d{-1:14367} state up:standby seq 1 addr [v2:172.21.15.2:6836/3732907395,v1:172.21.15.2:6837/3732907395] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T02:17:09.302 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a{-1:14400} state up:standby seq 1 addr [v2:172.21.15.2:6840/3458450195,v1:172.21.15.2:6841/3458450195] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T02:17:09.302 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.l{-1:24421} state up:standby seq 1 addr [v2:172.21.15.175:6832/1278226284,v1:172.21.15.175:6833/1278226284] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T02:17:09.302 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.j{-1:24439} state up:standby seq 1 addr [v2:172.21.15.2:6834/206981148,v1:172.21.15.2:6835/206981148] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T02:17:09.303 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.k{-1:24443} state up:standby seq 1 addr [v2:172.21.15.84:6832/3039491270,v1:172.21.15.84:6833/3039491270] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T02:17:09.303 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.f{-1:24463} state up:standby seq 1 addr [v2:172.21.15.175:6834/1709394731,v1:172.21.15.175:6835/1709394731] compat {c=[1],r=[1],i=[1fff]}] 2024-06-13T02:17:09.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.302+0000 7f33d6600700 1 -- 172.21.15.2:0/3092215182 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f33b40a2ca0 msgr2=0x7f33b40a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:09.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.302+0000 7f33d6600700 1 --2- 172.21.15.2:0/3092215182 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f33b40a2ca0 0x7f33b40a5160 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f33d01a01b0 tx=0x7f33b8009310 comp rx=0 tx=0).stop 2024-06-13T02:17:09.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.302+0000 7f33d6600700 1 -- 172.21.15.2:0/3092215182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d0108b30 msgr2=0x7f33d019eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:09.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.302+0000 7f33d6600700 1 --2- 172.21.15.2:0/3092215182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d0108b30 0x7f33d019eca0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f33c000e970 tx=0x7f33c000ed30 comp rx=0 tx=0).stop 2024-06-13T02:17:09.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.302+0000 7f33d6600700 1 -- 172.21.15.2:0/3092215182 shutdown_connections 2024-06-13T02:17:09.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.302+0000 7f33d6600700 1 --2- 172.21.15.2:0/3092215182 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f33b40a2ca0 0x7f33b40a5160 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:09.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.302+0000 7f33d6600700 1 --2- 172.21.15.2:0/3092215182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33d010a6d0 0x7f33d01a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:09.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.302+0000 7f33d6600700 1 --2- 172.21.15.2:0/3092215182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33d0108b30 0x7f33d019eca0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:09.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.302+0000 7f33d6600700 1 --2- 172.21.15.2:0/3092215182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33d0109d30 0x7f33d019f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:09.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.302+0000 7f33d6600700 1 -- 172.21.15.2:0/3092215182 >> 172.21.15.2:0/3092215182 conn(0x7f33d0077b00 msgr2=0x7f33d010cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:09.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.303+0000 7f33d6600700 1 -- 172.21.15.2:0/3092215182 shutdown_connections 2024-06-13T02:17:09.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:09.303+0000 7f33d6600700 1 -- 172.21.15.2:0/3092215182 wait complete. 2024-06-13T02:17:09.305 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-06-13T02:17:10.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:09 smithi002 ceph-mon[31960]: pgmap v472: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:17:10.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:09 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3092215182' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-13T02:17:10.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:09 smithi084 ceph-mon[36833]: pgmap v472: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:17:10.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:09 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3092215182' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-13T02:17:10.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:09 smithi175 ceph-mon[36977]: pgmap v472: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:17:10.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:09 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3092215182' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-13T02:17:10.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- bash -c 'ceph osd dump' 2024-06-13T02:17:10.775 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:17:12.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:11 smithi002 ceph-mon[31960]: pgmap v473: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:17:12.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:11 smithi084 ceph-mon[36833]: pgmap v473: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:17:12.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:11 smithi175 ceph-mon[36977]: pgmap v473: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:17:13.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.179+0000 7fceffa00700 1 -- 172.21.15.2:0/1780310166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8105930 msgr2=0x7fcef8105d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:13.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.179+0000 7fceffa00700 1 --2- 172.21.15.2:0/1780310166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8105930 0x7fcef8105d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcee40099c0 tx=0x7fcee4009cd0 comp rx=0 tx=0).stop 2024-06-13T02:17:13.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.179+0000 7fceffa00700 1 -- 172.21.15.2:0/1780310166 shutdown_connections 2024-06-13T02:17:13.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.179+0000 7fceffa00700 1 --2- 172.21.15.2:0/1780310166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcef81062d0 0x7fcef810cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:13.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.179+0000 7fceffa00700 1 --2- 172.21.15.2:0/1780310166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef8104730 0x7fcef8104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:13.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.179+0000 7fceffa00700 1 --2- 172.21.15.2:0/1780310166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8105930 0x7fcef8105d90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:13.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.179+0000 7fceffa00700 1 -- 172.21.15.2:0/1780310166 >> 172.21.15.2:0/1780310166 conn(0x7fcef80ffcf0 msgr2=0x7fcef8102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:13.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.180+0000 7fceffa00700 1 -- 172.21.15.2:0/1780310166 shutdown_connections 2024-06-13T02:17:13.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.180+0000 7fceffa00700 1 -- 172.21.15.2:0/1780310166 wait complete. 2024-06-13T02:17:13.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.181+0000 7fceffa00700 1 Processor -- start 2024-06-13T02:17:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.181+0000 7fceffa00700 1 -- start start 2024-06-13T02:17:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.182+0000 7fceffa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8104730 0x7fcef819a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.182+0000 7fceffa00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcef8105930 0x7fcef819ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.182+0000 7fceffa00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef81062d0 0x7fcef81a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.182+0000 7fceffa00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcef8110370 con 0x7fcef8104730 2024-06-13T02:17:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.182+0000 7fceffa00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcef81101f0 con 0x7fcef81062d0 2024-06-13T02:17:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.182+0000 7fceffa00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcef81104f0 con 0x7fcef8105930 2024-06-13T02:17:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.182+0000 7fcefd000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8104730 0x7fcef819a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:13.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.182+0000 7fcefd000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8104730 0x7fcef819a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39076/0 (socket says 172.21.15.2:39076) 2024-06-13T02:17:13.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.182+0000 7fcefd000700 1 -- 172.21.15.2:0/1460325328 learned_addr learned my addr 172.21.15.2:0/1460325328 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:13.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.182+0000 7fcef7e00700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcef8105930 0x7fcef819ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:13.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.182+0000 7fcefda00700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef81062d0 0x7fcef81a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:13.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.183+0000 7fcefd000700 1 -- 172.21.15.2:0/1460325328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcef8105930 msgr2=0x7fcef819ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:13.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.183+0000 7fcefd000700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcef8105930 0x7fcef819ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:13.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.183+0000 7fcefd000700 1 -- 172.21.15.2:0/1460325328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef81062d0 msgr2=0x7fcef81a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:13.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.183+0000 7fcefd000700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef81062d0 0x7fcef81a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:13.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.183+0000 7fcefd000700 1 -- 172.21.15.2:0/1460325328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef81a2560 con 0x7fcef8104730 2024-06-13T02:17:13.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.183+0000 7fcef7e00700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcef8105930 0x7fcef819ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:13.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.183+0000 7fcefda00700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef81062d0 0x7fcef81a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:13.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.183+0000 7fcefd000700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8104730 0x7fcef819a900 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fceec00e9a0 tx=0x7fceec00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:13.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.183+0000 7fcef5600700 1 -- 172.21.15.2:0/1460325328 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec004220 con 0x7fcef8104730 2024-06-13T02:17:13.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.183+0000 7fcef5600700 1 -- 172.21.15.2:0/1460325328 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fceec0043c0 con 0x7fcef8104730 2024-06-13T02:17:13.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.183+0000 7fceffa00700 1 -- 172.21.15.2:0/1460325328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef81a2850 con 0x7fcef8104730 2024-06-13T02:17:13.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.183+0000 7fcef5600700 1 -- 172.21.15.2:0/1460325328 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec003df0 con 0x7fcef8104730 2024-06-13T02:17:13.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.184+0000 7fceffa00700 1 -- 172.21.15.2:0/1460325328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef81a2de0 con 0x7fcef8104730 2024-06-13T02:17:13.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.185+0000 7fceffa00700 1 -- 172.21.15.2:0/1460325328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef8069180 con 0x7fcef8104730 2024-06-13T02:17:13.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.187+0000 7fcef5600700 1 -- 172.21.15.2:0/1460325328 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fceec00c810 con 0x7fcef8104730 2024-06-13T02:17:13.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.188+0000 7fcef5600700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcee00a2ca0 0x7fcee00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.188+0000 7fcef5600700 1 -- 172.21.15.2:0/1460325328 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fceec0cf5f0 con 0x7fcef8104730 2024-06-13T02:17:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.189+0000 7fcef7e00700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcee00a2ca0 0x7fcee00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:13.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.189+0000 7fcef7e00700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcee00a2ca0 0x7fcee00a5160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcee4000c00 tx=0x7fcee4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:13.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.193+0000 7fcef5600700 1 -- 172.21.15.2:0/1460325328 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fceec09c100 con 0x7fcef8104730 2024-06-13T02:17:13.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.425+0000 7fceffa00700 1 -- 172.21.15.2:0/1460325328 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fcef80630a0 con 0x7fcef8104730 2024-06-13T02:17:13.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.427+0000 7fcef5600700 1 -- 172.21.15.2:0/1460325328 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v100) ==== 56+0+5696 (secure 0 0 0) 0x7fceec09ba00 con 0x7fcef8104730 2024-06-13T02:17:13.428 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 100 2024-06-13T02:17:13.428 INFO:teuthology.orchestra.run.smithi002.stdout:fsid efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:17:13.429 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-06-13T02:03:16.412002+0000 2024-06-13T02:17:13.429 INFO:teuthology.orchestra.run.smithi002.stdout:modified 2024-06-13T02:14:25.693752+0000 2024-06-13T02:17:13.429 INFO:teuthology.orchestra.run.smithi002.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-06-13T02:17:13.429 INFO:teuthology.orchestra.run.smithi002.stdout:crush_version 27 2024-06-13T02:17:13.429 INFO:teuthology.orchestra.run.smithi002.stdout:full_ratio 0.95 2024-06-13T02:17:13.429 INFO:teuthology.orchestra.run.smithi002.stdout:backfillfull_ratio 0.9 2024-06-13T02:17:13.429 INFO:teuthology.orchestra.run.smithi002.stdout:nearfull_ratio 0.85 2024-06-13T02:17:13.429 INFO:teuthology.orchestra.run.smithi002.stdout:require_min_compat_client luminous 2024-06-13T02:17:13.429 INFO:teuthology.orchestra.run.smithi002.stdout:min_compat_client luminous 2024-06-13T02:17:13.429 INFO:teuthology.orchestra.run.smithi002.stdout:require_osd_release squid 2024-06-13T02:17:13.429 INFO:teuthology.orchestra.run.smithi002.stdout:stretch_mode_enabled false 2024-06-13T02:17:13.429 INFO:teuthology.orchestra.run.smithi002.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-06-13T02:17:13.430 INFO:teuthology.orchestra.run.smithi002.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-06-13T02:17:13.430 INFO:teuthology.orchestra.run.smithi002.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 89 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.69 2024-06-13T02:17:13.430 INFO:teuthology.orchestra.run.smithi002.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 96 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-06-13T02:17:13.430 INFO:teuthology.orchestra.run.smithi002.stdout:max_osd 12 2024-06-13T02:17:13.430 INFO:teuthology.orchestra.run.smithi002.stdout:osd.0 up in weight 1 up_from 8 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6802/3254812126,v1:172.21.15.2:6803/3254812126] [v2:172.21.15.2:6804/3254812126,v1:172.21.15.2:6805/3254812126] exists,up 96b4d494-453c-48aa-b1e2-ee30dfa83e2e 2024-06-13T02:17:13.430 INFO:teuthology.orchestra.run.smithi002.stdout:osd.1 up in weight 1 up_from 13 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6800/1593775403,v1:172.21.15.84:6801/1593775403] [v2:172.21.15.84:6802/1593775403,v1:172.21.15.84:6803/1593775403] exists,up 856e86b6-9281-485b-a36b-2fe04de31329 2024-06-13T02:17:13.430 INFO:teuthology.orchestra.run.smithi002.stdout:osd.2 up in weight 1 up_from 18 up_thru 99 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6800/2174304558,v1:172.21.15.175:6801/2174304558] [v2:172.21.15.175:6802/2174304558,v1:172.21.15.175:6803/2174304558] exists,up 8c9daa52-0dfb-471a-afb4-6eb0b908195a 2024-06-13T02:17:13.430 INFO:teuthology.orchestra.run.smithi002.stdout:osd.3 up in weight 1 up_from 26 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6810/3010864289,v1:172.21.15.2:6811/3010864289] [v2:172.21.15.2:6812/3010864289,v1:172.21.15.2:6813/3010864289] exists,up 2e747d36-4aa5-4c4c-918d-b8100980cc8d 2024-06-13T02:17:13.430 INFO:teuthology.orchestra.run.smithi002.stdout:osd.4 up in weight 1 up_from 34 up_thru 97 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6808/2541323390,v1:172.21.15.84:6809/2541323390] [v2:172.21.15.84:6810/2541323390,v1:172.21.15.84:6811/2541323390] exists,up bd063fb2-1a65-4b18-898c-f80ddc2a1229 2024-06-13T02:17:13.430 INFO:teuthology.orchestra.run.smithi002.stdout:osd.5 up in weight 1 up_from 39 up_thru 97 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6808/764262885,v1:172.21.15.175:6809/764262885] [v2:172.21.15.175:6810/764262885,v1:172.21.15.175:6811/764262885] exists,up e0ea80fd-1bfe-4d2e-9733-ff442ec015b9 2024-06-13T02:17:13.430 INFO:teuthology.orchestra.run.smithi002.stdout:osd.6 up in weight 1 up_from 47 up_thru 92 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6818/297321106,v1:172.21.15.2:6819/297321106] [v2:172.21.15.2:6820/297321106,v1:172.21.15.2:6821/297321106] exists,up 1c204d74-5e48-4e2e-bb98-6a8d4974187c 2024-06-13T02:17:13.431 INFO:teuthology.orchestra.run.smithi002.stdout:osd.7 up in weight 1 up_from 52 up_thru 97 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6816/3873726653,v1:172.21.15.84:6817/3873726653] [v2:172.21.15.84:6818/3873726653,v1:172.21.15.84:6819/3873726653] exists,up 1299bbb1-fbfb-4aba-be6b-6704691735f6 2024-06-13T02:17:13.431 INFO:teuthology.orchestra.run.smithi002.stdout:osd.8 up in weight 1 up_from 60 up_thru 99 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6816/2622818232,v1:172.21.15.175:6817/2622818232] [v2:172.21.15.175:6818/2622818232,v1:172.21.15.175:6819/2622818232] exists,up 9c3f2a92-d956-4246-bce9-620824d0da22 2024-06-13T02:17:13.431 INFO:teuthology.orchestra.run.smithi002.stdout:osd.9 up in weight 1 up_from 68 up_thru 97 down_at 0 last_clean_interval [0,0) [v2:172.21.15.2:6826/1171735390,v1:172.21.15.2:6827/1171735390] [v2:172.21.15.2:6828/1171735390,v1:172.21.15.2:6829/1171735390] exists,up e9839f78-05c6-4b3f-bc14-cb771a03ff5c 2024-06-13T02:17:13.431 INFO:teuthology.orchestra.run.smithi002.stdout:osd.10 up in weight 1 up_from 73 up_thru 97 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6824/4269523460,v1:172.21.15.84:6825/4269523460] [v2:172.21.15.84:6826/4269523460,v1:172.21.15.84:6827/4269523460] exists,up 66719431-5ba9-4865-957b-f6582e607a00 2024-06-13T02:17:13.431 INFO:teuthology.orchestra.run.smithi002.stdout:osd.11 up in weight 1 up_from 81 up_thru 99 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6824/2762894732,v1:172.21.15.175:6825/2762894732] [v2:172.21.15.175:6826/2762894732,v1:172.21.15.175:6827/2762894732] exists,up 1ce6e6ee-6ff3-416f-b985-e3afe503093d 2024-06-13T02:17:13.431 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.a [2,11] 2024-06-13T02:17:13.431 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.c [2,4] 2024-06-13T02:17:13.431 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 2.10 [8,11] 2024-06-13T02:17:13.431 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.3 [4,9] 2024-06-13T02:17:13.431 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.7 [3,9] 2024-06-13T02:17:13.431 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.11 [4,6] 2024-06-13T02:17:13.431 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.1a [5,6] 2024-06-13T02:17:13.431 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.1b [4,8] 2024-06-13T02:17:13.432 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.27 [3,9] 2024-06-13T02:17:13.432 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.28 [5,7] 2024-06-13T02:17:13.432 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 3.3a [4,8] 2024-06-13T02:17:13.432 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 4.6 [5,8] 2024-06-13T02:17:13.432 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 4.10 [9,8] 2024-06-13T02:17:13.432 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 4.1c [9,10] 2024-06-13T02:17:13.432 INFO:teuthology.orchestra.run.smithi002.stdout:pg_upmap_items 4.1f [9,8] 2024-06-13T02:17:13.432 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/3121279966 expires 2024-06-14T02:04:24.281164+0000 2024-06-13T02:17:13.432 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/3121279966 expires 2024-06-14T02:04:24.281164+0000 2024-06-13T02:17:13.432 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/3397168014 expires 2024-06-14T02:04:24.281164+0000 2024-06-13T02:17:13.432 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/1789744365 expires 2024-06-14T02:04:24.281164+0000 2024-06-13T02:17:13.432 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/3831398703 expires 2024-06-14T02:03:50.073572+0000 2024-06-13T02:17:13.432 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/3119270562 expires 2024-06-14T02:03:50.073572+0000 2024-06-13T02:17:13.432 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/2163302458 expires 2024-06-14T02:03:50.073572+0000 2024-06-13T02:17:13.433 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6800/2830681579 expires 2024-06-14T02:03:50.073572+0000 2024-06-13T02:17:13.433 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:0/1678672435 expires 2024-06-14T02:04:24.281164+0000 2024-06-13T02:17:13.433 INFO:teuthology.orchestra.run.smithi002.stdout:blocklist 172.21.15.2:6801/2830681579 expires 2024-06-14T02:03:50.073572+0000 2024-06-13T02:17:13.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.430+0000 7fceffa00700 1 -- 172.21.15.2:0/1460325328 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcee00a2ca0 msgr2=0x7fcee00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:13.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.430+0000 7fceffa00700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcee00a2ca0 0x7fcee00a5160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcee4000c00 tx=0x7fcee4005fb0 comp rx=0 tx=0).stop 2024-06-13T02:17:13.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.430+0000 7fceffa00700 1 -- 172.21.15.2:0/1460325328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8104730 msgr2=0x7fcef819a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:13.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.430+0000 7fceffa00700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8104730 0x7fcef819a900 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fceec00e9a0 tx=0x7fceec00ecb0 comp rx=0 tx=0).stop 2024-06-13T02:17:13.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.430+0000 7fceffa00700 1 -- 172.21.15.2:0/1460325328 shutdown_connections 2024-06-13T02:17:13.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.430+0000 7fceffa00700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fcee00a2ca0 0x7fcee00a5160 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:13.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.430+0000 7fceffa00700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcef81062d0 0x7fcef81a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:13.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.430+0000 7fceffa00700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8104730 0x7fcef819a900 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:13.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.430+0000 7fceffa00700 1 --2- 172.21.15.2:0/1460325328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcef8105930 0x7fcef819ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:13.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.430+0000 7fceffa00700 1 -- 172.21.15.2:0/1460325328 >> 172.21.15.2:0/1460325328 conn(0x7fcef80ffcf0 msgr2=0x7fcef8108bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:13.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.430+0000 7fceffa00700 1 -- 172.21.15.2:0/1460325328 shutdown_connections 2024-06-13T02:17:13.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:13.430+0000 7fceffa00700 1 -- 172.21.15.2:0/1460325328 wait complete. 2024-06-13T02:17:14.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:13 smithi002 ceph-mon[31960]: pgmap v474: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:17:14.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:13 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1460325328' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-13T02:17:14.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:13 smithi084 ceph-mon[36833]: pgmap v474: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:17:14.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:13 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1460325328' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-13T02:17:14.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:13 smithi175 ceph-mon[36977]: pgmap v474: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:17:14.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:13 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1460325328' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-13T02:17:14.567 INFO:teuthology.run_tasks:Running task fs.ready... 2024-06-13T02:17:14.579 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:17:15.064 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:17:16.156 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:15 smithi002 ceph-mon[31960]: pgmap v475: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:17:16.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:15 smithi084 ceph-mon[36833]: pgmap v475: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:17:16.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:15 smithi175 ceph-mon[36977]: pgmap v475: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:17:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.490+0000 7fd938600700 1 -- 172.21.15.2:0/4233335244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd93006ab30 msgr2=0x7fd93010f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.490+0000 7fd938600700 1 --2- 172.21.15.2:0/4233335244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd93006ab30 0x7fd93010f320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd92800b0a0 tx=0x7fd92800b3b0 comp rx=0 tx=0).stop 2024-06-13T02:17:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.490+0000 7fd938600700 1 -- 172.21.15.2:0/4233335244 shutdown_connections 2024-06-13T02:17:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.490+0000 7fd938600700 1 --2- 172.21.15.2:0/4233335244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd93006ab30 0x7fd93010f320 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.490+0000 7fd938600700 1 --2- 172.21.15.2:0/4233335244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd930108500 0x7fd9301088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.490+0000 7fd938600700 1 --2- 172.21.15.2:0/4233335244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd93006a170 0x7fd93006a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.490+0000 7fd938600700 1 -- 172.21.15.2:0/4233335244 >> 172.21.15.2:0/4233335244 conn(0x7fd930078340 msgr2=0x7fd930078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.490+0000 7fd938600700 1 -- 172.21.15.2:0/4233335244 shutdown_connections 2024-06-13T02:17:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.490+0000 7fd938600700 1 -- 172.21.15.2:0/4233335244 wait complete. 2024-06-13T02:17:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.492+0000 7fd938600700 1 Processor -- start 2024-06-13T02:17:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.492+0000 7fd938600700 1 -- start start 2024-06-13T02:17:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.493+0000 7fd938600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd93006a170 0x7fd93019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.493+0000 7fd938600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd93006ab30 0x7fd93019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.493+0000 7fd938600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd930108500 0x7fd930198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.493+0000 7fd938600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd9301127d0 con 0x7fd930108500 2024-06-13T02:17:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.493+0000 7fd938600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd930112650 con 0x7fd93006a170 2024-06-13T02:17:17.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.493+0000 7fd938600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd930112950 con 0x7fd93006ab30 2024-06-13T02:17:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.493+0000 7fd935200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd93006ab30 0x7fd93019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.493+0000 7fd936600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd930108500 0x7fd930198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.493+0000 7fd935200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd93006ab30 0x7fd93019ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:36306/0 (socket says 172.21.15.2:36306) 2024-06-13T02:17:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.493+0000 7fd935200700 1 -- 172.21.15.2:0/2978881104 learned_addr learned my addr 172.21.15.2:0/2978881104 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.493+0000 7fd935c00700 1 --2- 172.21.15.2:0/2978881104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd93006a170 0x7fd93019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.494+0000 7fd935200700 1 -- 172.21.15.2:0/2978881104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd93006a170 msgr2=0x7fd93019e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.494+0000 7fd935200700 1 --2- 172.21.15.2:0/2978881104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd93006a170 0x7fd93019e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.494+0000 7fd935200700 1 -- 172.21.15.2:0/2978881104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd930108500 msgr2=0x7fd930198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.494+0000 7fd935200700 1 --2- 172.21.15.2:0/2978881104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd930108500 0x7fd930198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.494+0000 7fd935200700 1 -- 172.21.15.2:0/2978881104 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd930199170 con 0x7fd93006ab30 2024-06-13T02:17:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.494+0000 7fd935200700 1 --2- 172.21.15.2:0/2978881104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd93006ab30 0x7fd93019ed90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00e9c0 tx=0x7fd91c00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.494+0000 7fd92e000700 1 -- 172.21.15.2:0/2978881104 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c00cbd0 con 0x7fd93006ab30 2024-06-13T02:17:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.494+0000 7fd938600700 1 -- 172.21.15.2:0/2978881104 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd930199460 con 0x7fd93006ab30 2024-06-13T02:17:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.494+0000 7fd92e000700 1 -- 172.21.15.2:0/2978881104 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd91c00ee60 con 0x7fd93006ab30 2024-06-13T02:17:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.494+0000 7fd92e000700 1 -- 172.21.15.2:0/2978881104 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c005630 con 0x7fd93006ab30 2024-06-13T02:17:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.495+0000 7fd938600700 1 -- 172.21.15.2:0/2978881104 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9301a5720 con 0x7fd93006ab30 2024-06-13T02:17:17.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.496+0000 7fd938600700 1 -- 172.21.15.2:0/2978881104 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd930069180 con 0x7fd93006ab30 2024-06-13T02:17:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.498+0000 7fd92e000700 1 -- 172.21.15.2:0/2978881104 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fd91c004750 con 0x7fd93006ab30 2024-06-13T02:17:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.499+0000 7fd92e000700 1 --2- 172.21.15.2:0/2978881104 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd9180a2c20 0x7fd9180a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:17.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.499+0000 7fd92e000700 1 -- 172.21.15.2:0/2978881104 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fd91c0cf720 con 0x7fd93006ab30 2024-06-13T02:17:17.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.500+0000 7fd935c00700 1 --2- 172.21.15.2:0/2978881104 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd9180a2c20 0x7fd9180a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:17.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.500+0000 7fd935c00700 1 --2- 172.21.15.2:0/2978881104 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd9180a2c20 0x7fd9180a50e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd924009680 tx=0x7fd924009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:17.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.504+0000 7fd92e000700 1 -- 172.21.15.2:0/2978881104 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd91c09c230 con 0x7fd93006ab30 2024-06-13T02:17:17.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.786+0000 7fd938600700 1 -- 172.21.15.2:0/2978881104 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd93002dca0 con 0x7fd93006ab30 2024-06-13T02:17:17.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.788+0000 7fd92e000700 1 -- 172.21.15.2:0/2978881104 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11857 (secure 0 0 0) 0x7fd91c09bb30 con 0x7fd93006ab30 2024-06-13T02:17:17.789 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:17:17.790 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3458450195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3458450195},{"type":"v1","addr":"172.21.15.2:6841","nonce":3458450195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1709394731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1709394731},{"type":"v1","addr":"172.21.15.175:6835","nonce":1709394731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T02:12:43.063161+0000","modified":"2024-06-13T02:14:13.553770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24503,"mds_2":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/2403775181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2403775181},{"type":"v1","addr":"172.21.15.84:6835","nonce":2403775181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/1446546569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1446546569},{"type":"v1","addr":"172.21.15.175:6837","nonce":1446546569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/2537381027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2537381027},{"type":"v1","addr":"172.21.15.84:6837","nonce":2537381027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/2743442301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":2743442301},{"type":"v1","addr":"172.21.15.175:6839","nonce":2743442301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":29,"addr":"172.21.15.2:6839/3208917373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3208917373},{"type":"v1","addr":"172.21.15.2:6839","nonce":3208917373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6839/541041266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":541041266},{"type":"v1","addr":"172.21.15.84:6839","nonce":541041266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24503,24527,24490]},"id":1}]} 2024-06-13T02:17:17.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.791+0000 7fd938600700 1 -- 172.21.15.2:0/2978881104 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd9180a2c20 msgr2=0x7fd9180a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:17.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.791+0000 7fd938600700 1 --2- 172.21.15.2:0/2978881104 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd9180a2c20 0x7fd9180a50e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd924009680 tx=0x7fd924009260 comp rx=0 tx=0).stop 2024-06-13T02:17:17.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.791+0000 7fd938600700 1 -- 172.21.15.2:0/2978881104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd93006ab30 msgr2=0x7fd93019ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:17.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.791+0000 7fd938600700 1 --2- 172.21.15.2:0/2978881104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd93006ab30 0x7fd93019ed90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00e9c0 tx=0x7fd91c00ecd0 comp rx=0 tx=0).stop 2024-06-13T02:17:17.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.792+0000 7fd938600700 1 -- 172.21.15.2:0/2978881104 shutdown_connections 2024-06-13T02:17:17.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.792+0000 7fd938600700 1 --2- 172.21.15.2:0/2978881104 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fd9180a2c20 0x7fd9180a50e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:17.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.792+0000 7fd938600700 1 --2- 172.21.15.2:0/2978881104 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd930108500 0x7fd930198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:17.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.792+0000 7fd938600700 1 --2- 172.21.15.2:0/2978881104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd93006a170 0x7fd93019e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:17.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.792+0000 7fd938600700 1 --2- 172.21.15.2:0/2978881104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd93006ab30 0x7fd93019ed90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:17.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.792+0000 7fd938600700 1 -- 172.21.15.2:0/2978881104 >> 172.21.15.2:0/2978881104 conn(0x7fd930078340 msgr2=0x7fd9300fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:17.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.792+0000 7fd938600700 1 -- 172.21.15.2:0/2978881104 shutdown_connections 2024-06-13T02:17:17.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:17.792+0000 7fd938600700 1 -- 172.21.15.2:0/2978881104 wait complete. 2024-06-13T02:17:17.795 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-06-13T02:17:18.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:17 smithi002 ceph-mon[31960]: pgmap v476: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:17:18.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:17 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2978881104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:17:18.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:17 smithi084 ceph-mon[36833]: pgmap v476: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:17:18.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:17 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2978881104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:17:18.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:17 smithi175 ceph-mon[36977]: pgmap v476: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:17:18.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:17 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2978881104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:17:18.808 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:17:19.285 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:17:20.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:19 smithi002 ceph-mon[31960]: pgmap v477: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:17:20.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:19 smithi084 ceph-mon[36833]: pgmap v477: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:17:20.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:19 smithi175 ceph-mon[36977]: pgmap v477: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:17:21.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.622+0000 7f4d61c00700 1 -- 172.21.15.2:0/1895650619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d5c06a170 msgr2=0x7f4d5c06a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.622+0000 7f4d61c00700 1 --2- 172.21.15.2:0/1895650619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d5c06a170 0x7f4d5c06a5f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009990 tx=0x7f4d44009ca0 comp rx=0 tx=0).stop 2024-06-13T02:17:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.623+0000 7f4d61c00700 1 -- 172.21.15.2:0/1895650619 shutdown_connections 2024-06-13T02:17:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.623+0000 7f4d61c00700 1 --2- 172.21.15.2:0/1895650619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d5c06ab30 0x7f4d5c10f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.623+0000 7f4d61c00700 1 --2- 172.21.15.2:0/1895650619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d5c108500 0x7f4d5c1088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.623+0000 7f4d61c00700 1 --2- 172.21.15.2:0/1895650619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d5c06a170 0x7f4d5c06a5f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.623+0000 7f4d61c00700 1 -- 172.21.15.2:0/1895650619 >> 172.21.15.2:0/1895650619 conn(0x7f4d5c078340 msgr2=0x7f4d5c078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.623+0000 7f4d61c00700 1 -- 172.21.15.2:0/1895650619 shutdown_connections 2024-06-13T02:17:21.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.623+0000 7f4d61c00700 1 -- 172.21.15.2:0/1895650619 wait complete. 2024-06-13T02:17:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.624+0000 7f4d61c00700 1 Processor -- start 2024-06-13T02:17:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.624+0000 7f4d61c00700 1 -- start start 2024-06-13T02:17:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.624+0000 7f4d61c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d5c06a170 0x7f4d5c19ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.624+0000 7f4d61c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d5c06ab30 0x7f4d5c19b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.624+0000 7f4d61c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d5c108500 0x7f4d5c19f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.624+0000 7f4d61c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c112760 con 0x7f4d5c108500 2024-06-13T02:17:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.624+0000 7f4d61c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c1125e0 con 0x7f4d5c06ab30 2024-06-13T02:17:21.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.624+0000 7f4d61c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c1128e0 con 0x7f4d5c06a170 2024-06-13T02:17:21.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.625+0000 7f4d5b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d5c108500 0x7f4d5c19f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.625+0000 7f4d5b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d5c108500 0x7f4d5c19f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39118/0 (socket says 172.21.15.2:39118) 2024-06-13T02:17:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.625+0000 7f4d5b400700 1 -- 172.21.15.2:0/3112717257 learned_addr learned my addr 172.21.15.2:0/3112717257 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.625+0000 7f4d5aa00700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d5c06a170 0x7f4d5c19ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.625+0000 7f4d52000700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d5c06ab30 0x7f4d5c19b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.625+0000 7f4d5b400700 1 -- 172.21.15.2:0/3112717257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d5c06a170 msgr2=0x7f4d5c19ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.625+0000 7f4d5b400700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d5c06a170 0x7f4d5c19ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.625+0000 7f4d5b400700 1 -- 172.21.15.2:0/3112717257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d5c06ab30 msgr2=0x7f4d5c19b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.625+0000 7f4d5b400700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d5c06ab30 0x7f4d5c19b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.625+0000 7f4d5b400700 1 -- 172.21.15.2:0/3112717257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d5c19fe30 con 0x7f4d5c108500 2024-06-13T02:17:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.625+0000 7f4d52000700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d5c06ab30 0x7f4d5c19b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.625+0000 7f4d5aa00700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d5c06a170 0x7f4d5c19ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.626+0000 7f4d5b400700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d5c108500 0x7f4d5c19f6f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4d54007ee0 tx=0x7f4d5400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:21.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.626+0000 7f4d53e00700 1 -- 172.21.15.2:0/3112717257 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5400dd20 con 0x7f4d5c108500 2024-06-13T02:17:21.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.626+0000 7f4d61c00700 1 -- 172.21.15.2:0/3112717257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d5c1a0120 con 0x7f4d5c108500 2024-06-13T02:17:21.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.626+0000 7f4d53e00700 1 -- 172.21.15.2:0/3112717257 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d54004020 con 0x7f4d5c108500 2024-06-13T02:17:21.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.626+0000 7f4d53e00700 1 -- 172.21.15.2:0/3112717257 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54015660 con 0x7f4d5c108500 2024-06-13T02:17:21.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.626+0000 7f4d61c00700 1 -- 172.21.15.2:0/3112717257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d5c1a79a0 con 0x7f4d5c108500 2024-06-13T02:17:21.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.627+0000 7f4d61c00700 1 -- 172.21.15.2:0/3112717257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d5c069180 con 0x7f4d5c108500 2024-06-13T02:17:21.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.630+0000 7f4d53e00700 1 -- 172.21.15.2:0/3112717257 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f4d540041d0 con 0x7f4d5c108500 2024-06-13T02:17:21.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.631+0000 7f4d53e00700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f4d400a2ca0 0x7f4d400a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:21.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.631+0000 7f4d53e00700 1 -- 172.21.15.2:0/3112717257 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f4d540cf6a0 con 0x7f4d5c108500 2024-06-13T02:17:21.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.631+0000 7f4d5aa00700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f4d400a2ca0 0x7f4d400a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:21.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.632+0000 7f4d5aa00700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f4d400a2ca0 0x7f4d400a5160 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009fd0 tx=0x7f4d4c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:21.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.634+0000 7f4d53e00700 1 -- 172.21.15.2:0/3112717257 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4d54010070 con 0x7f4d5c108500 2024-06-13T02:17:21.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.910+0000 7f4d61c00700 1 -- 172.21.15.2:0/3112717257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d5c1a7b70 con 0x7f4d5c108500 2024-06-13T02:17:21.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.912+0000 7f4d53e00700 1 -- 172.21.15.2:0/3112717257 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11857 (secure 0 0 0) 0x7f4d5409c1b0 con 0x7f4d5c108500 2024-06-13T02:17:21.914 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:17:21.914 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3458450195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3458450195},{"type":"v1","addr":"172.21.15.2:6841","nonce":3458450195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1709394731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1709394731},{"type":"v1","addr":"172.21.15.175:6835","nonce":1709394731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T02:12:43.063161+0000","modified":"2024-06-13T02:14:13.553770+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24503,"mds_2":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/2403775181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2403775181},{"type":"v1","addr":"172.21.15.84:6835","nonce":2403775181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/1446546569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1446546569},{"type":"v1","addr":"172.21.15.175:6837","nonce":1446546569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24488":{"gid":24488,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/2537381027","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":2537381027},{"type":"v1","addr":"172.21.15.84:6837","nonce":2537381027}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/2743442301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":2743442301},{"type":"v1","addr":"172.21.15.175:6839","nonce":2743442301}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":29,"addr":"172.21.15.2:6839/3208917373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3208917373},{"type":"v1","addr":"172.21.15.2:6839","nonce":3208917373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6839/541041266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":541041266},{"type":"v1","addr":"172.21.15.84:6839","nonce":541041266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24503,24527,24490]},"id":1}]} 2024-06-13T02:17:21.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.915+0000 7f4d61c00700 1 -- 172.21.15.2:0/3112717257 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f4d400a2ca0 msgr2=0x7f4d400a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:21.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.915+0000 7f4d61c00700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f4d400a2ca0 0x7f4d400a5160 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009fd0 tx=0x7f4d4c009260 comp rx=0 tx=0).stop 2024-06-13T02:17:21.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.915+0000 7f4d61c00700 1 -- 172.21.15.2:0/3112717257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d5c108500 msgr2=0x7f4d5c19f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:21.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.915+0000 7f4d61c00700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d5c108500 0x7f4d5c19f6f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4d54007ee0 tx=0x7f4d5400d3b0 comp rx=0 tx=0).stop 2024-06-13T02:17:21.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.915+0000 7f4d61c00700 1 -- 172.21.15.2:0/3112717257 shutdown_connections 2024-06-13T02:17:21.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.915+0000 7f4d61c00700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f4d400a2ca0 0x7f4d400a5160 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:21.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.915+0000 7f4d61c00700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d5c108500 0x7f4d5c19f6f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:21.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.915+0000 7f4d61c00700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d5c06a170 0x7f4d5c19ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:21.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.915+0000 7f4d61c00700 1 --2- 172.21.15.2:0/3112717257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d5c06ab30 0x7f4d5c19b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:21.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.915+0000 7f4d61c00700 1 -- 172.21.15.2:0/3112717257 >> 172.21.15.2:0/3112717257 conn(0x7f4d5c078340 msgr2=0x7f4d5c10d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:21.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.916+0000 7f4d61c00700 1 -- 172.21.15.2:0/3112717257 shutdown_connections 2024-06-13T02:17:21.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:21.916+0000 7f4d61c00700 1 -- 172.21.15.2:0/3112717257 wait complete. 2024-06-13T02:17:21.919 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 26 2024-06-13T02:17:22.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:21 smithi084 ceph-mon[36833]: pgmap v478: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:17:22.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:21 smithi175 ceph-mon[36977]: pgmap v478: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:17:22.325 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:21 smithi002 ceph-mon[31960]: pgmap v478: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:17:22.727 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T02:17:23.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:22 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3112717257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:17:23.200 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:17:23.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:22 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3112717257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:17:23.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:22 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3112717257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:17:24.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:23 smithi002 ceph-mon[31960]: pgmap v479: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:17:24.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:23 smithi084 ceph-mon[36833]: pgmap v479: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:17:24.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:23 smithi175 ceph-mon[36977]: pgmap v479: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:17:25.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.542+0000 7f7bf3400700 1 -- 172.21.15.2:0/3935443965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bec06a6e0 msgr2=0x7f7bec06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:25.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.542+0000 7f7bf3400700 1 --2- 172.21.15.2:0/3935443965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bec06a6e0 0x7f7bec06ab40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009990 tx=0x7f7bd4009ca0 comp rx=0 tx=0).stop 2024-06-13T02:17:25.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.543+0000 7f7bf3400700 1 -- 172.21.15.2:0/3935443965 shutdown_connections 2024-06-13T02:17:25.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.543+0000 7f7bf3400700 1 --2- 172.21.15.2:0/3935443965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bec104ed0 0x7f7bec105360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:25.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.543+0000 7f7bf3400700 1 --2- 172.21.15.2:0/3935443965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bec1073c0 0x7f7bec06a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:25.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.543+0000 7f7bf3400700 1 --2- 172.21.15.2:0/3935443965 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bec06a6e0 0x7f7bec06ab40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:25.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.543+0000 7f7bf3400700 1 -- 172.21.15.2:0/3935443965 >> 172.21.15.2:0/3935443965 conn(0x7f7bec078340 msgr2=0x7f7bec078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:25.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.543+0000 7f7bf3400700 1 -- 172.21.15.2:0/3935443965 shutdown_connections 2024-06-13T02:17:25.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.543+0000 7f7bf3400700 1 -- 172.21.15.2:0/3935443965 wait complete. 2024-06-13T02:17:25.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.544+0000 7f7bf3400700 1 Processor -- start 2024-06-13T02:17:25.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.544+0000 7f7bf3400700 1 -- start start 2024-06-13T02:17:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.545+0000 7f7bf3400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bec06a6e0 0x7f7bec19f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.545+0000 7f7bf3400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bec104ed0 0x7f7bec19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.545+0000 7f7bf3400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bec1073c0 0x7f7bec1a3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.545+0000 7f7bf3400700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec118e20 con 0x7f7bec06a6e0 2024-06-13T02:17:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.545+0000 7f7bf3400700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec118ca0 con 0x7f7bec104ed0 2024-06-13T02:17:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.545+0000 7f7bf3400700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec118fa0 con 0x7f7bec1073c0 2024-06-13T02:17:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.545+0000 7f7be3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bec104ed0 0x7f7bec19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.545+0000 7f7be3e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bec104ed0 0x7f7bec19f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:34102/0 (socket says 172.21.15.2:34102) 2024-06-13T02:17:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.545+0000 7f7be3e00700 1 -- 172.21.15.2:0/138811019 learned_addr learned my addr 172.21.15.2:0/138811019 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.545+0000 7f7bf1400700 1 --2- 172.21.15.2:0/138811019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bec1073c0 0x7f7bec1a3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.545+0000 7f7bf0a00700 1 --2- 172.21.15.2:0/138811019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bec06a6e0 0x7f7bec19f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.546+0000 7f7be3e00700 1 -- 172.21.15.2:0/138811019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bec1073c0 msgr2=0x7f7bec1a3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.546+0000 7f7be3e00700 1 --2- 172.21.15.2:0/138811019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bec1073c0 0x7f7bec1a3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.546+0000 7f7be3e00700 1 -- 172.21.15.2:0/138811019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bec06a6e0 msgr2=0x7f7bec19f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.546+0000 7f7be3e00700 1 --2- 172.21.15.2:0/138811019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bec06a6e0 0x7f7bec19f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.546+0000 7f7be3e00700 1 -- 172.21.15.2:0/138811019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bec1a4320 con 0x7f7bec104ed0 2024-06-13T02:17:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.546+0000 7f7bf0a00700 1 --2- 172.21.15.2:0/138811019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bec06a6e0 0x7f7bec19f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:17:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.546+0000 7f7be3e00700 1 --2- 172.21.15.2:0/138811019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bec104ed0 0x7f7bec19f850 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4005910 tx=0x7f7bd400bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.546+0000 7f7bea000700 1 -- 172.21.15.2:0/138811019 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4027070 con 0x7f7bec104ed0 2024-06-13T02:17:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.546+0000 7f7bf3400700 1 -- 172.21.15.2:0/138811019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bec1a45b0 con 0x7f7bec104ed0 2024-06-13T02:17:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.546+0000 7f7bea000700 1 -- 172.21.15.2:0/138811019 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd4003d70 con 0x7f7bec104ed0 2024-06-13T02:17:25.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.546+0000 7f7bea000700 1 -- 172.21.15.2:0/138811019 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd400f6c0 con 0x7f7bec104ed0 2024-06-13T02:17:25.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.547+0000 7f7bf3400700 1 -- 172.21.15.2:0/138811019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bec1abe90 con 0x7f7bec104ed0 2024-06-13T02:17:25.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.548+0000 7f7bf3400700 1 -- 172.21.15.2:0/138811019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bec069180 con 0x7f7bec104ed0 2024-06-13T02:17:25.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.550+0000 7f7bea000700 1 -- 172.21.15.2:0/138811019 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f7bd402a070 con 0x7f7bec104ed0 2024-06-13T02:17:25.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.551+0000 7f7bea000700 1 --2- 172.21.15.2:0/138811019 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7bd00a2ca0 0x7f7bd00a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.552+0000 7f7bea000700 1 -- 172.21.15.2:0/138811019 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f7bd40d0520 con 0x7f7bec104ed0 2024-06-13T02:17:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.552+0000 7f7bf0a00700 1 --2- 172.21.15.2:0/138811019 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7bd00a2ca0 0x7f7bd00a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.552+0000 7f7bf0a00700 1 --2- 172.21.15.2:0/138811019 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7bd00a2ca0 0x7f7bd00a5160 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009cb0 tx=0x7f7bdc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:25.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.556+0000 7f7bea000700 1 -- 172.21.15.2:0/138811019 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7bd405e850 con 0x7f7bec104ed0 2024-06-13T02:17:25.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.793+0000 7f7bf3400700 1 -- 172.21.15.2:0/138811019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7bec1ac060 con 0x7f7bec104ed0 2024-06-13T02:17:25.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.795+0000 7f7bea000700 1 -- 172.21.15.2:0/138811019 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+24854 (secure 0 0 0) 0x7f7bd4022e20 con 0x7f7bec104ed0 2024-06-13T02:17:25.797 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:17:25.797 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":100,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","created":"2024-06-13T02:03:16.412002+0000","modified":"2024-06-13T02:14:25.693752+0000","last_up_change":"2024-06-13T02:11:26.464184+0000","last_in_change":"2024-06-13T02:11:06.957351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T02:07:10.994857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T02:12:34.674172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T02:12:39.213985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T02:12:53.098590+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96b4d494-453c-48aa-b1e2-ee30dfa83e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6803","nonce":3254812126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6805","nonce":3254812126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6809","nonce":3254812126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6807","nonce":3254812126}]},"public_addr":"172.21.15.2:6803/3254812126","cluster_addr":"172.21.15.2:6805/3254812126","heartbeat_back_addr":"172.21.15.2:6809/3254812126","heartbeat_front_addr":"172.21.15.2:6807/3254812126","state":["exists","up"]},{"osd":1,"uuid":"856e86b6-9281-485b-a36b-2fe04de31329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6801","nonce":1593775403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6803","nonce":1593775403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6807","nonce":1593775403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6805","nonce":1593775403}]},"public_addr":"172.21.15.84:6801/1593775403","cluster_addr":"172.21.15.84:6803/1593775403","heartbeat_back_addr":"172.21.15.84:6807/1593775403","heartbeat_front_addr":"172.21.15.84:6805/1593775403","state":["exists","up"]},{"osd":2,"uuid":"8c9daa52-0dfb-471a-afb4-6eb0b908195a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6801","nonce":2174304558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6803","nonce":2174304558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6807","nonce":2174304558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6805","nonce":2174304558}]},"public_addr":"172.21.15.175:6801/2174304558","cluster_addr":"172.21.15.175:6803/2174304558","heartbeat_back_addr":"172.21.15.175:6807/2174304558","heartbeat_front_addr":"172.21.15.175:6805/2174304558","state":["exists","up"]},{"osd":3,"uuid":"2e747d36-4aa5-4c4c-918d-b8100980cc8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6811","nonce":3010864289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6813","nonce":3010864289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6817","nonce":3010864289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6815","nonce":3010864289}]},"public_addr":"172.21.15.2:6811/3010864289","cluster_addr":"172.21.15.2:6813/3010864289","heartbeat_back_addr":"172.21.15.2:6817/3010864289","heartbeat_front_addr":"172.21.15.2:6815/3010864289","state":["exists","up"]},{"osd":4,"uuid":"bd063fb2-1a65-4b18-898c-f80ddc2a1229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6809","nonce":2541323390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6811","nonce":2541323390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6815","nonce":2541323390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6813","nonce":2541323390}]},"public_addr":"172.21.15.84:6809/2541323390","cluster_addr":"172.21.15.84:6811/2541323390","heartbeat_back_addr":"172.21.15.84:6815/2541323390","heartbeat_front_addr":"172.21.15.84:6813/2541323390","state":["exists","up"]},{"osd":5,"uuid":"e0ea80fd-1bfe-4d2e-9733-ff442ec015b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6809","nonce":764262885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6811","nonce":764262885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6815","nonce":764262885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6813","nonce":764262885}]},"public_addr":"172.21.15.175:6809/764262885","cluster_addr":"172.21.15.175:6811/764262885","heartbeat_back_addr":"172.21.15.175:6815/764262885","heartbeat_front_addr":"172.21.15.175:6813/764262885","state":["exists","up"]},{"osd":6,"uuid":"1c204d74-5e48-4e2e-bb98-6a8d4974187c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6819","nonce":297321106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6821","nonce":297321106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6825","nonce":297321106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6823","nonce":297321106}]},"public_addr":"172.21.15.2:6819/297321106","cluster_addr":"172.21.15.2:6821/297321106","heartbeat_back_addr":"172.21.15.2:6825/297321106","heartbeat_front_addr":"172.21.15.2:6823/297321106","state":["exists","up"]},{"osd":7,"uuid":"1299bbb1-fbfb-4aba-be6b-6704691735f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6817","nonce":3873726653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6819","nonce":3873726653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6823","nonce":3873726653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6821","nonce":3873726653}]},"public_addr":"172.21.15.84:6817/3873726653","cluster_addr":"172.21.15.84:6819/3873726653","heartbeat_back_addr":"172.21.15.84:6823/3873726653","heartbeat_front_addr":"172.21.15.84:6821/3873726653","state":["exists","up"]},{"osd":8,"uuid":"9c3f2a92-d956-4246-bce9-620824d0da22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6817","nonce":2622818232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6819","nonce":2622818232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6823","nonce":2622818232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6821","nonce":2622818232}]},"public_addr":"172.21.15.175:6817/2622818232","cluster_addr":"172.21.15.175:6819/2622818232","heartbeat_back_addr":"172.21.15.175:6823/2622818232","heartbeat_front_addr":"172.21.15.175:6821/2622818232","state":["exists","up"]},{"osd":9,"uuid":"e9839f78-05c6-4b3f-bc14-cb771a03ff5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6827","nonce":1171735390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6829","nonce":1171735390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6833","nonce":1171735390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6831","nonce":1171735390}]},"public_addr":"172.21.15.2:6827/1171735390","cluster_addr":"172.21.15.2:6829/1171735390","heartbeat_back_addr":"172.21.15.2:6833/1171735390","heartbeat_front_addr":"172.21.15.2:6831/1171735390","state":["exists","up"]},{"osd":10,"uuid":"66719431-5ba9-4865-957b-f6582e607a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6825","nonce":4269523460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6827","nonce":4269523460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6831","nonce":4269523460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6829","nonce":4269523460}]},"public_addr":"172.21.15.84:6825/4269523460","cluster_addr":"172.21.15.84:6827/4269523460","heartbeat_back_addr":"172.21.15.84:6831/4269523460","heartbeat_front_addr":"172.21.15.84:6829/4269523460","state":["exists","up"]},{"osd":11,"uuid":"1ce6e6ee-6ff3-416f-b985-e3afe503093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6825","nonce":2762894732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6827","nonce":2762894732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6831","nonce":2762894732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6829","nonce":2762894732}]},"public_addr":"172.21.15.175:6825/2762894732","cluster_addr":"172.21.15.175:6827/2762894732","heartbeat_back_addr":"172.21.15.175:6831/2762894732","heartbeat_front_addr":"172.21.15.175:6829/2762894732","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:16.956638+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:42.268685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:06.272084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:39.696927+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:06.182991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:31.626603+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:05.247728+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:31.985114+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:57.474180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:31.988863+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:59.683056+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:11:24.493248+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:6801/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6800/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3397168014":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/1789744365":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3831398703":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/3119270562":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/2163302458":"2024-06-14T02:03:50.073572+0000","172.21.15.2:6800/2830681579":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/1678672435":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6801/2830681579":"2024-06-14T02:03:50.073572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T02:17:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.799+0000 7f7bf3400700 1 -- 172.21.15.2:0/138811019 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7bd00a2ca0 msgr2=0x7f7bd00a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.799+0000 7f7bf3400700 1 --2- 172.21.15.2:0/138811019 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7bd00a2ca0 0x7f7bd00a5160 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009cb0 tx=0x7f7bdc009260 comp rx=0 tx=0).stop 2024-06-13T02:17:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.799+0000 7f7bf3400700 1 -- 172.21.15.2:0/138811019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bec104ed0 msgr2=0x7f7bec19f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.799+0000 7f7bf3400700 1 --2- 172.21.15.2:0/138811019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bec104ed0 0x7f7bec19f850 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4005910 tx=0x7f7bd400bab0 comp rx=0 tx=0).stop 2024-06-13T02:17:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.799+0000 7f7bf3400700 1 -- 172.21.15.2:0/138811019 shutdown_connections 2024-06-13T02:17:25.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.799+0000 7f7bf3400700 1 --2- 172.21.15.2:0/138811019 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f7bd00a2ca0 0x7f7bd00a5160 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:25.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.799+0000 7f7bf3400700 1 --2- 172.21.15.2:0/138811019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bec1073c0 0x7f7bec1a3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:25.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.799+0000 7f7bf3400700 1 --2- 172.21.15.2:0/138811019 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7bec06a6e0 0x7f7bec19f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:25.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.799+0000 7f7bf3400700 1 --2- 172.21.15.2:0/138811019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7bec104ed0 0x7f7bec19f850 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:25.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.799+0000 7f7bf3400700 1 -- 172.21.15.2:0/138811019 >> 172.21.15.2:0/138811019 conn(0x7f7bec078340 msgr2=0x7f7bec103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:25.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.800+0000 7f7bf3400700 1 -- 172.21.15.2:0/138811019 shutdown_connections 2024-06-13T02:17:25.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:25.800+0000 7f7bf3400700 1 -- 172.21.15.2:0/138811019 wait complete. 2024-06-13T02:17:26.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:25 smithi002 ceph-mon[31960]: pgmap v480: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:17:26.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:25 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/138811019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:17:26.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:25 smithi084 ceph-mon[36833]: pgmap v480: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:17:26.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:25 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/138811019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:17:26.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:25 smithi175 ceph-mon[36977]: pgmap v480: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:17:26.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:25 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/138811019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:17:26.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-13T02:12:43.063161+0000', 'modified': '2024-06-13T02:14:13.553770+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24527, 'mds_1': 24503, 'mds_2': 24490}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24473': {'gid': 24473, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.84:6835/2403775181', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 2403775181}, {'type': 'v1', 'addr': '172.21.15.84:6835', 'nonce': 2403775181}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.175:6837/1446546569', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 1446546569}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1446546569}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24488': {'gid': 24488, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.84:6837/2537381027', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 2537381027}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 2537381027}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 31, 'addr': '172.21.15.175:6839/2743442301', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6838', 'nonce': 2743442301}, {'type': 'v1', 'addr': '172.21.15.175:6839', 'nonce': 2743442301}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24503': {'gid': 24503, 'name': 'g', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 29, 'addr': '172.21.15.2:6839/3208917373', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6838', 'nonce': 3208917373}, {'type': 'v1', 'addr': '172.21.15.2:6839', 'nonce': 3208917373}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24527': {'gid': 24527, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.84:6839/541041266', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6838', 'nonce': 541041266}, {'type': 'v1', 'addr': '172.21.15.84:6839', 'nonce': 541041266}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24527, 'qdb_cluster': [24503, 24527, 24490]} 2024-06-13T02:17:26.766 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-06-13T02:17:26.766 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell mds.i status 2024-06-13T02:17:27.246 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:17:27.998 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:27 smithi002 ceph-mon[31960]: pgmap v481: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:17:28.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:27 smithi084 ceph-mon[36833]: pgmap v481: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:17:28.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:27 smithi175 ceph-mon[36977]: pgmap v481: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:17:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.647+0000 7efe9fe00700 1 -- 172.21.15.2:0/2875200931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe98108ac0 msgr2=0x7efe98108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.647+0000 7efe9fe00700 1 --2- 172.21.15.2:0/2875200931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe98108ac0 0x7efe98108f40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efe84009990 tx=0x7efe84009ca0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.647+0000 7efe9fe00700 1 -- 172.21.15.2:0/2875200931 shutdown_connections 2024-06-13T02:17:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.647+0000 7efe9fe00700 1 --2- 172.21.15.2:0/2875200931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe98109480 0x7efe98115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.647+0000 7efe9fe00700 1 --2- 172.21.15.2:0/2875200931 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe9810eac0 0x7efe9810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.647+0000 7efe9fe00700 1 --2- 172.21.15.2:0/2875200931 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe98108ac0 0x7efe98108f40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.647+0000 7efe9fe00700 1 -- 172.21.15.2:0/2875200931 >> 172.21.15.2:0/2875200931 conn(0x7efe98075c60 msgr2=0x7efe981072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.647+0000 7efe9fe00700 1 -- 172.21.15.2:0/2875200931 shutdown_connections 2024-06-13T02:17:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.647+0000 7efe9fe00700 1 -- 172.21.15.2:0/2875200931 wait complete. 2024-06-13T02:17:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.649+0000 7efe9fe00700 1 Processor -- start 2024-06-13T02:17:29.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.649+0000 7efe9fe00700 1 -- start start 2024-06-13T02:17:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.649+0000 7efe9fe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe98108ac0 0x7efe9819f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.649+0000 7efe9fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe98109480 0x7efe9819f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.649+0000 7efe9fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe9810eac0 0x7efe981a3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.649+0000 7efe9fe00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efe98118e10 con 0x7efe9810eac0 2024-06-13T02:17:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.649+0000 7efe9fe00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efe98118c90 con 0x7efe98109480 2024-06-13T02:17:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.649+0000 7efe9fe00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efe98118f90 con 0x7efe98108ac0 2024-06-13T02:17:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.650+0000 7efe9de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe9810eac0 0x7efe981a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.650+0000 7efe9d400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe98108ac0 0x7efe9819f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.650+0000 7efe9ca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe98109480 0x7efe9819f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.650+0000 7efe9d400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe98108ac0 0x7efe9819f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:54224/0 (socket says 172.21.15.2:54224) 2024-06-13T02:17:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.650+0000 7efe9d400700 1 -- 172.21.15.2:0/1667415050 learned_addr learned my addr 172.21.15.2:0/1667415050 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.650+0000 7efe9de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe9810eac0 0x7efe981a3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40076/0 (socket says 172.21.15.2:40076) 2024-06-13T02:17:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.650+0000 7efe9ca00700 1 -- 172.21.15.2:0/1667415050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe98108ac0 msgr2=0x7efe9819f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.650+0000 7efe9ca00700 1 --2- 172.21.15.2:0/1667415050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe98108ac0 0x7efe9819f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.650+0000 7efe9ca00700 1 -- 172.21.15.2:0/1667415050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe9810eac0 msgr2=0x7efe981a3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.650+0000 7efe9ca00700 1 --2- 172.21.15.2:0/1667415050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe9810eac0 0x7efe981a3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.650+0000 7efe9ca00700 1 -- 172.21.15.2:0/1667415050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe981a4220 con 0x7efe98109480 2024-06-13T02:17:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.650+0000 7efe9de00700 1 --2- 172.21.15.2:0/1667415050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe9810eac0 0x7efe981a3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.650+0000 7efe9d400700 1 --2- 172.21.15.2:0/1667415050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe98108ac0 0x7efe9819f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:29.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.651+0000 7efe9ca00700 1 --2- 172.21.15.2:0/1667415050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe98109480 0x7efe9819f7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efe84006010 tx=0x7efe8400bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.651+0000 7efe96000700 1 -- 172.21.15.2:0/1667415050 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe84027070 con 0x7efe98109480 2024-06-13T02:17:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.651+0000 7efe96000700 1 -- 172.21.15.2:0/1667415050 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe840056d0 con 0x7efe98109480 2024-06-13T02:17:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.651+0000 7efe96000700 1 -- 172.21.15.2:0/1667415050 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe84022d90 con 0x7efe98109480 2024-06-13T02:17:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.651+0000 7efe9fe00700 1 -- 172.21.15.2:0/1667415050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe981a44b0 con 0x7efe98109480 2024-06-13T02:17:29.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.651+0000 7efe9fe00700 1 -- 172.21.15.2:0/1667415050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe981abd90 con 0x7efe98109480 2024-06-13T02:17:29.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.654+0000 7efe96000700 1 -- 172.21.15.2:0/1667415050 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7efe8402a070 con 0x7efe98109480 2024-06-13T02:17:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.656+0000 7efe96000700 1 --2- 172.21.15.2:0/1667415050 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7efe800a2c20 0x7efe800a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.656+0000 7efe96000700 1 -- 172.21.15.2:0/1667415050 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7efe840d0350 con 0x7efe98109480 2024-06-13T02:17:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.656+0000 7efeaa67fb80 1 Processor -- start 2024-06-13T02:17:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.656+0000 7efe9d400700 1 --2- 172.21.15.2:0/1667415050 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7efe800a2c20 0x7efe800a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.656+0000 7efeaa67fb80 1 -- start start 2024-06-13T02:17:29.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.656+0000 7efeaa67fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da11adf0 0x55c7da19e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.656+0000 7efeaa67fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 0x55c7da19e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.656+0000 7efeaa67fb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da1a92b0 0x55c7da1ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.656+0000 7efeaa67fb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c7da0ad9c0 con 0x55c7da1a92b0 2024-06-13T02:17:29.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.656+0000 7efeaa67fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c7da0f0ab0 con 0x55c7da19e560 2024-06-13T02:17:29.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.656+0000 7efeaa67fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c7da0ab8a0 con 0x55c7da11adf0 2024-06-13T02:17:29.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.657+0000 7efe9de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da1a92b0 0x55c7da1ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.657+0000 7efe9ca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 0x55c7da19e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.657+0000 7efe9de00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da1a92b0 0x55c7da1ab6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40090/0 (socket says 172.21.15.2:40090) 2024-06-13T02:17:29.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.657+0000 7efe9de00700 1 -- 172.21.15.2:0/808143773 learned_addr learned my addr 172.21.15.2:0/808143773 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:29.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.657+0000 7efe9d400700 1 --2- 172.21.15.2:0/1667415050 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7efe800a2c20 0x7efe800a50e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efe8c011550 tx=0x7efe8c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:29.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.657+0000 7efe9d400700 1 --2- 172.21.15.2:0/808143773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da11adf0 0x55c7da19e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.657+0000 7efe9ca00700 1 -- 172.21.15.2:0/808143773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da11adf0 msgr2=0x55c7da19e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:29.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.657+0000 7efe9ca00700 1 --2- 172.21.15.2:0/808143773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da11adf0 0x55c7da19e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.657+0000 7efe9ca00700 1 -- 172.21.15.2:0/808143773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da1a92b0 msgr2=0x55c7da1ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:29.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.657+0000 7efe9ca00700 1 --2- 172.21.15.2:0/808143773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da1a92b0 0x55c7da1ab6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.657+0000 7efe9ca00700 1 -- 172.21.15.2:0/808143773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7da098f40 con 0x55c7da19e560 2024-06-13T02:17:29.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.658+0000 7efe9ca00700 1 --2- 172.21.15.2:0/808143773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 0x55c7da19e9e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe840059d0 tx=0x7efe840227e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95574e84d86d262d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:29.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.658+0000 7efe8aa00700 1 -- 172.21.15.2:0/808143773 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8409c150 con 0x55c7da19e560 2024-06-13T02:17:29.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.658+0000 7efe8aa00700 1 -- 172.21.15.2:0/808143773 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe84022470 con 0x55c7da19e560 2024-06-13T02:17:29.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.658+0000 7efe8aa00700 1 -- 172.21.15.2:0/808143773 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe840a53d0 con 0x55c7da19e560 2024-06-13T02:17:29.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.659+0000 7efeaa67fb80 1 -- 172.21.15.2:0/808143773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 msgr2=0x55c7da19e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:29.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.659+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/808143773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 0x55c7da19e9e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe840059d0 tx=0x7efe840227e0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.659+0000 7efeaa67fb80 1 -- 172.21.15.2:0/808143773 shutdown_connections 2024-06-13T02:17:29.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.659+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/808143773 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da1a92b0 0x55c7da1ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.659+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/808143773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da11adf0 0x55c7da19e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.659+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/808143773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 0x55c7da19e9e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.659+0000 7efeaa67fb80 1 -- 172.21.15.2:0/808143773 >> 172.21.15.2:0/808143773 conn(0x55c7da0cb120 msgr2=0x55c7da19a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:29.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.659+0000 7efeaa67fb80 1 -- 172.21.15.2:0/808143773 shutdown_connections 2024-06-13T02:17:29.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.659+0000 7efeaa67fb80 1 -- 172.21.15.2:0/808143773 wait complete. 2024-06-13T02:17:29.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.660+0000 7efeaa67fb80 1 -- start start 2024-06-13T02:17:29.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.660+0000 7efeaa67fb80 1 Processor -- start 2024-06-13T02:17:29.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.660+0000 7efeaa67fb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da11adf0 0x55c7da1a8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.660+0000 7efeaa67fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 0x55c7da1a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.660+0000 7efeaa67fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da1a92b0 0x55c7da1a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.660+0000 7efeaa67fb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c7da08cf10 con 0x55c7da11adf0 2024-06-13T02:17:29.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.660+0000 7efeaa67fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c7da0eca70 con 0x55c7da19e560 2024-06-13T02:17:29.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.660+0000 7efeaa67fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c7da1abd20 con 0x55c7da1a92b0 2024-06-13T02:17:29.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.661+0000 7efeaa67fb80 10 client.0 _ll_register_callbacks cb 0x55c7da08a6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:17:29.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.661+0000 7efe9d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da11adf0 0x55c7da1a8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.661+0000 7efe9d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da11adf0 0x55c7da1a8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40106/0 (socket says 172.21.15.2:40106) 2024-06-13T02:17:29.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.661+0000 7efe9d400700 1 -- 172.21.15.2:0/2479711416 learned_addr learned my addr 172.21.15.2:0/2479711416 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:29.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.661+0000 7efe9ca00700 1 --2- 172.21.15.2:0/2479711416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 0x55c7da1a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.661+0000 7efe9de00700 1 --2- 172.21.15.2:0/2479711416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da1a92b0 0x55c7da1a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.661+0000 7efe9d400700 1 -- 172.21.15.2:0/2479711416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da1a92b0 msgr2=0x55c7da1a62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:29.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.661+0000 7efe9d400700 1 --2- 172.21.15.2:0/2479711416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da1a92b0 0x55c7da1a62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.661+0000 7efe9d400700 1 -- 172.21.15.2:0/2479711416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 msgr2=0x55c7da1a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:29.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.661+0000 7efe9d400700 1 --2- 172.21.15.2:0/2479711416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 0x55c7da1a5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.661+0000 7efe9d400700 1 -- 172.21.15.2:0/2479711416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7da03f880 con 0x55c7da11adf0 2024-06-13T02:17:29.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.661+0000 7efe9ca00700 1 --2- 172.21.15.2:0/2479711416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 0x55c7da1a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:29.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.662+0000 7efe9d400700 1 --2- 172.21.15.2:0/2479711416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da11adf0 0x55c7da1a8a70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efe8c01ed00 tx=0x7efe8c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46ca064bd7cd275 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:29.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.662+0000 7efe7f400700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:17:29.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.662+0000 7efe7f400700 1 -- 172.21.15.2:0/2479711416 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c00ee00 con 0x55c7da11adf0 2024-06-13T02:17:29.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.662+0000 7efe7f400700 1 -- 172.21.15.2:0/2479711416 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7efe8c01e050 con 0x55c7da11adf0 2024-06-13T02:17:29.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.662+0000 7efeaa67fb80 1 -- 172.21.15.2:0/2479711416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c7da0fdfb0 con 0x55c7da11adf0 2024-06-13T02:17:29.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.662+0000 7efe7f400700 1 -- 172.21.15.2:0/2479711416 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efe8c01e250 con 0x55c7da11adf0 2024-06-13T02:17:29.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.662+0000 7efeaa67fb80 10 client.14964 fetch_fsmap learned FSMap version 26 2024-06-13T02:17:29.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.662+0000 7efeaa67fb80 1 -- 172.21.15.2:0/2479711416 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c7da1b6480 con 0x55c7da11adf0 2024-06-13T02:17:29.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.663+0000 7efe7f400700 1 -- 172.21.15.2:0/2479711416 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c7da0fdfb0 con 0x55c7da11adf0 2024-06-13T02:17:29.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.663+0000 7efe7f400700 1 -- 172.21.15.2:0/2479711416 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7efe8c025070 con 0x55c7da11adf0 2024-06-13T02:17:29.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.663+0000 7efeaa67fb80 10 client.14964 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T02:17:29.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.663+0000 7efeaa67fb80 10 client.14964 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-13T02:17:29.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.663+0000 7efeaa67fb80 20 client.14964 populate_metadata read hostname 'smithi002' 2024-06-13T02:17:29.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.663+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/2479711416 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55c7da1b8b20 0x55c7da1b9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.663+0000 7efeaa67fb80 4 client.14964 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:17:29.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.663+0000 7efeaa67fb80 1 -- 172.21.15.2:0/2479711416 --> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7da0f8530 con 0x55c7da1b8b20 2024-06-13T02:17:29.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.663+0000 7efe9ca00700 1 --2- 172.21.15.2:0/2479711416 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55c7da1b8b20 0x55c7da1b9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.664+0000 7efe9ca00700 1 --2- 172.21.15.2:0/2479711416 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55c7da1b8b20 0x55c7da1b9f90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6afbb028b7e75b30 server_cookie=5ee7870f690b60ed in_seq=0 out_seq=0 2024-06-13T02:17:29.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.664+0000 7efe7f400700 10 client.14964 ms_handle_connect on v2:172.21.15.175:6838/2743442301 2024-06-13T02:17:29.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.665+0000 7efe7f400700 1 -- 172.21.15.2:0/2479711416 <== mds.2 v2:172.21.15.175:6838/2743442301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c7da0f8530 con 0x55c7da1b8b20 2024-06-13T02:17:29.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.665+0000 7efe7f400700 10 client.14964 handle_command_reply: tid=0 2024-06-13T02:17:29.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.665+0000 7efeaa67fb80 1 client.14964 shutdown 2024-06-13T02:17:29.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.665+0000 7efeaa67fb80 1 -- 172.21.15.2:0/2479711416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da11adf0 msgr2=0x55c7da1a8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:29.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.665+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/2479711416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da11adf0 0x55c7da1a8a70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efe8c01ed00 tx=0x7efe8c0047c0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.665+0000 7efeaa67fb80 1 -- 172.21.15.2:0/2479711416 shutdown_connections 2024-06-13T02:17:29.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.665+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/2479711416 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55c7da1b8b20 0x55c7da1b9f90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.665+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/2479711416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da1a92b0 0x55c7da1a62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.665+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/2479711416 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da11adf0 0x55c7da1a8a70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.665+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/2479711416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 0x55c7da1a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.665+0000 7efeaa67fb80 1 -- 172.21.15.2:0/2479711416 >> 172.21.15.2:0/2479711416 conn(0x55c7da0cb120 msgr2=0x55c7da1996f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:29.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.665+0000 7efe7f400700 0 client.14964 ms_handle_reset on v2:172.21.15.175:6838/2743442301 2024-06-13T02:17:29.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.666+0000 7efeaa67fb80 1 -- 172.21.15.2:0/2479711416 shutdown_connections 2024-06-13T02:17:29.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.666+0000 7efeaa67fb80 1 -- 172.21.15.2:0/2479711416 wait complete. 2024-06-13T02:17:29.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.666+0000 7efeaa67fb80 20 client.14964 trim_cache size 0 max 16384 2024-06-13T02:17:29.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.689+0000 7efeaa67fb80 1 Processor -- start 2024-06-13T02:17:29.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.689+0000 7efeaa67fb80 1 -- start start 2024-06-13T02:17:29.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.689+0000 7efeaa67fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da11adf0 0x55c7da1aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.689+0000 7efeaa67fb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da19e560 0x55c7da1a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.689+0000 7efeaa67fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da1a92b0 0x55c7da1a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.689+0000 7efeaa67fb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c7da1b82d0 con 0x55c7da19e560 2024-06-13T02:17:29.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.689+0000 7efeaa67fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c7da1b89a0 con 0x55c7da1a92b0 2024-06-13T02:17:29.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.689+0000 7efeaa67fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c7da1b9070 con 0x55c7da11adf0 2024-06-13T02:17:29.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.690+0000 7efe9ca00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da19e560 0x55c7da1a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.690+0000 7efe9ca00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da19e560 0x55c7da1a0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40110/0 (socket says 172.21.15.2:40110) 2024-06-13T02:17:29.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.690+0000 7efe9ca00700 1 -- 172.21.15.2:0/269989222 learned_addr learned my addr 172.21.15.2:0/269989222 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:29.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.690+0000 7efe9d400700 1 --2- 172.21.15.2:0/269989222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da11adf0 0x55c7da1aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.690+0000 7efe9de00700 1 --2- 172.21.15.2:0/269989222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da1a92b0 0x55c7da1a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.690+0000 7efe9ca00700 1 -- 172.21.15.2:0/269989222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da11adf0 msgr2=0x55c7da1aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:29.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.690+0000 7efe9ca00700 1 --2- 172.21.15.2:0/269989222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da11adf0 0x55c7da1aa6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.690+0000 7efe9ca00700 1 -- 172.21.15.2:0/269989222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da1a92b0 msgr2=0x55c7da1a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:29.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.690+0000 7efe9ca00700 1 --2- 172.21.15.2:0/269989222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da1a92b0 0x55c7da1a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.690+0000 7efe9ca00700 1 -- 172.21.15.2:0/269989222 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7da1ab9f0 con 0x55c7da19e560 2024-06-13T02:17:29.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.690+0000 7efe9d400700 1 --2- 172.21.15.2:0/269989222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da11adf0 0x55c7da1aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:29.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.690+0000 7efe9de00700 1 --2- 172.21.15.2:0/269989222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da1a92b0 0x55c7da1a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:29.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.691+0000 7efe9ca00700 1 --2- 172.21.15.2:0/269989222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da19e560 0x55c7da1a0f80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efe84029000 tx=0x7efe84009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5001d6a811615d3a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:29.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.691+0000 7efe8a000700 1 -- 172.21.15.2:0/269989222 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8409cef0 con 0x55c7da19e560 2024-06-13T02:17:29.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.691+0000 7efe8a000700 1 -- 172.21.15.2:0/269989222 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe840a53d0 con 0x55c7da19e560 2024-06-13T02:17:29.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.691+0000 7efe8a000700 1 -- 172.21.15.2:0/269989222 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe840a4f40 con 0x55c7da19e560 2024-06-13T02:17:29.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.692+0000 7efeaa67fb80 1 -- 172.21.15.2:0/269989222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da19e560 msgr2=0x55c7da1a0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:29.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.692+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/269989222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da19e560 0x55c7da1a0f80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efe84029000 tx=0x7efe84009ca0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.692+0000 7efeaa67fb80 1 -- 172.21.15.2:0/269989222 shutdown_connections 2024-06-13T02:17:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.692+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/269989222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da1a92b0 0x55c7da1a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.692+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/269989222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da11adf0 0x55c7da1aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.692+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/269989222 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da19e560 0x55c7da1a0f80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.692+0000 7efeaa67fb80 1 -- 172.21.15.2:0/269989222 >> 172.21.15.2:0/269989222 conn(0x55c7da0cb120 msgr2=0x55c7da1a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.692+0000 7efeaa67fb80 1 -- 172.21.15.2:0/269989222 shutdown_connections 2024-06-13T02:17:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.692+0000 7efeaa67fb80 1 -- 172.21.15.2:0/269989222 wait complete. 2024-06-13T02:17:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.692+0000 7efeaa67fb80 1 -- start start 2024-06-13T02:17:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.693+0000 7efeaa67fb80 1 Processor -- start 2024-06-13T02:17:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.693+0000 7efeaa67fb80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da11adf0 0x55c7da1a9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.693+0000 7efeaa67fb80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 0x55c7da1a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.693+0000 7efeaa67fb80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da1a92b0 0x55c7da1aa510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.693+0000 7efeaa67fb80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c7da1b9e10 con 0x55c7da11adf0 2024-06-13T02:17:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.693+0000 7efeaa67fb80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c7da1b9740 con 0x55c7da19e560 2024-06-13T02:17:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.693+0000 7efeaa67fb80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c7da1ba4e0 con 0x55c7da1a92b0 2024-06-13T02:17:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.693+0000 7efeaa67fb80 10 client.0 _ll_register_callbacks cb 0x55c7da08a6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:17:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.693+0000 7efe9d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da11adf0 0x55c7da1a9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.693+0000 7efe9de00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da1a92b0 0x55c7da1aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.693+0000 7efe9ca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 0x55c7da1a9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.693+0000 7efe9de00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da1a92b0 0x55c7da1aa510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:54250/0 (socket says 172.21.15.2:54250) 2024-06-13T02:17:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.693+0000 7efe9d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da11adf0 0x55c7da1a9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40122/0 (socket says 172.21.15.2:40122) 2024-06-13T02:17:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.693+0000 7efe9de00700 1 -- 172.21.15.2:0/3365720437 learned_addr learned my addr 172.21.15.2:0/3365720437 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.694+0000 7efe9de00700 1 -- 172.21.15.2:0/3365720437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 msgr2=0x55c7da1a9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.694+0000 7efe9de00700 1 --2- 172.21.15.2:0/3365720437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 0x55c7da1a9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.694+0000 7efe9de00700 1 -- 172.21.15.2:0/3365720437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da11adf0 msgr2=0x55c7da1a9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.694+0000 7efe9de00700 1 --2- 172.21.15.2:0/3365720437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da11adf0 0x55c7da1a9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.694+0000 7efe9de00700 1 -- 172.21.15.2:0/3365720437 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7da1c2540 con 0x55c7da1a92b0 2024-06-13T02:17:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.694+0000 7efe9de00700 1 --2- 172.21.15.2:0/3365720437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da1a92b0 0x55c7da1aa510 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efe9000eea0 tx=0x7efe900077e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9ecd3134e7a77fb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.694+0000 7efe7f400700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:17:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.694+0000 7efe7f400700 1 -- 172.21.15.2:0/3365720437 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe90016610 con 0x55c7da1a92b0 2024-06-13T02:17:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.694+0000 7efeaa67fb80 1 -- 172.21.15.2:0/3365720437 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe840a53d0 con 0x55c7da1a92b0 2024-06-13T02:17:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.695+0000 7efe7f400700 1 -- 172.21.15.2:0/3365720437 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7efe900167b0 con 0x55c7da1a92b0 2024-06-13T02:17:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.695+0000 7efe7f400700 1 -- 172.21.15.2:0/3365720437 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efe900169f0 con 0x55c7da1a92b0 2024-06-13T02:17:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.695+0000 7efeaa67fb80 10 client.25069 fetch_fsmap learned FSMap version 26 2024-06-13T02:17:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.695+0000 7efeaa67fb80 1 -- 172.21.15.2:0/3365720437 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c7da1c38d0 con 0x55c7da1a92b0 2024-06-13T02:17:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.695+0000 7efe7f400700 1 -- 172.21.15.2:0/3365720437 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe840a53d0 con 0x55c7da1a92b0 2024-06-13T02:17:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.695+0000 7efe7f400700 1 -- 172.21.15.2:0/3365720437 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7efe900203c0 con 0x55c7da1a92b0 2024-06-13T02:17:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.695+0000 7efeaa67fb80 10 client.25069 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T02:17:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.695+0000 7efeaa67fb80 10 client.25069 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-13T02:17:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.695+0000 7efeaa67fb80 20 client.25069 populate_metadata read hostname 'smithi002' 2024-06-13T02:17:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.695+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/3365720437 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55c7da228690 0x55c7da2273a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.695+0000 7efeaa67fb80 4 client.25069 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T02:17:29.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.695+0000 7efeaa67fb80 1 -- 172.21.15.2:0/3365720437 --> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] -- command(tid 0: {"prefix": "status"}) -- 0x55c7d9f72200 con 0x55c7da228690 2024-06-13T02:17:29.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.696+0000 7efe9d400700 1 --2- 172.21.15.2:0/3365720437 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55c7da228690 0x55c7da2273a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:29.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.697+0000 7efe9d400700 1 --2- 172.21.15.2:0/3365720437 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55c7da228690 0x55c7da2273a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=24c14154044b8748 server_cookie=a63994490388efcc in_seq=0 out_seq=0 2024-06-13T02:17:29.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.697+0000 7efe7f400700 10 client.25069 ms_handle_connect on v2:172.21.15.175:6838/2743442301 2024-06-13T02:17:29.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.697+0000 7efe7f400700 1 -- 172.21.15.2:0/3365720437 <== mds.2 v2:172.21.15.175:6838/2743442301 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55c7d9f72200 con 0x55c7da228690 2024-06-13T02:17:29.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.697+0000 7efe7f400700 10 client.25069 handle_command_reply: tid=0 2024-06-13T02:17:29.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.697+0000 7efeaa67fb80 1 client.25069 shutdown 2024-06-13T02:17:29.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.697+0000 7efeaa67fb80 1 -- 172.21.15.2:0/3365720437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da1a92b0 msgr2=0x55c7da1aa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:29.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.697+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/3365720437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da1a92b0 0x55c7da1aa510 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efe9000eea0 tx=0x7efe900077e0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.698+0000 7efeaa67fb80 1 -- 172.21.15.2:0/3365720437 shutdown_connections 2024-06-13T02:17:29.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.698+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/3365720437 >> [v2:172.21.15.175:6838/2743442301,v1:172.21.15.175:6839/2743442301] conn(0x55c7da228690 0x55c7da2273a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.698+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/3365720437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c7da1a92b0 0x55c7da1aa510 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.698+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/3365720437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c7da11adf0 0x55c7da1a9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.698+0000 7efeaa67fb80 1 --2- 172.21.15.2:0/3365720437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c7da19e560 0x55c7da1a9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.698+0000 7efe7f400700 0 client.25069 ms_handle_reset on v2:172.21.15.175:6838/2743442301 2024-06-13T02:17:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.698+0000 7efeaa67fb80 1 -- 172.21.15.2:0/3365720437 >> 172.21.15.2:0/3365720437 conn(0x55c7da0cb120 msgr2=0x55c7da1a7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.698+0000 7efeaa67fb80 1 -- 172.21.15.2:0/3365720437 shutdown_connections 2024-06-13T02:17:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.698+0000 7efeaa67fb80 1 -- 172.21.15.2:0/3365720437 wait complete. 2024-06-13T02:17:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.698+0000 7efeaa67fb80 20 client.25069 trim_cache size 0 max 16384 2024-06-13T02:17:29.703 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T02:17:29.703 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "efed8ab4-2928-11ef-bc9c-c7b262605968", 2024-06-13T02:17:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 2, 2024-06-13T02:17:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24490, 2024-06-13T02:17:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-06-13T02:17:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-06-13T02:17:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-06-13T02:17:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 204.118633475, 2024-06-13T02:17:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 26, 2024-06-13T02:17:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 100, 2024-06-13T02:17:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 98, 2024-06-13T02:17:29.704 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 321.72068029000002 2024-06-13T02:17:29.704 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T02:17:29.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.699+0000 7efe9fe00700 1 -- 172.21.15.2:0/1667415050 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7efe800a2c20 msgr2=0x7efe800a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:29.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.699+0000 7efe9fe00700 1 --2- 172.21.15.2:0/1667415050 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7efe800a2c20 0x7efe800a50e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efe8c011550 tx=0x7efe8c009260 comp rx=0 tx=0).stop 2024-06-13T02:17:29.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.699+0000 7efe9fe00700 1 -- 172.21.15.2:0/1667415050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe98109480 msgr2=0x7efe9819f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:29.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.699+0000 7efe9fe00700 1 --2- 172.21.15.2:0/1667415050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe98109480 0x7efe9819f7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efe84006010 tx=0x7efe8400bab0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.699+0000 7efe9fe00700 1 -- 172.21.15.2:0/1667415050 shutdown_connections 2024-06-13T02:17:29.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.699+0000 7efe9fe00700 1 --2- 172.21.15.2:0/1667415050 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7efe800a2c20 0x7efe800a50e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.699+0000 7efe9fe00700 1 --2- 172.21.15.2:0/1667415050 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe9810eac0 0x7efe981a3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.699+0000 7efe9fe00700 1 --2- 172.21.15.2:0/1667415050 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe98108ac0 0x7efe9819f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.699+0000 7efe9fe00700 1 --2- 172.21.15.2:0/1667415050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe98109480 0x7efe9819f7a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:29.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.699+0000 7efe9fe00700 1 -- 172.21.15.2:0/1667415050 >> 172.21.15.2:0/1667415050 conn(0x7efe98075c60 msgr2=0x7efe98076220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:29.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.699+0000 7efe9fe00700 1 -- 172.21.15.2:0/1667415050 shutdown_connections 2024-06-13T02:17:29.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:29.699+0000 7efe9fe00700 1 -- 172.21.15.2:0/1667415050 wait complete. 2024-06-13T02:17:30.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:29 smithi084 ceph-mon[36833]: pgmap v482: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:17:30.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:29 smithi175 ceph-mon[36977]: pgmap v482: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:17:30.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:29 smithi002 ceph-mon[31960]: pgmap v482: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:17:30.726 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell mds.g status 2024-06-13T02:17:31.215 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:17:32.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:31 smithi002 ceph-mon[31960]: pgmap v483: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:17:32.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:31 smithi084 ceph-mon[36833]: pgmap v483: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:17:32.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:31 smithi175 ceph-mon[36977]: pgmap v483: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:17:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.644+0000 7fc47be00700 1 -- 172.21.15.2:0/783916735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4740746c0 msgr2=0x7fc474074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.644+0000 7fc47be00700 1 --2- 172.21.15.2:0/783916735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4740746c0 0x7fc474074aa0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc468009990 tx=0x7fc468009ca0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.644+0000 7fc47be00700 1 -- 172.21.15.2:0/783916735 shutdown_connections 2024-06-13T02:17:33.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.644+0000 7fc47be00700 1 --2- 172.21.15.2:0/783916735 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc47410ee90 0x7fc474111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.644+0000 7fc47be00700 1 --2- 172.21.15.2:0/783916735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc4740746c0 0x7fc474074aa0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.644+0000 7fc47be00700 1 --2- 172.21.15.2:0/783916735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc474074fe0 0x7fc47410e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.644+0000 7fc47be00700 1 -- 172.21.15.2:0/783916735 >> 172.21.15.2:0/783916735 conn(0x7fc474079530 msgr2=0x7fc474079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.644+0000 7fc47be00700 1 -- 172.21.15.2:0/783916735 shutdown_connections 2024-06-13T02:17:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.644+0000 7fc47be00700 1 -- 172.21.15.2:0/783916735 wait complete. 2024-06-13T02:17:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.646+0000 7fc47be00700 1 Processor -- start 2024-06-13T02:17:33.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.646+0000 7fc47be00700 1 -- start start 2024-06-13T02:17:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.647+0000 7fc47be00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4740746c0 0x7fc47419aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.647+0000 7fc47be00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc474074fe0 0x7fc47419b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.647+0000 7fc47be00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47410ee90 0x7fc47419f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.647+0000 7fc47be00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc4741149a0 con 0x7fc4740746c0 2024-06-13T02:17:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.647+0000 7fc47be00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc474114820 con 0x7fc47410ee90 2024-06-13T02:17:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.647+0000 7fc47be00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc474114b20 con 0x7fc474074fe0 2024-06-13T02:17:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.647+0000 7fc479400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4740746c0 0x7fc47419aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.647+0000 7fc479400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4740746c0 0x7fc47419aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36816/0 (socket says 172.21.15.2:36816) 2024-06-13T02:17:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.647+0000 7fc479400700 1 -- 172.21.15.2:0/646144103 learned_addr learned my addr 172.21.15.2:0/646144103 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:33.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.647+0000 7fc478a00700 1 --2- 172.21.15.2:0/646144103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc474074fe0 0x7fc47419b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.647+0000 7fc479e00700 1 --2- 172.21.15.2:0/646144103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47410ee90 0x7fc47419f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.648+0000 7fc479400700 1 -- 172.21.15.2:0/646144103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc474074fe0 msgr2=0x7fc47419b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.648+0000 7fc479400700 1 --2- 172.21.15.2:0/646144103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc474074fe0 0x7fc47419b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.648+0000 7fc479400700 1 -- 172.21.15.2:0/646144103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47410ee90 msgr2=0x7fc47419f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.648+0000 7fc479400700 1 --2- 172.21.15.2:0/646144103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47410ee90 0x7fc47419f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.648+0000 7fc479400700 1 -- 172.21.15.2:0/646144103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47419fe20 con 0x7fc4740746c0 2024-06-13T02:17:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.648+0000 7fc479e00700 1 --2- 172.21.15.2:0/646144103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47410ee90 0x7fc47419f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.648+0000 7fc479400700 1 --2- 172.21.15.2:0/646144103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4740746c0 0x7fc47419aeb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc46800bae0 tx=0x7fc46800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.649+0000 7fc472000700 1 -- 172.21.15.2:0/646144103 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc468026070 con 0x7fc4740746c0 2024-06-13T02:17:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.649+0000 7fc472000700 1 -- 172.21.15.2:0/646144103 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc468003d70 con 0x7fc4740746c0 2024-06-13T02:17:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.649+0000 7fc472000700 1 -- 172.21.15.2:0/646144103 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc468021410 con 0x7fc4740746c0 2024-06-13T02:17:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.649+0000 7fc47be00700 1 -- 172.21.15.2:0/646144103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4741a00b0 con 0x7fc4740746c0 2024-06-13T02:17:33.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.649+0000 7fc47be00700 1 -- 172.21.15.2:0/646144103 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4741a7990 con 0x7fc4740746c0 2024-06-13T02:17:33.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.652+0000 7fc472000700 1 -- 172.21.15.2:0/646144103 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7fc468029070 con 0x7fc4740746c0 2024-06-13T02:17:33.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.654+0000 7fc486872b80 1 Processor -- start 2024-06-13T02:17:33.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.655+0000 7fc486872b80 1 -- start start 2024-06-13T02:17:33.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.655+0000 7fc472000700 1 --2- 172.21.15.2:0/646144103 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc45c0a2ca0 0x7fc45c0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.655+0000 7fc486872b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x56356474f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.655+0000 7fc486872b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356474f560 0x56356474f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.655+0000 7fc486872b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356475a2b0 0x56356475c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.655+0000 7fc472000700 1 -- 172.21.15.2:0/646144103 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fc4680d0460 con 0x7fc4740746c0 2024-06-13T02:17:33.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.655+0000 7fc486872b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56356465e9c0 con 0x56356475a2b0 2024-06-13T02:17:33.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.655+0000 7fc486872b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5635646a1ab0 con 0x5635646cbdf0 2024-06-13T02:17:33.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.655+0000 7fc486872b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56356465c8a0 con 0x56356474f560 2024-06-13T02:17:33.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.655+0000 7fc479e00700 1 --2- 172.21.15.2:0/646144103 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc45c0a2ca0 0x7fc45c0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.656+0000 7fc478a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356474f560 0x56356474f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.656+0000 7fc478a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356474f560 0x56356474f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:50286/0 (socket says 172.21.15.2:50286) 2024-06-13T02:17:33.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.656+0000 7fc478a00700 1 -- 172.21.15.2:0/567650557 learned_addr learned my addr 172.21.15.2:0/567650557 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:33.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.656+0000 7fc479e00700 1 --2- 172.21.15.2:0/567650557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356475a2b0 0x56356475c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.656+0000 7fc479400700 1 --2- 172.21.15.2:0/567650557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x56356474f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.656+0000 7fc478a00700 1 -- 172.21.15.2:0/567650557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 msgr2=0x56356474f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.656+0000 7fc478a00700 1 --2- 172.21.15.2:0/567650557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x56356474f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.656+0000 7fc478a00700 1 -- 172.21.15.2:0/567650557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356475a2b0 msgr2=0x56356475c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.656+0000 7fc478a00700 1 --2- 172.21.15.2:0/567650557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356475a2b0 0x56356475c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.656+0000 7fc478a00700 1 -- 172.21.15.2:0/567650557 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563564649f40 con 0x56356474f560 2024-06-13T02:17:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.657+0000 7fc478a00700 1 --2- 172.21.15.2:0/567650557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356474f560 0x56356474f9e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc460009d30 tx=0x7fc460011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87276c8f3df4e483 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.657+0000 7fc479e00700 1 --2- 172.21.15.2:0/646144103 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc45c0a2ca0 0x7fc45c0a5160 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009fd0 tx=0x7fc46c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.657+0000 7fc466a00700 1 -- 172.21.15.2:0/567650557 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46001e070 con 0x56356474f560 2024-06-13T02:17:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.657+0000 7fc466a00700 1 -- 172.21.15.2:0/567650557 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc460019b10 con 0x56356474f560 2024-06-13T02:17:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.657+0000 7fc466a00700 1 -- 172.21.15.2:0/567650557 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46000eac0 con 0x56356474f560 2024-06-13T02:17:33.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.658+0000 7fc486872b80 1 -- 172.21.15.2:0/567650557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356474f560 msgr2=0x56356474f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.658+0000 7fc486872b80 1 --2- 172.21.15.2:0/567650557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356474f560 0x56356474f9e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc460009d30 tx=0x7fc460011720 comp rx=0 tx=0).stop 2024-06-13T02:17:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.658+0000 7fc486872b80 1 -- 172.21.15.2:0/567650557 shutdown_connections 2024-06-13T02:17:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.658+0000 7fc486872b80 1 --2- 172.21.15.2:0/567650557 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356475a2b0 0x56356475c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.658+0000 7fc486872b80 1 --2- 172.21.15.2:0/567650557 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x56356474f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.658+0000 7fc486872b80 1 --2- 172.21.15.2:0/567650557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356474f560 0x56356474f9e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.658+0000 7fc486872b80 1 -- 172.21.15.2:0/567650557 >> 172.21.15.2:0/567650557 conn(0x56356467c120 msgr2=0x56356474b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.658+0000 7fc486872b80 1 -- 172.21.15.2:0/567650557 shutdown_connections 2024-06-13T02:17:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.658+0000 7fc486872b80 1 -- 172.21.15.2:0/567650557 wait complete. 2024-06-13T02:17:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.659+0000 7fc486872b80 1 -- start start 2024-06-13T02:17:33.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.659+0000 7fc486872b80 1 Processor -- start 2024-06-13T02:17:33.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.659+0000 7fc486872b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x5635647599c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.659+0000 7fc486872b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 0x563564756cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.659+0000 7fc486872b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356475a2b0 0x563564757200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.659+0000 7fc486872b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56356463df10 con 0x56356474f560 2024-06-13T02:17:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.659+0000 7fc486872b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56356469da70 con 0x5635646cbdf0 2024-06-13T02:17:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.659+0000 7fc486872b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56356475cf70 con 0x56356475a2b0 2024-06-13T02:17:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.659+0000 7fc486872b80 10 client.0 _ll_register_callbacks cb 0x56356463b6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:17:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.660+0000 7fc478a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 0x563564756cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.660+0000 7fc478a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 0x563564756cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36830/0 (socket says 172.21.15.2:36830) 2024-06-13T02:17:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.660+0000 7fc479e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356475a2b0 0x563564757200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.660+0000 7fc478a00700 1 -- 172.21.15.2:0/3612272027 learned_addr learned my addr 172.21.15.2:0/3612272027 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:33.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.660+0000 7fc479400700 1 --2- 172.21.15.2:0/3612272027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x5635647599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.660+0000 7fc478a00700 1 -- 172.21.15.2:0/3612272027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356475a2b0 msgr2=0x563564757200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.660+0000 7fc478a00700 1 --2- 172.21.15.2:0/3612272027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356475a2b0 0x563564757200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.660+0000 7fc478a00700 1 -- 172.21.15.2:0/3612272027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 msgr2=0x5635647599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.660+0000 7fc478a00700 1 --2- 172.21.15.2:0/3612272027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x5635647599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.660+0000 7fc478a00700 1 -- 172.21.15.2:0/3612272027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635645f0880 con 0x56356474f560 2024-06-13T02:17:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.660+0000 7fc479e00700 1 --2- 172.21.15.2:0/3612272027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356475a2b0 0x563564757200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.660+0000 7fc479400700 1 --2- 172.21.15.2:0/3612272027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x5635647599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.661+0000 7fc478a00700 1 --2- 172.21.15.2:0/3612272027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 0x563564756cc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc460009230 tx=0x7fc460005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1848700f16486be5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.661+0000 7fc45b400700 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:17:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.661+0000 7fc45b400700 1 -- 172.21.15.2:0/3612272027 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460027030 con 0x56356474f560 2024-06-13T02:17:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.661+0000 7fc45b400700 1 -- 172.21.15.2:0/3612272027 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fc460019740 con 0x56356474f560 2024-06-13T02:17:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.661+0000 7fc486872b80 1 -- 172.21.15.2:0/3612272027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc460019b10 con 0x56356474f560 2024-06-13T02:17:33.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.661+0000 7fc45b400700 1 -- 172.21.15.2:0/3612272027 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc460031050 con 0x56356474f560 2024-06-13T02:17:33.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.661+0000 7fc486872b80 10 client.14982 fetch_fsmap learned FSMap version 26 2024-06-13T02:17:33.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.661+0000 7fc486872b80 1 -- 172.21.15.2:0/3612272027 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563564767630 con 0x56356474f560 2024-06-13T02:17:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.662+0000 7fc45b400700 1 -- 172.21.15.2:0/3612272027 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc460019b10 con 0x56356474f560 2024-06-13T02:17:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.662+0000 7fc45b400700 1 -- 172.21.15.2:0/3612272027 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc460004c70 con 0x56356474f560 2024-06-13T02:17:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.662+0000 7fc486872b80 10 client.14982 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T02:17:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.662+0000 7fc486872b80 10 client.14982 resolve_mds: resolved name 'g' to daemon mds.g 2024-06-13T02:17:33.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.662+0000 7fc486872b80 20 client.14982 populate_metadata read hostname 'smithi002' 2024-06-13T02:17:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.662+0000 7fc486872b80 1 --2- 172.21.15.2:0/3612272027 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x563564769990 0x56356476ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.662+0000 7fc486872b80 4 client.14982 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:17:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.662+0000 7fc486872b80 1 -- 172.21.15.2:0/3612272027 --> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635646aefb0 con 0x563564769990 2024-06-13T02:17:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.662+0000 7fc479400700 1 --2- 172.21.15.2:0/3612272027 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x563564769990 0x56356476ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.663+0000 7fc479400700 1 --2- 172.21.15.2:0/3612272027 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x563564769990 0x56356476ae00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f74fb57046e6d3d6 server_cookie=63bd0f88939b0582 in_seq=0 out_seq=0 2024-06-13T02:17:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.663+0000 7fc45b400700 10 client.14982 ms_handle_connect on v2:172.21.15.2:6838/3208917373 2024-06-13T02:17:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.664+0000 7fc45b400700 1 -- 172.21.15.2:0/3612272027 <== mds.1 v2:172.21.15.2:6838/3208917373 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5635646aefb0 con 0x563564769990 2024-06-13T02:17:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.664+0000 7fc45b400700 10 client.14982 handle_command_reply: tid=0 2024-06-13T02:17:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.664+0000 7fc486872b80 1 client.14982 shutdown 2024-06-13T02:17:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.664+0000 7fc486872b80 1 -- 172.21.15.2:0/3612272027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 msgr2=0x563564756cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.664+0000 7fc486872b80 1 --2- 172.21.15.2:0/3612272027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 0x563564756cc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc460009230 tx=0x7fc460005e40 comp rx=0 tx=0).stop 2024-06-13T02:17:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.664+0000 7fc486872b80 1 -- 172.21.15.2:0/3612272027 shutdown_connections 2024-06-13T02:17:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.664+0000 7fc486872b80 1 --2- 172.21.15.2:0/3612272027 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x563564769990 0x56356476ae00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.664+0000 7fc486872b80 1 --2- 172.21.15.2:0/3612272027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356475a2b0 0x563564757200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.664+0000 7fc486872b80 1 --2- 172.21.15.2:0/3612272027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x5635647599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.664+0000 7fc486872b80 1 --2- 172.21.15.2:0/3612272027 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 0x563564756cc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.664+0000 7fc486872b80 1 -- 172.21.15.2:0/3612272027 >> 172.21.15.2:0/3612272027 conn(0x56356467c120 msgr2=0x56356474a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.664+0000 7fc45b400700 0 client.14982 ms_handle_reset on v2:172.21.15.2:6838/3208917373 2024-06-13T02:17:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.665+0000 7fc486872b80 1 -- 172.21.15.2:0/3612272027 shutdown_connections 2024-06-13T02:17:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.665+0000 7fc486872b80 1 -- 172.21.15.2:0/3612272027 wait complete. 2024-06-13T02:17:33.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.665+0000 7fc486872b80 20 client.14982 trim_cache size 0 max 16384 2024-06-13T02:17:33.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.688+0000 7fc486872b80 1 Processor -- start 2024-06-13T02:17:33.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.689+0000 7fc486872b80 1 -- start start 2024-06-13T02:17:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.689+0000 7fc486872b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356467c120 0x56356475b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.689+0000 7fc486872b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x56356474af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.689+0000 7fc486872b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 0x56356474b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.689+0000 7fc486872b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563564769140 con 0x56356474f560 2024-06-13T02:17:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.689+0000 7fc486872b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563564769810 con 0x5635646cbdf0 2024-06-13T02:17:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.689+0000 7fc486872b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563564769ee0 con 0x56356467c120 2024-06-13T02:17:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.689+0000 7fc479400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356467c120 0x56356475b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.689+0000 7fc479400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356467c120 0x56356475b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:50306/0 (socket says 172.21.15.2:50306) 2024-06-13T02:17:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.689+0000 7fc479400700 1 -- 172.21.15.2:0/1707291334 learned_addr learned my addr 172.21.15.2:0/1707291334 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:33.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.689+0000 7fc479e00700 1 --2- 172.21.15.2:0/1707291334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 0x56356474b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.690+0000 7fc478a00700 1 --2- 172.21.15.2:0/1707291334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x56356474af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.690+0000 7fc479400700 1 -- 172.21.15.2:0/1707291334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 msgr2=0x56356474af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:33.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.690+0000 7fc479400700 1 --2- 172.21.15.2:0/1707291334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x56356474af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.690+0000 7fc479400700 1 -- 172.21.15.2:0/1707291334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 msgr2=0x56356474b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:33.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.690+0000 7fc479400700 1 --2- 172.21.15.2:0/1707291334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 0x56356474b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.690+0000 7fc479400700 1 -- 172.21.15.2:0/1707291334 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563564742dc0 con 0x56356467c120 2024-06-13T02:17:33.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.690+0000 7fc479400700 1 --2- 172.21.15.2:0/1707291334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356467c120 0x56356475b6a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc468005d90 tx=0x7fc468087040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5b6ee4da2d65914 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:33.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.691+0000 7fc466000700 1 -- 172.21.15.2:0/1707291334 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46809c4a0 con 0x56356467c120 2024-06-13T02:17:33.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.691+0000 7fc466000700 1 -- 172.21.15.2:0/1707291334 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc46809d060 con 0x56356467c120 2024-06-13T02:17:33.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.691+0000 7fc466000700 1 -- 172.21.15.2:0/1707291334 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46809c2c0 con 0x56356467c120 2024-06-13T02:17:33.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.691+0000 7fc486872b80 1 -- 172.21.15.2:0/1707291334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356467c120 msgr2=0x56356475b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:33.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.691+0000 7fc486872b80 1 --2- 172.21.15.2:0/1707291334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356467c120 0x56356475b6a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc468005d90 tx=0x7fc468087040 comp rx=0 tx=0).stop 2024-06-13T02:17:33.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.692+0000 7fc486872b80 1 -- 172.21.15.2:0/1707291334 shutdown_connections 2024-06-13T02:17:33.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.692+0000 7fc486872b80 1 --2- 172.21.15.2:0/1707291334 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 0x56356474b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.692+0000 7fc486872b80 1 --2- 172.21.15.2:0/1707291334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356467c120 0x56356475b6a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.692+0000 7fc486872b80 1 --2- 172.21.15.2:0/1707291334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x56356474af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.692+0000 7fc486872b80 1 -- 172.21.15.2:0/1707291334 >> 172.21.15.2:0/1707291334 conn(0x5635647474b0 msgr2=0x563564752250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.692+0000 7fc486872b80 1 -- 172.21.15.2:0/1707291334 shutdown_connections 2024-06-13T02:17:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.692+0000 7fc486872b80 1 -- 172.21.15.2:0/1707291334 wait complete. 2024-06-13T02:17:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.692+0000 7fc486872b80 1 -- start start 2024-06-13T02:17:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.692+0000 7fc486872b80 1 Processor -- start 2024-06-13T02:17:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.693+0000 7fc486872b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356467c120 0x563564753050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.693+0000 7fc486872b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x563564753590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.693+0000 7fc486872b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 0x563564753ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.693+0000 7fc486872b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56356476ac80 con 0x56356474f560 2024-06-13T02:17:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.693+0000 7fc486872b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56356476a5b0 con 0x5635646cbdf0 2024-06-13T02:17:33.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.693+0000 7fc486872b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56356476b350 con 0x56356467c120 2024-06-13T02:17:33.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.693+0000 7fc486872b80 10 client.0 _ll_register_callbacks cb 0x56356463b6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:17:33.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.693+0000 7fc479e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 0x563564753ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.693+0000 7fc479400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356467c120 0x563564753050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.693+0000 7fc479e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 0x563564753ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36840/0 (socket says 172.21.15.2:36840) 2024-06-13T02:17:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.693+0000 7fc478a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x563564753590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.693+0000 7fc479e00700 1 -- 172.21.15.2:0/4191469040 learned_addr learned my addr 172.21.15.2:0/4191469040 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.694+0000 7fc478a00700 1 -- 172.21.15.2:0/4191469040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356467c120 msgr2=0x563564753050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.694+0000 7fc478a00700 1 --2- 172.21.15.2:0/4191469040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356467c120 0x563564753050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.694+0000 7fc478a00700 1 -- 172.21.15.2:0/4191469040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 msgr2=0x563564753ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.694+0000 7fc478a00700 1 --2- 172.21.15.2:0/4191469040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 0x563564753ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.694+0000 7fc478a00700 1 -- 172.21.15.2:0/4191469040 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635647733b0 con 0x5635646cbdf0 2024-06-13T02:17:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.694+0000 7fc478a00700 1 --2- 172.21.15.2:0/4191469040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x563564753590 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc46000e900 tx=0x7fc460005d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=944d8468892c235f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.694+0000 7fc45b400700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:17:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.694+0000 7fc45b400700 1 -- 172.21.15.2:0/4191469040 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460027040 con 0x5635646cbdf0 2024-06-13T02:17:33.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.694+0000 7fc486872b80 1 -- 172.21.15.2:0/4191469040 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc46809d060 con 0x5635646cbdf0 2024-06-13T02:17:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.694+0000 7fc45b400700 1 -- 172.21.15.2:0/4191469040 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fc46000eb80 con 0x5635646cbdf0 2024-06-13T02:17:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.695+0000 7fc45b400700 1 -- 172.21.15.2:0/4191469040 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc46003c050 con 0x5635646cbdf0 2024-06-13T02:17:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.695+0000 7fc486872b80 10 client.25103 fetch_fsmap learned FSMap version 26 2024-06-13T02:17:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.695+0000 7fc486872b80 1 -- 172.21.15.2:0/4191469040 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5635647746b0 con 0x5635646cbdf0 2024-06-13T02:17:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.695+0000 7fc45b400700 1 -- 172.21.15.2:0/4191469040 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc46809d060 con 0x5635646cbdf0 2024-06-13T02:17:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.695+0000 7fc45b400700 1 -- 172.21.15.2:0/4191469040 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fc460003680 con 0x5635646cbdf0 2024-06-13T02:17:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.695+0000 7fc486872b80 10 client.25103 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T02:17:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.695+0000 7fc486872b80 10 client.25103 resolve_mds: resolved name 'g' to daemon mds.g 2024-06-13T02:17:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.695+0000 7fc486872b80 20 client.25103 populate_metadata read hostname 'smithi002' 2024-06-13T02:17:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.695+0000 7fc486872b80 1 --2- 172.21.15.2:0/4191469040 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x56356475a2b0 0x5635647d8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.695+0000 7fc486872b80 4 client.25103 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T02:17:33.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.695+0000 7fc486872b80 1 -- 172.21.15.2:0/4191469040 --> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] -- command(tid 0: {"prefix": "status"}) -- 0x5635646a9530 con 0x56356475a2b0 2024-06-13T02:17:33.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.696+0000 7fc479400700 1 --2- 172.21.15.2:0/4191469040 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x56356475a2b0 0x5635647d8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:33.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.696+0000 7fc479400700 1 --2- 172.21.15.2:0/4191469040 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x56356475a2b0 0x5635647d8070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f2eef5e880ecda08 server_cookie=a6dc6f3088a0adde in_seq=0 out_seq=0 2024-06-13T02:17:33.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.696+0000 7fc45b400700 10 client.25103 ms_handle_connect on v2:172.21.15.2:6838/3208917373 2024-06-13T02:17:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.697+0000 7fc45b400700 1 -- 172.21.15.2:0/4191469040 <== mds.1 v2:172.21.15.2:6838/3208917373 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x5635646a9530 con 0x56356475a2b0 2024-06-13T02:17:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.697+0000 7fc45b400700 10 client.25103 handle_command_reply: tid=0 2024-06-13T02:17:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.697+0000 7fc486872b80 1 client.25103 shutdown 2024-06-13T02:17:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.697+0000 7fc486872b80 1 -- 172.21.15.2:0/4191469040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 msgr2=0x563564753590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.697+0000 7fc486872b80 1 --2- 172.21.15.2:0/4191469040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x563564753590 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc46000e900 tx=0x7fc460005d20 comp rx=0 tx=0).stop 2024-06-13T02:17:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.697+0000 7fc486872b80 1 -- 172.21.15.2:0/4191469040 shutdown_connections 2024-06-13T02:17:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.697+0000 7fc486872b80 1 --2- 172.21.15.2:0/4191469040 >> [v2:172.21.15.2:6838/3208917373,v1:172.21.15.2:6839/3208917373] conn(0x56356475a2b0 0x5635647d8070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.697+0000 7fc486872b80 1 --2- 172.21.15.2:0/4191469040 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56356474f560 0x563564753ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.697+0000 7fc486872b80 1 --2- 172.21.15.2:0/4191469040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56356467c120 0x563564753050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.697+0000 7fc486872b80 1 --2- 172.21.15.2:0/4191469040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5635646cbdf0 0x563564753590 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.697+0000 7fc45b400700 0 client.25103 ms_handle_reset on v2:172.21.15.2:6838/3208917373 2024-06-13T02:17:33.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.697+0000 7fc486872b80 1 -- 172.21.15.2:0/4191469040 >> 172.21.15.2:0/4191469040 conn(0x5635647474b0 msgr2=0x5635647584f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:33.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.697+0000 7fc486872b80 1 -- 172.21.15.2:0/4191469040 shutdown_connections 2024-06-13T02:17:33.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.697+0000 7fc486872b80 1 -- 172.21.15.2:0/4191469040 wait complete. 2024-06-13T02:17:33.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.697+0000 7fc486872b80 20 client.25103 trim_cache size 0 max 16384 2024-06-13T02:17:33.702 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T02:17:33.702 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "efed8ab4-2928-11ef-bc9c-c7b262605968", 2024-06-13T02:17:33.702 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 1, 2024-06-13T02:17:33.702 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24503, 2024-06-13T02:17:33.703 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-06-13T02:17:33.703 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-06-13T02:17:33.703 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-06-13T02:17:33.703 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 209.128693285, 2024-06-13T02:17:33.703 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 26, 2024-06-13T02:17:33.703 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 100, 2024-06-13T02:17:33.703 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 98, 2024-06-13T02:17:33.703 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 320.85320378500001 2024-06-13T02:17:33.703 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T02:17:33.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.698+0000 7fc47be00700 1 -- 172.21.15.2:0/646144103 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc45c0a2ca0 msgr2=0x7fc45c0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:33.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.698+0000 7fc47be00700 1 --2- 172.21.15.2:0/646144103 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc45c0a2ca0 0x7fc45c0a5160 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009fd0 tx=0x7fc46c009310 comp rx=0 tx=0).stop 2024-06-13T02:17:33.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.698+0000 7fc47be00700 1 -- 172.21.15.2:0/646144103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4740746c0 msgr2=0x7fc47419aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:33.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.698+0000 7fc47be00700 1 --2- 172.21.15.2:0/646144103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4740746c0 0x7fc47419aeb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc46800bae0 tx=0x7fc46800bb10 comp rx=0 tx=0).stop 2024-06-13T02:17:33.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.698+0000 7fc47be00700 1 -- 172.21.15.2:0/646144103 shutdown_connections 2024-06-13T02:17:33.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.698+0000 7fc47be00700 1 --2- 172.21.15.2:0/646144103 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fc45c0a2ca0 0x7fc45c0a5160 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.698+0000 7fc47be00700 1 --2- 172.21.15.2:0/646144103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc47410ee90 0x7fc47419f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.698+0000 7fc47be00700 1 --2- 172.21.15.2:0/646144103 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc4740746c0 0x7fc47419aeb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.698+0000 7fc47be00700 1 --2- 172.21.15.2:0/646144103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc474074fe0 0x7fc47419b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:33.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.698+0000 7fc47be00700 1 -- 172.21.15.2:0/646144103 >> 172.21.15.2:0/646144103 conn(0x7fc474079530 msgr2=0x7fc4740ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:33.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.698+0000 7fc47be00700 1 -- 172.21.15.2:0/646144103 shutdown_connections 2024-06-13T02:17:33.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:33.698+0000 7fc47be00700 1 -- 172.21.15.2:0/646144103 wait complete. 2024-06-13T02:17:34.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:33 smithi002 ceph-mon[31960]: pgmap v484: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:17:34.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:33 smithi084 ceph-mon[36833]: pgmap v484: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:17:34.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:33 smithi175 ceph-mon[36977]: pgmap v484: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-13T02:17:34.797 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph tell mds.b status 2024-06-13T02:17:35.265 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:17:36.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:35 smithi002 ceph-mon[31960]: pgmap v485: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:17:36.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:35 smithi084 ceph-mon[36833]: pgmap v485: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:17:36.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:35 smithi175 ceph-mon[36977]: pgmap v485: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-06-13T02:17:37.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.646+0000 7f93dc800700 1 -- 172.21.15.2:0/3128403166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d4102770 msgr2=0x7f93d4102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:37.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.646+0000 7f93dc800700 1 --2- 172.21.15.2:0/3128403166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d4102770 0x7f93d4102b50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f93c80099c0 tx=0x7f93c8009cd0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.646+0000 7f93dc800700 1 -- 172.21.15.2:0/3128403166 shutdown_connections 2024-06-13T02:17:37.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.646+0000 7f93dc800700 1 --2- 172.21.15.2:0/3128403166 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d4107840 0x7f93d410f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.646+0000 7f93dc800700 1 --2- 172.21.15.2:0/3128403166 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d4102770 0x7f93d4102b50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.646+0000 7f93dc800700 1 --2- 172.21.15.2:0/3128403166 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d4103120 0x7f93d4107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.646+0000 7f93dc800700 1 -- 172.21.15.2:0/3128403166 >> 172.21.15.2:0/3128403166 conn(0x7f93d4079500 msgr2=0x7f93d4079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:37.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.646+0000 7f93dc800700 1 -- 172.21.15.2:0/3128403166 shutdown_connections 2024-06-13T02:17:37.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.646+0000 7f93dc800700 1 -- 172.21.15.2:0/3128403166 wait complete. 2024-06-13T02:17:37.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.647+0000 7f93dc800700 1 Processor -- start 2024-06-13T02:17:37.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.648+0000 7f93dc800700 1 -- start start 2024-06-13T02:17:37.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.648+0000 7f93dc800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d4102770 0x7f93d419adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.648+0000 7f93dc800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d4103120 0x7f93d419b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.648+0000 7f93dc800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d4107840 0x7f93d419f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.648+0000 7f93dc800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93d41127d0 con 0x7f93d4103120 2024-06-13T02:17:37.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.648+0000 7f93dc800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f93d4112650 con 0x7f93d4102770 2024-06-13T02:17:37.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.648+0000 7f93dc800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93d4112950 con 0x7f93d4107840 2024-06-13T02:17:37.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.648+0000 7f93d9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d4102770 0x7f93d419adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.648+0000 7f93d9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d4102770 0x7f93d419adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37778/0 (socket says 172.21.15.2:37778) 2024-06-13T02:17:37.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.648+0000 7f93d9e00700 1 -- 172.21.15.2:0/860849371 learned_addr learned my addr 172.21.15.2:0/860849371 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:37.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.648+0000 7f93da800700 1 --2- 172.21.15.2:0/860849371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d4107840 0x7f93d419f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.649+0000 7f93d9400700 1 --2- 172.21.15.2:0/860849371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d4103120 0x7f93d419b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.649+0000 7f93d9e00700 1 -- 172.21.15.2:0/860849371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d4107840 msgr2=0x7f93d419f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.649+0000 7f93d9e00700 1 --2- 172.21.15.2:0/860849371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d4107840 0x7f93d419f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.649+0000 7f93d9e00700 1 -- 172.21.15.2:0/860849371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d4103120 msgr2=0x7f93d419b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.649+0000 7f93d9e00700 1 --2- 172.21.15.2:0/860849371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d4103120 0x7f93d419b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.649+0000 7f93d9e00700 1 -- 172.21.15.2:0/860849371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d419fdc0 con 0x7f93d4102770 2024-06-13T02:17:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.649+0000 7f93d9400700 1 --2- 172.21.15.2:0/860849371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d4103120 0x7f93d419b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:17:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.649+0000 7f93d9e00700 1 --2- 172.21.15.2:0/860849371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d4102770 0x7f93d419adb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f93c8006010 tx=0x7f93c8003a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.650+0000 7f93cea00700 1 -- 172.21.15.2:0/860849371 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c80050c0 con 0x7f93d4102770 2024-06-13T02:17:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.650+0000 7f93cea00700 1 -- 172.21.15.2:0/860849371 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93c800f460 con 0x7f93d4102770 2024-06-13T02:17:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.650+0000 7f93dc800700 1 -- 172.21.15.2:0/860849371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d41a0050 con 0x7f93d4102770 2024-06-13T02:17:37.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.650+0000 7f93cea00700 1 -- 172.21.15.2:0/860849371 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c8017650 con 0x7f93d4102770 2024-06-13T02:17:37.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.650+0000 7f93dc800700 1 -- 172.21.15.2:0/860849371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d41a7930 con 0x7f93d4102770 2024-06-13T02:17:37.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.653+0000 7f93cea00700 1 -- 172.21.15.2:0/860849371 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f93c800f610 con 0x7f93d4102770 2024-06-13T02:17:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.654+0000 7f93e70c2b80 1 Processor -- start 2024-06-13T02:17:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.654+0000 7f93cea00700 1 --2- 172.21.15.2:0/860849371 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f93bc0a2ca0 0x7f93bc0a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.655+0000 7f93e70c2b80 1 -- start start 2024-06-13T02:17:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.655+0000 7f93cea00700 1 -- 172.21.15.2:0/860849371 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f93c80d01a0 con 0x7f93d4102770 2024-06-13T02:17:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.655+0000 7f93da800700 1 --2- 172.21.15.2:0/860849371 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f93bc0a2ca0 0x7f93bc0a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.655+0000 7f93e70c2b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2904b40 0x55d7d2904f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.655+0000 7f93e70c2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2905460 0x55d7d28fecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.655+0000 7f93e70c2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d28ff630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.655+0000 7f93e70c2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d7d280d9c0 con 0x55d7d2905460 2024-06-13T02:17:37.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.655+0000 7f93e70c2b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d7d2850ab0 con 0x55d7d2904b40 2024-06-13T02:17:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.655+0000 7f93e70c2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d7d280b8a0 con 0x55d7d28ff1f0 2024-06-13T02:17:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.655+0000 7f93d9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2904b40 0x55d7d2904f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.655+0000 7f93d9e00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2904b40 0x55d7d2904f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37782/0 (socket says 172.21.15.2:37782) 2024-06-13T02:17:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.655+0000 7f93d9e00700 1 -- 172.21.15.2:0/2504735966 learned_addr learned my addr 172.21.15.2:0/2504735966 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.655+0000 7f93d9400700 1 --2- 172.21.15.2:0/2504735966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2905460 0x55d7d28fecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.656+0000 7f93d9e00700 1 -- 172.21.15.2:0/2504735966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 msgr2=0x55d7d28ff630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.656+0000 7f93da800700 1 --2- 172.21.15.2:0/2504735966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d28ff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.656+0000 7f93d9e00700 1 --2- 172.21.15.2:0/2504735966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d28ff630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.656+0000 7f93d9e00700 1 -- 172.21.15.2:0/2504735966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2905460 msgr2=0x55d7d28fecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.656+0000 7f93d9e00700 1 --2- 172.21.15.2:0/2504735966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2905460 0x55d7d28fecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.656+0000 7f93d9e00700 1 -- 172.21.15.2:0/2504735966 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7d27f8f40 con 0x55d7d2904b40 2024-06-13T02:17:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.656+0000 7f93d9400700 1 --2- 172.21.15.2:0/2504735966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2905460 0x55d7d28fecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:17:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.656+0000 7f93da800700 1 --2- 172.21.15.2:0/2504735966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d28ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:17:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.656+0000 7f93da800700 1 --2- 172.21.15.2:0/860849371 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f93bc0a2ca0 0x7f93bc0a5160 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f93d000f590 tx=0x7f93d000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.656+0000 7f93d9e00700 1 --2- 172.21.15.2:0/2504735966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2904b40 0x55d7d2904f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f93c8099010 tx=0x7f93c809c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a2be2b285b348c8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.656+0000 7f93c3400700 1 -- 172.21.15.2:0/2504735966 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c8020370 con 0x55d7d2904b40 2024-06-13T02:17:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.656+0000 7f93c3400700 1 -- 172.21.15.2:0/2504735966 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93c809cd40 con 0x55d7d2904b40 2024-06-13T02:17:37.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.657+0000 7f93c3400700 1 -- 172.21.15.2:0/2504735966 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c800f9a0 con 0x55d7d2904b40 2024-06-13T02:17:37.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.657+0000 7f93e70c2b80 1 -- 172.21.15.2:0/2504735966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2904b40 msgr2=0x55d7d2904f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:37.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.657+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/2504735966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2904b40 0x55d7d2904f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f93c8099010 tx=0x7f93c809c4c0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.657+0000 7f93e70c2b80 1 -- 172.21.15.2:0/2504735966 shutdown_connections 2024-06-13T02:17:37.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.657+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/2504735966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d28ff630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.657+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/2504735966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2904b40 0x55d7d2904f20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.657+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/2504735966 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2905460 0x55d7d28fecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.657+0000 7f93e70c2b80 1 -- 172.21.15.2:0/2504735966 >> 172.21.15.2:0/2504735966 conn(0x55d7d282b120 msgr2=0x55d7d28f9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:37.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.658+0000 7f93e70c2b80 1 -- 172.21.15.2:0/2504735966 shutdown_connections 2024-06-13T02:17:37.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.658+0000 7f93e70c2b80 1 -- 172.21.15.2:0/2504735966 wait complete. 2024-06-13T02:17:37.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.658+0000 7f93e70c2b80 1 -- start start 2024-06-13T02:17:37.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.658+0000 7f93e70c2b80 1 Processor -- start 2024-06-13T02:17:37.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.659+0000 7f93e70c2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d28ff1f0 0x55d7d290b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.659+0000 7f93e70c2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d2904b40 0x55d7d29084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.659+0000 7f93e70c2b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2905460 0x55d7d29089e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.659+0000 7f93e70c2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d7d27ecf10 con 0x55d7d28ff1f0 2024-06-13T02:17:37.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.659+0000 7f93e70c2b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d7d284ca70 con 0x55d7d2905460 2024-06-13T02:17:37.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.659+0000 7f93e70c2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d7d290bbf0 con 0x55d7d2904b40 2024-06-13T02:17:37.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.659+0000 7f93e70c2b80 10 client.0 _ll_register_callbacks cb 0x55d7d27e6330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:17:37.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.659+0000 7f93d9e00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d28ff1f0 0x55d7d290b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.659+0000 7f93da800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2905460 0x55d7d29089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.659+0000 7f93d9400700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d2904b40 0x55d7d29084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.659+0000 7f93da800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2905460 0x55d7d29089e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37784/0 (socket says 172.21.15.2:37784) 2024-06-13T02:17:37.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.659+0000 7f93da800700 1 -- 172.21.15.2:0/2344423259 learned_addr learned my addr 172.21.15.2:0/2344423259 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:37.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.660+0000 7f93da800700 1 -- 172.21.15.2:0/2344423259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d2904b40 msgr2=0x55d7d29084a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:37.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.660+0000 7f93da800700 1 --2- 172.21.15.2:0/2344423259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d2904b40 0x55d7d29084a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.660+0000 7f93da800700 1 -- 172.21.15.2:0/2344423259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d28ff1f0 msgr2=0x55d7d290b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:37.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.660+0000 7f93da800700 1 --2- 172.21.15.2:0/2344423259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d28ff1f0 0x55d7d290b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.660+0000 7f93da800700 1 -- 172.21.15.2:0/2344423259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7d279f880 con 0x55d7d2905460 2024-06-13T02:17:37.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.660+0000 7f93d9400700 1 --2- 172.21.15.2:0/2344423259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d2904b40 0x55d7d29084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:37.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.660+0000 7f93da800700 1 --2- 172.21.15.2:0/2344423259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2905460 0x55d7d29089e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f93d0008ac0 tx=0x7f93d0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28d05a706a82632f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:37.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.660+0000 7f93b7e00700 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:17:37.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.660+0000 7f93b7e00700 1 -- 172.21.15.2:0/2344423259 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0026030 con 0x55d7d2905460 2024-06-13T02:17:37.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.661+0000 7f93e70c2b80 1 -- 172.21.15.2:0/2344423259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93c809cd40 con 0x55d7d2905460 2024-06-13T02:17:37.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.661+0000 7f93b7e00700 1 -- 172.21.15.2:0/2344423259 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f93d001d040 con 0x55d7d2905460 2024-06-13T02:17:37.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.661+0000 7f93b7e00700 1 -- 172.21.15.2:0/2344423259 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f93d0030050 con 0x55d7d2905460 2024-06-13T02:17:37.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.661+0000 7f93e70c2b80 10 client.25115 fetch_fsmap learned FSMap version 26 2024-06-13T02:17:37.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.661+0000 7f93e70c2b80 1 -- 172.21.15.2:0/2344423259 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d7d29162f0 con 0x55d7d2905460 2024-06-13T02:17:37.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.661+0000 7f93b7e00700 1 -- 172.21.15.2:0/2344423259 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93c809cd40 con 0x55d7d2905460 2024-06-13T02:17:37.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.662+0000 7f93b7e00700 1 -- 172.21.15.2:0/2344423259 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f93d00040b0 con 0x55d7d2905460 2024-06-13T02:17:37.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.662+0000 7f93e70c2b80 10 client.25115 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T02:17:37.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.662+0000 7f93e70c2b80 10 client.25115 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T02:17:37.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.662+0000 7f93e70c2b80 20 client.25115 populate_metadata read hostname 'smithi002' 2024-06-13T02:17:37.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.662+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/2344423259 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d7d2918910 0x55d7d2919d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.662+0000 7f93e70c2b80 4 client.25115 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:17:37.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.662+0000 7f93e70c2b80 1 -- 172.21.15.2:0/2344423259 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7d285dfb0 con 0x55d7d2918910 2024-06-13T02:17:37.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.662+0000 7f93d9e00700 1 --2- 172.21.15.2:0/2344423259 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d7d2918910 0x55d7d2919d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.663+0000 7f93d9e00700 1 --2- 172.21.15.2:0/2344423259 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d7d2918910 0x55d7d2919d80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bfab16edf4582a0 server_cookie=2b097716c8ad9f72 in_seq=0 out_seq=0 2024-06-13T02:17:37.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.663+0000 7f93b7e00700 10 client.25115 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:17:37.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.664+0000 7f93b7e00700 1 -- 172.21.15.2:0/2344423259 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d7d285dfb0 con 0x55d7d2918910 2024-06-13T02:17:37.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.664+0000 7f93b7e00700 10 client.25115 handle_command_reply: tid=0 2024-06-13T02:17:37.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.664+0000 7f93e70c2b80 1 client.25115 shutdown 2024-06-13T02:17:37.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.664+0000 7f93e70c2b80 1 -- 172.21.15.2:0/2344423259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2905460 msgr2=0x55d7d29089e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:37.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.664+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/2344423259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2905460 0x55d7d29089e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f93d0008ac0 tx=0x7f93d0004ad0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.664+0000 7f93e70c2b80 1 -- 172.21.15.2:0/2344423259 shutdown_connections 2024-06-13T02:17:37.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.664+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/2344423259 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d7d2918910 0x55d7d2919d80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.664+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/2344423259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2905460 0x55d7d29089e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.664+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/2344423259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d28ff1f0 0x55d7d290b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.664+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/2344423259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d2904b40 0x55d7d29084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.664+0000 7f93e70c2b80 1 -- 172.21.15.2:0/2344423259 >> 172.21.15.2:0/2344423259 conn(0x55d7d282b120 msgr2=0x55d7d28f3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:37.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.664+0000 7f93b7e00700 0 client.25115 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:17:37.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.664+0000 7f93e70c2b80 1 -- 172.21.15.2:0/2344423259 shutdown_connections 2024-06-13T02:17:37.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.664+0000 7f93e70c2b80 1 -- 172.21.15.2:0/2344423259 wait complete. 2024-06-13T02:17:37.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.664+0000 7f93e70c2b80 20 client.25115 trim_cache size 0 max 16384 2024-06-13T02:17:37.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.689+0000 7f93e70c2b80 1 Processor -- start 2024-06-13T02:17:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.689+0000 7f93e70c2b80 1 -- start start 2024-06-13T02:17:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93e70c2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d28fecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93e70c2b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2904b40 0x55d7d28f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93e70c2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2905460 0x55d7d28f9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93e70c2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d7d29180c0 con 0x55d7d2905460 2024-06-13T02:17:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93e70c2b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d7d2918790 con 0x55d7d2904b40 2024-06-13T02:17:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93e70c2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d7d2918e60 con 0x55d7d28ff1f0 2024-06-13T02:17:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93d9400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2904b40 0x55d7d28f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93da800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2905460 0x55d7d28f9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93d9400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2904b40 0x55d7d28f40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37796/0 (socket says 172.21.15.2:37796) 2024-06-13T02:17:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93da800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2905460 0x55d7d28f9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36892/0 (socket says 172.21.15.2:36892) 2024-06-13T02:17:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93d9400700 1 -- 172.21.15.2:0/66047861 learned_addr learned my addr 172.21.15.2:0/66047861 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:37.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93d9e00700 1 --2- 172.21.15.2:0/66047861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d28fecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93d9e00700 1 -- 172.21.15.2:0/66047861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2904b40 msgr2=0x55d7d28f40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93d9e00700 1 --2- 172.21.15.2:0/66047861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2904b40 0x55d7d28f40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93d9e00700 1 -- 172.21.15.2:0/66047861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2905460 msgr2=0x55d7d28f9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.690+0000 7f93d9e00700 1 --2- 172.21.15.2:0/66047861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2905460 0x55d7d28f9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.691+0000 7f93d9e00700 1 -- 172.21.15.2:0/66047861 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7d291ace0 con 0x55d7d28ff1f0 2024-06-13T02:17:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.691+0000 7f93da800700 1 --2- 172.21.15.2:0/66047861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2905460 0x55d7d28f9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.691+0000 7f93d9e00700 1 --2- 172.21.15.2:0/66047861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d28fecb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55d7d290ba80 tx=0x7f93c8005050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f4920001684fa65 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.691+0000 7f93c2a00700 1 -- 172.21.15.2:0/66047861 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c8020370 con 0x55d7d28ff1f0 2024-06-13T02:17:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.691+0000 7f93c2a00700 1 -- 172.21.15.2:0/66047861 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93c80a09f0 con 0x55d7d28ff1f0 2024-06-13T02:17:37.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.691+0000 7f93c2a00700 1 -- 172.21.15.2:0/66047861 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c809c8a0 con 0x55d7d28ff1f0 2024-06-13T02:17:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.692+0000 7f93e70c2b80 1 -- 172.21.15.2:0/66047861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 msgr2=0x55d7d28fecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.692+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/66047861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d28fecb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55d7d290ba80 tx=0x7f93c8005050 comp rx=0 tx=0).stop 2024-06-13T02:17:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.692+0000 7f93e70c2b80 1 -- 172.21.15.2:0/66047861 shutdown_connections 2024-06-13T02:17:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.692+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/66047861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2905460 0x55d7d28f9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.692+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/66047861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d28fecb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.692+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/66047861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2904b40 0x55d7d28f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.692+0000 7f93e70c2b80 1 -- 172.21.15.2:0/66047861 >> 172.21.15.2:0/66047861 conn(0x55d7d282b120 msgr2=0x55d7d29025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.692+0000 7f93e70c2b80 1 -- 172.21.15.2:0/66047861 shutdown_connections 2024-06-13T02:17:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.692+0000 7f93e70c2b80 1 -- 172.21.15.2:0/66047861 wait complete. 2024-06-13T02:17:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.692+0000 7f93e70c2b80 1 -- start start 2024-06-13T02:17:37.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.693+0000 7f93e70c2b80 1 Processor -- start 2024-06-13T02:17:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.693+0000 7f93e70c2b80 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d2923590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.693+0000 7f93e70c2b80 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2904b40 0x55d7d2923ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.693+0000 7f93e70c2b80 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2905460 0x55d7d28f32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.693+0000 7f93e70c2b80 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d7d2919c00 con 0x55d7d2904b40 2024-06-13T02:17:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.693+0000 7f93e70c2b80 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d7d2919530 con 0x55d7d2905460 2024-06-13T02:17:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.693+0000 7f93e70c2b80 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d7d291a2d0 con 0x55d7d28ff1f0 2024-06-13T02:17:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.693+0000 7f93e70c2b80 10 client.0 _ll_register_callbacks cb 0x55d7d27e6330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:17:37.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.693+0000 7f93d9400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2904b40 0x55d7d2923ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.693+0000 7f93d9e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d2923590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.693+0000 7f93d9e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d2923590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:50372/0 (socket says 172.21.15.2:50372) 2024-06-13T02:17:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.693+0000 7f93d9400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2904b40 0x55d7d2923ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36898/0 (socket says 172.21.15.2:36898) 2024-06-13T02:17:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.693+0000 7f93d9e00700 1 -- 172.21.15.2:0/1626860251 learned_addr learned my addr 172.21.15.2:0/1626860251 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.693+0000 7f93da800700 1 --2- 172.21.15.2:0/1626860251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2905460 0x55d7d28f32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.694+0000 7f93d9e00700 1 -- 172.21.15.2:0/1626860251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2905460 msgr2=0x55d7d28f32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.694+0000 7f93d9e00700 1 --2- 172.21.15.2:0/1626860251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2905460 0x55d7d28f32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.694+0000 7f93d9e00700 1 -- 172.21.15.2:0/1626860251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2904b40 msgr2=0x55d7d2923ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:17:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.694+0000 7f93d9e00700 1 --2- 172.21.15.2:0/1626860251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2904b40 0x55d7d2923ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.694+0000 7f93d9e00700 1 -- 172.21.15.2:0/1626860251 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7d28f3b20 con 0x55d7d28ff1f0 2024-06-13T02:17:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.694+0000 7f93d9e00700 1 --2- 172.21.15.2:0/1626860251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d2923590 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f93c80a4cf0 tx=0x7f93c809c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54d017960039f0f4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:37.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.694+0000 7f93b7e00700 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:17:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.694+0000 7f93b7e00700 1 -- 172.21.15.2:0/1626860251 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c8020370 con 0x55d7d28ff1f0 2024-06-13T02:17:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.694+0000 7f93b7e00700 1 -- 172.21.15.2:0/1626860251 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f93c809a940 con 0x55d7d28ff1f0 2024-06-13T02:17:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.694+0000 7f93e70c2b80 1 -- 172.21.15.2:0/1626860251 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93c80a09f0 con 0x55d7d28ff1f0 2024-06-13T02:17:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.695+0000 7f93b7e00700 1 -- 172.21.15.2:0/1626860251 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f93c80a5220 con 0x55d7d28ff1f0 2024-06-13T02:17:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.695+0000 7f93e70c2b80 10 client.25102 fetch_fsmap learned FSMap version 26 2024-06-13T02:17:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.695+0000 7f93e70c2b80 1 -- 172.21.15.2:0/1626860251 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d7d2922df0 con 0x55d7d28ff1f0 2024-06-13T02:17:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.695+0000 7f93b7e00700 1 -- 172.21.15.2:0/1626860251 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93c80a09f0 con 0x55d7d28ff1f0 2024-06-13T02:17:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.695+0000 7f93b7e00700 1 -- 172.21.15.2:0/1626860251 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f93c809c930 con 0x55d7d28ff1f0 2024-06-13T02:17:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.695+0000 7f93e70c2b80 10 client.25102 fetch_fsmap finished waiting for FSMap version 26 2024-06-13T02:17:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.695+0000 7f93e70c2b80 10 client.25102 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-13T02:17:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.695+0000 7f93e70c2b80 20 client.25102 populate_metadata read hostname 'smithi002' 2024-06-13T02:17:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.695+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/1626860251 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d7d2990cf0 0x55d7d298fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:37.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.695+0000 7f93e70c2b80 4 client.25102 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-13T02:17:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.695+0000 7f93e70c2b80 1 -- 172.21.15.2:0/1626860251 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "status"}) -- 0x55d7d2858530 con 0x55d7d2990cf0 2024-06-13T02:17:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.696+0000 7f93d9400700 1 --2- 172.21.15.2:0/1626860251 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d7d2990cf0 0x55d7d298fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.696+0000 7f93d9400700 1 --2- 172.21.15.2:0/1626860251 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d7d2990cf0 0x55d7d298fa00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51ce6b9b46bd07f6 server_cookie=bf5d8500ac1ac6c6 in_seq=0 out_seq=0 2024-06-13T02:17:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.696+0000 7f93b7e00700 10 client.25102 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:17:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.697+0000 7f93b7e00700 1 -- 172.21.15.2:0/1626860251 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55d7d2858530 con 0x55d7d2990cf0 2024-06-13T02:17:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.697+0000 7f93b7e00700 10 client.25102 handle_command_reply: tid=0 2024-06-13T02:17:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.697+0000 7f93e70c2b80 1 client.25102 shutdown 2024-06-13T02:17:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.697+0000 7f93e70c2b80 1 -- 172.21.15.2:0/1626860251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 msgr2=0x55d7d2923590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:37.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.697+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/1626860251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d2923590 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f93c80a4cf0 tx=0x7f93c809c4c0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.697+0000 7f93e70c2b80 1 -- 172.21.15.2:0/1626860251 shutdown_connections 2024-06-13T02:17:37.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.697+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/1626860251 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d7d2990cf0 0x55d7d298fa00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.697+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/1626860251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d7d2905460 0x55d7d28f32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.697+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/1626860251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7d28ff1f0 0x55d7d2923590 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.697+0000 7f93e70c2b80 1 --2- 172.21.15.2:0/1626860251 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d7d2904b40 0x55d7d2923ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.697+0000 7f93e70c2b80 1 -- 172.21.15.2:0/1626860251 >> 172.21.15.2:0/1626860251 conn(0x55d7d282b120 msgr2=0x55d7d28f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:37.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.697+0000 7f93b7e00700 0 client.25102 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:17:37.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.697+0000 7f93e70c2b80 1 -- 172.21.15.2:0/1626860251 shutdown_connections 2024-06-13T02:17:37.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.697+0000 7f93e70c2b80 1 -- 172.21.15.2:0/1626860251 wait complete. 2024-06-13T02:17:37.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.697+0000 7f93e70c2b80 20 client.25102 trim_cache size 0 max 16384 2024-06-13T02:17:37.703 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T02:17:37.703 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "efed8ab4-2928-11ef-bc9c-c7b262605968", 2024-06-13T02:17:37.703 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-06-13T02:17:37.703 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 24527, 2024-06-13T02:17:37.703 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-06-13T02:17:37.703 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-06-13T02:17:37.703 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-06-13T02:17:37.704 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 294.193970165, 2024-06-13T02:17:37.704 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 26, 2024-06-13T02:17:37.704 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 100, 2024-06-13T02:17:37.704 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 98, 2024-06-13T02:17:37.704 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 317.73170390000001 2024-06-13T02:17:37.704 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T02:17:37.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.698+0000 7f93dc800700 1 -- 172.21.15.2:0/860849371 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f93bc0a2ca0 msgr2=0x7f93bc0a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:37.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.698+0000 7f93dc800700 1 --2- 172.21.15.2:0/860849371 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f93bc0a2ca0 0x7f93bc0a5160 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f93d000f590 tx=0x7f93d000b040 comp rx=0 tx=0).stop 2024-06-13T02:17:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.698+0000 7f93dc800700 1 -- 172.21.15.2:0/860849371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d4102770 msgr2=0x7f93d419adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.698+0000 7f93dc800700 1 --2- 172.21.15.2:0/860849371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d4102770 0x7f93d419adb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f93c8006010 tx=0x7f93c8003a90 comp rx=0 tx=0).stop 2024-06-13T02:17:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.698+0000 7f93dc800700 1 -- 172.21.15.2:0/860849371 shutdown_connections 2024-06-13T02:17:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.698+0000 7f93dc800700 1 --2- 172.21.15.2:0/860849371 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f93bc0a2ca0 0x7f93bc0a5160 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.698+0000 7f93dc800700 1 --2- 172.21.15.2:0/860849371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d4107840 0x7f93d419f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.698+0000 7f93dc800700 1 --2- 172.21.15.2:0/860849371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d4102770 0x7f93d419adb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.698+0000 7f93dc800700 1 --2- 172.21.15.2:0/860849371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d4103120 0x7f93d419b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.698+0000 7f93dc800700 1 -- 172.21.15.2:0/860849371 >> 172.21.15.2:0/860849371 conn(0x7f93d4079500 msgr2=0x7f93d4100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.698+0000 7f93dc800700 1 -- 172.21.15.2:0/860849371 shutdown_connections 2024-06-13T02:17:37.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:37.698+0000 7f93dc800700 1 -- 172.21.15.2:0/860849371 wait complete. 2024-06-13T02:17:38.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:37 smithi084 ceph-mon[36833]: pgmap v486: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:17:38.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:37 smithi175 ceph-mon[36977]: pgmap v486: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:17:38.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:37 smithi002 ceph-mon[31960]: pgmap v486: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:17:38.531 INFO:teuthology.run_tasks:Running task sequential... 2024-06-13T02:17:38.541 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-06-13T02:17:38.542 INFO:teuthology.task.sequential:In sequential, running task print... 2024-06-13T02:17:38.542 INFO:teuthology.task.print:Enabling mgr modules 2024-06-13T02:17:38.542 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-06-13T02:17:38.543 INFO:teuthology.task.exec:Executing custom commands... 2024-06-13T02:17:38.543 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T02:17:38.543 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-06-13T02:17:38.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.759+0000 7f2ad7200640 1 -- 172.21.15.2:0/3128242317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad8102ac0 msgr2=0x7f2ad8102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:38.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.759+0000 7f2ad7200640 1 --2- 172.21.15.2:0/3128242317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad8102ac0 0x7f2ad8102f40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009900 tx=0x7f2ac002a410 comp rx=0 tx=0).stop 2024-06-13T02:17:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.759+0000 7f2ad7200640 1 -- 172.21.15.2:0/3128242317 shutdown_connections 2024-06-13T02:17:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.759+0000 7f2ad7200640 1 --2- 172.21.15.2:0/3128242317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ad8103480 0x7f2ad8109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.759+0000 7f2ad7200640 1 --2- 172.21.15.2:0/3128242317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad8102ac0 0x7f2ad8102f40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.759+0000 7f2ad7200640 1 --2- 172.21.15.2:0/3128242317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ad80ffaf0 0x7f2ad80fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.759+0000 7f2ad7200640 1 -- 172.21.15.2:0/3128242317 >> 172.21.15.2:0/3128242317 conn(0x7f2ad80fb400 msgr2=0x7f2ad80fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.759+0000 7f2ad7200640 1 -- 172.21.15.2:0/3128242317 shutdown_connections 2024-06-13T02:17:38.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.759+0000 7f2ad7200640 1 -- 172.21.15.2:0/3128242317 wait complete. 2024-06-13T02:17:38.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.760+0000 7f2ad7200640 1 Processor -- start 2024-06-13T02:17:38.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.761+0000 7f2ad7200640 1 -- start start 2024-06-13T02:17:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.761+0000 7f2ad7200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ad80ffaf0 0x7f2ad8199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.761+0000 7f2ad7200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad8102ac0 0x7f2ad819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.761+0000 7f2ad7200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ad8103480 0x7f2ad81a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.761+0000 7f2ad7200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad810d500 con 0x7f2ad80ffaf0 2024-06-13T02:17:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.761+0000 7f2ad7200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad810d380 con 0x7f2ad8102ac0 2024-06-13T02:17:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.761+0000 7f2ad7200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad810d680 con 0x7f2ad8103480 2024-06-13T02:17:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.761+0000 7f2ad5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ad80ffaf0 0x7f2ad8199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.761+0000 7f2acfe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad8102ac0 0x7f2ad819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:38.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.761+0000 7f2ad5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ad80ffaf0 0x7f2ad8199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36922/0 (socket says 172.21.15.2:36922) 2024-06-13T02:17:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.761+0000 7f2ad5e00640 1 -- 172.21.15.2:0/3332218202 learned_addr learned my addr 172.21.15.2:0/3332218202 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.761+0000 7f2ad6800640 1 --2- 172.21.15.2:0/3332218202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ad8103480 0x7f2ad81a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.762+0000 7f2ad6800640 1 -- 172.21.15.2:0/3332218202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad8102ac0 msgr2=0x7f2ad819a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.762+0000 7f2ad6800640 1 --2- 172.21.15.2:0/3332218202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad8102ac0 0x7f2ad819a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.762+0000 7f2ad6800640 1 -- 172.21.15.2:0/3332218202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ad80ffaf0 msgr2=0x7f2ad8199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.762+0000 7f2ad6800640 1 --2- 172.21.15.2:0/3332218202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ad80ffaf0 0x7f2ad8199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:38.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.762+0000 7f2ad6800640 1 -- 172.21.15.2:0/3332218202 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad81a1a10 con 0x7f2ad8103480 2024-06-13T02:17:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.762+0000 7f2ad6800640 1 --2- 172.21.15.2:0/3332218202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ad8103480 0x7f2ad81a13a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000ec50 tx=0x7f2ad000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.762+0000 7f2acea00640 1 -- 172.21.15.2:0/3332218202 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0003b70 con 0x7f2ad8103480 2024-06-13T02:17:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.762+0000 7f2acea00640 1 -- 172.21.15.2:0/3332218202 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ad0003d10 con 0x7f2ad8103480 2024-06-13T02:17:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.762+0000 7f2ad7200640 1 -- 172.21.15.2:0/3332218202 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad81a1d00 con 0x7f2ad8103480 2024-06-13T02:17:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.762+0000 7f2acea00640 1 -- 172.21.15.2:0/3332218202 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0010890 con 0x7f2ad8103480 2024-06-13T02:17:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.763+0000 7f2ad7200640 1 -- 172.21.15.2:0/3332218202 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad81a21d0 con 0x7f2ad8103480 2024-06-13T02:17:38.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.764+0000 7f2ad7200640 1 -- 172.21.15.2:0/3332218202 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad81a2460 con 0x7f2ad8103480 2024-06-13T02:17:38.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.766+0000 7f2acea00640 1 -- 172.21.15.2:0/3332218202 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 18) ==== 137832+0+0 (secure 0 0 0) 0x7f2ad0003fc0 con 0x7f2ad8103480 2024-06-13T02:17:38.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.768+0000 7f2acea00640 1 --2- 172.21.15.2:0/3332218202 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2abc0a2bf0 0x7f2abc0a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:38.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.768+0000 7f2acea00640 1 -- 172.21.15.2:0/3332218202 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f2ad00cfa10 con 0x7f2ad8103480 2024-06-13T02:17:38.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.768+0000 7f2ad5e00640 1 --2- 172.21.15.2:0/3332218202 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2abc0a2bf0 0x7f2abc0a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:38.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.769+0000 7f2ad5e00640 1 --2- 172.21.15.2:0/3332218202 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2abc0a2bf0 0x7f2abc0a50b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80058c0 tx=0x7f2ac8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:38.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:38.772+0000 7f2acea00640 1 -- 172.21.15.2:0/3332218202 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f2ad009c520 con 0x7f2ad8103480 2024-06-13T02:17:39.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:39.036+0000 7f2ad7200640 1 -- 172.21.15.2:0/3332218202 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f2ad81a2630 con 0x7f2ad8103480 2024-06-13T02:17:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:39.977+0000 7f2acea00640 1 -- 172.21.15.2:0/3332218202 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mgrmap(e 19) ==== 137849+0+0 (secure 0 0 0) 0x7f2ad0098490 con 0x7f2ad8103480 2024-06-13T02:17:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:39.978+0000 7f2acea00640 1 -- 172.21.15.2:0/3332218202 <== mon.1 v2:172.21.15.175:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f2ad0078520 con 0x7f2ad8103480 2024-06-13T02:17:39.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:39.983+0000 7f2ad7200640 1 -- 172.21.15.2:0/3332218202 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2abc0a2bf0 msgr2=0x7f2abc0a50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:39.983+0000 7f2ad7200640 1 --2- 172.21.15.2:0/3332218202 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2abc0a2bf0 0x7f2abc0a50b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80058c0 tx=0x7f2ac8005f90 comp rx=0 tx=0).stop 2024-06-13T02:17:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:39.983+0000 7f2ad7200640 1 -- 172.21.15.2:0/3332218202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ad8103480 msgr2=0x7f2ad81a13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:39.983+0000 7f2ad7200640 1 --2- 172.21.15.2:0/3332218202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ad8103480 0x7f2ad81a13a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000ec50 tx=0x7f2ad000c6a0 comp rx=0 tx=0).stop 2024-06-13T02:17:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:39.983+0000 7f2ad7200640 1 -- 172.21.15.2:0/3332218202 shutdown_connections 2024-06-13T02:17:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:39.983+0000 7f2ad7200640 1 --2- 172.21.15.2:0/3332218202 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f2abc0a2bf0 0x7f2abc0a50b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:39.983+0000 7f2ad7200640 1 --2- 172.21.15.2:0/3332218202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ad8103480 0x7f2ad81a13a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:39.983+0000 7f2ad7200640 1 --2- 172.21.15.2:0/3332218202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ad8102ac0 0x7f2ad819a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:39.983+0000 7f2ad7200640 1 --2- 172.21.15.2:0/3332218202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ad80ffaf0 0x7f2ad8199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:39.983+0000 7f2ad7200640 1 -- 172.21.15.2:0/3332218202 >> 172.21.15.2:0/3332218202 conn(0x7f2ad80fb400 msgr2=0x7f2ad81008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:39.983+0000 7f2ad7200640 1 -- 172.21.15.2:0/3332218202 shutdown_connections 2024-06-13T02:17:39.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:39.983+0000 7f2ad7200640 1 -- 172.21.15.2:0/3332218202 wait complete. 2024-06-13T02:17:40.006 INFO:teuthology.run_tasks:Running task kclient... 2024-06-13T02:17:40.020 INFO:tasks.kclient:Mounting kernel clients... 2024-06-13T02:17:40.020 INFO:tasks.kclient:config is {'client.0': {}} 2024-06-13T02:17:40.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:17:40.020 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-06-13T02:17:40.065 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-06-13T02:17:40.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:17:40.066 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-06-13T02:17:40.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:17:40.176 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-06-13T02:17:40.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:39 smithi084 ceph-mon[36833]: pgmap v487: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:17:40.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:39 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3332218202' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-06-13T02:17:40.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:39 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-06-13T02:17:40.221 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:40 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: ignoring --setuser ceph since I am not root 2024-06-13T02:17:40.221 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:40 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: ignoring --setgroup ceph since I am not root 2024-06-13T02:17:40.221 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:40 smithi084 ceph-mgr[38206]: -- 172.21.15.84:0/3925041443 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557ce53e05a0 con 0x557ce53b4c00 2024-06-13T02:17:40.221 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:40 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:40.146+0000 7f7eb278b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T02:17:40.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:39 smithi002 ceph-mon[31960]: pgmap v487: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:17:40.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:39 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3332218202' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-06-13T02:17:40.232 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:39 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-06-13T02:17:40.232 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:40 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: ignoring --setuser ceph since I am not root 2024-06-13T02:17:40.232 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:40 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: ignoring --setgroup ceph since I am not root 2024-06-13T02:17:40.281 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-06-13T02:17:40.281 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-13T02:17:40.281 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-13T02:17:40.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs ls 2024-06-13T02:17:40.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:39 smithi175 ceph-mon[36977]: pgmap v487: 129 pgs: 129 active+clean; 643 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-06-13T02:17:40.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:39 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3332218202' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-06-13T02:17:40.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:39 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-06-13T02:17:40.283 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:40 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: ignoring --setuser ceph since I am not root 2024-06-13T02:17:40.283 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:40 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: ignoring --setgroup ceph since I am not root 2024-06-13T02:17:40.283 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:40 smithi175 ceph-mgr[38844]: -- 172.21.15.175:0/2271137610 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563f053025a0 con 0x563f052d6800 2024-06-13T02:17:40.283 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:40 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:40.146+0000 7ff3f3612200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T02:17:40.566 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:40 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:40.304+0000 7fc86b1ff200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-13T02:17:40.566 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:40 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:40.563+0000 7fc86b1ff200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:17:40.720 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:40 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:40.331+0000 7f7eb278b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:17:40.721 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:40 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:40.433+0000 7f7eb278b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T02:17:40.722 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:17:40.736 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:40 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:40.330+0000 7ff3f3612200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:17:40.736 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:40 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:40.430+0000 7ff3f3612200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T02:17:40.873 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:40 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:40.721+0000 7fc86b1ff200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-13T02:17:41.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:40 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-06-13T02:17:41.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:40 smithi175 ceph-mon[36977]: mgrmap e19: x(active, since 13m), standbys: y, z 2024-06-13T02:17:41.033 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:40 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:40.735+0000 7ff3f3612200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T02:17:41.033 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:40 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:40.819+0000 7ff3f3612200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T02:17:41.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:40 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-06-13T02:17:41.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:40 smithi002 ceph-mon[31960]: mgrmap e19: x(active, since 13m), standbys: y, z 2024-06-13T02:17:41.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:40 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-06-13T02:17:41.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:40 smithi084 ceph-mon[36833]: mgrmap e19: x(active, since 13m), standbys: y, z 2024-06-13T02:17:41.221 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:40 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:40.739+0000 7f7eb278b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T02:17:41.221 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:40 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:40.824+0000 7f7eb278b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T02:17:41.631 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:41.155+0000 7fc86b1ff200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-13T02:17:41.631 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:41.278+0000 7fc86b1ff200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-13T02:17:42.282 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:41 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:41.988+0000 7ff3f3612200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T02:17:42.282 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:42 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:42.155+0000 7ff3f3612200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T02:17:42.335 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:41 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:41.997+0000 7f7eb278b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T02:17:42.336 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:42 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:42.165+0000 7f7eb278b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T02:17:42.611 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:42 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:42.324+0000 7ff3f3612200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T02:17:42.625 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:42 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:42.334+0000 7f7eb278b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T02:17:42.906 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:42 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:42.610+0000 7ff3f3612200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T02:17:42.906 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:42 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:42.703+0000 7ff3f3612200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T02:17:42.919 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:42 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:42.624+0000 7f7eb278b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T02:17:42.919 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:42 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:42.717+0000 7f7eb278b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T02:17:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.062+0000 7fa00ea00700 1 -- 172.21.15.2:0/4056190615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa008108500 msgr2=0x7fa0081088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.062+0000 7fa00ea00700 1 --2- 172.21.15.2:0/4056190615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa008108500 0x7fa0081088e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009990 tx=0x7f9ff8009ca0 comp rx=0 tx=0).stop 2024-06-13T02:17:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.063+0000 7fa00ea00700 1 -- 172.21.15.2:0/4056190615 shutdown_connections 2024-06-13T02:17:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.063+0000 7fa00ea00700 1 --2- 172.21.15.2:0/4056190615 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa00806ab30 0x7fa00810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.063+0000 7fa00ea00700 1 --2- 172.21.15.2:0/4056190615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa008108500 0x7fa0081088e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.063+0000 7fa00ea00700 1 --2- 172.21.15.2:0/4056190615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa00806a170 0x7fa00806a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.063+0000 7fa00ea00700 1 -- 172.21.15.2:0/4056190615 >> 172.21.15.2:0/4056190615 conn(0x7fa008078340 msgr2=0x7fa008078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.063+0000 7fa00ea00700 1 -- 172.21.15.2:0/4056190615 shutdown_connections 2024-06-13T02:17:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.063+0000 7fa00ea00700 1 -- 172.21.15.2:0/4056190615 wait complete. 2024-06-13T02:17:43.066 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:42 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:42.908+0000 7fc86b1ff200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-13T02:17:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.064+0000 7fa00ea00700 1 Processor -- start 2024-06-13T02:17:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.064+0000 7fa00ea00700 1 -- start start 2024-06-13T02:17:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.064+0000 7fa00ea00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa00806a170 0x7fa00819e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.064+0000 7fa00ea00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa00806ab30 0x7fa00819ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.064+0000 7fa00ea00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa008108500 0x7fa008198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.064+0000 7fa00ea00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081127b0 con 0x7fa00806a170 2024-06-13T02:17:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.064+0000 7fa00ea00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa008112630 con 0x7fa00806ab30 2024-06-13T02:17:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.064+0000 7fa00ea00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa008112930 con 0x7fa008108500 2024-06-13T02:17:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.065+0000 7f9fff400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa00806ab30 0x7fa00819ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.065+0000 7fa00ca00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa008108500 0x7fa008198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.065+0000 7f9fff400700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa00806ab30 0x7fa00819ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:34350/0 (socket says 172.21.15.2:34350) 2024-06-13T02:17:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.065+0000 7f9fff400700 1 -- 172.21.15.2:0/2667835528 learned_addr learned my addr 172.21.15.2:0/2667835528 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.065+0000 7fa007e00700 1 --2- 172.21.15.2:0/2667835528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa00806a170 0x7fa00819e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.065+0000 7f9fff400700 1 -- 172.21.15.2:0/2667835528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa008108500 msgr2=0x7fa008198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.065+0000 7f9fff400700 1 --2- 172.21.15.2:0/2667835528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa008108500 0x7fa008198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.065+0000 7f9fff400700 1 -- 172.21.15.2:0/2667835528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa00806a170 msgr2=0x7fa00819e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.065+0000 7f9fff400700 1 --2- 172.21.15.2:0/2667835528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa00806a170 0x7fa00819e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.065+0000 7f9fff400700 1 -- 172.21.15.2:0/2667835528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa008199250 con 0x7fa00806ab30 2024-06-13T02:17:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.065+0000 7fa00ca00700 1 --2- 172.21.15.2:0/2667835528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa008108500 0x7fa008198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.066+0000 7f9fff400700 1 --2- 172.21.15.2:0/2667835528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa00806ab30 0x7fa00819ee20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000e9a0 tx=0x7f9ff000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.066+0000 7fa005600700 1 -- 172.21.15.2:0/2667835528 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff000ca10 con 0x7fa00806ab30 2024-06-13T02:17:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.066+0000 7fa005600700 1 -- 172.21.15.2:0/2667835528 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ff000cbb0 con 0x7fa00806ab30 2024-06-13T02:17:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.066+0000 7fa005600700 1 -- 172.21.15.2:0/2667835528 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0018680 con 0x7fa00806ab30 2024-06-13T02:17:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.066+0000 7fa00ea00700 1 -- 172.21.15.2:0/2667835528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa008199540 con 0x7fa00806ab30 2024-06-13T02:17:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.066+0000 7fa00ea00700 1 -- 172.21.15.2:0/2667835528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0081a57b0 con 0x7fa00806ab30 2024-06-13T02:17:43.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.067+0000 7fa00ea00700 1 -- 172.21.15.2:0/2667835528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa00810a9e0 con 0x7fa00806ab30 2024-06-13T02:17:43.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.069+0000 7fa005600700 1 -- 172.21.15.2:0/2667835528 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) ==== 137849+0+0 (secure 0 0 0) 0x7f9ff0010430 con 0x7fa00806ab30 2024-06-13T02:17:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.071+0000 7fa005600700 1 --2- 172.21.15.2:0/2667835528 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9fec0a2cf0 0x7f9fec0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.071+0000 7fa007e00700 1 -- 172.21.15.2:0/2667835528 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9fec0a2cf0 msgr2=0x7f9fec0a51b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2988831869 2024-06-13T02:17:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.071+0000 7fa005600700 1 -- 172.21.15.2:0/2667835528 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7f9ff00cfb60 con 0x7fa00806ab30 2024-06-13T02:17:43.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.071+0000 7fa007e00700 1 --2- 172.21.15.2:0/2667835528 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9fec0a2cf0 0x7f9fec0a51b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T02:17:43.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.073+0000 7fa005600700 1 -- 172.21.15.2:0/2667835528 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9ff009c670 con 0x7fa00806ab30 2024-06-13T02:17:43.220 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:42 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:42.918+0000 7f7eb278b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T02:17:43.220 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:43 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:43.110+0000 7f7eb278b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:17:43.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.272+0000 7fa007e00700 1 -- 172.21.15.2:0/2667835528 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9fec0a2cf0 msgr2=0x7f9fec0a51b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2988831869 2024-06-13T02:17:43.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.272+0000 7fa007e00700 1 --2- 172.21.15.2:0/2667835528 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9fec0a2cf0 0x7f9fec0a51b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T02:17:43.282 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:42 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:42.904+0000 7ff3f3612200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T02:17:43.282 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:43 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:43.094+0000 7ff3f3612200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:17:43.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.348+0000 7fa00ea00700 1 -- 172.21.15.2:0/2667835528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa00810a3c0 con 0x7fa00806ab30 2024-06-13T02:17:43.350 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:43 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:43.152+0000 7fc86b1ff200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-13T02:17:43.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.349+0000 7fa005600700 1 -- 172.21.15.2:0/2667835528 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+88 (secure 0 0 0) 0x7f9ff009bf70 con 0x7fa00806ab30 2024-06-13T02:17:43.351 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-06-13T02:17:43.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.352+0000 7fa00ea00700 1 -- 172.21.15.2:0/2667835528 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9fec0a2cf0 msgr2=0x7f9fec0a51b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T02:17:43.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.352+0000 7fa00ea00700 1 --2- 172.21.15.2:0/2667835528 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9fec0a2cf0 0x7f9fec0a51b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:43.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.352+0000 7fa00ea00700 1 -- 172.21.15.2:0/2667835528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa00806ab30 msgr2=0x7fa00819ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:43.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.352+0000 7fa00ea00700 1 --2- 172.21.15.2:0/2667835528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa00806ab30 0x7fa00819ee20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000e9a0 tx=0x7f9ff000ecb0 comp rx=0 tx=0).stop 2024-06-13T02:17:43.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.352+0000 7fa00ea00700 1 -- 172.21.15.2:0/2667835528 shutdown_connections 2024-06-13T02:17:43.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.352+0000 7fa00ea00700 1 --2- 172.21.15.2:0/2667835528 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7f9fec0a2cf0 0x7f9fec0a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:43.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.352+0000 7fa00ea00700 1 --2- 172.21.15.2:0/2667835528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa008108500 0x7fa008198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:43.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.352+0000 7fa00ea00700 1 --2- 172.21.15.2:0/2667835528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa00806a170 0x7fa00819e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:43.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.352+0000 7fa00ea00700 1 --2- 172.21.15.2:0/2667835528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa00806ab30 0x7fa00819ee20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:43.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.352+0000 7fa00ea00700 1 -- 172.21.15.2:0/2667835528 >> 172.21.15.2:0/2667835528 conn(0x7fa008078340 msgr2=0x7fa0080fffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:43.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.352+0000 7fa00ea00700 1 -- 172.21.15.2:0/2667835528 shutdown_connections 2024-06-13T02:17:43.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:43.353+0000 7fa00ea00700 1 -- 172.21.15.2:0/2667835528 wait complete. 2024-06-13T02:17:43.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:43 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2667835528' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-13T02:17:44.231 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:43 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:43.378+0000 7fc86b1ff200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-13T02:17:44.231 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:43 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:43.784+0000 7fc86b1ff200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-13T02:17:44.231 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:43 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:43.913+0000 7fc86b1ff200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-13T02:17:44.232 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:43 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2667835528' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-13T02:17:44.232 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:43 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2667835528' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-13T02:17:44.232 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:43 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:43.712+0000 7f7eb278b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T02:17:44.232 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:43 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:43.693+0000 7ff3f3612200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T02:17:44.291 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-13T02:17:44.291 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-13T02:17:44.291 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-06-13T02:17:44.291 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-13T02:17:44.291 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-13T02:17:44.291 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-13T02:17:44.291 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-13T02:17:44.292 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-13T02:17:44.292 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-13T02:17:44.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:17:44.292 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-06-13T02:17:44.347 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-13T02:17:44.347 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-13T02:17:44.347 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-06-13T02:17:44.347 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-06-13T02:17:44.347 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-06-13T02:17:44.347 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-06-13T02:17:44.347 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T02:17:44.347 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-06-13T02:17:44.347 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-06-13T02:17:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T02:17:44.348 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-06-13T02:17:44.348 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-06-13T02:17:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-13T02:17:44.348 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-06-13T02:17:44.348 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-06-13T02:17:44.348 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-06-13T02:17:44.348 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 41634sec preferred_lft 41634sec 2024-06-13T02:17:44.348 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2024-06-13T02:17:44.348 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-06-13T02:17:44.348 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-13T02:17:44.348 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-06-13T02:17:44.348 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-06-13T02:17:44.349 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-13T02:17:44.349 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T02:17:44.349 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T02:17:44.350 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-06-13T02:17:44.350 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-06-13T02:17:44.350 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-06-13T02:17:44.350 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-13T02:17:44.350 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T02:17:44.403 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:44 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:44.107+0000 7ff3f3612200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T02:17:44.403 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:44 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:44.201+0000 7ff3f3612200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T02:17:44.404 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:44 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:44.402+0000 7ff3f3612200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T02:17:44.438 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:44 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:44.135+0000 7f7eb278b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T02:17:44.438 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:44 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:44.233+0000 7f7eb278b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T02:17:44.438 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:44 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:44.437+0000 7f7eb278b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T02:17:44.454 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:44 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:44.176+0000 7fc86b1ff200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-13T02:17:44.454 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:44 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:44.451+0000 7fc86b1ff200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-13T02:17:44.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T02:17:44.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:17:44.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:17:44.610 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-13T02:17:44.675 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-06-13T02:17:44.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:17:44.681 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-06-13T02:17:44.731 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-06-13T02:17:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-13T02:17:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-06-13T02:17:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-06-13T02:17:44.732 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-13T02:17:44.732 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T02:17:44.733 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T02:17:44.733 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-06-13T02:17:44.733 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-06-13T02:17:44.733 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-06-13T02:17:44.733 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T02:17:44.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T02:17:44.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:17:44.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:17:44.943 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-06-13T02:17:44.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:17:44.985 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-06-13T02:17:45.074 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T02:17:45.074 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T02:17:45.074 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-13T02:17:45.074 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-06-13T02:17:45.074 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T02:17:45.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T02:17:45.220 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:44 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:44.957+0000 7f7eb278b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T02:17:45.220 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:45.049+0000 7f7eb278b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T02:17:45.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:17:45.252 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:44 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:44.922+0000 7ff3f3612200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T02:17:45.253 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:45.013+0000 7ff3f3612200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T02:17:45.254 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-06-13T02:17:45.254 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T02:17:45.254 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T02:17:45.254 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-06-13T02:17:45.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-13T02:17:45.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-06-13T02:17:45.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-06-13T02:17:45.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-06-13T02:17:45.255 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T02:17:45.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T02:17:45.455 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:45 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:45.334+0000 7fc86b1ff200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-13T02:17:45.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:17:45.521 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-13T02:17:45.521 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-06-13T02:17:45.521 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-06-13T02:17:45.522 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-06-13T02:17:45.522 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-06-13T02:17:45.532 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:45.252+0000 7ff3f3612200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T02:17:45.533 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:45.385+0000 7ff3f3612200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T02:17:45.533 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:45.478+0000 7ff3f3612200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T02:17:45.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T02:17:45.635 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:45.293+0000 7f7eb278b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T02:17:45.635 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:45.426+0000 7f7eb278b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T02:17:45.635 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:45.520+0000 7f7eb278b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T02:17:45.635 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:45.634+0000 7f7eb278b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T02:17:45.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:17:45.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T02:17:45.720 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-13T02:17:45.762 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-13T02:17:45.763 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-13T02:17:45.763 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-13T02:17:45.852 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-06-13T02:17:45.852 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-06-13T02:17:45.852 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/15597729-d88c-4a88-b8de-9b3ee6cd87e6 2024-06-13T02:17:45.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:17:45.852 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/15597729-d88c-4a88-b8de-9b3ee6cd87e6 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-06-13T02:17:45.894 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:45.592+0000 7ff3f3612200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T02:17:45.963 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:45 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:45.935+0000 7fc86b1ff200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-13T02:17:46.018 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-06-13T02:17:46.018 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-06-13T02:17:46.019 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2024-06-13T02:17:46.220 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:45.932+0000 7f7eb278b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T02:17:46.282 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:45.893+0000 7ff3f3612200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T02:17:46.291 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:46 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:46.076+0000 7fc86b1ff200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-13T02:17:46.630 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:46 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:46.365+0000 7fc86b1ff200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-13T02:17:46.672 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-06-13T02:17:46.673 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-06-13T02:17:46.673 INFO:teuthology.orchestra.run.smithi002.stdout:invalid new device string format 2024-06-13T02:17:46.673 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.84:3300,172.21.15.175:3300" 2024-06-13T02:17:46.673 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.2:3300,172.21.15.84:3300,172.21.15.175:3300:/volumes/qa/sv_1/15597729-d88c-4a88-b8de-9b3ee6cd87e6 2024-06-13T02:17:46.673 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=efed8ab4-2928-11ef-bc9c-c7b262605968" will pass to kernel 2024-06-13T02:17:46.676 INFO:teuthology.orchestra.run.smithi002.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-06-13T02:17:46.677 INFO:teuthology.orchestra.run.smithi002.stdout: You just mounted a file system that supports labels which does not 2024-06-13T02:17:46.677 INFO:teuthology.orchestra.run.smithi002.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-13T02:17:46.677 INFO:teuthology.orchestra.run.smithi002.stdout: applications will generate AVC messages and not be allowed access to 2024-06-13T02:17:46.677 INFO:teuthology.orchestra.run.smithi002.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-13T02:17:46.681 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-13T02:17:46.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:17:46.681 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-13T02:17:46.760 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T02:17:46.782 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:46 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:46.496+0000 7ff3f3612200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T02:17:46.783 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:17:46 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z[38840]: 2024-06-13T02:17:46.713+0000 7ff3f3612200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T02:17:46.787 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:46 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:46.532+0000 7f7eb278b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T02:17:46.788 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:17:46 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y[38202]: 2024-06-13T02:17:46.749+0000 7f7eb278b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T02:17:46.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T02:17:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:17:46.873 INFO:teuthology.orchestra.run.smithi002.stdout:client25132 2024-06-13T02:17:46.873 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:17:46.873 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T02:17:46.917 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T02:17:47.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T02:17:47.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:46 smithi002 ceph-mon[31960]: Standby manager daemon z restarted 2024-06-13T02:17:47.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:46 smithi002 ceph-mon[31960]: Standby manager daemon z started 2024-06-13T02:17:47.065 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:46 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.175:0/90402790' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-13T02:17:47.066 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:46 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.175:0/90402790' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T02:17:47.066 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:46 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.175:0/90402790' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-13T02:17:47.066 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:46 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.175:0/90402790' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T02:17:47.066 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:46 smithi002 ceph-mon[31960]: Standby manager daemon y restarted 2024-06-13T02:17:47.066 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:46 smithi002 ceph-mon[31960]: Standby manager daemon y started 2024-06-13T02:17:47.066 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:46 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.84:0/4127844575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-13T02:17:47.066 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:46 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.84:0/4127844575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T02:17:47.066 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:46 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.84:0/4127844575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-13T02:17:47.066 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:46 smithi002 ceph-mon[31960]: from='mgr.? 172.21.15.84:0/4127844575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T02:17:47.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:17:47.075 INFO:teuthology.orchestra.run.smithi002.stdout:client25132 2024-06-13T02:17:47.075 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-13T02:17:47.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-13T02:17:47.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:17:47.190 INFO:teuthology.orchestra.run.smithi002.stdout:client25132 2024-06-13T02:17:47.191 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968.client25132/status') 2024-06-13T02:17:47.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:46 smithi084 ceph-mon[36833]: Standby manager daemon z restarted 2024-06-13T02:17:47.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:46 smithi084 ceph-mon[36833]: Standby manager daemon z started 2024-06-13T02:17:47.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:46 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.175:0/90402790' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-13T02:17:47.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:46 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.175:0/90402790' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T02:17:47.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:46 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.175:0/90402790' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-13T02:17:47.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:46 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.175:0/90402790' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T02:17:47.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:46 smithi084 ceph-mon[36833]: Standby manager daemon y restarted 2024-06-13T02:17:47.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:46 smithi084 ceph-mon[36833]: Standby manager daemon y started 2024-06-13T02:17:47.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:46 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.84:0/4127844575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-13T02:17:47.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:46 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.84:0/4127844575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T02:17:47.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:46 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.84:0/4127844575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-13T02:17:47.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:46 smithi084 ceph-mon[36833]: from='mgr.? 172.21.15.84:0/4127844575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T02:17:47.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:46 smithi175 ceph-mon[36977]: Standby manager daemon z restarted 2024-06-13T02:17:47.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:46 smithi175 ceph-mon[36977]: Standby manager daemon z started 2024-06-13T02:17:47.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:46 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.175:0/90402790' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-13T02:17:47.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:46 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.175:0/90402790' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T02:17:47.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:46 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.175:0/90402790' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-13T02:17:47.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:46 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.175:0/90402790' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T02:17:47.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:46 smithi175 ceph-mon[36977]: Standby manager daemon y restarted 2024-06-13T02:17:47.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:46 smithi175 ceph-mon[36977]: Standby manager daemon y started 2024-06-13T02:17:47.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:46 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.84:0/4127844575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-13T02:17:47.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:46 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.84:0/4127844575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-13T02:17:47.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:46 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.84:0/4127844575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-13T02:17:47.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:46 smithi175 ceph-mon[36977]: from='mgr.? 172.21.15.84:0/4127844575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-13T02:17:47.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-13T02:17:47.310 INFO:teuthology.orchestra.run.smithi002.stdout:instance: client.25132 (3)172.21.15.2:0/3457031772 2024-06-13T02:17:47.310 INFO:teuthology.orchestra.run.smithi002.stdout:blocklisted: false 2024-06-13T02:17:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records in 2024-06-13T02:17:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records out 2024-06-13T02:17:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:70 bytes copied, 9.6063e-05 s, 729 kB/s 2024-06-13T02:17:47.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-13T02:17:47.322 INFO:teuthology.run_tasks:Running task exec... 2024-06-13T02:17:47.331 INFO:teuthology.task.exec:Executing custom commands... 2024-06-13T02:17:47.331 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T02:17:47.331 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-06-13T02:17:47.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:47 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:47.063+0000 7fc86b1ff200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-13T02:17:47.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:47 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:47.197+0000 7fc86b1ff200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-13T02:17:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.533+0000 7fb011600640 1 -- 172.21.15.2:0/3125441143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb00c102300 msgr2=0x7fb00c108b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:47.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.533+0000 7fb011600640 1 --2- 172.21.15.2:0/3125441143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb00c102300 0x7fb00c108b90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb004009900 tx=0x7fb00402a410 comp rx=0 tx=0).stop 2024-06-13T02:17:47.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.533+0000 7fb011600640 1 -- 172.21.15.2:0/3125441143 shutdown_connections 2024-06-13T02:17:47.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.533+0000 7fb011600640 1 --2- 172.21.15.2:0/3125441143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb00c102300 0x7fb00c108b90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:47.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.533+0000 7fb011600640 1 --2- 172.21.15.2:0/3125441143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb00c101940 0x7fb00c101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:47.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.533+0000 7fb011600640 1 --2- 172.21.15.2:0/3125441143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb00c100750 0x7fb00c100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:47.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.533+0000 7fb011600640 1 -- 172.21.15.2:0/3125441143 >> 172.21.15.2:0/3125441143 conn(0x7fb00c0fbc80 msgr2=0x7fb00c0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:47.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.533+0000 7fb011600640 1 -- 172.21.15.2:0/3125441143 shutdown_connections 2024-06-13T02:17:47.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.533+0000 7fb011600640 1 -- 172.21.15.2:0/3125441143 wait complete. 2024-06-13T02:17:47.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.534+0000 7fb011600640 1 Processor -- start 2024-06-13T02:17:47.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.534+0000 7fb011600640 1 -- start start 2024-06-13T02:17:47.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.534+0000 7fb011600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb00c100750 0x7fb00c199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:47.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.534+0000 7fb011600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb00c101940 0x7fb00c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:47.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.534+0000 7fb011600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb00c102300 0x7fb00c1a1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:47.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.534+0000 7fb011600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c10c400 con 0x7fb00c101940 2024-06-13T02:17:47.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.534+0000 7fb011600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c10c280 con 0x7fb00c102300 2024-06-13T02:17:47.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.534+0000 7fb011600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb00c10c580 con 0x7fb00c100750 2024-06-13T02:17:47.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.535+0000 7fb00b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb00c101940 0x7fb00c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:47.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.535+0000 7fb010c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb00c102300 0x7fb00c1a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:47.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.535+0000 7fb00b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb00c101940 0x7fb00c19a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47616/0 (socket says 172.21.15.2:47616) 2024-06-13T02:17:47.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.535+0000 7fb00b400640 1 -- 172.21.15.2:0/1221683405 learned_addr learned my addr 172.21.15.2:0/1221683405 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:47.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.535+0000 7fb00be00640 1 --2- 172.21.15.2:0/1221683405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb00c100750 0x7fb00c199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:47.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.535+0000 7fb010c00640 1 -- 172.21.15.2:0/1221683405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb00c100750 msgr2=0x7fb00c199d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:47.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.535+0000 7fb010c00640 1 --2- 172.21.15.2:0/1221683405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb00c100750 0x7fb00c199d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:47.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.535+0000 7fb010c00640 1 -- 172.21.15.2:0/1221683405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb00c101940 msgr2=0x7fb00c19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:47.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.535+0000 7fb010c00640 1 --2- 172.21.15.2:0/1221683405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb00c101940 0x7fb00c19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:47.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.535+0000 7fb010c00640 1 -- 172.21.15.2:0/1221683405 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00c1a1910 con 0x7fb00c102300 2024-06-13T02:17:47.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.535+0000 7fb00b400640 1 --2- 172.21.15.2:0/1221683405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb00c101940 0x7fb00c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:47.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.536+0000 7fb010c00640 1 --2- 172.21.15.2:0/1221683405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb00c102300 0x7fb00c1a1270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb00402a930 tx=0x7fb004032c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:47.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.536+0000 7fb008c00640 1 -- 172.21.15.2:0/1221683405 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00403f030 con 0x7fb00c102300 2024-06-13T02:17:47.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.536+0000 7fb008c00640 1 -- 172.21.15.2:0/1221683405 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb004032e50 con 0x7fb00c102300 2024-06-13T02:17:47.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.536+0000 7fb011600640 1 -- 172.21.15.2:0/1221683405 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb00c1a1ba0 con 0x7fb00c102300 2024-06-13T02:17:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.536+0000 7fb008c00640 1 -- 172.21.15.2:0/1221683405 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb004035070 con 0x7fb00c102300 2024-06-13T02:17:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.536+0000 7fb011600640 1 -- 172.21.15.2:0/1221683405 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb00c1a2060 con 0x7fb00c102300 2024-06-13T02:17:47.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.537+0000 7fb011600640 1 -- 172.21.15.2:0/1221683405 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb00c1a2230 con 0x7fb00c102300 2024-06-13T02:17:47.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.539+0000 7fb008c00640 1 -- 172.21.15.2:0/1221683405 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 137849+0+0 (secure 0 0 0) 0x7fb004042030 con 0x7fb00c102300 2024-06-13T02:17:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.541+0000 7fb008c00640 1 --2- 172.21.15.2:0/1221683405 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faff00a2bc0 0x7faff00a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.541+0000 7fb00be00640 1 -- 172.21.15.2:0/1221683405 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faff00a2bc0 msgr2=0x7faff00a5080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2988831869 2024-06-13T02:17:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.541+0000 7fb008c00640 1 -- 172.21.15.2:0/1221683405 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fb0040ef8c0 con 0x7fb00c102300 2024-06-13T02:17:47.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.541+0000 7fb00be00640 1 --2- 172.21.15.2:0/1221683405 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faff00a2bc0 0x7faff00a5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T02:17:47.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.545+0000 7fb008c00640 1 -- 172.21.15.2:0/1221683405 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb0040bbd80 con 0x7fb00c102300 2024-06-13T02:17:47.737 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:47 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:47.543+0000 7fc86b1ff200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-13T02:17:47.737 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:47 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:47.735+0000 7fc86b1ff200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-13T02:17:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.742+0000 7fb00be00640 1 -- 172.21.15.2:0/1221683405 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faff00a2bc0 msgr2=0x7faff00a5080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2988831869 2024-06-13T02:17:47.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.742+0000 7fb00be00640 1 --2- 172.21.15.2:0/1221683405 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faff00a2bc0 0x7faff00a5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T02:17:47.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:47.790+0000 7fb011600640 1 -- 172.21.15.2:0/1221683405 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fb00c1a25c0 con 0x7fb00c102300 2024-06-13T02:17:48.047 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:47 smithi002 ceph-mon[31960]: mgrmap e20: x(active, since 13m), standbys: z, y 2024-06-13T02:17:48.047 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:47 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:47.875+0000 7fc86b1ff200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-13T02:17:48.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:48.143+0000 7fb00be00640 1 -- 172.21.15.2:0/1221683405 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faff00a2bc0 msgr2=0x7faff00a5080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2988831869 2024-06-13T02:17:48.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:48.143+0000 7fb00be00640 1 --2- 172.21.15.2:0/1221683405 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faff00a2bc0 0x7faff00a5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-13T02:17:48.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:47 smithi084 ceph-mon[36833]: mgrmap e20: x(active, since 13m), standbys: z, y 2024-06-13T02:17:48.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:47 smithi175 ceph-mon[36977]: mgrmap e20: x(active, since 13m), standbys: z, y 2024-06-13T02:17:48.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:48 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:48.045+0000 7fc86b1ff200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-13T02:17:48.792 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:48 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:48.434+0000 7fc86b1ff200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-13T02:17:48.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:48.804+0000 7fb008c00640 1 -- 172.21.15.2:0/1221683405 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7fb0040c0080 con 0x7fb00c102300 2024-06-13T02:17:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:48.807+0000 7fb011600640 1 -- 172.21.15.2:0/1221683405 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faff00a2bc0 msgr2=0x7faff00a5080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T02:17:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:48.807+0000 7fb011600640 1 --2- 172.21.15.2:0/1221683405 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faff00a2bc0 0x7faff00a5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:48.807+0000 7fb011600640 1 -- 172.21.15.2:0/1221683405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb00c102300 msgr2=0x7fb00c1a1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:48.807+0000 7fb011600640 1 --2- 172.21.15.2:0/1221683405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb00c102300 0x7fb00c1a1270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb00402a930 tx=0x7fb004032c60 comp rx=0 tx=0).stop 2024-06-13T02:17:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:48.807+0000 7fb011600640 1 -- 172.21.15.2:0/1221683405 shutdown_connections 2024-06-13T02:17:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:48.807+0000 7fb011600640 1 --2- 172.21.15.2:0/1221683405 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7faff00a2bc0 0x7faff00a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:48.807+0000 7fb011600640 1 --2- 172.21.15.2:0/1221683405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb00c102300 0x7fb00c1a1270 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:48.807+0000 7fb011600640 1 --2- 172.21.15.2:0/1221683405 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb00c101940 0x7fb00c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:48.807+0000 7fb011600640 1 --2- 172.21.15.2:0/1221683405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb00c100750 0x7fb00c199d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:48.807+0000 7fb011600640 1 -- 172.21.15.2:0/1221683405 >> 172.21.15.2:0/1221683405 conn(0x7fb00c0fbc80 msgr2=0x7fb00c069170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:48.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:48.807+0000 7fb011600640 1 -- 172.21.15.2:0/1221683405 shutdown_connections 2024-06-13T02:17:48.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:48.807+0000 7fb011600640 1 -- 172.21.15.2:0/1221683405 wait complete. 2024-06-13T02:17:48.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-06-13T02:17:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.016+0000 7fb569e00640 1 -- 172.21.15.2:0/3490439953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb564100120 msgr2=0x7fb564100540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.016+0000 7fb569e00640 1 --2- 172.21.15.2:0/3490439953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb564100120 0x7fb564100540 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb558009900 tx=0x7fb55802a3f0 comp rx=0 tx=0).stop 2024-06-13T02:17:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.016+0000 7fb569e00640 1 -- 172.21.15.2:0/3490439953 shutdown_connections 2024-06-13T02:17:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.016+0000 7fb569e00640 1 --2- 172.21.15.2:0/3490439953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb564101420 0x7fb5641018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.016+0000 7fb569e00640 1 --2- 172.21.15.2:0/3490439953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb564100a80 0x7fb564100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.016+0000 7fb569e00640 1 --2- 172.21.15.2:0/3490439953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb564100120 0x7fb564100540 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.016+0000 7fb569e00640 1 -- 172.21.15.2:0/3490439953 >> 172.21.15.2:0/3490439953 conn(0x7fb5640fbc80 msgr2=0x7fb5640fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.016+0000 7fb569e00640 1 -- 172.21.15.2:0/3490439953 shutdown_connections 2024-06-13T02:17:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.016+0000 7fb569e00640 1 -- 172.21.15.2:0/3490439953 wait complete. 2024-06-13T02:17:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.017+0000 7fb569e00640 1 Processor -- start 2024-06-13T02:17:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.018+0000 7fb569e00640 1 -- start start 2024-06-13T02:17:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.018+0000 7fb569e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb564100120 0x7fb564199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.018+0000 7fb569e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb564100a80 0x7fb56419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.018+0000 7fb569e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb564101420 0x7fb5641a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:49.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.018+0000 7fb569e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb56410f700 con 0x7fb564100a80 2024-06-13T02:17:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.018+0000 7fb569e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb56410f580 con 0x7fb564100120 2024-06-13T02:17:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.018+0000 7fb569e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb56410f880 con 0x7fb564101420 2024-06-13T02:17:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.018+0000 7fb563e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb564100a80 0x7fb56419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.018+0000 7fb568a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb564100120 0x7fb564199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.018+0000 7fb563e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb564100a80 0x7fb56419a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47626/0 (socket says 172.21.15.2:47626) 2024-06-13T02:17:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.018+0000 7fb563e00640 1 -- 172.21.15.2:0/4246269017 learned_addr learned my addr 172.21.15.2:0/4246269017 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.018+0000 7fb569400640 1 --2- 172.21.15.2:0/4246269017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb564101420 0x7fb5641a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.019+0000 7fb568a00640 1 -- 172.21.15.2:0/4246269017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb564101420 msgr2=0x7fb5641a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.019+0000 7fb568a00640 1 --2- 172.21.15.2:0/4246269017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb564101420 0x7fb5641a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.019+0000 7fb568a00640 1 -- 172.21.15.2:0/4246269017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb564100a80 msgr2=0x7fb56419a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.019+0000 7fb568a00640 1 --2- 172.21.15.2:0/4246269017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb564100a80 0x7fb56419a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.019+0000 7fb568a00640 1 -- 172.21.15.2:0/4246269017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5641a1960 con 0x7fb564100120 2024-06-13T02:17:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.019+0000 7fb563e00640 1 --2- 172.21.15.2:0/4246269017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb564100a80 0x7fb56419a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:49.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.019+0000 7fb568a00640 1 --2- 172.21.15.2:0/4246269017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb564100120 0x7fb564199dc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb55802a910 tx=0x7fb558032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.020+0000 7fb561600640 1 -- 172.21.15.2:0/4246269017 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55803f030 con 0x7fb564100120 2024-06-13T02:17:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.020+0000 7fb561600640 1 -- 172.21.15.2:0/4246269017 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb558003ce0 con 0x7fb564100120 2024-06-13T02:17:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.020+0000 7fb561600640 1 -- 172.21.15.2:0/4246269017 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb558035070 con 0x7fb564100120 2024-06-13T02:17:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.020+0000 7fb569e00640 1 -- 172.21.15.2:0/4246269017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5641a1bf0 con 0x7fb564100120 2024-06-13T02:17:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.020+0000 7fb569e00640 1 -- 172.21.15.2:0/4246269017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5641a2060 con 0x7fb564100120 2024-06-13T02:17:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.021+0000 7fb569e00640 1 -- 172.21.15.2:0/4246269017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb56410ae70 con 0x7fb564100120 2024-06-13T02:17:49.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.023+0000 7fb561600640 1 -- 172.21.15.2:0/4246269017 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 137849+0+0 (secure 0 0 0) 0x7fb558042030 con 0x7fb564100120 2024-06-13T02:17:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.024+0000 7fb561600640 1 --2- 172.21.15.2:0/4246269017 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb54c0a2bc0 0x7fb54c0a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.024+0000 7fb561600640 1 -- 172.21.15.2:0/4246269017 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9237+0+0 (secure 0 0 0) 0x7fb5580ef930 con 0x7fb564100120 2024-06-13T02:17:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.025+0000 7fb563e00640 1 -- 172.21.15.2:0/4246269017 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb54c0a2bc0 msgr2=0x7fb54c0a5080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2988831869 2024-06-13T02:17:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.025+0000 7fb563e00640 1 --2- 172.21.15.2:0/4246269017 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb54c0a2bc0 0x7fb54c0a5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-13T02:17:49.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.029+0000 7fb561600640 1 -- 172.21.15.2:0/4246269017 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fb5580bbdf0 con 0x7fb564100120 2024-06-13T02:17:49.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:48 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1221683405' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-13T02:17:49.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:48 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-13T02:17:49.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:48 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1221683405' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-13T02:17:49.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:48 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-13T02:17:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.226+0000 7fb563e00640 1 -- 172.21.15.2:0/4246269017 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb54c0a2bc0 msgr2=0x7fb54c0a5080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.2:6800/2988831869 2024-06-13T02:17:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.226+0000 7fb563e00640 1 --2- 172.21.15.2:0/4246269017 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb54c0a2bc0 0x7fb54c0a5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-13T02:17:49.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.263+0000 7fb569e00640 1 -- 172.21.15.2:0/4246269017 --> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7fb564061e80 con 0x7fb54c0a2bc0 2024-06-13T02:17:49.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:48 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1221683405' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-13T02:17:49.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:48 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-13T02:17:49.556 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:49.248+0000 7fc86b1ff200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-13T02:17:49.556 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:49.554+0000 7fc86b1ff200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-13T02:17:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.579+0000 7fb561600640 1 -- 172.21.15.2:0/4246269017 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 21) ==== 137518+0+0 (secure 0 0 0) 0x7fb55803b460 con 0x7fb564100120 2024-06-13T02:17:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.581+0000 7fb561600640 1 -- 172.21.15.2:0/4246269017 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb54c0a2bc0 msgr2=0x7fb54c0a5080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-13T02:17:49.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:49.581+0000 7fb561600640 1 --2- 172.21.15.2:0/4246269017 >> [v2:172.21.15.2:6800/2988831869,v1:172.21.15.2:6801/2988831869] conn(0x7fb54c0a2bc0 0x7fb54c0a5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:49.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-06-13T02:17:49.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:17:49.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: Active manager daemon x restarted 2024-06-13T02:17:49.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: Activating manager daemon x 2024-06-13T02:17:49.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: osdmap e101: 12 total, 12 up, 12 in 2024-06-13T02:17:49.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: mgrmap e21: x(active, starting, since 0.025336s), standbys: z, y 2024-06-13T02:17:49.807 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:17:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:17:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:17:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-13T02:17:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-13T02:17:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-13T02:17:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-13T02:17:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-13T02:17:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-13T02:17:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T02:17:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T02:17:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:17:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T02:17:49.808 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-13T02:17:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T02:17:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-13T02:17:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-13T02:17:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-13T02:17:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:17:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:17:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:17:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:17:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:17:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:17:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:17:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:17:49.809 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:17:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:17:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:17:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:17:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-13T02:17:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-13T02:17:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-13T02:17:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: Manager daemon x is now available 2024-06-13T02:17:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:17:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T02:17:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T02:17:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T02:17:49.810 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T02:17:50.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-06-13T02:17:50.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:17:50.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: Active manager daemon x restarted 2024-06-13T02:17:50.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: Activating manager daemon x 2024-06-13T02:17:50.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: osdmap e101: 12 total, 12 up, 12 in 2024-06-13T02:17:50.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: mgrmap e21: x(active, starting, since 0.025336s), standbys: z, y 2024-06-13T02:17:50.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:17:50.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:17:50.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:17:50.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-13T02:17:50.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-13T02:17:50.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-13T02:17:50.035 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-13T02:17:50.035 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-13T02:17:50.035 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-13T02:17:50.035 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T02:17:50.035 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T02:17:50.035 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:17:50.035 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T02:17:50.035 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-13T02:17:50.035 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T02:17:50.035 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-13T02:17:50.035 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-13T02:17:50.035 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-13T02:17:50.036 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:17:50.036 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:17:50.036 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:17:50.036 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:17:50.036 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:17:50.036 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:17:50.036 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:17:50.036 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:17:50.036 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:17:50.036 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:17:50.036 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:17:50.036 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:17:50.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-13T02:17:50.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-13T02:17:50.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-13T02:17:50.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: Manager daemon x is now available 2024-06-13T02:17:50.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:17:50.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T02:17:50.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T02:17:50.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T02:17:50.037 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:49 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T02:17:50.131 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:49.894+0000 7fc7c0200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:17:50.131 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:49.894+0000 7fc7c0200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:17:50.131 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:49.894+0000 7fc7c0200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:17:50.131 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:49.894+0000 7fc7c0200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:17:50.131 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:49.894+0000 7fc7c0200700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:17:50.131 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:49.894+0000 7fc7bda00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:17:50.131 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:49.894+0000 7fc7bda00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:17:50.131 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:49.894+0000 7fc7bda00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:17:50.132 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:49.894+0000 7fc7bda00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:17:50.132 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:49.894+0000 7fc7bda00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:17:50.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-06-13T02:17:50.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:17:50.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: Active manager daemon x restarted 2024-06-13T02:17:50.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: Activating manager daemon x 2024-06-13T02:17:50.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: osdmap e101: 12 total, 12 up, 12 in 2024-06-13T02:17:50.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: mgrmap e21: x(active, starting, since 0.025336s), standbys: z, y 2024-06-13T02:17:50.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-13T02:17:50.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-13T02:17:50.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-13T02:17:50.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-13T02:17:50.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-13T02:17:50.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-13T02:17:50.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-13T02:17:50.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-13T02:17:50.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-13T02:17:50.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T02:17:50.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T02:17:50.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:17:50.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T02:17:50.222 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-13T02:17:50.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T02:17:50.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-13T02:17:50.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-13T02:17:50.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-13T02:17:50.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-13T02:17:50.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-13T02:17:50.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-13T02:17:50.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-13T02:17:50.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-13T02:17:50.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-13T02:17:50.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-13T02:17:50.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-13T02:17:50.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-13T02:17:50.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-13T02:17:50.224 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-13T02:17:50.224 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-13T02:17:50.224 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-13T02:17:50.224 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-13T02:17:50.224 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-13T02:17:50.224 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: Manager daemon x is now available 2024-06-13T02:17:50.224 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:17:50.224 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T02:17:50.224 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-13T02:17:50.224 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T02:17:50.224 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:49 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-13T02:17:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.591+0000 7fb561600640 1 -- 172.21.15.2:0/4246269017 <== mon.2 v2:172.21.15.84:3300/0 8 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7fb558046d70 con 0x7fb564100120 2024-06-13T02:17:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.592+0000 7fb561600640 1 --2- 172.21.15.2:0/4246269017 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fb54c051860 0x7fb54c051c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.592+0000 7fb561600640 1 -- 172.21.15.2:0/4246269017 --> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7fb558041e80 con 0x7fb54c051860 2024-06-13T02:17:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.606+0000 7fb563e00640 1 --2- 172.21.15.2:0/4246269017 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fb54c051860 0x7fb54c051c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:50.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.612+0000 7fb563e00640 1 --2- 172.21.15.2:0/4246269017 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fb54c051860 0x7fb54c051c40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb550009c60 tx=0x7fb550005f90 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:50.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.640+0000 7fb561600640 1 -- 172.21.15.2:0/4246269017 <== mgr.25123 v2:172.21.15.2:6800/2181612853 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7fb558041e80 con 0x7fb54c051860 2024-06-13T02:17:50.641 INFO:teuthology.orchestra.run.smithi002.stdout:{} 2024-06-13T02:17:50.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.643+0000 7fb569e00640 1 -- 172.21.15.2:0/4246269017 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fb54c051860 msgr2=0x7fb54c051c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:50.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.643+0000 7fb569e00640 1 --2- 172.21.15.2:0/4246269017 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fb54c051860 0x7fb54c051c40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb550009c60 tx=0x7fb550005f90 comp rx=0 tx=0).stop 2024-06-13T02:17:50.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.643+0000 7fb569e00640 1 -- 172.21.15.2:0/4246269017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb564100120 msgr2=0x7fb564199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:50.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.643+0000 7fb569e00640 1 --2- 172.21.15.2:0/4246269017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb564100120 0x7fb564199dc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb55802a910 tx=0x7fb558032ce0 comp rx=0 tx=0).stop 2024-06-13T02:17:50.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.643+0000 7fb569400640 1 -- 172.21.15.2:0/4246269017 reap_dead start 2024-06-13T02:17:50.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.643+0000 7fb569e00640 1 -- 172.21.15.2:0/4246269017 shutdown_connections 2024-06-13T02:17:50.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.643+0000 7fb569e00640 1 -- 172.21.15.2:0/4246269017 >> 172.21.15.2:0/4246269017 conn(0x7fb5640fbc80 msgr2=0x7fb5640ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:50.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.643+0000 7fb569e00640 1 -- 172.21.15.2:0/4246269017 shutdown_connections 2024-06-13T02:17:50.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.643+0000 7fb569e00640 1 -- 172.21.15.2:0/4246269017 wait complete. 2024-06-13T02:17:50.662 INFO:teuthology.run_tasks:Running task check-counter... 2024-06-13T02:17:50.673 INFO:teuthology.run_tasks:Running task exec... 2024-06-13T02:17:50.712 INFO:teuthology.task.exec:Executing custom commands... 2024-06-13T02:17:50.712 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T02:17:50.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-06-13T02:17:50.882 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:50 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:50.622+0000 7fc7b9e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:17:50.882 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:50 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:50.622+0000 7fc7b9e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:17:50.883 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:50 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:50.622+0000 7fc7b9e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:17:50.883 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:50 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:50.622+0000 7fc7b9e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:17:50.883 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:17:50 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:17:50.622+0000 7fc7b9e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:17:50.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.891+0000 7fd831400640 1 -- 172.21.15.2:0/2606473614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd82c103410 msgr2=0x7fd82c109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:50.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.891+0000 7fd831400640 1 --2- 172.21.15.2:0/2606473614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd82c103410 0x7fd82c109ca0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd824009ca0 tx=0x7fd82402a8c0 comp rx=0 tx=0).stop 2024-06-13T02:17:50.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.891+0000 7fd831400640 1 -- 172.21.15.2:0/2606473614 shutdown_connections 2024-06-13T02:17:50.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.891+0000 7fd831400640 1 --2- 172.21.15.2:0/2606473614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd82c103410 0x7fd82c109ca0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:50.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.891+0000 7fd831400640 1 --2- 172.21.15.2:0/2606473614 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd82c102a50 0x7fd82c102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:50.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.891+0000 7fd831400640 1 --2- 172.21.15.2:0/2606473614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c101860 0x7fd82c101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:50.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.891+0000 7fd831400640 1 -- 172.21.15.2:0/2606473614 >> 172.21.15.2:0/2606473614 conn(0x7fd82c0fcdd0 msgr2=0x7fd82c0ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:50.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.891+0000 7fd831400640 1 -- 172.21.15.2:0/2606473614 shutdown_connections 2024-06-13T02:17:50.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.891+0000 7fd831400640 1 -- 172.21.15.2:0/2606473614 wait complete. 2024-06-13T02:17:50.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.892+0000 7fd831400640 1 Processor -- start 2024-06-13T02:17:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.892+0000 7fd831400640 1 -- start start 2024-06-13T02:17:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.893+0000 7fd831400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c101860 0x7fd82c197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.893+0000 7fd831400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd82c102a50 0x7fd82c198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.893+0000 7fd831400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd82c103410 0x7fd82c19f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.893+0000 7fd831400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c10d4c0 con 0x7fd82c103410 2024-06-13T02:17:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.893+0000 7fd831400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c10d340 con 0x7fd82c102a50 2024-06-13T02:17:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.893+0000 7fd831400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c10d640 con 0x7fd82c101860 2024-06-13T02:17:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.893+0000 7fd830a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd82c103410 0x7fd82c19f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.893+0000 7fd82be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c101860 0x7fd82c197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.893+0000 7fd82b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd82c102a50 0x7fd82c198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.893+0000 7fd82be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c101860 0x7fd82c197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:41598/0 (socket says 172.21.15.2:41598) 2024-06-13T02:17:50.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.893+0000 7fd82be00640 1 -- 172.21.15.2:0/3505781450 learned_addr learned my addr 172.21.15.2:0/3505781450 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.893+0000 7fd82be00640 1 -- 172.21.15.2:0/3505781450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd82c102a50 msgr2=0x7fd82c198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.893+0000 7fd82be00640 1 --2- 172.21.15.2:0/3505781450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd82c102a50 0x7fd82c198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.893+0000 7fd82be00640 1 -- 172.21.15.2:0/3505781450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd82c103410 msgr2=0x7fd82c19f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.893+0000 7fd82be00640 1 --2- 172.21.15.2:0/3505781450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd82c103410 0x7fd82c19f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.894+0000 7fd82be00640 1 -- 172.21.15.2:0/3505781450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd82c19f720 con 0x7fd82c101860 2024-06-13T02:17:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.894+0000 7fd82b400640 1 --2- 172.21.15.2:0/3505781450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd82c102a50 0x7fd82c198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.894+0000 7fd82be00640 1 --2- 172.21.15.2:0/3505781450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c101860 0x7fd82c197b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00d950 tx=0x7fd81c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.894+0000 7fd828c00640 1 -- 172.21.15.2:0/3505781450 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c017020 con 0x7fd82c101860 2024-06-13T02:17:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.894+0000 7fd831400640 1 -- 172.21.15.2:0/3505781450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd82c19fa10 con 0x7fd82c101860 2024-06-13T02:17:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.894+0000 7fd828c00640 1 -- 172.21.15.2:0/3505781450 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd81c009c30 con 0x7fd82c101860 2024-06-13T02:17:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.894+0000 7fd828c00640 1 -- 172.21.15.2:0/3505781450 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c00f6b0 con 0x7fd82c101860 2024-06-13T02:17:50.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.894+0000 7fd831400640 1 -- 172.21.15.2:0/3505781450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd82c19ff60 con 0x7fd82c101860 2024-06-13T02:17:50.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.896+0000 7fd831400640 1 -- 172.21.15.2:0/3505781450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd82c068240 con 0x7fd82c101860 2024-06-13T02:17:50.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.898+0000 7fd828c00640 1 -- 172.21.15.2:0/3505781450 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7fd81c01a020 con 0x7fd82c101860 2024-06-13T02:17:50.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.899+0000 7fd828c00640 1 --2- 172.21.15.2:0/3505781450 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd8100a2970 0x7fd8100a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.899+0000 7fd828c00640 1 -- 172.21.15.2:0/3505781450 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fd81c0cf0f0 con 0x7fd82c101860 2024-06-13T02:17:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.900+0000 7fd82b400640 1 --2- 172.21.15.2:0/3505781450 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd8100a2970 0x7fd8100a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:50.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.900+0000 7fd82b400640 1 --2- 172.21.15.2:0/3505781450 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd8100a2970 0x7fd8100a4e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd82c199010 tx=0x7fd818005f90 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:50.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:50.904+0000 7fd828c00640 1 -- 172.21.15.2:0/3505781450 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd81c021020 con 0x7fd82c101860 2024-06-13T02:17:51.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.152+0000 7fd831400640 1 -- 172.21.15.2:0/3505781450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fd82c062610 con 0x7fd82c101860 2024-06-13T02:17:51.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.159+0000 7fd828c00640 1 -- 172.21.15.2:0/3505781450 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v28)=0 v28) ==== 129+0+0 (secure 0 0 0) 0x7fd81c09be10 con 0x7fd82c101860 2024-06-13T02:17:51.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.162+0000 7fd831400640 1 -- 172.21.15.2:0/3505781450 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd8100a2970 msgr2=0x7fd8100a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:51.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.162+0000 7fd831400640 1 --2- 172.21.15.2:0/3505781450 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd8100a2970 0x7fd8100a4e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd82c199010 tx=0x7fd818005f90 comp rx=0 tx=0).stop 2024-06-13T02:17:51.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.162+0000 7fd831400640 1 -- 172.21.15.2:0/3505781450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c101860 msgr2=0x7fd82c197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:51.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.163+0000 7fd831400640 1 --2- 172.21.15.2:0/3505781450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c101860 0x7fd82c197b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00d950 tx=0x7fd81c00de10 comp rx=0 tx=0).stop 2024-06-13T02:17:51.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.163+0000 7fd831400640 1 -- 172.21.15.2:0/3505781450 shutdown_connections 2024-06-13T02:17:51.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.163+0000 7fd831400640 1 --2- 172.21.15.2:0/3505781450 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd8100a2970 0x7fd8100a4e30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.163+0000 7fd831400640 1 --2- 172.21.15.2:0/3505781450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd82c103410 0x7fd82c19f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.163+0000 7fd831400640 1 --2- 172.21.15.2:0/3505781450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd82c102a50 0x7fd82c198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.163+0000 7fd831400640 1 --2- 172.21.15.2:0/3505781450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c101860 0x7fd82c197b00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.163+0000 7fd831400640 1 -- 172.21.15.2:0/3505781450 >> 172.21.15.2:0/3505781450 conn(0x7fd82c0fcdd0 msgr2=0x7fd82c105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:51.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.163+0000 7fd831400640 1 -- 172.21.15.2:0/3505781450 shutdown_connections 2024-06-13T02:17:51.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.163+0000 7fd831400640 1 -- 172.21.15.2:0/3505781450 wait complete. 2024-06-13T02:17:51.188 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-06-13T02:17:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.360+0000 7fbded000640 1 -- 172.21.15.2:0/1570338660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbde8109c00 msgr2=0x7fbde8110490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.360+0000 7fbded000640 1 --2- 172.21.15.2:0/1570338660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbde8109c00 0x7fbde8110490 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009ca0 tx=0x7fbde002a8c0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.360+0000 7fbded000640 1 -- 172.21.15.2:0/1570338660 shutdown_connections 2024-06-13T02:17:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.360+0000 7fbded000640 1 --2- 172.21.15.2:0/1570338660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbde8109c00 0x7fbde8110490 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.360+0000 7fbded000640 1 --2- 172.21.15.2:0/1570338660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbde8109240 0x7fbde81096c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.360+0000 7fbded000640 1 --2- 172.21.15.2:0/1570338660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbde81080a0 0x7fbde81084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.360+0000 7fbded000640 1 -- 172.21.15.2:0/1570338660 >> 172.21.15.2:0/1570338660 conn(0x7fbde8076ff0 msgr2=0x7fbde8079430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:51.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.360+0000 7fbded000640 1 -- 172.21.15.2:0/1570338660 shutdown_connections 2024-06-13T02:17:51.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.360+0000 7fbded000640 1 -- 172.21.15.2:0/1570338660 wait complete. 2024-06-13T02:17:51.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.361+0000 7fbded000640 1 Processor -- start 2024-06-13T02:17:51.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.361+0000 7fbded000640 1 -- start start 2024-06-13T02:17:51.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.362+0000 7fbded000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbde81080a0 0x7fbde819e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:51.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.362+0000 7fbded000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbde8109240 0x7fbde819e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:51.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.362+0000 7fbded000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbde8109c00 0x7fbde81a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:51.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.362+0000 7fbded000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbde8113cf0 con 0x7fbde8109c00 2024-06-13T02:17:51.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.362+0000 7fbded000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbde8113b70 con 0x7fbde8109240 2024-06-13T02:17:51.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.362+0000 7fbded000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbde8113e70 con 0x7fbde81080a0 2024-06-13T02:17:51.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.362+0000 7fbde6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbde8109c00 0x7fbde81a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:51.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.362+0000 7fbde6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbde8109c00 0x7fbde81a5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47764/0 (socket says 172.21.15.2:47764) 2024-06-13T02:17:51.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.362+0000 7fbde6800640 1 -- 172.21.15.2:0/496039437 learned_addr learned my addr 172.21.15.2:0/496039437 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:51.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.362+0000 7fbde5e00640 1 --2- 172.21.15.2:0/496039437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbde81080a0 0x7fbde819e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:51.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.362+0000 7fbddd400640 1 --2- 172.21.15.2:0/496039437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbde8109240 0x7fbde819e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:51.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.362+0000 7fbde6800640 1 -- 172.21.15.2:0/496039437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbde81080a0 msgr2=0x7fbde819e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:51.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.362+0000 7fbde6800640 1 --2- 172.21.15.2:0/496039437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbde81080a0 0x7fbde819e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.362+0000 7fbde6800640 1 -- 172.21.15.2:0/496039437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbde8109240 msgr2=0x7fbde819e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:51.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.362+0000 7fbde6800640 1 --2- 172.21.15.2:0/496039437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbde8109240 0x7fbde819e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.363+0000 7fbde6800640 1 -- 172.21.15.2:0/496039437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde81a5ef0 con 0x7fbde8109c00 2024-06-13T02:17:51.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.363+0000 7fbde6800640 1 --2- 172.21.15.2:0/496039437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbde8109c00 0x7fbde81a5880 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009430 tx=0x7fbde00319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:51.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.363+0000 7fbddf400640 1 -- 172.21.15.2:0/496039437 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde0003b70 con 0x7fbde8109c00 2024-06-13T02:17:51.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.363+0000 7fbded000640 1 -- 172.21.15.2:0/496039437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde81a6180 con 0x7fbde8109c00 2024-06-13T02:17:51.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.363+0000 7fbddf400640 1 -- 172.21.15.2:0/496039437 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbde0003d10 con 0x7fbde8109c00 2024-06-13T02:17:51.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.363+0000 7fbddf400640 1 -- 172.21.15.2:0/496039437 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde002fc50 con 0x7fbde8109c00 2024-06-13T02:17:51.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.363+0000 7fbded000640 1 -- 172.21.15.2:0/496039437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde81a66d0 con 0x7fbde8109c00 2024-06-13T02:17:51.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.364+0000 7fbded000640 1 -- 172.21.15.2:0/496039437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde810f370 con 0x7fbde8109c00 2024-06-13T02:17:51.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.366+0000 7fbddf400640 1 -- 172.21.15.2:0/496039437 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7fbde0004040 con 0x7fbde8109c00 2024-06-13T02:17:51.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.367+0000 7fbddf400640 1 --2- 172.21.15.2:0/496039437 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fbdcc0a2970 0x7fbdcc0a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:51.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.368+0000 7fbddf400640 1 -- 172.21.15.2:0/496039437 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fbde00f0600 con 0x7fbde8109c00 2024-06-13T02:17:51.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.368+0000 7fbde5e00640 1 --2- 172.21.15.2:0/496039437 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fbdcc0a2970 0x7fbdcc0a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:51.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.368+0000 7fbde5e00640 1 --2- 172.21.15.2:0/496039437 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fbdcc0a2970 0x7fbdcc0a4e30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbde81090a0 tx=0x7fbdd8005f90 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:51.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.372+0000 7fbddf400640 1 -- 172.21.15.2:0/496039437 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fbde00bd320 con 0x7fbde8109c00 2024-06-13T02:17:51.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.586+0000 7fbded000640 1 -- 172.21.15.2:0/496039437 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fbde80625a0 con 0x7fbde8109c00 2024-06-13T02:17:51.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.592+0000 7fbddf400640 1 -- 172.21.15.2:0/496039437 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7fbde00bcc20 con 0x7fbde8109c00 2024-06-13T02:17:51.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.595+0000 7fbded000640 1 -- 172.21.15.2:0/496039437 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fbdcc0a2970 msgr2=0x7fbdcc0a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:51.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.595+0000 7fbded000640 1 --2- 172.21.15.2:0/496039437 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fbdcc0a2970 0x7fbdcc0a4e30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbde81090a0 tx=0x7fbdd8005f90 comp rx=0 tx=0).stop 2024-06-13T02:17:51.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.595+0000 7fbded000640 1 -- 172.21.15.2:0/496039437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbde8109c00 msgr2=0x7fbde81a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:51.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.595+0000 7fbded000640 1 --2- 172.21.15.2:0/496039437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbde8109c00 0x7fbde81a5880 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009430 tx=0x7fbde00319f0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.596+0000 7fbded000640 1 -- 172.21.15.2:0/496039437 shutdown_connections 2024-06-13T02:17:51.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.596+0000 7fbded000640 1 --2- 172.21.15.2:0/496039437 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fbdcc0a2970 0x7fbdcc0a4e30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.596+0000 7fbded000640 1 --2- 172.21.15.2:0/496039437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbde8109c00 0x7fbde81a5880 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.596+0000 7fbded000640 1 --2- 172.21.15.2:0/496039437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbde8109240 0x7fbde819e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.596+0000 7fbded000640 1 --2- 172.21.15.2:0/496039437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbde81080a0 0x7fbde819e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.596+0000 7fbded000640 1 -- 172.21.15.2:0/496039437 >> 172.21.15.2:0/496039437 conn(0x7fbde8076ff0 msgr2=0x7fbde810c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.596+0000 7fbded000640 1 -- 172.21.15.2:0/496039437 shutdown_connections 2024-06-13T02:17:51.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.596+0000 7fbded000640 1 -- 172.21.15.2:0/496039437 wait complete. 2024-06-13T02:17:51.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-06-13T02:17:51.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.804+0000 7fd487400640 1 -- 172.21.15.2:0/2722865782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd480104df0 msgr2=0x7fd4801071e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:51.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.804+0000 7fd487400640 1 --2- 172.21.15.2:0/2722865782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd480104df0 0x7fd4801071e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009900 tx=0x7fd46c02a3f0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.804+0000 7fd487400640 1 -- 172.21.15.2:0/2722865782 shutdown_connections 2024-06-13T02:17:51.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.804+0000 7fd487400640 1 --2- 172.21.15.2:0/2722865782 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd480107720 0x7fd480109b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.804+0000 7fd487400640 1 --2- 172.21.15.2:0/2722865782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd480104df0 0x7fd4801071e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.804+0000 7fd487400640 1 --2- 172.21.15.2:0/2722865782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4801024c0 0x7fd4801048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.804+0000 7fd487400640 1 -- 172.21.15.2:0/2722865782 >> 172.21.15.2:0/2722865782 conn(0x7fd4800fbed0 msgr2=0x7fd4800fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:51.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.804+0000 7fd487400640 1 -- 172.21.15.2:0/2722865782 shutdown_connections 2024-06-13T02:17:51.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.804+0000 7fd487400640 1 -- 172.21.15.2:0/2722865782 wait complete. 2024-06-13T02:17:51.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.805+0000 7fd487400640 1 Processor -- start 2024-06-13T02:17:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.805+0000 7fd487400640 1 -- start start 2024-06-13T02:17:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.806+0000 7fd487400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4801024c0 0x7fd480199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.806+0000 7fd487400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd480104df0 0x7fd48019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.806+0000 7fd487400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd480107720 0x7fd4801a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.806+0000 7fd487400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd48010d720 con 0x7fd480107720 2024-06-13T02:17:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.806+0000 7fd487400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd48010d5a0 con 0x7fd480104df0 2024-06-13T02:17:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.806+0000 7fd487400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd48010d8a0 con 0x7fd4801024c0 2024-06-13T02:17:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.806+0000 7fd485400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd480107720 0x7fd4801a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.806+0000 7fd484a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4801024c0 0x7fd480199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.806+0000 7fd485400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd480107720 0x7fd4801a1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47790/0 (socket says 172.21.15.2:47790) 2024-06-13T02:17:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.806+0000 7fd47fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd480104df0 0x7fd48019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:51.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.806+0000 7fd485400640 1 -- 172.21.15.2:0/504927390 learned_addr learned my addr 172.21.15.2:0/504927390 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.807+0000 7fd484a00640 1 -- 172.21.15.2:0/504927390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd480104df0 msgr2=0x7fd48019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.807+0000 7fd484a00640 1 --2- 172.21.15.2:0/504927390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd480104df0 0x7fd48019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.807+0000 7fd484a00640 1 -- 172.21.15.2:0/504927390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd480107720 msgr2=0x7fd4801a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.807+0000 7fd484a00640 1 --2- 172.21.15.2:0/504927390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd480107720 0x7fd4801a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.807+0000 7fd484a00640 1 -- 172.21.15.2:0/504927390 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4801a1bb0 con 0x7fd4801024c0 2024-06-13T02:17:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.807+0000 7fd485400640 1 --2- 172.21.15.2:0/504927390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd480107720 0x7fd4801a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.807+0000 7fd47fe00640 1 --2- 172.21.15.2:0/504927390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd480104df0 0x7fd48019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:17:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.807+0000 7fd484a00640 1 --2- 172.21.15.2:0/504927390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4801024c0 0x7fd480199f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd47400e9f0 tx=0x7fd47400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.807+0000 7fd47d600640 1 -- 172.21.15.2:0/504927390 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47400ccc0 con 0x7fd4801024c0 2024-06-13T02:17:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.807+0000 7fd47d600640 1 -- 172.21.15.2:0/504927390 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd474005020 con 0x7fd4801024c0 2024-06-13T02:17:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.807+0000 7fd487400640 1 -- 172.21.15.2:0/504927390 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4801a1ea0 con 0x7fd4801024c0 2024-06-13T02:17:51.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.807+0000 7fd47d600640 1 -- 172.21.15.2:0/504927390 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4740049e0 con 0x7fd4801024c0 2024-06-13T02:17:51.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.808+0000 7fd487400640 1 -- 172.21.15.2:0/504927390 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4801a2300 con 0x7fd4801024c0 2024-06-13T02:17:51.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.809+0000 7fd487400640 1 -- 172.21.15.2:0/504927390 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd480109270 con 0x7fd4801024c0 2024-06-13T02:17:51.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.812+0000 7fd47d600640 1 -- 172.21.15.2:0/504927390 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7fd474005560 con 0x7fd4801024c0 2024-06-13T02:17:51.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.813+0000 7fd47d600640 1 --2- 172.21.15.2:0/504927390 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd4680a29f0 0x7fd4680a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:51.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.813+0000 7fd47d600640 1 -- 172.21.15.2:0/504927390 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fd4740cf060 con 0x7fd4801024c0 2024-06-13T02:17:51.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.813+0000 7fd47fe00640 1 --2- 172.21.15.2:0/504927390 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd4680a29f0 0x7fd4680a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:51.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.814+0000 7fd47fe00640 1 --2- 172.21.15.2:0/504927390 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd4680a29f0 0x7fd4680a4eb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd46c02a9e0 tx=0x7fd46c0315b0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:51.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:51.817+0000 7fd47d600640 1 -- 172.21.15.2:0/504927390 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fd4740051d0 con 0x7fd4801024c0 2024-06-13T02:17:51.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:51 smithi002 ceph-mon[31960]: mgrmap e22: x(active, since 1.03978s), standbys: z, y 2024-06-13T02:17:51.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:51 smithi002 ceph-mon[31960]: from='client.25160 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:51.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:51 smithi002 ceph-mon[31960]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:17:51.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:51 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' 2024-06-13T02:17:51.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:51 smithi084 ceph-mon[36833]: mgrmap e22: x(active, since 1.03978s), standbys: z, y 2024-06-13T02:17:51.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:51 smithi084 ceph-mon[36833]: from='client.25160 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:51.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:51 smithi084 ceph-mon[36833]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:17:51.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:51 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' 2024-06-13T02:17:52.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:51 smithi175 ceph-mon[36977]: mgrmap e22: x(active, since 1.03978s), standbys: z, y 2024-06-13T02:17:52.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:51 smithi175 ceph-mon[36977]: from='client.25160 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:52.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:51 smithi175 ceph-mon[36977]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:17:52.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:51 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' 2024-06-13T02:17:52.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.061+0000 7fd487400640 1 -- 172.21.15.2:0/504927390 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fd48002d2e0 con 0x7fd4801024c0 2024-06-13T02:17:52.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.067+0000 7fd47d600640 1 -- 172.21.15.2:0/504927390 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) ==== 133+0+0 (secure 0 0 0) 0x7fd47409bd80 con 0x7fd4801024c0 2024-06-13T02:17:52.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.070+0000 7fd487400640 1 -- 172.21.15.2:0/504927390 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd4680a29f0 msgr2=0x7fd4680a4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:52.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.070+0000 7fd487400640 1 --2- 172.21.15.2:0/504927390 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd4680a29f0 0x7fd4680a4eb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd46c02a9e0 tx=0x7fd46c0315b0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.070+0000 7fd487400640 1 -- 172.21.15.2:0/504927390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4801024c0 msgr2=0x7fd480199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:52.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.070+0000 7fd487400640 1 --2- 172.21.15.2:0/504927390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4801024c0 0x7fd480199f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd47400e9f0 tx=0x7fd47400eeb0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.070+0000 7fd487400640 1 -- 172.21.15.2:0/504927390 shutdown_connections 2024-06-13T02:17:52.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.070+0000 7fd487400640 1 --2- 172.21.15.2:0/504927390 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd4680a29f0 0x7fd4680a4eb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.070+0000 7fd487400640 1 --2- 172.21.15.2:0/504927390 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd480107720 0x7fd4801a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.070+0000 7fd487400640 1 --2- 172.21.15.2:0/504927390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd480104df0 0x7fd48019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.070+0000 7fd487400640 1 --2- 172.21.15.2:0/504927390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4801024c0 0x7fd480199f90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.070+0000 7fd487400640 1 -- 172.21.15.2:0/504927390 >> 172.21.15.2:0/504927390 conn(0x7fd4800fbed0 msgr2=0x7fd480101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:52.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.070+0000 7fd487400640 1 -- 172.21.15.2:0/504927390 shutdown_connections 2024-06-13T02:17:52.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.070+0000 7fd487400640 1 -- 172.21.15.2:0/504927390 wait complete. 2024-06-13T02:17:52.090 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-06-13T02:17:52.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.284+0000 7ff83f200640 1 -- 172.21.15.2:0/129392162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff840103a40 msgr2=0x7ff840103e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:52.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.284+0000 7ff83f200640 1 --2- 172.21.15.2:0/129392162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff840103a40 0x7ff840103e60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff830009900 tx=0x7ff83002a410 comp rx=0 tx=0).stop 2024-06-13T02:17:52.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.284+0000 7ff83f200640 1 -- 172.21.15.2:0/129392162 shutdown_connections 2024-06-13T02:17:52.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.284+0000 7ff83f200640 1 --2- 172.21.15.2:0/129392162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8401055f0 0x7ff84010be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.284+0000 7ff83f200640 1 --2- 172.21.15.2:0/129392162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff840104c30 0x7ff8401050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.284+0000 7ff83f200640 1 --2- 172.21.15.2:0/129392162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff840103a40 0x7ff840103e60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.284+0000 7ff83f200640 1 -- 172.21.15.2:0/129392162 >> 172.21.15.2:0/129392162 conn(0x7ff8400fefb0 msgr2=0x7ff8401013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:52.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.284+0000 7ff83f200640 1 -- 172.21.15.2:0/129392162 shutdown_connections 2024-06-13T02:17:52.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.284+0000 7ff83f200640 1 -- 172.21.15.2:0/129392162 wait complete. 2024-06-13T02:17:52.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.286+0000 7ff83f200640 1 Processor -- start 2024-06-13T02:17:52.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.286+0000 7ff83f200640 1 -- start start 2024-06-13T02:17:52.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.286+0000 7ff83f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff840103a40 0x7ff840199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:52.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.286+0000 7ff83f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff840104c30 0x7ff84019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:52.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.286+0000 7ff83f200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8401055f0 0x7ff8401a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:52.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.286+0000 7ff83f200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff84010f6c0 con 0x7ff8401055f0 2024-06-13T02:17:52.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.286+0000 7ff83f200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff84010f540 con 0x7ff840104c30 2024-06-13T02:17:52.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.286+0000 7ff83f200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff84010f840 con 0x7ff840103a40 2024-06-13T02:17:52.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.287+0000 7ff83de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff840103a40 0x7ff840199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:52.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.287+0000 7ff83d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff840104c30 0x7ff84019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:52.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.287+0000 7ff83e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8401055f0 0x7ff8401a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:52.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.287+0000 7ff83de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff840103a40 0x7ff840199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:44736/0 (socket says 172.21.15.2:44736) 2024-06-13T02:17:52.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.287+0000 7ff83d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff840104c30 0x7ff84019a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:57268/0 (socket says 172.21.15.2:57268) 2024-06-13T02:17:52.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.287+0000 7ff83de00640 1 -- 172.21.15.2:0/2026855174 learned_addr learned my addr 172.21.15.2:0/2026855174 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:52.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.287+0000 7ff83d400640 1 -- 172.21.15.2:0/2026855174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff840103a40 msgr2=0x7ff840199d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:52.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.287+0000 7ff83d400640 1 --2- 172.21.15.2:0/2026855174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff840103a40 0x7ff840199d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.287+0000 7ff83d400640 1 -- 172.21.15.2:0/2026855174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8401055f0 msgr2=0x7ff8401a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:52.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.287+0000 7ff83d400640 1 --2- 172.21.15.2:0/2026855174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8401055f0 0x7ff8401a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.287+0000 7ff83d400640 1 -- 172.21.15.2:0/2026855174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8401a1980 con 0x7ff840104c30 2024-06-13T02:17:52.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.288+0000 7ff83d400640 1 --2- 172.21.15.2:0/2026855174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff840104c30 0x7ff84019a2a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00d6d0 tx=0x7ff82c00db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:52.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.288+0000 7ff836a00640 1 -- 172.21.15.2:0/2026855174 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c017070 con 0x7ff840104c30 2024-06-13T02:17:52.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.288+0000 7ff836a00640 1 -- 172.21.15.2:0/2026855174 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff82c009820 con 0x7ff840104c30 2024-06-13T02:17:52.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.288+0000 7ff836a00640 1 -- 172.21.15.2:0/2026855174 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c004d00 con 0x7ff840104c30 2024-06-13T02:17:52.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.288+0000 7ff83f200640 1 -- 172.21.15.2:0/2026855174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8401a1c70 con 0x7ff840104c30 2024-06-13T02:17:52.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.288+0000 7ff83f200640 1 -- 172.21.15.2:0/2026855174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8401a21c0 con 0x7ff840104c30 2024-06-13T02:17:52.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.289+0000 7ff83f200640 1 -- 172.21.15.2:0/2026855174 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff84010ad60 con 0x7ff840104c30 2024-06-13T02:17:52.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.292+0000 7ff836a00640 1 -- 172.21.15.2:0/2026855174 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 138003+0+0 (secure 0 0 0) 0x7ff82c0099d0 con 0x7ff840104c30 2024-06-13T02:17:52.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.293+0000 7ff836a00640 1 --2- 172.21.15.2:0/2026855174 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff8240a2df0 0x7ff8240a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:52.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.293+0000 7ff836a00640 1 -- 172.21.15.2:0/2026855174 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7ff82c0cf470 con 0x7ff840104c30 2024-06-13T02:17:52.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.293+0000 7ff83de00640 1 --2- 172.21.15.2:0/2026855174 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff8240a2df0 0x7ff8240a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:52.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.294+0000 7ff83de00640 1 --2- 172.21.15.2:0/2026855174 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff8240a2df0 0x7ff8240a52b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff830000c00 tx=0x7ff8300046c0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:52.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.298+0000 7ff836a00640 1 -- 172.21.15.2:0/2026855174 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7ff82c09b4a0 con 0x7ff840104c30 2024-06-13T02:17:52.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.544+0000 7ff83f200640 1 -- 172.21.15.2:0/2026855174 --> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7ff840061de0 con 0x7ff8240a2df0 2024-06-13T02:17:52.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.626+0000 7ff836a00640 1 -- 172.21.15.2:0/2026855174 <== mgr.25123 v2:172.21.15.2:6800/2181612853 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff840061de0 con 0x7ff8240a2df0 2024-06-13T02:17:52.626 INFO:teuthology.orchestra.run.smithi002.stdout:Schedule set for path / 2024-06-13T02:17:52.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.628+0000 7ff83f200640 1 -- 172.21.15.2:0/2026855174 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff8240a2df0 msgr2=0x7ff8240a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:52.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.628+0000 7ff83f200640 1 --2- 172.21.15.2:0/2026855174 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff8240a2df0 0x7ff8240a52b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff830000c00 tx=0x7ff8300046c0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.628+0000 7ff83f200640 1 -- 172.21.15.2:0/2026855174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff840104c30 msgr2=0x7ff84019a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.628+0000 7ff83f200640 1 --2- 172.21.15.2:0/2026855174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff840104c30 0x7ff84019a2a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00d6d0 tx=0x7ff82c00db90 comp rx=0 tx=0).stop 2024-06-13T02:17:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.628+0000 7ff83f200640 1 -- 172.21.15.2:0/2026855174 shutdown_connections 2024-06-13T02:17:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.628+0000 7ff83f200640 1 --2- 172.21.15.2:0/2026855174 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff8240a2df0 0x7ff8240a52b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.628+0000 7ff83f200640 1 --2- 172.21.15.2:0/2026855174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff8401055f0 0x7ff8401a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.628+0000 7ff83f200640 1 --2- 172.21.15.2:0/2026855174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff840104c30 0x7ff84019a2a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.628+0000 7ff83f200640 1 --2- 172.21.15.2:0/2026855174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff840103a40 0x7ff840199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.628+0000 7ff83f200640 1 -- 172.21.15.2:0/2026855174 >> 172.21.15.2:0/2026855174 conn(0x7ff8400fefb0 msgr2=0x7ff840107f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.628+0000 7ff83f200640 1 -- 172.21.15.2:0/2026855174 shutdown_connections 2024-06-13T02:17:52.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.628+0000 7ff83f200640 1 -- 172.21.15.2:0/2026855174 wait complete. 2024-06-13T02:17:52.645 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-06-13T02:17:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.822+0000 7fef6e600640 1 -- 172.21.15.2:0/2664427622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef68104c20 msgr2=0x7fef68107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.822+0000 7fef6e600640 1 --2- 172.21.15.2:0/2664427622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef68104c20 0x7fef68107010 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fef54009900 tx=0x7fef5402a3f0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.822+0000 7fef6e600640 1 -- 172.21.15.2:0/2664427622 shutdown_connections 2024-06-13T02:17:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.822+0000 7fef6e600640 1 --2- 172.21.15.2:0/2664427622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef68107550 0x7fef68109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.822+0000 7fef6e600640 1 --2- 172.21.15.2:0/2664427622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef68104c20 0x7fef68107010 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.822+0000 7fef6e600640 1 --2- 172.21.15.2:0/2664427622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef681022f0 0x7fef681046e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.822+0000 7fef6e600640 1 -- 172.21.15.2:0/2664427622 >> 172.21.15.2:0/2664427622 conn(0x7fef680fbc80 msgr2=0x7fef680fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.822+0000 7fef6e600640 1 -- 172.21.15.2:0/2664427622 shutdown_connections 2024-06-13T02:17:52.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.823+0000 7fef6e600640 1 -- 172.21.15.2:0/2664427622 wait complete. 2024-06-13T02:17:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.824+0000 7fef6e600640 1 Processor -- start 2024-06-13T02:17:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.824+0000 7fef6e600640 1 -- start start 2024-06-13T02:17:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.824+0000 7fef6e600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef681022f0 0x7fef68197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:52.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.824+0000 7fef6e600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef68104c20 0x7fef68198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.824+0000 7fef6e600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef68107550 0x7fef6819f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.825+0000 7fef6e600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fef6810d4c0 con 0x7fef68104c20 2024-06-13T02:17:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.825+0000 7fef6e600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fef6810d340 con 0x7fef681022f0 2024-06-13T02:17:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.825+0000 7fef6e600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef6810d640 con 0x7fef68107550 2024-06-13T02:17:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.825+0000 7fef6d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef681022f0 0x7fef68197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.825+0000 7fef6d200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef681022f0 0x7fef68197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:57280/0 (socket says 172.21.15.2:57280) 2024-06-13T02:17:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.825+0000 7fef6d200640 1 -- 172.21.15.2:0/543365486 learned_addr learned my addr 172.21.15.2:0/543365486 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.825+0000 7fef6dc00640 1 --2- 172.21.15.2:0/543365486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef68107550 0x7fef6819f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.825+0000 7fef67e00640 1 --2- 172.21.15.2:0/543365486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef68104c20 0x7fef68198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.825+0000 7fef6d200640 1 -- 172.21.15.2:0/543365486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef68107550 msgr2=0x7fef6819f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.825+0000 7fef6d200640 1 --2- 172.21.15.2:0/543365486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef68107550 0x7fef6819f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.825+0000 7fef6d200640 1 -- 172.21.15.2:0/543365486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef68104c20 msgr2=0x7fef68198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.825+0000 7fef6d200640 1 --2- 172.21.15.2:0/543365486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef68104c20 0x7fef68198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.825+0000 7fef6d200640 1 -- 172.21.15.2:0/543365486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6819f760 con 0x7fef681022f0 2024-06-13T02:17:52.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.825+0000 7fef6d200640 1 --2- 172.21.15.2:0/543365486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef681022f0 0x7fef68197b40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00e9f0 tx=0x7fef5c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.826+0000 7fef65600640 1 -- 172.21.15.2:0/543365486 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00cd80 con 0x7fef681022f0 2024-06-13T02:17:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.826+0000 7fef65600640 1 -- 172.21.15.2:0/543365486 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef5c010910 con 0x7fef681022f0 2024-06-13T02:17:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.826+0000 7fef65600640 1 -- 172.21.15.2:0/543365486 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c018990 con 0x7fef681022f0 2024-06-13T02:17:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.826+0000 7fef6e600640 1 -- 172.21.15.2:0/543365486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef6819fa50 con 0x7fef681022f0 2024-06-13T02:17:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.826+0000 7fef6e600640 1 -- 172.21.15.2:0/543365486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef6819ff20 con 0x7fef681022f0 2024-06-13T02:17:52.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.827+0000 7fef6e600640 1 -- 172.21.15.2:0/543365486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef680fd770 con 0x7fef681022f0 2024-06-13T02:17:52.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.829+0000 7fef65600640 1 -- 172.21.15.2:0/543365486 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 138003+0+0 (secure 0 0 0) 0x7fef5c010ac0 con 0x7fef681022f0 2024-06-13T02:17:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.830+0000 7fef65600640 1 --2- 172.21.15.2:0/543365486 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fef500a2df0 0x7fef500a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.831+0000 7fef65600640 1 -- 172.21.15.2:0/543365486 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fef5c0cfd40 con 0x7fef681022f0 2024-06-13T02:17:52.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.831+0000 7fef67e00640 1 --2- 172.21.15.2:0/543365486 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fef500a2df0 0x7fef500a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:52.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.832+0000 7fef67e00640 1 --2- 172.21.15.2:0/543365486 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fef500a2df0 0x7fef500a52b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fef54006010 tx=0x7fef54000bc0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:52.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:52.834+0000 7fef65600640 1 -- 172.21.15.2:0/543365486 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fef5c09c3c0 con 0x7fef681022f0 2024-06-13T02:17:52.872 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:52 smithi084 ceph-mon[36833]: [13/Jun/2024:02:17:51] ENGINE Bus STARTING 2024-06-13T02:17:52.872 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:52 smithi084 ceph-mon[36833]: [13/Jun/2024:02:17:51] ENGINE Serving on https://172.21.15.2:7150 2024-06-13T02:17:52.872 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:52 smithi084 ceph-mon[36833]: [13/Jun/2024:02:17:51] ENGINE Serving on http://172.21.15.2:8765 2024-06-13T02:17:52.872 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:52 smithi084 ceph-mon[36833]: [13/Jun/2024:02:17:51] ENGINE Bus STARTED 2024-06-13T02:17:52.872 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:52 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/496039437' entity='client.admin' 2024-06-13T02:17:52.873 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:52 smithi084 ceph-mon[36833]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:17:52.873 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:52 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:52.873 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:52 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:52.873 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:52 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:52.873 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:52 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:52.873 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:52 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' 2024-06-13T02:17:52.873 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:52 smithi084 ceph-mon[36833]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-06-13T02:17:52.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:52 smithi002 ceph-mon[31960]: [13/Jun/2024:02:17:51] ENGINE Bus STARTING 2024-06-13T02:17:52.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:52 smithi002 ceph-mon[31960]: [13/Jun/2024:02:17:51] ENGINE Serving on https://172.21.15.2:7150 2024-06-13T02:17:52.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:52 smithi002 ceph-mon[31960]: [13/Jun/2024:02:17:51] ENGINE Serving on http://172.21.15.2:8765 2024-06-13T02:17:52.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:52 smithi002 ceph-mon[31960]: [13/Jun/2024:02:17:51] ENGINE Bus STARTED 2024-06-13T02:17:52.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:52 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/496039437' entity='client.admin' 2024-06-13T02:17:52.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:52 smithi002 ceph-mon[31960]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:17:52.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:52 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:52.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:52 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:52.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:52 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:52.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:52 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:52.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:52 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' 2024-06-13T02:17:52.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:52 smithi002 ceph-mon[31960]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-06-13T02:17:53.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:52 smithi175 ceph-mon[36977]: [13/Jun/2024:02:17:51] ENGINE Bus STARTING 2024-06-13T02:17:53.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:52 smithi175 ceph-mon[36977]: [13/Jun/2024:02:17:51] ENGINE Serving on https://172.21.15.2:7150 2024-06-13T02:17:53.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:52 smithi175 ceph-mon[36977]: [13/Jun/2024:02:17:51] ENGINE Serving on http://172.21.15.2:8765 2024-06-13T02:17:53.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:52 smithi175 ceph-mon[36977]: [13/Jun/2024:02:17:51] ENGINE Bus STARTED 2024-06-13T02:17:53.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:52 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/496039437' entity='client.admin' 2024-06-13T02:17:53.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:52 smithi175 ceph-mon[36977]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:17:53.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:52 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:53.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:52 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:53.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:52 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:53.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:52 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:53.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:52 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' 2024-06-13T02:17:53.034 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:52 smithi175 ceph-mon[36977]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-06-13T02:17:53.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.089+0000 7fef6e600640 1 -- 172.21.15.2:0/543365486 --> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fef68061e80 con 0x7fef500a2df0 2024-06-13T02:17:53.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.190+0000 7fef65600640 1 -- 172.21.15.2:0/543365486 <== mgr.25123 v2:172.21.15.2:6800/2181612853 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fef68061e80 con 0x7fef500a2df0 2024-06-13T02:17:53.191 INFO:teuthology.orchestra.run.smithi002.stdout:Retention added to path / 2024-06-13T02:17:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.193+0000 7fef6e600640 1 -- 172.21.15.2:0/543365486 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fef500a2df0 msgr2=0x7fef500a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.193+0000 7fef6e600640 1 --2- 172.21.15.2:0/543365486 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fef500a2df0 0x7fef500a52b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fef54006010 tx=0x7fef54000bc0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.193+0000 7fef6e600640 1 -- 172.21.15.2:0/543365486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef681022f0 msgr2=0x7fef68197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.193+0000 7fef6e600640 1 --2- 172.21.15.2:0/543365486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef681022f0 0x7fef68197b40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00e9f0 tx=0x7fef5c00eeb0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.193+0000 7fef6e600640 1 -- 172.21.15.2:0/543365486 shutdown_connections 2024-06-13T02:17:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.193+0000 7fef6e600640 1 --2- 172.21.15.2:0/543365486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef68107550 0x7fef6819f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.193+0000 7fef6e600640 1 --2- 172.21.15.2:0/543365486 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fef500a2df0 0x7fef500a52b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.193+0000 7fef6e600640 1 --2- 172.21.15.2:0/543365486 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef68104c20 0x7fef68198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.193+0000 7fef6e600640 1 --2- 172.21.15.2:0/543365486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef681022f0 0x7fef68197b40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.193+0000 7fef6e600640 1 -- 172.21.15.2:0/543365486 >> 172.21.15.2:0/543365486 conn(0x7fef680fbc80 msgr2=0x7fef68102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.193+0000 7fef6e600640 1 -- 172.21.15.2:0/543365486 shutdown_connections 2024-06-13T02:17:53.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.193+0000 7fef6e600640 1 -- 172.21.15.2:0/543365486 wait complete. 2024-06-13T02:17:53.211 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-06-13T02:17:53.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.393+0000 7f6da3a00640 1 -- 172.21.15.2:0/3650579460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d9c104e20 msgr2=0x7f6d9c1052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:53.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.393+0000 7f6da3a00640 1 --2- 172.21.15.2:0/3650579460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d9c104e20 0x7f6d9c1052a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009900 tx=0x7f6d8802a3f0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.393+0000 7f6da3a00640 1 -- 172.21.15.2:0/3650579460 shutdown_connections 2024-06-13T02:17:53.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.393+0000 7f6da3a00640 1 --2- 172.21.15.2:0/3650579460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d9c1057e0 0x7f6d9c10c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.393+0000 7f6da3a00640 1 --2- 172.21.15.2:0/3650579460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d9c104e20 0x7f6d9c1052a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.393+0000 7f6da3a00640 1 --2- 172.21.15.2:0/3650579460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d9c103c30 0x7f6d9c104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.393+0000 7f6da3a00640 1 -- 172.21.15.2:0/3650579460 >> 172.21.15.2:0/3650579460 conn(0x7f6d9c0ff1c0 msgr2=0x7f6d9c1015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:53.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.393+0000 7f6da3a00640 1 -- 172.21.15.2:0/3650579460 shutdown_connections 2024-06-13T02:17:53.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.393+0000 7f6da3a00640 1 -- 172.21.15.2:0/3650579460 wait complete. 2024-06-13T02:17:53.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.395+0000 7f6da3a00640 1 Processor -- start 2024-06-13T02:17:53.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.395+0000 7f6da3a00640 1 -- start start 2024-06-13T02:17:53.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.395+0000 7f6da3a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d9c103c30 0x7f6d9c199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:53.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.395+0000 7f6da3a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d9c104e20 0x7f6d9c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:53.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.396+0000 7f6da3a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d9c1057e0 0x7f6d9c1a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:53.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.396+0000 7f6da3a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c10f900 con 0x7f6d9c103c30 2024-06-13T02:17:53.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.396+0000 7f6da3a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c10f780 con 0x7f6d9c1057e0 2024-06-13T02:17:53.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.396+0000 7f6da3a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c10fa80 con 0x7f6d9c104e20 2024-06-13T02:17:53.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.396+0000 7f6da1000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d9c103c30 0x7f6d9c199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:53.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.396+0000 7f6da1000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d9c103c30 0x7f6d9c199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38656/0 (socket says 172.21.15.2:38656) 2024-06-13T02:17:53.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.396+0000 7f6da1a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d9c1057e0 0x7f6d9c1a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:53.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.396+0000 7f6da1000640 1 -- 172.21.15.2:0/3207043281 learned_addr learned my addr 172.21.15.2:0/3207043281 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:53.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.396+0000 7f6d9be00640 1 --2- 172.21.15.2:0/3207043281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d9c104e20 0x7f6d9c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:53.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.396+0000 7f6da1a00640 1 -- 172.21.15.2:0/3207043281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d9c104e20 msgr2=0x7f6d9c19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:53.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.396+0000 7f6da1a00640 1 --2- 172.21.15.2:0/3207043281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d9c104e20 0x7f6d9c19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.396+0000 7f6da1a00640 1 -- 172.21.15.2:0/3207043281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d9c103c30 msgr2=0x7f6d9c199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:53.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.396+0000 7f6da1a00640 1 --2- 172.21.15.2:0/3207043281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d9c103c30 0x7f6d9c199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.396+0000 7f6da1a00640 1 -- 172.21.15.2:0/3207043281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d9c1a1b90 con 0x7f6d9c1057e0 2024-06-13T02:17:53.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.397+0000 7f6da1a00640 1 --2- 172.21.15.2:0/3207043281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d9c1057e0 0x7f6d9c1a1520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400ec50 tx=0x7f6d9400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:53.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.397+0000 7f6d99600640 1 -- 172.21.15.2:0/3207043281 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94003b70 con 0x7f6d9c1057e0 2024-06-13T02:17:53.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.397+0000 7f6d99600640 1 -- 172.21.15.2:0/3207043281 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d94003d10 con 0x7f6d9c1057e0 2024-06-13T02:17:53.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.397+0000 7f6da3a00640 1 -- 172.21.15.2:0/3207043281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d9c1a1e80 con 0x7f6d9c1057e0 2024-06-13T02:17:53.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.397+0000 7f6d99600640 1 -- 172.21.15.2:0/3207043281 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94010890 con 0x7f6d9c1057e0 2024-06-13T02:17:53.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.397+0000 7f6da3a00640 1 -- 172.21.15.2:0/3207043281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d9c1a22f0 con 0x7f6d9c1057e0 2024-06-13T02:17:53.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.398+0000 7f6da3a00640 1 -- 172.21.15.2:0/3207043281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d9c10af50 con 0x7f6d9c1057e0 2024-06-13T02:17:53.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.400+0000 7f6d99600640 1 -- 172.21.15.2:0/3207043281 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 138003+0+0 (secure 0 0 0) 0x7f6d94003fc0 con 0x7f6d9c1057e0 2024-06-13T02:17:53.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.401+0000 7f6d99600640 1 --2- 172.21.15.2:0/3207043281 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f6d840a2d80 0x7f6d840a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:53.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.402+0000 7f6d99600640 1 -- 172.21.15.2:0/3207043281 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f6d940cffd0 con 0x7f6d9c1057e0 2024-06-13T02:17:53.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.402+0000 7f6da1000640 1 --2- 172.21.15.2:0/3207043281 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f6d840a2d80 0x7f6d840a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:53.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.402+0000 7f6da1000640 1 --2- 172.21.15.2:0/3207043281 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f6d840a2d80 0x7f6d840a5240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d900058c0 tx=0x7f6d90005f90 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:53.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.405+0000 7f6d99600640 1 -- 172.21.15.2:0/3207043281 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f6d9409c650 con 0x7f6d9c1057e0 2024-06-13T02:17:53.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.638+0000 7f6da3a00640 1 -- 172.21.15.2:0/3207043281 --> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f6d9c061de0 con 0x7f6d840a2d80 2024-06-13T02:17:53.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.647+0000 7f6d99600640 1 -- 172.21.15.2:0/3207043281 <== mgr.25123 v2:172.21.15.2:6800/2181612853 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f6d9c061de0 con 0x7f6d840a2d80 2024-06-13T02:17:53.647 INFO:teuthology.orchestra.run.smithi002.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-06-13T00:00:00", "created": "2024-06-13T02:17:52", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-06-13T02:17:53.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.649+0000 7f6da3a00640 1 -- 172.21.15.2:0/3207043281 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f6d840a2d80 msgr2=0x7f6d840a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:53.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.649+0000 7f6da3a00640 1 --2- 172.21.15.2:0/3207043281 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f6d840a2d80 0x7f6d840a5240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6d900058c0 tx=0x7f6d90005f90 comp rx=0 tx=0).stop 2024-06-13T02:17:53.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.649+0000 7f6da3a00640 1 -- 172.21.15.2:0/3207043281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d9c1057e0 msgr2=0x7f6d9c1a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:53.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.649+0000 7f6da3a00640 1 --2- 172.21.15.2:0/3207043281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d9c1057e0 0x7f6d9c1a1520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400ec50 tx=0x7f6d9400c6a0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.649+0000 7f6da3a00640 1 -- 172.21.15.2:0/3207043281 shutdown_connections 2024-06-13T02:17:53.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.649+0000 7f6da3a00640 1 --2- 172.21.15.2:0/3207043281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6d9c1057e0 0x7f6d9c1a1520 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.649+0000 7f6da3a00640 1 --2- 172.21.15.2:0/3207043281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d9c104e20 0x7f6d9c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.649+0000 7f6da3a00640 1 --2- 172.21.15.2:0/3207043281 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f6d840a2d80 0x7f6d840a5240 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.649+0000 7f6da3a00640 1 --2- 172.21.15.2:0/3207043281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6d9c103c30 0x7f6d9c199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.649+0000 7f6da3a00640 1 -- 172.21.15.2:0/3207043281 >> 172.21.15.2:0/3207043281 conn(0x7f6d9c0ff1c0 msgr2=0x7f6d9c108120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:53.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.650+0000 7f6da3a00640 1 -- 172.21.15.2:0/3207043281 shutdown_connections 2024-06-13T02:17:53.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.650+0000 7f6da3a00640 1 -- 172.21.15.2:0/3207043281 wait complete. 2024-06-13T02:17:53.669 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-06-13T02:17:53.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.863+0000 7f9e06e00640 1 -- 172.21.15.2:0/816327733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00102a50 msgr2=0x7f9e00102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:53.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.863+0000 7f9e06e00640 1 --2- 172.21.15.2:0/816327733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00102a50 0x7f9e00102ed0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009900 tx=0x7f9dec02a3f0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.863+0000 7f9e06e00640 1 -- 172.21.15.2:0/816327733 shutdown_connections 2024-06-13T02:17:53.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.864+0000 7f9e06e00640 1 --2- 172.21.15.2:0/816327733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e00103410 0x7f9e00109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.864+0000 7f9e06e00640 1 --2- 172.21.15.2:0/816327733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00102a50 0x7f9e00102ed0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.864+0000 7f9e06e00640 1 --2- 172.21.15.2:0/816327733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e00101860 0x7f9e00101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.864+0000 7f9e06e00640 1 -- 172.21.15.2:0/816327733 >> 172.21.15.2:0/816327733 conn(0x7f9e000fcdd0 msgr2=0x7f9e000ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:53.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.864+0000 7f9e06e00640 1 -- 172.21.15.2:0/816327733 shutdown_connections 2024-06-13T02:17:53.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.864+0000 7f9e06e00640 1 -- 172.21.15.2:0/816327733 wait complete. 2024-06-13T02:17:53.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.865+0000 7f9e06e00640 1 Processor -- start 2024-06-13T02:17:53.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.865+0000 7f9e06e00640 1 -- start start 2024-06-13T02:17:53.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.865+0000 7f9e06e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e00101860 0x7f9e00075750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:53.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.865+0000 7f9e06e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00102a50 0x7f9e00073d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:53.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.865+0000 7f9e06e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e00103410 0x7f9e000742d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:53.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.865+0000 7f9e06e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0010d4c0 con 0x7f9e00101860 2024-06-13T02:17:53.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.865+0000 7f9e06e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0010d340 con 0x7f9e00102a50 2024-06-13T02:17:53.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.865+0000 7f9e06e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0010d640 con 0x7f9e00103410 2024-06-13T02:17:53.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.865+0000 7f9e05a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e00101860 0x7f9e00075750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:53.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.865+0000 7f9e05000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00102a50 0x7f9e00073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:53.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.865+0000 7f9e06400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e00103410 0x7f9e000742d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:53.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.865+0000 7f9e05000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00102a50 0x7f9e00073d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:57320/0 (socket says 172.21.15.2:57320) 2024-06-13T02:17:53.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.865+0000 7f9e05a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e00101860 0x7f9e00075750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38678/0 (socket says 172.21.15.2:38678) 2024-06-13T02:17:53.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.865+0000 7f9e05000640 1 -- 172.21.15.2:0/2293113990 learned_addr learned my addr 172.21.15.2:0/2293113990 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:17:53.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.866+0000 7f9e05000640 1 -- 172.21.15.2:0/2293113990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e00103410 msgr2=0x7f9e000742d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:53.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.866+0000 7f9e05000640 1 --2- 172.21.15.2:0/2293113990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e00103410 0x7f9e000742d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.866+0000 7f9e05000640 1 -- 172.21.15.2:0/2293113990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e00101860 msgr2=0x7f9e00075750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:53.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.866+0000 7f9e05000640 1 --2- 172.21.15.2:0/2293113990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e00101860 0x7f9e00075750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:53.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.866+0000 7f9e05000640 1 -- 172.21.15.2:0/2293113990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e00074b60 con 0x7f9e00102a50 2024-06-13T02:17:53.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.866+0000 7f9e05000640 1 --2- 172.21.15.2:0/2293113990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00102a50 0x7f9e00073d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009230 tx=0x7f9dec031b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:53.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.866+0000 7f9dfe000640 1 -- 172.21.15.2:0/2293113990 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec03f030 con 0x7f9e00102a50 2024-06-13T02:17:53.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.867+0000 7f9dfe000640 1 -- 172.21.15.2:0/2293113990 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dec003ad0 con 0x7f9e00102a50 2024-06-13T02:17:53.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.867+0000 7f9e06e00640 1 -- 172.21.15.2:0/2293113990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e001a1c20 con 0x7f9e00102a50 2024-06-13T02:17:53.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.867+0000 7f9dfe000640 1 -- 172.21.15.2:0/2293113990 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dec035070 con 0x7f9e00102a50 2024-06-13T02:17:53.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.867+0000 7f9e06e00640 1 -- 172.21.15.2:0/2293113990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e001a2170 con 0x7f9e00102a50 2024-06-13T02:17:53.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.868+0000 7f9e06e00640 1 -- 172.21.15.2:0/2293113990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e00108b80 con 0x7f9e00102a50 2024-06-13T02:17:53.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.870+0000 7f9dfe000640 1 -- 172.21.15.2:0/2293113990 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 138003+0+0 (secure 0 0 0) 0x7f9dec042030 con 0x7f9e00102a50 2024-06-13T02:17:53.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.871+0000 7f9dfe000640 1 --2- 172.21.15.2:0/2293113990 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f9de80a2d70 0x7f9de80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:17:53.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.871+0000 7f9dfe000640 1 -- 172.21.15.2:0/2293113990 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f9dec0effb0 con 0x7f9e00102a50 2024-06-13T02:17:53.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.872+0000 7f9e05a00640 1 --2- 172.21.15.2:0/2293113990 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f9de80a2d70 0x7f9de80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:17:53.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.872+0000 7f9e05a00640 1 --2- 172.21.15.2:0/2293113990 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f9de80a2d70 0x7f9de80a5230 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9e001028b0 tx=0x7f9df4005f90 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:17:53.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:53.878+0000 7f9dfe000640 1 -- 172.21.15.2:0/2293113990 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f9dec0bbfe0 con 0x7f9e00102a50 2024-06-13T02:17:54.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:54.025+0000 7f9dfe000640 1 -- 172.21.15.2:0/2293113990 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 24) ==== 138059+0+0 (secure 0 0 0) 0x7f9dec03b460 con 0x7f9e00102a50 2024-06-13T02:17:54.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:54.127+0000 7f9e06e00640 1 -- 172.21.15.2:0/2293113990 --> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f9e00061de0 con 0x7f9de80a2d70 2024-06-13T02:17:54.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='client.25229 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:54.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi175 to 176.2M 2024-06-13T02:17:54.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: Unable to set osd_memory_target on smithi175 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-06-13T02:17:54.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi084 to 176.2M 2024-06-13T02:17:54.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: Unable to set osd_memory_target on smithi084 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-06-13T02:17:54.133 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:53 smithi002 ceph-mon[31960]: from='client.25235 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:54.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:54.137+0000 7f9dfe000640 1 -- 172.21.15.2:0/2293113990 <== mgr.25123 v2:172.21.15.2:6800/2181612853 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f9e00061de0 con 0x7f9de80a2d70 2024-06-13T02:17:54.137 INFO:teuthology.orchestra.run.smithi002.stdout:/ 1m 6m3h 2024-06-13T02:17:54.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:54.139+0000 7f9e06e00640 1 -- 172.21.15.2:0/2293113990 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f9de80a2d70 msgr2=0x7f9de80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:54.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:54.139+0000 7f9e06e00640 1 --2- 172.21.15.2:0/2293113990 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f9de80a2d70 0x7f9de80a5230 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9e001028b0 tx=0x7f9df4005f90 comp rx=0 tx=0).stop 2024-06-13T02:17:54.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:54.139+0000 7f9e06e00640 1 -- 172.21.15.2:0/2293113990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00102a50 msgr2=0x7f9e00073d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:17:54.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:54.139+0000 7f9e06e00640 1 --2- 172.21.15.2:0/2293113990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00102a50 0x7f9e00073d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009230 tx=0x7f9dec031b60 comp rx=0 tx=0).stop 2024-06-13T02:17:54.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:54.140+0000 7f9e06e00640 1 -- 172.21.15.2:0/2293113990 shutdown_connections 2024-06-13T02:17:54.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:54.140+0000 7f9e06e00640 1 --2- 172.21.15.2:0/2293113990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e00103410 0x7f9e000742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:54.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:54.140+0000 7f9e06e00640 1 --2- 172.21.15.2:0/2293113990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e00102a50 0x7f9e00073d90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:54.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:54.140+0000 7f9e06e00640 1 --2- 172.21.15.2:0/2293113990 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f9de80a2d70 0x7f9de80a5230 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:54.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:54.140+0000 7f9e06e00640 1 --2- 172.21.15.2:0/2293113990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e00101860 0x7f9e00075750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:17:54.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:54.140+0000 7f9e06e00640 1 -- 172.21.15.2:0/2293113990 >> 172.21.15.2:0/2293113990 conn(0x7f9e000fcdd0 msgr2=0x7f9e00105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:17:54.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:54.140+0000 7f9e06e00640 1 -- 172.21.15.2:0/2293113990 shutdown_connections 2024-06-13T02:17:54.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:17:54.140+0000 7f9e06e00640 1 -- 172.21.15.2:0/2293113990 wait complete. 2024-06-13T02:17:54.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='client.25229 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:54.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.149 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi175 to 176.2M 2024-06-13T02:17:54.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: Unable to set osd_memory_target on smithi175 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-06-13T02:17:54.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.150 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.151 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.151 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.151 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi084 to 176.2M 2024-06-13T02:17:54.151 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: Unable to set osd_memory_target on smithi084 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-06-13T02:17:54.151 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:53 smithi084 ceph-mon[36833]: from='client.25235 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:54.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-06-13T02:17:54.232 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-06-13T02:17:54.243 INFO:teuthology.run_tasks:Running task background_exec... 2024-06-13T02:17:54.288 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T02:17:54.288 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-06-13T02:17:54.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='client.25229 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:54.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.289 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi175 to 176.2M 2024-06-13T02:17:54.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: Unable to set osd_memory_target on smithi175 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-06-13T02:17:54.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:54.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:54.290 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi084 to 176.2M 2024-06-13T02:17:54.291 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: Unable to set osd_memory_target on smithi084 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-06-13T02:17:54.291 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:53 smithi175 ceph-mon[36977]: from='client.25235 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:54.295 INFO:teuthology.run_tasks:Running task workunit... 2024-06-13T02:17:54.332 INFO:tasks.workunit:Pulling workunits from ref 1373963c202323287783ccb099bbae1ec8f14a5d 2024-06-13T02:17:54.333 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-06-13T02:17:54.333 INFO:tasks.workunit:timeout=3h 2024-06-13T02:17:54.333 INFO:tasks.workunit:cleanup=True 2024-06-13T02:17:54.333 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-06-13T02:17:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-06-13T02:17:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-06-13T02:17:54.374 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 77h/119d Inode: 1099511628283 Links: 2 2024-06-13T02:17:54.374 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-13T02:17:54.374 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-06-13T02:17:54.374 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-06-13 02:14:29.219053483 +0000 2024-06-13T02:17:54.374 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-06-13 02:14:29.219053483 +0000 2024-06-13T02:17:54.374 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-06-13 02:17:46.748331404 +0000 2024-06-13T02:17:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-06-13 02:14:29.219053483 +0000 2024-06-13T02:17:54.374 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-06-13T02:17:54.375 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-06-13T02:17:54.501 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1373963c202323287783ccb099bbae1ec8f14a5d 2024-06-13T02:17:54.559 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-06-13T02:17:55.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:55 smithi175 ceph-mon[36977]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:17:55.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:55 smithi175 ceph-mon[36977]: from='client.25241 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:55.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:55 smithi175 ceph-mon[36977]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-06-13T02:17:55.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:55 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:55.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:55 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:55.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:55 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:55 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:55 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:55 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:55 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:55 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:55 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:55 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:55 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:17:55.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:55 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:17:55.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:55 smithi002 ceph-mon[31960]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:17:55.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:55 smithi002 ceph-mon[31960]: from='client.25241 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:55.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:55 smithi002 ceph-mon[31960]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-06-13T02:17:55.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:55 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:55.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:55 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:55.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:55 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:55 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:55 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:55 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:55 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:55 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:55 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:55 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:55 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:17:55.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:55 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:17:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:55 smithi084 ceph-mon[36833]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:17:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:55 smithi084 ceph-mon[36833]: from='client.25241 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:55 smithi084 ceph-mon[36833]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-06-13T02:17:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:55 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:55 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:55 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:55 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:55 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:55 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:55 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:55 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:55 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:55 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:17:55.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:55 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:17:55.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:55 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:17:56.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:56 smithi175 ceph-mon[36977]: from='client.25247 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:56.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:56 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi002 to 177.5M 2024-06-13T02:17:56.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:56 smithi175 ceph-mon[36977]: Unable to set osd_memory_target on smithi002 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-13T02:17:56.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:56 smithi175 ceph-mon[36977]: Updating smithi002:/etc/ceph/ceph.conf 2024-06-13T02:17:56.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:56 smithi175 ceph-mon[36977]: Updating smithi084:/etc/ceph/ceph.conf 2024-06-13T02:17:56.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:56 smithi175 ceph-mon[36977]: Updating smithi175:/etc/ceph/ceph.conf 2024-06-13T02:17:56.283 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:56 smithi002 ceph-mon[31960]: from='client.25247 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:56.283 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:56 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi002 to 177.5M 2024-06-13T02:17:56.283 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:56 smithi002 ceph-mon[31960]: Unable to set osd_memory_target on smithi002 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-13T02:17:56.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:56 smithi002 ceph-mon[31960]: Updating smithi002:/etc/ceph/ceph.conf 2024-06-13T02:17:56.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:56 smithi002 ceph-mon[31960]: Updating smithi084:/etc/ceph/ceph.conf 2024-06-13T02:17:56.284 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:56 smithi002 ceph-mon[31960]: Updating smithi175:/etc/ceph/ceph.conf 2024-06-13T02:17:56.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:56 smithi084 ceph-mon[36833]: from='client.25247 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:17:56.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:56 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi002 to 177.5M 2024-06-13T02:17:56.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:56 smithi084 ceph-mon[36833]: Unable to set osd_memory_target on smithi002 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-13T02:17:56.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:56 smithi084 ceph-mon[36833]: Updating smithi002:/etc/ceph/ceph.conf 2024-06-13T02:17:56.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:56 smithi084 ceph-mon[36833]: Updating smithi084:/etc/ceph/ceph.conf 2024-06-13T02:17:56.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:56 smithi084 ceph-mon[36833]: Updating smithi175:/etc/ceph/ceph.conf 2024-06-13T02:17:57.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:57 smithi175 ceph-mon[36977]: Updating smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:17:57.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:57 smithi175 ceph-mon[36977]: Updating smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:17:57.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:57 smithi175 ceph-mon[36977]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:17:57.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:57 smithi175 ceph-mon[36977]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:17:57.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:57 smithi175 ceph-mon[36977]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 411 B/s wr, 0 op/s 2024-06-13T02:17:57.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:57 smithi175 ceph-mon[36977]: Updating smithi002:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:17:57.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:57 smithi175 ceph-mon[36977]: Updating smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:17:57.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:57 smithi175 ceph-mon[36977]: Updating smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:17:57.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:57 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:57.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:57 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:57.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:57 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:57.284 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:57 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:57.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:57 smithi002 ceph-mon[31960]: Updating smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:17:57.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:57 smithi002 ceph-mon[31960]: Updating smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:17:57.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:57 smithi002 ceph-mon[31960]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:17:57.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:57 smithi002 ceph-mon[31960]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:17:57.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:57 smithi002 ceph-mon[31960]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 411 B/s wr, 0 op/s 2024-06-13T02:17:57.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:57 smithi002 ceph-mon[31960]: Updating smithi002:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:17:57.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:57 smithi002 ceph-mon[31960]: Updating smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:17:57.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:57 smithi002 ceph-mon[31960]: Updating smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:17:57.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:57 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:57.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:57 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:57.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:57 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:57.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:57 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:57.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:57 smithi084 ceph-mon[36833]: Updating smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:17:57.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:57 smithi084 ceph-mon[36833]: Updating smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:17:57.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:57 smithi084 ceph-mon[36833]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:17:57.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:57 smithi084 ceph-mon[36833]: Updating smithi175:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:17:57.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:57 smithi084 ceph-mon[36833]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 411 B/s wr, 0 op/s 2024-06-13T02:17:57.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:57 smithi084 ceph-mon[36833]: Updating smithi002:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.conf 2024-06-13T02:17:57.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:57 smithi084 ceph-mon[36833]: Updating smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:17:57.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:57 smithi084 ceph-mon[36833]: Updating smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:17:57.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:57 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:57.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:57 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:57.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:57 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:57.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:57 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:58.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:58 smithi002 ceph-mon[31960]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:17:58.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:58 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:58.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:58 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:58.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:58 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:58.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:58 smithi084 ceph-mon[36833]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:17:58.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:58 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:58.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:58 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:58.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:58 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:58.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:58 smithi175 ceph-mon[36977]: Updating smithi002:/etc/ceph/ceph.client.admin.keyring 2024-06-13T02:17:58.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:58 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:58.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:58 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:58.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:58 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:59 smithi002 ceph-mon[31960]: Updating smithi002:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:17:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:59 smithi002 ceph-mon[31960]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 78 op/s 2024-06-13T02:17:59.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:59 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:17:59.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:59 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:17:59.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:59 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:17:59.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:17:59 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:59.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:59 smithi084 ceph-mon[36833]: Updating smithi002:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:17:59.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:59 smithi084 ceph-mon[36833]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 78 op/s 2024-06-13T02:17:59.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:59 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:17:59.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:59 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:17:59.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:59 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:17:59.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:17:59 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:17:59.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:59 smithi175 ceph-mon[36977]: Updating smithi002:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/config/ceph.client.admin.keyring 2024-06-13T02:17:59.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:59 smithi175 ceph-mon[36977]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 78 op/s 2024-06-13T02:17:59.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:59 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:17:59.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:59 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:17:59.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:59 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:17:59.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:17:59 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:18:00.631 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:18:00 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:18:00.215+0000 7fc78c400700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:18:00.631 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:18:00 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:18:00.215+0000 7fc78c400700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:18:00.632 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:18:00 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:18:00.215+0000 7fc78c400700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:18:00.632 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:18:00 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:18:00.215+0000 7fc78c400700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:18:00.632 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:18:00 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:18:00.215+0000 7fc78c400700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-13T02:18:01.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:01 smithi002 ceph-mon[31960]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 103 KiB/s wr, 60 op/s 2024-06-13T02:18:01.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:01 smithi084 ceph-mon[36833]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 103 KiB/s wr, 60 op/s 2024-06-13T02:18:01.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:01 smithi175 ceph-mon[36977]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 103 KiB/s wr, 60 op/s 2024-06-13T02:18:03.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:03 smithi002 ceph-mon[31960]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 109 KiB/s wr, 68 op/s 2024-06-13T02:18:03.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:03 smithi002 ceph-mon[31960]: mgrmap e25: x(active, since 12s), standbys: z, y 2024-06-13T02:18:03.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:03 smithi084 ceph-mon[36833]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 109 KiB/s wr, 68 op/s 2024-06-13T02:18:03.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:03 smithi084 ceph-mon[36833]: mgrmap e25: x(active, since 12s), standbys: z, y 2024-06-13T02:18:03.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:03 smithi175 ceph-mon[36977]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 109 KiB/s wr, 68 op/s 2024-06-13T02:18:03.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:03 smithi175 ceph-mon[36977]: mgrmap e25: x(active, since 12s), standbys: z, y 2024-06-13T02:18:05.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:05 smithi002 ceph-mon[31960]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 100 KiB/s wr, 62 op/s 2024-06-13T02:18:05.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:05 smithi084 ceph-mon[36833]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 100 KiB/s wr, 62 op/s 2024-06-13T02:18:05.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:05 smithi175 ceph-mon[36977]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 100 KiB/s wr, 62 op/s 2024-06-13T02:18:07.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:07 smithi002 ceph-mon[31960]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 100 KiB/s wr, 63 op/s 2024-06-13T02:18:07.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:07 smithi084 ceph-mon[36833]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 100 KiB/s wr, 63 op/s 2024-06-13T02:18:07.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:07 smithi175 ceph-mon[36977]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 100 KiB/s wr, 63 op/s 2024-06-13T02:18:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.540+0000 7f0f40a00640 1 -- 172.21.15.2:0/1363054370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3c107e00 msgr2=0x7f0f3c108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.540+0000 7f0f40a00640 1 --2- 172.21.15.2:0/1363054370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3c107e00 0x7f0f3c108260 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009860 tx=0x7f0f2802a3d0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.540+0000 7f0f40a00640 1 -- 172.21.15.2:0/1363054370 shutdown_connections 2024-06-13T02:18:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.540+0000 7f0f40a00640 1 --2- 172.21.15.2:0/1363054370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f3c1087a0 0x7f0f3c114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.540+0000 7f0f40a00640 1 --2- 172.21.15.2:0/1363054370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3c107e00 0x7f0f3c108260 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.540+0000 7f0f40a00640 1 --2- 172.21.15.2:0/1363054370 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3c10dec0 0x7f0f3c10e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.540+0000 7f0f40a00640 1 -- 172.21.15.2:0/1363054370 >> 172.21.15.2:0/1363054370 conn(0x7f0f3c077550 msgr2=0x7f0f3c079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:07.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.541+0000 7f0f40a00640 1 -- 172.21.15.2:0/1363054370 shutdown_connections 2024-06-13T02:18:07.543 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.541+0000 7f0f40a00640 1 -- 172.21.15.2:0/1363054370 wait complete. 2024-06-13T02:18:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.542+0000 7f0f40a00640 1 Processor -- start 2024-06-13T02:18:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.542+0000 7f0f40a00640 1 -- start start 2024-06-13T02:18:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.542+0000 7f0f40a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3c107e00 0x7f0f3c19e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.542+0000 7f0f40a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f3c1087a0 0x7f0f3c19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.542+0000 7f0f40a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3c10dec0 0x7f0f3c1a2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.542+0000 7f0f40a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c118180 con 0x7f0f3c10dec0 2024-06-13T02:18:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.542+0000 7f0f40a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c118000 con 0x7f0f3c1087a0 2024-06-13T02:18:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.542+0000 7f0f40a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c118300 con 0x7f0f3c107e00 2024-06-13T02:18:07.545 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.542+0000 7f0f3a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3c107e00 0x7f0f3c19e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.543+0000 7f0f3a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3c107e00 0x7f0f3c19e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:38332/0 (socket says 172.21.15.2:38332) 2024-06-13T02:18:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.543+0000 7f0f3a800640 1 -- 172.21.15.2:0/218054396 learned_addr learned my addr 172.21.15.2:0/218054396 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.543+0000 7f0f39e00640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f3c1087a0 0x7f0f3c19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.543+0000 7f0f3b200640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3c10dec0 0x7f0f3c1a2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.543+0000 7f0f3a800640 1 -- 172.21.15.2:0/218054396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f3c1087a0 msgr2=0x7f0f3c19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.543+0000 7f0f3a800640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f3c1087a0 0x7f0f3c19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.543+0000 7f0f3a800640 1 -- 172.21.15.2:0/218054396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3c10dec0 msgr2=0x7f0f3c1a2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.543+0000 7f0f3a800640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3c10dec0 0x7f0f3c1a2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.543+0000 7f0f3a800640 1 -- 172.21.15.2:0/218054396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c1a3640 con 0x7f0f3c107e00 2024-06-13T02:18:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.543+0000 7f0f3b200640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3c10dec0 0x7f0f3c1a2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:18:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.543+0000 7f0f39e00640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f3c1087a0 0x7f0f3c19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:18:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.543+0000 7f0f3a800640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3c107e00 0x7f0f3c19e6a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00e9f0 tx=0x7f0f2c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:07.546 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.544+0000 7f0f33400640 1 -- 172.21.15.2:0/218054396 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00cd80 con 0x7f0f3c107e00 2024-06-13T02:18:07.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.544+0000 7f0f33400640 1 -- 172.21.15.2:0/218054396 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f2c010910 con 0x7f0f3c107e00 2024-06-13T02:18:07.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.544+0000 7f0f33400640 1 -- 172.21.15.2:0/218054396 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c018990 con 0x7f0f3c107e00 2024-06-13T02:18:07.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.544+0000 7f0f40a00640 1 -- 172.21.15.2:0/218054396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3c1a3930 con 0x7f0f3c107e00 2024-06-13T02:18:07.547 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.544+0000 7f0f40a00640 1 -- 172.21.15.2:0/218054396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3c1ab1c0 con 0x7f0f3c107e00 2024-06-13T02:18:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.547+0000 7f0f4421f740 1 Processor -- start 2024-06-13T02:18:07.548 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.547+0000 7f0f33400640 1 -- 172.21.15.2:0/218054396 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 138116+0+0 (secure 0 0 0) 0x7f0f2c010ac0 con 0x7f0f3c107e00 2024-06-13T02:18:07.549 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.547+0000 7f0f4421f740 1 -- start start 2024-06-13T02:18:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.547+0000 7f0f4421f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba9007a0 0x5573ba8fecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.548+0000 7f0f4421f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba8ff230 0x5573ba8ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.548+0000 7f0f4421f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba909fb0 0x5573ba90c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.548+0000 7f0f4421f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5573ba863420 con 0x5573ba9007a0 2024-06-13T02:18:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.548+0000 7f0f4421f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5573ba80ac50 con 0x5573ba909fb0 2024-06-13T02:18:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.548+0000 7f0f4421f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5573ba85f3e0 con 0x5573ba8ff230 2024-06-13T02:18:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.548+0000 7f0f3b200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba9007a0 0x5573ba8fecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.548+0000 7f0f3b200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba9007a0 0x5573ba8fecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59326/0 (socket says 172.21.15.2:59326) 2024-06-13T02:18:07.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.548+0000 7f0f3b200640 1 -- 172.21.15.2:0/2357425701 learned_addr learned my addr 172.21.15.2:0/2357425701 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.548+0000 7f0f3a800640 1 --2- 172.21.15.2:0/2357425701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba8ff230 0x5573ba8ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.548+0000 7f0f39e00640 1 --2- 172.21.15.2:0/2357425701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba909fb0 0x5573ba90c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.549+0000 7f0f3b200640 1 -- 172.21.15.2:0/2357425701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba8ff230 msgr2=0x5573ba8ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.549+0000 7f0f3b200640 1 --2- 172.21.15.2:0/2357425701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba8ff230 0x5573ba8ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.549+0000 7f0f3b200640 1 -- 172.21.15.2:0/2357425701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba909fb0 msgr2=0x5573ba90c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.549+0000 7f0f3b200640 1 --2- 172.21.15.2:0/2357425701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba909fb0 0x5573ba90c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.549+0000 7f0f3b200640 1 -- 172.21.15.2:0/2357425701 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ba577210 con 0x5573ba9007a0 2024-06-13T02:18:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.549+0000 7f0f3b200640 1 --2- 172.21.15.2:0/2357425701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba9007a0 0x5573ba8fecf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f34009fb0 tx=0x7f0f3400f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2178c9ac7c1e36ff server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.549+0000 7f0f33400640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f0f200a2e90 0x7f0f200a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.549+0000 7f0f27400640 1 -- 172.21.15.2:0/2357425701 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f34003970 con 0x5573ba9007a0 2024-06-13T02:18:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.549+0000 7f0f27400640 1 -- 172.21.15.2:0/2357425701 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f34004020 con 0x5573ba9007a0 2024-06-13T02:18:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.549+0000 7f0f27400640 1 -- 172.21.15.2:0/2357425701 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3400ca40 con 0x5573ba9007a0 2024-06-13T02:18:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.549+0000 7f0f33400640 1 -- 172.21.15.2:0/218054396 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f0f2c0cff50 con 0x7f0f3c107e00 2024-06-13T02:18:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.550+0000 7f0f3a800640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f0f200a2e90 0x7f0f200a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.550+0000 7f0f4421f740 1 -- 172.21.15.2:0/2357425701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba9007a0 msgr2=0x5573ba8fecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.550+0000 7f0f3a800640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f0f200a2e90 0x7f0f200a5350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0cd0f0 tx=0x7f0f2c0d3a00 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.550+0000 7f0f4421f740 1 --2- 172.21.15.2:0/2357425701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba9007a0 0x5573ba8fecf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f34009fb0 tx=0x7f0f3400f890 comp rx=0 tx=0).stop 2024-06-13T02:18:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.550+0000 7f0f4421f740 1 -- 172.21.15.2:0/2357425701 shutdown_connections 2024-06-13T02:18:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.550+0000 7f0f4421f740 1 --2- 172.21.15.2:0/2357425701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba909fb0 0x5573ba90c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.550+0000 7f0f4421f740 1 --2- 172.21.15.2:0/2357425701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba8ff230 0x5573ba8ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.550+0000 7f0f4421f740 1 --2- 172.21.15.2:0/2357425701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba9007a0 0x5573ba8fecf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.550+0000 7f0f4421f740 1 -- 172.21.15.2:0/2357425701 >> 172.21.15.2:0/2357425701 conn(0x5573ba8c7fb0 msgr2=0x5573ba8fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.550+0000 7f0f4421f740 1 -- 172.21.15.2:0/2357425701 shutdown_connections 2024-06-13T02:18:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.550+0000 7f0f4421f740 1 -- 172.21.15.2:0/2357425701 wait complete. 2024-06-13T02:18:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.551+0000 7f0f4421f740 1 -- start start 2024-06-13T02:18:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.551+0000 7f0f4421f740 1 Processor -- start 2024-06-13T02:18:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.552+0000 7f0f4421f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 0x5573ba906fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.552+0000 7f0f4421f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba9074f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.552+0000 7f0f4421f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 0x5573ba907a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.552+0000 7f0f4421f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5573ba90cd80 con 0x5573ba909fb0 2024-06-13T02:18:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.552+0000 7f0f4421f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5573ba81e0b0 con 0x5573ba8ff230 2024-06-13T02:18:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.552+0000 7f0f4421f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5573ba90cf00 con 0x5573ba9007a0 2024-06-13T02:18:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.552+0000 7f0f4421f740 10 client.0 _ll_register_callbacks cb 0x5573ba809f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:18:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.552+0000 7f0f39e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba9074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.552+0000 7f0f3b200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 0x5573ba906fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.552+0000 7f0f39e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba9074f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:38338/0 (socket says 172.21.15.2:38338) 2024-06-13T02:18:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.552+0000 7f0f39e00640 1 -- 172.21.15.2:0/1667483592 learned_addr learned my addr 172.21.15.2:0/1667483592 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.552+0000 7f0f3b200640 1 --2- 172.21.15.2:0/1667483592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 0x5573ba907a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.553+0000 7f0f39e00640 1 -- 172.21.15.2:0/1667483592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 msgr2=0x5573ba906fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.553+0000 7f0f39e00640 1 --2- 172.21.15.2:0/1667483592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 0x5573ba906fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.553+0000 7f0f39e00640 1 -- 172.21.15.2:0/1667483592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 msgr2=0x5573ba907a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.553+0000 7f0f39e00640 1 --2- 172.21.15.2:0/1667483592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 0x5573ba907a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.553+0000 7f0f39e00640 1 -- 172.21.15.2:0/1667483592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ba643620 con 0x5573ba9007a0 2024-06-13T02:18:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.553+0000 7f0f39e00640 1 --2- 172.21.15.2:0/1667483592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba9074f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f28000c00 tx=0x7f0f28005da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c5a9490ac369aa8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.553+0000 7f0f1be00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:18:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.553+0000 7f0f1be00640 1 -- 172.21.15.2:0/1667483592 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28004030 con 0x5573ba9007a0 2024-06-13T02:18:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.554+0000 7f0f4421f740 1 -- 172.21.15.2:0/1667483592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f34004020 con 0x5573ba9007a0 2024-06-13T02:18:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.554+0000 7f0f1be00640 1 -- 172.21.15.2:0/1667483592 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f0f280041d0 con 0x5573ba9007a0 2024-06-13T02:18:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.554+0000 7f0f1be00640 1 -- 172.21.15.2:0/1667483592 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0f2804e050 con 0x5573ba9007a0 2024-06-13T02:18:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.554+0000 7f0f4421f740 10 client.25252 fetch_fsmap learned FSMap version 27 2024-06-13T02:18:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.554+0000 7f0f4421f740 1 -- 172.21.15.2:0/1667483592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5573ba919110 con 0x5573ba9007a0 2024-06-13T02:18:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.554+0000 7f0f1be00640 1 -- 172.21.15.2:0/1667483592 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f34004020 con 0x5573ba9007a0 2024-06-13T02:18:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.555+0000 7f0f1be00640 1 -- 172.21.15.2:0/1667483592 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0f28004a30 con 0x5573ba9007a0 2024-06-13T02:18:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.555+0000 7f0f4421f740 10 client.25252 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T02:18:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.555+0000 7f0f4421f740 10 client.25252 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:18:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.555+0000 7f0f4421f740 20 client.25252 populate_metadata read hostname 'smithi002' 2024-06-13T02:18:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.555+0000 7f0f4421f740 1 --2- 172.21.15.2:0/1667483592 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573ba91a5d0 0x5573ba91c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.555+0000 7f0f4421f740 4 client.25252 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:18:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.555+0000 7f0f4421f740 1 -- 172.21.15.2:0/1667483592 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573ba870b50 con 0x5573ba91a5d0 2024-06-13T02:18:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.555+0000 7f0f3b200640 1 --2- 172.21.15.2:0/1667483592 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573ba91a5d0 0x5573ba91c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.556+0000 7f0f3b200640 1 --2- 172.21.15.2:0/1667483592 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573ba91a5d0 0x5573ba91c9e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b34a5344dc302d4 server_cookie=13538818d4ca77b4 in_seq=0 out_seq=0 2024-06-13T02:18:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.556+0000 7f0f1be00640 10 client.25252 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.557+0000 7f0f1be00640 1 -- 172.21.15.2:0/1667483592 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5573ba870b50 con 0x5573ba91a5d0 2024-06-13T02:18:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.557+0000 7f0f1be00640 10 client.25252 handle_command_reply: tid=0 2024-06-13T02:18:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.557+0000 7f0f4421f740 1 client.25252 shutdown 2024-06-13T02:18:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.557+0000 7f0f4421f740 1 -- 172.21.15.2:0/1667483592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 msgr2=0x5573ba9074f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.557+0000 7f0f4421f740 1 --2- 172.21.15.2:0/1667483592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba9074f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f28000c00 tx=0x7f0f28005da0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.557+0000 7f0f4421f740 1 -- 172.21.15.2:0/1667483592 shutdown_connections 2024-06-13T02:18:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.557+0000 7f0f4421f740 1 --2- 172.21.15.2:0/1667483592 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573ba91a5d0 0x5573ba91c9e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.557+0000 7f0f4421f740 1 --2- 172.21.15.2:0/1667483592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 0x5573ba907a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.557+0000 7f0f4421f740 1 --2- 172.21.15.2:0/1667483592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba9074f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.557+0000 7f0f4421f740 1 --2- 172.21.15.2:0/1667483592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 0x5573ba906fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.557+0000 7f0f4421f740 1 -- 172.21.15.2:0/1667483592 >> 172.21.15.2:0/1667483592 conn(0x5573ba8c7fb0 msgr2=0x5573ba901650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.557+0000 7f0f1be00640 0 client.25252 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:07.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.557+0000 7f0f4421f740 1 -- 172.21.15.2:0/1667483592 shutdown_connections 2024-06-13T02:18:07.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.558+0000 7f0f4421f740 1 -- 172.21.15.2:0/1667483592 wait complete. 2024-06-13T02:18:07.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.558+0000 7f0f4421f740 20 client.25252 trim_cache size 0 max 16384 2024-06-13T02:18:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.576+0000 7f0f4421f740 1 Processor -- start 2024-06-13T02:18:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.576+0000 7f0f4421f740 1 -- start start 2024-06-13T02:18:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.577+0000 7f0f4421f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 0x5573ba907850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.577+0000 7f0f4421f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba8fa820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.577+0000 7f0f4421f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 0x5573ba9222f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.577+0000 7f0f4421f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c1b7c20 con 0x5573ba909fb0 2024-06-13T02:18:07.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.577+0000 7f0f4421f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c1b54f0 con 0x5573ba8ff230 2024-06-13T02:18:07.579 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.577+0000 7f0f4421f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c1b3340 con 0x5573ba9007a0 2024-06-13T02:18:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.577+0000 7f0f39e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba8fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.577+0000 7f0f39e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba8fa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:38342/0 (socket says 172.21.15.2:38342) 2024-06-13T02:18:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.577+0000 7f0f39e00640 1 -- 172.21.15.2:0/546447399 learned_addr learned my addr 172.21.15.2:0/546447399 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.577+0000 7f0f3b200640 1 --2- 172.21.15.2:0/546447399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 0x5573ba9222f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.580 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.577+0000 7f0f3b200640 1 --2- 172.21.15.2:0/546447399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 0x5573ba907850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.578+0000 7f0f39e00640 1 -- 172.21.15.2:0/546447399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 msgr2=0x5573ba907850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.578+0000 7f0f39e00640 1 --2- 172.21.15.2:0/546447399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 0x5573ba907850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.578+0000 7f0f39e00640 1 -- 172.21.15.2:0/546447399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 msgr2=0x5573ba9222f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.578+0000 7f0f39e00640 1 --2- 172.21.15.2:0/546447399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 0x5573ba9222f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.578+0000 7f0f39e00640 1 -- 172.21.15.2:0/546447399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ba907d90 con 0x5573ba9007a0 2024-06-13T02:18:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.578+0000 7f0f3b200640 1 --2- 172.21.15.2:0/546447399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 0x5573ba9222f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:18:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.578+0000 7f0f39e00640 1 --2- 172.21.15.2:0/546447399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba8fa820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0f2802a8f0 tx=0x7f0f28005fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42653304fa5e1c8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.578+0000 7f0f26a00640 1 -- 172.21.15.2:0/546447399 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28003640 con 0x5573ba9007a0 2024-06-13T02:18:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.578+0000 7f0f26a00640 1 -- 172.21.15.2:0/546447399 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f28057070 con 0x5573ba9007a0 2024-06-13T02:18:07.581 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.578+0000 7f0f26a00640 1 -- 172.21.15.2:0/546447399 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28005440 con 0x5573ba9007a0 2024-06-13T02:18:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.579+0000 7f0f4421f740 1 -- 172.21.15.2:0/546447399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 msgr2=0x5573ba8fa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.579+0000 7f0f4421f740 1 --2- 172.21.15.2:0/546447399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba8fa820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0f2802a8f0 tx=0x7f0f28005fc0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.579+0000 7f0f4421f740 1 -- 172.21.15.2:0/546447399 shutdown_connections 2024-06-13T02:18:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.579+0000 7f0f4421f740 1 --2- 172.21.15.2:0/546447399 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 0x5573ba9222f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.579+0000 7f0f4421f740 1 --2- 172.21.15.2:0/546447399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba8fa820 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.579+0000 7f0f4421f740 1 --2- 172.21.15.2:0/546447399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 0x5573ba907850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.579+0000 7f0f4421f740 1 -- 172.21.15.2:0/546447399 >> 172.21.15.2:0/546447399 conn(0x5573ba8c7fb0 msgr2=0x5573ba8fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.580+0000 7f0f4421f740 1 -- 172.21.15.2:0/546447399 shutdown_connections 2024-06-13T02:18:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.580+0000 7f0f4421f740 1 -- 172.21.15.2:0/546447399 wait complete. 2024-06-13T02:18:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.580+0000 7f0f4421f740 1 -- start start 2024-06-13T02:18:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.580+0000 7f0f4421f740 1 Processor -- start 2024-06-13T02:18:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.581+0000 7f0f4421f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 0x5573ba903f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.581+0000 7f0f4421f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba904450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.581+0000 7f0f4421f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 0x5573ba904990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.581+0000 7f0f4421f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c1b39b0 con 0x5573ba909fb0 2024-06-13T02:18:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.581+0000 7f0f4421f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c1b4e20 con 0x5573ba8ff230 2024-06-13T02:18:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.581+0000 7f0f4421f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c1b4080 con 0x5573ba9007a0 2024-06-13T02:18:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.581+0000 7f0f4421f740 10 client.0 _ll_register_callbacks cb 0x7f0f34009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:18:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.581+0000 7f0f3b200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 0x5573ba903f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.582+0000 7f0f3b200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 0x5573ba903f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:51556/0 (socket says 172.21.15.2:51556) 2024-06-13T02:18:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.582+0000 7f0f3b200640 1 -- 172.21.15.2:0/2589878742 learned_addr learned my addr 172.21.15.2:0/2589878742 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.582+0000 7f0f3b200640 1 --2- 172.21.15.2:0/2589878742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 0x5573ba904990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.582+0000 7f0f39e00640 1 --2- 172.21.15.2:0/2589878742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba904450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.582+0000 7f0f39e00640 1 -- 172.21.15.2:0/2589878742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 msgr2=0x5573ba903f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.582+0000 7f0f39e00640 1 --2- 172.21.15.2:0/2589878742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 0x5573ba903f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.582+0000 7f0f39e00640 1 -- 172.21.15.2:0/2589878742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 msgr2=0x5573ba904990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.582+0000 7f0f39e00640 1 --2- 172.21.15.2:0/2589878742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 0x5573ba904990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.582+0000 7f0f39e00640 1 -- 172.21.15.2:0/2589878742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ba9842c0 con 0x5573ba9007a0 2024-06-13T02:18:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.582+0000 7f0f39e00640 1 --2- 172.21.15.2:0/2589878742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba904450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5573ba902a30 tx=0x7f0f28005930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62d3e5f6ffef8c04 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.582+0000 7f0f1be00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:18:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.583+0000 7f0f1be00640 1 -- 172.21.15.2:0/2589878742 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f280048c0 con 0x5573ba9007a0 2024-06-13T02:18:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.583+0000 7f0f4421f740 1 -- 172.21.15.2:0/2589878742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f28057070 con 0x5573ba9007a0 2024-06-13T02:18:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.583+0000 7f0f1be00640 1 -- 172.21.15.2:0/2589878742 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f0f28004a60 con 0x5573ba9007a0 2024-06-13T02:18:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.583+0000 7f0f1be00640 1 -- 172.21.15.2:0/2589878742 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0f28005040 con 0x5573ba9007a0 2024-06-13T02:18:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.583+0000 7f0f4421f740 10 client.25258 fetch_fsmap learned FSMap version 27 2024-06-13T02:18:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.583+0000 7f0f4421f740 1 -- 172.21.15.2:0/2589878742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5573ba9854b0 con 0x5573ba9007a0 2024-06-13T02:18:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.583+0000 7f0f1be00640 1 -- 172.21.15.2:0/2589878742 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f28057070 con 0x5573ba9007a0 2024-06-13T02:18:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.583+0000 7f0f1be00640 1 -- 172.21.15.2:0/2589878742 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0f2802fc60 con 0x5573ba9007a0 2024-06-13T02:18:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.584+0000 7f0f4421f740 10 client.25258 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T02:18:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.584+0000 7f0f4421f740 10 client.25258 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:18:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.584+0000 7f0f4421f740 20 client.25258 populate_metadata read hostname 'smithi002' 2024-06-13T02:18:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.584+0000 7f0f4421f740 1 --2- 172.21.15.2:0/2589878742 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573ba985b60 0x5573ba987f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.584+0000 7f0f4421f740 4 client.25258 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:18:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.584+0000 7f0f4421f740 1 -- 172.21.15.2:0/2589878742 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5573ba86aea0 con 0x5573ba985b60 2024-06-13T02:18:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.584+0000 7f0f3b200640 1 --2- 172.21.15.2:0/2589878742 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573ba985b60 0x5573ba987f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.585+0000 7f0f3b200640 1 --2- 172.21.15.2:0/2589878742 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573ba985b60 0x5573ba987f50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d83b5610de3c306 server_cookie=a3e2b96ae46dcd94 in_seq=0 out_seq=0 2024-06-13T02:18:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.585+0000 7f0f1be00640 10 client.25258 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:07.600 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.598+0000 7f0f1be00640 1 -- 172.21.15.2:0/2589878742 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5573ba86aea0 con 0x5573ba985b60 2024-06-13T02:18:07.600 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.598+0000 7f0f1be00640 10 client.25258 handle_command_reply: tid=0 2024-06-13T02:18:07.600 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.599+0000 7f0f4421f740 1 client.25258 shutdown 2024-06-13T02:18:07.600 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.599+0000 7f0f4421f740 1 -- 172.21.15.2:0/2589878742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 msgr2=0x5573ba904450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:07.600 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.599+0000 7f0f4421f740 1 --2- 172.21.15.2:0/2589878742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba904450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x5573ba902a30 tx=0x7f0f28005930 comp rx=0 tx=0).stop 2024-06-13T02:18:07.600 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.599+0000 7f0f4421f740 1 -- 172.21.15.2:0/2589878742 shutdown_connections 2024-06-13T02:18:07.600 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.599+0000 7f0f4421f740 1 --2- 172.21.15.2:0/2589878742 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573ba985b60 0x5573ba987f50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.600 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.599+0000 7f0f4421f740 1 --2- 172.21.15.2:0/2589878742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573ba909fb0 0x5573ba904990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.599+0000 7f0f4421f740 1 --2- 172.21.15.2:0/2589878742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573ba9007a0 0x5573ba904450 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.599+0000 7f0f4421f740 1 --2- 172.21.15.2:0/2589878742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573ba8ff230 0x5573ba903f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.599+0000 7f0f1be00640 0 client.25258 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.599+0000 7f0f4421f740 1 -- 172.21.15.2:0/2589878742 >> 172.21.15.2:0/2589878742 conn(0x5573ba8c7fb0 msgr2=0x5573ba8fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.599+0000 7f0f4421f740 1 -- 172.21.15.2:0/2589878742 shutdown_connections 2024-06-13T02:18:07.601 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.599+0000 7f0f4421f740 1 -- 172.21.15.2:0/2589878742 wait complete. 2024-06-13T02:18:07.602 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.599+0000 7f0f4421f740 20 client.25258 trim_cache size 0 max 16384 2024-06-13T02:18:07.602 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:18:07.602 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:18:07.602 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:18:07.603 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.600+0000 7f0f40a00640 1 -- 172.21.15.2:0/218054396 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f0f200a2e90 msgr2=0x7f0f200a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:07.603 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.600+0000 7f0f40a00640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f0f200a2e90 0x7f0f200a5350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0cd0f0 tx=0x7f0f2c0d3a00 comp rx=0 tx=0).stop 2024-06-13T02:18:07.603 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.600+0000 7f0f40a00640 1 -- 172.21.15.2:0/218054396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3c107e00 msgr2=0x7f0f3c19e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:07.603 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.600+0000 7f0f40a00640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3c107e00 0x7f0f3c19e6a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00e9f0 tx=0x7f0f2c00eeb0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.603 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.600+0000 7f0f40a00640 1 -- 172.21.15.2:0/218054396 shutdown_connections 2024-06-13T02:18:07.603 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.600+0000 7f0f40a00640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f0f200a2e90 0x7f0f200a5350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.603 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.600+0000 7f0f40a00640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0f3c10dec0 0x7f0f3c1a2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.603 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.600+0000 7f0f40a00640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f3c1087a0 0x7f0f3c19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.603 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.600+0000 7f0f40a00640 1 --2- 172.21.15.2:0/218054396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3c107e00 0x7f0f3c19e6a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:07.603 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.600+0000 7f0f40a00640 1 -- 172.21.15.2:0/218054396 >> 172.21.15.2:0/218054396 conn(0x7f0f3c077550 msgr2=0x7f0f3c078d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.600+0000 7f0f40a00640 1 -- 172.21.15.2:0/218054396 shutdown_connections 2024-06-13T02:18:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:07.600+0000 7f0f40a00640 1 -- 172.21.15.2:0/218054396 wait complete. 2024-06-13T02:18:09.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:09 smithi002 ceph-mon[31960]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 100 KiB/s wr, 65 op/s 2024-06-13T02:18:09.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:09 smithi084 ceph-mon[36833]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 100 KiB/s wr, 65 op/s 2024-06-13T02:18:09.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:09 smithi175 ceph-mon[36977]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 100 KiB/s wr, 65 op/s 2024-06-13T02:18:11.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:11 smithi002 ceph-mon[31960]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-06-13T02:18:11.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:11 smithi084 ceph-mon[36833]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-06-13T02:18:11.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:11 smithi175 ceph-mon[36977]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-06-13T02:18:13.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:13 smithi002 ceph-mon[31960]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-06-13T02:18:13.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:13 smithi084 ceph-mon[36833]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-06-13T02:18:13.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:13 smithi175 ceph-mon[36977]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-06-13T02:18:15.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:15 smithi002 ceph-mon[31960]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-06-13T02:18:15.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:15 smithi084 ceph-mon[36833]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-06-13T02:18:15.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:15 smithi175 ceph-mon[36977]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-06-13T02:18:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:17 smithi002 ceph-mon[31960]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-06-13T02:18:17.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:17 smithi084 ceph-mon[36833]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-06-13T02:18:17.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:17 smithi175 ceph-mon[36977]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-06-13T02:18:19.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:19 smithi002 ceph-mon[31960]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-06-13T02:18:19.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:19 smithi084 ceph-mon[36833]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-06-13T02:18:19.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:19 smithi175 ceph-mon[36977]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-06-13T02:18:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.743+0000 7fd7f8a00640 1 -- 172.21.15.2:0/1508690592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7f41099e0 msgr2=0x7fd7f4109dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.743+0000 7fd7f8a00640 1 --2- 172.21.15.2:0/1508690592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7f41099e0 0x7fd7f4109dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009930 tx=0x7fd7e402a420 comp rx=0 tx=0).stop 2024-06-13T02:18:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.743+0000 7fd7f8a00640 1 -- 172.21.15.2:0/1508690592 shutdown_connections 2024-06-13T02:18:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.743+0000 7fd7f8a00640 1 --2- 172.21.15.2:0/1508690592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7f4104390 0x7fd7f41108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.743+0000 7fd7f8a00640 1 --2- 172.21.15.2:0/1508690592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7f41039d0 0x7fd7f4103e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.743+0000 7fd7f8a00640 1 --2- 172.21.15.2:0/1508690592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7f41099e0 0x7fd7f4109dc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.743+0000 7fd7f8a00640 1 -- 172.21.15.2:0/1508690592 >> 172.21.15.2:0/1508690592 conn(0x7fd7f40ff4a0 msgr2=0x7fd7f41018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.743+0000 7fd7f8a00640 1 -- 172.21.15.2:0/1508690592 shutdown_connections 2024-06-13T02:18:20.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.743+0000 7fd7f8a00640 1 -- 172.21.15.2:0/1508690592 wait complete. 2024-06-13T02:18:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.744+0000 7fd7f8a00640 1 Processor -- start 2024-06-13T02:18:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.744+0000 7fd7f8a00640 1 -- start start 2024-06-13T02:18:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.745+0000 7fd7f8a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7f41039d0 0x7fd7f419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.745+0000 7fd7f8a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7f4104390 0x7fd7f419a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.745+0000 7fd7f8a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7f41099e0 0x7fd7f419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.745+0000 7fd7f8a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f4113e10 con 0x7fd7f4104390 2024-06-13T02:18:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.745+0000 7fd7f8a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f4113c90 con 0x7fd7f41039d0 2024-06-13T02:18:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.745+0000 7fd7f8a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f4113f90 con 0x7fd7f41099e0 2024-06-13T02:18:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.745+0000 7fd7f1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7f4104390 0x7fd7f419a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.745+0000 7fd7f2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7f41039d0 0x7fd7f419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.745+0000 7fd7f1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7f4104390 0x7fd7f419a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35190/0 (socket says 172.21.15.2:35190) 2024-06-13T02:18:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.745+0000 7fd7f1e00640 1 -- 172.21.15.2:0/3423001860 learned_addr learned my addr 172.21.15.2:0/3423001860 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.745+0000 7fd7f2800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7f41039d0 0x7fd7f419a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37912/0 (socket says 172.21.15.2:37912) 2024-06-13T02:18:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.745+0000 7fd7f3200640 1 --2- 172.21.15.2:0/3423001860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7f41099e0 0x7fd7f419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.746+0000 7fd7f2800640 1 -- 172.21.15.2:0/3423001860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7f41099e0 msgr2=0x7fd7f419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.746+0000 7fd7f2800640 1 --2- 172.21.15.2:0/3423001860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7f41099e0 0x7fd7f419eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.746+0000 7fd7f2800640 1 -- 172.21.15.2:0/3423001860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7f4104390 msgr2=0x7fd7f419a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.746+0000 7fd7f2800640 1 --2- 172.21.15.2:0/3423001860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7f4104390 0x7fd7f419a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.746+0000 7fd7f2800640 1 -- 172.21.15.2:0/3423001860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f419f290 con 0x7fd7f41039d0 2024-06-13T02:18:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.746+0000 7fd7f2800640 1 --2- 172.21.15.2:0/3423001860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7f41039d0 0x7fd7f419a2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd7e402a940 tx=0x7fd7e4003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.746+0000 7fd7eb400640 1 -- 172.21.15.2:0/3423001860 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e403f070 con 0x7fd7f41039d0 2024-06-13T02:18:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.747+0000 7fd7eb400640 1 -- 172.21.15.2:0/3423001860 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e4031c90 con 0x7fd7f41039d0 2024-06-13T02:18:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.747+0000 7fd7f8a00640 1 -- 172.21.15.2:0/3423001860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f419f520 con 0x7fd7f41039d0 2024-06-13T02:18:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.747+0000 7fd7eb400640 1 -- 172.21.15.2:0/3423001860 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4035030 con 0x7fd7f41039d0 2024-06-13T02:18:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.747+0000 7fd7f8a00640 1 -- 172.21.15.2:0/3423001860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f41a6e10 con 0x7fd7f41039d0 2024-06-13T02:18:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.750+0000 7fd7fc237740 1 Processor -- start 2024-06-13T02:18:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.750+0000 7fd7fc237740 1 -- start start 2024-06-13T02:18:20.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.750+0000 7fd7fc237740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143e7a0 0x557e1143ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.750+0000 7fd7fc237740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143d230 0x557e1143d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.750+0000 7fd7fc237740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 0x557e1144a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.750+0000 7fd7fc237740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557e113a1420 con 0x557e1143d230 2024-06-13T02:18:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.750+0000 7fd7fc237740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557e11348c50 con 0x557e11447fb0 2024-06-13T02:18:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.750+0000 7fd7fc237740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557e1139d3e0 con 0x557e1143e7a0 2024-06-13T02:18:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.751+0000 7fd7f1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 0x557e1144a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.751+0000 7fd7f1e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 0x557e1144a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37916/0 (socket says 172.21.15.2:37916) 2024-06-13T02:18:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.751+0000 7fd7eb400640 1 -- 172.21.15.2:0/3423001860 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 138116+0+0 (secure 0 0 0) 0x7fd7e4042070 con 0x7fd7f41039d0 2024-06-13T02:18:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.751+0000 7fd7f1e00640 1 -- 172.21.15.2:0/4196762456 learned_addr learned my addr 172.21.15.2:0/4196762456 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.751+0000 7fd7f3200640 1 --2- 172.21.15.2:0/4196762456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143e7a0 0x557e1143ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.751+0000 7fd7f1e00640 1 -- 172.21.15.2:0/4196762456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143e7a0 msgr2=0x557e1143ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.751+0000 7fd7f1e00640 1 --2- 172.21.15.2:0/4196762456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143e7a0 0x557e1143ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.751+0000 7fd7f1e00640 1 -- 172.21.15.2:0/4196762456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143d230 msgr2=0x557e1143d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:20.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.751+0000 7fd7f2800640 1 --2- 172.21.15.2:0/4196762456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143d230 0x557e1143d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.751+0000 7fd7f1e00640 1 --2- 172.21.15.2:0/4196762456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143d230 0x557e1143d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.751+0000 7fd7f1e00640 1 -- 172.21.15.2:0/4196762456 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e110b5210 con 0x557e11447fb0 2024-06-13T02:18:20.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.751+0000 7fd7f2800640 1 --2- 172.21.15.2:0/4196762456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143d230 0x557e1143d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:18:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.752+0000 7fd7f1e00640 1 --2- 172.21.15.2:0/4196762456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 0x557e1144a3a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009d90 tx=0x7fd7e0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc1b08573517fdef server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.752+0000 7fd7df400640 1 -- 172.21.15.2:0/4196762456 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0004230 con 0x557e11447fb0 2024-06-13T02:18:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.752+0000 7fd7df400640 1 -- 172.21.15.2:0/4196762456 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e00043d0 con 0x557e11447fb0 2024-06-13T02:18:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.752+0000 7fd7df400640 1 -- 172.21.15.2:0/4196762456 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00035f0 con 0x557e11447fb0 2024-06-13T02:18:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.752+0000 7fd7eb400640 1 --2- 172.21.15.2:0/3423001860 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd7d80a2e90 0x7fd7d80a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.752+0000 7fd7fc237740 1 -- 172.21.15.2:0/4196762456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 msgr2=0x557e1144a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.752+0000 7fd7fc237740 1 --2- 172.21.15.2:0/4196762456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 0x557e1144a3a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009d90 tx=0x7fd7e0011810 comp rx=0 tx=0).stop 2024-06-13T02:18:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.752+0000 7fd7eb400640 1 -- 172.21.15.2:0/3423001860 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fd7e40f0320 con 0x7fd7f41039d0 2024-06-13T02:18:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.753+0000 7fd7f3200640 1 --2- 172.21.15.2:0/3423001860 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd7d80a2e90 0x7fd7d80a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.753+0000 7fd7fc237740 1 -- 172.21.15.2:0/4196762456 shutdown_connections 2024-06-13T02:18:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.753+0000 7fd7fc237740 1 --2- 172.21.15.2:0/4196762456 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 0x557e1144a3a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.753+0000 7fd7fc237740 1 --2- 172.21.15.2:0/4196762456 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143d230 0x557e1143d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.753+0000 7fd7fc237740 1 --2- 172.21.15.2:0/4196762456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143e7a0 0x557e1143ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.753+0000 7fd7fc237740 1 -- 172.21.15.2:0/4196762456 >> 172.21.15.2:0/4196762456 conn(0x557e11405fb0 msgr2=0x557e11439820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.753+0000 7fd7fc237740 1 -- 172.21.15.2:0/4196762456 shutdown_connections 2024-06-13T02:18:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.753+0000 7fd7fc237740 1 -- 172.21.15.2:0/4196762456 wait complete. 2024-06-13T02:18:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.754+0000 7fd7f3200640 1 --2- 172.21.15.2:0/3423001860 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd7d80a2e90 0x7fd7d80a5350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec005fd0 tx=0x7fd7ec009500 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.754+0000 7fd7fc237740 1 -- start start 2024-06-13T02:18:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.754+0000 7fd7fc237740 1 Processor -- start 2024-06-13T02:18:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.754+0000 7fd7fc237740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e11444f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.754+0000 7fd7fc237740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143e7a0 0x557e114454c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.754+0000 7fd7fc237740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 0x557e11445a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.754+0000 7fd7fc237740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557e1144ad80 con 0x557e1143e7a0 2024-06-13T02:18:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.754+0000 7fd7fc237740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557e1135c0b0 con 0x557e11447fb0 2024-06-13T02:18:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.754+0000 7fd7fc237740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557e1144af00 con 0x557e1143d230 2024-06-13T02:18:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.754+0000 7fd7fc237740 10 client.0 _ll_register_callbacks cb 0x557e11347f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:18:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.755+0000 7fd7f1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143e7a0 0x557e114454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.755+0000 7fd7f1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143e7a0 0x557e114454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35210/0 (socket says 172.21.15.2:35210) 2024-06-13T02:18:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.755+0000 7fd7f1e00640 1 -- 172.21.15.2:0/447250035 learned_addr learned my addr 172.21.15.2:0/447250035 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.755+0000 7fd7f2800640 1 --2- 172.21.15.2:0/447250035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e11444f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.755+0000 7fd7f3200640 1 --2- 172.21.15.2:0/447250035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 0x557e11445a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.755+0000 7fd7f2800640 1 -- 172.21.15.2:0/447250035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 msgr2=0x557e11445a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.755+0000 7fd7f2800640 1 --2- 172.21.15.2:0/447250035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 0x557e11445a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.755+0000 7fd7f2800640 1 -- 172.21.15.2:0/447250035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143e7a0 msgr2=0x557e114454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.755+0000 7fd7f2800640 1 --2- 172.21.15.2:0/447250035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143e7a0 0x557e114454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.755+0000 7fd7f2800640 1 -- 172.21.15.2:0/447250035 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e11181620 con 0x557e1143d230 2024-06-13T02:18:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.755+0000 7fd7f1e00640 1 --2- 172.21.15.2:0/447250035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143e7a0 0x557e114454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:18:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.755+0000 7fd7f2800640 1 --2- 172.21.15.2:0/447250035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e11444f80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40ed460 tx=0x7fd7e402a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8193875972e9fb2e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.756+0000 7fd7d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:18:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.756+0000 7fd7d3e00640 1 -- 172.21.15.2:0/447250035 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4049070 con 0x557e1143d230 2024-06-13T02:18:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.756+0000 7fd7fc237740 1 -- 172.21.15.2:0/447250035 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7e00043d0 con 0x557e1143d230 2024-06-13T02:18:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.756+0000 7fd7d3e00640 1 -- 172.21.15.2:0/447250035 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fd7e40b8950 con 0x557e1143d230 2024-06-13T02:18:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.756+0000 7fd7d3e00640 1 -- 172.21.15.2:0/447250035 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd7e40f0160 con 0x557e1143d230 2024-06-13T02:18:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.756+0000 7fd7fc237740 10 client.25270 fetch_fsmap learned FSMap version 27 2024-06-13T02:18:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.756+0000 7fd7fc237740 1 -- 172.21.15.2:0/447250035 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557e1144ade0 con 0x557e1143d230 2024-06-13T02:18:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.756+0000 7fd7d3e00640 1 -- 172.21.15.2:0/447250035 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e00043d0 con 0x557e1143d230 2024-06-13T02:18:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.757+0000 7fd7d3e00640 1 -- 172.21.15.2:0/447250035 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd7e40bc540 con 0x557e1143d230 2024-06-13T02:18:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.757+0000 7fd7fc237740 10 client.25270 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T02:18:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.757+0000 7fd7fc237740 10 client.25270 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:18:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.757+0000 7fd7fc237740 20 client.25270 populate_metadata read hostname 'smithi002' 2024-06-13T02:18:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.757+0000 7fd7fc237740 1 --2- 172.21.15.2:0/447250035 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557e11458560 0x557e1145a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.757+0000 7fd7fc237740 4 client.25270 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:18:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.757+0000 7fd7fc237740 1 -- 172.21.15.2:0/447250035 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e113aeb50 con 0x557e11458560 2024-06-13T02:18:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.757+0000 7fd7f1e00640 1 --2- 172.21.15.2:0/447250035 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557e11458560 0x557e1145a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.758+0000 7fd7f1e00640 1 --2- 172.21.15.2:0/447250035 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557e11458560 0x557e1145a9f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97916f13bbe3becc server_cookie=b998232c7ffcbbed in_seq=0 out_seq=0 2024-06-13T02:18:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.758+0000 7fd7d3e00640 10 client.25270 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.758+0000 7fd7d3e00640 1 -- 172.21.15.2:0/447250035 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557e113aeb50 con 0x557e11458560 2024-06-13T02:18:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.758+0000 7fd7d3e00640 10 client.25270 handle_command_reply: tid=0 2024-06-13T02:18:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.759+0000 7fd7fc237740 1 client.25270 shutdown 2024-06-13T02:18:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.759+0000 7fd7fc237740 1 -- 172.21.15.2:0/447250035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 msgr2=0x557e11444f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.759+0000 7fd7fc237740 1 --2- 172.21.15.2:0/447250035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e11444f80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40ed460 tx=0x7fd7e402a420 comp rx=0 tx=0).stop 2024-06-13T02:18:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.759+0000 7fd7fc237740 1 -- 172.21.15.2:0/447250035 shutdown_connections 2024-06-13T02:18:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.759+0000 7fd7fc237740 1 --2- 172.21.15.2:0/447250035 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557e11458560 0x557e1145a9f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.759+0000 7fd7fc237740 1 --2- 172.21.15.2:0/447250035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 0x557e11445a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.759+0000 7fd7fc237740 1 --2- 172.21.15.2:0/447250035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143e7a0 0x557e114454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.759+0000 7fd7d3e00640 0 client.25270 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.759+0000 7fd7fc237740 1 --2- 172.21.15.2:0/447250035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e11444f80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.759+0000 7fd7fc237740 1 -- 172.21.15.2:0/447250035 >> 172.21.15.2:0/447250035 conn(0x557e11405fb0 msgr2=0x557e1143f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.759+0000 7fd7fc237740 1 -- 172.21.15.2:0/447250035 shutdown_connections 2024-06-13T02:18:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.759+0000 7fd7fc237740 1 -- 172.21.15.2:0/447250035 wait complete. 2024-06-13T02:18:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.759+0000 7fd7fc237740 20 client.25270 trim_cache size 0 max 16384 2024-06-13T02:18:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.778+0000 7fd7fc237740 1 Processor -- start 2024-06-13T02:18:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.778+0000 7fd7fc237740 1 -- start start 2024-06-13T02:18:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.779+0000 7fd7fc237740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e11438820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.779+0000 7fd7fc237740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e1143e7a0 0x557e11460290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.779+0000 7fd7fc237740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e11447fb0 0x557e114607d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.779+0000 7fd7fc237740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f41b38b0 con 0x557e11447fb0 2024-06-13T02:18:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.779+0000 7fd7fc237740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f41b1180 con 0x557e1143e7a0 2024-06-13T02:18:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.779+0000 7fd7fc237740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f41aefd0 con 0x557e1143d230 2024-06-13T02:18:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.779+0000 7fd7f3200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e11447fb0 0x557e114607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.779+0000 7fd7f3200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e11447fb0 0x557e114607d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35224/0 (socket says 172.21.15.2:35224) 2024-06-13T02:18:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.779+0000 7fd7f3200640 1 -- 172.21.15.2:0/567543338 learned_addr learned my addr 172.21.15.2:0/567543338 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.779+0000 7fd7f1e00640 1 --2- 172.21.15.2:0/567543338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e1143e7a0 0x557e11460290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.779+0000 7fd7f2800640 1 --2- 172.21.15.2:0/567543338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e11438820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.780+0000 7fd7f1e00640 1 -- 172.21.15.2:0/567543338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 msgr2=0x557e11438820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.780+0000 7fd7f1e00640 1 --2- 172.21.15.2:0/567543338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e11438820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.780+0000 7fd7f1e00640 1 -- 172.21.15.2:0/567543338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e11447fb0 msgr2=0x557e114607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.780+0000 7fd7f1e00640 1 --2- 172.21.15.2:0/567543338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e11447fb0 0x557e114607d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.780+0000 7fd7f1e00640 1 -- 172.21.15.2:0/567543338 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e1143d9f0 con 0x557e1143e7a0 2024-06-13T02:18:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.780+0000 7fd7f2800640 1 --2- 172.21.15.2:0/567543338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e11438820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:18:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.780+0000 7fd7f1e00640 1 --2- 172.21.15.2:0/567543338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e1143e7a0 0x557e11460290 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0004650 tx=0x7fd7e0004960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff5bb8a5c00678f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.780+0000 7fd7dea00640 1 -- 172.21.15.2:0/567543338 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e001e040 con 0x557e1143e7a0 2024-06-13T02:18:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.780+0000 7fd7dea00640 1 -- 172.21.15.2:0/567543338 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e001f040 con 0x557e1143e7a0 2024-06-13T02:18:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.780+0000 7fd7dea00640 1 -- 172.21.15.2:0/567543338 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0026840 con 0x557e1143e7a0 2024-06-13T02:18:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.781+0000 7fd7fc237740 1 -- 172.21.15.2:0/567543338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e1143e7a0 msgr2=0x557e11460290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.781+0000 7fd7fc237740 1 --2- 172.21.15.2:0/567543338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e1143e7a0 0x557e11460290 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0004650 tx=0x7fd7e0004960 comp rx=0 tx=0).stop 2024-06-13T02:18:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.781+0000 7fd7fc237740 1 -- 172.21.15.2:0/567543338 shutdown_connections 2024-06-13T02:18:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.781+0000 7fd7fc237740 1 --2- 172.21.15.2:0/567543338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e11447fb0 0x557e114607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.781+0000 7fd7fc237740 1 --2- 172.21.15.2:0/567543338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e1143e7a0 0x557e11460290 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.781+0000 7fd7fc237740 1 --2- 172.21.15.2:0/567543338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e11438820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.781+0000 7fd7fc237740 1 -- 172.21.15.2:0/567543338 >> 172.21.15.2:0/567543338 conn(0x557e11405fb0 msgr2=0x557e11438110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.781+0000 7fd7fc237740 1 -- 172.21.15.2:0/567543338 shutdown_connections 2024-06-13T02:18:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.781+0000 7fd7fc237740 1 -- 172.21.15.2:0/567543338 wait complete. 2024-06-13T02:18:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.782+0000 7fd7fc237740 1 -- start start 2024-06-13T02:18:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.782+0000 7fd7fc237740 1 Processor -- start 2024-06-13T02:18:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.782+0000 7fd7fc237740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e1144bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.782+0000 7fd7fc237740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143e7a0 0x557e1144c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.782+0000 7fd7fc237740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 0x557e1144ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.782+0000 7fd7fc237740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f41af640 con 0x557e1143e7a0 2024-06-13T02:18:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.782+0000 7fd7fc237740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f41b0ab0 con 0x557e11447fb0 2024-06-13T02:18:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.782+0000 7fd7fc237740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f41afd10 con 0x557e1143d230 2024-06-13T02:18:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.782+0000 7fd7fc237740 10 client.0 _ll_register_callbacks cb 0x7fd7e4005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:18:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.783+0000 7fd7f1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143e7a0 0x557e1144c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.783+0000 7fd7f2800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e1144bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.783+0000 7fd7f3200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 0x557e1144ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.783+0000 7fd7f2800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e1144bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:45562/0 (socket says 172.21.15.2:45562) 2024-06-13T02:18:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.783+0000 7fd7f3200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 0x557e1144ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37944/0 (socket says 172.21.15.2:37944) 2024-06-13T02:18:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.783+0000 7fd7f2800640 1 -- 172.21.15.2:0/3081756749 learned_addr learned my addr 172.21.15.2:0/3081756749 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.783+0000 7fd7f2800640 1 -- 172.21.15.2:0/3081756749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 msgr2=0x557e1144ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.783+0000 7fd7f2800640 1 --2- 172.21.15.2:0/3081756749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 0x557e1144ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.783+0000 7fd7f2800640 1 -- 172.21.15.2:0/3081756749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143e7a0 msgr2=0x557e1144c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.783+0000 7fd7f2800640 1 --2- 172.21.15.2:0/3081756749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143e7a0 0x557e1144c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.783+0000 7fd7f2800640 1 -- 172.21.15.2:0/3081756749 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e114c22b0 con 0x557e1143d230 2024-06-13T02:18:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.783+0000 7fd7f2800640 1 --2- 172.21.15.2:0/3081756749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e1144bfe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4005e90 tx=0x7fd7e403b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=274935925193ddcc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.783+0000 7fd7d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:18:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.784+0000 7fd7d3e00640 1 -- 172.21.15.2:0/3081756749 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40d4020 con 0x557e1143d230 2024-06-13T02:18:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.784+0000 7fd7d3e00640 1 -- 172.21.15.2:0/3081756749 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fd7e40c4a10 con 0x557e1143d230 2024-06-13T02:18:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.784+0000 7fd7fc237740 1 -- 172.21.15.2:0/3081756749 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7e001f040 con 0x557e1143d230 2024-06-13T02:18:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.784+0000 7fd7d3e00640 1 -- 172.21.15.2:0/3081756749 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd7e4049070 con 0x557e1143d230 2024-06-13T02:18:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.784+0000 7fd7fc237740 10 client.25276 fetch_fsmap learned FSMap version 27 2024-06-13T02:18:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.784+0000 7fd7fc237740 1 -- 172.21.15.2:0/3081756749 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557e114c35c0 con 0x557e1143d230 2024-06-13T02:18:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.784+0000 7fd7d3e00640 1 -- 172.21.15.2:0/3081756749 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e001f040 con 0x557e1143d230 2024-06-13T02:18:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.784+0000 7fd7d3e00640 1 -- 172.21.15.2:0/3081756749 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd7e40c0130 con 0x557e1143d230 2024-06-13T02:18:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.785+0000 7fd7fc237740 10 client.25276 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T02:18:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.785+0000 7fd7fc237740 10 client.25276 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:18:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.785+0000 7fd7fc237740 20 client.25276 populate_metadata read hostname 'smithi002' 2024-06-13T02:18:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.785+0000 7fd7fc237740 1 --2- 172.21.15.2:0/3081756749 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557e114c3bd0 0x557e114c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.785+0000 7fd7fc237740 4 client.25276 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:18:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.785+0000 7fd7fc237740 1 -- 172.21.15.2:0/3081756749 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557e113a8ea0 con 0x557e114c3bd0 2024-06-13T02:18:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.785+0000 7fd7f1e00640 1 --2- 172.21.15.2:0/3081756749 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557e114c3bd0 0x557e114c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.786+0000 7fd7d3e00640 10 client.25276 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.785+0000 7fd7f1e00640 1 --2- 172.21.15.2:0/3081756749 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557e114c3bd0 0x557e114c5ff0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=966f7e6609eb2156 server_cookie=192f324a6e63951 in_seq=0 out_seq=0 2024-06-13T02:18:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.791+0000 7fd7d3e00640 1 -- 172.21.15.2:0/3081756749 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x557e113a8ea0 con 0x557e114c3bd0 2024-06-13T02:18:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.791+0000 7fd7d3e00640 10 client.25276 handle_command_reply: tid=0 2024-06-13T02:18:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.791+0000 7fd7fc237740 1 client.25276 shutdown 2024-06-13T02:18:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.792+0000 7fd7fc237740 1 -- 172.21.15.2:0/3081756749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 msgr2=0x557e1144bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.792+0000 7fd7fc237740 1 --2- 172.21.15.2:0/3081756749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e1144bfe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4005e90 tx=0x7fd7e403b690 comp rx=0 tx=0).stop 2024-06-13T02:18:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.792+0000 7fd7fc237740 1 -- 172.21.15.2:0/3081756749 shutdown_connections 2024-06-13T02:18:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.792+0000 7fd7fc237740 1 --2- 172.21.15.2:0/3081756749 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557e114c3bd0 0x557e114c5ff0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.792+0000 7fd7fc237740 1 --2- 172.21.15.2:0/3081756749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557e11447fb0 0x557e1144ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.792+0000 7fd7fc237740 1 --2- 172.21.15.2:0/3081756749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557e1143e7a0 0x557e1144c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.792+0000 7fd7d3e00640 0 client.25276 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.792+0000 7fd7fc237740 1 --2- 172.21.15.2:0/3081756749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557e1143d230 0x557e1144bfe0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.792+0000 7fd7fc237740 1 -- 172.21.15.2:0/3081756749 >> 172.21.15.2:0/3081756749 conn(0x557e11405fb0 msgr2=0x557e1143f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.792+0000 7fd7fc237740 1 -- 172.21.15.2:0/3081756749 shutdown_connections 2024-06-13T02:18:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.792+0000 7fd7fc237740 1 -- 172.21.15.2:0/3081756749 wait complete. 2024-06-13T02:18:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.792+0000 7fd7fc237740 20 client.25276 trim_cache size 0 max 16384 2024-06-13T02:18:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:18:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:18:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:18:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.793+0000 7fd7f8a00640 1 -- 172.21.15.2:0/3423001860 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd7d80a2e90 msgr2=0x7fd7d80a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.793+0000 7fd7f8a00640 1 --2- 172.21.15.2:0/3423001860 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd7d80a2e90 0x7fd7d80a5350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec005fd0 tx=0x7fd7ec009500 comp rx=0 tx=0).stop 2024-06-13T02:18:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.793+0000 7fd7f8a00640 1 -- 172.21.15.2:0/3423001860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7f41039d0 msgr2=0x7fd7f419a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.793+0000 7fd7f8a00640 1 --2- 172.21.15.2:0/3423001860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7f41039d0 0x7fd7f419a2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd7e402a940 tx=0x7fd7e4003b20 comp rx=0 tx=0).stop 2024-06-13T02:18:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.793+0000 7fd7f8a00640 1 -- 172.21.15.2:0/3423001860 shutdown_connections 2024-06-13T02:18:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.793+0000 7fd7f8a00640 1 --2- 172.21.15.2:0/3423001860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7f41099e0 0x7fd7f419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.793+0000 7fd7f8a00640 1 --2- 172.21.15.2:0/3423001860 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fd7d80a2e90 0x7fd7d80a5350 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.793+0000 7fd7f8a00640 1 --2- 172.21.15.2:0/3423001860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd7f4104390 0x7fd7f419a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.793+0000 7fd7f8a00640 1 --2- 172.21.15.2:0/3423001860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7f41039d0 0x7fd7f419a2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.793+0000 7fd7f8a00640 1 -- 172.21.15.2:0/3423001860 >> 172.21.15.2:0/3423001860 conn(0x7fd7f40ff4a0 msgr2=0x7fd7f40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.793+0000 7fd7f8a00640 1 -- 172.21.15.2:0/3423001860 shutdown_connections 2024-06-13T02:18:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:20.793+0000 7fd7f8a00640 1 -- 172.21.15.2:0/3423001860 wait complete. 2024-06-13T02:18:21.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:21 smithi002 ceph-mon[31960]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-06-13T02:18:21.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:21 smithi084 ceph-mon[36833]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-06-13T02:18:21.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:21 smithi175 ceph-mon[36977]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-06-13T02:18:23.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:23 smithi002 ceph-mon[31960]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-06-13T02:18:23.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:23 smithi084 ceph-mon[36833]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-06-13T02:18:23.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:23 smithi175 ceph-mon[36977]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-06-13T02:18:25.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:25 smithi002 ceph-mon[31960]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:18:25.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:25 smithi084 ceph-mon[36833]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:18:25.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:25 smithi175 ceph-mon[36977]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:18:27.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:27 smithi002 ceph-mon[31960]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:18:27.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:27 smithi084 ceph-mon[36833]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:18:27.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:27 smithi175 ceph-mon[36977]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-13T02:18:29.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:29 smithi002 ceph-mon[31960]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-06-13T02:18:29.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:29 smithi084 ceph-mon[36833]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-06-13T02:18:29.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:29 smithi175 ceph-mon[36977]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-06-13T02:18:31.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:31 smithi002 ceph-mon[31960]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-13T02:18:31.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:31 smithi084 ceph-mon[36833]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-13T02:18:31.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:31 smithi175 ceph-mon[36977]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-13T02:18:33.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:33 smithi002 ceph-mon[31960]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 8 op/s 2024-06-13T02:18:33.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:33 smithi084 ceph-mon[36833]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 8 op/s 2024-06-13T02:18:33.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:33 smithi175 ceph-mon[36977]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 8 op/s 2024-06-13T02:18:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.983+0000 7febe2400640 1 -- 172.21.15.2:0/113064404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febdc1043a0 msgr2=0x7febdc1108b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.983+0000 7febe2400640 1 --2- 172.21.15.2:0/113064404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febdc1043a0 0x7febdc1108b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7febd4009ca0 tx=0x7febd402a8c0 comp rx=0 tx=0).stop 2024-06-13T02:18:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.983+0000 7febe2400640 1 -- 172.21.15.2:0/113064404 shutdown_connections 2024-06-13T02:18:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.983+0000 7febe2400640 1 --2- 172.21.15.2:0/113064404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febdc1043a0 0x7febdc1108b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.983+0000 7febe2400640 1 --2- 172.21.15.2:0/113064404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febdc1039e0 0x7febdc103e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.983+0000 7febe2400640 1 --2- 172.21.15.2:0/113064404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febdc1099f0 0x7febdc109dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.983+0000 7febe2400640 1 -- 172.21.15.2:0/113064404 >> 172.21.15.2:0/113064404 conn(0x7febdc0ff4b0 msgr2=0x7febdc1018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.983+0000 7febe2400640 1 -- 172.21.15.2:0/113064404 shutdown_connections 2024-06-13T02:18:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.983+0000 7febe2400640 1 -- 172.21.15.2:0/113064404 wait complete. 2024-06-13T02:18:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.984+0000 7febe2400640 1 Processor -- start 2024-06-13T02:18:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.984+0000 7febe2400640 1 -- start start 2024-06-13T02:18:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.985+0000 7febe2400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febdc1039e0 0x7febdc19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.985+0000 7febe2400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febdc1043a0 0x7febdc19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:33.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.985+0000 7febe2400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febdc1099f0 0x7febdc19ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.985+0000 7febe2400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7febdc113dd0 con 0x7febdc1043a0 2024-06-13T02:18:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.985+0000 7febe2400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7febdc113c50 con 0x7febdc1039e0 2024-06-13T02:18:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.985+0000 7febe2400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7febdc113f50 con 0x7febdc1099f0 2024-06-13T02:18:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.985+0000 7febe1000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febdc1039e0 0x7febdc19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.985+0000 7febe1a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febdc1099f0 0x7febdc19ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.985+0000 7febe1000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febdc1039e0 0x7febdc19a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:56132/0 (socket says 172.21.15.2:56132) 2024-06-13T02:18:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.985+0000 7febe1a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febdc1099f0 0x7febdc19ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:48986/0 (socket says 172.21.15.2:48986) 2024-06-13T02:18:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.985+0000 7febe1000640 1 -- 172.21.15.2:0/4036361888 learned_addr learned my addr 172.21.15.2:0/4036361888 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.986+0000 7febdbe00640 1 --2- 172.21.15.2:0/4036361888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febdc1043a0 0x7febdc19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.986+0000 7febe1a00640 1 -- 172.21.15.2:0/4036361888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febdc1039e0 msgr2=0x7febdc19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.986+0000 7febe1a00640 1 --2- 172.21.15.2:0/4036361888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febdc1039e0 0x7febdc19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.986+0000 7febe1a00640 1 -- 172.21.15.2:0/4036361888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febdc1043a0 msgr2=0x7febdc19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.986+0000 7febe1a00640 1 --2- 172.21.15.2:0/4036361888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febdc1043a0 0x7febdc19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.986+0000 7febe1a00640 1 -- 172.21.15.2:0/4036361888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febdc19f550 con 0x7febdc1099f0 2024-06-13T02:18:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.986+0000 7febdbe00640 1 --2- 172.21.15.2:0/4036361888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febdc1043a0 0x7febdc19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:18:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.986+0000 7febe1a00640 1 --2- 172.21.15.2:0/4036361888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febdc1099f0 0x7febdc19ee20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7febd4009ca0 tx=0x7febd4003ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.987+0000 7febd9600640 1 -- 172.21.15.2:0/4036361888 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd4031650 con 0x7febdc1099f0 2024-06-13T02:18:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.987+0000 7febd9600640 1 -- 172.21.15.2:0/4036361888 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febd40317f0 con 0x7febdc1099f0 2024-06-13T02:18:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.987+0000 7febd9600640 1 -- 172.21.15.2:0/4036361888 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd40309e0 con 0x7febdc1099f0 2024-06-13T02:18:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.987+0000 7febe2400640 1 -- 172.21.15.2:0/4036361888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febdc19f7e0 con 0x7febdc1099f0 2024-06-13T02:18:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.987+0000 7febe2400640 1 -- 172.21.15.2:0/4036361888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febdc1a70d0 con 0x7febdc1099f0 2024-06-13T02:18:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.991+0000 7febe680f740 1 Processor -- start 2024-06-13T02:18:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.992+0000 7febd9600640 1 -- 172.21.15.2:0/4036361888 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 138116+0+0 (secure 0 0 0) 0x7febd4030b80 con 0x7febdc1099f0 2024-06-13T02:18:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.992+0000 7febe680f740 1 -- start start 2024-06-13T02:18:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.992+0000 7febe680f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d555a07a0 0x563d5559ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.992+0000 7febe680f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d5559f230 0x563d5559f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.992+0000 7febe680f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d555b27c0 0x563d555b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.992+0000 7febe680f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563d55503420 con 0x563d5559f230 2024-06-13T02:18:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.992+0000 7febe680f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563d554aac50 con 0x563d555b27c0 2024-06-13T02:18:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.992+0000 7febe680f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563d554ff3e0 con 0x563d555a07a0 2024-06-13T02:18:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.993+0000 7febe1000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d5559f230 0x563d5559f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.993+0000 7febdbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d555a07a0 0x563d5559ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.993+0000 7febe1000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d5559f230 0x563d5559f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38088/0 (socket says 172.21.15.2:38088) 2024-06-13T02:18:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.993+0000 7febe1000640 1 -- 172.21.15.2:0/3883440998 learned_addr learned my addr 172.21.15.2:0/3883440998 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.993+0000 7febdbe00640 1 --2- 172.21.15.2:0/3883440998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d555b27c0 0x563d555b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.994+0000 7febe1000640 1 -- 172.21.15.2:0/3883440998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d555a07a0 msgr2=0x563d5559ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.994+0000 7febe1000640 1 --2- 172.21.15.2:0/3883440998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d555a07a0 0x563d5559ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.994+0000 7febe1000640 1 -- 172.21.15.2:0/3883440998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d555b27c0 msgr2=0x563d555b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.994+0000 7febe1000640 1 --2- 172.21.15.2:0/3883440998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d555b27c0 0x563d555b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.994+0000 7febe1000640 1 -- 172.21.15.2:0/3883440998 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d55217210 con 0x563d5559f230 2024-06-13T02:18:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.994+0000 7febd9600640 1 --2- 172.21.15.2:0/4036361888 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7febc40a2f10 0x7febc40a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.994+0000 7febd9600640 1 -- 172.21.15.2:0/4036361888 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7febd40f0dd0 con 0x7febdc1099f0 2024-06-13T02:18:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.994+0000 7febe1000640 1 --2- 172.21.15.2:0/3883440998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d5559f230 0x563d5559f6b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7febd0009d40 tx=0x7febd0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc308498d9e4012a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.995+0000 7febdbe00640 1 --2- 172.21.15.2:0/4036361888 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7febc40a2f10 0x7febc40a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.995+0000 7febce000640 1 -- 172.21.15.2:0/3883440998 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0004220 con 0x563d5559f230 2024-06-13T02:18:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.995+0000 7febce000640 1 -- 172.21.15.2:0/3883440998 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febd00043c0 con 0x563d5559f230 2024-06-13T02:18:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.995+0000 7febce000640 1 -- 172.21.15.2:0/3883440998 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd00035f0 con 0x563d5559f230 2024-06-13T02:18:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.995+0000 7febe680f740 1 -- 172.21.15.2:0/3883440998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d5559f230 msgr2=0x563d5559f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.995+0000 7febe680f740 1 --2- 172.21.15.2:0/3883440998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d5559f230 0x563d5559f6b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7febd0009d40 tx=0x7febd0011810 comp rx=0 tx=0).stop 2024-06-13T02:18:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.996+0000 7febe680f740 1 -- 172.21.15.2:0/3883440998 shutdown_connections 2024-06-13T02:18:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.996+0000 7febe680f740 1 --2- 172.21.15.2:0/3883440998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d555b27c0 0x563d555b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.996+0000 7febe680f740 1 --2- 172.21.15.2:0/3883440998 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d5559f230 0x563d5559f6b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.996+0000 7febe680f740 1 --2- 172.21.15.2:0/3883440998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d555a07a0 0x563d5559ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.996+0000 7febe680f740 1 -- 172.21.15.2:0/3883440998 >> 172.21.15.2:0/3883440998 conn(0x563d55567fb0 msgr2=0x563d5559b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.996+0000 7febdbe00640 1 --2- 172.21.15.2:0/4036361888 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7febc40a2f10 0x7febc40a53d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x563d5559c9b0 tx=0x7febc80046c0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.996+0000 7febe680f740 1 -- 172.21.15.2:0/3883440998 shutdown_connections 2024-06-13T02:18:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.996+0000 7febe680f740 1 -- 172.21.15.2:0/3883440998 wait complete. 2024-06-13T02:18:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.996+0000 7febe680f740 1 -- start start 2024-06-13T02:18:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.997+0000 7febe680f740 1 Processor -- start 2024-06-13T02:18:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.997+0000 7febe680f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d5559f230 0x563d555af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.997+0000 7febe680f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555a07a0 0x563d555afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.997+0000 7febe680f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d555b27c0 0x563d555b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.997+0000 7febe680f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563d555b5590 con 0x563d555a07a0 2024-06-13T02:18:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.997+0000 7febe680f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563d554be0b0 con 0x563d5559f230 2024-06-13T02:18:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.997+0000 7febe680f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563d555b5710 con 0x563d555b27c0 2024-06-13T02:18:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.997+0000 7febe680f740 10 client.0 _ll_register_callbacks cb 0x563d554a9f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:18:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.997+0000 7febdbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555a07a0 0x563d555afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.998+0000 7febdbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555a07a0 0x563d555afcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38104/0 (socket says 172.21.15.2:38104) 2024-06-13T02:18:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.998+0000 7febdbe00640 1 -- 172.21.15.2:0/2063761758 learned_addr learned my addr 172.21.15.2:0/2063761758 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.998+0000 7febe1000640 1 --2- 172.21.15.2:0/2063761758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d5559f230 0x563d555af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.998+0000 7febe1a00640 1 --2- 172.21.15.2:0/2063761758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d555b27c0 0x563d555b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.998+0000 7febe1000640 1 -- 172.21.15.2:0/2063761758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d555b27c0 msgr2=0x563d555b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.998+0000 7febe1000640 1 --2- 172.21.15.2:0/2063761758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d555b27c0 0x563d555b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.998+0000 7febe1000640 1 -- 172.21.15.2:0/2063761758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555a07a0 msgr2=0x563d555afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.998+0000 7febe1000640 1 --2- 172.21.15.2:0/2063761758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555a07a0 0x563d555afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.998+0000 7febe1000640 1 -- 172.21.15.2:0/2063761758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d552e3620 con 0x563d5559f230 2024-06-13T02:18:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.998+0000 7febdbe00640 1 --2- 172.21.15.2:0/2063761758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555a07a0 0x563d555afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:18:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.998+0000 7febe1000640 1 --2- 172.21.15.2:0/2063761758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d5559f230 0x563d555af780 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7febd0009d40 tx=0x7febd0005260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e73fb3b371628bba server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.999+0000 7febc2a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:18:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.999+0000 7febc2a00640 1 -- 172.21.15.2:0/2063761758 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0028020 con 0x563d5559f230 2024-06-13T02:18:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.999+0000 7febc2a00640 1 -- 172.21.15.2:0/2063761758 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7febd00053d0 con 0x563d5559f230 2024-06-13T02:18:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.999+0000 7febe680f740 1 -- 172.21.15.2:0/2063761758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febd00043c0 con 0x563d5559f230 2024-06-13T02:18:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.999+0000 7febc2a00640 1 -- 172.21.15.2:0/2063761758 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7febd0033050 con 0x563d5559f230 2024-06-13T02:18:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.999+0000 7febe680f740 10 client.25301 fetch_fsmap learned FSMap version 27 2024-06-13T02:18:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:33.999+0000 7febe680f740 1 -- 172.21.15.2:0/2063761758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563d555c1900 con 0x563d5559f230 2024-06-13T02:18:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.000+0000 7febc2a00640 1 -- 172.21.15.2:0/2063761758 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febd00043c0 con 0x563d5559f230 2024-06-13T02:18:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.000+0000 7febc2a00640 1 -- 172.21.15.2:0/2063761758 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7febd0023070 con 0x563d5559f230 2024-06-13T02:18:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.000+0000 7febe680f740 10 client.25301 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T02:18:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.000+0000 7febe680f740 10 client.25301 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:18:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.000+0000 7febe680f740 20 client.25301 populate_metadata read hostname 'smithi002' 2024-06-13T02:18:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.000+0000 7febe680f740 1 --2- 172.21.15.2:0/2063761758 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563d555c2dc0 0x563d555c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.000+0000 7febe680f740 4 client.25301 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:18:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.000+0000 7febe680f740 1 -- 172.21.15.2:0/2063761758 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d55510b50 con 0x563d555c2dc0 2024-06-13T02:18:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.000+0000 7febdbe00640 1 --2- 172.21.15.2:0/2063761758 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563d555c2dc0 0x563d555c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.001+0000 7febdbe00640 1 --2- 172.21.15.2:0/2063761758 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563d555c2dc0 0x563d555c51b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5523bb1c651509ab server_cookie=41906eee5c8524a5 in_seq=0 out_seq=0 2024-06-13T02:18:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.001+0000 7febc2a00640 10 client.25301 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.002+0000 7febc2a00640 1 -- 172.21.15.2:0/2063761758 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563d55510b50 con 0x563d555c2dc0 2024-06-13T02:18:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.002+0000 7febc2a00640 10 client.25301 handle_command_reply: tid=0 2024-06-13T02:18:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.002+0000 7febe680f740 1 client.25301 shutdown 2024-06-13T02:18:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.002+0000 7febe680f740 1 -- 172.21.15.2:0/2063761758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d5559f230 msgr2=0x563d555af780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.002+0000 7febe680f740 1 --2- 172.21.15.2:0/2063761758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d5559f230 0x563d555af780 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7febd0009d40 tx=0x7febd0005260 comp rx=0 tx=0).stop 2024-06-13T02:18:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.002+0000 7febe680f740 1 -- 172.21.15.2:0/2063761758 shutdown_connections 2024-06-13T02:18:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.002+0000 7febe680f740 1 --2- 172.21.15.2:0/2063761758 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563d555c2dc0 0x563d555c51b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.002+0000 7febe680f740 1 --2- 172.21.15.2:0/2063761758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d555b27c0 0x563d555b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.002+0000 7febe680f740 1 --2- 172.21.15.2:0/2063761758 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555a07a0 0x563d555afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.002+0000 7febe680f740 1 --2- 172.21.15.2:0/2063761758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d5559f230 0x563d555af780 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.002+0000 7febe680f740 1 -- 172.21.15.2:0/2063761758 >> 172.21.15.2:0/2063761758 conn(0x563d55567fb0 msgr2=0x563d555a1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.002+0000 7febc2a00640 0 client.25301 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.003+0000 7febe680f740 1 -- 172.21.15.2:0/2063761758 shutdown_connections 2024-06-13T02:18:34.006 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.003+0000 7febe680f740 1 -- 172.21.15.2:0/2063761758 wait complete. 2024-06-13T02:18:34.006 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.003+0000 7febe680f740 20 client.25301 trim_cache size 0 max 16384 2024-06-13T02:18:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.034+0000 7febe680f740 1 Processor -- start 2024-06-13T02:18:34.034 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.034+0000 7febe680f740 1 -- start start 2024-06-13T02:18:34.035 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.034+0000 7febe680f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d5559f230 0x563d5559b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:34.035 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.034+0000 7febe680f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d555a07a0 0x563d5559b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:34.035 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.034+0000 7febe680f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555b27c0 0x563d555ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:34.035 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.034+0000 7febe680f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7febdc1af3d0 con 0x563d555b27c0 2024-06-13T02:18:34.035 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.034+0000 7febe680f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7febdc1acca0 con 0x563d5559f230 2024-06-13T02:18:34.035 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.034+0000 7febe680f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7febdc1aab10 con 0x563d555a07a0 2024-06-13T02:18:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.035+0000 7febe1a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555b27c0 0x563d555ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.035+0000 7febe1000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d5559f230 0x563d5559b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.035+0000 7febe1a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555b27c0 0x563d555ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:38120/0 (socket says 172.21.15.2:38120) 2024-06-13T02:18:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.035+0000 7febe1a00640 1 -- 172.21.15.2:0/1092862347 learned_addr learned my addr 172.21.15.2:0/1092862347 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:34.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.035+0000 7febdbe00640 1 --2- 172.21.15.2:0/1092862347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d555a07a0 0x563d5559b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.035+0000 7febe1000640 1 -- 172.21.15.2:0/1092862347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d555a07a0 msgr2=0x563d5559b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.035+0000 7febe1000640 1 --2- 172.21.15.2:0/1092862347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d555a07a0 0x563d5559b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.035+0000 7febe1000640 1 -- 172.21.15.2:0/1092862347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555b27c0 msgr2=0x563d555ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.035+0000 7febe1000640 1 --2- 172.21.15.2:0/1092862347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555b27c0 0x563d555ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.035+0000 7febe1000640 1 -- 172.21.15.2:0/1092862347 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d555b06e0 con 0x563d5559f230 2024-06-13T02:18:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.035+0000 7febe1000640 1 --2- 172.21.15.2:0/1092862347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d5559f230 0x563d5559b120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7febd0009b00 tx=0x7febd0004f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75ff6950cebaa5b2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.036+0000 7febcd600640 1 -- 172.21.15.2:0/1092862347 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0028040 con 0x563d5559f230 2024-06-13T02:18:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.036+0000 7febcd600640 1 -- 172.21.15.2:0/1092862347 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febd0024430 con 0x563d5559f230 2024-06-13T02:18:34.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.036+0000 7febcd600640 1 -- 172.21.15.2:0/1092862347 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd001d030 con 0x563d5559f230 2024-06-13T02:18:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.037+0000 7febe680f740 1 -- 172.21.15.2:0/1092862347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d5559f230 msgr2=0x563d5559b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.037+0000 7febe680f740 1 --2- 172.21.15.2:0/1092862347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d5559f230 0x563d5559b120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7febd0009b00 tx=0x7febd0004f10 comp rx=0 tx=0).stop 2024-06-13T02:18:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.037+0000 7febe680f740 1 -- 172.21.15.2:0/1092862347 shutdown_connections 2024-06-13T02:18:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.037+0000 7febe680f740 1 --2- 172.21.15.2:0/1092862347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555b27c0 0x563d555ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.037+0000 7febe680f740 1 --2- 172.21.15.2:0/1092862347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d555a07a0 0x563d5559b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.037+0000 7febe680f740 1 --2- 172.21.15.2:0/1092862347 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d5559f230 0x563d5559b120 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.037+0000 7febe680f740 1 -- 172.21.15.2:0/1092862347 >> 172.21.15.2:0/1092862347 conn(0x563d55567fb0 msgr2=0x563d555affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.037+0000 7febe680f740 1 -- 172.21.15.2:0/1092862347 shutdown_connections 2024-06-13T02:18:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.037+0000 7febe680f740 1 -- 172.21.15.2:0/1092862347 wait complete. 2024-06-13T02:18:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.038+0000 7febe680f740 1 -- start start 2024-06-13T02:18:34.039 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.038+0000 7febe680f740 1 Processor -- start 2024-06-13T02:18:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.038+0000 7febe680f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d5559f230 0x563d555baa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.038+0000 7febe680f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d555a07a0 0x563d555baf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.038+0000 7febe680f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555b27c0 0x563d555b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.038+0000 7febe680f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7febdc1ab160 con 0x563d555b27c0 2024-06-13T02:18:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.039+0000 7febe680f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7febdc1ac5d0 con 0x563d555a07a0 2024-06-13T02:18:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.039+0000 7febe680f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7febdc1ab830 con 0x563d5559f230 2024-06-13T02:18:34.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.039+0000 7febe680f740 10 client.0 _ll_register_callbacks cb 0x7febc800bec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:18:34.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.039+0000 7febe1000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d5559f230 0x563d555baa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:34.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.039+0000 7febe1000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d5559f230 0x563d555baa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:49012/0 (socket says 172.21.15.2:49012) 2024-06-13T02:18:34.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.039+0000 7febe1000640 1 -- 172.21.15.2:0/518146345 learned_addr learned my addr 172.21.15.2:0/518146345 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:34.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.039+0000 7febdbe00640 1 --2- 172.21.15.2:0/518146345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d555a07a0 0x563d555baf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:34.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.039+0000 7febe1a00640 1 --2- 172.21.15.2:0/518146345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555b27c0 0x563d555b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:34.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.039+0000 7febe1000640 1 -- 172.21.15.2:0/518146345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d555a07a0 msgr2=0x563d555baf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:34.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.039+0000 7febe1000640 1 --2- 172.21.15.2:0/518146345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d555a07a0 0x563d555baf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.039+0000 7febe1000640 1 -- 172.21.15.2:0/518146345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555b27c0 msgr2=0x563d555b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:34.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.039+0000 7febe1000640 1 --2- 172.21.15.2:0/518146345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555b27c0 0x563d555b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.039+0000 7febe1000640 1 -- 172.21.15.2:0/518146345 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d555b6700 con 0x563d5559f230 2024-06-13T02:18:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.040+0000 7febe1000640 1 --2- 172.21.15.2:0/518146345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d5559f230 0x563d555baa40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7febd0003630 tx=0x7febd0011f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=630694eb7e1d3c65 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.040+0000 7febc2a00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:18:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.040+0000 7febc2a00640 1 -- 172.21.15.2:0/518146345 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd0028070 con 0x563d5559f230 2024-06-13T02:18:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.040+0000 7febe680f740 1 -- 172.21.15.2:0/518146345 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febd0024430 con 0x563d5559f230 2024-06-13T02:18:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.040+0000 7febc2a00640 1 -- 172.21.15.2:0/518146345 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7febd0005440 con 0x563d5559f230 2024-06-13T02:18:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.040+0000 7febc2a00640 1 -- 172.21.15.2:0/518146345 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7febd001d040 con 0x563d5559f230 2024-06-13T02:18:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.040+0000 7febe680f740 10 client.25294 fetch_fsmap learned FSMap version 27 2024-06-13T02:18:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.040+0000 7febe680f740 1 -- 172.21.15.2:0/518146345 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563d5562d3e0 con 0x563d5559f230 2024-06-13T02:18:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.041+0000 7febc2a00640 1 -- 172.21.15.2:0/518146345 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febd0024430 con 0x563d5559f230 2024-06-13T02:18:34.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.041+0000 7febc2a00640 1 -- 172.21.15.2:0/518146345 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7febd0023040 con 0x563d5559f230 2024-06-13T02:18:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.041+0000 7febe680f740 10 client.25294 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T02:18:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.041+0000 7febe680f740 10 client.25294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:18:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.041+0000 7febe680f740 20 client.25294 populate_metadata read hostname 'smithi002' 2024-06-13T02:18:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.041+0000 7febe680f740 1 --2- 172.21.15.2:0/518146345 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563d5562da30 0x563d5562fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.041+0000 7febe680f740 4 client.25294 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:18:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.041+0000 7febe680f740 1 -- 172.21.15.2:0/518146345 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563d5550aea0 con 0x563d5562da30 2024-06-13T02:18:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.041+0000 7febdbe00640 1 --2- 172.21.15.2:0/518146345 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563d5562da30 0x563d5562fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.042+0000 7febdbe00640 1 --2- 172.21.15.2:0/518146345 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563d5562da30 0x563d5562fe50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc9d88efa29f340a server_cookie=bd2c587ce01c5a5e in_seq=0 out_seq=0 2024-06-13T02:18:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.042+0000 7febc2a00640 10 client.25294 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.050+0000 7febc2a00640 1 -- 172.21.15.2:0/518146345 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x563d5550aea0 con 0x563d5562da30 2024-06-13T02:18:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.050+0000 7febc2a00640 10 client.25294 handle_command_reply: tid=0 2024-06-13T02:18:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.050+0000 7febe680f740 1 client.25294 shutdown 2024-06-13T02:18:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.050+0000 7febe680f740 1 -- 172.21.15.2:0/518146345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d5559f230 msgr2=0x563d555baa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.050+0000 7febe680f740 1 --2- 172.21.15.2:0/518146345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d5559f230 0x563d555baa40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7febd0003630 tx=0x7febd0011f90 comp rx=0 tx=0).stop 2024-06-13T02:18:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.050+0000 7febe680f740 1 -- 172.21.15.2:0/518146345 shutdown_connections 2024-06-13T02:18:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.050+0000 7febe680f740 1 --2- 172.21.15.2:0/518146345 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563d5562da30 0x563d5562fe50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.051+0000 7febe680f740 1 --2- 172.21.15.2:0/518146345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563d555b27c0 0x563d555b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.051+0000 7febe680f740 1 --2- 172.21.15.2:0/518146345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d555a07a0 0x563d555baf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.051+0000 7febe680f740 1 --2- 172.21.15.2:0/518146345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563d5559f230 0x563d555baa40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.051+0000 7febe680f740 1 -- 172.21.15.2:0/518146345 >> 172.21.15.2:0/518146345 conn(0x563d55567fb0 msgr2=0x563d555a0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.051+0000 7febc2a00640 0 client.25294 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.051+0000 7febe680f740 1 -- 172.21.15.2:0/518146345 shutdown_connections 2024-06-13T02:18:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.052+0000 7febe680f740 1 -- 172.21.15.2:0/518146345 wait complete. 2024-06-13T02:18:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.052+0000 7febe680f740 20 client.25294 trim_cache size 0 max 16384 2024-06-13T02:18:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:18:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:18:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:18:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.053+0000 7febe2400640 1 -- 172.21.15.2:0/4036361888 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7febc40a2f10 msgr2=0x7febc40a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.053+0000 7febe2400640 1 --2- 172.21.15.2:0/4036361888 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7febc40a2f10 0x7febc40a53d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x563d5559c9b0 tx=0x7febc80046c0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.053+0000 7febe2400640 1 -- 172.21.15.2:0/4036361888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febdc1099f0 msgr2=0x7febdc19ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.053+0000 7febe2400640 1 --2- 172.21.15.2:0/4036361888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febdc1099f0 0x7febdc19ee20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7febd4009ca0 tx=0x7febd4003ce0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.053+0000 7febe2400640 1 -- 172.21.15.2:0/4036361888 shutdown_connections 2024-06-13T02:18:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.053+0000 7febe2400640 1 --2- 172.21.15.2:0/4036361888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febdc1099f0 0x7febdc19ee20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.053+0000 7febe2400640 1 --2- 172.21.15.2:0/4036361888 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7febc40a2f10 0x7febc40a53d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.053+0000 7febe2400640 1 --2- 172.21.15.2:0/4036361888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7febdc1043a0 0x7febdc19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.053+0000 7febe2400640 1 --2- 172.21.15.2:0/4036361888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febdc1039e0 0x7febdc19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.053+0000 7febe2400640 1 -- 172.21.15.2:0/4036361888 >> 172.21.15.2:0/4036361888 conn(0x7febdc0ff4b0 msgr2=0x7febdc0ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.053+0000 7febe2400640 1 -- 172.21.15.2:0/4036361888 shutdown_connections 2024-06-13T02:18:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:34.053+0000 7febe2400640 1 -- 172.21.15.2:0/4036361888 wait complete. 2024-06-13T02:18:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:35 smithi084 ceph-mon[36833]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-13T02:18:35.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:35 smithi175 ceph-mon[36977]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-13T02:18:35.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:35 smithi002 ceph-mon[31960]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-06-13T02:18:37.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:37 smithi084 ceph-mon[36833]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-06-13T02:18:37.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:37 smithi175 ceph-mon[36977]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-06-13T02:18:37.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:37 smithi002 ceph-mon[31960]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-06-13T02:18:39.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:39 smithi084 ceph-mon[36833]: pgmap v27: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-06-13T02:18:39.483 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:39 smithi002 ceph-mon[31960]: pgmap v27: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-06-13T02:18:39.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:39 smithi175 ceph-mon[36977]: pgmap v27: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-06-13T02:18:40.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:40 smithi084 ceph-mon[36833]: pgmap v28: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-06-13T02:18:40.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:40 smithi175 ceph-mon[36977]: pgmap v28: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-06-13T02:18:40.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:40 smithi002 ceph-mon[31960]: pgmap v28: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-06-13T02:18:42.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:42 smithi084 ceph-mon[36833]: pgmap v29: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-06-13T02:18:43.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:42 smithi175 ceph-mon[36977]: pgmap v29: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-06-13T02:18:43.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:42 smithi002 ceph-mon[31960]: pgmap v29: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-06-13T02:18:44.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:44 smithi084 ceph-mon[36833]: pgmap v30: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-06-13T02:18:45.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:44 smithi175 ceph-mon[36977]: pgmap v30: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-06-13T02:18:45.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:44 smithi002 ceph-mon[31960]: pgmap v30: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-06-13T02:18:46.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:46 smithi084 ceph-mon[36833]: pgmap v31: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-06-13T02:18:47.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:46 smithi175 ceph-mon[36977]: pgmap v31: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-06-13T02:18:47.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:46 smithi002 ceph-mon[31960]: pgmap v31: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-06-13T02:18:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.240+0000 7f1ea5e00640 1 -- 172.21.15.2:0/1648387750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea01032a0 msgr2=0x7f1ea010b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:47.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.240+0000 7f1ea5e00640 1 --2- 172.21.15.2:0/1648387750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea01032a0 0x7f1ea010b780 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009900 tx=0x7f1e8c02a480 comp rx=0 tx=0).stop 2024-06-13T02:18:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.240+0000 7f1ea5e00640 1 -- 172.21.15.2:0/1648387750 shutdown_connections 2024-06-13T02:18:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.240+0000 7f1ea5e00640 1 --2- 172.21.15.2:0/1648387750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea010bda0 0x7f1ea010e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.240+0000 7f1ea5e00640 1 --2- 172.21.15.2:0/1648387750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea01032a0 0x7f1ea010b780 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.240+0000 7f1ea5e00640 1 --2- 172.21.15.2:0/1648387750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ea0102980 0x7f1ea0102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.240+0000 7f1ea5e00640 1 -- 172.21.15.2:0/1648387750 >> 172.21.15.2:0/1648387750 conn(0x7f1ea00fc180 msgr2=0x7f1ea00fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.240+0000 7f1ea5e00640 1 -- 172.21.15.2:0/1648387750 shutdown_connections 2024-06-13T02:18:47.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.240+0000 7f1ea5e00640 1 -- 172.21.15.2:0/1648387750 wait complete. 2024-06-13T02:18:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.241+0000 7f1ea5e00640 1 Processor -- start 2024-06-13T02:18:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.242+0000 7f1ea5e00640 1 -- start start 2024-06-13T02:18:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.242+0000 7f1ea5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0102980 0x7f1ea019a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.242+0000 7f1ea5e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea01032a0 0x7f1ea019a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.242+0000 7f1ea5e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ea010bda0 0x7f1ea019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.242+0000 7f1ea5e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea0111bf0 con 0x7f1ea0102980 2024-06-13T02:18:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.242+0000 7f1ea5e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea0111a70 con 0x7f1ea01032a0 2024-06-13T02:18:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.242+0000 7f1ea5e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea0111d70 con 0x7f1ea010bda0 2024-06-13T02:18:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.243+0000 7f1ea4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0102980 0x7f1ea019a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.243+0000 7f1ea4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0102980 0x7f1ea019a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41984/0 (socket says 172.21.15.2:41984) 2024-06-13T02:18:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.243+0000 7f1ea4a00640 1 -- 172.21.15.2:0/1351706393 learned_addr learned my addr 172.21.15.2:0/1351706393 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.243+0000 7f1e9fe00640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea01032a0 0x7f1ea019a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.243+0000 7f1ea5400640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ea010bda0 0x7f1ea019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.243+0000 7f1e9fe00640 1 -- 172.21.15.2:0/1351706393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ea010bda0 msgr2=0x7f1ea019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.243+0000 7f1e9fe00640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ea010bda0 0x7f1ea019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.243+0000 7f1e9fe00640 1 -- 172.21.15.2:0/1351706393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0102980 msgr2=0x7f1ea019a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.243+0000 7f1e9fe00640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0102980 0x7f1ea019a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.243+0000 7f1e9fe00640 1 -- 172.21.15.2:0/1351706393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea019f2c0 con 0x7f1ea01032a0 2024-06-13T02:18:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.243+0000 7f1ea5400640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ea010bda0 0x7f1ea019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:18:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.243+0000 7f1ea4a00640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0102980 0x7f1ea019a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:18:47.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.244+0000 7f1e9fe00640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea01032a0 0x7f1ea019a810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c02a9a0 tx=0x7f1e8c003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.244+0000 7f1e9d600640 1 -- 172.21.15.2:0/1351706393 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c03f070 con 0x7f1ea01032a0 2024-06-13T02:18:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.244+0000 7f1e9d600640 1 -- 172.21.15.2:0/1351706393 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e8c031c90 con 0x7f1ea01032a0 2024-06-13T02:18:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.244+0000 7f1e9d600640 1 -- 172.21.15.2:0/1351706393 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c035030 con 0x7f1ea01032a0 2024-06-13T02:18:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.244+0000 7f1ea5e00640 1 -- 172.21.15.2:0/1351706393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea019f550 con 0x7f1ea01032a0 2024-06-13T02:18:47.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.244+0000 7f1ea5e00640 1 -- 172.21.15.2:0/1351706393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea01a6e40 con 0x7f1ea01032a0 2024-06-13T02:18:47.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.248+0000 7f1eaa232740 1 Processor -- start 2024-06-13T02:18:47.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.248+0000 7f1eaa232740 1 -- start start 2024-06-13T02:18:47.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.249+0000 7f1eaa232740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.249+0000 7f1e9d600640 1 -- 172.21.15.2:0/1351706393 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 138116+0+0 (secure 0 0 0) 0x7f1e8c042070 con 0x7f1ea01032a0 2024-06-13T02:18:47.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.249+0000 7f1eaa232740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee01d0230 0x55fee01d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.249+0000 7f1eaa232740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01dafb0 0x55fee01dd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.249+0000 7f1eaa232740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fee0134420 con 0x55fee01d17a0 2024-06-13T02:18:47.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.249+0000 7f1eaa232740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fee00dbc50 con 0x55fee01d0230 2024-06-13T02:18:47.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.249+0000 7f1eaa232740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fee01303e0 con 0x55fee01dafb0 2024-06-13T02:18:47.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.249+0000 7f1e9fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01dafb0 0x55fee01dd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.249+0000 7f1e9fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01dafb0 0x55fee01dd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:41364/0 (socket says 172.21.15.2:41364) 2024-06-13T02:18:47.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.249+0000 7f1e9fe00640 1 -- 172.21.15.2:0/4085609306 learned_addr learned my addr 172.21.15.2:0/4085609306 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:47.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.250+0000 7f1ea4a00640 1 --2- 172.21.15.2:0/4085609306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee01d0230 0x55fee01d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.250+0000 7f1e9fe00640 1 -- 172.21.15.2:0/4085609306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee01d0230 msgr2=0x55fee01d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:47.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.250+0000 7f1e9fe00640 1 --2- 172.21.15.2:0/4085609306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee01d0230 0x55fee01d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.250+0000 7f1e9fe00640 1 -- 172.21.15.2:0/4085609306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 msgr2=0x55fee01cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:47.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.250+0000 7f1ea5400640 1 --2- 172.21.15.2:0/4085609306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.250+0000 7f1e9fe00640 1 --2- 172.21.15.2:0/4085609306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.250+0000 7f1e9fe00640 1 -- 172.21.15.2:0/4085609306 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fedfe48210 con 0x55fee01dafb0 2024-06-13T02:18:47.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.250+0000 7f1ea5400640 1 --2- 172.21.15.2:0/4085609306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:18:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.251+0000 7f1e9fe00640 1 --2- 172.21.15.2:0/4085609306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01dafb0 0x55fee01dd3a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0ed4c0 tx=0x7f1e8c0fee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb07b599222b29f9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.251+0000 7f1e91c00640 1 -- 172.21.15.2:0/4085609306 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c0f2300 con 0x55fee01dafb0 2024-06-13T02:18:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.251+0000 7f1e91c00640 1 -- 172.21.15.2:0/4085609306 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e8c0fe5b0 con 0x55fee01dafb0 2024-06-13T02:18:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.251+0000 7f1e91c00640 1 -- 172.21.15.2:0/4085609306 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c0f0800 con 0x55fee01dafb0 2024-06-13T02:18:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.251+0000 7f1e9d600640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f1e880a2f10 0x7f1e880a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.251+0000 7f1e9d600640 1 -- 172.21.15.2:0/1351706393 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f1e8c0f0410 con 0x7f1ea01032a0 2024-06-13T02:18:47.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.251+0000 7f1ea5400640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f1e880a2f10 0x7f1e880a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.252+0000 7f1eaa232740 1 -- 172.21.15.2:0/4085609306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01dafb0 msgr2=0x55fee01dd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.252+0000 7f1ea5400640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f1e880a2f10 0x7f1e880a53d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e98005fd0 tx=0x7f1e980094a0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.252+0000 7f1eaa232740 1 --2- 172.21.15.2:0/4085609306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01dafb0 0x55fee01dd3a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0ed4c0 tx=0x7f1e8c0fee40 comp rx=0 tx=0).stop 2024-06-13T02:18:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.253+0000 7f1eaa232740 1 -- 172.21.15.2:0/4085609306 shutdown_connections 2024-06-13T02:18:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.253+0000 7f1eaa232740 1 --2- 172.21.15.2:0/4085609306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01dafb0 0x55fee01dd3a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.253+0000 7f1eaa232740 1 --2- 172.21.15.2:0/4085609306 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee01d0230 0x55fee01d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.253+0000 7f1eaa232740 1 --2- 172.21.15.2:0/4085609306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.253+0000 7f1eaa232740 1 -- 172.21.15.2:0/4085609306 >> 172.21.15.2:0/4085609306 conn(0x55fee0198fb0 msgr2=0x55fee01cc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.253+0000 7f1eaa232740 1 -- 172.21.15.2:0/4085609306 shutdown_connections 2024-06-13T02:18:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.253+0000 7f1eaa232740 1 -- 172.21.15.2:0/4085609306 wait complete. 2024-06-13T02:18:47.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.253+0000 7f1eaa232740 1 -- start start 2024-06-13T02:18:47.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.254+0000 7f1eaa232740 1 Processor -- start 2024-06-13T02:18:47.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.254+0000 7f1eaa232740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 0x55fee01d7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.254+0000 7f1eaa232740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01d8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.254+0000 7f1eaa232740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee01dafb0 0x55fee01d89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.254+0000 7f1eaa232740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fee01ddaa0 con 0x55fee01d17a0 2024-06-13T02:18:47.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.254+0000 7f1eaa232740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fee00ef0b0 con 0x55fee01dafb0 2024-06-13T02:18:47.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.254+0000 7f1eaa232740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55fee01ddc20 con 0x55fee01d0230 2024-06-13T02:18:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.254+0000 7f1eaa232740 10 client.0 _ll_register_callbacks cb 0x55fee00daf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:18:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.255+0000 7f1ea4a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 0x55fee01d7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.255+0000 7f1ea4a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 0x55fee01d7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:41370/0 (socket says 172.21.15.2:41370) 2024-06-13T02:18:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.255+0000 7f1ea4a00640 1 -- 172.21.15.2:0/3102430094 learned_addr learned my addr 172.21.15.2:0/3102430094 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.255+0000 7f1ea5400640 1 --2- 172.21.15.2:0/3102430094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee01dafb0 0x55fee01d89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.255+0000 7f1e9fe00640 1 --2- 172.21.15.2:0/3102430094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01d8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.255+0000 7f1ea4a00640 1 -- 172.21.15.2:0/3102430094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee01dafb0 msgr2=0x55fee01d89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.255+0000 7f1ea4a00640 1 --2- 172.21.15.2:0/3102430094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee01dafb0 0x55fee01d89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.255+0000 7f1ea4a00640 1 -- 172.21.15.2:0/3102430094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 msgr2=0x55fee01d8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.255+0000 7f1ea4a00640 1 --2- 172.21.15.2:0/3102430094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01d8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.256+0000 7f1ea4a00640 1 -- 172.21.15.2:0/3102430094 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fedff14620 con 0x55fee01d0230 2024-06-13T02:18:47.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.256+0000 7f1ea4a00640 1 --2- 172.21.15.2:0/3102430094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 0x55fee01d7f40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1e94012d50 tx=0x7f1e9400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91e3ced3beb2a679 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:47.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.256+0000 7f1e86000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:18:47.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.256+0000 7f1e86000640 1 -- 172.21.15.2:0/3102430094 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e940120d0 con 0x55fee01d0230 2024-06-13T02:18:47.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.256+0000 7f1e86000640 1 -- 172.21.15.2:0/3102430094 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f1e94005020 con 0x55fee01d0230 2024-06-13T02:18:47.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.257+0000 7f1eaa232740 1 -- 172.21.15.2:0/3102430094 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e8c0fe5b0 con 0x55fee01d0230 2024-06-13T02:18:47.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.257+0000 7f1e86000640 1 -- 172.21.15.2:0/3102430094 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1e94012270 con 0x55fee01d0230 2024-06-13T02:18:47.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.257+0000 7f1eaa232740 10 client.25306 fetch_fsmap learned FSMap version 27 2024-06-13T02:18:47.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.257+0000 7f1eaa232740 1 -- 172.21.15.2:0/3102430094 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fee01e9d80 con 0x55fee01d0230 2024-06-13T02:18:47.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.257+0000 7f1e86000640 1 -- 172.21.15.2:0/3102430094 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e8c0fe5b0 con 0x55fee01d0230 2024-06-13T02:18:47.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.258+0000 7f1e86000640 1 -- 172.21.15.2:0/3102430094 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1e9401c470 con 0x55fee01d0230 2024-06-13T02:18:47.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.258+0000 7f1eaa232740 10 client.25306 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T02:18:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.258+0000 7f1eaa232740 10 client.25306 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:18:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.258+0000 7f1eaa232740 20 client.25306 populate_metadata read hostname 'smithi002' 2024-06-13T02:18:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.258+0000 7f1eaa232740 1 --2- 172.21.15.2:0/3102430094 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55fee01eb1f0 0x55fee01ed640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.258+0000 7f1eaa232740 4 client.25306 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:18:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.258+0000 7f1eaa232740 1 -- 172.21.15.2:0/3102430094 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fee0141b50 con 0x55fee01eb1f0 2024-06-13T02:18:47.263 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.258+0000 7f1e9fe00640 1 --2- 172.21.15.2:0/3102430094 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55fee01eb1f0 0x55fee01ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.259+0000 7f1e9fe00640 1 --2- 172.21.15.2:0/3102430094 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55fee01eb1f0 0x55fee01ed640 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24d6fe8caa682333 server_cookie=193568949df4d595 in_seq=0 out_seq=0 2024-06-13T02:18:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.259+0000 7f1e86000640 10 client.25306 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.260+0000 7f1e86000640 1 -- 172.21.15.2:0/3102430094 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fee0141b50 con 0x55fee01eb1f0 2024-06-13T02:18:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.260+0000 7f1e86000640 10 client.25306 handle_command_reply: tid=0 2024-06-13T02:18:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.260+0000 7f1eaa232740 1 client.25306 shutdown 2024-06-13T02:18:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.260+0000 7f1eaa232740 1 -- 172.21.15.2:0/3102430094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 msgr2=0x55fee01d7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.260+0000 7f1eaa232740 1 --2- 172.21.15.2:0/3102430094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 0x55fee01d7f40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1e94012d50 tx=0x7f1e9400f790 comp rx=0 tx=0).stop 2024-06-13T02:18:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.260+0000 7f1eaa232740 1 -- 172.21.15.2:0/3102430094 shutdown_connections 2024-06-13T02:18:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.260+0000 7f1eaa232740 1 --2- 172.21.15.2:0/3102430094 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55fee01eb1f0 0x55fee01ed640 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.260+0000 7f1eaa232740 1 --2- 172.21.15.2:0/3102430094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee01dafb0 0x55fee01d89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.260+0000 7f1e86000640 0 client.25306 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.260+0000 7f1eaa232740 1 --2- 172.21.15.2:0/3102430094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01d8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.260+0000 7f1eaa232740 1 --2- 172.21.15.2:0/3102430094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 0x55fee01d7f40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.260+0000 7f1eaa232740 1 -- 172.21.15.2:0/3102430094 >> 172.21.15.2:0/3102430094 conn(0x55fee0198fb0 msgr2=0x55fee01d2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:47.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.260+0000 7f1eaa232740 1 -- 172.21.15.2:0/3102430094 shutdown_connections 2024-06-13T02:18:47.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.260+0000 7f1eaa232740 1 -- 172.21.15.2:0/3102430094 wait complete. 2024-06-13T02:18:47.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.261+0000 7f1eaa232740 20 client.25306 trim_cache size 0 max 16384 2024-06-13T02:18:47.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.277+0000 7f1eaa232740 1 Processor -- start 2024-06-13T02:18:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.277+0000 7f1eaa232740 1 -- start start 2024-06-13T02:18:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.277+0000 7f1eaa232740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee0198fb0 0x55fee01cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.277+0000 7f1eaa232740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 0x55fee01f2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.277+0000 7f1eaa232740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01f3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.277+0000 7f1eaa232740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea01af480 con 0x55fee01d17a0 2024-06-13T02:18:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.277+0000 7f1eaa232740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea01acd50 con 0x55fee0198fb0 2024-06-13T02:18:47.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.277+0000 7f1eaa232740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea01aabc0 con 0x55fee01d0230 2024-06-13T02:18:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.278+0000 7f1ea4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee0198fb0 0x55fee01cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.278+0000 7f1ea4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee0198fb0 0x55fee01cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:60606/0 (socket says 172.21.15.2:60606) 2024-06-13T02:18:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.278+0000 7f1ea4a00640 1 -- 172.21.15.2:0/495650592 learned_addr learned my addr 172.21.15.2:0/495650592 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:47.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.278+0000 7f1ea5400640 1 --2- 172.21.15.2:0/495650592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.278+0000 7f1e9fe00640 1 --2- 172.21.15.2:0/495650592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 0x55fee01f2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.278+0000 7f1ea4a00640 1 -- 172.21.15.2:0/495650592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 msgr2=0x55fee01f2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.278+0000 7f1ea4a00640 1 --2- 172.21.15.2:0/495650592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 0x55fee01f2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.278+0000 7f1ea4a00640 1 -- 172.21.15.2:0/495650592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 msgr2=0x55fee01f3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.278+0000 7f1ea4a00640 1 --2- 172.21.15.2:0/495650592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01f3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.278+0000 7f1ea4a00640 1 -- 172.21.15.2:0/495650592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fee01d0d00 con 0x55fee0198fb0 2024-06-13T02:18:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.278+0000 7f1ea5400640 1 --2- 172.21.15.2:0/495650592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:18:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.278+0000 7f1ea4a00640 1 --2- 172.21.15.2:0/495650592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee0198fb0 0x55fee01cb820 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1e940095e0 tx=0x7f1e940092a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=431bc0a2999a21e8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.279+0000 7f1e91200640 1 -- 172.21.15.2:0/495650592 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e940120d0 con 0x55fee0198fb0 2024-06-13T02:18:47.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.279+0000 7f1e91200640 1 -- 172.21.15.2:0/495650592 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e9402b020 con 0x55fee0198fb0 2024-06-13T02:18:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.279+0000 7f1e91200640 1 -- 172.21.15.2:0/495650592 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e940053e0 con 0x55fee0198fb0 2024-06-13T02:18:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.279+0000 7f1eaa232740 1 -- 172.21.15.2:0/495650592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee0198fb0 msgr2=0x55fee01cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.279+0000 7f1eaa232740 1 --2- 172.21.15.2:0/495650592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee0198fb0 0x55fee01cb820 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1e940095e0 tx=0x7f1e940092a0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.280+0000 7f1eaa232740 1 -- 172.21.15.2:0/495650592 shutdown_connections 2024-06-13T02:18:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.280+0000 7f1eaa232740 1 --2- 172.21.15.2:0/495650592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.280+0000 7f1eaa232740 1 --2- 172.21.15.2:0/495650592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 0x55fee01f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.280+0000 7f1eaa232740 1 --2- 172.21.15.2:0/495650592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee0198fb0 0x55fee01cb820 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.280+0000 7f1eaa232740 1 -- 172.21.15.2:0/495650592 >> 172.21.15.2:0/495650592 conn(0x55fee01dd710 msgr2=0x55fee01cb110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.280+0000 7f1eaa232740 1 -- 172.21.15.2:0/495650592 shutdown_connections 2024-06-13T02:18:47.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.280+0000 7f1eaa232740 1 -- 172.21.15.2:0/495650592 wait complete. 2024-06-13T02:18:47.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.280+0000 7f1eaa232740 1 -- start start 2024-06-13T02:18:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.280+0000 7f1eaa232740 1 Processor -- start 2024-06-13T02:18:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.281+0000 7f1eaa232740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee0198fb0 0x55fee01e3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.281+0000 7f1eaa232740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 0x55fee01e3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.281+0000 7f1eaa232740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01de670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.281+0000 7f1eaa232740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea01ab210 con 0x55fee01d17a0 2024-06-13T02:18:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.281+0000 7f1eaa232740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea01ac680 con 0x55fee0198fb0 2024-06-13T02:18:47.285 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.281+0000 7f1eaa232740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea01ab8e0 con 0x55fee01d0230 2024-06-13T02:18:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.281+0000 7f1eaa232740 10 client.0 _ll_register_callbacks cb 0x7f1e94009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:18:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.281+0000 7f1ea4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee0198fb0 0x55fee01e3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.281+0000 7f1ea4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee0198fb0 0x55fee01e3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:60616/0 (socket says 172.21.15.2:60616) 2024-06-13T02:18:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.281+0000 7f1ea4a00640 1 -- 172.21.15.2:0/1520989097 learned_addr learned my addr 172.21.15.2:0/1520989097 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:18:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.281+0000 7f1ea5400640 1 --2- 172.21.15.2:0/1520989097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01de670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.281+0000 7f1e9fe00640 1 --2- 172.21.15.2:0/1520989097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 0x55fee01e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.282+0000 7f1ea4a00640 1 -- 172.21.15.2:0/1520989097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 msgr2=0x55fee01e3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.282+0000 7f1ea4a00640 1 --2- 172.21.15.2:0/1520989097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 0x55fee01e3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.282+0000 7f1ea4a00640 1 -- 172.21.15.2:0/1520989097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 msgr2=0x55fee01de670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:18:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.282+0000 7f1ea4a00640 1 --2- 172.21.15.2:0/1520989097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01de670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.282+0000 7f1ea4a00640 1 -- 172.21.15.2:0/1520989097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fee01deea0 con 0x55fee0198fb0 2024-06-13T02:18:47.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.282+0000 7f1ea5400640 1 --2- 172.21.15.2:0/1520989097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01de670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:18:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.282+0000 7f1ea4a00640 1 --2- 172.21.15.2:0/1520989097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee0198fb0 0x55fee01e3230 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400f7d0 tx=0x7f1e940128a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0473fa44a2c0300 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:18:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.282+0000 7f1e86000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:18:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.282+0000 7f1e86000640 1 -- 172.21.15.2:0/1520989097 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e940120d0 con 0x55fee0198fb0 2024-06-13T02:18:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.282+0000 7f1e86000640 1 -- 172.21.15.2:0/1520989097 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f1e9402c070 con 0x55fee0198fb0 2024-06-13T02:18:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.282+0000 7f1eaa232740 1 -- 172.21.15.2:0/1520989097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e9402b020 con 0x55fee0198fb0 2024-06-13T02:18:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.283+0000 7f1e86000640 1 -- 172.21.15.2:0/1520989097 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1e9401cc40 con 0x55fee0198fb0 2024-06-13T02:18:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.283+0000 7f1eaa232740 10 client.25325 fetch_fsmap learned FSMap version 27 2024-06-13T02:18:47.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.283+0000 7f1eaa232740 1 -- 172.21.15.2:0/1520989097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fee0255aa0 con 0x55fee0198fb0 2024-06-13T02:18:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.283+0000 7f1e86000640 1 -- 172.21.15.2:0/1520989097 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e9402b020 con 0x55fee0198fb0 2024-06-13T02:18:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.283+0000 7f1e86000640 1 -- 172.21.15.2:0/1520989097 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1e94010430 con 0x55fee0198fb0 2024-06-13T02:18:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.283+0000 7f1eaa232740 10 client.25325 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T02:18:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.283+0000 7f1eaa232740 10 client.25325 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:18:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.283+0000 7f1eaa232740 20 client.25325 populate_metadata read hostname 'smithi002' 2024-06-13T02:18:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.284+0000 7f1eaa232740 1 --2- 172.21.15.2:0/1520989097 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55fee01dafb0 0x55fee0258110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:18:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.284+0000 7f1eaa232740 4 client.25325 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:18:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.284+0000 7f1eaa232740 1 -- 172.21.15.2:0/1520989097 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fee013bea0 con 0x55fee01dafb0 2024-06-13T02:18:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.284+0000 7f1e9fe00640 1 --2- 172.21.15.2:0/1520989097 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55fee01dafb0 0x55fee0258110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:18:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.284+0000 7f1e9fe00640 1 --2- 172.21.15.2:0/1520989097 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55fee01dafb0 0x55fee0258110 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=161d5e45ebbb6a92 server_cookie=a674d38ae607bd77 in_seq=0 out_seq=0 2024-06-13T02:18:47.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.284+0000 7f1e86000640 10 client.25325 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:47.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.288+0000 7f1e86000640 1 -- 172.21.15.2:0/1520989097 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55fee013bea0 con 0x55fee01dafb0 2024-06-13T02:18:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.288+0000 7f1e86000640 10 client.25325 handle_command_reply: tid=0 2024-06-13T02:18:47.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.288+0000 7f1eaa232740 1 client.25325 shutdown 2024-06-13T02:18:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.289+0000 7f1eaa232740 1 -- 172.21.15.2:0/1520989097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee0198fb0 msgr2=0x55fee01e3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.289+0000 7f1eaa232740 1 --2- 172.21.15.2:0/1520989097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee0198fb0 0x55fee01e3230 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400f7d0 tx=0x7f1e940128a0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.289+0000 7f1eaa232740 1 -- 172.21.15.2:0/1520989097 shutdown_connections 2024-06-13T02:18:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.289+0000 7f1eaa232740 1 --2- 172.21.15.2:0/1520989097 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55fee01dafb0 0x55fee0258110 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.289+0000 7f1eaa232740 1 --2- 172.21.15.2:0/1520989097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fee01d17a0 0x55fee01de670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.289+0000 7f1eaa232740 1 --2- 172.21.15.2:0/1520989097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fee01d0230 0x55fee01e3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.289+0000 7f1eaa232740 1 --2- 172.21.15.2:0/1520989097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fee0198fb0 0x55fee01e3230 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.289+0000 7f1eaa232740 1 -- 172.21.15.2:0/1520989097 >> 172.21.15.2:0/1520989097 conn(0x55fee01dd710 msgr2=0x55fee01d8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.289+0000 7f1e86000640 0 client.25325 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:18:47.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.289+0000 7f1eaa232740 1 -- 172.21.15.2:0/1520989097 shutdown_connections 2024-06-13T02:18:47.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.289+0000 7f1eaa232740 1 -- 172.21.15.2:0/1520989097 wait complete. 2024-06-13T02:18:47.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.289+0000 7f1eaa232740 20 client.25325 trim_cache size 0 max 16384 2024-06-13T02:18:47.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:18:47.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:18:47.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:18:47.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.290+0000 7f1ea5e00640 1 -- 172.21.15.2:0/1351706393 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f1e880a2f10 msgr2=0x7f1e880a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:47.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.290+0000 7f1ea5e00640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f1e880a2f10 0x7f1e880a53d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e98005fd0 tx=0x7f1e980094a0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.290+0000 7f1ea5e00640 1 -- 172.21.15.2:0/1351706393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea01032a0 msgr2=0x7f1ea019a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:18:47.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.290+0000 7f1ea5e00640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea01032a0 0x7f1ea019a810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c02a9a0 tx=0x7f1e8c003b20 comp rx=0 tx=0).stop 2024-06-13T02:18:47.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.291+0000 7f1ea5e00640 1 -- 172.21.15.2:0/1351706393 shutdown_connections 2024-06-13T02:18:47.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.291+0000 7f1ea5e00640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ea010bda0 0x7f1ea019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.291+0000 7f1ea5e00640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ea01032a0 0x7f1ea019a810 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.291+0000 7f1ea5e00640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f1e880a2f10 0x7f1e880a53d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.291+0000 7f1ea5e00640 1 --2- 172.21.15.2:0/1351706393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ea0102980 0x7f1ea019a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:18:47.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.291+0000 7f1ea5e00640 1 -- 172.21.15.2:0/1351706393 >> 172.21.15.2:0/1351706393 conn(0x7f1ea00fc180 msgr2=0x7f1ea0100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:18:47.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.292+0000 7f1ea5e00640 1 -- 172.21.15.2:0/1351706393 shutdown_connections 2024-06-13T02:18:47.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:18:47.292+0000 7f1ea5e00640 1 -- 172.21.15.2:0/1351706393 wait complete. 2024-06-13T02:18:48.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:48 smithi084 ceph-mon[36833]: pgmap v32: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-06-13T02:18:49.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:48 smithi175 ceph-mon[36977]: pgmap v32: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-06-13T02:18:49.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:48 smithi002 ceph-mon[31960]: pgmap v32: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-06-13T02:18:50.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:50 smithi084 ceph-mon[36833]: pgmap v33: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:18:51.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:50 smithi175 ceph-mon[36977]: pgmap v33: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:18:51.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:50 smithi002 ceph-mon[31960]: pgmap v33: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-06-13T02:18:52.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:52 smithi084 ceph-mon[36833]: pgmap v34: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T02:18:53.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:52 smithi175 ceph-mon[36977]: pgmap v34: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T02:18:53.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:52 smithi002 ceph-mon[31960]: pgmap v34: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T02:18:54.348 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 60% (7590/12572) Updating files: 61% (7669/12572) Updating files: 62% (7795/12572) Updating files: 63% (7921/12572) Updating files: 64% (8047/12572) Updating files: 65% (8172/12572) Updating files: 66% (8298/12572) Updating files: 67% (8424/12572) Updating files: 68% (8549/12572) Updating files: 69% (8675/12572) Updating files: 70% (8801/12572) Updating files: 71% (8927/12572) Updating files: 72% (9052/12572) Updating files: 73% (9178/12572) Updating files: 74% (9304/12572) Updating files: 75% (9429/12572) Updating files: 76% (9555/12572) Updating files: 77% (9681/12572) Updating files: 78% (9807/12572) Updating files: 79% (9932/12572) Updating files: 80% (10058/12572) Updating files: 81% (10184/12572) Updating files: 82% (10310/12572) Updating files: 83% (10435/12572) Updating files: 84% (10561/12572) Updating files: 85% (10687/12572) Updating files: 86% (10812/12572) Updating files: 87% (10938/12572) Updating files: 88% (11064/12572) Updating files: 89% (11190/12572) Updating files: 90% (11315/12572) Updating files: 91% (11441/12572) Updating files: 92% (11567/12572) Updating files: 93% (11692/12572) Updating files: 94% (11818/12572) Updating files: 95% (11944/12572) Updating files: 95% (11982/12572) Updating files: 96% (12070/12572) Updating files: 97% (12195/12572) Updating files: 98% (12321/12572) Updating files: 99% (12447/12572) Updating files: 100% (12572/12572) Updating files: 100% (12572/12572), done. 2024-06-13T02:18:54.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:54 smithi084 ceph-mon[36833]: pgmap v35: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-13T02:18:54.978 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to '1373963c202323287783ccb099bbae1ec8f14a5d'. 2024-06-13T02:18:54.978 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T02:18:54.978 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-13T02:18:54.978 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-13T02:18:54.978 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-06-13T02:18:54.978 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T02:18:54.978 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-13T02:18:54.978 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-13T02:18:54.978 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T02:18:54.978 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-06-13T02:18:54.978 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T02:18:54.979 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-06-13T02:18:54.979 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T02:18:54.979 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-06-13T02:18:54.979 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T02:18:54.979 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-13T02:18:54.979 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-06-13T02:18:54.979 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at 1373963c202 Merge pull request #56700 from joscollin/wip-65318-squid 2024-06-13T02:18:54.989 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-06-13T02:18:55.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:54 smithi175 ceph-mon[36977]: pgmap v35: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-13T02:18:55.049 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-06-13T02:18:55.057 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-13T02:18:55.057 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-06-13T02:18:55.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:54 smithi002 ceph-mon[31960]: pgmap v35: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-13T02:18:55.903 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-06-13T02:18:56.017 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-06-13T02:18:56.110 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-13T02:18:56.116 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-13T02:18:56.116 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-06-13T02:18:56.206 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-13T02:18:56.216 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:18:56.217 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-06-13T02:18:56.268 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-06-13T02:18:56.269 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-06-13T02:18:56.269 DEBUG:teuthology.orchestra.run.smithi002:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1373963c202323287783ccb099bbae1ec8f14a5d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-06-13T02:18:56.346 INFO:tasks.workunit.client.0.smithi002.stderr:+ dbench 1 2024-06-13T02:18:56.355 INFO:tasks.workunit.client.0.smithi002.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-06-13T02:18:56.355 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-06-13T02:18:56.355 INFO:tasks.workunit.client.0.smithi002.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-06-13T02:18:56.364 INFO:tasks.workunit.client.0.smithi002.stdout:0 of 1 processes prepared for launch 0 sec 2024-06-13T02:18:56.464 INFO:tasks.workunit.client.0.smithi002.stdout:1 of 1 processes prepared for launch 0 sec 2024-06-13T02:18:56.464 INFO:tasks.workunit.client.0.smithi002.stdout:releasing clients 2024-06-13T02:18:56.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:56 smithi084 ceph-mon[36833]: pgmap v36: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T02:18:57.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:56 smithi175 ceph-mon[36977]: pgmap v36: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T02:18:57.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:56 smithi002 ceph-mon[31960]: pgmap v36: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-13T02:18:57.465 INFO:tasks.workunit.client.0.smithi002.stdout: 1 1899 26.38 MB/sec warmup 1 sec latency 12.899 ms 2024-06-13T02:18:58.465 INFO:tasks.workunit.client.0.smithi002.stdout: 1 4161 20.04 MB/sec warmup 2 sec latency 10.213 ms 2024-06-13T02:18:58.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:58 smithi084 ceph-mon[36833]: pgmap v37: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-13T02:18:58.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:18:58 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:18:59.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:58 smithi175 ceph-mon[36977]: pgmap v37: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-13T02:18:59.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:18:58 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:18:59.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:58 smithi002 ceph-mon[31960]: pgmap v37: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-13T02:18:59.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:18:58 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:18:59.465 INFO:tasks.workunit.client.0.smithi002.stdout: 1 6764 17.80 MB/sec warmup 3 sec latency 11.701 ms 2024-06-13T02:19:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.461+0000 7fc1cb200640 1 -- 172.21.15.2:0/786836811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1cc100f40 msgr2=0x7fc1cc10db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.461+0000 7fc1cb200640 1 --2- 172.21.15.2:0/786836811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1cc100f40 0x7fc1cc10db70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009900 tx=0x7fc1b402a410 comp rx=0 tx=0).stop 2024-06-13T02:19:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.461+0000 7fc1cb200640 1 -- 172.21.15.2:0/786836811 shutdown_connections 2024-06-13T02:19:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.461+0000 7fc1cb200640 1 --2- 172.21.15.2:0/786836811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc10e140 0x7fc1cc110530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.461+0000 7fc1cb200640 1 --2- 172.21.15.2:0/786836811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1cc100f40 0x7fc1cc10db70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.461+0000 7fc1cb200640 1 --2- 172.21.15.2:0/786836811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1cc100590 0x7fc1cc100970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.461+0000 7fc1cb200640 1 -- 172.21.15.2:0/786836811 >> 172.21.15.2:0/786836811 conn(0x7fc1cc0fc180 msgr2=0x7fc1cc0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.461+0000 7fc1cb200640 1 -- 172.21.15.2:0/786836811 shutdown_connections 2024-06-13T02:19:00.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.461+0000 7fc1cb200640 1 -- 172.21.15.2:0/786836811 wait complete. 2024-06-13T02:19:00.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.462+0000 7fc1cb200640 1 Processor -- start 2024-06-13T02:19:00.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.463+0000 7fc1cb200640 1 -- start start 2024-06-13T02:19:00.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.463+0000 7fc1cb200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1cc100590 0x7fc1cc19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.463+0000 7fc1cb200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc100f40 0x7fc1cc19a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.463+0000 7fc1cb200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1cc10e140 0x7fc1cc19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.463+0000 7fc1cb200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc113e00 con 0x7fc1cc100590 2024-06-13T02:19:00.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.463+0000 7fc1cb200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc113c80 con 0x7fc1cc100f40 2024-06-13T02:19:00.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.463+0000 7fc1cb200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1cc113f80 con 0x7fc1cc10e140 2024-06-13T02:19:00.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.463+0000 7fc1c9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1cc100590 0x7fc1cc19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.463+0000 7fc1c1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc100f40 0x7fc1cc19a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.463+0000 7fc1c1400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc100f40 0x7fc1cc19a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36814/0 (socket says 172.21.15.2:36814) 2024-06-13T02:19:00.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.463+0000 7fc1c9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1cc100590 0x7fc1cc19a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59372/0 (socket says 172.21.15.2:59372) 2024-06-13T02:19:00.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.463+0000 7fc1c1400640 1 -- 172.21.15.2:0/4067479418 learned_addr learned my addr 172.21.15.2:0/4067479418 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:00.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.463+0000 7fc1ca800640 1 --2- 172.21.15.2:0/4067479418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1cc10e140 0x7fc1cc19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.466 INFO:tasks.workunit.client.0.smithi002.stdout: 1 8373 15.33 MB/sec warmup 4 sec latency 9.876 ms 2024-06-13T02:19:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.464+0000 7fc1ca800640 1 -- 172.21.15.2:0/4067479418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc100f40 msgr2=0x7fc1cc19a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.464+0000 7fc1ca800640 1 --2- 172.21.15.2:0/4067479418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc100f40 0x7fc1cc19a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.464+0000 7fc1ca800640 1 -- 172.21.15.2:0/4067479418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1cc100590 msgr2=0x7fc1cc19a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.464+0000 7fc1ca800640 1 --2- 172.21.15.2:0/4067479418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1cc100590 0x7fc1cc19a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.464+0000 7fc1ca800640 1 -- 172.21.15.2:0/4067479418 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1cc19f320 con 0x7fc1cc10e140 2024-06-13T02:19:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.464+0000 7fc1c9e00640 1 --2- 172.21.15.2:0/4067479418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1cc100590 0x7fc1cc19a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:19:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.464+0000 7fc1ca800640 1 --2- 172.21.15.2:0/4067479418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1cc10e140 0x7fc1cc19ebf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc06af30 tx=0x7fc1c400db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.465+0000 7fc1c3400640 1 -- 172.21.15.2:0/4067479418 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4017070 con 0x7fc1cc10e140 2024-06-13T02:19:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.465+0000 7fc1c3400640 1 -- 172.21.15.2:0/4067479418 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1c4009cd0 con 0x7fc1cc10e140 2024-06-13T02:19:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.465+0000 7fc1cb200640 1 -- 172.21.15.2:0/4067479418 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1cc19f610 con 0x7fc1cc10e140 2024-06-13T02:19:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.465+0000 7fc1c3400640 1 -- 172.21.15.2:0/4067479418 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4003d60 con 0x7fc1cc10e140 2024-06-13T02:19:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.465+0000 7fc1cb200640 1 -- 172.21.15.2:0/4067479418 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1cc1a6ea0 con 0x7fc1cc10e140 2024-06-13T02:19:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.469+0000 7fc1c3400640 1 -- 172.21.15.2:0/4067479418 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 138116+0+0 (secure 0 0 0) 0x7fc1c40097f0 con 0x7fc1cc10e140 2024-06-13T02:19:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.471+0000 7fc1d3fcf740 1 Processor -- start 2024-06-13T02:19:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.471+0000 7fc1d3fcf740 1 -- start start 2024-06-13T02:19:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.471+0000 7fc1c3400640 1 --2- 172.21.15.2:0/4067479418 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc1b00a2f10 0x7fc1b00a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.471+0000 7fc1d3fcf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 0x55e901782500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.472+0000 7fc1d3fcf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e901782a40 0x55e901782ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.472+0000 7fc1d3fcf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90178d7c0 0x55e90178fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.472+0000 7fc1d3fcf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e9016de420 con 0x55e901783fb0 2024-06-13T02:19:00.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.472+0000 7fc1d3fcf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e901685c50 con 0x55e901782a40 2024-06-13T02:19:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.472+0000 7fc1d3fcf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e9016da3e0 con 0x55e90178d7c0 2024-06-13T02:19:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.472+0000 7fc1c3400640 1 -- 172.21.15.2:0/4067479418 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fc1c40cf0e0 con 0x7fc1cc10e140 2024-06-13T02:19:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.472+0000 7fc1c1400640 1 --2- 172.21.15.2:0/4067479418 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc1b00a2f10 0x7fc1b00a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.472+0000 7fc1ca800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90178d7c0 0x55e90178fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.472+0000 7fc1ca800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90178d7c0 0x55e90178fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:34456/0 (socket says 172.21.15.2:34456) 2024-06-13T02:19:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.472+0000 7fc1ca800640 1 -- 172.21.15.2:0/2159872827 learned_addr learned my addr 172.21.15.2:0/2159872827 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.472+0000 7fc1c9e00640 1 --2- 172.21.15.2:0/2159872827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 0x55e901782500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.472+0000 7fc1c1400640 1 --2- 172.21.15.2:0/2159872827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e901782a40 0x55e901782ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.473+0000 7fc1ca800640 1 -- 172.21.15.2:0/2159872827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e901782a40 msgr2=0x55e901782ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.473+0000 7fc1ca800640 1 --2- 172.21.15.2:0/2159872827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e901782a40 0x55e901782ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.473+0000 7fc1ca800640 1 -- 172.21.15.2:0/2159872827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 msgr2=0x55e901782500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.473+0000 7fc1ca800640 1 --2- 172.21.15.2:0/2159872827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 0x55e901782500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.473+0000 7fc1ca800640 1 -- 172.21.15.2:0/2159872827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9013f2210 con 0x55e90178d7c0 2024-06-13T02:19:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.473+0000 7fc1c9e00640 1 --2- 172.21.15.2:0/2159872827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 0x55e901782500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:19:00.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.473+0000 7fc1c1400640 1 --2- 172.21.15.2:0/2159872827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e901782a40 0x55e901782ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:19:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.473+0000 7fc1ca800640 1 --2- 172.21.15.2:0/2159872827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90178d7c0 0x55e90178fbb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40cc310 tx=0x7fc1c409b160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca91a9dd180a9128 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.473+0000 7fc1c1400640 1 --2- 172.21.15.2:0/4067479418 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc1b00a2f10 0x7fc1b00a53d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40096c0 tx=0x7fc1b40046c0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.473+0000 7fc1bb400640 1 -- 172.21.15.2:0/2159872827 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4020040 con 0x55e90178d7c0 2024-06-13T02:19:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.474+0000 7fc1bb400640 1 -- 172.21.15.2:0/2159872827 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1c4009ae0 con 0x55e90178d7c0 2024-06-13T02:19:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.474+0000 7fc1bb400640 1 -- 172.21.15.2:0/2159872827 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c40a3a30 con 0x55e90178d7c0 2024-06-13T02:19:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.474+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/2159872827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90178d7c0 msgr2=0x55e90178fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:00.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.474+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/2159872827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90178d7c0 0x55e90178fbb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40cc310 tx=0x7fc1c409b160 comp rx=0 tx=0).stop 2024-06-13T02:19:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.475+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/2159872827 shutdown_connections 2024-06-13T02:19:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.475+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/2159872827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e90178d7c0 0x55e90178fbb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.475+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/2159872827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e901782a40 0x55e901782ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.475+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/2159872827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 0x55e901782500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.475+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/2159872827 >> 172.21.15.2:0/2159872827 conn(0x55e901742fb0 msgr2=0x55e90177f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.475+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/2159872827 shutdown_connections 2024-06-13T02:19:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.475+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/2159872827 wait complete. 2024-06-13T02:19:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.475+0000 7fc1d3fcf740 1 -- start start 2024-06-13T02:19:00.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.476+0000 7fc1d3fcf740 1 Processor -- start 2024-06-13T02:19:00.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.476+0000 7fc1d3fcf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901782a40 0x55e90178a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.476+0000 7fc1d3fcf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 0x55e90178acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.476+0000 7fc1d3fcf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e90178d7c0 0x55e90178b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.476+0000 7fc1d3fcf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e901790590 con 0x55e901783fb0 2024-06-13T02:19:00.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.476+0000 7fc1d3fcf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e9016990b0 con 0x55e90178d7c0 2024-06-13T02:19:00.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.476+0000 7fc1d3fcf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e901790710 con 0x55e901782a40 2024-06-13T02:19:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.476+0000 7fc1d3fcf740 10 client.0 _ll_register_callbacks cb 0x55e901684f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:19:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.476+0000 7fc1ca800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e90178d7c0 0x55e90178b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.477+0000 7fc1c9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901782a40 0x55e90178a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.477+0000 7fc1ca800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e90178d7c0 0x55e90178b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36822/0 (socket says 172.21.15.2:36822) 2024-06-13T02:19:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.477+0000 7fc1c9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901782a40 0x55e90178a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:34464/0 (socket says 172.21.15.2:34464) 2024-06-13T02:19:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.477+0000 7fc1ca800640 1 -- 172.21.15.2:0/3843091731 learned_addr learned my addr 172.21.15.2:0/3843091731 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.477+0000 7fc1c1400640 1 --2- 172.21.15.2:0/3843091731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 0x55e90178acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.477+0000 7fc1ca800640 1 -- 172.21.15.2:0/3843091731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901782a40 msgr2=0x55e90178a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.477+0000 7fc1ca800640 1 --2- 172.21.15.2:0/3843091731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901782a40 0x55e90178a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.477+0000 7fc1ca800640 1 -- 172.21.15.2:0/3843091731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 msgr2=0x55e90178acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.477+0000 7fc1ca800640 1 --2- 172.21.15.2:0/3843091731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 0x55e90178acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.477+0000 7fc1ca800640 1 -- 172.21.15.2:0/3843091731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9014be620 con 0x55e90178d7c0 2024-06-13T02:19:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.477+0000 7fc1c1400640 1 --2- 172.21.15.2:0/3843091731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 0x55e90178acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:19:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.477+0000 7fc1ca800640 1 --2- 172.21.15.2:0/3843091731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e90178d7c0 0x55e90178b230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4097a70 tx=0x7fc1c4005bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=882dd6c6d22a001b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:00.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.477+0000 7fc1afe00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:19:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.478+0000 7fc1afe00640 1 -- 172.21.15.2:0/3843091731 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4020030 con 0x55e90178d7c0 2024-06-13T02:19:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.478+0000 7fc1afe00640 1 -- 172.21.15.2:0/3843091731 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fc1c40a39d0 con 0x55e90178d7c0 2024-06-13T02:19:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.478+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3843091731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1c4009ae0 con 0x55e90178d7c0 2024-06-13T02:19:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.478+0000 7fc1afe00640 1 -- 172.21.15.2:0/3843091731 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc1c40ccbb0 con 0x55e90178d7c0 2024-06-13T02:19:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.478+0000 7fc1d3fcf740 10 client.25337 fetch_fsmap learned FSMap version 27 2024-06-13T02:19:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.478+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3843091731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e90179c900 con 0x55e90178d7c0 2024-06-13T02:19:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.478+0000 7fc1afe00640 1 -- 172.21.15.2:0/3843091731 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1c4009ae0 con 0x55e90178d7c0 2024-06-13T02:19:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.478+0000 7fc1afe00640 1 -- 172.21.15.2:0/3843091731 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc1c4096df0 con 0x55e90178d7c0 2024-06-13T02:19:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.479+0000 7fc1d3fcf740 10 client.25337 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T02:19:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.479+0000 7fc1d3fcf740 10 client.25337 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:19:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.479+0000 7fc1d3fcf740 20 client.25337 populate_metadata read hostname 'smithi002' 2024-06-13T02:19:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.479+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/3843091731 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e90179dc50 0x55e9017a0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.479+0000 7fc1d3fcf740 4 client.25337 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:19:00.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.479+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3843091731 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9016ebb50 con 0x55e90179dc50 2024-06-13T02:19:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.479+0000 7fc1c9e00640 1 --2- 172.21.15.2:0/3843091731 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e90179dc50 0x55e9017a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.480+0000 7fc1c9e00640 1 --2- 172.21.15.2:0/3843091731 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e90179dc50 0x55e9017a0040 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65ea172fbf89b303 server_cookie=3fcf0c4265205779 in_seq=0 out_seq=0 2024-06-13T02:19:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.480+0000 7fc1afe00640 10 client.25337 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.480+0000 7fc1afe00640 1 -- 172.21.15.2:0/3843091731 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55e9016ebb50 con 0x55e90179dc50 2024-06-13T02:19:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.480+0000 7fc1afe00640 10 client.25337 handle_command_reply: tid=0 2024-06-13T02:19:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.481+0000 7fc1d3fcf740 1 client.25337 shutdown 2024-06-13T02:19:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.481+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3843091731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e90178d7c0 msgr2=0x55e90178b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.481+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/3843091731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e90178d7c0 0x55e90178b230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4097a70 tx=0x7fc1c4005bf0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.481+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3843091731 shutdown_connections 2024-06-13T02:19:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.481+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/3843091731 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e90179dc50 0x55e9017a0040 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.481+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/3843091731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e90178d7c0 0x55e90178b230 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.481+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/3843091731 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 0x55e90178acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.481+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/3843091731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901782a40 0x55e90178a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.481+0000 7fc1afe00640 0 client.25337 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.481+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3843091731 >> 172.21.15.2:0/3843091731 conn(0x55e901742fb0 msgr2=0x55e9017759a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.481+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3843091731 shutdown_connections 2024-06-13T02:19:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.481+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3843091731 wait complete. 2024-06-13T02:19:00.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.482+0000 7fc1d3fcf740 20 client.25337 trim_cache size 0 max 16384 2024-06-13T02:19:00.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.507+0000 7fc1d3fcf740 1 Processor -- start 2024-06-13T02:19:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.507+0000 7fc1d3fcf740 1 -- start start 2024-06-13T02:19:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.507+0000 7fc1d3fcf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e901782a40 0x55e90178b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.507+0000 7fc1d3fcf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901783fb0 0x55e901775820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.507+0000 7fc1d3fcf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e90178d7c0 0x55e9017a3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.507+0000 7fc1d3fcf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a80128e0 con 0x55e90178d7c0 2024-06-13T02:19:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.507+0000 7fc1d3fcf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a80101b0 con 0x55e901782a40 2024-06-13T02:19:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.507+0000 7fc1d3fcf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a800e000 con 0x55e901783fb0 2024-06-13T02:19:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.508+0000 7fc1c1400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901783fb0 0x55e901775820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.508+0000 7fc1c9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e901782a40 0x55e90178b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.508+0000 7fc1c1400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901783fb0 0x55e901775820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:34474/0 (socket says 172.21.15.2:34474) 2024-06-13T02:19:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.508+0000 7fc1c1400640 1 -- 172.21.15.2:0/825242473 learned_addr learned my addr 172.21.15.2:0/825242473 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.508+0000 7fc1ca800640 1 --2- 172.21.15.2:0/825242473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e90178d7c0 0x55e9017a3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.508+0000 7fc1c1400640 1 -- 172.21.15.2:0/825242473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e901782a40 msgr2=0x55e90178b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.508+0000 7fc1c1400640 1 --2- 172.21.15.2:0/825242473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e901782a40 0x55e90178b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.508+0000 7fc1c1400640 1 -- 172.21.15.2:0/825242473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e90178d7c0 msgr2=0x55e9017a3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.508+0000 7fc1c1400640 1 --2- 172.21.15.2:0/825242473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e90178d7c0 0x55e9017a3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.508+0000 7fc1c1400640 1 -- 172.21.15.2:0/825242473 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e901783220 con 0x55e901783fb0 2024-06-13T02:19:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.508+0000 7fc1c1400640 1 --2- 172.21.15.2:0/825242473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901783fb0 0x55e901775820 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc1b402aa00 tx=0x7fc1b403f070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be85e275959bbc9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.509+0000 7fc1baa00640 1 -- 172.21.15.2:0/825242473 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4035040 con 0x55e901783fb0 2024-06-13T02:19:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.509+0000 7fc1baa00640 1 -- 172.21.15.2:0/825242473 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b4050070 con 0x55e901783fb0 2024-06-13T02:19:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.509+0000 7fc1baa00640 1 -- 172.21.15.2:0/825242473 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b403a3f0 con 0x55e901783fb0 2024-06-13T02:19:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.510+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/825242473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901783fb0 msgr2=0x55e901775820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.510+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/825242473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901783fb0 0x55e901775820 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc1b402aa00 tx=0x7fc1b403f070 comp rx=0 tx=0).stop 2024-06-13T02:19:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.510+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/825242473 shutdown_connections 2024-06-13T02:19:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.510+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/825242473 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e90178d7c0 0x55e9017a3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.510+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/825242473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901783fb0 0x55e901775820 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.510+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/825242473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e901782a40 0x55e90178b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.510+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/825242473 >> 172.21.15.2:0/825242473 conn(0x55e901742fb0 msgr2=0x55e901775110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.510+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/825242473 shutdown_connections 2024-06-13T02:19:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.510+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/825242473 wait complete. 2024-06-13T02:19:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.510+0000 7fc1d3fcf740 1 -- start start 2024-06-13T02:19:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.511+0000 7fc1d3fcf740 1 Processor -- start 2024-06-13T02:19:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.511+0000 7fc1d3fcf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901782a40 0x55e9017a34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.511+0000 7fc1d3fcf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 0x55e9017a0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.511+0000 7fc1d3fcf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e90178d7c0 0x55e9017a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.511+0000 7fc1d3fcf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a800e670 con 0x55e901783fb0 2024-06-13T02:19:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.511+0000 7fc1d3fcf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a800fae0 con 0x55e90178d7c0 2024-06-13T02:19:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.511+0000 7fc1d3fcf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a800ed40 con 0x55e901782a40 2024-06-13T02:19:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.511+0000 7fc1d3fcf740 10 client.0 _ll_register_callbacks cb 0x7fc1c409aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:19:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.511+0000 7fc1c9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901782a40 0x55e9017a34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.511+0000 7fc1c9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901782a40 0x55e9017a34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:34478/0 (socket says 172.21.15.2:34478) 2024-06-13T02:19:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.511+0000 7fc1c9e00640 1 -- 172.21.15.2:0/3078149470 learned_addr learned my addr 172.21.15.2:0/3078149470 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.511+0000 7fc1ca800640 1 --2- 172.21.15.2:0/3078149470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e90178d7c0 0x55e9017a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.511+0000 7fc1c1400640 1 --2- 172.21.15.2:0/3078149470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 0x55e9017a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.512+0000 7fc1ca800640 1 -- 172.21.15.2:0/3078149470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901782a40 msgr2=0x55e9017a34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.512+0000 7fc1ca800640 1 --2- 172.21.15.2:0/3078149470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901782a40 0x55e9017a34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.512+0000 7fc1ca800640 1 -- 172.21.15.2:0/3078149470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 msgr2=0x55e9017a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.512+0000 7fc1ca800640 1 --2- 172.21.15.2:0/3078149470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 0x55e9017a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.512+0000 7fc1ca800640 1 -- 172.21.15.2:0/3078149470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9017a12b0 con 0x55e90178d7c0 2024-06-13T02:19:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.512+0000 7fc1ca800640 1 --2- 172.21.15.2:0/3078149470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e90178d7c0 0x55e9017a0d70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc1c409b030 tx=0x7fc1c40a3de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6550e5b9af2b759 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.512+0000 7fc1afe00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:19:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.512+0000 7fc1afe00640 1 -- 172.21.15.2:0/3078149470 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4014040 con 0x55e90178d7c0 2024-06-13T02:19:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.512+0000 7fc1afe00640 1 -- 172.21.15.2:0/3078149470 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fc1c40977d0 con 0x55e90178d7c0 2024-06-13T02:19:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.512+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3078149470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1b4050070 con 0x55e90178d7c0 2024-06-13T02:19:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.513+0000 7fc1afe00640 1 -- 172.21.15.2:0/3078149470 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc1c4020040 con 0x55e90178d7c0 2024-06-13T02:19:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.513+0000 7fc1d3fcf740 10 client.25343 fetch_fsmap learned FSMap version 27 2024-06-13T02:19:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.513+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3078149470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e901808270 con 0x55e90178d7c0 2024-06-13T02:19:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.513+0000 7fc1afe00640 1 -- 172.21.15.2:0/3078149470 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b4050070 con 0x55e90178d7c0 2024-06-13T02:19:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.513+0000 7fc1afe00640 1 -- 172.21.15.2:0/3078149470 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc1c409a4f0 con 0x55e90178d7c0 2024-06-13T02:19:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.513+0000 7fc1d3fcf740 10 client.25343 fetch_fsmap finished waiting for FSMap version 27 2024-06-13T02:19:00.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.513+0000 7fc1d3fcf740 10 client.25343 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:19:00.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.513+0000 7fc1d3fcf740 20 client.25343 populate_metadata read hostname 'smithi002' 2024-06-13T02:19:00.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.513+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/3078149470 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e9018086f0 0x55e90180ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:00.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.513+0000 7fc1d3fcf740 4 client.25343 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:19:00.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.513+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3078149470 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e9017863b0 con 0x55e9018086f0 2024-06-13T02:19:00.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.513+0000 7fc1c9e00640 1 --2- 172.21.15.2:0/3078149470 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e9018086f0 0x55e90180ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:00.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.514+0000 7fc1c9e00640 1 --2- 172.21.15.2:0/3078149470 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e9018086f0 0x55e90180ab10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc3727ada1435725 server_cookie=11d2c2080036823f in_seq=0 out_seq=0 2024-06-13T02:19:00.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.514+0000 7fc1afe00640 10 client.25343 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:00.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.662+0000 7fc1afe00640 1 -- 172.21.15.2:0/3078149470 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55e9017863b0 con 0x55e9018086f0 2024-06-13T02:19:00.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.662+0000 7fc1afe00640 10 client.25343 handle_command_reply: tid=0 2024-06-13T02:19:00.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.662+0000 7fc1d3fcf740 1 client.25343 shutdown 2024-06-13T02:19:00.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.662+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3078149470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e90178d7c0 msgr2=0x55e9017a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.662+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/3078149470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e90178d7c0 0x55e9017a0d70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc1c409b030 tx=0x7fc1c40a3de0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.662+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3078149470 shutdown_connections 2024-06-13T02:19:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.662+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/3078149470 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e9018086f0 0x55e90180ab10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.662+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/3078149470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e90178d7c0 0x55e9017a0d70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.662+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/3078149470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e901783fb0 0x55e9017a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.662+0000 7fc1d3fcf740 1 --2- 172.21.15.2:0/3078149470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e901782a40 0x55e9017a34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.662+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3078149470 >> 172.21.15.2:0/3078149470 conn(0x55e901742fb0 msgr2=0x55e901784e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.662+0000 7fc1afe00640 0 client.25343 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.663+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3078149470 shutdown_connections 2024-06-13T02:19:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.663+0000 7fc1d3fcf740 1 -- 172.21.15.2:0/3078149470 wait complete. 2024-06-13T02:19:00.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.663+0000 7fc1d3fcf740 20 client.25343 trim_cache size 0 max 16384 2024-06-13T02:19:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:19:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:19:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:19:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.664+0000 7fc1cb200640 1 -- 172.21.15.2:0/4067479418 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc1b00a2f10 msgr2=0x7fc1b00a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:00.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.664+0000 7fc1cb200640 1 --2- 172.21.15.2:0/4067479418 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc1b00a2f10 0x7fc1b00a53d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40096c0 tx=0x7fc1b40046c0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.664+0000 7fc1cb200640 1 -- 172.21.15.2:0/4067479418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1cc10e140 msgr2=0x7fc1cc19ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.664+0000 7fc1cb200640 1 --2- 172.21.15.2:0/4067479418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1cc10e140 0x7fc1cc19ebf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc06af30 tx=0x7fc1c400db40 comp rx=0 tx=0).stop 2024-06-13T02:19:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.664+0000 7fc1cb200640 1 -- 172.21.15.2:0/4067479418 shutdown_connections 2024-06-13T02:19:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.664+0000 7fc1cb200640 1 --2- 172.21.15.2:0/4067479418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1cc10e140 0x7fc1cc19ebf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.664+0000 7fc1cb200640 1 --2- 172.21.15.2:0/4067479418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc100f40 0x7fc1cc19a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.664+0000 7fc1cb200640 1 --2- 172.21.15.2:0/4067479418 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc1b00a2f10 0x7fc1b00a53d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.664+0000 7fc1cb200640 1 --2- 172.21.15.2:0/4067479418 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1cc100590 0x7fc1cc19a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.664+0000 7fc1cb200640 1 -- 172.21.15.2:0/4067479418 >> 172.21.15.2:0/4067479418 conn(0x7fc1cc0fc180 msgr2=0x7fc1cc0fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.664+0000 7fc1cb200640 1 -- 172.21.15.2:0/4067479418 shutdown_connections 2024-06-13T02:19:00.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:00.664+0000 7fc1cb200640 1 -- 172.21.15.2:0/4067479418 wait complete. 2024-06-13T02:19:00.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:00 smithi084 ceph-mon[36833]: pgmap v38: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-13T02:19:00.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:00 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:19:00.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:00 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:19:00.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:00 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:19:01.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:00 smithi175 ceph-mon[36977]: pgmap v38: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-13T02:19:01.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:00 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:19:01.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:00 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:19:01.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:00 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:19:01.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:00 smithi002 ceph-mon[31960]: pgmap v38: 129 pgs: 129 active+clean; 1.4 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-13T02:19:01.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:00 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:19:01.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:00 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:19:01.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:00 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:19:01.465 INFO:tasks.workunit.client.0.smithi002.stdout: 1 9389 13.12 MB/sec warmup 5 sec latency 93.783 ms 2024-06-13T02:19:02.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:01 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:19:02.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:01 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:19:02.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:01 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:19:02.465 INFO:tasks.workunit.client.0.smithi002.stdout: 1 10779 12.83 MB/sec warmup 6 sec latency 81.956 ms 2024-06-13T02:19:03.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:02 smithi002 ceph-mon[31960]: pgmap v39: 129 pgs: 129 active+clean; 6.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 500 KiB/s wr, 149 op/s 2024-06-13T02:19:03.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:02 smithi084 ceph-mon[36833]: pgmap v39: 129 pgs: 129 active+clean; 6.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 500 KiB/s wr, 149 op/s 2024-06-13T02:19:03.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:02 smithi175 ceph-mon[36977]: pgmap v39: 129 pgs: 129 active+clean; 6.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 500 KiB/s wr, 149 op/s 2024-06-13T02:19:03.465 INFO:tasks.workunit.client.0.smithi002.stdout: 1 11175 11.19 MB/sec warmup 7 sec latency 582.012 ms 2024-06-13T02:19:04.465 INFO:tasks.workunit.client.0.smithi002.stdout: 1 11175 9.79 MB/sec warmup 8 sec latency 1582.158 ms 2024-06-13T02:19:05.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:04 smithi002 ceph-mon[31960]: pgmap v40: 129 pgs: 129 active+clean; 6.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 500 KiB/s wr, 146 op/s 2024-06-13T02:19:05.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:04 smithi084 ceph-mon[36833]: pgmap v40: 129 pgs: 129 active+clean; 6.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 500 KiB/s wr, 146 op/s 2024-06-13T02:19:05.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:04 smithi175 ceph-mon[36977]: pgmap v40: 129 pgs: 129 active+clean; 6.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 500 KiB/s wr, 146 op/s 2024-06-13T02:19:05.465 INFO:tasks.workunit.client.0.smithi002.stdout: 1 11175 8.70 MB/sec warmup 9 sec latency 2582.322 ms 2024-06-13T02:19:06.466 INFO:tasks.workunit.client.0.smithi002.stdout: 1 11175 7.83 MB/sec warmup 10 sec latency 3582.473 ms 2024-06-13T02:19:07.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:06 smithi002 ceph-mon[31960]: pgmap v41: 129 pgs: 129 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 671 KiB/s wr, 201 op/s 2024-06-13T02:19:07.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:06 smithi084 ceph-mon[36833]: pgmap v41: 129 pgs: 129 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 671 KiB/s wr, 201 op/s 2024-06-13T02:19:07.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:06 smithi175 ceph-mon[36977]: pgmap v41: 129 pgs: 129 active+clean; 7.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 671 KiB/s wr, 201 op/s 2024-06-13T02:19:07.466 INFO:tasks.workunit.client.0.smithi002.stdout: 1 11175 7.12 MB/sec warmup 11 sec latency 4582.611 ms 2024-06-13T02:19:08.466 INFO:tasks.workunit.client.0.smithi002.stdout: 1 11175 6.53 MB/sec warmup 12 sec latency 5582.766 ms 2024-06-13T02:19:09.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:08 smithi002 ceph-mon[31960]: pgmap v42: 129 pgs: 129 active+clean; 7.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 690 KiB/s wr, 212 op/s 2024-06-13T02:19:09.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:08 smithi084 ceph-mon[36833]: pgmap v42: 129 pgs: 129 active+clean; 7.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 690 KiB/s wr, 212 op/s 2024-06-13T02:19:09.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:08 smithi175 ceph-mon[36977]: pgmap v42: 129 pgs: 129 active+clean; 7.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 690 KiB/s wr, 212 op/s 2024-06-13T02:19:09.466 INFO:tasks.workunit.client.0.smithi002.stdout: 1 11175 6.02 MB/sec warmup 13 sec latency 6582.904 ms 2024-06-13T02:19:10.466 INFO:tasks.workunit.client.0.smithi002.stdout: 1 11175 5.59 MB/sec warmup 14 sec latency 7583.053 ms 2024-06-13T02:19:11.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:10 smithi002 ceph-mon[31960]: pgmap v43: 129 pgs: 129 active+clean; 7.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 690 KiB/s wr, 212 op/s 2024-06-13T02:19:11.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:10 smithi084 ceph-mon[36833]: pgmap v43: 129 pgs: 129 active+clean; 7.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 690 KiB/s wr, 212 op/s 2024-06-13T02:19:11.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:10 smithi175 ceph-mon[36977]: pgmap v43: 129 pgs: 129 active+clean; 7.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 690 KiB/s wr, 212 op/s 2024-06-13T02:19:11.467 INFO:tasks.workunit.client.0.smithi002.stdout: 1 11175 5.22 MB/sec warmup 15 sec latency 8583.218 ms 2024-06-13T02:19:12.467 INFO:tasks.workunit.client.0.smithi002.stdout: 1 11175 4.89 MB/sec warmup 16 sec latency 9583.310 ms 2024-06-13T02:19:13.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:12 smithi002 ceph-mon[31960]: pgmap v44: 129 pgs: 129 active+clean; 7.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 692 KiB/s wr, 215 op/s 2024-06-13T02:19:13.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:12 smithi084 ceph-mon[36833]: pgmap v44: 129 pgs: 129 active+clean; 7.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 692 KiB/s wr, 215 op/s 2024-06-13T02:19:13.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:12 smithi175 ceph-mon[36977]: pgmap v44: 129 pgs: 129 active+clean; 7.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 692 KiB/s wr, 215 op/s 2024-06-13T02:19:13.467 INFO:tasks.workunit.client.0.smithi002.stdout: 1 11175 4.61 MB/sec warmup 17 sec latency 10583.461 ms 2024-06-13T02:19:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.810+0000 7f780be00640 1 -- 172.21.15.2:0/3679081687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780c102150 msgr2=0x7f780c10e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.810+0000 7f780be00640 1 --2- 172.21.15.2:0/3679081687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780c102150 0x7f780c10e660 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7804009cd0 tx=0x7f780402a8e0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.810+0000 7f780be00640 1 -- 172.21.15.2:0/3679081687 shutdown_connections 2024-06-13T02:19:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.810+0000 7f780be00640 1 --2- 172.21.15.2:0/3679081687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780c102150 0x7f780c10e660 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.810+0000 7f780be00640 1 --2- 172.21.15.2:0/3679081687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f780c101790 0x7f780c101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.810+0000 7f780be00640 1 --2- 172.21.15.2:0/3679081687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f780c1077a0 0x7f780c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.810+0000 7f780be00640 1 -- 172.21.15.2:0/3679081687 >> 172.21.15.2:0/3679081687 conn(0x7f780c0fd2e0 msgr2=0x7f780c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.810+0000 7f780be00640 1 -- 172.21.15.2:0/3679081687 shutdown_connections 2024-06-13T02:19:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.810+0000 7f780be00640 1 -- 172.21.15.2:0/3679081687 wait complete. 2024-06-13T02:19:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.811+0000 7f780be00640 1 Processor -- start 2024-06-13T02:19:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.812+0000 7f780be00640 1 -- start start 2024-06-13T02:19:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.812+0000 7f780be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f780c101790 0x7f780c1980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.812+0000 7f780be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f780c102150 0x7f780c198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.812+0000 7f780be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780c1077a0 0x7f780c19c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.812+0000 7f780be00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f780c111c00 con 0x7f780c1077a0 2024-06-13T02:19:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.812+0000 7f780be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f780c111a80 con 0x7f780c102150 2024-06-13T02:19:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.812+0000 7f780be00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f780c111d80 con 0x7f780c101790 2024-06-13T02:19:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.812+0000 7f780b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780c1077a0 0x7f780c19c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.812+0000 7f780b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780c1077a0 0x7f780c19c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60822/0 (socket says 172.21.15.2:60822) 2024-06-13T02:19:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.812+0000 7f780aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f780c101790 0x7f780c1980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.812+0000 7f780b400640 1 -- 172.21.15.2:0/4010044295 learned_addr learned my addr 172.21.15.2:0/4010044295 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.812+0000 7f7803e00640 1 --2- 172.21.15.2:0/4010044295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f780c102150 0x7f780c198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.813+0000 7f780aa00640 1 -- 172.21.15.2:0/4010044295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f780c102150 msgr2=0x7f780c198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.813+0000 7f780aa00640 1 --2- 172.21.15.2:0/4010044295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f780c102150 0x7f780c198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.813+0000 7f780aa00640 1 -- 172.21.15.2:0/4010044295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780c1077a0 msgr2=0x7f780c19c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.813+0000 7f780aa00640 1 --2- 172.21.15.2:0/4010044295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780c1077a0 0x7f780c19c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.813+0000 7f780aa00640 1 -- 172.21.15.2:0/4010044295 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780c19d080 con 0x7f780c101790 2024-06-13T02:19:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.813+0000 7f780b400640 1 --2- 172.21.15.2:0/4010044295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780c1077a0 0x7f780c19c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:19:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.813+0000 7f7803e00640 1 --2- 172.21.15.2:0/4010044295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f780c102150 0x7f780c198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:19:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.813+0000 7f780aa00640 1 --2- 172.21.15.2:0/4010044295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f780c101790 0x7f780c1980e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00e9f0 tx=0x7f77fc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.813+0000 7f7803400640 1 -- 172.21.15.2:0/4010044295 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00ccc0 con 0x7f780c101790 2024-06-13T02:19:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.814+0000 7f780be00640 1 -- 172.21.15.2:0/4010044295 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780c19d370 con 0x7f780c101790 2024-06-13T02:19:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.814+0000 7f7803400640 1 -- 172.21.15.2:0/4010044295 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77fc005020 con 0x7f780c101790 2024-06-13T02:19:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.814+0000 7f7803400640 1 -- 172.21.15.2:0/4010044295 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0049e0 con 0x7f780c101790 2024-06-13T02:19:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.814+0000 7f780be00640 1 -- 172.21.15.2:0/4010044295 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f780c1a4c00 con 0x7f780c101790 2024-06-13T02:19:13.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.817+0000 7f7814606740 1 Processor -- start 2024-06-13T02:19:13.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.817+0000 7f7814606740 1 -- start start 2024-06-13T02:19:13.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.817+0000 7f7803400640 1 -- 172.21.15.2:0/4010044295 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 25) ==== 138116+0+0 (secure 0 0 0) 0x7f77fc005560 con 0x7f780c101790 2024-06-13T02:19:13.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.817+0000 7f7814606740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe37a0 0x55a4eebe1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.817+0000 7f7814606740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebe2230 0x55a4eebe26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.817+0000 7f7814606740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebecfb0 0x55a4eebef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.817+0000 7f7814606740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a4eeb46420 con 0x55a4eebe37a0 2024-06-13T02:19:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.817+0000 7f7814606740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a4eeaedc50 con 0x55a4eebe2230 2024-06-13T02:19:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.817+0000 7f7814606740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a4eeb423e0 con 0x55a4eebecfb0 2024-06-13T02:19:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.818+0000 7f780b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe37a0 0x55a4eebe1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.818+0000 7f780b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe37a0 0x55a4eebe1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60832/0 (socket says 172.21.15.2:60832) 2024-06-13T02:19:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.818+0000 7f780b400640 1 -- 172.21.15.2:0/2687115663 learned_addr learned my addr 172.21.15.2:0/2687115663 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.818+0000 7f780aa00640 1 --2- 172.21.15.2:0/2687115663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebe2230 0x55a4eebe26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.818+0000 7f7803e00640 1 --2- 172.21.15.2:0/2687115663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebecfb0 0x55a4eebef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.818+0000 7f780b400640 1 -- 172.21.15.2:0/2687115663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebecfb0 msgr2=0x55a4eebef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:13.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.818+0000 7f780b400640 1 --2- 172.21.15.2:0/2687115663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebecfb0 0x55a4eebef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.818+0000 7f780b400640 1 -- 172.21.15.2:0/2687115663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebe2230 msgr2=0x55a4eebe26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.818+0000 7f780b400640 1 --2- 172.21.15.2:0/2687115663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebe2230 0x55a4eebe26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.818+0000 7f780b400640 1 -- 172.21.15.2:0/2687115663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4ee85a210 con 0x55a4eebe37a0 2024-06-13T02:19:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.818+0000 7f780aa00640 1 --2- 172.21.15.2:0/2687115663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebe2230 0x55a4eebe26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:19:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.819+0000 7f780b400640 1 --2- 172.21.15.2:0/2687115663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe37a0 0x55a4eebe1cf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7804009a20 tx=0x7f78040093a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1134efdf11740d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.819+0000 7f7803400640 1 --2- 172.21.15.2:0/4010044295 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f77f00a2e90 0x7f77f00a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.819+0000 7f77fbe00640 1 -- 172.21.15.2:0/2687115663 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7804049070 con 0x55a4eebe37a0 2024-06-13T02:19:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.819+0000 7f7803400640 1 -- 172.21.15.2:0/4010044295 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f77fc0cf9d0 con 0x7f780c101790 2024-06-13T02:19:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.819+0000 7f77fbe00640 1 -- 172.21.15.2:0/2687115663 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7804036040 con 0x55a4eebe37a0 2024-06-13T02:19:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.819+0000 7f77fbe00640 1 -- 172.21.15.2:0/2687115663 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78040044a0 con 0x55a4eebe37a0 2024-06-13T02:19:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.819+0000 7f780aa00640 1 --2- 172.21.15.2:0/4010044295 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f77f00a2e90 0x7f77f00a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.820+0000 7f7814606740 1 -- 172.21.15.2:0/2687115663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe37a0 msgr2=0x55a4eebe1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.820+0000 7f7814606740 1 --2- 172.21.15.2:0/2687115663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe37a0 0x55a4eebe1cf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7804009a20 tx=0x7f78040093a0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.820+0000 7f780aa00640 1 --2- 172.21.15.2:0/4010044295 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f77f00a2e90 0x7f77f00a5350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0ccb70 tx=0x7f77fc0d5530 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:13.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.820+0000 7f7814606740 1 -- 172.21.15.2:0/2687115663 shutdown_connections 2024-06-13T02:19:13.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.820+0000 7f7814606740 1 --2- 172.21.15.2:0/2687115663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebecfb0 0x55a4eebef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.820+0000 7f7814606740 1 --2- 172.21.15.2:0/2687115663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebe2230 0x55a4eebe26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.820+0000 7f7814606740 1 --2- 172.21.15.2:0/2687115663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe37a0 0x55a4eebe1cf0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.820+0000 7f7814606740 1 -- 172.21.15.2:0/2687115663 >> 172.21.15.2:0/2687115663 conn(0x55a4eebaafb0 msgr2=0x55a4eebde820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:13.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.820+0000 7f7814606740 1 -- 172.21.15.2:0/2687115663 shutdown_connections 2024-06-13T02:19:13.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.820+0000 7f7814606740 1 -- 172.21.15.2:0/2687115663 wait complete. 2024-06-13T02:19:13.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.821+0000 7f7814606740 1 -- start start 2024-06-13T02:19:13.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.821+0000 7f7814606740 1 Processor -- start 2024-06-13T02:19:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.822+0000 7f7814606740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebe2230 0x55a4eebf7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.822+0000 7f7814606740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebf77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.822+0000 7f7814606740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebecfb0 0x55a4eebf15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.822+0000 7f7814606740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55a4eebefd20 con 0x55a4eebecfb0 2024-06-13T02:19:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.822+0000 7f7814606740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a4eeb010b0 con 0x55a4eebe2230 2024-06-13T02:19:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.822+0000 7f7814606740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a4eebefea0 con 0x55a4eebe37a0 2024-06-13T02:19:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.822+0000 7f7814606740 10 client.0 _ll_register_callbacks cb 0x55a4eeaecf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:19:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.822+0000 7f780b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebecfb0 0x55a4eebf15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.822+0000 7f7803e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebf77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.822+0000 7f7803e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebf77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:55346/0 (socket says 172.21.15.2:55346) 2024-06-13T02:19:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.822+0000 7f7803e00640 1 -- 172.21.15.2:0/58407421 learned_addr learned my addr 172.21.15.2:0/58407421 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.822+0000 7f780b400640 1 --2- 172.21.15.2:0/58407421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebe2230 0x55a4eebf7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.822+0000 7f7803e00640 1 -- 172.21.15.2:0/58407421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebe2230 msgr2=0x55a4eebf7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.822+0000 7f7803e00640 1 --2- 172.21.15.2:0/58407421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebe2230 0x55a4eebf7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.823+0000 7f7803e00640 1 -- 172.21.15.2:0/58407421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebecfb0 msgr2=0x55a4eebf15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.823+0000 7f7803e00640 1 --2- 172.21.15.2:0/58407421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebecfb0 0x55a4eebf15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.823+0000 7f7803e00640 1 -- 172.21.15.2:0/58407421 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4ee926620 con 0x55a4eebe37a0 2024-06-13T02:19:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.823+0000 7f780b400640 1 --2- 172.21.15.2:0/58407421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebecfb0 0x55a4eebf15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:19:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.823+0000 7f7803e00640 1 --2- 172.21.15.2:0/58407421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebf77b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f77f4012d20 tx=0x7f77f400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db013fe8f2152c2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.823+0000 7f77f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:19:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.823+0000 7f77f8c00640 1 -- 172.21.15.2:0/58407421 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4012110 con 0x55a4eebe37a0 2024-06-13T02:19:13.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.823+0000 7f77f8c00640 1 -- 172.21.15.2:0/58407421 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f77f4004030 con 0x55a4eebe37a0 2024-06-13T02:19:13.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.823+0000 7f7814606740 1 -- 172.21.15.2:0/58407421 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7804036040 con 0x55a4eebe37a0 2024-06-13T02:19:13.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.823+0000 7f77f8c00640 1 -- 172.21.15.2:0/58407421 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f77f40122b0 con 0x55a4eebe37a0 2024-06-13T02:19:13.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.823+0000 7f7814606740 10 client.25342 fetch_fsmap learned FSMap version 28 2024-06-13T02:19:13.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.823+0000 7f7814606740 1 -- 172.21.15.2:0/58407421 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a4eec00550 con 0x55a4eebe37a0 2024-06-13T02:19:13.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.824+0000 7f77f8c00640 1 -- 172.21.15.2:0/58407421 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7804036040 con 0x55a4eebe37a0 2024-06-13T02:19:13.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.824+0000 7f77f8c00640 1 -- 172.21.15.2:0/58407421 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f77f4010430 con 0x55a4eebe37a0 2024-06-13T02:19:13.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.824+0000 7f7814606740 10 client.25342 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:19:13.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.824+0000 7f7814606740 10 client.25342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:19:13.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.824+0000 7f7814606740 20 client.25342 populate_metadata read hostname 'smithi002' 2024-06-13T02:19:13.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.824+0000 7f7814606740 1 --2- 172.21.15.2:0/58407421 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55a4eec01a80 0x55a4eec03e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.824+0000 7f7814606740 4 client.25342 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:19:13.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.824+0000 7f7814606740 1 -- 172.21.15.2:0/58407421 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4eeb53b50 con 0x55a4eec01a80 2024-06-13T02:19:13.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.825+0000 7f780b400640 1 --2- 172.21.15.2:0/58407421 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55a4eec01a80 0x55a4eec03e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.825+0000 7f780b400640 1 --2- 172.21.15.2:0/58407421 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55a4eec01a80 0x55a4eec03e70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9f72a5ffc24cfd1 server_cookie=278f541cc779919d in_seq=0 out_seq=0 2024-06-13T02:19:13.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.825+0000 7f77f8c00640 10 client.25342 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.826+0000 7f77f8c00640 1 -- 172.21.15.2:0/58407421 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a4eeb53b50 con 0x55a4eec01a80 2024-06-13T02:19:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.826+0000 7f77f8c00640 10 client.25342 handle_command_reply: tid=0 2024-06-13T02:19:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.826+0000 7f7814606740 1 client.25342 shutdown 2024-06-13T02:19:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.826+0000 7f7814606740 1 -- 172.21.15.2:0/58407421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 msgr2=0x55a4eebf77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.826+0000 7f7814606740 1 --2- 172.21.15.2:0/58407421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebf77b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f77f4012d20 tx=0x7f77f400f790 comp rx=0 tx=0).stop 2024-06-13T02:19:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.826+0000 7f7814606740 1 -- 172.21.15.2:0/58407421 shutdown_connections 2024-06-13T02:19:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.826+0000 7f7814606740 1 --2- 172.21.15.2:0/58407421 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55a4eec01a80 0x55a4eec03e70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.826+0000 7f7814606740 1 --2- 172.21.15.2:0/58407421 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebecfb0 0x55a4eebf15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.826+0000 7f7814606740 1 --2- 172.21.15.2:0/58407421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebf77b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.826+0000 7f7814606740 1 --2- 172.21.15.2:0/58407421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebe2230 0x55a4eebf7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.826+0000 7f77f8c00640 0 client.25342 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.826+0000 7f7814606740 1 -- 172.21.15.2:0/58407421 >> 172.21.15.2:0/58407421 conn(0x55a4eebaafb0 msgr2=0x55a4eebe4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:13.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.826+0000 7f7814606740 1 -- 172.21.15.2:0/58407421 shutdown_connections 2024-06-13T02:19:13.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.826+0000 7f7814606740 1 -- 172.21.15.2:0/58407421 wait complete. 2024-06-13T02:19:13.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.827+0000 7f7814606740 20 client.25342 trim_cache size 0 max 16384 2024-06-13T02:19:13.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.844+0000 7f7814606740 1 Processor -- start 2024-06-13T02:19:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.844+0000 7f7814606740 1 -- start start 2024-06-13T02:19:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.844+0000 7f7814606740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe2230 0x55a4eebf00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.844+0000 7f7814606740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebf7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.844+0000 7f7814606740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebecfb0 0x55a4eec09790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.844+0000 7f7814606740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f780c1af3d0 con 0x55a4eebe2230 2024-06-13T02:19:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.844+0000 7f7814606740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f780c1acca0 con 0x55a4eebecfb0 2024-06-13T02:19:13.846 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.844+0000 7f7814606740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f780c1aaaf0 con 0x55a4eebe37a0 2024-06-13T02:19:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.845+0000 7f780b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe2230 0x55a4eebf00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.845+0000 7f7803e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebf7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.845+0000 7f7803e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebf7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:55354/0 (socket says 172.21.15.2:55354) 2024-06-13T02:19:13.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.845+0000 7f780b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe2230 0x55a4eebf00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60840/0 (socket says 172.21.15.2:60840) 2024-06-13T02:19:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.845+0000 7f7803e00640 1 -- 172.21.15.2:0/3451506011 learned_addr learned my addr 172.21.15.2:0/3451506011 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.845+0000 7f780b400640 1 --2- 172.21.15.2:0/3451506011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebecfb0 0x55a4eec09790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.845+0000 7f7803e00640 1 -- 172.21.15.2:0/3451506011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebecfb0 msgr2=0x55a4eec09790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.845+0000 7f7803e00640 1 --2- 172.21.15.2:0/3451506011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebecfb0 0x55a4eec09790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.845+0000 7f7803e00640 1 -- 172.21.15.2:0/3451506011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe2230 msgr2=0x55a4eebf00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.845+0000 7f7803e00640 1 --2- 172.21.15.2:0/3451506011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe2230 0x55a4eebf00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.845+0000 7f7803e00640 1 -- 172.21.15.2:0/3451506011 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4eebda1f0 con 0x55a4eebe37a0 2024-06-13T02:19:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.845+0000 7f780b400640 1 --2- 172.21.15.2:0/3451506011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebecfb0 0x55a4eec09790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:19:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.845+0000 7f7803e00640 1 --2- 172.21.15.2:0/3451506011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebf7540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f77f4010820 tx=0x7f77f40059b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1900537a6503f94 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.846+0000 7f77fb400640 1 -- 172.21.15.2:0/3451506011 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f400fe80 con 0x55a4eebe37a0 2024-06-13T02:19:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.846+0000 7f77fb400640 1 -- 172.21.15.2:0/3451506011 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77f4010430 con 0x55a4eebe37a0 2024-06-13T02:19:13.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.846+0000 7f77fb400640 1 -- 172.21.15.2:0/3451506011 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4003850 con 0x55a4eebe37a0 2024-06-13T02:19:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.847+0000 7f7814606740 1 -- 172.21.15.2:0/3451506011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 msgr2=0x55a4eebf7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.847+0000 7f7814606740 1 --2- 172.21.15.2:0/3451506011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebf7540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f77f4010820 tx=0x7f77f40059b0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.847+0000 7f7814606740 1 -- 172.21.15.2:0/3451506011 shutdown_connections 2024-06-13T02:19:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.847+0000 7f7814606740 1 --2- 172.21.15.2:0/3451506011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebecfb0 0x55a4eec09790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.847+0000 7f7814606740 1 --2- 172.21.15.2:0/3451506011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebf7540 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.847+0000 7f7814606740 1 --2- 172.21.15.2:0/3451506011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe2230 0x55a4eebf00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.847+0000 7f7814606740 1 -- 172.21.15.2:0/3451506011 >> 172.21.15.2:0/3451506011 conn(0x55a4eebaafb0 msgr2=0x55a4eebf6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.847+0000 7f7814606740 1 -- 172.21.15.2:0/3451506011 shutdown_connections 2024-06-13T02:19:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.847+0000 7f7814606740 1 -- 172.21.15.2:0/3451506011 wait complete. 2024-06-13T02:19:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.847+0000 7f7814606740 1 -- start start 2024-06-13T02:19:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.847+0000 7f7814606740 1 Processor -- start 2024-06-13T02:19:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.848+0000 7f7814606740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe2230 0x55a4eebfdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.848+0000 7f7814606740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebfb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.848+0000 7f7814606740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebecfb0 0x55a4eebfb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.848+0000 7f7814606740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f780c1ab160 con 0x55a4eebe2230 2024-06-13T02:19:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.848+0000 7f7814606740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f780c1ac5d0 con 0x55a4eebecfb0 2024-06-13T02:19:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.848+0000 7f7814606740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f780c1ab830 con 0x55a4eebe37a0 2024-06-13T02:19:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.848+0000 7f7814606740 10 client.0 _ll_register_callbacks cb 0x7f77f4009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:19:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.848+0000 7f780b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe2230 0x55a4eebfdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.848+0000 7f7803e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebfb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.848+0000 7f780b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe2230 0x55a4eebfdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60848/0 (socket says 172.21.15.2:60848) 2024-06-13T02:19:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.848+0000 7f780b400640 1 -- 172.21.15.2:0/2551404620 learned_addr learned my addr 172.21.15.2:0/2551404620 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.848+0000 7f7803e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebfb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:55362/0 (socket says 172.21.15.2:55362) 2024-06-13T02:19:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.849+0000 7f780b400640 1 --2- 172.21.15.2:0/2551404620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebecfb0 0x55a4eebfb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.849+0000 7f7803e00640 1 -- 172.21.15.2:0/2551404620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebecfb0 msgr2=0x55a4eebfb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.849+0000 7f7803e00640 1 --2- 172.21.15.2:0/2551404620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebecfb0 0x55a4eebfb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.849+0000 7f7803e00640 1 -- 172.21.15.2:0/2551404620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe2230 msgr2=0x55a4eebfdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.849+0000 7f7803e00640 1 --2- 172.21.15.2:0/2551404620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe2230 0x55a4eebfdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.849+0000 7f7803e00640 1 -- 172.21.15.2:0/2551404620 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4eec6b770 con 0x55a4eebe37a0 2024-06-13T02:19:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.849+0000 7f780b400640 1 --2- 172.21.15.2:0/2551404620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe2230 0x55a4eebfdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:19:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.849+0000 7f7803e00640 1 --2- 172.21.15.2:0/2551404620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebfb110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f77f4012870 tx=0x7f77f4009280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2299f0d146bb3634 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.849+0000 7f77f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:19:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.850+0000 7f77f8c00640 1 -- 172.21.15.2:0/2551404620 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f400fe80 con 0x55a4eebe37a0 2024-06-13T02:19:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.850+0000 7f77f8c00640 1 -- 172.21.15.2:0/2551404620 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f77f4005490 con 0x55a4eebe37a0 2024-06-13T02:19:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.850+0000 7f7814606740 1 -- 172.21.15.2:0/2551404620 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77f4010430 con 0x55a4eebe37a0 2024-06-13T02:19:13.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.850+0000 7f77f8c00640 1 -- 172.21.15.2:0/2551404620 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f77f403f050 con 0x55a4eebe37a0 2024-06-13T02:19:13.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.850+0000 7f7814606740 10 client.25348 fetch_fsmap learned FSMap version 28 2024-06-13T02:19:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.850+0000 7f7814606740 1 -- 172.21.15.2:0/2551404620 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a4eec6c940 con 0x55a4eebe37a0 2024-06-13T02:19:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.850+0000 7f77f8c00640 1 -- 172.21.15.2:0/2551404620 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77f4010430 con 0x55a4eebe37a0 2024-06-13T02:19:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.851+0000 7f77f8c00640 1 -- 172.21.15.2:0/2551404620 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f77f403a030 con 0x55a4eebe37a0 2024-06-13T02:19:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.851+0000 7f7814606740 10 client.25348 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:19:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.851+0000 7f7814606740 10 client.25348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:19:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.851+0000 7f7814606740 20 client.25348 populate_metadata read hostname 'smithi002' 2024-06-13T02:19:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.851+0000 7f7814606740 1 --2- 172.21.15.2:0/2551404620 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55a4eec6d090 0x55a4eec6f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.851+0000 7f7814606740 4 client.25348 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:19:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.851+0000 7f7814606740 1 -- 172.21.15.2:0/2551404620 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a4eeb4dea0 con 0x55a4eec6d090 2024-06-13T02:19:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.851+0000 7f780b400640 1 --2- 172.21.15.2:0/2551404620 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55a4eec6d090 0x55a4eec6f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.852+0000 7f780b400640 1 --2- 172.21.15.2:0/2551404620 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55a4eec6d090 0x55a4eec6f4b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b9cec75c85d1a16 server_cookie=a3fce268cef7a11b in_seq=0 out_seq=0 2024-06-13T02:19:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.852+0000 7f77f8c00640 10 client.25348 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.907+0000 7f77f8c00640 1 -- 172.21.15.2:0/2551404620 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55a4eeb4dea0 con 0x55a4eec6d090 2024-06-13T02:19:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.907+0000 7f77f8c00640 10 client.25348 handle_command_reply: tid=0 2024-06-13T02:19:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.907+0000 7f7814606740 1 client.25348 shutdown 2024-06-13T02:19:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.907+0000 7f7814606740 1 -- 172.21.15.2:0/2551404620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 msgr2=0x55a4eebfb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.907+0000 7f7814606740 1 --2- 172.21.15.2:0/2551404620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebfb110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f77f4012870 tx=0x7f77f4009280 comp rx=0 tx=0).stop 2024-06-13T02:19:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.907+0000 7f7814606740 1 -- 172.21.15.2:0/2551404620 shutdown_connections 2024-06-13T02:19:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.907+0000 7f7814606740 1 --2- 172.21.15.2:0/2551404620 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55a4eec6d090 0x55a4eec6f4b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.907+0000 7f7814606740 1 --2- 172.21.15.2:0/2551404620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a4eebecfb0 0x55a4eebfb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.907+0000 7f7814606740 1 --2- 172.21.15.2:0/2551404620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4eebe37a0 0x55a4eebfb110 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.907+0000 7f7814606740 1 --2- 172.21.15.2:0/2551404620 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55a4eebe2230 0x55a4eebfdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.907+0000 7f77f8c00640 0 client.25348 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.907+0000 7f7814606740 1 -- 172.21.15.2:0/2551404620 >> 172.21.15.2:0/2551404620 conn(0x55a4eebaafb0 msgr2=0x55a4eebe3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.908+0000 7f7814606740 1 -- 172.21.15.2:0/2551404620 shutdown_connections 2024-06-13T02:19:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.908+0000 7f7814606740 1 -- 172.21.15.2:0/2551404620 wait complete. 2024-06-13T02:19:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.908+0000 7f7814606740 20 client.25348 trim_cache size 0 max 16384 2024-06-13T02:19:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:19:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:19:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:19:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.909+0000 7f780be00640 1 -- 172.21.15.2:0/4010044295 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f77f00a2e90 msgr2=0x7f77f00a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.909+0000 7f780be00640 1 --2- 172.21.15.2:0/4010044295 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f77f00a2e90 0x7f77f00a5350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0ccb70 tx=0x7f77fc0d5530 comp rx=0 tx=0).stop 2024-06-13T02:19:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.909+0000 7f780be00640 1 -- 172.21.15.2:0/4010044295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f780c101790 msgr2=0x7f780c1980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.909+0000 7f780be00640 1 --2- 172.21.15.2:0/4010044295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f780c101790 0x7f780c1980e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00e9f0 tx=0x7f77fc00eeb0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.909+0000 7f780be00640 1 -- 172.21.15.2:0/4010044295 shutdown_connections 2024-06-13T02:19:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.909+0000 7f780be00640 1 --2- 172.21.15.2:0/4010044295 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f77f00a2e90 0x7f77f00a5350 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.909+0000 7f780be00640 1 --2- 172.21.15.2:0/4010044295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f780c1077a0 0x7f780c19c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.909+0000 7f780be00640 1 --2- 172.21.15.2:0/4010044295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f780c102150 0x7f780c198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.909+0000 7f780be00640 1 --2- 172.21.15.2:0/4010044295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f780c101790 0x7f780c1980e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.909+0000 7f780be00640 1 -- 172.21.15.2:0/4010044295 >> 172.21.15.2:0/4010044295 conn(0x7f780c0fd2e0 msgr2=0x7f780c0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.909+0000 7f780be00640 1 -- 172.21.15.2:0/4010044295 shutdown_connections 2024-06-13T02:19:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:13.909+0000 7f780be00640 1 -- 172.21.15.2:0/4010044295 wait complete. 2024-06-13T02:19:14.467 INFO:tasks.workunit.client.0.smithi002.stdout: 1 11175 4.35 MB/sec warmup 18 sec latency 11583.618 ms 2024-06-13T02:19:15.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:14 smithi002 ceph-mon[31960]: pgmap v45: 129 pgs: 129 active+clean; 7.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 193 KiB/s wr, 71 op/s 2024-06-13T02:19:15.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:14 smithi084 ceph-mon[36833]: pgmap v45: 129 pgs: 129 active+clean; 7.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 193 KiB/s wr, 71 op/s 2024-06-13T02:19:15.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:14 smithi175 ceph-mon[36977]: pgmap v45: 129 pgs: 129 active+clean; 7.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 193 KiB/s wr, 71 op/s 2024-06-13T02:19:15.467 INFO:tasks.workunit.client.0.smithi002.stdout: 1 11175 4.12 MB/sec warmup 19 sec latency 12583.769 ms 2024-06-13T02:19:16.467 INFO:tasks.workunit.client.0.smithi002.stdout: 1 11175 3.92 MB/sec warmup 20 sec latency 13583.936 ms 2024-06-13T02:19:17.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:16 smithi002 ceph-mon[31960]: pgmap v46: 129 pgs: 129 active+clean; 19 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 1.1 MiB/s wr, 88 op/s 2024-06-13T02:19:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:16 smithi084 ceph-mon[36833]: pgmap v46: 129 pgs: 129 active+clean; 19 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 1.1 MiB/s wr, 88 op/s 2024-06-13T02:19:17.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:16 smithi175 ceph-mon[36977]: pgmap v46: 129 pgs: 129 active+clean; 19 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 1.1 MiB/s wr, 88 op/s 2024-06-13T02:19:17.468 INFO:tasks.workunit.client.0.smithi002.stdout: 1 11577 3.77 MB/sec warmup 21 sec latency 14239.075 ms 2024-06-13T02:19:18.468 INFO:tasks.workunit.client.0.smithi002.stdout: 1 13060 3.88 MB/sec warmup 22 sec latency 352.691 ms 2024-06-13T02:19:19.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:18 smithi002 ceph-mon[31960]: pgmap v47: 129 pgs: 129 active+clean; 23 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 40 op/s 2024-06-13T02:19:19.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:18 smithi084 ceph-mon[36833]: pgmap v47: 129 pgs: 129 active+clean; 23 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 40 op/s 2024-06-13T02:19:19.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:18 smithi175 ceph-mon[36977]: pgmap v47: 129 pgs: 129 active+clean; 23 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 40 op/s 2024-06-13T02:19:19.468 INFO:tasks.workunit.client.0.smithi002.stdout: 1 14919 4.25 MB/sec warmup 23 sec latency 10.895 ms 2024-06-13T02:19:20.468 INFO:tasks.workunit.client.0.smithi002.stdout: 1 17090 4.55 MB/sec warmup 24 sec latency 12.762 ms 2024-06-13T02:19:21.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:20 smithi002 ceph-mon[31960]: pgmap v48: 129 pgs: 129 active+clean; 23 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 27 op/s 2024-06-13T02:19:21.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:20 smithi084 ceph-mon[36833]: pgmap v48: 129 pgs: 129 active+clean; 23 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 27 op/s 2024-06-13T02:19:21.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:20 smithi175 ceph-mon[36977]: pgmap v48: 129 pgs: 129 active+clean; 23 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 27 op/s 2024-06-13T02:19:21.468 INFO:tasks.workunit.client.0.smithi002.stdout: 1 18622 4.69 MB/sec warmup 25 sec latency 13.194 ms 2024-06-13T02:19:22.468 INFO:tasks.workunit.client.0.smithi002.stdout: 1 21047 5.04 MB/sec warmup 26 sec latency 9.864 ms 2024-06-13T02:19:23.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:22 smithi002 ceph-mon[31960]: pgmap v49: 129 pgs: 129 active+clean; 32 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 2.7 MiB/s wr, 106 op/s 2024-06-13T02:19:23.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:22 smithi002 ceph-mon[31960]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-06-13T02:19:23.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:22 smithi084 ceph-mon[36833]: pgmap v49: 129 pgs: 129 active+clean; 32 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 2.7 MiB/s wr, 106 op/s 2024-06-13T02:19:23.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:22 smithi084 ceph-mon[36833]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-06-13T02:19:23.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:22 smithi175 ceph-mon[36977]: pgmap v49: 129 pgs: 129 active+clean; 32 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 2.7 MiB/s wr, 106 op/s 2024-06-13T02:19:23.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:22 smithi175 ceph-mon[36977]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-06-13T02:19:23.468 INFO:tasks.workunit.client.0.smithi002.stdout: 1 22396 5.10 MB/sec warmup 27 sec latency 9.776 ms 2024-06-13T02:19:24.468 INFO:tasks.workunit.client.0.smithi002.stdout: 1 24861 5.47 MB/sec warmup 28 sec latency 10.249 ms 2024-06-13T02:19:25.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:24 smithi084 ceph-mon[36833]: pgmap v50: 129 pgs: 129 active+clean; 32 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 2.7 MiB/s wr, 103 op/s 2024-06-13T02:19:25.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:24 smithi175 ceph-mon[36977]: pgmap v50: 129 pgs: 129 active+clean; 32 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 2.7 MiB/s wr, 103 op/s 2024-06-13T02:19:25.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:24 smithi002 ceph-mon[31960]: pgmap v50: 129 pgs: 129 active+clean; 32 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 2.7 MiB/s wr, 103 op/s 2024-06-13T02:19:25.468 INFO:tasks.workunit.client.0.smithi002.stdout: 1 26096 5.41 MB/sec warmup 29 sec latency 13.466 ms 2024-06-13T02:19:26.468 INFO:tasks.workunit.client.0.smithi002.stdout: 1 28644 5.79 MB/sec warmup 30 sec latency 10.561 ms 2024-06-13T02:19:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.069+0000 7f592f600640 1 -- 172.21.15.2:0/333608397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5928102be0 msgr2=0x7f5928102fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.069+0000 7f592f600640 1 --2- 172.21.15.2:0/333608397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5928102be0 0x7f5928102fc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f591c009ca0 tx=0x7f591c02a950 comp rx=0 tx=0).stop 2024-06-13T02:19:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.069+0000 7f592f600640 1 -- 172.21.15.2:0/333608397 shutdown_connections 2024-06-13T02:19:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.069+0000 7f592f600640 1 --2- 172.21.15.2:0/333608397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f592810c000 0x7f592810e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.069+0000 7f592f600640 1 --2- 172.21.15.2:0/333608397 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5928103500 0x7f592810b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.069+0000 7f592f600640 1 --2- 172.21.15.2:0/333608397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5928102be0 0x7f5928102fc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.069+0000 7f592f600640 1 -- 172.21.15.2:0/333608397 >> 172.21.15.2:0/333608397 conn(0x7f59280fc3c0 msgr2=0x7f59280fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.070+0000 7f592f600640 1 -- 172.21.15.2:0/333608397 shutdown_connections 2024-06-13T02:19:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.070+0000 7f592f600640 1 -- 172.21.15.2:0/333608397 wait complete. 2024-06-13T02:19:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.071+0000 7f592f600640 1 Processor -- start 2024-06-13T02:19:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.071+0000 7f592f600640 1 -- start start 2024-06-13T02:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.071+0000 7f592f600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5928102be0 0x7f5928100830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.071+0000 7f592f600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5928103500 0x7f5928100d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.071+0000 7f592f600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f592810c000 0x7f59281012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.071+0000 7f592f600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5928111e00 con 0x7f592810c000 2024-06-13T02:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.071+0000 7f592f600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5928111c80 con 0x7f5928102be0 2024-06-13T02:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.071+0000 7f592f600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5928111f80 con 0x7f5928103500 2024-06-13T02:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.072+0000 7f592cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5928102be0 0x7f5928100830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.072+0000 7f5927e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5928103500 0x7f5928100d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.072+0000 7f592cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5928102be0 0x7f5928100830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:58630/0 (socket says 172.21.15.2:58630) 2024-06-13T02:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.072+0000 7f592cc00640 1 -- 172.21.15.2:0/3749721925 learned_addr learned my addr 172.21.15.2:0/3749721925 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.072+0000 7f592d600640 1 --2- 172.21.15.2:0/3749721925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f592810c000 0x7f59281012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.072+0000 7f592cc00640 1 -- 172.21.15.2:0/3749721925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5928103500 msgr2=0x7f5928100d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.072+0000 7f592cc00640 1 --2- 172.21.15.2:0/3749721925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5928103500 0x7f5928100d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.072+0000 7f592cc00640 1 -- 172.21.15.2:0/3749721925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f592810c000 msgr2=0x7f59281012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.072+0000 7f592cc00640 1 --2- 172.21.15.2:0/3749721925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f592810c000 0x7f59281012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.072+0000 7f592cc00640 1 -- 172.21.15.2:0/3749721925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59281a67a0 con 0x7f5928102be0 2024-06-13T02:19:27.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.073+0000 7f592cc00640 1 --2- 172.21.15.2:0/3749721925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5928102be0 0x7f5928100830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f591c005cc0 tx=0x7f591c02f630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:27.075 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.073+0000 7f5925600640 1 -- 172.21.15.2:0/3749721925 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c034040 con 0x7f5928102be0 2024-06-13T02:19:27.075 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.073+0000 7f5925600640 1 -- 172.21.15.2:0/3749721925 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f591c030920 con 0x7f5928102be0 2024-06-13T02:19:27.075 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.073+0000 7f5925600640 1 -- 172.21.15.2:0/3749721925 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c004780 con 0x7f5928102be0 2024-06-13T02:19:27.075 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.074+0000 7f592f600640 1 -- 172.21.15.2:0/3749721925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59281a6a30 con 0x7f5928102be0 2024-06-13T02:19:27.075 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.074+0000 7f592f600640 1 -- 172.21.15.2:0/3749721925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59281a6ea0 con 0x7f5928102be0 2024-06-13T02:19:27.077 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.077+0000 7f5925600640 1 -- 172.21.15.2:0/3749721925 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f591c037020 con 0x7f5928102be0 2024-06-13T02:19:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.078+0000 7f59323a1740 1 Processor -- start 2024-06-13T02:19:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.078+0000 7f59323a1740 1 -- start start 2024-06-13T02:19:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.078+0000 7f59323a1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566162085e0 0x556616206b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.078+0000 7f59323a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616207070 0x5566162074f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.078+0000 7f59323a1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556616211df0 0x5566162141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.078+0000 7f59323a1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55661616b420 con 0x5566162085e0 2024-06-13T02:19:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.078+0000 7f59323a1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556616112c50 con 0x556616211df0 2024-06-13T02:19:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.078+0000 7f59323a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5566161673e0 con 0x556616207070 2024-06-13T02:19:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.078+0000 7f592cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616207070 0x5566162074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.078+0000 7f5927e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556616211df0 0x5566162141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.078+0000 7f592d600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566162085e0 0x556616206b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.078+0000 7f592cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616207070 0x5566162074f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:49048/0 (socket says 172.21.15.2:49048) 2024-06-13T02:19:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.079+0000 7f592cc00640 1 -- 172.21.15.2:0/3691958953 learned_addr learned my addr 172.21.15.2:0/3691958953 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.079+0000 7f5927e00640 1 -- 172.21.15.2:0/3691958953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616207070 msgr2=0x5566162074f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.079+0000 7f5927e00640 1 --2- 172.21.15.2:0/3691958953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616207070 0x5566162074f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.079+0000 7f5927e00640 1 -- 172.21.15.2:0/3691958953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566162085e0 msgr2=0x556616206b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.079+0000 7f5927e00640 1 --2- 172.21.15.2:0/3691958953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566162085e0 0x556616206b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.079+0000 7f5927e00640 1 -- 172.21.15.2:0/3691958953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556615e7f210 con 0x556616211df0 2024-06-13T02:19:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.079+0000 7f5925600640 1 --2- 172.21.15.2:0/3749721925 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f59100a2da0 0x7f59100a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.079+0000 7f5927e00640 1 --2- 172.21.15.2:0/3691958953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556616211df0 0x5566162141e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5914009c10 tx=0x7f5914011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41edced1bf944748 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.079+0000 7f5925600640 1 -- 172.21.15.2:0/3749721925 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f591c0f0970 con 0x7f5928102be0 2024-06-13T02:19:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.079+0000 7f592d600640 1 --2- 172.21.15.2:0/3749721925 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f59100a2da0 0x7f59100a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.079+0000 7f5919c00640 1 -- 172.21.15.2:0/3691958953 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914004050 con 0x556616211df0 2024-06-13T02:19:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.080+0000 7f5919c00640 1 -- 172.21.15.2:0/3691958953 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5914005500 con 0x556616211df0 2024-06-13T02:19:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.080+0000 7f5919c00640 1 -- 172.21.15.2:0/3691958953 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914004e00 con 0x556616211df0 2024-06-13T02:19:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.080+0000 7f59323a1740 1 -- 172.21.15.2:0/3691958953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556616211df0 msgr2=0x5566162141e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.080+0000 7f59323a1740 1 --2- 172.21.15.2:0/3691958953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556616211df0 0x5566162141e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5914009c10 tx=0x7f5914011810 comp rx=0 tx=0).stop 2024-06-13T02:19:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.080+0000 7f59323a1740 1 -- 172.21.15.2:0/3691958953 shutdown_connections 2024-06-13T02:19:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.080+0000 7f59323a1740 1 --2- 172.21.15.2:0/3691958953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556616211df0 0x5566162141e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.080+0000 7f59323a1740 1 --2- 172.21.15.2:0/3691958953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616207070 0x5566162074f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.080+0000 7f59323a1740 1 --2- 172.21.15.2:0/3691958953 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5566162085e0 0x556616206b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.080+0000 7f59323a1740 1 -- 172.21.15.2:0/3691958953 >> 172.21.15.2:0/3691958953 conn(0x5566161cffb0 msgr2=0x556616203660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.081+0000 7f59323a1740 1 -- 172.21.15.2:0/3691958953 shutdown_connections 2024-06-13T02:19:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.081+0000 7f59323a1740 1 -- 172.21.15.2:0/3691958953 wait complete. 2024-06-13T02:19:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.081+0000 7f592d600640 1 --2- 172.21.15.2:0/3749721925 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f59100a2da0 0x7f59100a5260 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f592000b710 tx=0x7f592000b2e0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.081+0000 7f59323a1740 1 -- start start 2024-06-13T02:19:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.081+0000 7f59323a1740 1 Processor -- start 2024-06-13T02:19:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f59323a1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 0x55661620ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f59323a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566162085e0 0x55661620f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f59323a1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556616211df0 0x55661620f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f59323a1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556616214bc0 con 0x556616207070 2024-06-13T02:19:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f59323a1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5566161260b0 con 0x556616211df0 2024-06-13T02:19:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f59323a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556616214d40 con 0x5566162085e0 2024-06-13T02:19:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f59323a1740 10 client.0 _ll_register_callbacks cb 0x556616111f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:19:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f5927e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566162085e0 0x55661620f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f592d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556616211df0 0x55661620f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f5927e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566162085e0 0x55661620f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:49056/0 (socket says 172.21.15.2:49056) 2024-06-13T02:19:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f5927e00640 1 -- 172.21.15.2:0/4033667294 learned_addr learned my addr 172.21.15.2:0/4033667294 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f592cc00640 1 --2- 172.21.15.2:0/4033667294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 0x55661620ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f592d600640 1 -- 172.21.15.2:0/4033667294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566162085e0 msgr2=0x55661620f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f592d600640 1 --2- 172.21.15.2:0/4033667294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566162085e0 0x55661620f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f592d600640 1 -- 172.21.15.2:0/4033667294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 msgr2=0x55661620ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f592d600640 1 --2- 172.21.15.2:0/4033667294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 0x55661620ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.082+0000 7f592d600640 1 -- 172.21.15.2:0/4033667294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556615f4b620 con 0x556616211df0 2024-06-13T02:19:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.083+0000 7f592d600640 1 --2- 172.21.15.2:0/4033667294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556616211df0 0x55661620f880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f592000bfa0 tx=0x7f5920004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=780ac7c337588c64 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.083+0000 7f590e000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:19:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.083+0000 7f590e000640 1 -- 172.21.15.2:0/4033667294 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592001fd10 con 0x556616211df0 2024-06-13T02:19:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.083+0000 7f59323a1740 1 -- 172.21.15.2:0/4033667294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5914005500 con 0x556616211df0 2024-06-13T02:19:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.083+0000 7f590e000640 1 -- 172.21.15.2:0/4033667294 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f5920017030 con 0x556616211df0 2024-06-13T02:19:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.083+0000 7f590e000640 1 -- 172.21.15.2:0/4033667294 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5920032050 con 0x556616211df0 2024-06-13T02:19:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.083+0000 7f59323a1740 10 client.25373 fetch_fsmap learned FSMap version 28 2024-06-13T02:19:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.083+0000 7f59323a1740 1 -- 172.21.15.2:0/4033667294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556616221010 con 0x556616211df0 2024-06-13T02:19:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.084+0000 7f590e000640 1 -- 172.21.15.2:0/4033667294 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5914005500 con 0x556616211df0 2024-06-13T02:19:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.084+0000 7f590e000640 1 -- 172.21.15.2:0/4033667294 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f5920027410 con 0x556616211df0 2024-06-13T02:19:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.084+0000 7f59323a1740 10 client.25373 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:19:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.084+0000 7f59323a1740 10 client.25373 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:19:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.084+0000 7f59323a1740 20 client.25373 populate_metadata read hostname 'smithi002' 2024-06-13T02:19:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.084+0000 7f59323a1740 1 --2- 172.21.15.2:0/4033667294 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556616222540 0x556616224950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.084+0000 7f59323a1740 4 client.25373 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:19:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.084+0000 7f59323a1740 1 -- 172.21.15.2:0/4033667294 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556616178b50 con 0x556616222540 2024-06-13T02:19:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.084+0000 7f592cc00640 1 --2- 172.21.15.2:0/4033667294 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556616222540 0x556616224950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.085+0000 7f592cc00640 1 --2- 172.21.15.2:0/4033667294 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556616222540 0x556616224950 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8402cca31788e312 server_cookie=70f54ec52e39500e in_seq=0 out_seq=0 2024-06-13T02:19:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.085+0000 7f590e000640 10 client.25373 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.086+0000 7f590e000640 1 -- 172.21.15.2:0/4033667294 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556616178b50 con 0x556616222540 2024-06-13T02:19:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.086+0000 7f590e000640 10 client.25373 handle_command_reply: tid=0 2024-06-13T02:19:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.086+0000 7f59323a1740 1 client.25373 shutdown 2024-06-13T02:19:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.086+0000 7f59323a1740 1 -- 172.21.15.2:0/4033667294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556616211df0 msgr2=0x55661620f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.086+0000 7f59323a1740 1 --2- 172.21.15.2:0/4033667294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556616211df0 0x55661620f880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f592000bfa0 tx=0x7f5920004730 comp rx=0 tx=0).stop 2024-06-13T02:19:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.086+0000 7f59323a1740 1 -- 172.21.15.2:0/4033667294 shutdown_connections 2024-06-13T02:19:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.086+0000 7f59323a1740 1 --2- 172.21.15.2:0/4033667294 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556616222540 0x556616224950 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.086+0000 7f59323a1740 1 --2- 172.21.15.2:0/4033667294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556616211df0 0x55661620f880 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.086+0000 7f590e000640 0 client.25373 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.086+0000 7f59323a1740 1 --2- 172.21.15.2:0/4033667294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5566162085e0 0x55661620f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.086+0000 7f59323a1740 1 --2- 172.21.15.2:0/4033667294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 0x55661620ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.086+0000 7f59323a1740 1 -- 172.21.15.2:0/4033667294 >> 172.21.15.2:0/4033667294 conn(0x5566161cffb0 msgr2=0x5566162094d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.086+0000 7f59323a1740 1 -- 172.21.15.2:0/4033667294 shutdown_connections 2024-06-13T02:19:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.086+0000 7f59323a1740 1 -- 172.21.15.2:0/4033667294 wait complete. 2024-06-13T02:19:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.087+0000 7f59323a1740 20 client.25373 trim_cache size 0 max 16384 2024-06-13T02:19:27.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.105+0000 7f59323a1740 1 Processor -- start 2024-06-13T02:19:27.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.105+0000 7f59323a1740 1 -- start start 2024-06-13T02:19:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.105+0000 7f59323a1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 0x55661622a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.105+0000 7f59323a1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566162085e0 0x55661622a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.105+0000 7f59323a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616211df0 0x55661620edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.105+0000 7f59323a1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f59281b3970 con 0x556616207070 2024-06-13T02:19:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.105+0000 7f59323a1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f59281b1240 con 0x5566162085e0 2024-06-13T02:19:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.105+0000 7f59323a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59281af090 con 0x556616211df0 2024-06-13T02:19:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.106+0000 7f592d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616211df0 0x55661620edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.106+0000 7f5927e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566162085e0 0x55661622a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.106+0000 7f5927e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566162085e0 0x55661622a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:58660/0 (socket says 172.21.15.2:58660) 2024-06-13T02:19:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.106+0000 7f5927e00640 1 -- 172.21.15.2:0/45527871 learned_addr learned my addr 172.21.15.2:0/45527871 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.106+0000 7f592cc00640 1 --2- 172.21.15.2:0/45527871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 0x55661622a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.106+0000 7f592d600640 1 -- 172.21.15.2:0/45527871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566162085e0 msgr2=0x55661622a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.106+0000 7f592d600640 1 --2- 172.21.15.2:0/45527871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566162085e0 0x55661622a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.106+0000 7f592d600640 1 -- 172.21.15.2:0/45527871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 msgr2=0x55661622a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.106+0000 7f592d600640 1 --2- 172.21.15.2:0/45527871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 0x55661622a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.106+0000 7f592d600640 1 -- 172.21.15.2:0/45527871 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661620d350 con 0x556616211df0 2024-06-13T02:19:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.107+0000 7f592d600640 1 --2- 172.21.15.2:0/45527871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616211df0 0x55661620edc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5920003610 tx=0x7f5920005990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45543753a2a90659 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.107+0000 7f5919200640 1 -- 172.21.15.2:0/45527871 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5920027c70 con 0x556616211df0 2024-06-13T02:19:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.107+0000 7f5919200640 1 -- 172.21.15.2:0/45527871 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5920003950 con 0x556616211df0 2024-06-13T02:19:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.107+0000 7f5919200640 1 -- 172.21.15.2:0/45527871 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5920004cb0 con 0x556616211df0 2024-06-13T02:19:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.108+0000 7f59323a1740 1 -- 172.21.15.2:0/45527871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616211df0 msgr2=0x55661620edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.108+0000 7f59323a1740 1 --2- 172.21.15.2:0/45527871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616211df0 0x55661620edc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5920003610 tx=0x7f5920005990 comp rx=0 tx=0).stop 2024-06-13T02:19:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.108+0000 7f59323a1740 1 -- 172.21.15.2:0/45527871 shutdown_connections 2024-06-13T02:19:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.108+0000 7f59323a1740 1 --2- 172.21.15.2:0/45527871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616211df0 0x55661620edc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.108+0000 7f59323a1740 1 --2- 172.21.15.2:0/45527871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566162085e0 0x55661622a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.108+0000 7f59323a1740 1 --2- 172.21.15.2:0/45527871 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 0x55661622a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.108+0000 7f59323a1740 1 -- 172.21.15.2:0/45527871 >> 172.21.15.2:0/45527871 conn(0x5566161cffb0 msgr2=0x55661620a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.108+0000 7f59323a1740 1 -- 172.21.15.2:0/45527871 shutdown_connections 2024-06-13T02:19:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.108+0000 7f59323a1740 1 -- 172.21.15.2:0/45527871 wait complete. 2024-06-13T02:19:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.109+0000 7f59323a1740 1 -- start start 2024-06-13T02:19:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.109+0000 7f59323a1740 1 Processor -- start 2024-06-13T02:19:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.109+0000 7f59323a1740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 0x55661621a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.109+0000 7f59323a1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566162085e0 0x55661620ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.109+0000 7f59323a1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616211df0 0x55661620bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.109+0000 7f59323a1740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f59281af700 con 0x556616207070 2024-06-13T02:19:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.109+0000 7f59323a1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f59281b0b70 con 0x5566162085e0 2024-06-13T02:19:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.109+0000 7f59323a1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59281afdd0 con 0x556616211df0 2024-06-13T02:19:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.109+0000 7f59323a1740 10 client.0 _ll_register_callbacks cb 0x7f5920004390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:19:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.110+0000 7f592d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616211df0 0x55661620bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.110+0000 7f592cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 0x55661621a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.110+0000 7f5927e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566162085e0 0x55661620ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.110+0000 7f592d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616211df0 0x55661620bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:49080/0 (socket says 172.21.15.2:49080) 2024-06-13T02:19:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.110+0000 7f592d600640 1 -- 172.21.15.2:0/2318757689 learned_addr learned my addr 172.21.15.2:0/2318757689 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.110+0000 7f592d600640 1 -- 172.21.15.2:0/2318757689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566162085e0 msgr2=0x55661620ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.110+0000 7f592d600640 1 --2- 172.21.15.2:0/2318757689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566162085e0 0x55661620ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.110+0000 7f592d600640 1 -- 172.21.15.2:0/2318757689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 msgr2=0x55661621a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.110+0000 7f592d600640 1 --2- 172.21.15.2:0/2318757689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 0x55661621a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.110+0000 7f592d600640 1 -- 172.21.15.2:0/2318757689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55661620c7b0 con 0x556616211df0 2024-06-13T02:19:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.110+0000 7f5927e00640 1 --2- 172.21.15.2:0/2318757689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566162085e0 0x55661620ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:19:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.110+0000 7f592cc00640 1 --2- 172.21.15.2:0/2318757689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 0x55661621a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:19:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.111+0000 7f592d600640 1 --2- 172.21.15.2:0/2318757689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616211df0 0x55661620bfd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f592000c010 tx=0x7f5920027490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=670d0b93f6b3c6bb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.111+0000 7f590e000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:19:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.111+0000 7f590e000640 1 -- 172.21.15.2:0/2318757689 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5920044060 con 0x556616211df0 2024-06-13T02:19:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.111+0000 7f590e000640 1 -- 172.21.15.2:0/2318757689 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f5920037440 con 0x556616211df0 2024-06-13T02:19:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.111+0000 7f59323a1740 1 -- 172.21.15.2:0/2318757689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556616172ea0 con 0x556616211df0 2024-06-13T02:19:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.112+0000 7f590e000640 1 -- 172.21.15.2:0/2318757689 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f592004b050 con 0x556616211df0 2024-06-13T02:19:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.112+0000 7f59323a1740 10 client.25366 fetch_fsmap learned FSMap version 28 2024-06-13T02:19:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.112+0000 7f59323a1740 1 -- 172.21.15.2:0/2318757689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55661628d0f0 con 0x556616211df0 2024-06-13T02:19:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.112+0000 7f590e000640 1 -- 172.21.15.2:0/2318757689 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x556616172ea0 con 0x556616211df0 2024-06-13T02:19:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.112+0000 7f590e000640 1 -- 172.21.15.2:0/2318757689 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f592003f840 con 0x556616211df0 2024-06-13T02:19:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.112+0000 7f59323a1740 10 client.25366 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:19:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.112+0000 7f59323a1740 10 client.25366 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:19:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.112+0000 7f59323a1740 20 client.25366 populate_metadata read hostname 'smithi002' 2024-06-13T02:19:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.112+0000 7f59323a1740 1 --2- 172.21.15.2:0/2318757689 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55661628d710 0x55661628fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.112+0000 7f59323a1740 4 client.25366 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:19:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.112+0000 7f59323a1740 1 -- 172.21.15.2:0/2318757689 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5566160f07a0 con 0x55661628d710 2024-06-13T02:19:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.112+0000 7f592cc00640 1 --2- 172.21.15.2:0/2318757689 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55661628d710 0x55661628fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.113+0000 7f592cc00640 1 --2- 172.21.15.2:0/2318757689 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55661628d710 0x55661628fb30 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b1a6eaf5c493147 server_cookie=6d463712847da52 in_seq=0 out_seq=0 2024-06-13T02:19:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.113+0000 7f590e000640 10 client.25366 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:27.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:26 smithi084 ceph-mon[36833]: pgmap v51: 129 pgs: 129 active+clean; 35 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 3.1 MiB/s wr, 166 op/s 2024-06-13T02:19:27.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:26 smithi175 ceph-mon[36977]: pgmap v51: 129 pgs: 129 active+clean; 35 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 3.1 MiB/s wr, 166 op/s 2024-06-13T02:19:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.288+0000 7f590e000640 1 -- 172.21.15.2:0/2318757689 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5566160f07a0 con 0x55661628d710 2024-06-13T02:19:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.288+0000 7f590e000640 10 client.25366 handle_command_reply: tid=0 2024-06-13T02:19:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.288+0000 7f59323a1740 1 client.25366 shutdown 2024-06-13T02:19:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.288+0000 7f59323a1740 1 -- 172.21.15.2:0/2318757689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616211df0 msgr2=0x55661620bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.288+0000 7f59323a1740 1 --2- 172.21.15.2:0/2318757689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616211df0 0x55661620bfd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f592000c010 tx=0x7f5920027490 comp rx=0 tx=0).stop 2024-06-13T02:19:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.288+0000 7f59323a1740 1 -- 172.21.15.2:0/2318757689 shutdown_connections 2024-06-13T02:19:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.288+0000 7f59323a1740 1 --2- 172.21.15.2:0/2318757689 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55661628d710 0x55661628fb30 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.288+0000 7f59323a1740 1 --2- 172.21.15.2:0/2318757689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556616211df0 0x55661620bfd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.288+0000 7f59323a1740 1 --2- 172.21.15.2:0/2318757689 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5566162085e0 0x55661620ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.288+0000 7f59323a1740 1 --2- 172.21.15.2:0/2318757689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556616207070 0x55661621a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.288+0000 7f590e000640 0 client.25366 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.288+0000 7f59323a1740 1 -- 172.21.15.2:0/2318757689 >> 172.21.15.2:0/2318757689 conn(0x5566161cffb0 msgr2=0x556616201fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.288+0000 7f59323a1740 1 -- 172.21.15.2:0/2318757689 shutdown_connections 2024-06-13T02:19:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.288+0000 7f59323a1740 1 -- 172.21.15.2:0/2318757689 wait complete. 2024-06-13T02:19:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.288+0000 7f59323a1740 20 client.25366 trim_cache size 0 max 16384 2024-06-13T02:19:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:19:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:19:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:19:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.289+0000 7f592f600640 1 -- 172.21.15.2:0/3749721925 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f59100a2da0 msgr2=0x7f59100a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.289+0000 7f592f600640 1 --2- 172.21.15.2:0/3749721925 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f59100a2da0 0x7f59100a5260 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f592000b710 tx=0x7f592000b2e0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.289+0000 7f592f600640 1 -- 172.21.15.2:0/3749721925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5928102be0 msgr2=0x7f5928100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.289+0000 7f592f600640 1 --2- 172.21.15.2:0/3749721925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5928102be0 0x7f5928100830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f591c005cc0 tx=0x7f591c02f630 comp rx=0 tx=0).stop 2024-06-13T02:19:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.289+0000 7f592f600640 1 -- 172.21.15.2:0/3749721925 shutdown_connections 2024-06-13T02:19:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.289+0000 7f592f600640 1 --2- 172.21.15.2:0/3749721925 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f59100a2da0 0x7f59100a5260 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.289+0000 7f592f600640 1 --2- 172.21.15.2:0/3749721925 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f592810c000 0x7f59281012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.289+0000 7f592f600640 1 --2- 172.21.15.2:0/3749721925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5928103500 0x7f5928100d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.289+0000 7f592f600640 1 --2- 172.21.15.2:0/3749721925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5928102be0 0x7f5928100830 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.289+0000 7f592f600640 1 -- 172.21.15.2:0/3749721925 >> 172.21.15.2:0/3749721925 conn(0x7f59280fc3c0 msgr2=0x7f59280fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.289+0000 7f592f600640 1 -- 172.21.15.2:0/3749721925 shutdown_connections 2024-06-13T02:19:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:27.289+0000 7f592f600640 1 -- 172.21.15.2:0/3749721925 wait complete. 2024-06-13T02:19:27.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:26 smithi002 ceph-mon[31960]: pgmap v51: 129 pgs: 129 active+clean; 35 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 3.1 MiB/s wr, 166 op/s 2024-06-13T02:19:27.469 INFO:tasks.workunit.client.0.smithi002.stdout: 1 29827 5.77 MB/sec warmup 31 sec latency 71.782 ms 2024-06-13T02:19:28.469 INFO:tasks.workunit.client.0.smithi002.stdout: 1 32250 6.02 MB/sec warmup 32 sec latency 10.657 ms 2024-06-13T02:19:29.184 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:28 smithi002 ceph-mon[31960]: pgmap v52: 129 pgs: 129 active+clean; 34 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 2.3 MiB/s wr, 156 op/s 2024-06-13T02:19:29.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:28 smithi084 ceph-mon[36833]: pgmap v52: 129 pgs: 129 active+clean; 34 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 2.3 MiB/s wr, 156 op/s 2024-06-13T02:19:29.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:28 smithi175 ceph-mon[36977]: pgmap v52: 129 pgs: 129 active+clean; 34 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 2.3 MiB/s wr, 156 op/s 2024-06-13T02:19:29.469 INFO:tasks.workunit.client.0.smithi002.stdout: 1 33602 6.01 MB/sec warmup 33 sec latency 25.479 ms 2024-06-13T02:19:30.469 INFO:tasks.workunit.client.0.smithi002.stdout: 1 35772 6.23 MB/sec warmup 34 sec latency 11.597 ms 2024-06-13T02:19:31.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:30 smithi084 ceph-mon[36833]: pgmap v53: 129 pgs: 129 active+clean; 34 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 1.9 MiB/s wr, 150 op/s 2024-06-13T02:19:31.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:30 smithi175 ceph-mon[36977]: pgmap v53: 129 pgs: 129 active+clean; 34 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 1.9 MiB/s wr, 150 op/s 2024-06-13T02:19:31.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:30 smithi002 ceph-mon[31960]: pgmap v53: 129 pgs: 129 active+clean; 34 MiB data, 474 MiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 1.9 MiB/s wr, 150 op/s 2024-06-13T02:19:31.469 INFO:tasks.workunit.client.0.smithi002.stdout: 1 36956 6.21 MB/sec warmup 35 sec latency 15.335 ms 2024-06-13T02:19:32.469 INFO:tasks.workunit.client.0.smithi002.stdout: 1 39255 6.42 MB/sec warmup 36 sec latency 20.608 ms 2024-06-13T02:19:33.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:32 smithi084 ceph-mon[36833]: pgmap v54: 129 pgs: 129 active+clean; 32 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 2.5 MiB/s wr, 308 op/s 2024-06-13T02:19:33.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:32 smithi175 ceph-mon[36977]: pgmap v54: 129 pgs: 129 active+clean; 32 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 2.5 MiB/s wr, 308 op/s 2024-06-13T02:19:33.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:32 smithi002 ceph-mon[31960]: pgmap v54: 129 pgs: 129 active+clean; 32 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 2.5 MiB/s wr, 308 op/s 2024-06-13T02:19:33.469 INFO:tasks.workunit.client.0.smithi002.stdout: 1 40243 6.31 MB/sec warmup 37 sec latency 13.182 ms 2024-06-13T02:19:34.469 INFO:tasks.workunit.client.0.smithi002.stdout: 1 42447 6.47 MB/sec warmup 38 sec latency 11.683 ms 2024-06-13T02:19:35.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:34 smithi084 ceph-mon[36833]: pgmap v55: 129 pgs: 129 active+clean; 32 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 1.1 MiB/s wr, 228 op/s 2024-06-13T02:19:35.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:34 smithi175 ceph-mon[36977]: pgmap v55: 129 pgs: 129 active+clean; 32 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 1.1 MiB/s wr, 228 op/s 2024-06-13T02:19:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:34 smithi002 ceph-mon[31960]: pgmap v55: 129 pgs: 129 active+clean; 32 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 1.1 MiB/s wr, 228 op/s 2024-06-13T02:19:35.469 INFO:tasks.workunit.client.0.smithi002.stdout: 1 43590 6.45 MB/sec warmup 39 sec latency 13.015 ms 2024-06-13T02:19:36.470 INFO:tasks.workunit.client.0.smithi002.stdout: 1 45595 6.58 MB/sec warmup 40 sec latency 12.675 ms 2024-06-13T02:19:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:36 smithi084 ceph-mon[36833]: pgmap v56: 129 pgs: 129 active+clean; 34 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 1.2 MiB/s wr, 244 op/s 2024-06-13T02:19:37.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:36 smithi175 ceph-mon[36977]: pgmap v56: 129 pgs: 129 active+clean; 34 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 1.2 MiB/s wr, 244 op/s 2024-06-13T02:19:37.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:36 smithi002 ceph-mon[31960]: pgmap v56: 129 pgs: 129 active+clean; 34 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 1.2 MiB/s wr, 244 op/s 2024-06-13T02:19:37.470 INFO:tasks.workunit.client.0.smithi002.stdout: 1 46950 6.59 MB/sec warmup 41 sec latency 13.289 ms 2024-06-13T02:19:38.470 INFO:tasks.workunit.client.0.smithi002.stdout: 1 48923 6.68 MB/sec warmup 42 sec latency 27.739 ms 2024-06-13T02:19:39.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:38 smithi084 ceph-mon[36833]: pgmap v57: 129 pgs: 129 active+clean; 37 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 1.1 MiB/s wr, 222 op/s 2024-06-13T02:19:39.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:38 smithi175 ceph-mon[36977]: pgmap v57: 129 pgs: 129 active+clean; 37 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 1.1 MiB/s wr, 222 op/s 2024-06-13T02:19:39.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:38 smithi002 ceph-mon[31960]: pgmap v57: 129 pgs: 129 active+clean; 37 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 1.1 MiB/s wr, 222 op/s 2024-06-13T02:19:39.470 INFO:tasks.workunit.client.0.smithi002.stdout: 1 50428 6.72 MB/sec warmup 43 sec latency 12.933 ms 2024-06-13T02:19:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.450+0000 7fca91c00640 1 -- 172.21.15.2:0/3362005115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c102c40 msgr2=0x7fca8c103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.450+0000 7fca91c00640 1 --2- 172.21.15.2:0/3362005115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c102c40 0x7fca8c103020 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009900 tx=0x7fca7c02a480 comp rx=0 tx=0).stop 2024-06-13T02:19:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.450+0000 7fca91c00640 1 -- 172.21.15.2:0/3362005115 shutdown_connections 2024-06-13T02:19:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.450+0000 7fca91c00640 1 --2- 172.21.15.2:0/3362005115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca8c10c010 0x7fca8c10e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.450+0000 7fca91c00640 1 --2- 172.21.15.2:0/3362005115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca8c103560 0x7fca8c10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.450+0000 7fca91c00640 1 --2- 172.21.15.2:0/3362005115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c102c40 0x7fca8c103020 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.450+0000 7fca91c00640 1 -- 172.21.15.2:0/3362005115 >> 172.21.15.2:0/3362005115 conn(0x7fca8c0fc3c0 msgr2=0x7fca8c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.451+0000 7fca91c00640 1 -- 172.21.15.2:0/3362005115 shutdown_connections 2024-06-13T02:19:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.451+0000 7fca91c00640 1 -- 172.21.15.2:0/3362005115 wait complete. 2024-06-13T02:19:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.452+0000 7fca91c00640 1 Processor -- start 2024-06-13T02:19:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.452+0000 7fca91c00640 1 -- start start 2024-06-13T02:19:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.452+0000 7fca91c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c102c40 0x7fca8c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.452+0000 7fca91c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca8c103560 0x7fca8c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.452+0000 7fca91c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca8c10c010 0x7fca8c19ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.452+0000 7fca91c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c111df0 con 0x7fca8c103560 2024-06-13T02:19:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.452+0000 7fca91c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c111c70 con 0x7fca8c102c40 2024-06-13T02:19:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.452+0000 7fca91c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c111f70 con 0x7fca8c10c010 2024-06-13T02:19:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.453+0000 7fca8b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca8c10c010 0x7fca8c19ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.453+0000 7fca8aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c102c40 0x7fca8c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.453+0000 7fca8b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca8c10c010 0x7fca8c19ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58954/0 (socket says 172.21.15.2:58954) 2024-06-13T02:19:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.453+0000 7fca8b400640 1 -- 172.21.15.2:0/1828984943 learned_addr learned my addr 172.21.15.2:0/1828984943 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.453+0000 7fca8a000640 1 --2- 172.21.15.2:0/1828984943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca8c103560 0x7fca8c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.453+0000 7fca8b400640 1 -- 172.21.15.2:0/1828984943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c102c40 msgr2=0x7fca8c19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.453+0000 7fca8b400640 1 --2- 172.21.15.2:0/1828984943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c102c40 0x7fca8c19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.453+0000 7fca8b400640 1 -- 172.21.15.2:0/1828984943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca8c103560 msgr2=0x7fca8c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.453+0000 7fca8b400640 1 --2- 172.21.15.2:0/1828984943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca8c103560 0x7fca8c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.453+0000 7fca8b400640 1 -- 172.21.15.2:0/1828984943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8c19f4a0 con 0x7fca8c10c010 2024-06-13T02:19:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.453+0000 7fca8aa00640 1 --2- 172.21.15.2:0/1828984943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c102c40 0x7fca8c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:19:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.454+0000 7fca8b400640 1 --2- 172.21.15.2:0/1828984943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca8c10c010 0x7fca8c19ed70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fca8400eaa0 tx=0x7fca8400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.454+0000 7fca83400640 1 -- 172.21.15.2:0/1828984943 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8400cdb0 con 0x7fca8c10c010 2024-06-13T02:19:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.454+0000 7fca83400640 1 -- 172.21.15.2:0/1828984943 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca84005020 con 0x7fca8c10c010 2024-06-13T02:19:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.454+0000 7fca91c00640 1 -- 172.21.15.2:0/1828984943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca8c19f790 con 0x7fca8c10c010 2024-06-13T02:19:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.454+0000 7fca83400640 1 -- 172.21.15.2:0/1828984943 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca840116b0 con 0x7fca8c10c010 2024-06-13T02:19:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.454+0000 7fca91c00640 1 -- 172.21.15.2:0/1828984943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca8c1a7020 con 0x7fca8c10c010 2024-06-13T02:19:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.458+0000 7fca83400640 1 -- 172.21.15.2:0/1828984943 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fca84005560 con 0x7fca8c10c010 2024-06-13T02:19:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.458+0000 7fca94bde740 1 Processor -- start 2024-06-13T02:19:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.458+0000 7fca94bde740 1 -- start start 2024-06-13T02:19:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.458+0000 7fca94bde740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4bdf8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.458+0000 7fca94bde740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4bdf94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.458+0000 7fca94bde740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4be03df0 0x563a4be061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.458+0000 7fca94bde740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563a4bd5d420 con 0x563a4bdf9070 2024-06-13T02:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.458+0000 7fca94bde740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563a4bd04c50 con 0x563a4bdfa5e0 2024-06-13T02:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.458+0000 7fca94bde740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563a4bd593e0 con 0x563a4be03df0 2024-06-13T02:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.459+0000 7fca8aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4bdf94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.459+0000 7fca8aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4bdf94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50146/0 (socket says 172.21.15.2:50146) 2024-06-13T02:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.459+0000 7fca8aa00640 1 -- 172.21.15.2:0/295748023 learned_addr learned my addr 172.21.15.2:0/295748023 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.459+0000 7fca8a000640 1 --2- 172.21.15.2:0/295748023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4bdf8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.459+0000 7fca8a000640 1 --2- 172.21.15.2:0/295748023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4be03df0 0x563a4be061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.459+0000 7fca8aa00640 1 -- 172.21.15.2:0/295748023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4be03df0 msgr2=0x563a4be061e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.459+0000 7fca8aa00640 1 --2- 172.21.15.2:0/295748023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4be03df0 0x563a4be061e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.459+0000 7fca8aa00640 1 -- 172.21.15.2:0/295748023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 msgr2=0x563a4bdf8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.459+0000 7fca8aa00640 1 --2- 172.21.15.2:0/295748023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4bdf8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.459+0000 7fca8aa00640 1 -- 172.21.15.2:0/295748023 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a4ba71210 con 0x563a4bdf9070 2024-06-13T02:19:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.459+0000 7fca8a000640 1 --2- 172.21.15.2:0/295748023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4bdf8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:19:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.460+0000 7fca83400640 1 --2- 172.21.15.2:0/1828984943 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fca700a2d70 0x7fca700a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.460+0000 7fca8aa00640 1 --2- 172.21.15.2:0/295748023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4bdf94f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009900 tx=0x7fca7c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1627c2d0c059ebd server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.460+0000 7fca83400640 1 -- 172.21.15.2:0/1828984943 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fca840cf930 con 0x7fca8c10c010 2024-06-13T02:19:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.460+0000 7fca8a000640 1 --2- 172.21.15.2:0/1828984943 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fca700a2d70 0x7fca700a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.460+0000 7fca77e00640 1 -- 172.21.15.2:0/295748023 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c035040 con 0x563a4bdf9070 2024-06-13T02:19:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.460+0000 7fca77e00640 1 -- 172.21.15.2:0/295748023 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca7c0319f0 con 0x563a4bdf9070 2024-06-13T02:19:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.460+0000 7fca77e00640 1 -- 172.21.15.2:0/295748023 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c004a00 con 0x563a4bdf9070 2024-06-13T02:19:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.461+0000 7fca94bde740 1 -- 172.21.15.2:0/295748023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 msgr2=0x563a4bdf94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:40.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.461+0000 7fca94bde740 1 --2- 172.21.15.2:0/295748023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4bdf94f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009900 tx=0x7fca7c005e80 comp rx=0 tx=0).stop 2024-06-13T02:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.461+0000 7fca8a000640 1 --2- 172.21.15.2:0/1828984943 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fca700a2d70 0x7fca700a5230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x563a4bdf67f0 tx=0x7fca7800b410 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.461+0000 7fca94bde740 1 -- 172.21.15.2:0/295748023 shutdown_connections 2024-06-13T02:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.461+0000 7fca94bde740 1 --2- 172.21.15.2:0/295748023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4be03df0 0x563a4be061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.461+0000 7fca94bde740 1 --2- 172.21.15.2:0/295748023 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4bdf94f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.461+0000 7fca94bde740 1 --2- 172.21.15.2:0/295748023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4bdf8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.461+0000 7fca94bde740 1 -- 172.21.15.2:0/295748023 >> 172.21.15.2:0/295748023 conn(0x563a4bdc1fb0 msgr2=0x563a4bdf5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.461+0000 7fca94bde740 1 -- 172.21.15.2:0/295748023 shutdown_connections 2024-06-13T02:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.461+0000 7fca94bde740 1 -- 172.21.15.2:0/295748023 wait complete. 2024-06-13T02:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.462+0000 7fca94bde740 1 -- start start 2024-06-13T02:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.462+0000 7fca94bde740 1 Processor -- start 2024-06-13T02:19:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca94bde740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4bdf9070 0x563a4be00d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca94bde740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4be01280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca94bde740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4be03df0 0x563a4be017c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca94bde740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563a4be06b60 con 0x563a4be03df0 2024-06-13T02:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca94bde740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563a4bd180b0 con 0x563a4bdfa5e0 2024-06-13T02:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca94bde740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563a4be06ce0 con 0x563a4bdf9070 2024-06-13T02:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca94bde740 10 client.0 _ll_register_callbacks cb 0x563a4bd03f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca8a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4be01280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca8aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4bdf9070 0x563a4be00d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca8a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4be01280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:33182/0 (socket says 172.21.15.2:33182) 2024-06-13T02:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca8aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4bdf9070 0x563a4be00d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58976/0 (socket says 172.21.15.2:58976) 2024-06-13T02:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca8a000640 1 -- 172.21.15.2:0/2401501352 learned_addr learned my addr 172.21.15.2:0/2401501352 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca8b400640 1 --2- 172.21.15.2:0/2401501352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4be03df0 0x563a4be017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca8a000640 1 -- 172.21.15.2:0/2401501352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4bdf9070 msgr2=0x563a4be00d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca8a000640 1 --2- 172.21.15.2:0/2401501352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4bdf9070 0x563a4be00d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca8a000640 1 -- 172.21.15.2:0/2401501352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4be03df0 msgr2=0x563a4be017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca8a000640 1 --2- 172.21.15.2:0/2401501352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4be03df0 0x563a4be017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.463+0000 7fca8a000640 1 -- 172.21.15.2:0/2401501352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a4bb3d620 con 0x563a4bdfa5e0 2024-06-13T02:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.464+0000 7fca8a000640 1 --2- 172.21.15.2:0/2401501352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4be01280 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca7800f780 tx=0x7fca78004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd16803b2c235971 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.464+0000 7fca74c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.464+0000 7fca74c00640 1 -- 172.21.15.2:0/2401501352 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78005220 con 0x563a4bdfa5e0 2024-06-13T02:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.464+0000 7fca74c00640 1 -- 172.21.15.2:0/2401501352 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fca780053c0 con 0x563a4bdfa5e0 2024-06-13T02:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.464+0000 7fca94bde740 1 -- 172.21.15.2:0/2401501352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca7c0319f0 con 0x563a4bdfa5e0 2024-06-13T02:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.464+0000 7fca74c00640 1 -- 172.21.15.2:0/2401501352 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca78031050 con 0x563a4bdfa5e0 2024-06-13T02:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.464+0000 7fca94bde740 10 client.25391 fetch_fsmap learned FSMap version 28 2024-06-13T02:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.464+0000 7fca94bde740 1 -- 172.21.15.2:0/2401501352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563a4be12e50 con 0x563a4bdfa5e0 2024-06-13T02:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.465+0000 7fca74c00640 1 -- 172.21.15.2:0/2401501352 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca7c0319f0 con 0x563a4bdfa5e0 2024-06-13T02:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.465+0000 7fca74c00640 1 -- 172.21.15.2:0/2401501352 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7fca78004b90 con 0x563a4bdfa5e0 2024-06-13T02:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.465+0000 7fca94bde740 10 client.25391 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.465+0000 7fca94bde740 10 client.25391 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.465+0000 7fca94bde740 20 client.25391 populate_metadata read hostname 'smithi002' 2024-06-13T02:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.465+0000 7fca94bde740 1 --2- 172.21.15.2:0/2401501352 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563a4be142c0 0x563a4be16730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.465+0000 7fca94bde740 4 client.25391 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.465+0000 7fca94bde740 1 -- 172.21.15.2:0/2401501352 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a4bd6ab50 con 0x563a4be142c0 2024-06-13T02:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.465+0000 7fca8aa00640 1 --2- 172.21.15.2:0/2401501352 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563a4be142c0 0x563a4be16730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.466+0000 7fca8aa00640 1 --2- 172.21.15.2:0/2401501352 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563a4be142c0 0x563a4be16730 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d178e3d4698b0048 server_cookie=282424a899357eae in_seq=0 out_seq=0 2024-06-13T02:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.466+0000 7fca74c00640 10 client.25391 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.468+0000 7fca74c00640 1 -- 172.21.15.2:0/2401501352 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563a4bd6ab50 con 0x563a4be142c0 2024-06-13T02:19:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.468+0000 7fca74c00640 10 client.25391 handle_command_reply: tid=0 2024-06-13T02:19:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.468+0000 7fca94bde740 1 client.25391 shutdown 2024-06-13T02:19:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.468+0000 7fca94bde740 1 -- 172.21.15.2:0/2401501352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 msgr2=0x563a4be01280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.468+0000 7fca94bde740 1 --2- 172.21.15.2:0/2401501352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4be01280 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca7800f780 tx=0x7fca78004730 comp rx=0 tx=0).stop 2024-06-13T02:19:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.468+0000 7fca94bde740 1 -- 172.21.15.2:0/2401501352 shutdown_connections 2024-06-13T02:19:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.468+0000 7fca94bde740 1 --2- 172.21.15.2:0/2401501352 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563a4be142c0 0x563a4be16730 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.468+0000 7fca94bde740 1 --2- 172.21.15.2:0/2401501352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4be03df0 0x563a4be017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.468+0000 7fca94bde740 1 --2- 172.21.15.2:0/2401501352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4be01280 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.468+0000 7fca94bde740 1 --2- 172.21.15.2:0/2401501352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4bdf9070 0x563a4be00d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.468+0000 7fca94bde740 1 -- 172.21.15.2:0/2401501352 >> 172.21.15.2:0/2401501352 conn(0x563a4bdc1fb0 msgr2=0x563a4bdfb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.468+0000 7fca74c00640 0 client.25391 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.468+0000 7fca94bde740 1 -- 172.21.15.2:0/2401501352 shutdown_connections 2024-06-13T02:19:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.468+0000 7fca94bde740 1 -- 172.21.15.2:0/2401501352 wait complete. 2024-06-13T02:19:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.468+0000 7fca94bde740 20 client.25391 trim_cache size 0 max 16384 2024-06-13T02:19:40.474 INFO:tasks.workunit.client.0.smithi002.stdout: 1 52248 6.74 MB/sec warmup 44 sec latency 22.346 ms 2024-06-13T02:19:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.487+0000 7fca94bde740 1 Processor -- start 2024-06-13T02:19:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.488+0000 7fca94bde740 1 -- start start 2024-06-13T02:19:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.488+0000 7fca94bde740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4be051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.488+0000 7fca94bde740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4bdfa5e0 0x563a4be05720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.488+0000 7fca94bde740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4be03df0 0x563a4bdfabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.488+0000 7fca94bde740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c1b3a90 con 0x563a4bdf9070 2024-06-13T02:19:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.488+0000 7fca94bde740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c1b1360 con 0x563a4be03df0 2024-06-13T02:19:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.488+0000 7fca94bde740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c1af1b0 con 0x563a4bdfa5e0 2024-06-13T02:19:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.488+0000 7fca8aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4be051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.488+0000 7fca8a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4bdfa5e0 0x563a4be05720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.488+0000 7fca8aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4be051e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50170/0 (socket says 172.21.15.2:50170) 2024-06-13T02:19:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.488+0000 7fca8aa00640 1 -- 172.21.15.2:0/2614043162 learned_addr learned my addr 172.21.15.2:0/2614043162 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.488+0000 7fca8b400640 1 --2- 172.21.15.2:0/2614043162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4be03df0 0x563a4bdfabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.489+0000 7fca8a000640 1 -- 172.21.15.2:0/2614043162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4be03df0 msgr2=0x563a4bdfabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.489+0000 7fca8a000640 1 --2- 172.21.15.2:0/2614043162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4be03df0 0x563a4bdfabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.489+0000 7fca8a000640 1 -- 172.21.15.2:0/2614043162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 msgr2=0x563a4be051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.489+0000 7fca8a000640 1 --2- 172.21.15.2:0/2614043162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4be051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.489+0000 7fca8a000640 1 -- 172.21.15.2:0/2614043162 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a4bdf1020 con 0x563a4bdfa5e0 2024-06-13T02:19:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.489+0000 7fca8aa00640 1 --2- 172.21.15.2:0/2614043162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4be051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:19:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.489+0000 7fca8a000640 1 --2- 172.21.15.2:0/2614043162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4bdfa5e0 0x563a4be05720 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fca78005d00 tx=0x7fca7800b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7bc0672d3aa867e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.489+0000 7fca77400640 1 -- 172.21.15.2:0/2614043162 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca780049a0 con 0x563a4bdfa5e0 2024-06-13T02:19:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.489+0000 7fca77400640 1 -- 172.21.15.2:0/2614043162 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca78010ca0 con 0x563a4bdfa5e0 2024-06-13T02:19:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.489+0000 7fca77400640 1 -- 172.21.15.2:0/2614043162 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78022c80 con 0x563a4bdfa5e0 2024-06-13T02:19:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.490+0000 7fca94bde740 1 -- 172.21.15.2:0/2614043162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4bdfa5e0 msgr2=0x563a4be05720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.490+0000 7fca94bde740 1 --2- 172.21.15.2:0/2614043162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4bdfa5e0 0x563a4be05720 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fca78005d00 tx=0x7fca7800b990 comp rx=0 tx=0).stop 2024-06-13T02:19:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.490+0000 7fca94bde740 1 -- 172.21.15.2:0/2614043162 shutdown_connections 2024-06-13T02:19:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.490+0000 7fca94bde740 1 --2- 172.21.15.2:0/2614043162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4be03df0 0x563a4bdfabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.490+0000 7fca94bde740 1 --2- 172.21.15.2:0/2614043162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4bdfa5e0 0x563a4be05720 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.490+0000 7fca94bde740 1 --2- 172.21.15.2:0/2614043162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4be051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.490+0000 7fca94bde740 1 -- 172.21.15.2:0/2614043162 >> 172.21.15.2:0/2614043162 conn(0x563a4bdc1fb0 msgr2=0x563a4bdfc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.490+0000 7fca94bde740 1 -- 172.21.15.2:0/2614043162 shutdown_connections 2024-06-13T02:19:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.490+0000 7fca94bde740 1 -- 172.21.15.2:0/2614043162 wait complete. 2024-06-13T02:19:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.491+0000 7fca94bde740 1 -- start start 2024-06-13T02:19:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.491+0000 7fca94bde740 1 Processor -- start 2024-06-13T02:19:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca94bde740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4be0c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca94bde740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4be1bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca94bde740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4be03df0 0x563a4be1c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca94bde740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c1af820 con 0x563a4bdf9070 2024-06-13T02:19:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca94bde740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c1b0c90 con 0x563a4bdfa5e0 2024-06-13T02:19:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca94bde740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c1afef0 con 0x563a4be03df0 2024-06-13T02:19:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca94bde740 10 client.0 _ll_register_callbacks cb 0x7fca7800be40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:19:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca8aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4be0c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca8a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4be1bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca8a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4be1bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:33196/0 (socket says 172.21.15.2:33196) 2024-06-13T02:19:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca8a000640 1 -- 172.21.15.2:0/3505363663 learned_addr learned my addr 172.21.15.2:0/3505363663 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca8b400640 1 --2- 172.21.15.2:0/3505363663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4be03df0 0x563a4be1c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca8aa00640 1 -- 172.21.15.2:0/3505363663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4be03df0 msgr2=0x563a4be1c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca8aa00640 1 --2- 172.21.15.2:0/3505363663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4be03df0 0x563a4be1c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca8aa00640 1 -- 172.21.15.2:0/3505363663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 msgr2=0x563a4be1bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca8aa00640 1 --2- 172.21.15.2:0/3505363663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4be1bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca8aa00640 1 -- 172.21.15.2:0/3505363663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a4be0a2d0 con 0x563a4bdf9070 2024-06-13T02:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca8a000640 1 --2- 172.21.15.2:0/3505363663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4be1bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.492+0000 7fca8b400640 1 --2- 172.21.15.2:0/3505363663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4be03df0 0x563a4be1c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.493+0000 7fca8aa00640 1 --2- 172.21.15.2:0/3505363663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4be0c7c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca7c02a9a0 tx=0x7fca7c005560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b38425b48386eef server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.493+0000 7fca74c00640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.493+0000 7fca74c00640 1 -- 172.21.15.2:0/3505363663 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c057020 con 0x563a4bdf9070 2024-06-13T02:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.493+0000 7fca74c00640 1 -- 172.21.15.2:0/3505363663 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fca7c004240 con 0x563a4bdf9070 2024-06-13T02:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.493+0000 7fca94bde740 1 -- 172.21.15.2:0/3505363663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca78010ca0 con 0x563a4bdf9070 2024-06-13T02:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.493+0000 7fca74c00640 1 -- 172.21.15.2:0/3505363663 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fca7c062050 con 0x563a4bdf9070 2024-06-13T02:19:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.493+0000 7fca94bde740 10 client.15264 fetch_fsmap learned FSMap version 28 2024-06-13T02:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.493+0000 7fca94bde740 1 -- 172.21.15.2:0/3505363663 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563a4be7f190 con 0x563a4bdf9070 2024-06-13T02:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.494+0000 7fca74c00640 1 -- 172.21.15.2:0/3505363663 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca78010ca0 con 0x563a4bdf9070 2024-06-13T02:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.494+0000 7fca74c00640 1 -- 172.21.15.2:0/3505363663 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7fca7c052440 con 0x563a4bdf9070 2024-06-13T02:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.494+0000 7fca94bde740 10 client.15264 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.494+0000 7fca94bde740 10 client.15264 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.494+0000 7fca94bde740 20 client.15264 populate_metadata read hostname 'smithi002' 2024-06-13T02:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.494+0000 7fca94bde740 1 --2- 172.21.15.2:0/3505363663 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563a4be7f590 0x563a4be81980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.494+0000 7fca94bde740 4 client.15264 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.494+0000 7fca94bde740 1 -- 172.21.15.2:0/3505363663 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563a4bd64ea0 con 0x563a4be7f590 2024-06-13T02:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.494+0000 7fca8a000640 1 --2- 172.21.15.2:0/3505363663 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563a4be7f590 0x563a4be81980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.495+0000 7fca8a000640 1 --2- 172.21.15.2:0/3505363663 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563a4be7f590 0x563a4be81980 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55c0c620ef1d8719 server_cookie=d8641368c2dfc5ce in_seq=0 out_seq=0 2024-06-13T02:19:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.495+0000 7fca74c00640 10 client.15264 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:40.701 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.699+0000 7fca74c00640 1 -- 172.21.15.2:0/3505363663 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x563a4bd64ea0 con 0x563a4be7f590 2024-06-13T02:19:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.699+0000 7fca74c00640 10 client.15264 handle_command_reply: tid=0 2024-06-13T02:19:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.699+0000 7fca94bde740 1 client.15264 shutdown 2024-06-13T02:19:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.700+0000 7fca94bde740 1 -- 172.21.15.2:0/3505363663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 msgr2=0x563a4be0c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.700+0000 7fca94bde740 1 --2- 172.21.15.2:0/3505363663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4be0c7c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca7c02a9a0 tx=0x7fca7c005560 comp rx=0 tx=0).stop 2024-06-13T02:19:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.700+0000 7fca94bde740 1 -- 172.21.15.2:0/3505363663 shutdown_connections 2024-06-13T02:19:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.700+0000 7fca94bde740 1 --2- 172.21.15.2:0/3505363663 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563a4be7f590 0x563a4be81980 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.700+0000 7fca94bde740 1 --2- 172.21.15.2:0/3505363663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a4be03df0 0x563a4be1c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.700+0000 7fca94bde740 1 --2- 172.21.15.2:0/3505363663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563a4bdfa5e0 0x563a4be1bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.700+0000 7fca74c00640 0 client.15264 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.700+0000 7fca94bde740 1 --2- 172.21.15.2:0/3505363663 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563a4bdf9070 0x563a4be0c7c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.700+0000 7fca94bde740 1 -- 172.21.15.2:0/3505363663 >> 172.21.15.2:0/3505363663 conn(0x563a4bdc1fb0 msgr2=0x563a4bdf3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.700+0000 7fca94bde740 1 -- 172.21.15.2:0/3505363663 shutdown_connections 2024-06-13T02:19:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.700+0000 7fca94bde740 1 -- 172.21.15.2:0/3505363663 wait complete. 2024-06-13T02:19:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.700+0000 7fca94bde740 20 client.15264 trim_cache size 0 max 16384 2024-06-13T02:19:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:19:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:19:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:19:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.701+0000 7fca91c00640 1 -- 172.21.15.2:0/1828984943 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fca700a2d70 msgr2=0x7fca700a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.701+0000 7fca91c00640 1 --2- 172.21.15.2:0/1828984943 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fca700a2d70 0x7fca700a5230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x563a4bdf67f0 tx=0x7fca7800b410 comp rx=0 tx=0).stop 2024-06-13T02:19:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.701+0000 7fca91c00640 1 -- 172.21.15.2:0/1828984943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca8c10c010 msgr2=0x7fca8c19ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.701+0000 7fca91c00640 1 --2- 172.21.15.2:0/1828984943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca8c10c010 0x7fca8c19ed70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fca8400eaa0 tx=0x7fca8400ef60 comp rx=0 tx=0).stop 2024-06-13T02:19:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.701+0000 7fca91c00640 1 -- 172.21.15.2:0/1828984943 shutdown_connections 2024-06-13T02:19:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.701+0000 7fca91c00640 1 --2- 172.21.15.2:0/1828984943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca8c10c010 0x7fca8c19ed70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.701+0000 7fca91c00640 1 --2- 172.21.15.2:0/1828984943 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fca700a2d70 0x7fca700a5230 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.701+0000 7fca91c00640 1 --2- 172.21.15.2:0/1828984943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fca8c103560 0x7fca8c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.701+0000 7fca91c00640 1 --2- 172.21.15.2:0/1828984943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca8c102c40 0x7fca8c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.701+0000 7fca91c00640 1 -- 172.21.15.2:0/1828984943 >> 172.21.15.2:0/1828984943 conn(0x7fca8c0fc3c0 msgr2=0x7fca8c1007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.701+0000 7fca91c00640 1 -- 172.21.15.2:0/1828984943 shutdown_connections 2024-06-13T02:19:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:40.701+0000 7fca91c00640 1 -- 172.21.15.2:0/1828984943 wait complete. 2024-06-13T02:19:41.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:40 smithi084 ceph-mon[36833]: pgmap v58: 129 pgs: 129 active+clean; 37 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 1.0 MiB/s wr, 215 op/s 2024-06-13T02:19:41.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:40 smithi175 ceph-mon[36977]: pgmap v58: 129 pgs: 129 active+clean; 37 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 1.0 MiB/s wr, 215 op/s 2024-06-13T02:19:41.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:40 smithi002 ceph-mon[31960]: pgmap v58: 129 pgs: 129 active+clean; 37 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 1.0 MiB/s wr, 215 op/s 2024-06-13T02:19:41.470 INFO:tasks.workunit.client.0.smithi002.stdout: 1 53700 6.84 MB/sec warmup 45 sec latency 119.320 ms 2024-06-13T02:19:42.470 INFO:tasks.workunit.client.0.smithi002.stdout: 1 55242 6.81 MB/sec warmup 46 sec latency 21.962 ms 2024-06-13T02:19:43.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:42 smithi084 ceph-mon[36833]: pgmap v59: 129 pgs: 129 active+clean; 41 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 1.5 MiB/s wr, 358 op/s 2024-06-13T02:19:43.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:42 smithi175 ceph-mon[36977]: pgmap v59: 129 pgs: 129 active+clean; 41 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 1.5 MiB/s wr, 358 op/s 2024-06-13T02:19:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:42 smithi002 ceph-mon[31960]: pgmap v59: 129 pgs: 129 active+clean; 41 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 1.5 MiB/s wr, 358 op/s 2024-06-13T02:19:43.470 INFO:tasks.workunit.client.0.smithi002.stdout: 1 57151 6.95 MB/sec warmup 47 sec latency 13.251 ms 2024-06-13T02:19:44.471 INFO:tasks.workunit.client.0.smithi002.stdout: 1 58299 6.92 MB/sec warmup 48 sec latency 13.010 ms 2024-06-13T02:19:45.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:44 smithi084 ceph-mon[36833]: pgmap v60: 129 pgs: 129 active+clean; 41 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 947 KiB/s wr, 200 op/s 2024-06-13T02:19:45.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:44 smithi175 ceph-mon[36977]: pgmap v60: 129 pgs: 129 active+clean; 41 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 947 KiB/s wr, 200 op/s 2024-06-13T02:19:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:44 smithi002 ceph-mon[31960]: pgmap v60: 129 pgs: 129 active+clean; 41 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 947 KiB/s wr, 200 op/s 2024-06-13T02:19:45.471 INFO:tasks.workunit.client.0.smithi002.stdout: 1 60313 7.03 MB/sec warmup 49 sec latency 11.833 ms 2024-06-13T02:19:46.471 INFO:tasks.workunit.client.0.smithi002.stdout: 1 61243 6.93 MB/sec warmup 50 sec latency 19.525 ms 2024-06-13T02:19:47.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:46 smithi084 ceph-mon[36833]: pgmap v61: 129 pgs: 129 active+clean; 40 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 1.2 MiB/s wr, 265 op/s 2024-06-13T02:19:47.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:46 smithi175 ceph-mon[36977]: pgmap v61: 129 pgs: 129 active+clean; 40 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 1.2 MiB/s wr, 265 op/s 2024-06-13T02:19:47.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:46 smithi002 ceph-mon[31960]: pgmap v61: 129 pgs: 129 active+clean; 40 MiB data, 510 MiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 1.2 MiB/s wr, 265 op/s 2024-06-13T02:19:47.471 INFO:tasks.workunit.client.0.smithi002.stdout: 1 62937 6.94 MB/sec warmup 51 sec latency 13.074 ms 2024-06-13T02:19:48.471 INFO:tasks.workunit.client.0.smithi002.stdout: 1 64187 7.02 MB/sec warmup 52 sec latency 110.623 ms 2024-06-13T02:19:49.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:48 smithi084 ceph-mon[36833]: pgmap v62: 129 pgs: 129 active+clean; 37 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 1.2 MiB/s wr, 282 op/s 2024-06-13T02:19:49.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:48 smithi175 ceph-mon[36977]: pgmap v62: 129 pgs: 129 active+clean; 37 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 1.2 MiB/s wr, 282 op/s 2024-06-13T02:19:49.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:48 smithi002 ceph-mon[31960]: pgmap v62: 129 pgs: 129 active+clean; 37 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 1.2 MiB/s wr, 282 op/s 2024-06-13T02:19:49.471 INFO:tasks.workunit.client.0.smithi002.stdout: 1 65333 6.98 MB/sec warmup 53 sec latency 40.031 ms 2024-06-13T02:19:50.471 INFO:tasks.workunit.client.0.smithi002.stdout: 1 67361 7.08 MB/sec warmup 54 sec latency 15.108 ms 2024-06-13T02:19:51.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:50 smithi084 ceph-mon[36833]: pgmap v63: 129 pgs: 129 active+clean; 37 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 883 KiB/s wr, 240 op/s 2024-06-13T02:19:51.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:50 smithi175 ceph-mon[36977]: pgmap v63: 129 pgs: 129 active+clean; 37 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 883 KiB/s wr, 240 op/s 2024-06-13T02:19:51.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:50 smithi002 ceph-mon[31960]: pgmap v63: 129 pgs: 129 active+clean; 37 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 883 KiB/s wr, 240 op/s 2024-06-13T02:19:51.471 INFO:tasks.workunit.client.0.smithi002.stdout: 1 68344 7.00 MB/sec warmup 55 sec latency 18.887 ms 2024-06-13T02:19:52.471 INFO:tasks.workunit.client.0.smithi002.stdout: 1 70738 7.12 MB/sec warmup 56 sec latency 9.203 ms 2024-06-13T02:19:53.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:52 smithi084 ceph-mon[36833]: pgmap v64: 129 pgs: 129 active+clean; 38 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 348 op/s 2024-06-13T02:19:53.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:52 smithi175 ceph-mon[36977]: pgmap v64: 129 pgs: 129 active+clean; 38 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 348 op/s 2024-06-13T02:19:53.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:52 smithi002 ceph-mon[31960]: pgmap v64: 129 pgs: 129 active+clean; 38 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 348 op/s 2024-06-13T02:19:53.473 INFO:tasks.workunit.client.0.smithi002.stdout: 1 71524 7.08 MB/sec warmup 57 sec latency 97.991 ms 2024-06-13T02:19:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.905+0000 7fee67400640 1 -- 172.21.15.2:0/507525326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee60108f00 msgr2=0x7fee60110ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:53.907 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.905+0000 7fee67400640 1 --2- 172.21.15.2:0/507525326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee60108f00 0x7fee60110ad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fee58009ca0 tx=0x7fee5802a8b0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.905+0000 7fee67400640 1 -- 172.21.15.2:0/507525326 shutdown_connections 2024-06-13T02:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.905+0000 7fee67400640 1 --2- 172.21.15.2:0/507525326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee60108f00 0x7fee60110ad0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.905+0000 7fee67400640 1 --2- 172.21.15.2:0/507525326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee601047e0 0x7fee60108820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.905+0000 7fee67400640 1 --2- 172.21.15.2:0/507525326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee60103e30 0x7fee60104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.905+0000 7fee67400640 1 -- 172.21.15.2:0/507525326 >> 172.21.15.2:0/507525326 conn(0x7fee600ff650 msgr2=0x7fee60101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.906+0000 7fee67400640 1 -- 172.21.15.2:0/507525326 shutdown_connections 2024-06-13T02:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.906+0000 7fee67400640 1 -- 172.21.15.2:0/507525326 wait complete. 2024-06-13T02:19:53.908 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.907+0000 7fee67400640 1 Processor -- start 2024-06-13T02:19:53.909 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.907+0000 7fee67400640 1 -- start start 2024-06-13T02:19:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.908+0000 7fee67400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee60103e30 0x7fee60110990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.911 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.908+0000 7fee67400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee60108f00 0x7fee6010da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.908+0000 7fee67400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6010df70 0x7fee6010e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.908+0000 7fee67400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee60113fb0 con 0x7fee60108f00 2024-06-13T02:19:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.908+0000 7fee67400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fee60113e30 con 0x7fee6010df70 2024-06-13T02:19:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.908+0000 7fee67400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fee60114130 con 0x7fee60103e30 2024-06-13T02:19:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.908+0000 7fee64a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee60103e30 0x7fee60110990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.908+0000 7fee65400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6010df70 0x7fee6010e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.908+0000 7fee64a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee60103e30 0x7fee60110990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58910/0 (socket says 172.21.15.2:58910) 2024-06-13T02:19:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.908+0000 7fee65400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6010df70 0x7fee6010e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:33364/0 (socket says 172.21.15.2:33364) 2024-06-13T02:19:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.908+0000 7fee64a00640 1 -- 172.21.15.2:0/301269287 learned_addr learned my addr 172.21.15.2:0/301269287 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.908+0000 7fee5fe00640 1 --2- 172.21.15.2:0/301269287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee60108f00 0x7fee6010da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.909+0000 7fee64a00640 1 -- 172.21.15.2:0/301269287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6010df70 msgr2=0x7fee6010e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.909+0000 7fee64a00640 1 --2- 172.21.15.2:0/301269287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6010df70 0x7fee6010e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.909+0000 7fee64a00640 1 -- 172.21.15.2:0/301269287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee60108f00 msgr2=0x7fee6010da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.909+0000 7fee64a00640 1 --2- 172.21.15.2:0/301269287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee60108f00 0x7fee6010da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.909+0000 7fee64a00640 1 -- 172.21.15.2:0/301269287 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee601aaee0 con 0x7fee60103e30 2024-06-13T02:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.909+0000 7fee65400640 1 --2- 172.21.15.2:0/301269287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6010df70 0x7fee6010e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.910+0000 7fee64a00640 1 --2- 172.21.15.2:0/301269287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee60103e30 0x7fee60110990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fee5401fa00 tx=0x7fee5401fec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.910+0000 7fee5d600640 1 -- 172.21.15.2:0/301269287 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5400cd80 con 0x7fee60103e30 2024-06-13T02:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.910+0000 7fee5d600640 1 -- 172.21.15.2:0/301269287 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee54021920 con 0x7fee60103e30 2024-06-13T02:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.910+0000 7fee5d600640 1 -- 172.21.15.2:0/301269287 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee54029980 con 0x7fee60103e30 2024-06-13T02:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.910+0000 7fee67400640 1 -- 172.21.15.2:0/301269287 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee601994c0 con 0x7fee60103e30 2024-06-13T02:19:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.910+0000 7fee67400640 1 -- 172.21.15.2:0/301269287 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee60199900 con 0x7fee60103e30 2024-06-13T02:19:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.914+0000 7fee5d600640 1 -- 172.21.15.2:0/301269287 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fee54029b20 con 0x7fee60103e30 2024-06-13T02:19:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.918+0000 7fee5d600640 1 --2- 172.21.15.2:0/301269287 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fee480a2da0 0x7fee480a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.918+0000 7fee5d600640 1 -- 172.21.15.2:0/301269287 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fee540e0ca0 con 0x7fee60103e30 2024-06-13T02:19:53.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.919+0000 7fee5fe00640 1 --2- 172.21.15.2:0/301269287 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fee480a2da0 0x7fee480a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.921+0000 7fee5fe00640 1 --2- 172.21.15.2:0/301269287 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fee480a2da0 0x7fee480a5260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fee6010f1f0 tx=0x7fee4c00b4f0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:53.922 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.921+0000 7fee6a380740 1 Processor -- start 2024-06-13T02:19:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.923+0000 7fee6a380740 1 -- start start 2024-06-13T02:19:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.924+0000 7fee6a380740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83c5e0 0x55724a83ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.924+0000 7fee6a380740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a83b070 0x55724a83b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.925 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.924+0000 7fee6a380740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a845df0 0x55724a8481e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.924+0000 7fee6a380740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55724a79f420 con 0x55724a83c5e0 2024-06-13T02:19:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.924+0000 7fee6a380740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55724a746c50 con 0x55724a845df0 2024-06-13T02:19:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.924+0000 7fee6a380740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55724a79b3e0 con 0x55724a83b070 2024-06-13T02:19:53.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.924+0000 7fee5fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a83b070 0x55724a83b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.924+0000 7fee5fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a83b070 0x55724a83b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58916/0 (socket says 172.21.15.2:58916) 2024-06-13T02:19:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.924+0000 7fee5fe00640 1 -- 172.21.15.2:0/840567635 learned_addr learned my addr 172.21.15.2:0/840567635 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.925+0000 7fee65400640 1 --2- 172.21.15.2:0/840567635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a845df0 0x55724a8481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.925+0000 7fee5fe00640 1 -- 172.21.15.2:0/840567635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a845df0 msgr2=0x55724a8481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.925+0000 7fee5fe00640 1 --2- 172.21.15.2:0/840567635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a845df0 0x55724a8481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.925+0000 7fee5fe00640 1 -- 172.21.15.2:0/840567635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83c5e0 msgr2=0x55724a83ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.925+0000 7fee5fe00640 1 --2- 172.21.15.2:0/840567635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83c5e0 0x55724a83ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.925+0000 7fee5fe00640 1 -- 172.21.15.2:0/840567635 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55724a4b3210 con 0x55724a83b070 2024-06-13T02:19:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.925+0000 7fee5fe00640 1 --2- 172.21.15.2:0/840567635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a83b070 0x55724a83b4f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00fd90 tx=0x7fee4c012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe8bd6ef236c86f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.926+0000 7fee51c00640 1 -- 172.21.15.2:0/840567635 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c022070 con 0x55724a83b070 2024-06-13T02:19:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.926+0000 7fee51c00640 1 -- 172.21.15.2:0/840567635 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee4c01e930 con 0x55724a83b070 2024-06-13T02:19:53.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.926+0000 7fee51c00640 1 -- 172.21.15.2:0/840567635 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c010910 con 0x55724a83b070 2024-06-13T02:19:53.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.927+0000 7fee6a380740 1 -- 172.21.15.2:0/840567635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a83b070 msgr2=0x55724a83b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:53.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.927+0000 7fee6a380740 1 --2- 172.21.15.2:0/840567635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a83b070 0x55724a83b4f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00fd90 tx=0x7fee4c012000 comp rx=0 tx=0).stop 2024-06-13T02:19:53.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.928+0000 7fee6a380740 1 -- 172.21.15.2:0/840567635 shutdown_connections 2024-06-13T02:19:53.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.928+0000 7fee6a380740 1 --2- 172.21.15.2:0/840567635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a845df0 0x55724a8481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.928+0000 7fee6a380740 1 --2- 172.21.15.2:0/840567635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a83b070 0x55724a83b4f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.928+0000 7fee6a380740 1 --2- 172.21.15.2:0/840567635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83c5e0 0x55724a83ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.928+0000 7fee6a380740 1 -- 172.21.15.2:0/840567635 >> 172.21.15.2:0/840567635 conn(0x55724a803fb0 msgr2=0x55724a837660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:53.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.928+0000 7fee6a380740 1 -- 172.21.15.2:0/840567635 shutdown_connections 2024-06-13T02:19:53.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.928+0000 7fee6a380740 1 -- 172.21.15.2:0/840567635 wait complete. 2024-06-13T02:19:53.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.929+0000 7fee6a380740 1 -- start start 2024-06-13T02:19:53.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.929+0000 7fee6a380740 1 Processor -- start 2024-06-13T02:19:53.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.930+0000 7fee6a380740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a83b070 0x55724a842ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.930+0000 7fee6a380740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83c5e0 0x55724a843430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.930+0000 7fee6a380740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a845df0 0x55724a843970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.932 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.930+0000 7fee65400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a845df0 0x55724a843970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.932 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.930+0000 7fee65400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a845df0 0x55724a843970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:33382/0 (socket says 172.21.15.2:33382) 2024-06-13T02:19:53.932 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.930+0000 7fee65400640 1 -- 172.21.15.2:0/4113047016 learned_addr learned my addr 172.21.15.2:0/4113047016 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:53.933 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.930+0000 7fee6a380740 1 -- 172.21.15.2:0/4113047016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55724a848bc0 con 0x55724a83c5e0 2024-06-13T02:19:53.933 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.930+0000 7fee6a380740 1 -- 172.21.15.2:0/4113047016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55724a75a0b0 con 0x55724a845df0 2024-06-13T02:19:53.933 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.930+0000 7fee6a380740 1 -- 172.21.15.2:0/4113047016 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55724a848d40 con 0x55724a83b070 2024-06-13T02:19:53.933 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.930+0000 7fee64a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a83b070 0x55724a842ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.933 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.930+0000 7fee6a380740 10 client.0 _ll_register_callbacks cb 0x55724a745f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:19:53.933 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.931+0000 7fee5fe00640 1 --2- 172.21.15.2:0/4113047016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83c5e0 0x55724a843430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.934 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.931+0000 7fee65400640 1 -- 172.21.15.2:0/4113047016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a83b070 msgr2=0x55724a842ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:53.934 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.931+0000 7fee65400640 1 --2- 172.21.15.2:0/4113047016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a83b070 0x55724a842ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.934 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.931+0000 7fee65400640 1 -- 172.21.15.2:0/4113047016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83c5e0 msgr2=0x55724a843430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:53.934 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.931+0000 7fee65400640 1 --2- 172.21.15.2:0/4113047016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83c5e0 0x55724a843430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.934 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.931+0000 7fee65400640 1 -- 172.21.15.2:0/4113047016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55724a57f620 con 0x55724a845df0 2024-06-13T02:19:53.934 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.932+0000 7fee65400640 1 --2- 172.21.15.2:0/4113047016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a845df0 0x55724a843970 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fee58035000 tx=0x7fee58009a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=907c63c16b04c42 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:53.934 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.932+0000 7fee46000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:19:53.934 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.932+0000 7fee46000640 1 -- 172.21.15.2:0/4113047016 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58030750 con 0x55724a845df0 2024-06-13T02:19:53.934 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.932+0000 7fee6a380740 1 -- 172.21.15.2:0/4113047016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee4c01e930 con 0x55724a845df0 2024-06-13T02:19:53.934 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.932+0000 7fee46000640 1 -- 172.21.15.2:0/4113047016 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fee58003b80 con 0x55724a845df0 2024-06-13T02:19:53.935 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.932+0000 7fee46000640 1 -- 172.21.15.2:0/4113047016 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fee58003d80 con 0x55724a845df0 2024-06-13T02:19:53.935 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.932+0000 7fee6a380740 10 client.25409 fetch_fsmap learned FSMap version 28 2024-06-13T02:19:53.935 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.932+0000 7fee6a380740 1 -- 172.21.15.2:0/4113047016 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55724a855070 con 0x55724a845df0 2024-06-13T02:19:53.935 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.933+0000 7fee46000640 1 -- 172.21.15.2:0/4113047016 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee4c01e930 con 0x55724a845df0 2024-06-13T02:19:53.935 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.933+0000 7fee46000640 1 -- 172.21.15.2:0/4113047016 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7fee58005020 con 0x55724a845df0 2024-06-13T02:19:53.935 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.933+0000 7fee6a380740 10 client.25409 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:19:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.933+0000 7fee6a380740 10 client.25409 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:19:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.933+0000 7fee6a380740 20 client.25409 populate_metadata read hostname 'smithi002' 2024-06-13T02:19:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.933+0000 7fee6a380740 1 --2- 172.21.15.2:0/4113047016 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55724a8565a0 0x55724a858990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.933+0000 7fee6a380740 4 client.25409 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:19:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.933+0000 7fee6a380740 1 -- 172.21.15.2:0/4113047016 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55724a7acb50 con 0x55724a8565a0 2024-06-13T02:19:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.934+0000 7fee64a00640 1 --2- 172.21.15.2:0/4113047016 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55724a8565a0 0x55724a858990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.936+0000 7fee64a00640 1 --2- 172.21.15.2:0/4113047016 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55724a8565a0 0x55724a858990 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c29bbdd1f32a6b2a server_cookie=b105f215b69bbd7c in_seq=0 out_seq=0 2024-06-13T02:19:53.936 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.936+0000 7fee46000640 10 client.25409 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.936+0000 7fee46000640 1 -- 172.21.15.2:0/4113047016 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55724a7acb50 con 0x55724a8565a0 2024-06-13T02:19:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.936+0000 7fee46000640 10 client.25409 handle_command_reply: tid=0 2024-06-13T02:19:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.936+0000 7fee6a380740 1 client.25409 shutdown 2024-06-13T02:19:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.937+0000 7fee6a380740 1 -- 172.21.15.2:0/4113047016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a845df0 msgr2=0x55724a843970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:53.938 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.937+0000 7fee6a380740 1 --2- 172.21.15.2:0/4113047016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a845df0 0x55724a843970 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fee58035000 tx=0x7fee58009a10 comp rx=0 tx=0).stop 2024-06-13T02:19:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.937+0000 7fee6a380740 1 -- 172.21.15.2:0/4113047016 shutdown_connections 2024-06-13T02:19:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.937+0000 7fee6a380740 1 --2- 172.21.15.2:0/4113047016 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55724a8565a0 0x55724a858990 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.937+0000 7fee6a380740 1 --2- 172.21.15.2:0/4113047016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a845df0 0x55724a843970 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.937+0000 7fee6a380740 1 --2- 172.21.15.2:0/4113047016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83c5e0 0x55724a843430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.937+0000 7fee6a380740 1 --2- 172.21.15.2:0/4113047016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a83b070 0x55724a842ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.937+0000 7fee46000640 0 client.25409 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.937+0000 7fee6a380740 1 -- 172.21.15.2:0/4113047016 >> 172.21.15.2:0/4113047016 conn(0x55724a803fb0 msgr2=0x55724a83d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:53.939 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.937+0000 7fee6a380740 1 -- 172.21.15.2:0/4113047016 shutdown_connections 2024-06-13T02:19:53.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.938+0000 7fee6a380740 1 -- 172.21.15.2:0/4113047016 wait complete. 2024-06-13T02:19:53.940 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.938+0000 7fee6a380740 20 client.25409 trim_cache size 0 max 16384 2024-06-13T02:19:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.972+0000 7fee6a380740 1 Processor -- start 2024-06-13T02:19:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.972+0000 7fee6a380740 1 -- start start 2024-06-13T02:19:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.972+0000 7fee6a380740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a83b070 0x55724a836fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.972+0000 7fee6a380740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83c5e0 0x55724a837500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.972+0000 7fee6a380740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a845df0 0x55724a85e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.972+0000 7fee6a380740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee601af670 con 0x55724a83c5e0 2024-06-13T02:19:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.972+0000 7fee6a380740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fee601acf40 con 0x55724a83b070 2024-06-13T02:19:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.972+0000 7fee6a380740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fee601a1990 con 0x55724a845df0 2024-06-13T02:19:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.973+0000 7fee64a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a83b070 0x55724a836fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.973+0000 7fee65400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a845df0 0x55724a85e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.973+0000 7fee65400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a845df0 0x55724a85e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58926/0 (socket says 172.21.15.2:58926) 2024-06-13T02:19:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.973+0000 7fee64a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a83b070 0x55724a836fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:33390/0 (socket says 172.21.15.2:33390) 2024-06-13T02:19:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.973+0000 7fee65400640 1 -- 172.21.15.2:0/417402215 learned_addr learned my addr 172.21.15.2:0/417402215 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:53.975 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.973+0000 7fee5fe00640 1 --2- 172.21.15.2:0/417402215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83c5e0 0x55724a837500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.974+0000 7fee65400640 1 -- 172.21.15.2:0/417402215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a83b070 msgr2=0x55724a836fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:53.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.974+0000 7fee65400640 1 --2- 172.21.15.2:0/417402215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a83b070 0x55724a836fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.974+0000 7fee65400640 1 -- 172.21.15.2:0/417402215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83c5e0 msgr2=0x55724a837500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:53.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.974+0000 7fee65400640 1 --2- 172.21.15.2:0/417402215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83c5e0 0x55724a837500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.974+0000 7fee65400640 1 -- 172.21.15.2:0/417402215 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55724a858fc0 con 0x55724a845df0 2024-06-13T02:19:53.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.974+0000 7fee5fe00640 1 --2- 172.21.15.2:0/417402215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83c5e0 0x55724a837500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:19:53.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.975+0000 7fee65400640 1 --2- 172.21.15.2:0/417402215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a845df0 0x55724a85e230 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fee580054c0 tx=0x7fee58004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2479366a921d9c8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:53.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.975+0000 7fee51200640 1 -- 172.21.15.2:0/417402215 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58059070 con 0x55724a845df0 2024-06-13T02:19:53.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.975+0000 7fee51200640 1 -- 172.21.15.2:0/417402215 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee58036050 con 0x55724a845df0 2024-06-13T02:19:53.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.975+0000 7fee51200640 1 -- 172.21.15.2:0/417402215 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58005060 con 0x55724a845df0 2024-06-13T02:19:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.976+0000 7fee6a380740 1 -- 172.21.15.2:0/417402215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a845df0 msgr2=0x55724a85e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.976+0000 7fee6a380740 1 --2- 172.21.15.2:0/417402215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a845df0 0x55724a85e230 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fee580054c0 tx=0x7fee58004ab0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.977+0000 7fee6a380740 1 -- 172.21.15.2:0/417402215 shutdown_connections 2024-06-13T02:19:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.977+0000 7fee6a380740 1 --2- 172.21.15.2:0/417402215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a845df0 0x55724a85e230 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.977+0000 7fee6a380740 1 --2- 172.21.15.2:0/417402215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83c5e0 0x55724a837500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.977+0000 7fee6a380740 1 --2- 172.21.15.2:0/417402215 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a83b070 0x55724a836fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.977+0000 7fee6a380740 1 -- 172.21.15.2:0/417402215 >> 172.21.15.2:0/417402215 conn(0x55724a803fb0 msgr2=0x55724a83d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.977+0000 7fee6a380740 1 -- 172.21.15.2:0/417402215 shutdown_connections 2024-06-13T02:19:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.977+0000 7fee6a380740 1 -- 172.21.15.2:0/417402215 wait complete. 2024-06-13T02:19:53.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.978+0000 7fee6a380740 1 -- start start 2024-06-13T02:19:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.978+0000 7fee6a380740 1 Processor -- start 2024-06-13T02:19:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.979+0000 7fee6a380740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83b070 0x55724a84a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.979+0000 7fee6a380740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a83c5e0 0x55724a84a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.979+0000 7fee6a380740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a845df0 0x55724a8c0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.980+0000 7fee5fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a83c5e0 0x55724a84a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.980+0000 7fee5fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a83c5e0 0x55724a84a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:33396/0 (socket says 172.21.15.2:33396) 2024-06-13T02:19:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.980+0000 7fee65400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a845df0 0x55724a8c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.980+0000 7fee65400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a845df0 0x55724a8c0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58942/0 (socket says 172.21.15.2:58942) 2024-06-13T02:19:53.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.980+0000 7fee6a380740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fee601ab450 con 0x55724a83b070 2024-06-13T02:19:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.980+0000 7fee6a380740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fee601ac870 con 0x55724a83c5e0 2024-06-13T02:19:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.980+0000 7fee6a380740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fee601abb20 con 0x55724a845df0 2024-06-13T02:19:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.980+0000 7fee6a380740 10 client.0 _ll_register_callbacks cb 0x7fee58009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:19:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.981+0000 7fee64a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83b070 0x55724a84a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.981+0000 7fee5fe00640 1 -- 172.21.15.2:0/3519263748 learned_addr learned my addr 172.21.15.2:0/3519263748 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:19:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.982+0000 7fee64a00640 1 -- 172.21.15.2:0/3519263748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a845df0 msgr2=0x55724a8c0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.982+0000 7fee64a00640 1 --2- 172.21.15.2:0/3519263748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a845df0 0x55724a8c0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.982+0000 7fee64a00640 1 -- 172.21.15.2:0/3519263748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a83c5e0 msgr2=0x55724a84a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:19:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.982+0000 7fee64a00640 1 --2- 172.21.15.2:0/3519263748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a83c5e0 0x55724a84a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.982+0000 7fee64a00640 1 -- 172.21.15.2:0/3519263748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55724a8c0740 con 0x55724a83b070 2024-06-13T02:19:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.982+0000 7fee65400640 1 --2- 172.21.15.2:0/3519263748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a845df0 0x55724a8c0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:19:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.983+0000 7fee64a00640 1 --2- 172.21.15.2:0/3519263748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83b070 0x55724a84a160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fee540ddfc0 tx=0x7fee540a8990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec10ccbcd5aca3a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:19:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.983+0000 7fee46000640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:19:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.983+0000 7fee46000640 1 -- 172.21.15.2:0/3519263748 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee540ca060 con 0x55724a83b070 2024-06-13T02:19:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.983+0000 7fee46000640 1 -- 172.21.15.2:0/3519263748 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fee54021ad0 con 0x55724a83b070 2024-06-13T02:19:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.983+0000 7fee6a380740 1 -- 172.21.15.2:0/3519263748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee58036050 con 0x55724a83b070 2024-06-13T02:19:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.984+0000 7fee46000640 1 -- 172.21.15.2:0/3519263748 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fee540de240 con 0x55724a83b070 2024-06-13T02:19:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.984+0000 7fee6a380740 10 client.15279 fetch_fsmap learned FSMap version 28 2024-06-13T02:19:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.984+0000 7fee6a380740 1 -- 172.21.15.2:0/3519263748 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55724a8c1950 con 0x55724a83b070 2024-06-13T02:19:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.984+0000 7fee46000640 1 -- 172.21.15.2:0/3519263748 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee58036050 con 0x55724a83b070 2024-06-13T02:19:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.985+0000 7fee46000640 1 -- 172.21.15.2:0/3519263748 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7fee540ac1e0 con 0x55724a83b070 2024-06-13T02:19:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.985+0000 7fee6a380740 10 client.15279 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:19:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.985+0000 7fee6a380740 10 client.15279 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:19:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.985+0000 7fee6a380740 20 client.15279 populate_metadata read hostname 'smithi002' 2024-06-13T02:19:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.985+0000 7fee6a380740 1 --2- 172.21.15.2:0/3519263748 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55724a8c1f80 0x55724a8c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:19:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.985+0000 7fee6a380740 4 client.15279 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:19:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.985+0000 7fee6a380740 1 -- 172.21.15.2:0/3519263748 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55724a7a6ea0 con 0x55724a8c1f80 2024-06-13T02:19:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.986+0000 7fee5fe00640 1 --2- 172.21.15.2:0/3519263748 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55724a8c1f80 0x55724a8c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:19:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.987+0000 7fee5fe00640 1 --2- 172.21.15.2:0/3519263748 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55724a8c1f80 0x55724a8c43a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d44528dac004fc9 server_cookie=72b054ba6255ab4c in_seq=0 out_seq=0 2024-06-13T02:19:53.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:53.987+0000 7fee46000640 10 client.15279 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:54.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.097+0000 7fee46000640 1 -- 172.21.15.2:0/3519263748 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55724a7a6ea0 con 0x55724a8c1f80 2024-06-13T02:19:54.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.097+0000 7fee46000640 10 client.15279 handle_command_reply: tid=0 2024-06-13T02:19:54.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.098+0000 7fee6a380740 1 client.15279 shutdown 2024-06-13T02:19:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.098+0000 7fee6a380740 1 -- 172.21.15.2:0/3519263748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83b070 msgr2=0x55724a84a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.098+0000 7fee6a380740 1 --2- 172.21.15.2:0/3519263748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83b070 0x55724a84a160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fee540ddfc0 tx=0x7fee540a8990 comp rx=0 tx=0).stop 2024-06-13T02:19:54.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.099+0000 7fee6a380740 1 -- 172.21.15.2:0/3519263748 shutdown_connections 2024-06-13T02:19:54.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.099+0000 7fee6a380740 1 --2- 172.21.15.2:0/3519263748 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55724a8c1f80 0x55724a8c43a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:54.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.099+0000 7fee6a380740 1 --2- 172.21.15.2:0/3519263748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55724a845df0 0x55724a8c0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:54.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.099+0000 7fee6a380740 1 --2- 172.21.15.2:0/3519263748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55724a83c5e0 0x55724a84a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:54.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.099+0000 7fee6a380740 1 --2- 172.21.15.2:0/3519263748 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55724a83b070 0x55724a84a160 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:54.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.099+0000 7fee46000640 0 client.15279 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:19:54.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.099+0000 7fee6a380740 1 -- 172.21.15.2:0/3519263748 >> 172.21.15.2:0/3519263748 conn(0x55724a803fb0 msgr2=0x55724a83cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:54.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.099+0000 7fee6a380740 1 -- 172.21.15.2:0/3519263748 shutdown_connections 2024-06-13T02:19:54.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.099+0000 7fee6a380740 1 -- 172.21.15.2:0/3519263748 wait complete. 2024-06-13T02:19:54.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.100+0000 7fee6a380740 20 client.15279 trim_cache size 0 max 16384 2024-06-13T02:19:54.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:19:54.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:19:54.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:19:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.101+0000 7fee67400640 1 -- 172.21.15.2:0/301269287 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fee480a2da0 msgr2=0x7fee480a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.101+0000 7fee67400640 1 --2- 172.21.15.2:0/301269287 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fee480a2da0 0x7fee480a5260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fee6010f1f0 tx=0x7fee4c00b4f0 comp rx=0 tx=0).stop 2024-06-13T02:19:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.101+0000 7fee67400640 1 -- 172.21.15.2:0/301269287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee60103e30 msgr2=0x7fee60110990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:19:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.101+0000 7fee67400640 1 --2- 172.21.15.2:0/301269287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee60103e30 0x7fee60110990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fee5401fa00 tx=0x7fee5401fec0 comp rx=0 tx=0).stop 2024-06-13T02:19:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.101+0000 7fee67400640 1 -- 172.21.15.2:0/301269287 shutdown_connections 2024-06-13T02:19:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.101+0000 7fee67400640 1 --2- 172.21.15.2:0/301269287 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee6010df70 0x7fee6010e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.101+0000 7fee67400640 1 --2- 172.21.15.2:0/301269287 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fee480a2da0 0x7fee480a5260 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.101+0000 7fee67400640 1 --2- 172.21.15.2:0/301269287 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fee60108f00 0x7fee6010da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:54.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.101+0000 7fee67400640 1 --2- 172.21.15.2:0/301269287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee60103e30 0x7fee60110990 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:19:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.101+0000 7fee67400640 1 -- 172.21.15.2:0/301269287 >> 172.21.15.2:0/301269287 conn(0x7fee600ff650 msgr2=0x7fee60101910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:19:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.101+0000 7fee67400640 1 -- 172.21.15.2:0/301269287 shutdown_connections 2024-06-13T02:19:54.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:19:54.101+0000 7fee67400640 1 -- 172.21.15.2:0/301269287 wait complete. 2024-06-13T02:19:54.472 INFO:tasks.workunit.client.0.smithi002.stdout: 1 72835 7.05 MB/sec warmup 58 sec latency 40.821 ms 2024-06-13T02:19:55.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:54 smithi084 ceph-mon[36833]: pgmap v65: 129 pgs: 129 active+clean; 38 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 1.8 MiB/s wr, 205 op/s 2024-06-13T02:19:55.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:54 smithi175 ceph-mon[36977]: pgmap v65: 129 pgs: 129 active+clean; 38 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 1.8 MiB/s wr, 205 op/s 2024-06-13T02:19:55.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:54 smithi002 ceph-mon[31960]: pgmap v65: 129 pgs: 129 active+clean; 38 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 1.8 MiB/s wr, 205 op/s 2024-06-13T02:19:55.472 INFO:tasks.workunit.client.0.smithi002.stdout: 1 75005 7.16 MB/sec warmup 59 sec latency 8.883 ms 2024-06-13T02:19:56.472 INFO:tasks.workunit.client.0.smithi002.stdout: 1 76939 7.16 MB/sec warmup 60 sec latency 10.343 ms 2024-06-13T02:19:57.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:56 smithi084 ceph-mon[36833]: pgmap v66: 129 pgs: 129 active+clean; 34 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.0 MiB/s wr, 350 op/s 2024-06-13T02:19:57.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:56 smithi175 ceph-mon[36977]: pgmap v66: 129 pgs: 129 active+clean; 34 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.0 MiB/s wr, 350 op/s 2024-06-13T02:19:57.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:56 smithi002 ceph-mon[31960]: pgmap v66: 129 pgs: 129 active+clean; 34 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.0 MiB/s wr, 350 op/s 2024-06-13T02:19:57.472 INFO:tasks.workunit.client.0.smithi002.stdout: 1 78770 7.24 MB/sec warmup 61 sec latency 10.679 ms 2024-06-13T02:19:58.472 INFO:tasks.workunit.client.0.smithi002.stdout: 1 80868 7.30 MB/sec warmup 62 sec latency 21.231 ms 2024-06-13T02:19:59.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:19:58 smithi175 ceph-mon[36977]: pgmap v67: 129 pgs: 129 active+clean; 30 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 4.5 MiB/s wr, 346 op/s 2024-06-13T02:19:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:19:58 smithi002 ceph-mon[31960]: pgmap v67: 129 pgs: 129 active+clean; 30 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 4.5 MiB/s wr, 346 op/s 2024-06-13T02:19:59.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:19:58 smithi084 ceph-mon[36833]: pgmap v67: 129 pgs: 129 active+clean; 30 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 4.5 MiB/s wr, 346 op/s 2024-06-13T02:19:59.472 INFO:tasks.workunit.client.0.smithi002.stdout: 1 82510 7.32 MB/sec warmup 63 sec latency 10.322 ms 2024-06-13T02:20:00.472 INFO:tasks.workunit.client.0.smithi002.stdout: 1 84820 7.41 MB/sec warmup 64 sec latency 14.849 ms 2024-06-13T02:20:01.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:00 smithi175 ceph-mon[36977]: pgmap v68: 129 pgs: 129 active+clean; 30 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 4.4 MiB/s wr, 313 op/s 2024-06-13T02:20:01.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:00 smithi175 ceph-mon[36977]: overall HEALTH_OK 2024-06-13T02:20:01.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:00 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:20:01.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:00 smithi002 ceph-mon[31960]: pgmap v68: 129 pgs: 129 active+clean; 30 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 4.4 MiB/s wr, 313 op/s 2024-06-13T02:20:01.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:00 smithi002 ceph-mon[31960]: overall HEALTH_OK 2024-06-13T02:20:01.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:00 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:20:01.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:00 smithi084 ceph-mon[36833]: pgmap v68: 129 pgs: 129 active+clean; 30 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 4.4 MiB/s wr, 313 op/s 2024-06-13T02:20:01.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:00 smithi084 ceph-mon[36833]: overall HEALTH_OK 2024-06-13T02:20:01.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:00 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:20:01.472 INFO:tasks.workunit.client.0.smithi002.stdout: 1 85372 7.37 MB/sec warmup 65 sec latency 79.505 ms 2024-06-13T02:20:02.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:01 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:20:02.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:01 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:20:02.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:01 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:20:02.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:01 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:20:02.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:01 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:20:02.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:01 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:20:02.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:01 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:20:02.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:01 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:20:02.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:01 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:20:02.472 INFO:tasks.workunit.client.0.smithi002.stdout: 1 86156 7.28 MB/sec warmup 66 sec latency 73.741 ms 2024-06-13T02:20:03.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:02 smithi175 ceph-mon[36977]: pgmap v69: 129 pgs: 129 active+clean; 34 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.0 MiB/s wr, 400 op/s 2024-06-13T02:20:03.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:02 smithi002 ceph-mon[31960]: pgmap v69: 129 pgs: 129 active+clean; 34 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.0 MiB/s wr, 400 op/s 2024-06-13T02:20:03.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:02 smithi084 ceph-mon[36833]: pgmap v69: 129 pgs: 129 active+clean; 34 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 5.0 MiB/s wr, 400 op/s 2024-06-13T02:20:03.473 INFO:tasks.workunit.client.0.smithi002.stdout: 1 88360 7.36 MB/sec warmup 67 sec latency 11.021 ms 2024-06-13T02:20:04.473 INFO:tasks.workunit.client.0.smithi002.stdout: 1 89707 7.35 MB/sec warmup 68 sec latency 10.457 ms 2024-06-13T02:20:05.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:04 smithi175 ceph-mon[36977]: pgmap v70: 129 pgs: 129 active+clean; 34 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 3.5 MiB/s wr, 293 op/s 2024-06-13T02:20:05.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:04 smithi002 ceph-mon[31960]: pgmap v70: 129 pgs: 129 active+clean; 34 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 3.5 MiB/s wr, 293 op/s 2024-06-13T02:20:05.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:04 smithi084 ceph-mon[36833]: pgmap v70: 129 pgs: 129 active+clean; 34 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 3.5 MiB/s wr, 293 op/s 2024-06-13T02:20:05.473 INFO:tasks.workunit.client.0.smithi002.stdout: 1 92251 7.48 MB/sec warmup 69 sec latency 22.635 ms 2024-06-13T02:20:06.473 INFO:tasks.workunit.client.0.smithi002.stdout: 1 93520 7.43 MB/sec warmup 70 sec latency 10.791 ms 2024-06-13T02:20:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.260+0000 7f1e1be00640 1 -- 172.21.15.2:0/428609378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e1c1066c0 msgr2=0x7f1e1c106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.260+0000 7f1e1be00640 1 --2- 172.21.15.2:0/428609378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e1c1066c0 0x7f1e1c106aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009930 tx=0x7f1e0c02a420 comp rx=0 tx=0).stop 2024-06-13T02:20:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.260+0000 7f1e1be00640 1 -- 172.21.15.2:0/428609378 shutdown_connections 2024-06-13T02:20:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.260+0000 7f1e1be00640 1 --2- 172.21.15.2:0/428609378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e1c101070 0x7f1e1c10d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.260+0000 7f1e1be00640 1 --2- 172.21.15.2:0/428609378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e1c1006b0 0x7f1e1c100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.260+0000 7f1e1be00640 1 --2- 172.21.15.2:0/428609378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e1c1066c0 0x7f1e1c106aa0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.260+0000 7f1e1be00640 1 -- 172.21.15.2:0/428609378 >> 172.21.15.2:0/428609378 conn(0x7f1e1c0fc180 msgr2=0x7f1e1c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.260+0000 7f1e1be00640 1 -- 172.21.15.2:0/428609378 shutdown_connections 2024-06-13T02:20:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.260+0000 7f1e1be00640 1 -- 172.21.15.2:0/428609378 wait complete. 2024-06-13T02:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.261+0000 7f1e1be00640 1 Processor -- start 2024-06-13T02:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.261+0000 7f1e1be00640 1 -- start start 2024-06-13T02:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e1c1006b0 0x7f1e1c19a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e1c101070 0x7f1e1c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e1c1066c0 0x7f1e1c19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1be00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c111bd0 con 0x7f1e1c101070 2024-06-13T02:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1be00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c111a50 con 0x7f1e1c1006b0 2024-06-13T02:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1be00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c111d50 con 0x7f1e1c1066c0 2024-06-13T02:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e1c1006b0 0x7f1e1c19a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e1c1006b0 0x7f1e1c19a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:51150/0 (socket says 172.21.15.2:51150) 2024-06-13T02:20:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1a000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e1c101070 0x7f1e1c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1aa00640 1 -- 172.21.15.2:0/1690642708 learned_addr learned my addr 172.21.15.2:0/1690642708 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1b400640 1 --2- 172.21.15.2:0/1690642708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e1c1066c0 0x7f1e1c19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1aa00640 1 -- 172.21.15.2:0/1690642708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e1c1066c0 msgr2=0x7f1e1c19eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1aa00640 1 --2- 172.21.15.2:0/1690642708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e1c1066c0 0x7f1e1c19eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1aa00640 1 -- 172.21.15.2:0/1690642708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e1c101070 msgr2=0x7f1e1c19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1aa00640 1 --2- 172.21.15.2:0/1690642708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e1c101070 0x7f1e1c19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1aa00640 1 -- 172.21.15.2:0/1690642708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e1c19f2a0 con 0x7f1e1c1006b0 2024-06-13T02:20:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.262+0000 7f1e1b400640 1 --2- 172.21.15.2:0/1690642708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e1c1066c0 0x7f1e1c19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:20:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.263+0000 7f1e1aa00640 1 --2- 172.21.15.2:0/1690642708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e1c1006b0 0x7f1e1c19a2b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009230 tx=0x7f1e0c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.263+0000 7f1e13400640 1 -- 172.21.15.2:0/1690642708 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c03f030 con 0x7f1e1c1006b0 2024-06-13T02:20:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.263+0000 7f1e13400640 1 -- 172.21.15.2:0/1690642708 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e0c004440 con 0x7f1e1c1006b0 2024-06-13T02:20:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.263+0000 7f1e1be00640 1 -- 172.21.15.2:0/1690642708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e1c19f530 con 0x7f1e1c1006b0 2024-06-13T02:20:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.263+0000 7f1e13400640 1 -- 172.21.15.2:0/1690642708 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c035070 con 0x7f1e1c1006b0 2024-06-13T02:20:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.263+0000 7f1e1be00640 1 -- 172.21.15.2:0/1690642708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e1c1a6e20 con 0x7f1e1c1006b0 2024-06-13T02:20:07.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.266+0000 7f1e245ae740 1 Processor -- start 2024-06-13T02:20:07.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.267+0000 7f1e13400640 1 -- 172.21.15.2:0/1690642708 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f1e0c042030 con 0x7f1e1c1006b0 2024-06-13T02:20:07.267 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.267+0000 7f1e245ae740 1 -- start start 2024-06-13T02:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.267+0000 7f1e245ae740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caacc7a0 0x5654caacacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.267+0000 7f1e245ae740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 0x5654caacb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.267+0000 7f1e245ae740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caad5fb0 0x5654caad83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.267+0000 7f1e245ae740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5654caa2f420 con 0x5654caad5fb0 2024-06-13T02:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.267+0000 7f1e245ae740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5654ca9d6c50 con 0x5654caacb230 2024-06-13T02:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.267+0000 7f1e245ae740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5654caa2b3e0 con 0x5654caacc7a0 2024-06-13T02:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.267+0000 7f1e1b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caacc7a0 0x5654caacacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.267+0000 7f1e1b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caacc7a0 0x5654caacacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:43802/0 (socket says 172.21.15.2:43802) 2024-06-13T02:20:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.267+0000 7f1e1b400640 1 -- 172.21.15.2:0/867389666 learned_addr learned my addr 172.21.15.2:0/867389666 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.267+0000 7f1e1aa00640 1 --2- 172.21.15.2:0/867389666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 0x5654caacb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.268+0000 7f1e1a000640 1 --2- 172.21.15.2:0/867389666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caad5fb0 0x5654caad83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.268+0000 7f1e1b400640 1 -- 172.21.15.2:0/867389666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 msgr2=0x5654caacb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.268+0000 7f1e1b400640 1 --2- 172.21.15.2:0/867389666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 0x5654caacb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.268+0000 7f1e1b400640 1 -- 172.21.15.2:0/867389666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caad5fb0 msgr2=0x5654caad83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.268+0000 7f1e1b400640 1 --2- 172.21.15.2:0/867389666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caad5fb0 0x5654caad83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.268+0000 7f1e1b400640 1 -- 172.21.15.2:0/867389666 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654ca743210 con 0x5654caacc7a0 2024-06-13T02:20:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.268+0000 7f1e1a000640 1 --2- 172.21.15.2:0/867389666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caad5fb0 0x5654caad83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:20:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.268+0000 7f1e1b400640 1 --2- 172.21.15.2:0/867389666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caacc7a0 0x5654caacacf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1e140103d0 tx=0x7f1e14010890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b39b177f47ddcec7 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.268+0000 7f1e13400640 1 --2- 172.21.15.2:0/1690642708 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f1e000a2d60 0x7f1e000a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.268+0000 7f1e07e00640 1 -- 172.21.15.2:0/867389666 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e14011700 con 0x5654caacc7a0 2024-06-13T02:20:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.268+0000 7f1e07e00640 1 -- 172.21.15.2:0/867389666 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e14011d80 con 0x5654caacc7a0 2024-06-13T02:20:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.268+0000 7f1e07e00640 1 -- 172.21.15.2:0/867389666 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400e3c0 con 0x5654caacc7a0 2024-06-13T02:20:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.269+0000 7f1e13400640 1 -- 172.21.15.2:0/1690642708 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f1e0c0ef800 con 0x7f1e1c1006b0 2024-06-13T02:20:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.269+0000 7f1e1aa00640 1 --2- 172.21.15.2:0/1690642708 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f1e000a2d60 0x7f1e000a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.269+0000 7f1e245ae740 1 -- 172.21.15.2:0/867389666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caacc7a0 msgr2=0x5654caacacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.269+0000 7f1e245ae740 1 --2- 172.21.15.2:0/867389666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caacc7a0 0x5654caacacf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1e140103d0 tx=0x7f1e14010890 comp rx=0 tx=0).stop 2024-06-13T02:20:07.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.269+0000 7f1e1aa00640 1 --2- 172.21.15.2:0/1690642708 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f1e000a2d60 0x7f1e000a5220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x5654caacdf00 tx=0x7f1e0c009260 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.269+0000 7f1e245ae740 1 -- 172.21.15.2:0/867389666 shutdown_connections 2024-06-13T02:20:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.269+0000 7f1e245ae740 1 --2- 172.21.15.2:0/867389666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caad5fb0 0x5654caad83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.269+0000 7f1e245ae740 1 --2- 172.21.15.2:0/867389666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 0x5654caacb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.269+0000 7f1e245ae740 1 --2- 172.21.15.2:0/867389666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caacc7a0 0x5654caacacf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.270+0000 7f1e245ae740 1 -- 172.21.15.2:0/867389666 >> 172.21.15.2:0/867389666 conn(0x5654caa93fb0 msgr2=0x5654caac7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.270+0000 7f1e245ae740 1 -- 172.21.15.2:0/867389666 shutdown_connections 2024-06-13T02:20:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.270+0000 7f1e245ae740 1 -- 172.21.15.2:0/867389666 wait complete. 2024-06-13T02:20:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.270+0000 7f1e245ae740 1 -- start start 2024-06-13T02:20:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.270+0000 7f1e245ae740 1 Processor -- start 2024-06-13T02:20:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.271+0000 7f1e245ae740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 0x5654caad3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.271+0000 7f1e245ae740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caacc7a0 0x5654caad3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.271+0000 7f1e245ae740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caad5fb0 0x5654caad3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.271+0000 7f1e245ae740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5654caad8d80 con 0x5654caacc7a0 2024-06-13T02:20:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.271+0000 7f1e245ae740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5654ca9ea0b0 con 0x5654caacb230 2024-06-13T02:20:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.271+0000 7f1e245ae740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5654caad8f00 con 0x5654caad5fb0 2024-06-13T02:20:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.271+0000 7f1e245ae740 10 client.0 _ll_register_callbacks cb 0x5654ca9d5f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:20:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.271+0000 7f1e1b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 0x5654caad3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.271+0000 7f1e1a000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caacc7a0 0x5654caad3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.271+0000 7f1e1a000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caacc7a0 0x5654caad3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43122/0 (socket says 172.21.15.2:43122) 2024-06-13T02:20:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.271+0000 7f1e1a000640 1 -- 172.21.15.2:0/3297163959 learned_addr learned my addr 172.21.15.2:0/3297163959 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.272+0000 7f1e1b400640 1 --2- 172.21.15.2:0/3297163959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caad5fb0 0x5654caad3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.272+0000 7f1e1a000640 1 -- 172.21.15.2:0/3297163959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caad5fb0 msgr2=0x5654caad3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.272+0000 7f1e1a000640 1 --2- 172.21.15.2:0/3297163959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caad5fb0 0x5654caad3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.272+0000 7f1e1a000640 1 -- 172.21.15.2:0/3297163959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 msgr2=0x5654caad3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.272+0000 7f1e1a000640 1 --2- 172.21.15.2:0/3297163959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 0x5654caad3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.272+0000 7f1e1a000640 1 -- 172.21.15.2:0/3297163959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654ca80f620 con 0x5654caacc7a0 2024-06-13T02:20:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.272+0000 7f1e1a000640 1 --2- 172.21.15.2:0/3297163959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caacc7a0 0x5654caad3590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1e080136e0 tx=0x7f1e08013ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4d9ae63ab32833 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.272+0000 7f1e04c00640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:20:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.273+0000 7f1e04c00640 1 -- 172.21.15.2:0/3297163959 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e080119c0 con 0x5654caacc7a0 2024-06-13T02:20:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.273+0000 7f1e04c00640 1 -- 172.21.15.2:0/3297163959 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f1e08011b60 con 0x5654caacc7a0 2024-06-13T02:20:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.273+0000 7f1e245ae740 1 -- 172.21.15.2:0/3297163959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e14011d80 con 0x5654caacc7a0 2024-06-13T02:20:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.273+0000 7f1e04c00640 1 -- 172.21.15.2:0/3297163959 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1e08011d60 con 0x5654caacc7a0 2024-06-13T02:20:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.273+0000 7f1e245ae740 10 client.15288 fetch_fsmap learned FSMap version 28 2024-06-13T02:20:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.273+0000 7f1e245ae740 1 -- 172.21.15.2:0/3297163959 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5654caae5170 con 0x5654caacc7a0 2024-06-13T02:20:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.273+0000 7f1e04c00640 1 -- 172.21.15.2:0/3297163959 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e14011d80 con 0x5654caacc7a0 2024-06-13T02:20:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.274+0000 7f1e04c00640 1 -- 172.21.15.2:0/3297163959 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f1e0801a070 con 0x5654caacc7a0 2024-06-13T02:20:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.274+0000 7f1e245ae740 10 client.15288 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:20:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.274+0000 7f1e245ae740 10 client.15288 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:20:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.274+0000 7f1e245ae740 20 client.15288 populate_metadata read hostname 'smithi002' 2024-06-13T02:20:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.274+0000 7f1e245ae740 1 --2- 172.21.15.2:0/3297163959 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5654caae6630 0x5654caae8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.274+0000 7f1e245ae740 4 client.15288 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:20:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.274+0000 7f1e245ae740 1 -- 172.21.15.2:0/3297163959 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654caa3cb50 con 0x5654caae6630 2024-06-13T02:20:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.274+0000 7f1e1b400640 1 --2- 172.21.15.2:0/3297163959 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5654caae6630 0x5654caae8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.274+0000 7f1e1b400640 1 --2- 172.21.15.2:0/3297163959 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5654caae6630 0x5654caae8a40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b998e51d63731e98 server_cookie=ba2aa2b621993868 in_seq=0 out_seq=0 2024-06-13T02:20:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.274+0000 7f1e04c00640 10 client.15288 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.275+0000 7f1e04c00640 1 -- 172.21.15.2:0/3297163959 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5654caa3cb50 con 0x5654caae6630 2024-06-13T02:20:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.275+0000 7f1e04c00640 10 client.15288 handle_command_reply: tid=0 2024-06-13T02:20:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.275+0000 7f1e245ae740 1 client.15288 shutdown 2024-06-13T02:20:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.275+0000 7f1e245ae740 1 -- 172.21.15.2:0/3297163959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caacc7a0 msgr2=0x5654caad3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.275+0000 7f1e245ae740 1 --2- 172.21.15.2:0/3297163959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caacc7a0 0x5654caad3590 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1e080136e0 tx=0x7f1e08013ba0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.276+0000 7f1e245ae740 1 -- 172.21.15.2:0/3297163959 shutdown_connections 2024-06-13T02:20:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.276+0000 7f1e245ae740 1 --2- 172.21.15.2:0/3297163959 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5654caae6630 0x5654caae8a40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.276+0000 7f1e245ae740 1 --2- 172.21.15.2:0/3297163959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caad5fb0 0x5654caad3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.276+0000 7f1e245ae740 1 --2- 172.21.15.2:0/3297163959 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caacc7a0 0x5654caad3590 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.276+0000 7f1e04c00640 0 client.15288 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.276+0000 7f1e245ae740 1 --2- 172.21.15.2:0/3297163959 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 0x5654caad3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.276+0000 7f1e245ae740 1 -- 172.21.15.2:0/3297163959 >> 172.21.15.2:0/3297163959 conn(0x5654caa93fb0 msgr2=0x5654caacd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.276+0000 7f1e245ae740 1 -- 172.21.15.2:0/3297163959 shutdown_connections 2024-06-13T02:20:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.276+0000 7f1e245ae740 1 -- 172.21.15.2:0/3297163959 wait complete. 2024-06-13T02:20:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.276+0000 7f1e245ae740 20 client.15288 trim_cache size 0 max 16384 2024-06-13T02:20:07.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:06 smithi175 ceph-mon[36977]: pgmap v71: 129 pgs: 129 active+clean; 38 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 359 op/s 2024-06-13T02:20:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.294+0000 7f1e245ae740 1 Processor -- start 2024-06-13T02:20:07.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.295+0000 7f1e245ae740 1 -- start start 2024-06-13T02:20:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.295+0000 7f1e245ae740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 0x5654caad3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.295+0000 7f1e245ae740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caacc7a0 0x5654caaee310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.295+0000 7f1e245ae740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caad5fb0 0x5654caaee850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.295+0000 7f1e245ae740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c1b3900 con 0x5654caad5fb0 2024-06-13T02:20:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.295+0000 7f1e245ae740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c1b11d0 con 0x5654caacb230 2024-06-13T02:20:07.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.295+0000 7f1e245ae740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c1af020 con 0x5654caacc7a0 2024-06-13T02:20:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.295+0000 7f1e1b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 0x5654caad3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.295+0000 7f1e1a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caacc7a0 0x5654caaee310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.295+0000 7f1e1b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 0x5654caad3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:51176/0 (socket says 172.21.15.2:51176) 2024-06-13T02:20:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.295+0000 7f1e1b400640 1 -- 172.21.15.2:0/126348664 learned_addr learned my addr 172.21.15.2:0/126348664 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.296+0000 7f1e1b400640 1 --2- 172.21.15.2:0/126348664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caad5fb0 0x5654caaee850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.296+0000 7f1e1a000640 1 -- 172.21.15.2:0/126348664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 msgr2=0x5654caad3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.296+0000 7f1e1a000640 1 --2- 172.21.15.2:0/126348664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 0x5654caad3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.296+0000 7f1e1a000640 1 -- 172.21.15.2:0/126348664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caad5fb0 msgr2=0x5654caaee850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.296+0000 7f1e1a000640 1 --2- 172.21.15.2:0/126348664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caad5fb0 0x5654caaee850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.296+0000 7f1e1a000640 1 -- 172.21.15.2:0/126348664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654caacaf30 con 0x5654caacc7a0 2024-06-13T02:20:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.296+0000 7f1e1a000640 1 --2- 172.21.15.2:0/126348664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caacc7a0 0x5654caaee310 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1e0801c7a0 tx=0x7f1e08011f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=596f05feaa2a9b0c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.297+0000 7f1e07400640 1 -- 172.21.15.2:0/126348664 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0802e030 con 0x5654caacc7a0 2024-06-13T02:20:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.297+0000 7f1e07400640 1 -- 172.21.15.2:0/126348664 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e0801c440 con 0x5654caacc7a0 2024-06-13T02:20:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.297+0000 7f1e07400640 1 -- 172.21.15.2:0/126348664 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e080035f0 con 0x5654caacc7a0 2024-06-13T02:20:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.298+0000 7f1e245ae740 1 -- 172.21.15.2:0/126348664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caacc7a0 msgr2=0x5654caaee310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.298+0000 7f1e245ae740 1 --2- 172.21.15.2:0/126348664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caacc7a0 0x5654caaee310 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1e0801c7a0 tx=0x7f1e08011f80 comp rx=0 tx=0).stop 2024-06-13T02:20:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.298+0000 7f1e245ae740 1 -- 172.21.15.2:0/126348664 shutdown_connections 2024-06-13T02:20:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.298+0000 7f1e245ae740 1 --2- 172.21.15.2:0/126348664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caad5fb0 0x5654caaee850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.298+0000 7f1e245ae740 1 --2- 172.21.15.2:0/126348664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caacc7a0 0x5654caaee310 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.298+0000 7f1e245ae740 1 --2- 172.21.15.2:0/126348664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacb230 0x5654caad3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.298+0000 7f1e245ae740 1 -- 172.21.15.2:0/126348664 >> 172.21.15.2:0/126348664 conn(0x5654caa93fb0 msgr2=0x5654caad3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.298+0000 7f1e245ae740 1 -- 172.21.15.2:0/126348664 shutdown_connections 2024-06-13T02:20:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.298+0000 7f1e245ae740 1 -- 172.21.15.2:0/126348664 wait complete. 2024-06-13T02:20:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.298+0000 7f1e245ae740 1 -- start start 2024-06-13T02:20:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.299+0000 7f1e245ae740 1 Processor -- start 2024-06-13T02:20:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.299+0000 7f1e245ae740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caacb230 0x5654caade8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.299+0000 7f1e245ae740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacc7a0 0x5654caad9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.299+0000 7f1e245ae740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caad5fb0 0x5654caada1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.299+0000 7f1e245ae740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c1af690 con 0x5654caacb230 2024-06-13T02:20:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.299+0000 7f1e245ae740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c1b0b00 con 0x5654caacc7a0 2024-06-13T02:20:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.299+0000 7f1e245ae740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1c1afd60 con 0x5654caad5fb0 2024-06-13T02:20:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.299+0000 7f1e245ae740 10 client.0 _ll_register_callbacks cb 0x7f1e08009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:20:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.299+0000 7f1e1a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacc7a0 0x5654caad9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.299+0000 7f1e1a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacc7a0 0x5654caad9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:51184/0 (socket says 172.21.15.2:51184) 2024-06-13T02:20:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.299+0000 7f1e1a000640 1 -- 172.21.15.2:0/2442185328 learned_addr learned my addr 172.21.15.2:0/2442185328 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.300+0000 7f1e1b400640 1 --2- 172.21.15.2:0/2442185328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caad5fb0 0x5654caada1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.300+0000 7f1e1b400640 1 -- 172.21.15.2:0/2442185328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacc7a0 msgr2=0x5654caad9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.300+0000 7f1e1b400640 1 --2- 172.21.15.2:0/2442185328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacc7a0 0x5654caad9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.300+0000 7f1e1b400640 1 -- 172.21.15.2:0/2442185328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caacb230 msgr2=0x5654caade8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.300+0000 7f1e1b400640 1 --2- 172.21.15.2:0/2442185328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caacb230 0x5654caade8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.300+0000 7f1e1b400640 1 -- 172.21.15.2:0/2442185328 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654caadaa00 con 0x5654caad5fb0 2024-06-13T02:20:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.300+0000 7f1e1a000640 1 --2- 172.21.15.2:0/2442185328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacc7a0 0x5654caad9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:20:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.300+0000 7f1e1b400640 1 --2- 172.21.15.2:0/2442185328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caad5fb0 0x5654caada1f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1e1401bbc0 tx=0x7f1e1401cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b544d5bb1f47402e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.300+0000 7f1e04c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:20:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.301+0000 7f1e04c00640 1 -- 172.21.15.2:0/2442185328 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e14039020 con 0x5654caad5fb0 2024-06-13T02:20:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.301+0000 7f1e04c00640 1 -- 172.21.15.2:0/2442185328 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f1e1401b6c0 con 0x5654caad5fb0 2024-06-13T02:20:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.301+0000 7f1e245ae740 1 -- 172.21.15.2:0/2442185328 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e0801c440 con 0x5654caad5fb0 2024-06-13T02:20:07.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.301+0000 7f1e04c00640 1 -- 172.21.15.2:0/2442185328 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1e14041050 con 0x5654caad5fb0 2024-06-13T02:20:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.301+0000 7f1e245ae740 10 client.25420 fetch_fsmap learned FSMap version 28 2024-06-13T02:20:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.301+0000 7f1e245ae740 1 -- 172.21.15.2:0/2442185328 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5654cab512c0 con 0x5654caad5fb0 2024-06-13T02:20:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.301+0000 7f1e04c00640 1 -- 172.21.15.2:0/2442185328 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e0801c440 con 0x5654caad5fb0 2024-06-13T02:20:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.301+0000 7f1e04c00640 1 -- 172.21.15.2:0/2442185328 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f1e14029040 con 0x5654caad5fb0 2024-06-13T02:20:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.301+0000 7f1e245ae740 10 client.25420 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:20:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.301+0000 7f1e245ae740 10 client.25420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:20:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.301+0000 7f1e245ae740 20 client.25420 populate_metadata read hostname 'smithi002' 2024-06-13T02:20:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.302+0000 7f1e245ae740 1 --2- 172.21.15.2:0/2442185328 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5654cab51750 0x5654cab53b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.302+0000 7f1e245ae740 4 client.25420 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:20:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.302+0000 7f1e245ae740 1 -- 172.21.15.2:0/2442185328 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5654caa36ea0 con 0x5654cab51750 2024-06-13T02:20:07.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.302+0000 7f1e1a000640 1 --2- 172.21.15.2:0/2442185328 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5654cab51750 0x5654cab53b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.302+0000 7f1e1a000640 1 --2- 172.21.15.2:0/2442185328 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5654cab51750 0x5654cab53b40 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45b8a32122da58a7 server_cookie=d6db69da629ad58a in_seq=0 out_seq=0 2024-06-13T02:20:07.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.302+0000 7f1e04c00640 10 client.25420 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:07.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:06 smithi002 ceph-mon[31960]: pgmap v71: 129 pgs: 129 active+clean; 38 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 359 op/s 2024-06-13T02:20:07.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:06 smithi084 ceph-mon[36833]: pgmap v71: 129 pgs: 129 active+clean; 38 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 359 op/s 2024-06-13T02:20:07.473 INFO:tasks.workunit.client.0.smithi002.stdout: 1 95887 7.55 MB/sec warmup 71 sec latency 72.443 ms 2024-06-13T02:20:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.499+0000 7f1e04c00640 1 -- 172.21.15.2:0/2442185328 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5654caa36ea0 con 0x5654cab51750 2024-06-13T02:20:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.499+0000 7f1e04c00640 10 client.25420 handle_command_reply: tid=0 2024-06-13T02:20:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.499+0000 7f1e245ae740 1 client.25420 shutdown 2024-06-13T02:20:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.499+0000 7f1e245ae740 1 -- 172.21.15.2:0/2442185328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caad5fb0 msgr2=0x5654caada1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.499+0000 7f1e245ae740 1 --2- 172.21.15.2:0/2442185328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caad5fb0 0x5654caada1f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1e1401bbc0 tx=0x7f1e1401cea0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.499+0000 7f1e245ae740 1 -- 172.21.15.2:0/2442185328 shutdown_connections 2024-06-13T02:20:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.499+0000 7f1e245ae740 1 --2- 172.21.15.2:0/2442185328 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5654cab51750 0x5654cab53b40 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.499+0000 7f1e245ae740 1 --2- 172.21.15.2:0/2442185328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5654caad5fb0 0x5654caada1f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.499+0000 7f1e245ae740 1 --2- 172.21.15.2:0/2442185328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654caacc7a0 0x5654caad9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.499+0000 7f1e245ae740 1 --2- 172.21.15.2:0/2442185328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5654caacb230 0x5654caade8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.499+0000 7f1e245ae740 1 -- 172.21.15.2:0/2442185328 >> 172.21.15.2:0/2442185328 conn(0x5654caa93fb0 msgr2=0x5654caacd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.499+0000 7f1e04c00640 0 client.25420 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.500+0000 7f1e245ae740 1 -- 172.21.15.2:0/2442185328 shutdown_connections 2024-06-13T02:20:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.500+0000 7f1e245ae740 1 -- 172.21.15.2:0/2442185328 wait complete. 2024-06-13T02:20:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.500+0000 7f1e245ae740 20 client.25420 trim_cache size 0 max 16384 2024-06-13T02:20:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:20:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:20:07.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:20:07.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.501+0000 7f1e1be00640 1 -- 172.21.15.2:0/1690642708 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f1e000a2d60 msgr2=0x7f1e000a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:07.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.501+0000 7f1e1be00640 1 --2- 172.21.15.2:0/1690642708 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f1e000a2d60 0x7f1e000a5220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x5654caacdf00 tx=0x7f1e0c009260 comp rx=0 tx=0).stop 2024-06-13T02:20:07.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.501+0000 7f1e1be00640 1 -- 172.21.15.2:0/1690642708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e1c1006b0 msgr2=0x7f1e1c19a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.501+0000 7f1e1be00640 1 --2- 172.21.15.2:0/1690642708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e1c1006b0 0x7f1e1c19a2b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c009230 tx=0x7f1e0c004040 comp rx=0 tx=0).stop 2024-06-13T02:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.501+0000 7f1e1be00640 1 -- 172.21.15.2:0/1690642708 shutdown_connections 2024-06-13T02:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.501+0000 7f1e1be00640 1 --2- 172.21.15.2:0/1690642708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e1c1066c0 0x7f1e1c19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.501+0000 7f1e1be00640 1 --2- 172.21.15.2:0/1690642708 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f1e000a2d60 0x7f1e000a5220 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.501+0000 7f1e1be00640 1 --2- 172.21.15.2:0/1690642708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e1c101070 0x7f1e1c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.501+0000 7f1e1be00640 1 --2- 172.21.15.2:0/1690642708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e1c1006b0 0x7f1e1c19a2b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.501+0000 7f1e1be00640 1 -- 172.21.15.2:0/1690642708 >> 172.21.15.2:0/1690642708 conn(0x7f1e1c0fc180 msgr2=0x7f1e1c10be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.501+0000 7f1e1be00640 1 -- 172.21.15.2:0/1690642708 shutdown_connections 2024-06-13T02:20:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:07.501+0000 7f1e1be00640 1 -- 172.21.15.2:0/1690642708 wait complete. 2024-06-13T02:20:08.474 INFO:tasks.workunit.client.0.smithi002.stdout: 1 97067 7.49 MB/sec warmup 72 sec latency 15.938 ms 2024-06-13T02:20:09.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:08 smithi175 ceph-mon[36977]: pgmap v72: 129 pgs: 129 active+clean; 39 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 220 op/s 2024-06-13T02:20:09.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:08 smithi002 ceph-mon[31960]: pgmap v72: 129 pgs: 129 active+clean; 39 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 220 op/s 2024-06-13T02:20:09.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:08 smithi084 ceph-mon[36833]: pgmap v72: 129 pgs: 129 active+clean; 39 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 220 op/s 2024-06-13T02:20:09.474 INFO:tasks.workunit.client.0.smithi002.stdout: 1 99573 7.62 MB/sec warmup 73 sec latency 13.949 ms 2024-06-13T02:20:10.474 INFO:tasks.workunit.client.0.smithi002.stdout: 1 100582 7.55 MB/sec warmup 74 sec latency 12.871 ms 2024-06-13T02:20:11.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:11 smithi175 ceph-mon[36977]: pgmap v73: 129 pgs: 129 active+clean; 39 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 1.0 MiB/s wr, 160 op/s 2024-06-13T02:20:11.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:11 smithi002 ceph-mon[31960]: pgmap v73: 129 pgs: 129 active+clean; 39 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 1.0 MiB/s wr, 160 op/s 2024-06-13T02:20:11.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:11 smithi084 ceph-mon[36833]: pgmap v73: 129 pgs: 129 active+clean; 39 MiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 1.0 MiB/s wr, 160 op/s 2024-06-13T02:20:11.474 INFO:tasks.workunit.client.0.smithi002.stdout: 1 102729 7.61 MB/sec warmup 75 sec latency 13.377 ms 2024-06-13T02:20:12.474 INFO:tasks.workunit.client.0.smithi002.stdout: 1 103925 7.59 MB/sec warmup 76 sec latency 14.601 ms 2024-06-13T02:20:13.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:13 smithi175 ceph-mon[36977]: pgmap v74: 129 pgs: 129 active+clean; 36 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 351 op/s 2024-06-13T02:20:13.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:13 smithi002 ceph-mon[31960]: pgmap v74: 129 pgs: 129 active+clean; 36 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 351 op/s 2024-06-13T02:20:13.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:13 smithi084 ceph-mon[36833]: pgmap v74: 129 pgs: 129 active+clean; 36 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 351 op/s 2024-06-13T02:20:13.474 INFO:tasks.workunit.client.0.smithi002.stdout: 1 105923 7.64 MB/sec warmup 77 sec latency 10.357 ms 2024-06-13T02:20:14.474 INFO:tasks.workunit.client.0.smithi002.stdout: 1 107240 7.63 MB/sec warmup 78 sec latency 13.014 ms 2024-06-13T02:20:15.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:15 smithi175 ceph-mon[36977]: pgmap v75: 129 pgs: 129 active+clean; 36 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 263 op/s 2024-06-13T02:20:15.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:15 smithi002 ceph-mon[31960]: pgmap v75: 129 pgs: 129 active+clean; 36 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 263 op/s 2024-06-13T02:20:15.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:15 smithi084 ceph-mon[36833]: pgmap v75: 129 pgs: 129 active+clean; 36 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 263 op/s 2024-06-13T02:20:15.474 INFO:tasks.workunit.client.0.smithi002.stdout: 1 108929 7.63 MB/sec warmup 79 sec latency 34.796 ms 2024-06-13T02:20:16.475 INFO:tasks.workunit.client.0.smithi002.stdout: 1 110455 7.67 MB/sec warmup 80 sec latency 15.939 ms 2024-06-13T02:20:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:17 smithi175 ceph-mon[36977]: pgmap v76: 129 pgs: 129 active+clean; 42 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 317 op/s 2024-06-13T02:20:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:17 smithi002 ceph-mon[31960]: pgmap v76: 129 pgs: 129 active+clean; 42 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 317 op/s 2024-06-13T02:20:17.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:17 smithi084 ceph-mon[36833]: pgmap v76: 129 pgs: 129 active+clean; 42 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 317 op/s 2024-06-13T02:20:17.475 INFO:tasks.workunit.client.0.smithi002.stdout: 1 111994 7.65 MB/sec warmup 81 sec latency 19.467 ms 2024-06-13T02:20:18.475 INFO:tasks.workunit.client.0.smithi002.stdout: 1 113911 7.72 MB/sec warmup 82 sec latency 10.512 ms 2024-06-13T02:20:19.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:19 smithi175 ceph-mon[36977]: pgmap v77: 129 pgs: 129 active+clean; 43 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 1.3 MiB/s wr, 254 op/s 2024-06-13T02:20:19.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:19 smithi002 ceph-mon[31960]: pgmap v77: 129 pgs: 129 active+clean; 43 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 1.3 MiB/s wr, 254 op/s 2024-06-13T02:20:19.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:19 smithi084 ceph-mon[36833]: pgmap v77: 129 pgs: 129 active+clean; 43 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 1.3 MiB/s wr, 254 op/s 2024-06-13T02:20:19.475 INFO:tasks.workunit.client.0.smithi002.stdout: 1 115235 7.69 MB/sec warmup 83 sec latency 14.653 ms 2024-06-13T02:20:20.476 INFO:tasks.workunit.client.0.smithi002.stdout: 1 117375 7.76 MB/sec warmup 84 sec latency 29.198 ms 2024-06-13T02:20:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.656+0000 7f2a97200640 1 -- 172.21.15.2:0/289015717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a981087a0 msgr2=0x7f2a98114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.656+0000 7f2a97200640 1 --2- 172.21.15.2:0/289015717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a981087a0 0x7f2a98114c60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009900 tx=0x7f2a9002a480 comp rx=0 tx=0).stop 2024-06-13T02:20:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.656+0000 7f2a97200640 1 -- 172.21.15.2:0/289015717 shutdown_connections 2024-06-13T02:20:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.656+0000 7f2a97200640 1 --2- 172.21.15.2:0/289015717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a981087a0 0x7f2a98114c60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.656+0000 7f2a97200640 1 --2- 172.21.15.2:0/289015717 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98107e00 0x7f2a98108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.656+0000 7f2a97200640 1 --2- 172.21.15.2:0/289015717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a9810dec0 0x7f2a9810e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.656+0000 7f2a97200640 1 -- 172.21.15.2:0/289015717 >> 172.21.15.2:0/289015717 conn(0x7f2a98077550 msgr2=0x7f2a98079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:20.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.656+0000 7f2a97200640 1 -- 172.21.15.2:0/289015717 shutdown_connections 2024-06-13T02:20:20.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.656+0000 7f2a97200640 1 -- 172.21.15.2:0/289015717 wait complete. 2024-06-13T02:20:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.657+0000 7f2a97200640 1 Processor -- start 2024-06-13T02:20:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.657+0000 7f2a97200640 1 -- start start 2024-06-13T02:20:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a97200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98107e00 0x7f2a9819e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a97200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a981087a0 0x7f2a9819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a97200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a9810dec0 0x7f2a981a2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a97200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981181f0 con 0x7f2a98107e00 2024-06-13T02:20:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a97200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98118070 con 0x7f2a9810dec0 2024-06-13T02:20:20.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a97200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98118370 con 0x7f2a981087a0 2024-06-13T02:20:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a96800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a9810dec0 0x7f2a981a2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a96800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a9810dec0 0x7f2a981a2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:39288/0 (socket says 172.21.15.2:39288) 2024-06-13T02:20:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a96800640 1 -- 172.21.15.2:0/2973704428 learned_addr learned my addr 172.21.15.2:0/2973704428 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98107e00 0x7f2a9819e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a95400640 1 --2- 172.21.15.2:0/2973704428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a981087a0 0x7f2a9819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a96800640 1 -- 172.21.15.2:0/2973704428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a981087a0 msgr2=0x7f2a9819eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a96800640 1 --2- 172.21.15.2:0/2973704428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a981087a0 0x7f2a9819eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a96800640 1 -- 172.21.15.2:0/2973704428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98107e00 msgr2=0x7f2a9819e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a96800640 1 --2- 172.21.15.2:0/2973704428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98107e00 0x7f2a9819e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.658+0000 7f2a96800640 1 -- 172.21.15.2:0/2973704428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a981a35e0 con 0x7f2a9810dec0 2024-06-13T02:20:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.659+0000 7f2a95400640 1 --2- 172.21.15.2:0/2973704428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a981087a0 0x7f2a9819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:20:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.659+0000 7f2a95e00640 1 --2- 172.21.15.2:0/2973704428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98107e00 0x7f2a9819e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:20:20.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.659+0000 7f2a96800640 1 --2- 172.21.15.2:0/2973704428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a9810dec0 0x7f2a981a2eb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2a90004770 tx=0x7f2a90003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.659+0000 7f2a8ea00640 1 -- 172.21.15.2:0/2973704428 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9003f070 con 0x7f2a9810dec0 2024-06-13T02:20:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.659+0000 7f2a8ea00640 1 -- 172.21.15.2:0/2973704428 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a90031c90 con 0x7f2a9810dec0 2024-06-13T02:20:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.659+0000 7f2a97200640 1 -- 172.21.15.2:0/2973704428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a981a3870 con 0x7f2a9810dec0 2024-06-13T02:20:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.659+0000 7f2a8ea00640 1 -- 172.21.15.2:0/2973704428 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90035030 con 0x7f2a9810dec0 2024-06-13T02:20:20.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.659+0000 7f2a97200640 1 -- 172.21.15.2:0/2973704428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a981ab160 con 0x7f2a9810dec0 2024-06-13T02:20:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.662+0000 7f2a8ea00640 1 -- 172.21.15.2:0/2973704428 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f2a90042070 con 0x7f2a9810dec0 2024-06-13T02:20:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.663+0000 7f2aa001c740 1 Processor -- start 2024-06-13T02:20:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.663+0000 7f2aa001c740 1 -- start start 2024-06-13T02:20:20.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.664+0000 7f2aa001c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180be37a0 0x565180be1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.664+0000 7f2aa001c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be2230 0x565180be26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.664+0000 7f2aa001c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180becfb0 0x565180bef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.664+0000 7f2aa001c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x565180b46420 con 0x565180be37a0 2024-06-13T02:20:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.664+0000 7f2aa001c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x565180aedc50 con 0x565180be2230 2024-06-13T02:20:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.664+0000 7f2aa001c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x565180b423e0 con 0x565180becfb0 2024-06-13T02:20:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.664+0000 7f2a95400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180be37a0 0x565180be1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.664+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be2230 0x565180be26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.664+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be2230 0x565180be26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:39290/0 (socket says 172.21.15.2:39290) 2024-06-13T02:20:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.664+0000 7f2a95e00640 1 -- 172.21.15.2:0/3325940003 learned_addr learned my addr 172.21.15.2:0/3325940003 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.664+0000 7f2a95400640 1 --2- 172.21.15.2:0/3325940003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180becfb0 0x565180bef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.665+0000 7f2a95e00640 1 -- 172.21.15.2:0/3325940003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180becfb0 msgr2=0x565180bef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.665+0000 7f2a95e00640 1 --2- 172.21.15.2:0/3325940003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180becfb0 0x565180bef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.665+0000 7f2a95e00640 1 -- 172.21.15.2:0/3325940003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180be37a0 msgr2=0x565180be1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.665+0000 7f2a95e00640 1 --2- 172.21.15.2:0/3325940003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180be37a0 0x565180be1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.665+0000 7f2a95e00640 1 -- 172.21.15.2:0/3325940003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56518085a210 con 0x565180be2230 2024-06-13T02:20:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.665+0000 7f2a95400640 1 --2- 172.21.15.2:0/3325940003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180becfb0 0x565180bef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:20:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.665+0000 7f2a8ea00640 1 --2- 172.21.15.2:0/2973704428 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2a7c0a2ce0 0x7f2a7c0a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.665+0000 7f2a8ea00640 1 -- 172.21.15.2:0/2973704428 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f2a900efe10 con 0x7f2a9810dec0 2024-06-13T02:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.665+0000 7f2a95e00640 1 --2- 172.21.15.2:0/3325940003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be2230 0x565180be26b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2a800115f0 tx=0x7f2a80011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65b4b60ddf6738f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.665+0000 7f2a95400640 1 --2- 172.21.15.2:0/2973704428 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2a7c0a2ce0 0x7f2a7c0a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.665+0000 7f2a87400640 1 -- 172.21.15.2:0/3325940003 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8001e070 con 0x565180be2230 2024-06-13T02:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.665+0000 7f2a87400640 1 -- 172.21.15.2:0/3325940003 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a8000fb20 con 0x565180be2230 2024-06-13T02:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.665+0000 7f2a87400640 1 -- 172.21.15.2:0/3325940003 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80019c70 con 0x565180be2230 2024-06-13T02:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.666+0000 7f2aa001c740 1 -- 172.21.15.2:0/3325940003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be2230 msgr2=0x565180be26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.666+0000 7f2aa001c740 1 --2- 172.21.15.2:0/3325940003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be2230 0x565180be26b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2a800115f0 tx=0x7f2a80011ab0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.666+0000 7f2a95400640 1 --2- 172.21.15.2:0/2973704428 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2a7c0a2ce0 0x7f2a7c0a51a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x565180bdf9b0 tx=0x7f2a88015040 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.666+0000 7f2aa001c740 1 -- 172.21.15.2:0/3325940003 shutdown_connections 2024-06-13T02:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.666+0000 7f2aa001c740 1 --2- 172.21.15.2:0/3325940003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180becfb0 0x565180bef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.666+0000 7f2aa001c740 1 --2- 172.21.15.2:0/3325940003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be2230 0x565180be26b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.666+0000 7f2aa001c740 1 --2- 172.21.15.2:0/3325940003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180be37a0 0x565180be1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.666+0000 7f2aa001c740 1 -- 172.21.15.2:0/3325940003 >> 172.21.15.2:0/3325940003 conn(0x565180baafb0 msgr2=0x565180bde820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.666+0000 7f2aa001c740 1 -- 172.21.15.2:0/3325940003 shutdown_connections 2024-06-13T02:20:20.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.666+0000 7f2aa001c740 1 -- 172.21.15.2:0/3325940003 wait complete. 2024-06-13T02:20:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.667+0000 7f2aa001c740 1 -- start start 2024-06-13T02:20:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.667+0000 7f2aa001c740 1 Processor -- start 2024-06-13T02:20:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2aa001c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180be2230 0x565180be9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2aa001c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be37a0 0x565180bea4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2aa001c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180becfb0 0x565180bea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2aa001c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x565180befd80 con 0x565180becfb0 2024-06-13T02:20:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2aa001c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x565180b010b0 con 0x565180be37a0 2024-06-13T02:20:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2aa001c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x565180beff00 con 0x565180be2230 2024-06-13T02:20:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2aa001c740 10 client.0 _ll_register_callbacks cb 0x565180aecf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:20:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2a95400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be37a0 0x565180bea4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2a95400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be37a0 0x565180bea4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:39302/0 (socket says 172.21.15.2:39302) 2024-06-13T02:20:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2a95400640 1 -- 172.21.15.2:0/4272827319 learned_addr learned my addr 172.21.15.2:0/4272827319 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2a95e00640 1 --2- 172.21.15.2:0/4272827319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180be2230 0x565180be9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2a96800640 1 --2- 172.21.15.2:0/4272827319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180becfb0 0x565180bea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2a95400640 1 -- 172.21.15.2:0/4272827319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180be2230 msgr2=0x565180be9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2a95400640 1 --2- 172.21.15.2:0/4272827319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180be2230 0x565180be9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2a95400640 1 -- 172.21.15.2:0/4272827319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180becfb0 msgr2=0x565180bea9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2a95400640 1 --2- 172.21.15.2:0/4272827319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180becfb0 0x565180bea9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2a95400640 1 -- 172.21.15.2:0/4272827319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565180926620 con 0x565180be37a0 2024-06-13T02:20:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.668+0000 7f2a95e00640 1 --2- 172.21.15.2:0/4272827319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180be2230 0x565180be9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:20:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.669+0000 7f2a95400640 1 --2- 172.21.15.2:0/4272827319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be37a0 0x565180bea4b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2a88003bf0 tx=0x7f2a88009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aed881e455103a17 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.669+0000 7f2a7be00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:20:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.669+0000 7f2a7be00640 1 -- 172.21.15.2:0/4272827319 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a88023620 con 0x565180be37a0 2024-06-13T02:20:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.669+0000 7f2a7be00640 1 -- 172.21.15.2:0/4272827319 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f2a880237c0 con 0x565180be37a0 2024-06-13T02:20:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.669+0000 7f2aa001c740 1 -- 172.21.15.2:0/4272827319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a8000fb20 con 0x565180be37a0 2024-06-13T02:20:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.669+0000 7f2a7be00640 1 -- 172.21.15.2:0/4272827319 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2a88034050 con 0x565180be37a0 2024-06-13T02:20:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.669+0000 7f2aa001c740 10 client.25445 fetch_fsmap learned FSMap version 28 2024-06-13T02:20:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.669+0000 7f2aa001c740 1 -- 172.21.15.2:0/4272827319 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565180bfc150 con 0x565180be37a0 2024-06-13T02:20:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.670+0000 7f2a7be00640 1 -- 172.21.15.2:0/4272827319 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a8000fb20 con 0x565180be37a0 2024-06-13T02:20:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.670+0000 7f2a7be00640 1 -- 172.21.15.2:0/4272827319 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f2a8802ba80 con 0x565180be37a0 2024-06-13T02:20:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.670+0000 7f2aa001c740 10 client.25445 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:20:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.670+0000 7f2aa001c740 10 client.25445 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:20:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.670+0000 7f2aa001c740 20 client.25445 populate_metadata read hostname 'smithi002' 2024-06-13T02:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.670+0000 7f2aa001c740 1 --2- 172.21.15.2:0/4272827319 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565180bfd660 0x565180bffa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.670+0000 7f2aa001c740 4 client.25445 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.670+0000 7f2aa001c740 1 -- 172.21.15.2:0/4272827319 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565180b53b50 con 0x565180bfd660 2024-06-13T02:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.670+0000 7f2a95e00640 1 --2- 172.21.15.2:0/4272827319 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565180bfd660 0x565180bffa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.671+0000 7f2a95e00640 1 --2- 172.21.15.2:0/4272827319 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565180bfd660 0x565180bffa90 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2dcd69d35ab66b0 server_cookie=6c3c47ada21c37eb in_seq=0 out_seq=0 2024-06-13T02:20:20.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.671+0000 7f2a7be00640 10 client.25445 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.673+0000 7f2a7be00640 1 -- 172.21.15.2:0/4272827319 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x565180b53b50 con 0x565180bfd660 2024-06-13T02:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.673+0000 7f2a7be00640 10 client.25445 handle_command_reply: tid=0 2024-06-13T02:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.673+0000 7f2aa001c740 1 client.25445 shutdown 2024-06-13T02:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.673+0000 7f2aa001c740 1 -- 172.21.15.2:0/4272827319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be37a0 msgr2=0x565180bea4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.673+0000 7f2aa001c740 1 --2- 172.21.15.2:0/4272827319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be37a0 0x565180bea4b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2a88003bf0 tx=0x7f2a88009500 comp rx=0 tx=0).stop 2024-06-13T02:20:20.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.673+0000 7f2aa001c740 1 -- 172.21.15.2:0/4272827319 shutdown_connections 2024-06-13T02:20:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.673+0000 7f2aa001c740 1 --2- 172.21.15.2:0/4272827319 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565180bfd660 0x565180bffa90 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.673+0000 7f2aa001c740 1 --2- 172.21.15.2:0/4272827319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180becfb0 0x565180bea9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.673+0000 7f2a7be00640 0 client.25445 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.673+0000 7f2aa001c740 1 --2- 172.21.15.2:0/4272827319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be37a0 0x565180bea4b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.673+0000 7f2aa001c740 1 --2- 172.21.15.2:0/4272827319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180be2230 0x565180be9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.673+0000 7f2aa001c740 1 -- 172.21.15.2:0/4272827319 >> 172.21.15.2:0/4272827319 conn(0x565180baafb0 msgr2=0x565180be4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.673+0000 7f2aa001c740 1 -- 172.21.15.2:0/4272827319 shutdown_connections 2024-06-13T02:20:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.673+0000 7f2aa001c740 1 -- 172.21.15.2:0/4272827319 wait complete. 2024-06-13T02:20:20.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.673+0000 7f2aa001c740 20 client.25445 trim_cache size 0 max 16384 2024-06-13T02:20:20.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.692+0000 7f2aa001c740 1 Processor -- start 2024-06-13T02:20:20.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.692+0000 7f2aa001c740 1 -- start start 2024-06-13T02:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.693+0000 7f2aa001c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180be2230 0x565180bea640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.693+0000 7f2aa001c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180be37a0 0x565180bde120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.693+0000 7f2aa001c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180becfb0 0x565180bde660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.693+0000 7f2aa001c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981b7b90 con 0x565180be2230 2024-06-13T02:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.693+0000 7f2aa001c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981b5460 con 0x565180becfb0 2024-06-13T02:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.693+0000 7f2aa001c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981b32b0 con 0x565180be37a0 2024-06-13T02:20:20.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.693+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180be2230 0x565180bea640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.693+0000 7f2a96800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180becfb0 0x565180bde660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.693+0000 7f2a95400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180be37a0 0x565180bde120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.693+0000 7f2a96800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180becfb0 0x565180bde660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:39310/0 (socket says 172.21.15.2:39310) 2024-06-13T02:20:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.693+0000 7f2a96800640 1 -- 172.21.15.2:0/1648188903 learned_addr learned my addr 172.21.15.2:0/1648188903 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.694+0000 7f2a96800640 1 -- 172.21.15.2:0/1648188903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180be37a0 msgr2=0x565180bde120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.694+0000 7f2a96800640 1 --2- 172.21.15.2:0/1648188903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180be37a0 0x565180bde120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.694+0000 7f2a96800640 1 -- 172.21.15.2:0/1648188903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180be2230 msgr2=0x565180bea640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.694+0000 7f2a96800640 1 --2- 172.21.15.2:0/1648188903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180be2230 0x565180bea640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.694+0000 7f2a96800640 1 -- 172.21.15.2:0/1648188903 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565180bda000 con 0x565180becfb0 2024-06-13T02:20:20.696 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.694+0000 7f2a95400640 1 --2- 172.21.15.2:0/1648188903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180be37a0 0x565180bde120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.694+0000 7f2a96800640 1 --2- 172.21.15.2:0/1648188903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180becfb0 0x565180bde660 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2a9003b7e0 tx=0x7f2a9003b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dbfebe30f31637f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.694+0000 7f2a86a00640 1 -- 172.21.15.2:0/1648188903 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90049040 con 0x565180becfb0 2024-06-13T02:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.694+0000 7f2a86a00640 1 -- 172.21.15.2:0/1648188903 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a900bc070 con 0x565180becfb0 2024-06-13T02:20:20.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.694+0000 7f2a86a00640 1 -- 172.21.15.2:0/1648188903 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a900ed3b0 con 0x565180becfb0 2024-06-13T02:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.695+0000 7f2aa001c740 1 -- 172.21.15.2:0/1648188903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180becfb0 msgr2=0x565180bde660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.695+0000 7f2aa001c740 1 --2- 172.21.15.2:0/1648188903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180becfb0 0x565180bde660 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2a9003b7e0 tx=0x7f2a9003b730 comp rx=0 tx=0).stop 2024-06-13T02:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.695+0000 7f2aa001c740 1 -- 172.21.15.2:0/1648188903 shutdown_connections 2024-06-13T02:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.695+0000 7f2aa001c740 1 --2- 172.21.15.2:0/1648188903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180becfb0 0x565180bde660 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.695+0000 7f2aa001c740 1 --2- 172.21.15.2:0/1648188903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180be37a0 0x565180bde120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.695+0000 7f2aa001c740 1 --2- 172.21.15.2:0/1648188903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180be2230 0x565180bea640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.695+0000 7f2aa001c740 1 -- 172.21.15.2:0/1648188903 >> 172.21.15.2:0/1648188903 conn(0x565180baafb0 msgr2=0x565180be9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.695+0000 7f2aa001c740 1 -- 172.21.15.2:0/1648188903 shutdown_connections 2024-06-13T02:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.695+0000 7f2aa001c740 1 -- 172.21.15.2:0/1648188903 wait complete. 2024-06-13T02:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.696+0000 7f2aa001c740 1 -- start start 2024-06-13T02:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.696+0000 7f2aa001c740 1 Processor -- start 2024-06-13T02:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.696+0000 7f2aa001c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be2230 0x565180bf59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.696+0000 7f2aa001c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180be37a0 0x565180c04c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.696+0000 7f2aa001c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180becfb0 0x565180c051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.696+0000 7f2aa001c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981b3920 con 0x565180be37a0 2024-06-13T02:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.696+0000 7f2aa001c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981b4d90 con 0x565180be2230 2024-06-13T02:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.696+0000 7f2aa001c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981b3ff0 con 0x565180becfb0 2024-06-13T02:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.697+0000 7f2aa001c740 10 client.0 _ll_register_callbacks cb 0x7f2a880138e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.697+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be2230 0x565180bf59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.697+0000 7f2a95e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be2230 0x565180bf59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:39324/0 (socket says 172.21.15.2:39324) 2024-06-13T02:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.697+0000 7f2a95e00640 1 -- 172.21.15.2:0/1193918101 learned_addr learned my addr 172.21.15.2:0/1193918101 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.697+0000 7f2a95400640 1 --2- 172.21.15.2:0/1193918101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180be37a0 0x565180c04c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.697+0000 7f2a96800640 1 --2- 172.21.15.2:0/1193918101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180becfb0 0x565180c051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.697+0000 7f2a95e00640 1 -- 172.21.15.2:0/1193918101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180becfb0 msgr2=0x565180c051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.697+0000 7f2a95e00640 1 --2- 172.21.15.2:0/1193918101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180becfb0 0x565180c051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.701 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.697+0000 7f2a95e00640 1 -- 172.21.15.2:0/1193918101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180be37a0 msgr2=0x565180c04c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.697+0000 7f2a95e00640 1 --2- 172.21.15.2:0/1193918101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180be37a0 0x565180c04c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.697+0000 7f2a95e00640 1 -- 172.21.15.2:0/1193918101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565180c059f0 con 0x565180be2230 2024-06-13T02:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.697+0000 7f2a95e00640 1 --2- 172.21.15.2:0/1193918101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be2230 0x565180bf59d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2a800197e0 tx=0x7f2a80009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84292b6b4520a109 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.697+0000 7f2a7be00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.698+0000 7f2a7be00640 1 -- 172.21.15.2:0/1193918101 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8001e040 con 0x565180be2230 2024-06-13T02:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.698+0000 7f2a7be00640 1 -- 172.21.15.2:0/1193918101 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f2a80005190 con 0x565180be2230 2024-06-13T02:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.698+0000 7f2aa001c740 1 -- 172.21.15.2:0/1193918101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a900bc070 con 0x565180be2230 2024-06-13T02:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.698+0000 7f2a7be00640 1 -- 172.21.15.2:0/1193918101 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2a80036050 con 0x565180be2230 2024-06-13T02:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.698+0000 7f2aa001c740 10 client.25451 fetch_fsmap learned FSMap version 28 2024-06-13T02:20:20.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.698+0000 7f2aa001c740 1 -- 172.21.15.2:0/1193918101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565180c79380 con 0x565180be2230 2024-06-13T02:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.698+0000 7f2a7be00640 1 -- 172.21.15.2:0/1193918101 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a900bc070 con 0x565180be2230 2024-06-13T02:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.698+0000 7f2a7be00640 1 -- 172.21.15.2:0/1193918101 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f2a8000f800 con 0x565180be2230 2024-06-13T02:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.699+0000 7f2aa001c740 10 client.25451 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.699+0000 7f2aa001c740 10 client.25451 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.699+0000 7f2aa001c740 20 client.25451 populate_metadata read hostname 'smithi002' 2024-06-13T02:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.699+0000 7f2aa001c740 1 --2- 172.21.15.2:0/1193918101 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565180c79860 0x565180c7bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:20.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.699+0000 7f2aa001c740 4 client.25451 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.699+0000 7f2aa001c740 1 -- 172.21.15.2:0/1193918101 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x565180b4dea0 con 0x565180c79860 2024-06-13T02:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.699+0000 7f2a95400640 1 --2- 172.21.15.2:0/1193918101 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565180c79860 0x565180c7bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.699+0000 7f2a95400640 1 --2- 172.21.15.2:0/1193918101 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565180c79860 0x565180c7bc50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3fad6334220b922 server_cookie=fdb8a4aed3aac99 in_seq=0 out_seq=0 2024-06-13T02:20:20.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.699+0000 7f2a7be00640 10 client.25451 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.861+0000 7f2a7be00640 1 -- 172.21.15.2:0/1193918101 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x565180b4dea0 con 0x565180c79860 2024-06-13T02:20:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.861+0000 7f2a7be00640 10 client.25451 handle_command_reply: tid=0 2024-06-13T02:20:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.861+0000 7f2aa001c740 1 client.25451 shutdown 2024-06-13T02:20:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.861+0000 7f2aa001c740 1 -- 172.21.15.2:0/1193918101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be2230 msgr2=0x565180bf59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.861+0000 7f2aa001c740 1 --2- 172.21.15.2:0/1193918101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be2230 0x565180bf59d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2a800197e0 tx=0x7f2a80009310 comp rx=0 tx=0).stop 2024-06-13T02:20:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.861+0000 7f2aa001c740 1 -- 172.21.15.2:0/1193918101 shutdown_connections 2024-06-13T02:20:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.861+0000 7f2aa001c740 1 --2- 172.21.15.2:0/1193918101 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565180c79860 0x565180c7bc50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.861+0000 7f2aa001c740 1 --2- 172.21.15.2:0/1193918101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565180becfb0 0x565180c051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.861+0000 7f2aa001c740 1 --2- 172.21.15.2:0/1193918101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565180be37a0 0x565180c04c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.861+0000 7f2a7be00640 0 client.25451 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.861+0000 7f2aa001c740 1 --2- 172.21.15.2:0/1193918101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565180be2230 0x565180bf59d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.861+0000 7f2aa001c740 1 -- 172.21.15.2:0/1193918101 >> 172.21.15.2:0/1193918101 conn(0x565180baafb0 msgr2=0x565180be4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.861+0000 7f2aa001c740 1 -- 172.21.15.2:0/1193918101 shutdown_connections 2024-06-13T02:20:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.862+0000 7f2aa001c740 1 -- 172.21.15.2:0/1193918101 wait complete. 2024-06-13T02:20:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.862+0000 7f2aa001c740 20 client.25451 trim_cache size 0 max 16384 2024-06-13T02:20:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:20:20.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:20:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:20:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.863+0000 7f2a97200640 1 -- 172.21.15.2:0/2973704428 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2a7c0a2ce0 msgr2=0x7f2a7c0a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.863+0000 7f2a97200640 1 --2- 172.21.15.2:0/2973704428 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2a7c0a2ce0 0x7f2a7c0a51a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x565180bdf9b0 tx=0x7f2a88015040 comp rx=0 tx=0).stop 2024-06-13T02:20:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.863+0000 7f2a97200640 1 -- 172.21.15.2:0/2973704428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a9810dec0 msgr2=0x7f2a981a2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.863+0000 7f2a97200640 1 --2- 172.21.15.2:0/2973704428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a9810dec0 0x7f2a981a2eb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2a90004770 tx=0x7f2a90003b90 comp rx=0 tx=0).stop 2024-06-13T02:20:20.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.863+0000 7f2a97200640 1 -- 172.21.15.2:0/2973704428 shutdown_connections 2024-06-13T02:20:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.863+0000 7f2a97200640 1 --2- 172.21.15.2:0/2973704428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2a9810dec0 0x7f2a981a2eb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.863+0000 7f2a97200640 1 --2- 172.21.15.2:0/2973704428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a981087a0 0x7f2a9819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.863+0000 7f2a97200640 1 --2- 172.21.15.2:0/2973704428 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2a7c0a2ce0 0x7f2a7c0a51a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.863+0000 7f2a97200640 1 --2- 172.21.15.2:0/2973704428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a98107e00 0x7f2a9819e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.863+0000 7f2a97200640 1 -- 172.21.15.2:0/2973704428 >> 172.21.15.2:0/2973704428 conn(0x7f2a98077550 msgr2=0x7f2a98078c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.863+0000 7f2a97200640 1 -- 172.21.15.2:0/2973704428 shutdown_connections 2024-06-13T02:20:20.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:20.863+0000 7f2a97200640 1 -- 172.21.15.2:0/2973704428 wait complete. 2024-06-13T02:20:21.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:21 smithi175 ceph-mon[36977]: pgmap v78: 129 pgs: 129 active+clean; 43 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 1.2 MiB/s wr, 247 op/s 2024-06-13T02:20:21.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:21 smithi002 ceph-mon[31960]: pgmap v78: 129 pgs: 129 active+clean; 43 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 1.2 MiB/s wr, 247 op/s 2024-06-13T02:20:21.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:21 smithi084 ceph-mon[36833]: pgmap v78: 129 pgs: 129 active+clean; 43 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 1.2 MiB/s wr, 247 op/s 2024-06-13T02:20:21.476 INFO:tasks.workunit.client.0.smithi002.stdout: 1 118328 7.70 MB/sec warmup 85 sec latency 147.778 ms 2024-06-13T02:20:22.476 INFO:tasks.workunit.client.0.smithi002.stdout: 1 120845 7.80 MB/sec warmup 86 sec latency 14.476 ms 2024-06-13T02:20:23.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:23 smithi002 ceph-mon[31960]: pgmap v79: 129 pgs: 129 active+clean; 47 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 311 op/s 2024-06-13T02:20:23.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:23 smithi084 ceph-mon[36833]: pgmap v79: 129 pgs: 129 active+clean; 47 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 311 op/s 2024-06-13T02:20:23.476 INFO:tasks.workunit.client.0.smithi002.stdout: 1 122126 7.77 MB/sec warmup 87 sec latency 9.855 ms 2024-06-13T02:20:23.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:23 smithi175 ceph-mon[36977]: pgmap v79: 129 pgs: 129 active+clean; 47 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 311 op/s 2024-06-13T02:20:24.476 INFO:tasks.workunit.client.0.smithi002.stdout: 1 124426 7.84 MB/sec warmup 88 sec latency 24.823 ms 2024-06-13T02:20:25.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:25 smithi002 ceph-mon[31960]: pgmap v80: 129 pgs: 129 active+clean; 47 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2024-06-13T02:20:25.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:25 smithi084 ceph-mon[36833]: pgmap v80: 129 pgs: 129 active+clean; 47 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2024-06-13T02:20:25.476 INFO:tasks.workunit.client.0.smithi002.stdout: 1 125716 7.81 MB/sec warmup 89 sec latency 36.380 ms 2024-06-13T02:20:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:25 smithi175 ceph-mon[36977]: pgmap v80: 129 pgs: 129 active+clean; 47 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2024-06-13T02:20:26.477 INFO:tasks.workunit.client.0.smithi002.stdout: 1 128039 7.88 MB/sec warmup 90 sec latency 10.813 ms 2024-06-13T02:20:27.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:27 smithi002 ceph-mon[31960]: pgmap v81: 129 pgs: 129 active+clean; 44 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 269 op/s 2024-06-13T02:20:27.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:27 smithi084 ceph-mon[36833]: pgmap v81: 129 pgs: 129 active+clean; 44 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 269 op/s 2024-06-13T02:20:27.477 INFO:tasks.workunit.client.0.smithi002.stdout: 1 129365 7.85 MB/sec warmup 91 sec latency 14.491 ms 2024-06-13T02:20:27.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:27 smithi175 ceph-mon[36977]: pgmap v81: 129 pgs: 129 active+clean; 44 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 269 op/s 2024-06-13T02:20:28.477 INFO:tasks.workunit.client.0.smithi002.stdout: 1 131432 7.90 MB/sec warmup 92 sec latency 11.358 ms 2024-06-13T02:20:29.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:29 smithi002 ceph-mon[31960]: pgmap v82: 129 pgs: 129 active+clean; 44 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 1.7 MiB/s wr, 261 op/s 2024-06-13T02:20:29.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:29 smithi084 ceph-mon[36833]: pgmap v82: 129 pgs: 129 active+clean; 44 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 1.7 MiB/s wr, 261 op/s 2024-06-13T02:20:29.477 INFO:tasks.workunit.client.0.smithi002.stdout: 1 132315 7.85 MB/sec warmup 93 sec latency 80.231 ms 2024-06-13T02:20:29.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:29 smithi175 ceph-mon[36977]: pgmap v82: 129 pgs: 129 active+clean; 44 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 1.7 MiB/s wr, 261 op/s 2024-06-13T02:20:30.477 INFO:tasks.workunit.client.0.smithi002.stdout: 1 134289 7.88 MB/sec warmup 94 sec latency 27.380 ms 2024-06-13T02:20:31.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:31 smithi002 ceph-mon[31960]: pgmap v83: 129 pgs: 129 active+clean; 44 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.6 MiB/s wr, 257 op/s 2024-06-13T02:20:31.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:31 smithi084 ceph-mon[36833]: pgmap v83: 129 pgs: 129 active+clean; 44 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.6 MiB/s wr, 257 op/s 2024-06-13T02:20:31.477 INFO:tasks.workunit.client.0.smithi002.stdout: 1 135610 7.87 MB/sec warmup 95 sec latency 13.660 ms 2024-06-13T02:20:31.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:31 smithi175 ceph-mon[36977]: pgmap v83: 129 pgs: 129 active+clean; 44 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.6 MiB/s wr, 257 op/s 2024-06-13T02:20:32.477 INFO:tasks.workunit.client.0.smithi002.stdout: 1 137374 7.87 MB/sec warmup 96 sec latency 26.966 ms 2024-06-13T02:20:33.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:33 smithi002 ceph-mon[31960]: pgmap v84: 129 pgs: 129 active+clean; 48 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 353 op/s 2024-06-13T02:20:33.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:33 smithi084 ceph-mon[36833]: pgmap v84: 129 pgs: 129 active+clean; 48 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 353 op/s 2024-06-13T02:20:33.478 INFO:tasks.workunit.client.0.smithi002.stdout: 1 138905 7.90 MB/sec warmup 97 sec latency 10.170 ms 2024-06-13T02:20:33.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:33 smithi175 ceph-mon[36977]: pgmap v84: 129 pgs: 129 active+clean; 48 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 353 op/s 2024-06-13T02:20:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.008+0000 7f271d600640 1 -- 172.21.15.2:0/3537912935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27181039b0 msgr2=0x7f2718103e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.008+0000 7f271d600640 1 --2- 172.21.15.2:0/3537912935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27181039b0 0x7f2718103e30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2700009930 tx=0x7f270002a440 comp rx=0 tx=0).stop 2024-06-13T02:20:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.008+0000 7f271d600640 1 -- 172.21.15.2:0/3537912935 shutdown_connections 2024-06-13T02:20:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.008+0000 7f271d600640 1 --2- 172.21.15.2:0/3537912935 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2718104370 0x7f2718110880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.008+0000 7f271d600640 1 --2- 172.21.15.2:0/3537912935 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27181039b0 0x7f2718103e30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.008+0000 7f271d600640 1 --2- 172.21.15.2:0/3537912935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27181099c0 0x7f2718109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.008+0000 7f271d600640 1 -- 172.21.15.2:0/3537912935 >> 172.21.15.2:0/3537912935 conn(0x7f27180ff480 msgr2=0x7f27181018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.009+0000 7f271d600640 1 -- 172.21.15.2:0/3537912935 shutdown_connections 2024-06-13T02:20:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.009+0000 7f271d600640 1 -- 172.21.15.2:0/3537912935 wait complete. 2024-06-13T02:20:34.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.009+0000 7f271d600640 1 Processor -- start 2024-06-13T02:20:34.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.010+0000 7f271d600640 1 -- start start 2024-06-13T02:20:34.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.010+0000 7f271d600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27181039b0 0x7f271819a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.010+0000 7f271d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2718104370 0x7f271819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.010+0000 7f271d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27181099c0 0x7f271819eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.010+0000 7f271d600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2718113dd0 con 0x7f27181039b0 2024-06-13T02:20:34.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.010+0000 7f271d600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2718113c50 con 0x7f27181099c0 2024-06-13T02:20:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.010+0000 7f271d600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2718113f50 con 0x7f2718104370 2024-06-13T02:20:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.010+0000 7f271cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27181099c0 0x7f271819eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.010+0000 7f270fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2718104370 0x7f271819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.010+0000 7f2717e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27181039b0 0x7f271819a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.010+0000 7f270fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2718104370 0x7f271819a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:44462/0 (socket says 172.21.15.2:44462) 2024-06-13T02:20:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.010+0000 7f271cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27181099c0 0x7f271819eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37458/0 (socket says 172.21.15.2:37458) 2024-06-13T02:20:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.010+0000 7f270fe00640 1 -- 172.21.15.2:0/3993059862 learned_addr learned my addr 172.21.15.2:0/3993059862 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.011+0000 7f271cc00640 1 -- 172.21.15.2:0/3993059862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2718104370 msgr2=0x7f271819a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.011+0000 7f271cc00640 1 --2- 172.21.15.2:0/3993059862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2718104370 0x7f271819a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.011+0000 7f271cc00640 1 -- 172.21.15.2:0/3993059862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27181039b0 msgr2=0x7f271819a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.011+0000 7f271cc00640 1 --2- 172.21.15.2:0/3993059862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27181039b0 0x7f271819a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.011+0000 7f271cc00640 1 -- 172.21.15.2:0/3993059862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271819f2b0 con 0x7f27181099c0 2024-06-13T02:20:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.011+0000 7f271cc00640 1 --2- 172.21.15.2:0/3993059862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27181099c0 0x7f271819eb80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f271000ec50 tx=0x7f271000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.011+0000 7f2715600640 1 -- 172.21.15.2:0/3993059862 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2710003b70 con 0x7f27181099c0 2024-06-13T02:20:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.011+0000 7f2715600640 1 -- 172.21.15.2:0/3993059862 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2710003d10 con 0x7f27181099c0 2024-06-13T02:20:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.011+0000 7f271d600640 1 -- 172.21.15.2:0/3993059862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271819f5a0 con 0x7f27181099c0 2024-06-13T02:20:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.011+0000 7f2715600640 1 -- 172.21.15.2:0/3993059862 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2710010890 con 0x7f27181099c0 2024-06-13T02:20:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.012+0000 7f271d600640 1 -- 172.21.15.2:0/3993059862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27181a6e30 con 0x7f27181099c0 2024-06-13T02:20:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.015+0000 7f2715600640 1 -- 172.21.15.2:0/3993059862 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f2710003fe0 con 0x7f27181099c0 2024-06-13T02:20:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.015+0000 7f27219e2740 1 Processor -- start 2024-06-13T02:20:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.015+0000 7f27219e2740 1 -- start start 2024-06-13T02:20:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.015+0000 7f27219e2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb537a0 0x55e82eb51cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.015+0000 7f27219e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb52230 0x55e82eb526b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.015+0000 7f27219e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb5f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.015+0000 7f27219e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e82eab6420 con 0x55e82eb5cfb0 2024-06-13T02:20:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.015+0000 7f27219e2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e82ea5dc50 con 0x55e82eb537a0 2024-06-13T02:20:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.015+0000 7f27219e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e82eab23e0 con 0x55e82eb52230 2024-06-13T02:20:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.016+0000 7f2717e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb52230 0x55e82eb526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.016+0000 7f2717e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb52230 0x55e82eb526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:44468/0 (socket says 172.21.15.2:44468) 2024-06-13T02:20:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.016+0000 7f2717e00640 1 -- 172.21.15.2:0/733265544 learned_addr learned my addr 172.21.15.2:0/733265544 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.016+0000 7f270fe00640 1 --2- 172.21.15.2:0/733265544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb537a0 0x55e82eb51cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.016+0000 7f270fe00640 1 --2- 172.21.15.2:0/733265544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb5f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.016+0000 7f2717e00640 1 -- 172.21.15.2:0/733265544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb537a0 msgr2=0x55e82eb51cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.016+0000 7f2717e00640 1 --2- 172.21.15.2:0/733265544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb537a0 0x55e82eb51cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.016+0000 7f2717e00640 1 -- 172.21.15.2:0/733265544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 msgr2=0x55e82eb5f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.016+0000 7f2717e00640 1 --2- 172.21.15.2:0/733265544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb5f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.016+0000 7f2717e00640 1 -- 172.21.15.2:0/733265544 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e82e7ca210 con 0x55e82eb52230 2024-06-13T02:20:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.016+0000 7f270fe00640 1 --2- 172.21.15.2:0/733265544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb5f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:20:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.016+0000 7f2717e00640 1 --2- 172.21.15.2:0/733265544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb52230 0x55e82eb526b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2708009cd0 tx=0x7f2708011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=882325f6d69873f0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.017+0000 7f270d200640 1 -- 172.21.15.2:0/733265544 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270801e070 con 0x55e82eb52230 2024-06-13T02:20:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.017+0000 7f270d200640 1 -- 172.21.15.2:0/733265544 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2708019b10 con 0x55e82eb52230 2024-06-13T02:20:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.017+0000 7f270d200640 1 -- 172.21.15.2:0/733265544 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270800eae0 con 0x55e82eb52230 2024-06-13T02:20:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.017+0000 7f2715600640 1 --2- 172.21.15.2:0/3993059862 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f26fc0a2ce0 0x7f26fc0a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.017+0000 7f2715600640 1 -- 172.21.15.2:0/3993059862 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f27100cfe30 con 0x7f27181099c0 2024-06-13T02:20:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.017+0000 7f270fe00640 1 --2- 172.21.15.2:0/3993059862 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f26fc0a2ce0 0x7f26fc0a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.017+0000 7f27219e2740 1 -- 172.21.15.2:0/733265544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb52230 msgr2=0x55e82eb526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.017+0000 7f27219e2740 1 --2- 172.21.15.2:0/733265544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb52230 0x55e82eb526b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2708009cd0 tx=0x7f2708011810 comp rx=0 tx=0).stop 2024-06-13T02:20:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.018+0000 7f27219e2740 1 -- 172.21.15.2:0/733265544 shutdown_connections 2024-06-13T02:20:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.018+0000 7f27219e2740 1 --2- 172.21.15.2:0/733265544 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb5f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.018+0000 7f27219e2740 1 --2- 172.21.15.2:0/733265544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb52230 0x55e82eb526b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.018+0000 7f27219e2740 1 --2- 172.21.15.2:0/733265544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb537a0 0x55e82eb51cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.018+0000 7f27219e2740 1 -- 172.21.15.2:0/733265544 >> 172.21.15.2:0/733265544 conn(0x55e82eb1afb0 msgr2=0x55e82eb4e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.018+0000 7f27219e2740 1 -- 172.21.15.2:0/733265544 shutdown_connections 2024-06-13T02:20:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.018+0000 7f27219e2740 1 -- 172.21.15.2:0/733265544 wait complete. 2024-06-13T02:20:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.018+0000 7f270fe00640 1 --2- 172.21.15.2:0/3993059862 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f26fc0a2ce0 0x7f26fc0a51a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2718101b40 tx=0x7f2700031400 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.018+0000 7f27219e2740 1 -- start start 2024-06-13T02:20:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.019+0000 7f27219e2740 1 Processor -- start 2024-06-13T02:20:34.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.019+0000 7f27219e2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb52230 0x55e82eb5a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.019+0000 7f27219e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb537a0 0x55e82eb5a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.019+0000 7f27219e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb5aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.019+0000 7f27219e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e82eb5fd80 con 0x55e82eb5cfb0 2024-06-13T02:20:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.019+0000 7f27219e2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e82ea710b0 con 0x55e82eb52230 2024-06-13T02:20:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.019+0000 7f27219e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e82eb5ff00 con 0x55e82eb537a0 2024-06-13T02:20:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.019+0000 7f27219e2740 10 client.0 _ll_register_callbacks cb 0x55e82ea5cf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:20:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.019+0000 7f271cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb5aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.019+0000 7f270fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb537a0 0x55e82eb5a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.019+0000 7f2717e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb52230 0x55e82eb5a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.020+0000 7f2717e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb52230 0x55e82eb5a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37476/0 (socket says 172.21.15.2:37476) 2024-06-13T02:20:34.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.020+0000 7f270fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb537a0 0x55e82eb5a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:44472/0 (socket says 172.21.15.2:44472) 2024-06-13T02:20:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.020+0000 7f2717e00640 1 -- 172.21.15.2:0/204020354 learned_addr learned my addr 172.21.15.2:0/204020354 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.020+0000 7f2717e00640 1 -- 172.21.15.2:0/204020354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb537a0 msgr2=0x55e82eb5a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.020+0000 7f2717e00640 1 --2- 172.21.15.2:0/204020354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb537a0 0x55e82eb5a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.020+0000 7f2717e00640 1 -- 172.21.15.2:0/204020354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 msgr2=0x55e82eb5aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.020+0000 7f2717e00640 1 --2- 172.21.15.2:0/204020354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb5aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.020+0000 7f2717e00640 1 -- 172.21.15.2:0/204020354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e82e896620 con 0x55e82eb52230 2024-06-13T02:20:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.020+0000 7f2717e00640 1 --2- 172.21.15.2:0/204020354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb52230 0x55e82eb5a000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f270800a010 tx=0x7f2708005da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=106075ce982b0ba4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.020+0000 7f2705600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:20:34.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.021+0000 7f2705600640 1 -- 172.21.15.2:0/204020354 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270801e050 con 0x55e82eb52230 2024-06-13T02:20:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.021+0000 7f2705600640 1 -- 172.21.15.2:0/204020354 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f2708019700 con 0x55e82eb52230 2024-06-13T02:20:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.021+0000 7f27219e2740 1 -- 172.21.15.2:0/204020354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2708019b10 con 0x55e82eb52230 2024-06-13T02:20:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.021+0000 7f2705600640 1 -- 172.21.15.2:0/204020354 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2708032050 con 0x55e82eb52230 2024-06-13T02:20:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.021+0000 7f27219e2740 10 client.25460 fetch_fsmap learned FSMap version 28 2024-06-13T02:20:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.021+0000 7f27219e2740 1 -- 172.21.15.2:0/204020354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e82eb6c090 con 0x55e82eb52230 2024-06-13T02:20:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.021+0000 7f2705600640 1 -- 172.21.15.2:0/204020354 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2708019b10 con 0x55e82eb52230 2024-06-13T02:20:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.021+0000 7f2705600640 1 -- 172.21.15.2:0/204020354 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f270800ec30 con 0x55e82eb52230 2024-06-13T02:20:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.022+0000 7f27219e2740 10 client.25460 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:20:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.022+0000 7f27219e2740 10 client.25460 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:20:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.022+0000 7f27219e2740 20 client.25460 populate_metadata read hostname 'smithi002' 2024-06-13T02:20:34.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.022+0000 7f27219e2740 1 --2- 172.21.15.2:0/204020354 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e82eb6d490 0x55e82eb6f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.022+0000 7f27219e2740 4 client.25460 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:20:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.022+0000 7f27219e2740 1 -- 172.21.15.2:0/204020354 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e82eac3b50 con 0x55e82eb6d490 2024-06-13T02:20:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.022+0000 7f270fe00640 1 --2- 172.21.15.2:0/204020354 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e82eb6d490 0x55e82eb6f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.023+0000 7f270fe00640 1 --2- 172.21.15.2:0/204020354 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e82eb6d490 0x55e82eb6f880 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3acf29eb02561e8d server_cookie=29f6dd007473d1fd in_seq=0 out_seq=0 2024-06-13T02:20:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.023+0000 7f2705600640 10 client.25460 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.023+0000 7f2705600640 1 -- 172.21.15.2:0/204020354 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55e82eac3b50 con 0x55e82eb6d490 2024-06-13T02:20:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.023+0000 7f2705600640 10 client.25460 handle_command_reply: tid=0 2024-06-13T02:20:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.023+0000 7f27219e2740 1 client.25460 shutdown 2024-06-13T02:20:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.024+0000 7f27219e2740 1 -- 172.21.15.2:0/204020354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb52230 msgr2=0x55e82eb5a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.024+0000 7f27219e2740 1 --2- 172.21.15.2:0/204020354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb52230 0x55e82eb5a000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f270800a010 tx=0x7f2708005da0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.024+0000 7f27219e2740 1 -- 172.21.15.2:0/204020354 shutdown_connections 2024-06-13T02:20:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.024+0000 7f27219e2740 1 --2- 172.21.15.2:0/204020354 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e82eb6d490 0x55e82eb6f880 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.024+0000 7f27219e2740 1 --2- 172.21.15.2:0/204020354 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb5aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.024+0000 7f27219e2740 1 --2- 172.21.15.2:0/204020354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb537a0 0x55e82eb5a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.024+0000 7f2705600640 0 client.25460 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.024+0000 7f27219e2740 1 --2- 172.21.15.2:0/204020354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb52230 0x55e82eb5a000 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.024+0000 7f27219e2740 1 -- 172.21.15.2:0/204020354 >> 172.21.15.2:0/204020354 conn(0x55e82eb1afb0 msgr2=0x55e82eb54650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.024+0000 7f27219e2740 1 -- 172.21.15.2:0/204020354 shutdown_connections 2024-06-13T02:20:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.024+0000 7f27219e2740 1 -- 172.21.15.2:0/204020354 wait complete. 2024-06-13T02:20:34.033 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.024+0000 7f27219e2740 20 client.25460 trim_cache size 0 max 16384 2024-06-13T02:20:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.041+0000 7f27219e2740 1 Processor -- start 2024-06-13T02:20:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.041+0000 7f27219e2740 1 -- start start 2024-06-13T02:20:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.041+0000 7f27219e2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb52230 0x55e82eb4e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.041+0000 7f27219e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb537a0 0x55e82eb4e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.041+0000 7f27219e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb74fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.041+0000 7f27219e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27181b38f0 con 0x55e82eb5cfb0 2024-06-13T02:20:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.041+0000 7f27219e2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f27181b11c0 con 0x55e82eb52230 2024-06-13T02:20:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.041+0000 7f27219e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27181af010 con 0x55e82eb537a0 2024-06-13T02:20:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.042+0000 7f2717e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb52230 0x55e82eb4e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.042+0000 7f2717e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb52230 0x55e82eb4e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37488/0 (socket says 172.21.15.2:37488) 2024-06-13T02:20:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.042+0000 7f2717e00640 1 -- 172.21.15.2:0/3356322411 learned_addr learned my addr 172.21.15.2:0/3356322411 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.042+0000 7f270fe00640 1 --2- 172.21.15.2:0/3356322411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb537a0 0x55e82eb4e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.042+0000 7f271cc00640 1 --2- 172.21.15.2:0/3356322411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb74fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.042+0000 7f2717e00640 1 -- 172.21.15.2:0/3356322411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb537a0 msgr2=0x55e82eb4e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:34.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.042+0000 7f2717e00640 1 --2- 172.21.15.2:0/3356322411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb537a0 0x55e82eb4e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.042+0000 7f2717e00640 1 -- 172.21.15.2:0/3356322411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 msgr2=0x55e82eb74fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.042+0000 7f2717e00640 1 --2- 172.21.15.2:0/3356322411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb74fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.042+0000 7f2717e00640 1 -- 172.21.15.2:0/3356322411 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e82eb5af60 con 0x55e82eb52230 2024-06-13T02:20:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.042+0000 7f2717e00640 1 --2- 172.21.15.2:0/3356322411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb52230 0x55e82eb4e120 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f27080058c0 tx=0x7f2708009f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a1e49fe0c9fc075 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.043+0000 7f2707e00640 1 -- 172.21.15.2:0/3356322411 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2708015020 con 0x55e82eb52230 2024-06-13T02:20:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.043+0000 7f2707e00640 1 -- 172.21.15.2:0/3356322411 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f270801f040 con 0x55e82eb52230 2024-06-13T02:20:34.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.043+0000 7f2707e00640 1 -- 172.21.15.2:0/3356322411 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270801e040 con 0x55e82eb52230 2024-06-13T02:20:34.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.043+0000 7f27219e2740 1 -- 172.21.15.2:0/3356322411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb52230 msgr2=0x55e82eb4e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:34.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.043+0000 7f27219e2740 1 --2- 172.21.15.2:0/3356322411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb52230 0x55e82eb4e120 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f27080058c0 tx=0x7f2708009f40 comp rx=0 tx=0).stop 2024-06-13T02:20:34.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.043+0000 7f27219e2740 1 -- 172.21.15.2:0/3356322411 shutdown_connections 2024-06-13T02:20:34.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.043+0000 7f27219e2740 1 --2- 172.21.15.2:0/3356322411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb74fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.043+0000 7f27219e2740 1 --2- 172.21.15.2:0/3356322411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb537a0 0x55e82eb4e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.043+0000 7f27219e2740 1 --2- 172.21.15.2:0/3356322411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb52230 0x55e82eb4e120 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.043+0000 7f27219e2740 1 -- 172.21.15.2:0/3356322411 >> 172.21.15.2:0/3356322411 conn(0x55e82eb1afb0 msgr2=0x55e82eb5a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:34.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.044+0000 7f27219e2740 1 -- 172.21.15.2:0/3356322411 shutdown_connections 2024-06-13T02:20:34.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.044+0000 7f27219e2740 1 -- 172.21.15.2:0/3356322411 wait complete. 2024-06-13T02:20:34.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.044+0000 7f27219e2740 1 -- start start 2024-06-13T02:20:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.044+0000 7f27219e2740 1 Processor -- start 2024-06-13T02:20:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f27219e2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb52230 0x55e82eb65380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f27219e2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb537a0 0x55e82eb658c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f27219e2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb56870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f27219e2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27181af680 con 0x55e82eb5cfb0 2024-06-13T02:20:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f27219e2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f27181b0af0 con 0x55e82eb537a0 2024-06-13T02:20:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f27219e2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27181afd50 con 0x55e82eb52230 2024-06-13T02:20:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f27219e2740 10 client.0 _ll_register_callbacks cb 0x7f270801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:20:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f2717e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb52230 0x55e82eb65380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f270fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb537a0 0x55e82eb658c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f271cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb56870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f270fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb537a0 0x55e82eb658c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37492/0 (socket says 172.21.15.2:37492) 2024-06-13T02:20:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f2717e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb52230 0x55e82eb65380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:44478/0 (socket says 172.21.15.2:44478) 2024-06-13T02:20:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f270fe00640 1 -- 172.21.15.2:0/3193844555 learned_addr learned my addr 172.21.15.2:0/3193844555 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f2717e00640 1 -- 172.21.15.2:0/3193844555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb537a0 msgr2=0x55e82eb658c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f2717e00640 1 --2- 172.21.15.2:0/3193844555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb537a0 0x55e82eb658c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f2717e00640 1 -- 172.21.15.2:0/3193844555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 msgr2=0x55e82eb56870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f2717e00640 1 --2- 172.21.15.2:0/3193844555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb56870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f2717e00640 1 -- 172.21.15.2:0/3193844555 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e82eb56f60 con 0x55e82eb52230 2024-06-13T02:20:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.045+0000 7f270fe00640 1 --2- 172.21.15.2:0/3193844555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb537a0 0x55e82eb658c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:20:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.046+0000 7f2717e00640 1 --2- 172.21.15.2:0/3193844555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb52230 0x55e82eb65380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f27080047b0 tx=0x7f2708019c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26943a3900a7be3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.046+0000 7f2705600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:20:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.046+0000 7f2705600640 1 -- 172.21.15.2:0/3193844555 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2708015030 con 0x55e82eb52230 2024-06-13T02:20:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.046+0000 7f2705600640 1 -- 172.21.15.2:0/3193844555 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f2708019e00 con 0x55e82eb52230 2024-06-13T02:20:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.046+0000 7f27219e2740 1 -- 172.21.15.2:0/3193844555 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f270801f040 con 0x55e82eb52230 2024-06-13T02:20:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.046+0000 7f2705600640 1 -- 172.21.15.2:0/3193844555 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f270801e050 con 0x55e82eb52230 2024-06-13T02:20:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.046+0000 7f27219e2740 10 client.25456 fetch_fsmap learned FSMap version 28 2024-06-13T02:20:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.046+0000 7f27219e2740 1 -- 172.21.15.2:0/3193844555 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e82ebd7920 con 0x55e82eb52230 2024-06-13T02:20:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.047+0000 7f2705600640 1 -- 172.21.15.2:0/3193844555 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f270801f040 con 0x55e82eb52230 2024-06-13T02:20:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.047+0000 7f2705600640 1 -- 172.21.15.2:0/3193844555 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f2708025720 con 0x55e82eb52230 2024-06-13T02:20:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.047+0000 7f27219e2740 10 client.25456 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:20:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.047+0000 7f27219e2740 10 client.25456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:20:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.047+0000 7f27219e2740 20 client.25456 populate_metadata read hostname 'smithi002' 2024-06-13T02:20:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.047+0000 7f27219e2740 1 --2- 172.21.15.2:0/3193844555 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e82ebd8000 0x55e82ebda420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.047+0000 7f27219e2740 4 client.25456 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:20:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.047+0000 7f27219e2740 1 -- 172.21.15.2:0/3193844555 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e82eabdea0 con 0x55e82ebd8000 2024-06-13T02:20:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.047+0000 7f270fe00640 1 --2- 172.21.15.2:0/3193844555 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e82ebd8000 0x55e82ebda420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.048+0000 7f270fe00640 1 --2- 172.21.15.2:0/3193844555 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e82ebd8000 0x55e82ebda420 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67e137ec46b9a104 server_cookie=1a8635a0d83d4066 in_seq=0 out_seq=0 2024-06-13T02:20:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.048+0000 7f2705600640 10 client.25456 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.266+0000 7f2705600640 1 -- 172.21.15.2:0/3193844555 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55e82eabdea0 con 0x55e82ebd8000 2024-06-13T02:20:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.266+0000 7f2705600640 10 client.25456 handle_command_reply: tid=0 2024-06-13T02:20:34.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.266+0000 7f27219e2740 1 client.25456 shutdown 2024-06-13T02:20:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.267+0000 7f27219e2740 1 -- 172.21.15.2:0/3193844555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb52230 msgr2=0x55e82eb65380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.267+0000 7f27219e2740 1 --2- 172.21.15.2:0/3193844555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb52230 0x55e82eb65380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f27080047b0 tx=0x7f2708019c10 comp rx=0 tx=0).stop 2024-06-13T02:20:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.267+0000 7f27219e2740 1 -- 172.21.15.2:0/3193844555 shutdown_connections 2024-06-13T02:20:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.268+0000 7f27219e2740 1 --2- 172.21.15.2:0/3193844555 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e82ebd8000 0x55e82ebda420 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.268+0000 7f27219e2740 1 --2- 172.21.15.2:0/3193844555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e82eb5cfb0 0x55e82eb56870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.268+0000 7f27219e2740 1 --2- 172.21.15.2:0/3193844555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e82eb537a0 0x55e82eb658c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.268+0000 7f27219e2740 1 --2- 172.21.15.2:0/3193844555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e82eb52230 0x55e82eb65380 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.268+0000 7f27219e2740 1 -- 172.21.15.2:0/3193844555 >> 172.21.15.2:0/3193844555 conn(0x55e82eb1afb0 msgr2=0x55e82eb53d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:34.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.268+0000 7f2705600640 0 client.25456 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:34.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.268+0000 7f27219e2740 1 -- 172.21.15.2:0/3193844555 shutdown_connections 2024-06-13T02:20:34.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.268+0000 7f27219e2740 1 -- 172.21.15.2:0/3193844555 wait complete. 2024-06-13T02:20:34.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.268+0000 7f27219e2740 20 client.25456 trim_cache size 0 max 16384 2024-06-13T02:20:34.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:20:34.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:20:34.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:20:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.270+0000 7f271d600640 1 -- 172.21.15.2:0/3993059862 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f26fc0a2ce0 msgr2=0x7f26fc0a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.270+0000 7f271d600640 1 --2- 172.21.15.2:0/3993059862 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f26fc0a2ce0 0x7f26fc0a51a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2718101b40 tx=0x7f2700031400 comp rx=0 tx=0).stop 2024-06-13T02:20:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.270+0000 7f271d600640 1 -- 172.21.15.2:0/3993059862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27181099c0 msgr2=0x7f271819eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.270+0000 7f271d600640 1 --2- 172.21.15.2:0/3993059862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27181099c0 0x7f271819eb80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f271000ec50 tx=0x7f271000c6a0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.271+0000 7f271d600640 1 -- 172.21.15.2:0/3993059862 shutdown_connections 2024-06-13T02:20:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.271+0000 7f271d600640 1 --2- 172.21.15.2:0/3993059862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27181099c0 0x7f271819eb80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.271+0000 7f271d600640 1 --2- 172.21.15.2:0/3993059862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2718104370 0x7f271819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.271+0000 7f271d600640 1 --2- 172.21.15.2:0/3993059862 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f26fc0a2ce0 0x7f26fc0a51a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.271+0000 7f271d600640 1 --2- 172.21.15.2:0/3993059862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27181039b0 0x7f271819a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:34.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.271+0000 7f271d600640 1 -- 172.21.15.2:0/3993059862 >> 172.21.15.2:0/3993059862 conn(0x7f27180ff480 msgr2=0x7f27180ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:34.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.271+0000 7f271d600640 1 -- 172.21.15.2:0/3993059862 shutdown_connections 2024-06-13T02:20:34.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:34.271+0000 7f271d600640 1 -- 172.21.15.2:0/3993059862 wait complete. 2024-06-13T02:20:34.478 INFO:tasks.workunit.client.0.smithi002.stdout: 1 140287 7.88 MB/sec warmup 98 sec latency 112.685 ms 2024-06-13T02:20:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:35 smithi002 ceph-mon[31960]: pgmap v85: 129 pgs: 129 active+clean; 48 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 2.3 MiB/s wr, 290 op/s 2024-06-13T02:20:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:35 smithi084 ceph-mon[36833]: pgmap v85: 129 pgs: 129 active+clean; 48 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 2.3 MiB/s wr, 290 op/s 2024-06-13T02:20:35.478 INFO:tasks.workunit.client.0.smithi002.stdout: 1 142281 7.94 MB/sec warmup 99 sec latency 16.652 ms 2024-06-13T02:20:35.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:35 smithi175 ceph-mon[36977]: pgmap v85: 129 pgs: 129 active+clean; 48 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 2.3 MiB/s wr, 290 op/s 2024-06-13T02:20:36.478 INFO:tasks.workunit.client.0.smithi002.stdout: 1 143878 7.91 MB/sec warmup 100 sec latency 13.176 ms 2024-06-13T02:20:37.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:37 smithi002 ceph-mon[31960]: pgmap v86: 129 pgs: 129 active+clean; 40 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 443 op/s 2024-06-13T02:20:37.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:37 smithi084 ceph-mon[36833]: pgmap v86: 129 pgs: 129 active+clean; 40 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 443 op/s 2024-06-13T02:20:37.478 INFO:tasks.workunit.client.0.smithi002.stdout: 1 145846 7.97 MB/sec warmup 101 sec latency 12.382 ms 2024-06-13T02:20:37.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:37 smithi175 ceph-mon[36977]: pgmap v86: 129 pgs: 129 active+clean; 40 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 443 op/s 2024-06-13T02:20:38.478 INFO:tasks.workunit.client.0.smithi002.stdout: 1 147496 7.95 MB/sec warmup 102 sec latency 12.093 ms 2024-06-13T02:20:39.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:39 smithi002 ceph-mon[31960]: pgmap v87: 129 pgs: 129 active+clean; 40 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 2.2 MiB/s wr, 333 op/s 2024-06-13T02:20:39.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:39 smithi084 ceph-mon[36833]: pgmap v87: 129 pgs: 129 active+clean; 40 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 2.2 MiB/s wr, 333 op/s 2024-06-13T02:20:39.478 INFO:tasks.workunit.client.0.smithi002.stdout: 1 149272 8.00 MB/sec warmup 103 sec latency 42.327 ms 2024-06-13T02:20:39.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:39 smithi175 ceph-mon[36977]: pgmap v87: 129 pgs: 129 active+clean; 40 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 2.2 MiB/s wr, 333 op/s 2024-06-13T02:20:40.478 INFO:tasks.workunit.client.0.smithi002.stdout: 1 150488 7.97 MB/sec warmup 104 sec latency 22.116 ms 2024-06-13T02:20:41.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:41 smithi002 ceph-mon[31960]: pgmap v88: 129 pgs: 129 active+clean; 40 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 2.0 MiB/s wr, 288 op/s 2024-06-13T02:20:41.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:41 smithi084 ceph-mon[36833]: pgmap v88: 129 pgs: 129 active+clean; 40 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 2.0 MiB/s wr, 288 op/s 2024-06-13T02:20:41.478 INFO:tasks.workunit.client.0.smithi002.stdout: 1 152646 8.02 MB/sec warmup 105 sec latency 11.521 ms 2024-06-13T02:20:41.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:41 smithi175 ceph-mon[36977]: pgmap v88: 129 pgs: 129 active+clean; 40 MiB data, 711 MiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 2.0 MiB/s wr, 288 op/s 2024-06-13T02:20:42.479 INFO:tasks.workunit.client.0.smithi002.stdout: 1 153609 7.97 MB/sec warmup 106 sec latency 29.205 ms 2024-06-13T02:20:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:43 smithi002 ceph-mon[31960]: pgmap v89: 129 pgs: 129 active+clean; 43 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 387 op/s 2024-06-13T02:20:43.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:43 smithi084 ceph-mon[36833]: pgmap v89: 129 pgs: 129 active+clean; 43 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 387 op/s 2024-06-13T02:20:43.479 INFO:tasks.workunit.client.0.smithi002.stdout: 1 155722 8.00 MB/sec warmup 107 sec latency 11.637 ms 2024-06-13T02:20:43.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:43 smithi175 ceph-mon[36977]: pgmap v89: 129 pgs: 129 active+clean; 43 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 387 op/s 2024-06-13T02:20:44.486 INFO:tasks.workunit.client.0.smithi002.stdout: 1 156898 7.99 MB/sec warmup 108 sec latency 20.129 ms 2024-06-13T02:20:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:45 smithi002 ceph-mon[31960]: pgmap v90: 129 pgs: 129 active+clean; 43 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 291 op/s 2024-06-13T02:20:45.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:45 smithi084 ceph-mon[36833]: pgmap v90: 129 pgs: 129 active+clean; 43 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 291 op/s 2024-06-13T02:20:45.486 INFO:tasks.workunit.client.0.smithi002.stdout: 1 158850 8.01 MB/sec warmup 109 sec latency 30.417 ms 2024-06-13T02:20:45.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:45 smithi175 ceph-mon[36977]: pgmap v90: 129 pgs: 129 active+clean; 43 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 291 op/s 2024-06-13T02:20:46.486 INFO:tasks.workunit.client.0.smithi002.stdout: 1 160166 8.01 MB/sec warmup 110 sec latency 10.555 ms 2024-06-13T02:20:47.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:47 smithi002 ceph-mon[31960]: pgmap v91: 129 pgs: 129 active+clean; 46 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 366 op/s 2024-06-13T02:20:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.437+0000 7f8a9ac00640 1 -- 172.21.15.2:0/3852464286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a941077d0 msgr2=0x7f8a94107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.437+0000 7f8a9ac00640 1 --2- 172.21.15.2:0/3852464286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a941077d0 0x7f8a94107bb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009930 tx=0x7f8a8402a440 comp rx=0 tx=0).stop 2024-06-13T02:20:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.437+0000 7f8a9ac00640 1 -- 172.21.15.2:0/3852464286 shutdown_connections 2024-06-13T02:20:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.437+0000 7f8a9ac00640 1 --2- 172.21.15.2:0/3852464286 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a94102180 0x7f8a9410e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.437+0000 7f8a9ac00640 1 --2- 172.21.15.2:0/3852464286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a941017c0 0x7f8a94101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.437+0000 7f8a9ac00640 1 --2- 172.21.15.2:0/3852464286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a941077d0 0x7f8a94107bb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.437+0000 7f8a9ac00640 1 -- 172.21.15.2:0/3852464286 >> 172.21.15.2:0/3852464286 conn(0x7f8a940fd2b0 msgr2=0x7f8a940ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.437+0000 7f8a9ac00640 1 -- 172.21.15.2:0/3852464286 shutdown_connections 2024-06-13T02:20:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.437+0000 7f8a9ac00640 1 -- 172.21.15.2:0/3852464286 wait complete. 2024-06-13T02:20:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.438+0000 7f8a9ac00640 1 Processor -- start 2024-06-13T02:20:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.438+0000 7f8a9ac00640 1 -- start start 2024-06-13T02:20:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.439+0000 7f8a9ac00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a941017c0 0x7f8a9419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.439+0000 7f8a9ac00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a94102180 0x7f8a9419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.439+0000 7f8a9ac00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a941077d0 0x7f8a9419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.439+0000 7f8a9ac00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a94111c30 con 0x7f8a941077d0 2024-06-13T02:20:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.439+0000 7f8a9ac00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8a94111ab0 con 0x7f8a94102180 2024-06-13T02:20:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.439+0000 7f8a9ac00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a94111db0 con 0x7f8a941017c0 2024-06-13T02:20:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.439+0000 7f8a98e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a94102180 0x7f8a9419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.439+0000 7f8a99800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a941017c0 0x7f8a9419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.439+0000 7f8a98e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a94102180 0x7f8a9419a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:50762/0 (socket says 172.21.15.2:50762) 2024-06-13T02:20:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.439+0000 7f8a99800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a941017c0 0x7f8a9419a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:50846/0 (socket says 172.21.15.2:50846) 2024-06-13T02:20:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.439+0000 7f8a98e00640 1 -- 172.21.15.2:0/97640383 learned_addr learned my addr 172.21.15.2:0/97640383 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:47.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.439+0000 7f8a9a200640 1 --2- 172.21.15.2:0/97640383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a941077d0 0x7f8a9419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.440+0000 7f8a99800640 1 -- 172.21.15.2:0/97640383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a94102180 msgr2=0x7f8a9419a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.440+0000 7f8a99800640 1 --2- 172.21.15.2:0/97640383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a94102180 0x7f8a9419a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.440+0000 7f8a99800640 1 -- 172.21.15.2:0/97640383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a941077d0 msgr2=0x7f8a9419ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.440+0000 7f8a99800640 1 --2- 172.21.15.2:0/97640383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a941077d0 0x7f8a9419ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.440+0000 7f8a99800640 1 -- 172.21.15.2:0/97640383 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9419f360 con 0x7f8a941017c0 2024-06-13T02:20:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.440+0000 7f8a98e00640 1 --2- 172.21.15.2:0/97640383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a94102180 0x7f8a9419a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:20:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.440+0000 7f8a99800640 1 --2- 172.21.15.2:0/97640383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a941017c0 0x7f8a9419a370 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8a8402a960 tx=0x7f8a84003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.441+0000 7f8a92000640 1 -- 172.21.15.2:0/97640383 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8403f070 con 0x7f8a941017c0 2024-06-13T02:20:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.441+0000 7f8a92000640 1 -- 172.21.15.2:0/97640383 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a84031c90 con 0x7f8a941017c0 2024-06-13T02:20:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.441+0000 7f8a92000640 1 -- 172.21.15.2:0/97640383 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84035030 con 0x7f8a941017c0 2024-06-13T02:20:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.441+0000 7f8a9ac00640 1 -- 172.21.15.2:0/97640383 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9419f5f0 con 0x7f8a941017c0 2024-06-13T02:20:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.441+0000 7f8a9ac00640 1 -- 172.21.15.2:0/97640383 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a941a6ee0 con 0x7f8a941017c0 2024-06-13T02:20:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.444+0000 7f8a92000640 1 -- 172.21.15.2:0/97640383 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f8a84042070 con 0x7f8a941017c0 2024-06-13T02:20:47.447 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.445+0000 7f8a9f01e740 1 Processor -- start 2024-06-13T02:20:47.447 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.446+0000 7f8a9f01e740 1 -- start start 2024-06-13T02:20:47.448 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.446+0000 7f8a9f01e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6ab7a0 0x563e9e6a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.448 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.446+0000 7f8a9f01e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6aa230 0x563e9e6aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.448 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.446+0000 7f8a9f01e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6b4fb0 0x563e9e6b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.448 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.446+0000 7f8a9f01e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563e9e60e420 con 0x563e9e6b4fb0 2024-06-13T02:20:47.448 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.446+0000 7f8a9f01e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563e9e5b5c50 con 0x563e9e6aa230 2024-06-13T02:20:47.448 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.446+0000 7f8a9f01e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563e9e60a3e0 con 0x563e9e6ab7a0 2024-06-13T02:20:47.448 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.447+0000 7f8a9a200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6ab7a0 0x563e9e6a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.449 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.447+0000 7f8a9a200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6ab7a0 0x563e9e6a9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:50850/0 (socket says 172.21.15.2:50850) 2024-06-13T02:20:47.449 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.447+0000 7f8a9a200640 1 -- 172.21.15.2:0/485715145 learned_addr learned my addr 172.21.15.2:0/485715145 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:47.449 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.447+0000 7f8a99800640 1 --2- 172.21.15.2:0/485715145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6aa230 0x563e9e6aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.449 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.447+0000 7f8a98e00640 1 --2- 172.21.15.2:0/485715145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6b4fb0 0x563e9e6b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.447+0000 7f8a92000640 1 --2- 172.21.15.2:0/97640383 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8a780a2d60 0x7f8a780a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.447+0000 7f8a9a200640 1 -- 172.21.15.2:0/485715145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6aa230 msgr2=0x563e9e6aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.447+0000 7f8a9a200640 1 --2- 172.21.15.2:0/485715145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6aa230 0x563e9e6aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.447+0000 7f8a9a200640 1 -- 172.21.15.2:0/485715145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6b4fb0 msgr2=0x563e9e6b73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.447+0000 7f8a9a200640 1 --2- 172.21.15.2:0/485715145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6b4fb0 0x563e9e6b73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.447+0000 7f8a9a200640 1 -- 172.21.15.2:0/485715145 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e9e322210 con 0x563e9e6ab7a0 2024-06-13T02:20:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.447+0000 7f8a92000640 1 -- 172.21.15.2:0/97640383 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f8a840efe60 con 0x7f8a941017c0 2024-06-13T02:20:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.447+0000 7f8a9a200640 1 --2- 172.21.15.2:0/97640383 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8a780a2d60 0x7f8a780a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.448+0000 7f8a9a200640 1 --2- 172.21.15.2:0/485715145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6ab7a0 0x563e9e6a9cf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c0115c0 tx=0x7f8a8c011a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=566a4bb8df7aedb7 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.448+0000 7f8a8aa00640 1 -- 172.21.15.2:0/485715145 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c017050 con 0x563e9e6ab7a0 2024-06-13T02:20:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.448+0000 7f8a8aa00640 1 -- 172.21.15.2:0/485715145 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a8c01bb90 con 0x563e9e6ab7a0 2024-06-13T02:20:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.448+0000 7f8a8aa00640 1 -- 172.21.15.2:0/485715145 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c00e3b0 con 0x563e9e6ab7a0 2024-06-13T02:20:47.451 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.449+0000 7f8a9f01e740 1 -- 172.21.15.2:0/485715145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6ab7a0 msgr2=0x563e9e6a9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:47.451 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.449+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/485715145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6ab7a0 0x563e9e6a9cf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c0115c0 tx=0x7f8a8c011a80 comp rx=0 tx=0).stop 2024-06-13T02:20:47.451 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.449+0000 7f8a9a200640 1 --2- 172.21.15.2:0/97640383 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8a780a2d60 0x7f8a780a5220 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c022000 tx=0x7f8a8c023000 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:47.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.449+0000 7f8a9f01e740 1 -- 172.21.15.2:0/485715145 shutdown_connections 2024-06-13T02:20:47.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.449+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/485715145 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6b4fb0 0x563e9e6b73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.449+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/485715145 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6aa230 0x563e9e6aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.449+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/485715145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6ab7a0 0x563e9e6a9cf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.449+0000 7f8a9f01e740 1 -- 172.21.15.2:0/485715145 >> 172.21.15.2:0/485715145 conn(0x563e9e672fb0 msgr2=0x563e9e6a6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:47.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.449+0000 7f8a9f01e740 1 -- 172.21.15.2:0/485715145 shutdown_connections 2024-06-13T02:20:47.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.449+0000 7f8a9f01e740 1 -- 172.21.15.2:0/485715145 wait complete. 2024-06-13T02:20:47.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.450+0000 7f8a9f01e740 1 -- start start 2024-06-13T02:20:47.452 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.450+0000 7f8a9f01e740 1 Processor -- start 2024-06-13T02:20:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.451+0000 7f8a9f01e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6aa230 0x563e9e6b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.451+0000 7f8a9f01e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6ab7a0 0x563e9e6b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.451+0000 7f8a9f01e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6b4fb0 0x563e9e6b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.451+0000 7f8a9f01e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563e9e6b7d80 con 0x563e9e6ab7a0 2024-06-13T02:20:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.451+0000 7f8a9f01e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563e9e5c90b0 con 0x563e9e6aa230 2024-06-13T02:20:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.451+0000 7f8a9f01e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563e9e6b7f00 con 0x563e9e6b4fb0 2024-06-13T02:20:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.451+0000 7f8a9f01e740 10 client.0 _ll_register_callbacks cb 0x563e9e5b4f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:20:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.451+0000 7f8a99800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6aa230 0x563e9e6b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.451+0000 7f8a9a200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6b4fb0 0x563e9e6b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.451+0000 7f8a99800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6aa230 0x563e9e6b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:50782/0 (socket says 172.21.15.2:50782) 2024-06-13T02:20:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.451+0000 7f8a99800640 1 -- 172.21.15.2:0/2360300038 learned_addr learned my addr 172.21.15.2:0/2360300038 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.451+0000 7f8a98e00640 1 --2- 172.21.15.2:0/2360300038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6ab7a0 0x563e9e6b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.451+0000 7f8a9a200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6b4fb0 0x563e9e6b2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:50860/0 (socket says 172.21.15.2:50860) 2024-06-13T02:20:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.452+0000 7f8a99800640 1 -- 172.21.15.2:0/2360300038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6b4fb0 msgr2=0x563e9e6b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.452+0000 7f8a99800640 1 --2- 172.21.15.2:0/2360300038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6b4fb0 0x563e9e6b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.452+0000 7f8a99800640 1 -- 172.21.15.2:0/2360300038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6ab7a0 msgr2=0x563e9e6b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.452+0000 7f8a99800640 1 --2- 172.21.15.2:0/2360300038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6ab7a0 0x563e9e6b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.452+0000 7f8a99800640 1 -- 172.21.15.2:0/2360300038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e9e3ee620 con 0x563e9e6aa230 2024-06-13T02:20:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.452+0000 7f8a99800640 1 --2- 172.21.15.2:0/2360300038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6aa230 0x563e9e6b1f90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8a84000c00 tx=0x7f8a84031490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c20c4909e0f050c7 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.452+0000 7f8a7f400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:20:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.452+0000 7f8a7f400640 1 -- 172.21.15.2:0/2360300038 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84049070 con 0x563e9e6aa230 2024-06-13T02:20:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.452+0000 7f8a7f400640 1 -- 172.21.15.2:0/2360300038 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f8a840ed400 con 0x563e9e6aa230 2024-06-13T02:20:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.452+0000 7f8a9f01e740 1 -- 172.21.15.2:0/2360300038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a8c01bb90 con 0x563e9e6aa230 2024-06-13T02:20:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.452+0000 7f8a7f400640 1 -- 172.21.15.2:0/2360300038 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8a840bb8b0 con 0x563e9e6aa230 2024-06-13T02:20:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.452+0000 7f8a9f01e740 10 client.25478 fetch_fsmap learned FSMap version 28 2024-06-13T02:20:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.452+0000 7f8a9f01e740 1 -- 172.21.15.2:0/2360300038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563e9e6c3ea0 con 0x563e9e6aa230 2024-06-13T02:20:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.453+0000 7f8a7f400640 1 -- 172.21.15.2:0/2360300038 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a8c01bb90 con 0x563e9e6aa230 2024-06-13T02:20:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.453+0000 7f8a7f400640 1 -- 172.21.15.2:0/2360300038 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f8a840c4730 con 0x563e9e6aa230 2024-06-13T02:20:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.453+0000 7f8a9f01e740 10 client.25478 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:20:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.453+0000 7f8a9f01e740 10 client.25478 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:20:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.453+0000 7f8a9f01e740 20 client.25478 populate_metadata read hostname 'smithi002' 2024-06-13T02:20:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.453+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/2360300038 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563e9e6c53a0 0x563e9e6c7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.453+0000 7f8a9f01e740 4 client.25478 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:20:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.453+0000 7f8a9f01e740 1 -- 172.21.15.2:0/2360300038 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e9e61bb50 con 0x563e9e6c53a0 2024-06-13T02:20:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.453+0000 7f8a98e00640 1 --2- 172.21.15.2:0/2360300038 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563e9e6c53a0 0x563e9e6c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.454+0000 7f8a98e00640 1 --2- 172.21.15.2:0/2360300038 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563e9e6c53a0 0x563e9e6c7840 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5a1d692d1cf297 server_cookie=62492fcddc9fa6f6 in_seq=0 out_seq=0 2024-06-13T02:20:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.454+0000 7f8a7f400640 10 client.25478 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.456+0000 7f8a7f400640 1 -- 172.21.15.2:0/2360300038 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563e9e61bb50 con 0x563e9e6c53a0 2024-06-13T02:20:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.456+0000 7f8a7f400640 10 client.25478 handle_command_reply: tid=0 2024-06-13T02:20:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.456+0000 7f8a9f01e740 1 client.25478 shutdown 2024-06-13T02:20:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.457+0000 7f8a9f01e740 1 -- 172.21.15.2:0/2360300038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6aa230 msgr2=0x563e9e6b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.457+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/2360300038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6aa230 0x563e9e6b1f90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8a84000c00 tx=0x7f8a84031490 comp rx=0 tx=0).stop 2024-06-13T02:20:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.457+0000 7f8a9f01e740 1 -- 172.21.15.2:0/2360300038 shutdown_connections 2024-06-13T02:20:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.457+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/2360300038 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563e9e6c53a0 0x563e9e6c7840 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.457+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/2360300038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6b4fb0 0x563e9e6b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.457+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/2360300038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6ab7a0 0x563e9e6b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.457+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/2360300038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6aa230 0x563e9e6b1f90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.457+0000 7f8a7f400640 0 client.25478 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.457+0000 7f8a9f01e740 1 -- 172.21.15.2:0/2360300038 >> 172.21.15.2:0/2360300038 conn(0x563e9e672fb0 msgr2=0x563e9e6ac650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.457+0000 7f8a9f01e740 1 -- 172.21.15.2:0/2360300038 shutdown_connections 2024-06-13T02:20:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.457+0000 7f8a9f01e740 1 -- 172.21.15.2:0/2360300038 wait complete. 2024-06-13T02:20:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.457+0000 7f8a9f01e740 20 client.25478 trim_cache size 0 max 16384 2024-06-13T02:20:47.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:47 smithi084 ceph-mon[36833]: pgmap v91: 129 pgs: 129 active+clean; 46 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 366 op/s 2024-06-13T02:20:47.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.476+0000 7f8a9f01e740 1 Processor -- start 2024-06-13T02:20:47.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.476+0000 7f8a9f01e740 1 -- start start 2024-06-13T02:20:47.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.476+0000 7f8a9f01e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6aa230 0x563e9e6a5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.476+0000 7f8a9f01e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6ab7a0 0x563e9e6cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.476+0000 7f8a9f01e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6b4fb0 0x563e9e6cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.476+0000 7f8a9f01e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941b3800 con 0x563e9e6b4fb0 2024-06-13T02:20:47.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.476+0000 7f8a9f01e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941b10d0 con 0x563e9e6ab7a0 2024-06-13T02:20:47.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.476+0000 7f8a9f01e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941aef20 con 0x563e9e6aa230 2024-06-13T02:20:47.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.477+0000 7f8a9a200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6b4fb0 0x563e9e6cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.477+0000 7f8a98e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6ab7a0 0x563e9e6cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.477+0000 7f8a99800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6aa230 0x563e9e6a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.477+0000 7f8a98e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6ab7a0 0x563e9e6cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:50788/0 (socket says 172.21.15.2:50788) 2024-06-13T02:20:47.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.477+0000 7f8a98e00640 1 -- 172.21.15.2:0/3484668692 learned_addr learned my addr 172.21.15.2:0/3484668692 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:47.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.477+0000 7f8a99800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6aa230 0x563e9e6a5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:50864/0 (socket says 172.21.15.2:50864) 2024-06-13T02:20:47.479 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.477+0000 7f8a98e00640 1 -- 172.21.15.2:0/3484668692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6aa230 msgr2=0x563e9e6a5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.477+0000 7f8a98e00640 1 --2- 172.21.15.2:0/3484668692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6aa230 0x563e9e6a5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.477+0000 7f8a98e00640 1 -- 172.21.15.2:0/3484668692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6b4fb0 msgr2=0x563e9e6cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.477+0000 7f8a98e00640 1 --2- 172.21.15.2:0/3484668692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6b4fb0 0x563e9e6cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.477+0000 7f8a98e00640 1 -- 172.21.15.2:0/3484668692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e9e6aad00 con 0x563e9e6ab7a0 2024-06-13T02:20:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.477+0000 7f8a98e00640 1 --2- 172.21.15.2:0/3484668692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6ab7a0 0x563e9e6cd150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8a9410eb00 tx=0x7f8a8000b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32f5c3befe3609c8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.477+0000 7f8a8a000640 1 -- 172.21.15.2:0/3484668692 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80020020 con 0x563e9e6ab7a0 2024-06-13T02:20:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.478+0000 7f8a8a000640 1 -- 172.21.15.2:0/3484668692 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a8001cb50 con 0x563e9e6ab7a0 2024-06-13T02:20:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.478+0000 7f8a8a000640 1 -- 172.21.15.2:0/3484668692 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80010db0 con 0x563e9e6ab7a0 2024-06-13T02:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.478+0000 7f8a9f01e740 1 -- 172.21.15.2:0/3484668692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6ab7a0 msgr2=0x563e9e6cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.478+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/3484668692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6ab7a0 0x563e9e6cd150 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8a9410eb00 tx=0x7f8a8000b660 comp rx=0 tx=0).stop 2024-06-13T02:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.478+0000 7f8a9f01e740 1 -- 172.21.15.2:0/3484668692 shutdown_connections 2024-06-13T02:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.478+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/3484668692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6b4fb0 0x563e9e6cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.478+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/3484668692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6ab7a0 0x563e9e6cd150 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.478+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/3484668692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6aa230 0x563e9e6a5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.478+0000 7f8a9f01e740 1 -- 172.21.15.2:0/3484668692 >> 172.21.15.2:0/3484668692 conn(0x563e9e672fb0 msgr2=0x563e9e6a5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.479+0000 7f8a9f01e740 1 -- 172.21.15.2:0/3484668692 shutdown_connections 2024-06-13T02:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.479+0000 7f8a9f01e740 1 -- 172.21.15.2:0/3484668692 wait complete. 2024-06-13T02:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.479+0000 7f8a9f01e740 1 -- start start 2024-06-13T02:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.479+0000 7f8a9f01e740 1 Processor -- start 2024-06-13T02:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a9f01e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6aa230 0x563e9e6bd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a9f01e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6ab7a0 0x563e9e6b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a9f01e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6b4fb0 0x563e9e6b9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a9f01e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941af590 con 0x563e9e6b4fb0 2024-06-13T02:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a9f01e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941b0a00 con 0x563e9e6ab7a0 2024-06-13T02:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a9f01e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a941afc60 con 0x563e9e6aa230 2024-06-13T02:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a9f01e740 10 client.0 _ll_register_callbacks cb 0x7f8a84005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a98e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6ab7a0 0x563e9e6b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a98e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6ab7a0 0x563e9e6b8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:50800/0 (socket says 172.21.15.2:50800) 2024-06-13T02:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a98e00640 1 -- 172.21.15.2:0/393269743 learned_addr learned my addr 172.21.15.2:0/393269743 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a9a200640 1 --2- 172.21.15.2:0/393269743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6b4fb0 0x563e9e6b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a99800640 1 --2- 172.21.15.2:0/393269743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6aa230 0x563e9e6bd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a98e00640 1 -- 172.21.15.2:0/393269743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6aa230 msgr2=0x563e9e6bd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a98e00640 1 --2- 172.21.15.2:0/393269743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6aa230 0x563e9e6bd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a98e00640 1 -- 172.21.15.2:0/393269743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6b4fb0 msgr2=0x563e9e6b9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:20:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a98e00640 1 --2- 172.21.15.2:0/393269743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6b4fb0 0x563e9e6b9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a98e00640 1 -- 172.21.15.2:0/393269743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e9e6b9980 con 0x563e9e6ab7a0 2024-06-13T02:20:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.480+0000 7f8a99800640 1 --2- 172.21.15.2:0/393269743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6aa230 0x563e9e6bd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:20:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.481+0000 7f8a98e00640 1 --2- 172.21.15.2:0/393269743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6ab7a0 0x563e9e6b8c10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8a80005f80 tx=0x7f8a8001cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba5aeb6be4c31d90 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:20:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.481+0000 7f8a7f400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:20:47.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.481+0000 7f8a7f400640 1 -- 172.21.15.2:0/393269743 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80020030 con 0x563e9e6ab7a0 2024-06-13T02:20:47.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.481+0000 7f8a7f400640 1 -- 172.21.15.2:0/393269743 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f8a8001c670 con 0x563e9e6ab7a0 2024-06-13T02:20:47.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.481+0000 7f8a9f01e740 1 -- 172.21.15.2:0/393269743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a8001cb50 con 0x563e9e6ab7a0 2024-06-13T02:20:47.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.481+0000 7f8a7f400640 1 -- 172.21.15.2:0/393269743 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8a80036050 con 0x563e9e6ab7a0 2024-06-13T02:20:47.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.481+0000 7f8a9f01e740 10 client.25484 fetch_fsmap learned FSMap version 28 2024-06-13T02:20:47.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.481+0000 7f8a9f01e740 1 -- 172.21.15.2:0/393269743 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563e9e730100 con 0x563e9e6ab7a0 2024-06-13T02:20:47.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.481+0000 7f8a7f400640 1 -- 172.21.15.2:0/393269743 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a8001cb50 con 0x563e9e6ab7a0 2024-06-13T02:20:47.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.482+0000 7f8a7f400640 1 -- 172.21.15.2:0/393269743 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f8a8002d790 con 0x563e9e6ab7a0 2024-06-13T02:20:47.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.482+0000 7f8a9f01e740 10 client.25484 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:20:47.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.482+0000 7f8a9f01e740 10 client.25484 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:20:47.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.482+0000 7f8a9f01e740 20 client.25484 populate_metadata read hostname 'smithi002' 2024-06-13T02:20:47.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.482+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/393269743 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563e9e7307f0 0x563e9e732c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:20:47.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.482+0000 7f8a9f01e740 4 client.25484 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:20:47.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.482+0000 7f8a9f01e740 1 -- 172.21.15.2:0/393269743 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563e9e615ea0 con 0x563e9e7307f0 2024-06-13T02:20:47.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.482+0000 7f8a99800640 1 --2- 172.21.15.2:0/393269743 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563e9e7307f0 0x563e9e732c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:20:47.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.483+0000 7f8a7f400640 10 client.25484 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:47.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.483+0000 7f8a99800640 1 --2- 172.21.15.2:0/393269743 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563e9e7307f0 0x563e9e732c10 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46a3808c960c5d2b server_cookie=b41d34828252bb2a in_seq=0 out_seq=0 2024-06-13T02:20:47.486 INFO:tasks.workunit.client.0.smithi002.stdout: 1 161817 7.99 MB/sec warmup 111 sec latency 17.139 ms 2024-06-13T02:20:47.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:47 smithi175 ceph-mon[36977]: pgmap v91: 129 pgs: 129 active+clean; 46 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 366 op/s 2024-06-13T02:20:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.659+0000 7f8a7f400640 1 -- 172.21.15.2:0/393269743 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x563e9e615ea0 con 0x563e9e7307f0 2024-06-13T02:20:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.659+0000 7f8a7f400640 10 client.25484 handle_command_reply: tid=0 2024-06-13T02:20:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.659+0000 7f8a9f01e740 1 client.25484 shutdown 2024-06-13T02:20:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.659+0000 7f8a9f01e740 1 -- 172.21.15.2:0/393269743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6ab7a0 msgr2=0x563e9e6b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.659+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/393269743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6ab7a0 0x563e9e6b8c10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8a80005f80 tx=0x7f8a8001cdb0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.659+0000 7f8a9f01e740 1 -- 172.21.15.2:0/393269743 shutdown_connections 2024-06-13T02:20:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.659+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/393269743 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563e9e7307f0 0x563e9e732c10 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.659+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/393269743 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563e9e6b4fb0 0x563e9e6b9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.659+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/393269743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563e9e6ab7a0 0x563e9e6b8c10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.659+0000 7f8a9f01e740 1 --2- 172.21.15.2:0/393269743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563e9e6aa230 0x563e9e6bd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.659+0000 7f8a7f400640 0 client.25484 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:20:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.659+0000 7f8a9f01e740 1 -- 172.21.15.2:0/393269743 >> 172.21.15.2:0/393269743 conn(0x563e9e672fb0 msgr2=0x563e9e6a59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.659+0000 7f8a9f01e740 1 -- 172.21.15.2:0/393269743 shutdown_connections 2024-06-13T02:20:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.659+0000 7f8a9f01e740 1 -- 172.21.15.2:0/393269743 wait complete. 2024-06-13T02:20:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.659+0000 7f8a9f01e740 20 client.25484 trim_cache size 0 max 16384 2024-06-13T02:20:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:20:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:20:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:20:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.660+0000 7f8a9ac00640 1 -- 172.21.15.2:0/97640383 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8a780a2d60 msgr2=0x7f8a780a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.660+0000 7f8a9ac00640 1 --2- 172.21.15.2:0/97640383 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8a780a2d60 0x7f8a780a5220 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c022000 tx=0x7f8a8c023000 comp rx=0 tx=0).stop 2024-06-13T02:20:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.660+0000 7f8a9ac00640 1 -- 172.21.15.2:0/97640383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a941017c0 msgr2=0x7f8a9419a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:20:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.660+0000 7f8a9ac00640 1 --2- 172.21.15.2:0/97640383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a941017c0 0x7f8a9419a370 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8a8402a960 tx=0x7f8a84003b90 comp rx=0 tx=0).stop 2024-06-13T02:20:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.660+0000 7f8a9ac00640 1 -- 172.21.15.2:0/97640383 shutdown_connections 2024-06-13T02:20:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.660+0000 7f8a9ac00640 1 --2- 172.21.15.2:0/97640383 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8a780a2d60 0x7f8a780a5220 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.660+0000 7f8a9ac00640 1 --2- 172.21.15.2:0/97640383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a941077d0 0x7f8a9419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.660+0000 7f8a9ac00640 1 --2- 172.21.15.2:0/97640383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a94102180 0x7f8a9419a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.660+0000 7f8a9ac00640 1 --2- 172.21.15.2:0/97640383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a941017c0 0x7f8a9419a370 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:20:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.660+0000 7f8a9ac00640 1 -- 172.21.15.2:0/97640383 >> 172.21.15.2:0/97640383 conn(0x7f8a940fd2b0 msgr2=0x7f8a9410ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:20:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.660+0000 7f8a9ac00640 1 -- 172.21.15.2:0/97640383 shutdown_connections 2024-06-13T02:20:47.663 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:20:47.661+0000 7f8a9ac00640 1 -- 172.21.15.2:0/97640383 wait complete. 2024-06-13T02:20:48.487 INFO:tasks.workunit.client.0.smithi002.stdout: 1 163459 8.04 MB/sec warmup 112 sec latency 119.256 ms 2024-06-13T02:20:49.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:49 smithi002 ceph-mon[31960]: pgmap v92: 129 pgs: 129 active+clean; 47 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 218 op/s 2024-06-13T02:20:49.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:49 smithi084 ceph-mon[36833]: pgmap v92: 129 pgs: 129 active+clean; 47 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 218 op/s 2024-06-13T02:20:49.486 INFO:tasks.workunit.client.0.smithi002.stdout: 1 164671 8.01 MB/sec warmup 113 sec latency 15.873 ms 2024-06-13T02:20:49.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:49 smithi175 ceph-mon[36977]: pgmap v92: 129 pgs: 129 active+clean; 47 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 218 op/s 2024-06-13T02:20:50.487 INFO:tasks.workunit.client.0.smithi002.stdout: 1 166711 8.05 MB/sec warmup 114 sec latency 101.589 ms 2024-06-13T02:20:51.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:51 smithi002 ceph-mon[31960]: pgmap v93: 129 pgs: 129 active+clean; 47 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 179 op/s 2024-06-13T02:20:51.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:51 smithi084 ceph-mon[36833]: pgmap v93: 129 pgs: 129 active+clean; 47 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 179 op/s 2024-06-13T02:20:51.487 INFO:tasks.workunit.client.0.smithi002.stdout: 1 167791 8.01 MB/sec warmup 115 sec latency 10.793 ms 2024-06-13T02:20:51.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:51 smithi175 ceph-mon[36977]: pgmap v93: 129 pgs: 129 active+clean; 47 MiB data, 739 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 179 op/s 2024-06-13T02:20:52.487 INFO:tasks.workunit.client.0.smithi002.stdout: 1 169905 8.04 MB/sec warmup 116 sec latency 18.145 ms 2024-06-13T02:20:53.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:53 smithi002 ceph-mon[31960]: pgmap v94: 129 pgs: 129 active+clean; 42 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 374 op/s 2024-06-13T02:20:53.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:53 smithi084 ceph-mon[36833]: pgmap v94: 129 pgs: 129 active+clean; 42 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 374 op/s 2024-06-13T02:20:53.487 INFO:tasks.workunit.client.0.smithi002.stdout: 1 171100 8.03 MB/sec warmup 117 sec latency 12.533 ms 2024-06-13T02:20:53.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:53 smithi175 ceph-mon[36977]: pgmap v94: 129 pgs: 129 active+clean; 42 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 374 op/s 2024-06-13T02:20:54.487 INFO:tasks.workunit.client.0.smithi002.stdout: 1 173146 8.05 MB/sec warmup 118 sec latency 23.093 ms 2024-06-13T02:20:55.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:55 smithi002 ceph-mon[31960]: pgmap v95: 129 pgs: 129 active+clean; 42 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 1.9 MiB/s wr, 275 op/s 2024-06-13T02:20:55.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:55 smithi084 ceph-mon[36833]: pgmap v95: 129 pgs: 129 active+clean; 42 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 1.9 MiB/s wr, 275 op/s 2024-06-13T02:20:55.487 INFO:tasks.workunit.client.0.smithi002.stdout: 1 174291 8.05 MB/sec warmup 119 sec latency 36.474 ms 2024-06-13T02:20:55.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:55 smithi175 ceph-mon[36977]: pgmap v95: 129 pgs: 129 active+clean; 42 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 1.9 MiB/s wr, 275 op/s 2024-06-13T02:20:57.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:57 smithi002 ceph-mon[31960]: pgmap v96: 129 pgs: 129 active+clean; 45 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 355 op/s 2024-06-13T02:20:57.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:57 smithi084 ceph-mon[36833]: pgmap v96: 129 pgs: 129 active+clean; 45 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 355 op/s 2024-06-13T02:20:57.488 INFO:tasks.workunit.client.0.smithi002.stdout: 1 177650 13.31 MB/sec execute 1 sec latency 16.799 ms 2024-06-13T02:20:57.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:57 smithi175 ceph-mon[36977]: pgmap v96: 129 pgs: 129 active+clean; 45 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 355 op/s 2024-06-13T02:20:58.488 INFO:tasks.workunit.client.0.smithi002.stdout: 1 178927 9.38 MB/sec execute 2 sec latency 12.885 ms 2024-06-13T02:20:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:20:59 smithi002 ceph-mon[31960]: pgmap v97: 129 pgs: 129 active+clean; 45 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 2.3 MiB/s wr, 286 op/s 2024-06-13T02:20:59.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:20:59 smithi084 ceph-mon[36833]: pgmap v97: 129 pgs: 129 active+clean; 45 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 2.3 MiB/s wr, 286 op/s 2024-06-13T02:20:59.488 INFO:tasks.workunit.client.0.smithi002.stdout: 1 181242 10.81 MB/sec execute 3 sec latency 15.079 ms 2024-06-13T02:20:59.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:20:59 smithi175 ceph-mon[36977]: pgmap v97: 129 pgs: 129 active+clean; 45 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 2.3 MiB/s wr, 286 op/s 2024-06-13T02:21:00.488 INFO:tasks.workunit.client.0.smithi002.stdout: 1 182442 9.47 MB/sec execute 4 sec latency 55.129 ms 2024-06-13T02:21:00.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.838+0000 7faae7400640 1 -- 172.21.15.2:0/4000044157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0108f00 msgr2=0x7faae0110ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:00.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.838+0000 7faae7400640 1 --2- 172.21.15.2:0/4000044157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0108f00 0x7faae0110ad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faad8009ca0 tx=0x7faad802a8b0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.838+0000 7faae7400640 1 -- 172.21.15.2:0/4000044157 shutdown_connections 2024-06-13T02:21:00.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.838+0000 7faae7400640 1 --2- 172.21.15.2:0/4000044157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0108f00 0x7faae0110ad0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.838+0000 7faae7400640 1 --2- 172.21.15.2:0/4000044157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faae01047e0 0x7faae0108820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.838+0000 7faae7400640 1 --2- 172.21.15.2:0/4000044157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae0103e30 0x7faae0104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.838+0000 7faae7400640 1 -- 172.21.15.2:0/4000044157 >> 172.21.15.2:0/4000044157 conn(0x7faae00ff650 msgr2=0x7faae0101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:00.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.838+0000 7faae7400640 1 -- 172.21.15.2:0/4000044157 shutdown_connections 2024-06-13T02:21:00.840 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.838+0000 7faae7400640 1 -- 172.21.15.2:0/4000044157 wait complete. 2024-06-13T02:21:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.839+0000 7faae7400640 1 Processor -- start 2024-06-13T02:21:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.839+0000 7faae7400640 1 -- start start 2024-06-13T02:21:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faae7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0103e30 0x7faae019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faae7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae0108f00 0x7faae019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faae7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faae019ed50 0x7faae019f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faae7400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faae0113fb0 con 0x7faae019ed50 2024-06-13T02:21:00.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faae7400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faae0113e30 con 0x7faae0103e30 2024-06-13T02:21:00.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faae7400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faae0114130 con 0x7faae0108f00 2024-06-13T02:21:00.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faae4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0103e30 0x7faae019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faadfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae0108f00 0x7faae019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faae5400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faae019ed50 0x7faae019f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faadfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae0108f00 0x7faae019a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:51692/0 (socket says 172.21.15.2:51692) 2024-06-13T02:21:00.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faae4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0103e30 0x7faae019a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:48980/0 (socket says 172.21.15.2:48980) 2024-06-13T02:21:00.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faadfe00640 1 -- 172.21.15.2:0/4197600225 learned_addr learned my addr 172.21.15.2:0/4197600225 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:00.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faadfe00640 1 -- 172.21.15.2:0/4197600225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0103e30 msgr2=0x7faae019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:00.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faadfe00640 1 --2- 172.21.15.2:0/4197600225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0103e30 0x7faae019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faadfe00640 1 -- 172.21.15.2:0/4197600225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faae019ed50 msgr2=0x7faae019f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:00.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faadfe00640 1 --2- 172.21.15.2:0/4197600225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faae019ed50 0x7faae019f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faadfe00640 1 -- 172.21.15.2:0/4197600225 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae019f840 con 0x7faae0108f00 2024-06-13T02:21:00.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.840+0000 7faae4a00640 1 --2- 172.21.15.2:0/4197600225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0103e30 0x7faae019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:21:00.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.841+0000 7faadfe00640 1 --2- 172.21.15.2:0/4197600225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae0108f00 0x7faae019a9d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faacc00e9f0 tx=0x7faacc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:00.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.841+0000 7faadd600640 1 -- 172.21.15.2:0/4197600225 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faacc00cd80 con 0x7faae0108f00 2024-06-13T02:21:00.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.841+0000 7faae7400640 1 -- 172.21.15.2:0/4197600225 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae019fb30 con 0x7faae0108f00 2024-06-13T02:21:00.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.841+0000 7faae7400640 1 -- 172.21.15.2:0/4197600225 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae01a7370 con 0x7faae0108f00 2024-06-13T02:21:00.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.841+0000 7faadd600640 1 -- 172.21.15.2:0/4197600225 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faacc005030 con 0x7faae0108f00 2024-06-13T02:21:00.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.841+0000 7faadd600640 1 -- 172.21.15.2:0/4197600225 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faacc004c10 con 0x7faae0108f00 2024-06-13T02:21:00.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.845+0000 7faadd600640 1 -- 172.21.15.2:0/4197600225 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7faacc0051e0 con 0x7faae0108f00 2024-06-13T02:21:00.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.845+0000 7faaea3e9740 1 Processor -- start 2024-06-13T02:21:00.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.845+0000 7faaea3e9740 1 -- start start 2024-06-13T02:21:00.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.845+0000 7faaea3e9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e75e0 0x56075e5e5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.845+0000 7faaea3e9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e6070 0x56075e5e64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.845+0000 7faaea3e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5f0df0 0x56075e5f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.845+0000 7faaea3e9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56075e54a420 con 0x56075e5e6070 2024-06-13T02:21:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.846+0000 7faaea3e9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56075e4f1c50 con 0x56075e5e75e0 2024-06-13T02:21:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.846+0000 7faaea3e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56075e5463e0 con 0x56075e5f0df0 2024-06-13T02:21:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.846+0000 7faae5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e75e0 0x56075e5e5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.846+0000 7faadfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5f0df0 0x56075e5f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.846+0000 7faae5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e75e0 0x56075e5e5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:48996/0 (socket says 172.21.15.2:48996) 2024-06-13T02:21:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.846+0000 7faae5400640 1 -- 172.21.15.2:0/1821569640 learned_addr learned my addr 172.21.15.2:0/1821569640 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.846+0000 7faae4a00640 1 --2- 172.21.15.2:0/1821569640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e6070 0x56075e5e64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.846+0000 7faae5400640 1 -- 172.21.15.2:0/1821569640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5f0df0 msgr2=0x56075e5f31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:00.850 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.846+0000 7faae5400640 1 --2- 172.21.15.2:0/1821569640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5f0df0 0x56075e5f31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.850 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.846+0000 7faae5400640 1 -- 172.21.15.2:0/1821569640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e6070 msgr2=0x56075e5e64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:00.850 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.846+0000 7faae5400640 1 --2- 172.21.15.2:0/1821569640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e6070 0x56075e5e64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.850 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.846+0000 7faae5400640 1 -- 172.21.15.2:0/1821569640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56075e25e210 con 0x56075e5e75e0 2024-06-13T02:21:00.850 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.846+0000 7faae4a00640 1 --2- 172.21.15.2:0/1821569640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e6070 0x56075e5e64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:21:00.850 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.846+0000 7faae5400640 1 --2- 172.21.15.2:0/1821569640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e75e0 0x56075e5e5b30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faad8009360 tx=0x7faad8009390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19e2afeffb8f0794 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:00.850 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.847+0000 7faad1c00640 1 -- 172.21.15.2:0/1821569640 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad8030660 con 0x56075e5e75e0 2024-06-13T02:21:00.850 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.847+0000 7faad1c00640 1 -- 172.21.15.2:0/1821569640 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faad8036070 con 0x56075e5e75e0 2024-06-13T02:21:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.847+0000 7faad1c00640 1 -- 172.21.15.2:0/1821569640 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad8004440 con 0x56075e5e75e0 2024-06-13T02:21:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.847+0000 7faadd600640 1 --2- 172.21.15.2:0/4197600225 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7faac80a2d70 0x7faac80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.847+0000 7faadd600640 1 -- 172.21.15.2:0/4197600225 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7faacc0cf6b0 con 0x7faae0108f00 2024-06-13T02:21:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.847+0000 7faaea3e9740 1 -- 172.21.15.2:0/1821569640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e75e0 msgr2=0x56075e5e5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.847+0000 7faaea3e9740 1 --2- 172.21.15.2:0/1821569640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e75e0 0x56075e5e5b30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faad8009360 tx=0x7faad8009390 comp rx=0 tx=0).stop 2024-06-13T02:21:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.847+0000 7faae4a00640 1 --2- 172.21.15.2:0/4197600225 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7faac80a2d70 0x7faac80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.848+0000 7faaea3e9740 1 -- 172.21.15.2:0/1821569640 shutdown_connections 2024-06-13T02:21:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.848+0000 7faaea3e9740 1 --2- 172.21.15.2:0/1821569640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5f0df0 0x56075e5f31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.848+0000 7faaea3e9740 1 --2- 172.21.15.2:0/1821569640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e6070 0x56075e5e64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.848+0000 7faaea3e9740 1 --2- 172.21.15.2:0/1821569640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e75e0 0x56075e5e5b30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.848+0000 7faaea3e9740 1 -- 172.21.15.2:0/1821569640 >> 172.21.15.2:0/1821569640 conn(0x56075e5aefb0 msgr2=0x56075e5e2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.848+0000 7faae4a00640 1 --2- 172.21.15.2:0/4197600225 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7faac80a2d70 0x7faac80a5230 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x56075e5e8d40 tx=0x7faad4005f90 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.848+0000 7faaea3e9740 1 -- 172.21.15.2:0/1821569640 shutdown_connections 2024-06-13T02:21:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.848+0000 7faaea3e9740 1 -- 172.21.15.2:0/1821569640 wait complete. 2024-06-13T02:21:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.849+0000 7faaea3e9740 1 -- start start 2024-06-13T02:21:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.849+0000 7faaea3e9740 1 Processor -- start 2024-06-13T02:21:00.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.850+0000 7faaea3e9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e6070 0x56075e5ede30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.850+0000 7faaea3e9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e75e0 0x56075e5ee370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.850+0000 7faaea3e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5f0df0 0x56075e5ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.850+0000 7faaea3e9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56075e604b70 con 0x56075e5e75e0 2024-06-13T02:21:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.850+0000 7faaea3e9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56075e5050b0 con 0x56075e5e6070 2024-06-13T02:21:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.850+0000 7faaea3e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56075e604cf0 con 0x56075e5f0df0 2024-06-13T02:21:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.850+0000 7faaea3e9740 10 client.0 _ll_register_callbacks cb 0x56075e4f0f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:21:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.850+0000 7faae5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5f0df0 0x56075e5ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.850+0000 7faae4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e6070 0x56075e5ede30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.850+0000 7faadfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e75e0 0x56075e5ee370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.850+0000 7faae5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5f0df0 0x56075e5ee8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:51712/0 (socket says 172.21.15.2:51712) 2024-06-13T02:21:00.857 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.850+0000 7faae5400640 1 -- 172.21.15.2:0/3148371499 learned_addr learned my addr 172.21.15.2:0/3148371499 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.851+0000 7faae5400640 1 -- 172.21.15.2:0/3148371499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e6070 msgr2=0x56075e5ede30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.851+0000 7faae5400640 1 --2- 172.21.15.2:0/3148371499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e6070 0x56075e5ede30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.851+0000 7faae5400640 1 -- 172.21.15.2:0/3148371499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e75e0 msgr2=0x56075e5ee370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.851+0000 7faae5400640 1 --2- 172.21.15.2:0/3148371499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e75e0 0x56075e5ee370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.851+0000 7faae5400640 1 -- 172.21.15.2:0/3148371499 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56075e32a620 con 0x56075e5f0df0 2024-06-13T02:21:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.851+0000 7faadfe00640 1 --2- 172.21.15.2:0/3148371499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e75e0 0x56075e5ee370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:21:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.851+0000 7faae5400640 1 --2- 172.21.15.2:0/3148371499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5f0df0 0x56075e5ee8b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faad802add0 tx=0x7faad8003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=763a3a3bf8a34adc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.851+0000 7faac6000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:21:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.851+0000 7faac6000640 1 -- 172.21.15.2:0/3148371499 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad8057070 con 0x56075e5f0df0 2024-06-13T02:21:00.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.852+0000 7faac6000640 1 -- 172.21.15.2:0/3148371499 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7faad8030d40 con 0x56075e5f0df0 2024-06-13T02:21:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.852+0000 7faaea3e9740 1 -- 172.21.15.2:0/3148371499 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faad8036070 con 0x56075e5f0df0 2024-06-13T02:21:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.852+0000 7faac6000640 1 -- 172.21.15.2:0/3148371499 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faad8003f30 con 0x56075e5f0df0 2024-06-13T02:21:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.852+0000 7faaea3e9740 10 client.25486 fetch_fsmap learned FSMap version 28 2024-06-13T02:21:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.852+0000 7faaea3e9740 1 -- 172.21.15.2:0/3148371499 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56075e604b70 con 0x56075e5f0df0 2024-06-13T02:21:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.852+0000 7faac6000640 1 -- 172.21.15.2:0/3148371499 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faad8036070 con 0x56075e5f0df0 2024-06-13T02:21:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.852+0000 7faac6000640 1 -- 172.21.15.2:0/3148371499 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7faad8043020 con 0x56075e5f0df0 2024-06-13T02:21:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.853+0000 7faaea3e9740 10 client.25486 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:21:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.853+0000 7faaea3e9740 10 client.25486 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:21:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.853+0000 7faaea3e9740 20 client.25486 populate_metadata read hostname 'smithi002' 2024-06-13T02:21:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.853+0000 7faaea3e9740 1 --2- 172.21.15.2:0/3148371499 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56075e612030 0x56075e614420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.853+0000 7faaea3e9740 4 client.25486 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:21:00.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.853+0000 7faaea3e9740 1 -- 172.21.15.2:0/3148371499 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56075e557b50 con 0x56075e612030 2024-06-13T02:21:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.853+0000 7faae4a00640 1 --2- 172.21.15.2:0/3148371499 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56075e612030 0x56075e614420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.854+0000 7faae4a00640 1 --2- 172.21.15.2:0/3148371499 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56075e612030 0x56075e614420 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=810780f6a32bbaa6 server_cookie=5049c05f72c3d30f in_seq=0 out_seq=0 2024-06-13T02:21:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.854+0000 7faac6000640 10 client.25486 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.855+0000 7faac6000640 1 -- 172.21.15.2:0/3148371499 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56075e557b50 con 0x56075e612030 2024-06-13T02:21:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.855+0000 7faac6000640 10 client.25486 handle_command_reply: tid=0 2024-06-13T02:21:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.855+0000 7faaea3e9740 1 client.25486 shutdown 2024-06-13T02:21:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.855+0000 7faaea3e9740 1 -- 172.21.15.2:0/3148371499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5f0df0 msgr2=0x56075e5ee8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.855+0000 7faaea3e9740 1 --2- 172.21.15.2:0/3148371499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5f0df0 0x56075e5ee8b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faad802add0 tx=0x7faad8003ba0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.855+0000 7faaea3e9740 1 -- 172.21.15.2:0/3148371499 shutdown_connections 2024-06-13T02:21:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.855+0000 7faaea3e9740 1 --2- 172.21.15.2:0/3148371499 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56075e612030 0x56075e614420 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.860 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.855+0000 7faaea3e9740 1 --2- 172.21.15.2:0/3148371499 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5f0df0 0x56075e5ee8b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.855+0000 7faaea3e9740 1 --2- 172.21.15.2:0/3148371499 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e75e0 0x56075e5ee370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.855+0000 7faaea3e9740 1 --2- 172.21.15.2:0/3148371499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e6070 0x56075e5ede30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.855+0000 7faaea3e9740 1 -- 172.21.15.2:0/3148371499 >> 172.21.15.2:0/3148371499 conn(0x56075e5aefb0 msgr2=0x56075e5e84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.855+0000 7faac6000640 0 client.25486 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.855+0000 7faaea3e9740 1 -- 172.21.15.2:0/3148371499 shutdown_connections 2024-06-13T02:21:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.855+0000 7faaea3e9740 1 -- 172.21.15.2:0/3148371499 wait complete. 2024-06-13T02:21:00.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.855+0000 7faaea3e9740 20 client.25486 trim_cache size 0 max 16384 2024-06-13T02:21:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.872+0000 7faaea3e9740 1 Processor -- start 2024-06-13T02:21:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.872+0000 7faaea3e9740 1 -- start start 2024-06-13T02:21:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faaea3e9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e6070 0x56075e5ee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faaea3e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5e75e0 0x56075e619b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.873 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faaea3e9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5f0df0 0x56075e61a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faaea3e9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faac00128b0 con 0x56075e5f0df0 2024-06-13T02:21:00.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faaea3e9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faac0010180 con 0x56075e5e6070 2024-06-13T02:21:00.874 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faaea3e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faac000dfd0 con 0x56075e5e75e0 2024-06-13T02:21:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faadfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5e75e0 0x56075e619b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faae4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e6070 0x56075e5ee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faadfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5e75e0 0x56075e619b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:51728/0 (socket says 172.21.15.2:51728) 2024-06-13T02:21:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faadfe00640 1 -- 172.21.15.2:0/4032827259 learned_addr learned my addr 172.21.15.2:0/4032827259 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faae4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e6070 0x56075e5ee6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:49016/0 (socket says 172.21.15.2:49016) 2024-06-13T02:21:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faae5400640 1 --2- 172.21.15.2:0/4032827259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5f0df0 0x56075e61a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faadfe00640 1 -- 172.21.15.2:0/4032827259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e6070 msgr2=0x56075e5ee6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:00.875 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faadfe00640 1 --2- 172.21.15.2:0/4032827259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e6070 0x56075e5ee6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faadfe00640 1 -- 172.21.15.2:0/4032827259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5f0df0 msgr2=0x56075e61a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:00.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faadfe00640 1 --2- 172.21.15.2:0/4032827259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5f0df0 0x56075e61a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.873+0000 7faadfe00640 1 -- 172.21.15.2:0/4032827259 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56075e5e68b0 con 0x56075e5e75e0 2024-06-13T02:21:00.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.874+0000 7faadfe00640 1 --2- 172.21.15.2:0/4032827259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5e75e0 0x56075e619b90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faacc00c6a0 tx=0x7faacc0d5550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36b5bb584f672c80 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:00.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.874+0000 7faad1200640 1 -- 172.21.15.2:0/4032827259 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faacc09bf00 con 0x56075e5e75e0 2024-06-13T02:21:00.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.874+0000 7faad1200640 1 -- 172.21.15.2:0/4032827259 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faacc0ce070 con 0x56075e5e75e0 2024-06-13T02:21:00.876 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.874+0000 7faad1200640 1 -- 172.21.15.2:0/4032827259 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faacc004e40 con 0x56075e5e75e0 2024-06-13T02:21:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.875+0000 7faaea3e9740 1 -- 172.21.15.2:0/4032827259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5e75e0 msgr2=0x56075e619b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.875+0000 7faaea3e9740 1 --2- 172.21.15.2:0/4032827259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5e75e0 0x56075e619b90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faacc00c6a0 tx=0x7faacc0d5550 comp rx=0 tx=0).stop 2024-06-13T02:21:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.875+0000 7faaea3e9740 1 -- 172.21.15.2:0/4032827259 shutdown_connections 2024-06-13T02:21:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.875+0000 7faaea3e9740 1 --2- 172.21.15.2:0/4032827259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5f0df0 0x56075e61a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.875+0000 7faaea3e9740 1 --2- 172.21.15.2:0/4032827259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5e75e0 0x56075e619b90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.875+0000 7faaea3e9740 1 --2- 172.21.15.2:0/4032827259 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5e6070 0x56075e5ee6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.875+0000 7faaea3e9740 1 -- 172.21.15.2:0/4032827259 >> 172.21.15.2:0/4032827259 conn(0x56075e5aefb0 msgr2=0x56075e5ec700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.875+0000 7faaea3e9740 1 -- 172.21.15.2:0/4032827259 shutdown_connections 2024-06-13T02:21:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.875+0000 7faaea3e9740 1 -- 172.21.15.2:0/4032827259 wait complete. 2024-06-13T02:21:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.875+0000 7faaea3e9740 1 -- start start 2024-06-13T02:21:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.876+0000 7faaea3e9740 1 Processor -- start 2024-06-13T02:21:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.876+0000 7faaea3e9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5e6070 0x56075e605070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.876+0000 7faaea3e9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e75e0 0x56075e6055b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.876+0000 7faaea3e9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5f0df0 0x56075e67ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.876+0000 7faaea3e9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7faac000e640 con 0x56075e5e75e0 2024-06-13T02:21:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.876+0000 7faaea3e9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faac000fab0 con 0x56075e5f0df0 2024-06-13T02:21:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.876+0000 7faaea3e9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faac000ed10 con 0x56075e5e6070 2024-06-13T02:21:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.876+0000 7faaea3e9740 10 client.0 _ll_register_callbacks cb 0x7faacc0d5420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:21:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.876+0000 7faae4a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5e6070 0x56075e605070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.876+0000 7faae4a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5e6070 0x56075e605070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:51738/0 (socket says 172.21.15.2:51738) 2024-06-13T02:21:00.881 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.876+0000 7faae4a00640 1 -- 172.21.15.2:0/175984506 learned_addr learned my addr 172.21.15.2:0/175984506 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.876+0000 7faadfe00640 1 --2- 172.21.15.2:0/175984506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e75e0 0x56075e6055b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.876+0000 7faae5400640 1 --2- 172.21.15.2:0/175984506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5f0df0 0x56075e67ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.877+0000 7faae4a00640 1 -- 172.21.15.2:0/175984506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5f0df0 msgr2=0x56075e67ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.877+0000 7faae4a00640 1 --2- 172.21.15.2:0/175984506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5f0df0 0x56075e67ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.877+0000 7faae4a00640 1 -- 172.21.15.2:0/175984506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e75e0 msgr2=0x56075e6055b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.877+0000 7faae4a00640 1 --2- 172.21.15.2:0/175984506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e75e0 0x56075e6055b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.877+0000 7faae4a00640 1 -- 172.21.15.2:0/175984506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56075e605e40 con 0x56075e5e6070 2024-06-13T02:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.877+0000 7faae4a00640 1 --2- 172.21.15.2:0/175984506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5e6070 0x56075e605070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x56075e614b30 tx=0x7faad40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=213625acceeeceba server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.877+0000 7faac6000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.877+0000 7faac6000640 1 -- 172.21.15.2:0/175984506 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad402f070 con 0x56075e5e6070 2024-06-13T02:21:00.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.877+0000 7faaea3e9740 1 -- 172.21.15.2:0/175984506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faacc0ce070 con 0x56075e5e6070 2024-06-13T02:21:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.877+0000 7faac6000640 1 -- 172.21.15.2:0/175984506 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7faad401db90 con 0x56075e5e6070 2024-06-13T02:21:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.878+0000 7faac6000640 1 -- 172.21.15.2:0/175984506 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faad403c050 con 0x56075e5e6070 2024-06-13T02:21:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.878+0000 7faaea3e9740 10 client.25492 fetch_fsmap learned FSMap version 28 2024-06-13T02:21:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.878+0000 7faaea3e9740 1 -- 172.21.15.2:0/175984506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56075e67c1d0 con 0x56075e5e6070 2024-06-13T02:21:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.878+0000 7faac6000640 1 -- 172.21.15.2:0/175984506 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faacc0ce070 con 0x56075e5e6070 2024-06-13T02:21:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.878+0000 7faac6000640 1 -- 172.21.15.2:0/175984506 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7faad4033400 con 0x56075e5e6070 2024-06-13T02:21:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.878+0000 7faaea3e9740 10 client.25492 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:21:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.878+0000 7faaea3e9740 10 client.25492 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:21:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.878+0000 7faaea3e9740 20 client.25492 populate_metadata read hostname 'smithi002' 2024-06-13T02:21:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.878+0000 7faaea3e9740 1 --2- 172.21.15.2:0/175984506 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56075e67c8d0 0x56075e67ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.878+0000 7faaea3e9740 4 client.25492 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:21:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.878+0000 7faaea3e9740 1 -- 172.21.15.2:0/175984506 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56075e551ea0 con 0x56075e67c8d0 2024-06-13T02:21:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.878+0000 7faadfe00640 1 --2- 172.21.15.2:0/175984506 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56075e67c8d0 0x56075e67ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.879+0000 7faadfe00640 1 --2- 172.21.15.2:0/175984506 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56075e67c8d0 0x56075e67ecf0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f99843e810c72b38 server_cookie=a169418884f87db7 in_seq=0 out_seq=0 2024-06-13T02:21:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:00.879+0000 7faac6000640 10 client.25492 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.041+0000 7faac6000640 1 -- 172.21.15.2:0/175984506 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56075e551ea0 con 0x56075e67c8d0 2024-06-13T02:21:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.041+0000 7faac6000640 10 client.25492 handle_command_reply: tid=0 2024-06-13T02:21:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.041+0000 7faaea3e9740 1 client.25492 shutdown 2024-06-13T02:21:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.041+0000 7faaea3e9740 1 -- 172.21.15.2:0/175984506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5e6070 msgr2=0x56075e605070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.041+0000 7faaea3e9740 1 --2- 172.21.15.2:0/175984506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5e6070 0x56075e605070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x56075e614b30 tx=0x7faad40046c0 comp rx=0 tx=0).stop 2024-06-13T02:21:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.042+0000 7faaea3e9740 1 -- 172.21.15.2:0/175984506 shutdown_connections 2024-06-13T02:21:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.042+0000 7faaea3e9740 1 --2- 172.21.15.2:0/175984506 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56075e67c8d0 0x56075e67ecf0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.042+0000 7faaea3e9740 1 --2- 172.21.15.2:0/175984506 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56075e5f0df0 0x56075e67ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.042+0000 7faaea3e9740 1 --2- 172.21.15.2:0/175984506 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56075e5e75e0 0x56075e6055b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.042+0000 7faaea3e9740 1 --2- 172.21.15.2:0/175984506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56075e5e6070 0x56075e605070 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.042+0000 7faaea3e9740 1 -- 172.21.15.2:0/175984506 >> 172.21.15.2:0/175984506 conn(0x56075e5aefb0 msgr2=0x56075e5e0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.042+0000 7faac6000640 0 client.25492 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.043+0000 7faaea3e9740 1 -- 172.21.15.2:0/175984506 shutdown_connections 2024-06-13T02:21:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.043+0000 7faaea3e9740 1 -- 172.21.15.2:0/175984506 wait complete. 2024-06-13T02:21:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.043+0000 7faaea3e9740 20 client.25492 trim_cache size 0 max 16384 2024-06-13T02:21:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:21:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:21:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:21:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.044+0000 7faae7400640 1 -- 172.21.15.2:0/4197600225 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7faac80a2d70 msgr2=0x7faac80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.044+0000 7faae7400640 1 --2- 172.21.15.2:0/4197600225 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7faac80a2d70 0x7faac80a5230 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x56075e5e8d40 tx=0x7faad4005f90 comp rx=0 tx=0).stop 2024-06-13T02:21:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.044+0000 7faae7400640 1 -- 172.21.15.2:0/4197600225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae0108f00 msgr2=0x7faae019a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.044+0000 7faae7400640 1 --2- 172.21.15.2:0/4197600225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae0108f00 0x7faae019a9d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faacc00e9f0 tx=0x7faacc00eeb0 comp rx=0 tx=0).stop 2024-06-13T02:21:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.045+0000 7faae7400640 1 -- 172.21.15.2:0/4197600225 shutdown_connections 2024-06-13T02:21:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.045+0000 7faae7400640 1 --2- 172.21.15.2:0/4197600225 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7faac80a2d70 0x7faac80a5230 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.045+0000 7faae7400640 1 --2- 172.21.15.2:0/4197600225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faae019ed50 0x7faae019f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.045+0000 7faae7400640 1 --2- 172.21.15.2:0/4197600225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faae0108f00 0x7faae019a9d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.045+0000 7faae7400640 1 --2- 172.21.15.2:0/4197600225 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0103e30 0x7faae019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.045+0000 7faae7400640 1 -- 172.21.15.2:0/4197600225 >> 172.21.15.2:0/4197600225 conn(0x7faae00ff650 msgr2=0x7faae0101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.045+0000 7faae7400640 1 -- 172.21.15.2:0/4197600225 shutdown_connections 2024-06-13T02:21:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:01.045+0000 7faae7400640 1 -- 172.21.15.2:0/4197600225 wait complete. 2024-06-13T02:21:01.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:01 smithi002 ceph-mon[31960]: pgmap v98: 129 pgs: 129 active+clean; 45 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 2.2 MiB/s wr, 280 op/s 2024-06-13T02:21:01.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:01 smithi084 ceph-mon[36833]: pgmap v98: 129 pgs: 129 active+clean; 45 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 2.2 MiB/s wr, 280 op/s 2024-06-13T02:21:01.488 INFO:tasks.workunit.client.0.smithi002.stdout: 1 183198 7.83 MB/sec execute 5 sec latency 179.765 ms 2024-06-13T02:21:01.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:01 smithi175 ceph-mon[36977]: pgmap v98: 129 pgs: 129 active+clean; 45 MiB data, 792 MiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 2.2 MiB/s wr, 280 op/s 2024-06-13T02:21:02.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:02 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:21:02.488 INFO:tasks.workunit.client.0.smithi002.stdout: 1 184607 8.43 MB/sec execute 6 sec latency 81.779 ms 2024-06-13T02:21:02.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:02 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:21:02.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:02 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:21:03.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:03 smithi084 ceph-mon[36833]: pgmap v99: 129 pgs: 129 active+clean; 53 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 363 op/s 2024-06-13T02:21:03.488 INFO:tasks.workunit.client.0.smithi002.stdout: 1 185981 8.14 MB/sec execute 7 sec latency 14.975 ms 2024-06-13T02:21:03.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:03 smithi175 ceph-mon[36977]: pgmap v99: 129 pgs: 129 active+clean; 53 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 363 op/s 2024-06-13T02:21:03.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:03 smithi002 ceph-mon[31960]: pgmap v99: 129 pgs: 129 active+clean; 53 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 363 op/s 2024-06-13T02:21:04.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:04 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:21:04.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:04 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:21:04.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:04 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:21:04.488 INFO:tasks.workunit.client.0.smithi002.stdout: 1 187993 8.66 MB/sec execute 8 sec latency 13.120 ms 2024-06-13T02:21:04.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:04 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:21:04.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:04 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:21:04.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:04 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:21:04.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:04 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:21:04.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:04 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:21:04.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:04 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:21:05.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:05 smithi084 ceph-mon[36833]: pgmap v100: 129 pgs: 129 active+clean; 53 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 2.2 MiB/s wr, 168 op/s 2024-06-13T02:21:05.488 INFO:tasks.workunit.client.0.smithi002.stdout: 1 188796 7.93 MB/sec execute 9 sec latency 58.876 ms 2024-06-13T02:21:05.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:05 smithi175 ceph-mon[36977]: pgmap v100: 129 pgs: 129 active+clean; 53 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 2.2 MiB/s wr, 168 op/s 2024-06-13T02:21:05.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:05 smithi002 ceph-mon[31960]: pgmap v100: 129 pgs: 129 active+clean; 53 MiB data, 831 MiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 2.2 MiB/s wr, 168 op/s 2024-06-13T02:21:06.489 INFO:tasks.workunit.client.0.smithi002.stdout: 1 190485 7.87 MB/sec execute 10 sec latency 28.247 ms 2024-06-13T02:21:07.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:07 smithi084 ceph-mon[36833]: pgmap v101: 129 pgs: 129 active+clean; 53 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 339 op/s 2024-06-13T02:21:07.489 INFO:tasks.workunit.client.0.smithi002.stdout: 1 191869 8.16 MB/sec execute 11 sec latency 55.244 ms 2024-06-13T02:21:07.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:07 smithi175 ceph-mon[36977]: pgmap v101: 129 pgs: 129 active+clean; 53 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 339 op/s 2024-06-13T02:21:07.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:07 smithi002 ceph-mon[31960]: pgmap v101: 129 pgs: 129 active+clean; 53 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 339 op/s 2024-06-13T02:21:08.489 INFO:tasks.workunit.client.0.smithi002.stdout: 1 192797 7.69 MB/sec execute 12 sec latency 16.612 ms 2024-06-13T02:21:09.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:09 smithi084 ceph-mon[36833]: pgmap v102: 129 pgs: 129 active+clean; 53 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 267 op/s 2024-06-13T02:21:09.489 INFO:tasks.workunit.client.0.smithi002.stdout: 1 194843 8.04 MB/sec execute 13 sec latency 14.523 ms 2024-06-13T02:21:09.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:09 smithi175 ceph-mon[36977]: pgmap v102: 129 pgs: 129 active+clean; 53 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 267 op/s 2024-06-13T02:21:09.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:09 smithi002 ceph-mon[31960]: pgmap v102: 129 pgs: 129 active+clean; 53 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 267 op/s 2024-06-13T02:21:10.489 INFO:tasks.workunit.client.0.smithi002.stdout: 1 195785 7.82 MB/sec execute 14 sec latency 31.644 ms 2024-06-13T02:21:11.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:11 smithi084 ceph-mon[36833]: pgmap v103: 129 pgs: 129 active+clean; 53 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 2.2 MiB/s wr, 262 op/s 2024-06-13T02:21:11.489 INFO:tasks.workunit.client.0.smithi002.stdout: 1 197845 8.01 MB/sec execute 15 sec latency 27.772 ms 2024-06-13T02:21:11.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:11 smithi175 ceph-mon[36977]: pgmap v103: 129 pgs: 129 active+clean; 53 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 2.2 MiB/s wr, 262 op/s 2024-06-13T02:21:11.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:11 smithi002 ceph-mon[31960]: pgmap v103: 129 pgs: 129 active+clean; 53 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 2.2 MiB/s wr, 262 op/s 2024-06-13T02:21:12.489 INFO:tasks.workunit.client.0.smithi002.stdout: 1 199439 8.05 MB/sec execute 16 sec latency 12.442 ms 2024-06-13T02:21:13.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:13 smithi084 ceph-mon[36833]: pgmap v104: 129 pgs: 129 active+clean; 55 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 341 op/s 2024-06-13T02:21:13.489 INFO:tasks.workunit.client.0.smithi002.stdout: 1 201516 8.21 MB/sec execute 17 sec latency 16.241 ms 2024-06-13T02:21:13.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:13 smithi175 ceph-mon[36977]: pgmap v104: 129 pgs: 129 active+clean; 55 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 341 op/s 2024-06-13T02:21:13.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:13 smithi002 ceph-mon[31960]: pgmap v104: 129 pgs: 129 active+clean; 55 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 341 op/s 2024-06-13T02:21:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.209+0000 7ff9f7e00640 1 -- 172.21.15.2:0/870000651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f8103300 msgr2=0x7ff9f810b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.209+0000 7ff9f7e00640 1 --2- 172.21.15.2:0/870000651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f8103300 0x7ff9f810b7e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009900 tx=0x7ff9e402a490 comp rx=0 tx=0).stop 2024-06-13T02:21:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.209+0000 7ff9f7e00640 1 -- 172.21.15.2:0/870000651 shutdown_connections 2024-06-13T02:21:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.209+0000 7ff9f7e00640 1 --2- 172.21.15.2:0/870000651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f810bdb0 0x7ff9f810e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.209+0000 7ff9f7e00640 1 --2- 172.21.15.2:0/870000651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f8103300 0x7ff9f810b7e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.209+0000 7ff9f7e00640 1 --2- 172.21.15.2:0/870000651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f81029e0 0x7ff9f8102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.209+0000 7ff9f7e00640 1 -- 172.21.15.2:0/870000651 >> 172.21.15.2:0/870000651 conn(0x7ff9f80fc180 msgr2=0x7ff9f80fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:14.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.209+0000 7ff9f7e00640 1 -- 172.21.15.2:0/870000651 shutdown_connections 2024-06-13T02:21:14.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.209+0000 7ff9f7e00640 1 -- 172.21.15.2:0/870000651 wait complete. 2024-06-13T02:21:14.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.210+0000 7ff9f7e00640 1 Processor -- start 2024-06-13T02:21:14.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.210+0000 7ff9f7e00640 1 -- start start 2024-06-13T02:21:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.211+0000 7ff9f7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f81029e0 0x7ff9f81980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.211+0000 7ff9f7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f8103300 0x7ff9f8198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.211+0000 7ff9f7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f810bdb0 0x7ff9f819c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.211+0000 7ff9f7e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f8111b90 con 0x7ff9f8103300 2024-06-13T02:21:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.211+0000 7ff9f7e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f8111a10 con 0x7ff9f810bdb0 2024-06-13T02:21:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.211+0000 7ff9f7e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f8111d10 con 0x7ff9f81029e0 2024-06-13T02:21:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.211+0000 7ff9f7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f810bdb0 0x7ff9f819c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.211+0000 7ff9f6000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f8103300 0x7ff9f8198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.211+0000 7ff9f6000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f8103300 0x7ff9f8198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55990/0 (socket says 172.21.15.2:55990) 2024-06-13T02:21:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.211+0000 7ff9f6000640 1 -- 172.21.15.2:0/4073959271 learned_addr learned my addr 172.21.15.2:0/4073959271 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.211+0000 7ff9f7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f810bdb0 0x7ff9f819c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:44462/0 (socket says 172.21.15.2:44462) 2024-06-13T02:21:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.211+0000 7ff9f6a00640 1 --2- 172.21.15.2:0/4073959271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f81029e0 0x7ff9f81980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.212+0000 7ff9f7400640 1 -- 172.21.15.2:0/4073959271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f81029e0 msgr2=0x7ff9f81980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:14.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.212+0000 7ff9f7400640 1 --2- 172.21.15.2:0/4073959271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f81029e0 0x7ff9f81980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.212+0000 7ff9f7400640 1 -- 172.21.15.2:0/4073959271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f8103300 msgr2=0x7ff9f8198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:14.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.212+0000 7ff9f7400640 1 --2- 172.21.15.2:0/4073959271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f8103300 0x7ff9f8198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.212+0000 7ff9f7400640 1 -- 172.21.15.2:0/4073959271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f819d070 con 0x7ff9f810bdb0 2024-06-13T02:21:14.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.212+0000 7ff9f6a00640 1 --2- 172.21.15.2:0/4073959271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f81029e0 0x7ff9f81980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:21:14.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.212+0000 7ff9f7400640 1 --2- 172.21.15.2:0/4073959271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f810bdb0 0x7ff9f819c940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff9f000e940 tx=0x7ff9f000ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:14.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.212+0000 7ff9fca00640 1 -- 172.21.15.2:0/4073959271 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0004d20 con 0x7ff9f810bdb0 2024-06-13T02:21:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.212+0000 7ff9fca00640 1 -- 172.21.15.2:0/4073959271 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9f0005020 con 0x7ff9f810bdb0 2024-06-13T02:21:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.212+0000 7ff9f7e00640 1 -- 172.21.15.2:0/4073959271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f819d360 con 0x7ff9f810bdb0 2024-06-13T02:21:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.212+0000 7ff9fca00640 1 -- 172.21.15.2:0/4073959271 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00116b0 con 0x7ff9f810bdb0 2024-06-13T02:21:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.213+0000 7ff9f7e00640 1 -- 172.21.15.2:0/4073959271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f81a4bf0 con 0x7ff9f810bdb0 2024-06-13T02:21:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.216+0000 7ffa00c0c740 1 Processor -- start 2024-06-13T02:21:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.217+0000 7ff9fca00640 1 -- 172.21.15.2:0/4073959271 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7ff9f00054d0 con 0x7ff9f810bdb0 2024-06-13T02:21:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.217+0000 7ffa00c0c740 1 -- start start 2024-06-13T02:21:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.217+0000 7ffa00c0c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eb197a0 0x56100eb17cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.217+0000 7ffa00c0c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb186b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.217+0000 7ffa00c0c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb22fb0 0x56100eb253a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.217+0000 7ffa00c0c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56100ea7c420 con 0x56100eb197a0 2024-06-13T02:21:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.217+0000 7ffa00c0c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56100ea23c50 con 0x56100eb22fb0 2024-06-13T02:21:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.217+0000 7ffa00c0c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56100ea783e0 con 0x56100eb18230 2024-06-13T02:21:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.218+0000 7ff9f6000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eb197a0 0x56100eb17cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.218+0000 7ff9f6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb186b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.218+0000 7ff9f6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb186b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:51094/0 (socket says 172.21.15.2:51094) 2024-06-13T02:21:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.218+0000 7ff9f6000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eb197a0 0x56100eb17cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55996/0 (socket says 172.21.15.2:55996) 2024-06-13T02:21:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.218+0000 7ff9f6a00640 1 -- 172.21.15.2:0/1758225701 learned_addr learned my addr 172.21.15.2:0/1758225701 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.218+0000 7ff9f6000640 1 --2- 172.21.15.2:0/1758225701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb22fb0 0x56100eb253a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.218+0000 7ff9f6a00640 1 -- 172.21.15.2:0/1758225701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb22fb0 msgr2=0x56100eb253a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.218+0000 7ff9f6a00640 1 --2- 172.21.15.2:0/1758225701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb22fb0 0x56100eb253a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.218+0000 7ff9fca00640 1 --2- 172.21.15.2:0/4073959271 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff9dc0a2d60 0x7ff9dc0a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.218+0000 7ff9f6a00640 1 -- 172.21.15.2:0/1758225701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eb197a0 msgr2=0x56100eb17cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.218+0000 7ff9f6a00640 1 --2- 172.21.15.2:0/1758225701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eb197a0 0x56100eb17cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.218+0000 7ff9f6a00640 1 -- 172.21.15.2:0/1758225701 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100e790210 con 0x56100eb18230 2024-06-13T02:21:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.218+0000 7ff9f6000640 1 --2- 172.21.15.2:0/1758225701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb22fb0 0x56100eb253a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:21:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.219+0000 7ff9fca00640 1 -- 172.21.15.2:0/4073959271 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7ff9f00cf830 con 0x7ff9f810bdb0 2024-06-13T02:21:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.219+0000 7ff9f7400640 1 --2- 172.21.15.2:0/4073959271 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff9dc0a2d60 0x7ff9dc0a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.219+0000 7ff9f6a00640 1 --2- 172.21.15.2:0/1758225701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb186b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8011620 tx=0x7ff9e8011ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d623267c62de41a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.219+0000 7ff9e3e00640 1 -- 172.21.15.2:0/1758225701 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e801e070 con 0x56100eb18230 2024-06-13T02:21:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.219+0000 7ff9e3e00640 1 -- 172.21.15.2:0/1758225701 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9e800fb40 con 0x56100eb18230 2024-06-13T02:21:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.219+0000 7ff9e3e00640 1 -- 172.21.15.2:0/1758225701 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8019c80 con 0x56100eb18230 2024-06-13T02:21:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.220+0000 7ff9f7400640 1 --2- 172.21.15.2:0/4073959271 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff9dc0a2d60 0x7ff9dc0a5220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00983a0 tx=0x7ff9f0005f50 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.220+0000 7ffa00c0c740 1 -- 172.21.15.2:0/1758225701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 msgr2=0x56100eb186b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.220+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/1758225701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb186b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8011620 tx=0x7ff9e8011ae0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.220+0000 7ffa00c0c740 1 -- 172.21.15.2:0/1758225701 shutdown_connections 2024-06-13T02:21:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.220+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/1758225701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb22fb0 0x56100eb253a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.220+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/1758225701 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb186b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.220+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/1758225701 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eb197a0 0x56100eb17cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.220+0000 7ffa00c0c740 1 -- 172.21.15.2:0/1758225701 >> 172.21.15.2:0/1758225701 conn(0x56100eae0fb0 msgr2=0x56100eb14820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.220+0000 7ffa00c0c740 1 -- 172.21.15.2:0/1758225701 shutdown_connections 2024-06-13T02:21:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.220+0000 7ffa00c0c740 1 -- 172.21.15.2:0/1758225701 wait complete. 2024-06-13T02:21:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.221+0000 7ffa00c0c740 1 -- start start 2024-06-13T02:21:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.221+0000 7ffa00c0c740 1 Processor -- start 2024-06-13T02:21:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.221+0000 7ffa00c0c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eb18230 0x56100eb1ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.221+0000 7ffa00c0c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb197a0 0x56100eb20520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.221+0000 7ffa00c0c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb22fb0 0x56100eb20a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.222+0000 7ffa00c0c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56100eb25d80 con 0x56100eb18230 2024-06-13T02:21:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.222+0000 7ffa00c0c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56100ea370b0 con 0x56100eb22fb0 2024-06-13T02:21:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.222+0000 7ffa00c0c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56100eb25f00 con 0x56100eb197a0 2024-06-13T02:21:14.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.222+0000 7ffa00c0c740 10 client.0 _ll_register_callbacks cb 0x56100ea22f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:21:14.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.222+0000 7ff9f6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb197a0 0x56100eb20520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.222+0000 7ff9f6000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eb18230 0x56100eb1ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.222+0000 7ff9f6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb197a0 0x56100eb20520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:51108/0 (socket says 172.21.15.2:51108) 2024-06-13T02:21:14.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.222+0000 7ff9f6a00640 1 -- 172.21.15.2:0/2113198249 learned_addr learned my addr 172.21.15.2:0/2113198249 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:14.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.222+0000 7ff9f6000640 1 --2- 172.21.15.2:0/2113198249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb22fb0 0x56100eb20a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.222+0000 7ff9f6a00640 1 -- 172.21.15.2:0/2113198249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb22fb0 msgr2=0x56100eb20a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:14.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.222+0000 7ff9f6a00640 1 --2- 172.21.15.2:0/2113198249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb22fb0 0x56100eb20a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.222+0000 7ff9f6a00640 1 -- 172.21.15.2:0/2113198249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eb18230 msgr2=0x56100eb1ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:14.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.222+0000 7ff9f6a00640 1 --2- 172.21.15.2:0/2113198249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eb18230 0x56100eb1ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.437 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.222+0000 7ff9f6a00640 1 -- 172.21.15.2:0/2113198249 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56100e85c620 con 0x56100eb197a0 2024-06-13T02:21:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.223+0000 7ff9f6a00640 1 --2- 172.21.15.2:0/2113198249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb197a0 0x56100eb20520 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8019860 tx=0x7ff9e800f890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a2c843d188b77d8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.223+0000 7ff9e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:21:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.223+0000 7ff9e0c00640 1 -- 172.21.15.2:0/2113198249 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8027060 con 0x56100eb197a0 2024-06-13T02:21:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.223+0000 7ffa00c0c740 1 -- 172.21.15.2:0/2113198249 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9e800fb40 con 0x56100eb197a0 2024-06-13T02:21:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.223+0000 7ff9e0c00640 1 -- 172.21.15.2:0/2113198249 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7ff9e80199c0 con 0x56100eb197a0 2024-06-13T02:21:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.223+0000 7ff9e0c00640 1 -- 172.21.15.2:0/2113198249 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff9e801e040 con 0x56100eb197a0 2024-06-13T02:21:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.223+0000 7ffa00c0c740 10 client.25504 fetch_fsmap learned FSMap version 28 2024-06-13T02:21:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.223+0000 7ffa00c0c740 1 -- 172.21.15.2:0/2113198249 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56100eb320f0 con 0x56100eb197a0 2024-06-13T02:21:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.224+0000 7ff9e0c00640 1 -- 172.21.15.2:0/2113198249 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9e800fb40 con 0x56100eb197a0 2024-06-13T02:21:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.224+0000 7ff9e0c00640 1 -- 172.21.15.2:0/2113198249 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7ff9e8021030 con 0x56100eb197a0 2024-06-13T02:21:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.224+0000 7ffa00c0c740 10 client.25504 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:21:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.224+0000 7ffa00c0c740 10 client.25504 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:21:14.438 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.224+0000 7ffa00c0c740 20 client.25504 populate_metadata read hostname 'smithi002' 2024-06-13T02:21:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.224+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/2113198249 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56100eb33500 0x56100eb358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.224+0000 7ffa00c0c740 4 client.25504 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:21:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.224+0000 7ffa00c0c740 1 -- 172.21.15.2:0/2113198249 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56100ea89b50 con 0x56100eb33500 2024-06-13T02:21:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.224+0000 7ff9f6000640 1 --2- 172.21.15.2:0/2113198249 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56100eb33500 0x56100eb358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.225+0000 7ff9f6000640 1 --2- 172.21.15.2:0/2113198249 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56100eb33500 0x56100eb358f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb99f4e402d54a1f server_cookie=a931d55a6897b667 in_seq=0 out_seq=0 2024-06-13T02:21:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.225+0000 7ff9e0c00640 10 client.25504 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.225+0000 7ff9e0c00640 1 -- 172.21.15.2:0/2113198249 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56100ea89b50 con 0x56100eb33500 2024-06-13T02:21:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.225+0000 7ff9e0c00640 10 client.25504 handle_command_reply: tid=0 2024-06-13T02:21:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.225+0000 7ffa00c0c740 1 client.25504 shutdown 2024-06-13T02:21:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.226+0000 7ffa00c0c740 1 -- 172.21.15.2:0/2113198249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb197a0 msgr2=0x56100eb20520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.226+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/2113198249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb197a0 0x56100eb20520 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8019860 tx=0x7ff9e800f890 comp rx=0 tx=0).stop 2024-06-13T02:21:14.439 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.226+0000 7ffa00c0c740 1 -- 172.21.15.2:0/2113198249 shutdown_connections 2024-06-13T02:21:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.226+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/2113198249 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56100eb33500 0x56100eb358f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.226+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/2113198249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb22fb0 0x56100eb20a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.226+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/2113198249 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb197a0 0x56100eb20520 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.226+0000 7ff9e0c00640 0 client.25504 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.226+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/2113198249 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eb18230 0x56100eb1ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.226+0000 7ffa00c0c740 1 -- 172.21.15.2:0/2113198249 >> 172.21.15.2:0/2113198249 conn(0x56100eae0fb0 msgr2=0x56100eb1a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.226+0000 7ffa00c0c740 1 -- 172.21.15.2:0/2113198249 shutdown_connections 2024-06-13T02:21:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.226+0000 7ffa00c0c740 1 -- 172.21.15.2:0/2113198249 wait complete. 2024-06-13T02:21:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.226+0000 7ffa00c0c740 20 client.25504 trim_cache size 0 max 16384 2024-06-13T02:21:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.243+0000 7ffa00c0c740 1 Processor -- start 2024-06-13T02:21:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.244+0000 7ffa00c0c740 1 -- start start 2024-06-13T02:21:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.244+0000 7ffa00c0c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eae0fb0 0x56100eb14120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.244+0000 7ffa00c0c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb14660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.244+0000 7ffa00c0c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb197a0 0x56100eb3b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.244+0000 7ffa00c0c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f81af480 con 0x56100eae0fb0 2024-06-13T02:21:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.244+0000 7ffa00c0c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f81acd50 con 0x56100eb197a0 2024-06-13T02:21:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.244+0000 7ffa00c0c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f81aaba0 con 0x56100eb18230 2024-06-13T02:21:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.244+0000 7ff9f6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb14660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.244+0000 7ff9f6000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eae0fb0 0x56100eb14120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.244+0000 7ff9f6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb14660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:51116/0 (socket says 172.21.15.2:51116) 2024-06-13T02:21:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.244+0000 7ff9f6a00640 1 -- 172.21.15.2:0/995455781 learned_addr learned my addr 172.21.15.2:0/995455781 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.245+0000 7ff9f6000640 1 --2- 172.21.15.2:0/995455781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb197a0 0x56100eb3b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.245+0000 7ff9f6a00640 1 -- 172.21.15.2:0/995455781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb197a0 msgr2=0x56100eb3b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.245+0000 7ff9f6a00640 1 --2- 172.21.15.2:0/995455781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb197a0 0x56100eb3b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.245+0000 7ff9f6a00640 1 -- 172.21.15.2:0/995455781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eae0fb0 msgr2=0x56100eb14120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:14.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.245+0000 7ff9f6a00640 1 --2- 172.21.15.2:0/995455781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eae0fb0 0x56100eb14120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.245+0000 7ff9f6a00640 1 -- 172.21.15.2:0/995455781 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100eb1e530 con 0x56100eb18230 2024-06-13T02:21:14.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.245+0000 7ff9f6000640 1 --2- 172.21.15.2:0/995455781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eae0fb0 0x56100eb14120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:21:14.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.245+0000 7ff9f6a00640 1 --2- 172.21.15.2:0/995455781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb14660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8005870 tx=0x7ff9e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a901fd845f50d05a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:14.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.245+0000 7ff9e3400640 1 -- 172.21.15.2:0/995455781 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8027070 con 0x56100eb18230 2024-06-13T02:21:14.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.245+0000 7ff9e3400640 1 -- 172.21.15.2:0/995455781 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9e8019410 con 0x56100eb18230 2024-06-13T02:21:14.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.245+0000 7ff9e3400640 1 -- 172.21.15.2:0/995455781 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80226e0 con 0x56100eb18230 2024-06-13T02:21:14.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.246+0000 7ffa00c0c740 1 -- 172.21.15.2:0/995455781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 msgr2=0x56100eb14660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:14.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.246+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/995455781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb14660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8005870 tx=0x7ff9e8009b50 comp rx=0 tx=0).stop 2024-06-13T02:21:14.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.246+0000 7ffa00c0c740 1 -- 172.21.15.2:0/995455781 shutdown_connections 2024-06-13T02:21:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.246+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/995455781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb197a0 0x56100eb3b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.246+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/995455781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb14660 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.246+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/995455781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eae0fb0 0x56100eb14120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.246+0000 7ffa00c0c740 1 -- 172.21.15.2:0/995455781 >> 172.21.15.2:0/995455781 conn(0x56100eb35c60 msgr2=0x56100eb20830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.246+0000 7ffa00c0c740 1 -- 172.21.15.2:0/995455781 shutdown_connections 2024-06-13T02:21:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.246+0000 7ffa00c0c740 1 -- 172.21.15.2:0/995455781 wait complete. 2024-06-13T02:21:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.247+0000 7ffa00c0c740 1 -- start start 2024-06-13T02:21:14.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.247+0000 7ffa00c0c740 1 Processor -- start 2024-06-13T02:21:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.247+0000 7ffa00c0c740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eae0fb0 0x56100eb2b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.247+0000 7ffa00c0c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb2b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.247+0000 7ffa00c0c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb197a0 0x56100eb1c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.248+0000 7ffa00c0c740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f81ab210 con 0x56100eae0fb0 2024-06-13T02:21:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.248+0000 7ffa00c0c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f81ac680 con 0x56100eb197a0 2024-06-13T02:21:14.444 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.248+0000 7ffa00c0c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f81ab8e0 con 0x56100eb18230 2024-06-13T02:21:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.248+0000 7ffa00c0c740 10 client.0 _ll_register_callbacks cb 0x7ff9e801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:21:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.248+0000 7ff9f6000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eae0fb0 0x56100eb2b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.248+0000 7ff9f6000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eae0fb0 0x56100eb2b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56034/0 (socket says 172.21.15.2:56034) 2024-06-13T02:21:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.248+0000 7ff9f6000640 1 -- 172.21.15.2:0/1861003896 learned_addr learned my addr 172.21.15.2:0/1861003896 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.248+0000 7ff9f6a00640 1 --2- 172.21.15.2:0/1861003896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb2b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.248+0000 7ff9f6000640 1 --2- 172.21.15.2:0/1861003896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb197a0 0x56100eb1c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.445 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.248+0000 7ff9f6000640 1 -- 172.21.15.2:0/1861003896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 msgr2=0x56100eb2b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.248+0000 7ff9f6000640 1 --2- 172.21.15.2:0/1861003896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb2b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.248+0000 7ff9f6000640 1 -- 172.21.15.2:0/1861003896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb197a0 msgr2=0x56100eb1c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.248+0000 7ff9f6000640 1 --2- 172.21.15.2:0/1861003896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb197a0 0x56100eb1c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.248+0000 7ff9f6000640 1 -- 172.21.15.2:0/1861003896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56100eb1cbc0 con 0x56100eae0fb0 2024-06-13T02:21:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.249+0000 7ff9f6000640 1 --2- 172.21.15.2:0/1861003896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eae0fb0 0x56100eb2b190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4031550 tx=0x7ff9e403f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f82cbf90a6454f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:14.446 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.249+0000 7ff9e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:21:14.447 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.249+0000 7ff9e0c00640 1 -- 172.21.15.2:0/1861003896 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4035040 con 0x56100eae0fb0 2024-06-13T02:21:14.447 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.249+0000 7ff9e0c00640 1 -- 172.21.15.2:0/1861003896 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7ff9e4005030 con 0x56100eae0fb0 2024-06-13T02:21:14.447 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.249+0000 7ffa00c0c740 1 -- 172.21.15.2:0/1861003896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9e8019410 con 0x56100eae0fb0 2024-06-13T02:21:14.447 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.249+0000 7ff9e0c00640 1 -- 172.21.15.2:0/1861003896 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff9e4005230 con 0x56100eae0fb0 2024-06-13T02:21:14.447 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.249+0000 7ffa00c0c740 10 client.15375 fetch_fsmap learned FSMap version 28 2024-06-13T02:21:14.447 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.249+0000 7ffa00c0c740 1 -- 172.21.15.2:0/1861003896 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56100eb9d8e0 con 0x56100eae0fb0 2024-06-13T02:21:14.447 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.250+0000 7ff9e0c00640 1 -- 172.21.15.2:0/1861003896 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9e8019410 con 0x56100eae0fb0 2024-06-13T02:21:14.448 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.250+0000 7ff9e0c00640 1 -- 172.21.15.2:0/1861003896 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7ff9e40035f0 con 0x56100eae0fb0 2024-06-13T02:21:14.448 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.250+0000 7ffa00c0c740 10 client.15375 fetch_fsmap finished waiting for FSMap version 28 2024-06-13T02:21:14.448 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.250+0000 7ffa00c0c740 10 client.15375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:21:14.448 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.250+0000 7ffa00c0c740 20 client.15375 populate_metadata read hostname 'smithi002' 2024-06-13T02:21:14.448 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.250+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/1861003896 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56100eb22fb0 0x56100eba00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:14.448 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.250+0000 7ffa00c0c740 4 client.15375 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:21:14.449 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.250+0000 7ffa00c0c740 1 -- 172.21.15.2:0/1861003896 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56100ea83ea0 con 0x56100eb22fb0 2024-06-13T02:21:14.449 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.250+0000 7ff9f6a00640 1 --2- 172.21.15.2:0/1861003896 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56100eb22fb0 0x56100eba00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:14.449 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.251+0000 7ff9f6a00640 1 --2- 172.21.15.2:0/1861003896 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56100eb22fb0 0x56100eba00a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfa8cc0bc737f141 server_cookie=dcff04d46133961a in_seq=0 out_seq=0 2024-06-13T02:21:14.449 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.251+0000 7ff9e0c00640 10 client.15375 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:14.490 INFO:tasks.workunit.client.0.smithi002.stdout: 1 202864 8.20 MB/sec execute 18 sec latency 117.043 ms 2024-06-13T02:21:14.516 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.515+0000 7ff9e0c00640 1 -- 172.21.15.2:0/1861003896 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56100ea83ea0 con 0x56100eb22fb0 2024-06-13T02:21:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.515+0000 7ff9e0c00640 10 client.15375 handle_command_reply: tid=0 2024-06-13T02:21:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.515+0000 7ffa00c0c740 1 client.15375 shutdown 2024-06-13T02:21:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.516+0000 7ffa00c0c740 1 -- 172.21.15.2:0/1861003896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eae0fb0 msgr2=0x56100eb2b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.516+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/1861003896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eae0fb0 0x56100eb2b190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4031550 tx=0x7ff9e403f040 comp rx=0 tx=0).stop 2024-06-13T02:21:14.517 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.516+0000 7ffa00c0c740 1 -- 172.21.15.2:0/1861003896 shutdown_connections 2024-06-13T02:21:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.516+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/1861003896 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56100eb22fb0 0x56100eba00a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.516+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/1861003896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100eb197a0 0x56100eb1c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.516+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/1861003896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100eb18230 0x56100eb2b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.516+0000 7ffa00c0c740 1 --2- 172.21.15.2:0/1861003896 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56100eae0fb0 0x56100eb2b190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.516+0000 7ff9e0c00640 0 client.15375 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:14.518 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.516+0000 7ffa00c0c740 1 -- 172.21.15.2:0/1861003896 >> 172.21.15.2:0/1861003896 conn(0x56100eb35c60 msgr2=0x56100eb1fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.516+0000 7ffa00c0c740 1 -- 172.21.15.2:0/1861003896 shutdown_connections 2024-06-13T02:21:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.516+0000 7ffa00c0c740 1 -- 172.21.15.2:0/1861003896 wait complete. 2024-06-13T02:21:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.517+0000 7ffa00c0c740 20 client.15375 trim_cache size 0 max 16384 2024-06-13T02:21:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:21:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:21:14.519 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:21:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.518+0000 7ff9f7e00640 1 -- 172.21.15.2:0/4073959271 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff9dc0a2d60 msgr2=0x7ff9dc0a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.518+0000 7ff9f7e00640 1 --2- 172.21.15.2:0/4073959271 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff9dc0a2d60 0x7ff9dc0a5220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00983a0 tx=0x7ff9f0005f50 comp rx=0 tx=0).stop 2024-06-13T02:21:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.518+0000 7ff9f7e00640 1 -- 172.21.15.2:0/4073959271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f810bdb0 msgr2=0x7ff9f819c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.518+0000 7ff9f7e00640 1 --2- 172.21.15.2:0/4073959271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f810bdb0 0x7ff9f819c940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff9f000e940 tx=0x7ff9f000ee00 comp rx=0 tx=0).stop 2024-06-13T02:21:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.518+0000 7ff9f7e00640 1 -- 172.21.15.2:0/4073959271 shutdown_connections 2024-06-13T02:21:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.518+0000 7ff9f7e00640 1 --2- 172.21.15.2:0/4073959271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9f810bdb0 0x7ff9f819c940 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.520 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.518+0000 7ff9f7e00640 1 --2- 172.21.15.2:0/4073959271 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff9dc0a2d60 0x7ff9dc0a5220 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.518+0000 7ff9f7e00640 1 --2- 172.21.15.2:0/4073959271 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff9f8103300 0x7ff9f8198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.518+0000 7ff9f7e00640 1 --2- 172.21.15.2:0/4073959271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9f81029e0 0x7ff9f81980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.518+0000 7ff9f7e00640 1 -- 172.21.15.2:0/4073959271 >> 172.21.15.2:0/4073959271 conn(0x7ff9f80fc180 msgr2=0x7ff9f80fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.518+0000 7ff9f7e00640 1 -- 172.21.15.2:0/4073959271 shutdown_connections 2024-06-13T02:21:14.521 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:14.518+0000 7ff9f7e00640 1 -- 172.21.15.2:0/4073959271 wait complete. 2024-06-13T02:21:15.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:15 smithi084 ceph-mon[36833]: pgmap v105: 129 pgs: 129 active+clean; 55 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 2.2 MiB/s wr, 258 op/s 2024-06-13T02:21:15.490 INFO:tasks.workunit.client.0.smithi002.stdout: 1 204617 8.14 MB/sec execute 19 sec latency 54.543 ms 2024-06-13T02:21:15.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:15 smithi175 ceph-mon[36977]: pgmap v105: 129 pgs: 129 active+clean; 55 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 2.2 MiB/s wr, 258 op/s 2024-06-13T02:21:15.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:15 smithi002 ceph-mon[31960]: pgmap v105: 129 pgs: 129 active+clean; 55 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 2.2 MiB/s wr, 258 op/s 2024-06-13T02:21:16.490 INFO:tasks.workunit.client.0.smithi002.stdout: 1 206323 8.33 MB/sec execute 20 sec latency 14.369 ms 2024-06-13T02:21:17.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:17 smithi084 ceph-mon[36833]: pgmap v106: 129 pgs: 129 active+clean; 51 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 467 op/s 2024-06-13T02:21:17.490 INFO:tasks.workunit.client.0.smithi002.stdout: 1 208106 8.27 MB/sec execute 21 sec latency 24.002 ms 2024-06-13T02:21:17.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:17 smithi175 ceph-mon[36977]: pgmap v106: 129 pgs: 129 active+clean; 51 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 467 op/s 2024-06-13T02:21:17.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:17 smithi002 ceph-mon[31960]: pgmap v106: 129 pgs: 129 active+clean; 51 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 467 op/s 2024-06-13T02:21:18.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:18 smithi084 ceph-mon[36833]: pgmap v107: 129 pgs: 129 active+clean; 51 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 2.1 MiB/s wr, 314 op/s 2024-06-13T02:21:18.490 INFO:tasks.workunit.client.0.smithi002.stdout: 1 209867 8.44 MB/sec execute 22 sec latency 11.557 ms 2024-06-13T02:21:18.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:18 smithi175 ceph-mon[36977]: pgmap v107: 129 pgs: 129 active+clean; 51 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 2.1 MiB/s wr, 314 op/s 2024-06-13T02:21:18.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:18 smithi002 ceph-mon[31960]: pgmap v107: 129 pgs: 129 active+clean; 51 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 2.1 MiB/s wr, 314 op/s 2024-06-13T02:21:19.490 INFO:tasks.workunit.client.0.smithi002.stdout: 1 211668 8.38 MB/sec execute 23 sec latency 13.339 ms 2024-06-13T02:21:20.491 INFO:tasks.workunit.client.0.smithi002.stdout: 1 213273 8.53 MB/sec execute 24 sec latency 45.469 ms 2024-06-13T02:21:21.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:20 smithi175 ceph-mon[36977]: pgmap v108: 129 pgs: 129 active+clean; 51 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 2.0 MiB/s wr, 305 op/s 2024-06-13T02:21:21.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:20 smithi002 ceph-mon[31960]: pgmap v108: 129 pgs: 129 active+clean; 51 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 2.0 MiB/s wr, 305 op/s 2024-06-13T02:21:21.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:20 smithi084 ceph-mon[36833]: pgmap v108: 129 pgs: 129 active+clean; 51 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 2.0 MiB/s wr, 305 op/s 2024-06-13T02:21:21.491 INFO:tasks.workunit.client.0.smithi002.stdout: 1 215210 8.47 MB/sec execute 25 sec latency 21.226 ms 2024-06-13T02:21:22.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:21 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:21:22.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:21 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:21:22.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:21 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:21:22.491 INFO:tasks.workunit.client.0.smithi002.stdout: 1 216869 8.61 MB/sec execute 26 sec latency 10.515 ms 2024-06-13T02:21:23.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:22 smithi175 ceph-mon[36977]: pgmap v109: 129 pgs: 129 active+clean; 57 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 395 op/s 2024-06-13T02:21:23.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:22 smithi002 ceph-mon[31960]: pgmap v109: 129 pgs: 129 active+clean; 57 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 395 op/s 2024-06-13T02:21:23.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:22 smithi084 ceph-mon[36833]: pgmap v109: 129 pgs: 129 active+clean; 57 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 395 op/s 2024-06-13T02:21:23.491 INFO:tasks.workunit.client.0.smithi002.stdout: 1 218408 8.50 MB/sec execute 27 sec latency 12.650 ms 2024-06-13T02:21:24.491 INFO:tasks.workunit.client.0.smithi002.stdout: 1 220352 8.68 MB/sec execute 28 sec latency 9.810 ms 2024-06-13T02:21:25.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:24 smithi002 ceph-mon[31960]: pgmap v110: 129 pgs: 129 active+clean; 57 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 315 op/s 2024-06-13T02:21:25.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:24 smithi084 ceph-mon[36833]: pgmap v110: 129 pgs: 129 active+clean; 57 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 315 op/s 2024-06-13T02:21:25.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:24 smithi175 ceph-mon[36977]: pgmap v110: 129 pgs: 129 active+clean; 57 MiB data, 924 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 315 op/s 2024-06-13T02:21:25.491 INFO:tasks.workunit.client.0.smithi002.stdout: 1 221495 8.56 MB/sec execute 29 sec latency 35.627 ms 2024-06-13T02:21:26.491 INFO:tasks.workunit.client.0.smithi002.stdout: 1 223614 8.69 MB/sec execute 30 sec latency 37.118 ms 2024-06-13T02:21:27.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:26 smithi002 ceph-mon[31960]: pgmap v111: 129 pgs: 129 active+clean; 61 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 397 op/s 2024-06-13T02:21:27.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:26 smithi084 ceph-mon[36833]: pgmap v111: 129 pgs: 129 active+clean; 61 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 397 op/s 2024-06-13T02:21:27.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:26 smithi175 ceph-mon[36977]: pgmap v111: 129 pgs: 129 active+clean; 61 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 397 op/s 2024-06-13T02:21:27.491 INFO:tasks.workunit.client.0.smithi002.stdout: 1 224551 8.52 MB/sec execute 31 sec latency 23.749 ms 2024-06-13T02:21:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.675+0000 7f5ba9800640 1 -- 172.21.15.2:0/438626969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ba410bda0 msgr2=0x7f5ba410e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.675+0000 7f5ba9800640 1 --2- 172.21.15.2:0/438626969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ba410bda0 0x7f5ba410e240 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c009860 tx=0x7f5b9c02a3d0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.675+0000 7f5ba9800640 1 -- 172.21.15.2:0/438626969 shutdown_connections 2024-06-13T02:21:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.675+0000 7f5ba9800640 1 --2- 172.21.15.2:0/438626969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ba410bda0 0x7f5ba410e240 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.675+0000 7f5ba9800640 1 --2- 172.21.15.2:0/438626969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ba41032a0 0x7f5ba410b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.675+0000 7f5ba9800640 1 --2- 172.21.15.2:0/438626969 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ba4102980 0x7f5ba4102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.675+0000 7f5ba9800640 1 -- 172.21.15.2:0/438626969 >> 172.21.15.2:0/438626969 conn(0x7f5ba40fc180 msgr2=0x7f5ba40fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.675+0000 7f5ba9800640 1 -- 172.21.15.2:0/438626969 shutdown_connections 2024-06-13T02:21:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.675+0000 7f5ba9800640 1 -- 172.21.15.2:0/438626969 wait complete. 2024-06-13T02:21:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.676+0000 7f5ba9800640 1 Processor -- start 2024-06-13T02:21:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.676+0000 7f5ba9800640 1 -- start start 2024-06-13T02:21:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.677+0000 7f5ba9800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ba4102980 0x7f5ba419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.677+0000 7f5ba9800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ba41032a0 0x7f5ba419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.677+0000 7f5ba9800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ba410bda0 0x7f5ba419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.677+0000 7f5ba9800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba4111bf0 con 0x7f5ba4102980 2024-06-13T02:21:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.677+0000 7f5ba9800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba4111a70 con 0x7f5ba410bda0 2024-06-13T02:21:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.677+0000 7f5ba9800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba4111d70 con 0x7f5ba41032a0 2024-06-13T02:21:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.677+0000 7f5b9b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ba41032a0 0x7f5ba419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.677+0000 7f5b9b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ba41032a0 0x7f5ba419a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:47900/0 (socket says 172.21.15.2:47900) 2024-06-13T02:21:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.677+0000 7f5ba3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ba4102980 0x7f5ba419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.677+0000 7f5b9b400640 1 -- 172.21.15.2:0/150027218 learned_addr learned my addr 172.21.15.2:0/150027218 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.677+0000 7f5ba8e00640 1 --2- 172.21.15.2:0/150027218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ba410bda0 0x7f5ba419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.678+0000 7f5b9b400640 1 -- 172.21.15.2:0/150027218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ba410bda0 msgr2=0x7f5ba419eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.678+0000 7f5b9b400640 1 --2- 172.21.15.2:0/150027218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ba410bda0 0x7f5ba419eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.678+0000 7f5b9b400640 1 -- 172.21.15.2:0/150027218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ba4102980 msgr2=0x7f5ba419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.678+0000 7f5b9b400640 1 --2- 172.21.15.2:0/150027218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ba4102980 0x7f5ba419a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.678+0000 7f5b9b400640 1 -- 172.21.15.2:0/150027218 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba419f1f0 con 0x7f5ba41032a0 2024-06-13T02:21:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.678+0000 7f5ba8e00640 1 --2- 172.21.15.2:0/150027218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ba410bda0 0x7f5ba419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:21:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.678+0000 7f5ba3e00640 1 --2- 172.21.15.2:0/150027218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ba4102980 0x7f5ba419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:21:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.678+0000 7f5b9b400640 1 --2- 172.21.15.2:0/150027218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ba41032a0 0x7f5ba419a740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00e790 tx=0x7f5b8c00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.678+0000 7f5ba1600640 1 -- 172.21.15.2:0/150027218 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c00eea0 con 0x7f5ba41032a0 2024-06-13T02:21:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.678+0000 7f5ba9800640 1 -- 172.21.15.2:0/150027218 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba419f4e0 con 0x7f5ba41032a0 2024-06-13T02:21:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.678+0000 7f5ba1600640 1 -- 172.21.15.2:0/150027218 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b8c005500 con 0x7f5ba41032a0 2024-06-13T02:21:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.678+0000 7f5ba1600640 1 -- 172.21.15.2:0/150027218 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c010430 con 0x7f5ba41032a0 2024-06-13T02:21:27.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.678+0000 7f5ba9800640 1 -- 172.21.15.2:0/150027218 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba41a6d70 con 0x7f5ba41032a0 2024-06-13T02:21:27.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.682+0000 7f5ba1600640 1 -- 172.21.15.2:0/150027218 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f5b8c005000 con 0x7f5ba41032a0 2024-06-13T02:21:27.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.682+0000 7f5badbde740 1 Processor -- start 2024-06-13T02:21:27.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.682+0000 7f5badbde740 1 -- start start 2024-06-13T02:21:27.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.683+0000 7f5badbde740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc867f7a0 0x55abc867dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.683+0000 7f5badbde740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867e230 0x55abc867e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.683+0000 7f5badbde740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc8688fb0 0x55abc868b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.683+0000 7f5badbde740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55abc85e2420 con 0x55abc867e230 2024-06-13T02:21:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.683+0000 7f5badbde740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55abc8589c50 con 0x55abc867f7a0 2024-06-13T02:21:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.683+0000 7f5badbde740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55abc85de3e0 con 0x55abc8688fb0 2024-06-13T02:21:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.683+0000 7f5ba8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc867f7a0 0x55abc867dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.683+0000 7f5b9b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc8688fb0 0x55abc868b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.683+0000 7f5ba8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc867f7a0 0x55abc867dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:46472/0 (socket says 172.21.15.2:46472) 2024-06-13T02:21:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.683+0000 7f5ba8e00640 1 -- 172.21.15.2:0/3175171467 learned_addr learned my addr 172.21.15.2:0/3175171467 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.683+0000 7f5ba3e00640 1 --2- 172.21.15.2:0/3175171467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867e230 0x55abc867e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.684+0000 7f5ba8e00640 1 -- 172.21.15.2:0/3175171467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc8688fb0 msgr2=0x55abc868b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.684+0000 7f5ba8e00640 1 --2- 172.21.15.2:0/3175171467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc8688fb0 0x55abc868b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.684+0000 7f5ba8e00640 1 -- 172.21.15.2:0/3175171467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867e230 msgr2=0x55abc867e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.684+0000 7f5ba8e00640 1 --2- 172.21.15.2:0/3175171467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867e230 0x55abc867e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.684+0000 7f5ba8e00640 1 -- 172.21.15.2:0/3175171467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abc82f6210 con 0x55abc867f7a0 2024-06-13T02:21:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.684+0000 7f5ba1600640 1 --2- 172.21.15.2:0/150027218 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5b880a2ce0 0x7f5b880a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.684+0000 7f5ba8e00640 1 --2- 172.21.15.2:0/3175171467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc867f7a0 0x55abc867dcf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c030d70 tx=0x7f5b9c030da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4618244e1d8fb70b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.684+0000 7f5ba1600640 1 -- 172.21.15.2:0/150027218 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f5b8c0cfa70 con 0x7f5ba41032a0 2024-06-13T02:21:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.684+0000 7f5ba3e00640 1 --2- 172.21.15.2:0/150027218 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5b880a2ce0 0x7f5b880a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.684+0000 7f5b99600640 1 -- 172.21.15.2:0/3175171467 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c005c90 con 0x55abc867f7a0 2024-06-13T02:21:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.684+0000 7f5b99600640 1 -- 172.21.15.2:0/3175171467 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b9c040030 con 0x55abc867f7a0 2024-06-13T02:21:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.684+0000 7f5b99600640 1 -- 172.21.15.2:0/3175171467 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c004b20 con 0x55abc867f7a0 2024-06-13T02:21:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.685+0000 7f5badbde740 1 -- 172.21.15.2:0/3175171467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc867f7a0 msgr2=0x55abc867dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.685+0000 7f5badbde740 1 --2- 172.21.15.2:0/3175171467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc867f7a0 0x55abc867dcf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c030d70 tx=0x7f5b9c030da0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.685+0000 7f5ba3e00640 1 --2- 172.21.15.2:0/150027218 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5b880a2ce0 0x7f5b880a51a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55abc8680f00 tx=0x7f5b94009500 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.685+0000 7f5badbde740 1 -- 172.21.15.2:0/3175171467 shutdown_connections 2024-06-13T02:21:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.685+0000 7f5badbde740 1 --2- 172.21.15.2:0/3175171467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc8688fb0 0x55abc868b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.685+0000 7f5badbde740 1 --2- 172.21.15.2:0/3175171467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867e230 0x55abc867e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.685+0000 7f5badbde740 1 --2- 172.21.15.2:0/3175171467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc867f7a0 0x55abc867dcf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.685+0000 7f5badbde740 1 -- 172.21.15.2:0/3175171467 >> 172.21.15.2:0/3175171467 conn(0x55abc8646fb0 msgr2=0x55abc867a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.686+0000 7f5badbde740 1 -- 172.21.15.2:0/3175171467 shutdown_connections 2024-06-13T02:21:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.686+0000 7f5badbde740 1 -- 172.21.15.2:0/3175171467 wait complete. 2024-06-13T02:21:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.686+0000 7f5badbde740 1 -- start start 2024-06-13T02:21:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.686+0000 7f5badbde740 1 Processor -- start 2024-06-13T02:21:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.687+0000 7f5badbde740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc867e230 0x55abc8686020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.687+0000 7f5badbde740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 0x55abc8686560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.687+0000 7f5badbde740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc8688fb0 0x55abc8686aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.687+0000 7f5badbde740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55abc868bd20 con 0x55abc867f7a0 2024-06-13T02:21:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.687+0000 7f5badbde740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55abc859d0b0 con 0x55abc867e230 2024-06-13T02:21:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.687+0000 7f5badbde740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55abc868bea0 con 0x55abc8688fb0 2024-06-13T02:21:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.687+0000 7f5badbde740 10 client.0 _ll_register_callbacks cb 0x55abc8588f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:21:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.687+0000 7f5ba3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc867e230 0x55abc8686020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.687+0000 7f5ba3e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc867e230 0x55abc8686020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:46478/0 (socket says 172.21.15.2:46478) 2024-06-13T02:21:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.687+0000 7f5ba3e00640 1 -- 172.21.15.2:0/697051769 learned_addr learned my addr 172.21.15.2:0/697051769 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.687+0000 7f5b9b400640 1 --2- 172.21.15.2:0/697051769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 0x55abc8686560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.687+0000 7f5ba8e00640 1 --2- 172.21.15.2:0/697051769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc8688fb0 0x55abc8686aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.688+0000 7f5ba3e00640 1 -- 172.21.15.2:0/697051769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc8688fb0 msgr2=0x55abc8686aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.688+0000 7f5ba3e00640 1 --2- 172.21.15.2:0/697051769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc8688fb0 0x55abc8686aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.688+0000 7f5ba3e00640 1 -- 172.21.15.2:0/697051769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 msgr2=0x55abc8686560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.688+0000 7f5ba3e00640 1 --2- 172.21.15.2:0/697051769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 0x55abc8686560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.688+0000 7f5ba3e00640 1 -- 172.21.15.2:0/697051769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abc83c2620 con 0x55abc867e230 2024-06-13T02:21:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.688+0000 7f5ba3e00640 1 --2- 172.21.15.2:0/697051769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc867e230 0x55abc8686020 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5b94005c20 tx=0x7f5b94004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c905b02c04e4dd3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.688+0000 7f5b92000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:21:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.688+0000 7f5b92000640 1 -- 172.21.15.2:0/697051769 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94011d90 con 0x55abc867e230 2024-06-13T02:21:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.689+0000 7f5b92000640 1 -- 172.21.15.2:0/697051769 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f5b94003970 con 0x55abc867e230 2024-06-13T02:21:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.689+0000 7f5badbde740 1 -- 172.21.15.2:0/697051769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b9c040030 con 0x55abc867e230 2024-06-13T02:21:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.689+0000 7f5b92000640 1 -- 172.21.15.2:0/697051769 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5b94003b70 con 0x55abc867e230 2024-06-13T02:21:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.689+0000 7f5badbde740 10 client.25532 fetch_fsmap learned FSMap version 29 2024-06-13T02:21:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.689+0000 7f5badbde740 1 -- 172.21.15.2:0/697051769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55abc8698190 con 0x55abc867e230 2024-06-13T02:21:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.689+0000 7f5b92000640 1 -- 172.21.15.2:0/697051769 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b9c040030 con 0x55abc867e230 2024-06-13T02:21:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.689+0000 7f5b92000640 1 -- 172.21.15.2:0/697051769 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f5b94027020 con 0x55abc867e230 2024-06-13T02:21:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.690+0000 7f5badbde740 10 client.25532 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T02:21:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.690+0000 7f5badbde740 10 client.25532 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:21:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.690+0000 7f5badbde740 20 client.25532 populate_metadata read hostname 'smithi002' 2024-06-13T02:21:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.690+0000 7f5badbde740 1 --2- 172.21.15.2:0/697051769 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55abc8699650 0x55abc869ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.690+0000 7f5badbde740 4 client.25532 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:21:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.690+0000 7f5badbde740 1 -- 172.21.15.2:0/697051769 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abc85efb50 con 0x55abc8699650 2024-06-13T02:21:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.690+0000 7f5b9b400640 1 --2- 172.21.15.2:0/697051769 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55abc8699650 0x55abc869ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.690+0000 7f5b92000640 10 client.25532 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.690+0000 7f5b9b400640 1 --2- 172.21.15.2:0/697051769 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55abc8699650 0x55abc869ba60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3b13bd382dc4154 server_cookie=59e4210538d8bee5 in_seq=0 out_seq=0 2024-06-13T02:21:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.691+0000 7f5b92000640 1 -- 172.21.15.2:0/697051769 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55abc85efb50 con 0x55abc8699650 2024-06-13T02:21:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.691+0000 7f5b92000640 10 client.25532 handle_command_reply: tid=0 2024-06-13T02:21:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.691+0000 7f5badbde740 1 client.25532 shutdown 2024-06-13T02:21:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.692+0000 7f5badbde740 1 -- 172.21.15.2:0/697051769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc867e230 msgr2=0x55abc8686020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.692+0000 7f5badbde740 1 --2- 172.21.15.2:0/697051769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc867e230 0x55abc8686020 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5b94005c20 tx=0x7f5b94004ab0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.692+0000 7f5badbde740 1 -- 172.21.15.2:0/697051769 shutdown_connections 2024-06-13T02:21:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.692+0000 7f5badbde740 1 --2- 172.21.15.2:0/697051769 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55abc8699650 0x55abc869ba60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.692+0000 7f5badbde740 1 --2- 172.21.15.2:0/697051769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc8688fb0 0x55abc8686aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.692+0000 7f5badbde740 1 --2- 172.21.15.2:0/697051769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 0x55abc8686560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.692+0000 7f5badbde740 1 --2- 172.21.15.2:0/697051769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc867e230 0x55abc8686020 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.692+0000 7f5badbde740 1 -- 172.21.15.2:0/697051769 >> 172.21.15.2:0/697051769 conn(0x55abc8646fb0 msgr2=0x55abc8680690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.692+0000 7f5b92000640 0 client.25532 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.692+0000 7f5badbde740 1 -- 172.21.15.2:0/697051769 shutdown_connections 2024-06-13T02:21:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.692+0000 7f5badbde740 1 -- 172.21.15.2:0/697051769 wait complete. 2024-06-13T02:21:27.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.692+0000 7f5badbde740 20 client.25532 trim_cache size 0 max 16384 2024-06-13T02:21:27.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.711+0000 7f5badbde740 1 Processor -- start 2024-06-13T02:21:27.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.711+0000 7f5badbde740 1 -- start start 2024-06-13T02:21:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.711+0000 7f5badbde740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc867e230 0x55abc8679820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.711+0000 7f5badbde740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 0x55abc86a1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.711+0000 7f5badbde740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc8688fb0 0x55abc86a1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.711+0000 7f5badbde740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba41b3830 con 0x55abc867f7a0 2024-06-13T02:21:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.711+0000 7f5badbde740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba41b1100 con 0x55abc8688fb0 2024-06-13T02:21:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.711+0000 7f5badbde740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba41aef50 con 0x55abc867e230 2024-06-13T02:21:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.712+0000 7f5ba3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc867e230 0x55abc8679820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.712+0000 7f5ba3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc867e230 0x55abc8679820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:47930/0 (socket says 172.21.15.2:47930) 2024-06-13T02:21:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.712+0000 7f5ba3e00640 1 -- 172.21.15.2:0/4274893121 learned_addr learned my addr 172.21.15.2:0/4274893121 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.712+0000 7f5b9b400640 1 --2- 172.21.15.2:0/4274893121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 0x55abc86a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.712+0000 7f5ba8e00640 1 --2- 172.21.15.2:0/4274893121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc8688fb0 0x55abc86a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.712+0000 7f5ba3e00640 1 -- 172.21.15.2:0/4274893121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc8688fb0 msgr2=0x55abc86a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.712+0000 7f5ba3e00640 1 --2- 172.21.15.2:0/4274893121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc8688fb0 0x55abc86a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.712+0000 7f5ba3e00640 1 -- 172.21.15.2:0/4274893121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 msgr2=0x55abc86a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.712+0000 7f5ba3e00640 1 --2- 172.21.15.2:0/4274893121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 0x55abc86a1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.712+0000 7f5ba3e00640 1 -- 172.21.15.2:0/4274893121 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abc8676000 con 0x55abc867e230 2024-06-13T02:21:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.713+0000 7f5ba3e00640 1 --2- 172.21.15.2:0/4274893121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc867e230 0x55abc8679820 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5b94029600 tx=0x7f5b94012850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42cc2249c4911fc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.713+0000 7f5b98c00640 1 -- 172.21.15.2:0/4274893121 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9403b070 con 0x55abc867e230 2024-06-13T02:21:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.713+0000 7f5b98c00640 1 -- 172.21.15.2:0/4274893121 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b94011d90 con 0x55abc867e230 2024-06-13T02:21:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.713+0000 7f5b98c00640 1 -- 172.21.15.2:0/4274893121 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94036970 con 0x55abc867e230 2024-06-13T02:21:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.714+0000 7f5badbde740 1 -- 172.21.15.2:0/4274893121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc867e230 msgr2=0x55abc8679820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.714+0000 7f5badbde740 1 --2- 172.21.15.2:0/4274893121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc867e230 0x55abc8679820 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5b94029600 tx=0x7f5b94012850 comp rx=0 tx=0).stop 2024-06-13T02:21:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.714+0000 7f5badbde740 1 -- 172.21.15.2:0/4274893121 shutdown_connections 2024-06-13T02:21:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.714+0000 7f5badbde740 1 --2- 172.21.15.2:0/4274893121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc8688fb0 0x55abc86a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.714+0000 7f5badbde740 1 --2- 172.21.15.2:0/4274893121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 0x55abc86a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.714+0000 7f5badbde740 1 --2- 172.21.15.2:0/4274893121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc867e230 0x55abc8679820 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.714+0000 7f5badbde740 1 -- 172.21.15.2:0/4274893121 >> 172.21.15.2:0/4274893121 conn(0x55abc8646fb0 msgr2=0x55abc8679110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.714+0000 7f5badbde740 1 -- 172.21.15.2:0/4274893121 shutdown_connections 2024-06-13T02:21:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.714+0000 7f5badbde740 1 -- 172.21.15.2:0/4274893121 wait complete. 2024-06-13T02:21:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.714+0000 7f5badbde740 1 -- start start 2024-06-13T02:21:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.715+0000 7f5badbde740 1 Processor -- start 2024-06-13T02:21:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.715+0000 7f5badbde740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc867e230 0x55abc86fc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.715+0000 7f5badbde740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 0x55abc86fcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.715+0000 7f5badbde740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc8688fb0 0x55abc868c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.715+0000 7f5badbde740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba41af5c0 con 0x55abc867f7a0 2024-06-13T02:21:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.715+0000 7f5badbde740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba41b0a30 con 0x55abc8688fb0 2024-06-13T02:21:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.715+0000 7f5badbde740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba41afc90 con 0x55abc867e230 2024-06-13T02:21:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.715+0000 7f5badbde740 10 client.0 _ll_register_callbacks cb 0x7f5b94012050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:21:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.715+0000 7f5ba8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc8688fb0 0x55abc868c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.715+0000 7f5b9b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 0x55abc86fcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.715+0000 7f5ba3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc867e230 0x55abc86fc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.715+0000 7f5ba8e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc8688fb0 0x55abc868c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:46506/0 (socket says 172.21.15.2:46506) 2024-06-13T02:21:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.715+0000 7f5ba8e00640 1 -- 172.21.15.2:0/1569547750 learned_addr learned my addr 172.21.15.2:0/1569547750 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.716+0000 7f5ba8e00640 1 -- 172.21.15.2:0/1569547750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc867e230 msgr2=0x55abc86fc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.716+0000 7f5ba8e00640 1 --2- 172.21.15.2:0/1569547750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc867e230 0x55abc86fc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.716+0000 7f5ba8e00640 1 -- 172.21.15.2:0/1569547750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 msgr2=0x55abc86fcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.716+0000 7f5ba8e00640 1 --2- 172.21.15.2:0/1569547750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 0x55abc86fcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.716+0000 7f5ba8e00640 1 -- 172.21.15.2:0/1569547750 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abc868cde0 con 0x55abc8688fb0 2024-06-13T02:21:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.716+0000 7f5b9b400640 1 --2- 172.21.15.2:0/1569547750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 0x55abc86fcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:21:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.716+0000 7f5ba8e00640 1 --2- 172.21.15.2:0/1569547750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc8688fb0 0x55abc868c6f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c02a9c0 tx=0x7f5b9c004540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c8cdc8755927b33 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.716+0000 7f5b92000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:21:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.716+0000 7f5b92000640 1 -- 172.21.15.2:0/1569547750 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c005c90 con 0x55abc8688fb0 2024-06-13T02:21:27.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.716+0000 7f5badbde740 1 -- 172.21.15.2:0/1569547750 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b94011d90 con 0x55abc8688fb0 2024-06-13T02:21:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.716+0000 7f5b92000640 1 -- 172.21.15.2:0/1569547750 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7f5b9c005460 con 0x55abc8688fb0 2024-06-13T02:21:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.717+0000 7f5b92000640 1 -- 172.21.15.2:0/1569547750 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5b9c0303a0 con 0x55abc8688fb0 2024-06-13T02:21:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.717+0000 7f5badbde740 10 client.25538 fetch_fsmap learned FSMap version 29 2024-06-13T02:21:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.717+0000 7f5badbde740 1 -- 172.21.15.2:0/1569547750 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55abc8703dd0 con 0x55abc8688fb0 2024-06-13T02:21:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.717+0000 7f5b92000640 1 -- 172.21.15.2:0/1569547750 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b94011d90 con 0x55abc8688fb0 2024-06-13T02:21:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.717+0000 7f5b92000640 1 -- 172.21.15.2:0/1569547750 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7f5b9c004c80 con 0x55abc8688fb0 2024-06-13T02:21:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.717+0000 7f5badbde740 10 client.25538 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T02:21:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.717+0000 7f5badbde740 10 client.25538 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:21:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.717+0000 7f5badbde740 20 client.25538 populate_metadata read hostname 'smithi002' 2024-06-13T02:21:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.717+0000 7f5badbde740 1 --2- 172.21.15.2:0/1569547750 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55abc8704110 0x55abc8706500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.717+0000 7f5badbde740 4 client.25538 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:21:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.717+0000 7f5badbde740 1 -- 172.21.15.2:0/1569547750 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55abc85e9ea0 con 0x55abc8704110 2024-06-13T02:21:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.717+0000 7f5ba3e00640 1 --2- 172.21.15.2:0/1569547750 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55abc8704110 0x55abc8706500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.718+0000 7f5ba3e00640 1 --2- 172.21.15.2:0/1569547750 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55abc8704110 0x55abc8706500 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba1332961c726f10 server_cookie=e8d99fa4ab9d1408 in_seq=0 out_seq=0 2024-06-13T02:21:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.718+0000 7f5b92000640 10 client.25538 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:27.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.885+0000 7f5b92000640 1 -- 172.21.15.2:0/1569547750 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55abc85e9ea0 con 0x55abc8704110 2024-06-13T02:21:27.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.885+0000 7f5b92000640 10 client.25538 handle_command_reply: tid=0 2024-06-13T02:21:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.885+0000 7f5badbde740 1 client.25538 shutdown 2024-06-13T02:21:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.886+0000 7f5badbde740 1 -- 172.21.15.2:0/1569547750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc8688fb0 msgr2=0x55abc868c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.886+0000 7f5badbde740 1 --2- 172.21.15.2:0/1569547750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc8688fb0 0x55abc868c6f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c02a9c0 tx=0x7f5b9c004540 comp rx=0 tx=0).stop 2024-06-13T02:21:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.886+0000 7f5badbde740 1 -- 172.21.15.2:0/1569547750 shutdown_connections 2024-06-13T02:21:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.886+0000 7f5badbde740 1 --2- 172.21.15.2:0/1569547750 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55abc8704110 0x55abc8706500 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.886+0000 7f5badbde740 1 --2- 172.21.15.2:0/1569547750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55abc8688fb0 0x55abc868c6f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.886+0000 7f5badbde740 1 --2- 172.21.15.2:0/1569547750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55abc867f7a0 0x55abc86fcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.886+0000 7f5badbde740 1 --2- 172.21.15.2:0/1569547750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55abc867e230 0x55abc86fc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.886+0000 7f5b92000640 0 client.25538 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.886+0000 7f5badbde740 1 -- 172.21.15.2:0/1569547750 >> 172.21.15.2:0/1569547750 conn(0x55abc8646fb0 msgr2=0x55abc86799a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.886+0000 7f5badbde740 1 -- 172.21.15.2:0/1569547750 shutdown_connections 2024-06-13T02:21:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.886+0000 7f5badbde740 1 -- 172.21.15.2:0/1569547750 wait complete. 2024-06-13T02:21:27.888 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.886+0000 7f5badbde740 20 client.25538 trim_cache size 0 max 16384 2024-06-13T02:21:27.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:21:27.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:21:27.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:21:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.887+0000 7f5ba9800640 1 -- 172.21.15.2:0/150027218 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5b880a2ce0 msgr2=0x7f5b880a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.887+0000 7f5ba9800640 1 --2- 172.21.15.2:0/150027218 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5b880a2ce0 0x7f5b880a51a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55abc8680f00 tx=0x7f5b94009500 comp rx=0 tx=0).stop 2024-06-13T02:21:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.887+0000 7f5ba9800640 1 -- 172.21.15.2:0/150027218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ba41032a0 msgr2=0x7f5ba419a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.887+0000 7f5ba9800640 1 --2- 172.21.15.2:0/150027218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ba41032a0 0x7f5ba419a740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00e790 tx=0x7f5b8c00ec50 comp rx=0 tx=0).stop 2024-06-13T02:21:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.887+0000 7f5ba9800640 1 -- 172.21.15.2:0/150027218 shutdown_connections 2024-06-13T02:21:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.887+0000 7f5ba9800640 1 --2- 172.21.15.2:0/150027218 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5ba410bda0 0x7f5ba419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.887+0000 7f5ba9800640 1 --2- 172.21.15.2:0/150027218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ba41032a0 0x7f5ba419a740 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.887+0000 7f5ba9800640 1 --2- 172.21.15.2:0/150027218 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5b880a2ce0 0x7f5b880a51a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.887+0000 7f5ba9800640 1 --2- 172.21.15.2:0/150027218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ba4102980 0x7f5ba419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.887+0000 7f5ba9800640 1 -- 172.21.15.2:0/150027218 >> 172.21.15.2:0/150027218 conn(0x7f5ba40fc180 msgr2=0x7f5ba40fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.887+0000 7f5ba9800640 1 -- 172.21.15.2:0/150027218 shutdown_connections 2024-06-13T02:21:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:27.887+0000 7f5ba9800640 1 -- 172.21.15.2:0/150027218 wait complete. 2024-06-13T02:21:28.492 INFO:tasks.workunit.client.0.smithi002.stdout: 1 226409 8.57 MB/sec execute 32 sec latency 145.735 ms 2024-06-13T02:21:29.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:28 smithi175 ceph-mon[36977]: pgmap v112: 129 pgs: 129 active+clean; 60 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 196 op/s 2024-06-13T02:21:29.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:28 smithi002 ceph-mon[31960]: pgmap v112: 129 pgs: 129 active+clean; 60 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 196 op/s 2024-06-13T02:21:29.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:28 smithi084 ceph-mon[36833]: pgmap v112: 129 pgs: 129 active+clean; 60 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 196 op/s 2024-06-13T02:21:29.492 INFO:tasks.workunit.client.0.smithi002.stdout: 1 227766 8.53 MB/sec execute 33 sec latency 12.901 ms 2024-06-13T02:21:30.492 INFO:tasks.workunit.client.0.smithi002.stdout: 1 229456 8.48 MB/sec execute 34 sec latency 14.324 ms 2024-06-13T02:21:31.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:30 smithi002 ceph-mon[31960]: pgmap v113: 129 pgs: 129 active+clean; 60 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 180 op/s 2024-06-13T02:21:31.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:30 smithi084 ceph-mon[36833]: pgmap v113: 129 pgs: 129 active+clean; 60 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 180 op/s 2024-06-13T02:21:31.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:30 smithi175 ceph-mon[36977]: pgmap v113: 129 pgs: 129 active+clean; 60 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 180 op/s 2024-06-13T02:21:31.492 INFO:tasks.workunit.client.0.smithi002.stdout: 1 230915 8.58 MB/sec execute 35 sec latency 41.713 ms 2024-06-13T02:21:32.492 INFO:tasks.workunit.client.0.smithi002.stdout: 1 232057 8.49 MB/sec execute 36 sec latency 13.860 ms 2024-06-13T02:21:33.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:32 smithi002 ceph-mon[31960]: pgmap v114: 129 pgs: 129 active+clean; 51 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 342 op/s 2024-06-13T02:21:33.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:32 smithi084 ceph-mon[36833]: pgmap v114: 129 pgs: 129 active+clean; 51 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 342 op/s 2024-06-13T02:21:33.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:32 smithi175 ceph-mon[36977]: pgmap v114: 129 pgs: 129 active+clean; 51 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 342 op/s 2024-06-13T02:21:33.492 INFO:tasks.workunit.client.0.smithi002.stdout: 1 234172 8.59 MB/sec execute 37 sec latency 12.634 ms 2024-06-13T02:21:34.493 INFO:tasks.workunit.client.0.smithi002.stdout: 1 235215 8.46 MB/sec execute 38 sec latency 14.566 ms 2024-06-13T02:21:35.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:34 smithi002 ceph-mon[31960]: pgmap v115: 129 pgs: 129 active+clean; 51 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 252 op/s 2024-06-13T02:21:35.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:34 smithi084 ceph-mon[36833]: pgmap v115: 129 pgs: 129 active+clean; 51 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 252 op/s 2024-06-13T02:21:35.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:34 smithi175 ceph-mon[36977]: pgmap v115: 129 pgs: 129 active+clean; 51 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 252 op/s 2024-06-13T02:21:35.493 INFO:tasks.workunit.client.0.smithi002.stdout: 1 237120 8.52 MB/sec execute 39 sec latency 16.800 ms 2024-06-13T02:21:36.493 INFO:tasks.workunit.client.0.smithi002.stdout: 1 238363 8.47 MB/sec execute 40 sec latency 45.586 ms 2024-06-13T02:21:37.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:36 smithi002 ceph-mon[31960]: pgmap v116: 129 pgs: 129 active+clean; 51 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 319 op/s 2024-06-13T02:21:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:36 smithi084 ceph-mon[36833]: pgmap v116: 129 pgs: 129 active+clean; 51 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 319 op/s 2024-06-13T02:21:37.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:36 smithi175 ceph-mon[36977]: pgmap v116: 129 pgs: 129 active+clean; 51 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 319 op/s 2024-06-13T02:21:37.493 INFO:tasks.workunit.client.0.smithi002.stdout: 1 240193 8.45 MB/sec execute 41 sec latency 17.609 ms 2024-06-13T02:21:38.493 INFO:tasks.workunit.client.0.smithi002.stdout: 1 241960 8.53 MB/sec execute 42 sec latency 10.230 ms 2024-06-13T02:21:39.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:38 smithi002 ceph-mon[31960]: pgmap v117: 129 pgs: 129 active+clean; 51 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 250 op/s 2024-06-13T02:21:39.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:38 smithi084 ceph-mon[36833]: pgmap v117: 129 pgs: 129 active+clean; 51 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 250 op/s 2024-06-13T02:21:39.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:38 smithi175 ceph-mon[36977]: pgmap v117: 129 pgs: 129 active+clean; 51 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 250 op/s 2024-06-13T02:21:39.493 INFO:tasks.workunit.client.0.smithi002.stdout: 1 243841 8.51 MB/sec execute 43 sec latency 15.580 ms 2024-06-13T02:21:40.493 INFO:tasks.workunit.client.0.smithi002.stdout: 1 245521 8.57 MB/sec execute 44 sec latency 11.672 ms 2024-06-13T02:21:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.030+0000 7fc3ade00640 1 -- 172.21.15.2:0/711357796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a8103e10 msgr2=0x7fc3a81041f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.030+0000 7fc3ade00640 1 --2- 172.21.15.2:0/711357796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a8103e10 0x7fc3a81041f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc398009900 tx=0x7fc39802a3f0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.030+0000 7fc3ade00640 1 -- 172.21.15.2:0/711357796 shutdown_connections 2024-06-13T02:21:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.030+0000 7fc3ade00640 1 --2- 172.21.15.2:0/711357796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a8108ee0 0x7fc3a8110ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.030+0000 7fc3ade00640 1 --2- 172.21.15.2:0/711357796 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3a81047c0 0x7fc3a8108800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.031+0000 7fc3ade00640 1 --2- 172.21.15.2:0/711357796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a8103e10 0x7fc3a81041f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.031+0000 7fc3ade00640 1 -- 172.21.15.2:0/711357796 >> 172.21.15.2:0/711357796 conn(0x7fc3a80ff690 msgr2=0x7fc3a8101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.031+0000 7fc3ade00640 1 -- 172.21.15.2:0/711357796 shutdown_connections 2024-06-13T02:21:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.031+0000 7fc3ade00640 1 -- 172.21.15.2:0/711357796 wait complete. 2024-06-13T02:21:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.032+0000 7fc3ade00640 1 Processor -- start 2024-06-13T02:21:41.033 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.033+0000 7fc3ade00640 1 -- start start 2024-06-13T02:21:41.035 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.034+0000 7fc3ade00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3a8103e10 0x7fc3a81109f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.034+0000 7fc3ade00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a8108ee0 0x7fc3a810da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.034+0000 7fc3ade00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a810dfd0 0x7fc3a810e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.034+0000 7fc3ade00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8113f90 con 0x7fc3a8103e10 2024-06-13T02:21:41.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.034+0000 7fc3ade00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8113e10 con 0x7fc3a8108ee0 2024-06-13T02:21:41.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.034+0000 7fc3ade00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8114110 con 0x7fc3a810dfd0 2024-06-13T02:21:41.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.034+0000 7fc3a6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a8108ee0 0x7fc3a810da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.034+0000 7fc3a6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a8108ee0 0x7fc3a810da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:56244/0 (socket says 172.21.15.2:56244) 2024-06-13T02:21:41.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.034+0000 7fc3a6000640 1 -- 172.21.15.2:0/758687654 learned_addr learned my addr 172.21.15.2:0/758687654 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:41.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.034+0000 7fc3a7400640 1 --2- 172.21.15.2:0/758687654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a810dfd0 0x7fc3a810e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.034+0000 7fc3a6a00640 1 --2- 172.21.15.2:0/758687654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3a8103e10 0x7fc3a81109f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.035+0000 7fc3a6000640 1 -- 172.21.15.2:0/758687654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a810dfd0 msgr2=0x7fc3a810e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:41.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.035+0000 7fc3a6000640 1 --2- 172.21.15.2:0/758687654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a810dfd0 0x7fc3a810e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.035+0000 7fc3a6000640 1 -- 172.21.15.2:0/758687654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3a8103e10 msgr2=0x7fc3a81109f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:41.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.035+0000 7fc3a6000640 1 --2- 172.21.15.2:0/758687654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3a8103e10 0x7fc3a81109f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.035+0000 7fc3a6000640 1 -- 172.21.15.2:0/758687654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a81a0710 con 0x7fc3a8108ee0 2024-06-13T02:21:41.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.035+0000 7fc3a6000640 1 --2- 172.21.15.2:0/758687654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a8108ee0 0x7fc3a810da90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc39400e9c0 tx=0x7fc39400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:41.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.035+0000 7fc3aca00640 1 -- 172.21.15.2:0/758687654 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39400cd80 con 0x7fc3a8108ee0 2024-06-13T02:21:41.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.035+0000 7fc3ade00640 1 -- 172.21.15.2:0/758687654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a81a0a00 con 0x7fc3a8108ee0 2024-06-13T02:21:41.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.035+0000 7fc3aca00640 1 -- 172.21.15.2:0/758687654 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc394005500 con 0x7fc3a8108ee0 2024-06-13T02:21:41.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.035+0000 7fc3aca00640 1 -- 172.21.15.2:0/758687654 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc394010690 con 0x7fc3a8108ee0 2024-06-13T02:21:41.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.035+0000 7fc3ade00640 1 -- 172.21.15.2:0/758687654 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a81a0fa0 con 0x7fc3a8108ee0 2024-06-13T02:21:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.040+0000 7fc3b0b68740 1 Processor -- start 2024-06-13T02:21:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.041+0000 7fc3b0b68740 1 -- start start 2024-06-13T02:21:41.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.041+0000 7fc3b0b68740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e2215e0 0x55b49e21fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.041+0000 7fc3b0b68740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e220070 0x55b49e2204f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.041+0000 7fc3b0b68740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e22adf0 0x55b49e22d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.041+0000 7fc3b0b68740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b49e184420 con 0x55b49e2215e0 2024-06-13T02:21:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.041+0000 7fc3b0b68740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b49e12bc50 con 0x55b49e220070 2024-06-13T02:21:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.041+0000 7fc3b0b68740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b49e1803e0 con 0x55b49e22adf0 2024-06-13T02:21:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.041+0000 7fc3aca00640 1 -- 172.21.15.2:0/758687654 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fc3940046c0 con 0x7fc3a8108ee0 2024-06-13T02:21:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.041+0000 7fc3a7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e2215e0 0x55b49e21fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.041+0000 7fc3a6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e220070 0x55b49e2204f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.042+0000 7fc3a7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e2215e0 0x55b49e21fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44608/0 (socket says 172.21.15.2:44608) 2024-06-13T02:21:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.042+0000 7fc3a7400640 1 -- 172.21.15.2:0/2664190677 learned_addr learned my addr 172.21.15.2:0/2664190677 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:41.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.042+0000 7fc3a6000640 1 --2- 172.21.15.2:0/2664190677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e22adf0 0x55b49e22d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.045+0000 7fc3a7400640 1 -- 172.21.15.2:0/2664190677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e22adf0 msgr2=0x55b49e22d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.045+0000 7fc3a7400640 1 --2- 172.21.15.2:0/2664190677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e22adf0 0x55b49e22d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.045+0000 7fc3a7400640 1 -- 172.21.15.2:0/2664190677 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e220070 msgr2=0x55b49e2204f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.045+0000 7fc3a7400640 1 --2- 172.21.15.2:0/2664190677 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e220070 0x55b49e2204f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.045+0000 7fc3a7400640 1 -- 172.21.15.2:0/2664190677 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b49de98210 con 0x55b49e2215e0 2024-06-13T02:21:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.045+0000 7fc3a6000640 1 --2- 172.21.15.2:0/2664190677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e22adf0 0x55b49e22d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:21:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.045+0000 7fc3a6a00640 1 --2- 172.21.15.2:0/2664190677 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e220070 0x55b49e2204f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:21:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.046+0000 7fc3aca00640 1 --2- 172.21.15.2:0/758687654 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc38c0a2d70 0x7fc38c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.046+0000 7fc3aca00640 1 -- 172.21.15.2:0/758687654 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fc3940cfb40 con 0x7fc3a8108ee0 2024-06-13T02:21:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.046+0000 7fc3a7400640 1 --2- 172.21.15.2:0/2664190677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e2215e0 0x55b49e21fb30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009f50 tx=0x7fc3a00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eae10273095a583 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.048+0000 7fc3a6a00640 1 --2- 172.21.15.2:0/758687654 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc38c0a2d70 0x7fc38c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.049+0000 7fc3a6a00640 1 --2- 172.21.15.2:0/758687654 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc38c0a2d70 0x7fc38c0a5230 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc398009230 tx=0x7fc3980058d0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.051+0000 7fc393e00640 1 -- 172.21.15.2:0/2664190677 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0004d20 con 0x55b49e2215e0 2024-06-13T02:21:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.051+0000 7fc393e00640 1 -- 172.21.15.2:0/2664190677 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3a0004050 con 0x55b49e2215e0 2024-06-13T02:21:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.051+0000 7fc393e00640 1 -- 172.21.15.2:0/2664190677 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0005260 con 0x55b49e2215e0 2024-06-13T02:21:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.053+0000 7fc3b0b68740 1 -- 172.21.15.2:0/2664190677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e2215e0 msgr2=0x55b49e21fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.053+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/2664190677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e2215e0 0x55b49e21fb30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009f50 tx=0x7fc3a00118d0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.053+0000 7fc3b0b68740 1 -- 172.21.15.2:0/2664190677 shutdown_connections 2024-06-13T02:21:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.053+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/2664190677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e22adf0 0x55b49e22d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.053+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/2664190677 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e220070 0x55b49e2204f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.053+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/2664190677 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e2215e0 0x55b49e21fb30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.053+0000 7fc3b0b68740 1 -- 172.21.15.2:0/2664190677 >> 172.21.15.2:0/2664190677 conn(0x55b49e1e8fb0 msgr2=0x55b49e21c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.053+0000 7fc3b0b68740 1 -- 172.21.15.2:0/2664190677 shutdown_connections 2024-06-13T02:21:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.054+0000 7fc3b0b68740 1 -- 172.21.15.2:0/2664190677 wait complete. 2024-06-13T02:21:41.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.054+0000 7fc3b0b68740 1 -- start start 2024-06-13T02:21:41.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.055+0000 7fc3b0b68740 1 Processor -- start 2024-06-13T02:21:41.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.055+0000 7fc3b0b68740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e220070 0x55b49e227e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.055+0000 7fc3b0b68740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e2215e0 0x55b49e228380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.055+0000 7fc3b0b68740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e22adf0 0x55b49e2288c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.055+0000 7fc3b0b68740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b49e22dbc0 con 0x55b49e22adf0 2024-06-13T02:21:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.055+0000 7fc3b0b68740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b49e13f0b0 con 0x55b49e2215e0 2024-06-13T02:21:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.055+0000 7fc3b0b68740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b49e22dd40 con 0x55b49e220070 2024-06-13T02:21:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.055+0000 7fc3b0b68740 10 client.0 _ll_register_callbacks cb 0x55b49e12af40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:21:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.056+0000 7fc3a6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e2215e0 0x55b49e228380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.056+0000 7fc3a6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e2215e0 0x55b49e228380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:56260/0 (socket says 172.21.15.2:56260) 2024-06-13T02:21:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.056+0000 7fc3a6000640 1 -- 172.21.15.2:0/3423843669 learned_addr learned my addr 172.21.15.2:0/3423843669 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.056+0000 7fc3a6a00640 1 --2- 172.21.15.2:0/3423843669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e220070 0x55b49e227e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.056+0000 7fc3a7400640 1 --2- 172.21.15.2:0/3423843669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e22adf0 0x55b49e2288c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.056+0000 7fc3a6000640 1 -- 172.21.15.2:0/3423843669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e220070 msgr2=0x55b49e227e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.056+0000 7fc3a6000640 1 --2- 172.21.15.2:0/3423843669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e220070 0x55b49e227e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.056+0000 7fc3a6000640 1 -- 172.21.15.2:0/3423843669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e22adf0 msgr2=0x55b49e2288c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.056+0000 7fc3a6000640 1 --2- 172.21.15.2:0/3423843669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e22adf0 0x55b49e2288c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.056+0000 7fc3a6000640 1 -- 172.21.15.2:0/3423843669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b49df64620 con 0x55b49e2215e0 2024-06-13T02:21:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.056+0000 7fc3a7400640 1 --2- 172.21.15.2:0/3423843669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e22adf0 0x55b49e2288c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:21:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.056+0000 7fc3a6a00640 1 --2- 172.21.15.2:0/3423843669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e220070 0x55b49e227e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:21:41.059 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.057+0000 7fc390c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:21:41.059 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.057+0000 7fc3a6000640 1 --2- 172.21.15.2:0/3423843669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e2215e0 0x55b49e228380 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc39409bc20 tx=0x7fc3940056b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=125874cc11567b70 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.057+0000 7fc390c00640 1 -- 172.21.15.2:0/3423843669 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39409b7d0 con 0x55b49e2215e0 2024-06-13T02:21:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.057+0000 7fc390c00640 1 -- 172.21.15.2:0/3423843669 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fc3940a4470 con 0x55b49e2215e0 2024-06-13T02:21:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.058+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3423843669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3a0004050 con 0x55b49e2215e0 2024-06-13T02:21:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.058+0000 7fc390c00640 1 -- 172.21.15.2:0/3423843669 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc39409b5f0 con 0x55b49e2215e0 2024-06-13T02:21:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.058+0000 7fc3b0b68740 10 client.25550 fetch_fsmap learned FSMap version 29 2024-06-13T02:21:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.058+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3423843669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b49e239fc0 con 0x55b49e2215e0 2024-06-13T02:21:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.059+0000 7fc390c00640 1 -- 172.21.15.2:0/3423843669 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3a0004050 con 0x55b49e2215e0 2024-06-13T02:21:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.059+0000 7fc390c00640 1 -- 172.21.15.2:0/3423843669 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fc39409b0e0 con 0x55b49e2215e0 2024-06-13T02:21:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.059+0000 7fc3b0b68740 10 client.25550 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T02:21:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.059+0000 7fc3b0b68740 10 client.25550 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:21:41.060 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.059+0000 7fc3b0b68740 20 client.25550 populate_metadata read hostname 'smithi002' 2024-06-13T02:21:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.059+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/3423843669 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b49e23b430 0x55b49e23d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.059+0000 7fc3b0b68740 4 client.25550 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:21:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.059+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3423843669 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b49e191b50 con 0x55b49e23b430 2024-06-13T02:21:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.060+0000 7fc3a6a00640 1 --2- 172.21.15.2:0/3423843669 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b49e23b430 0x55b49e23d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.061+0000 7fc3a6a00640 1 --2- 172.21.15.2:0/3423843669 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b49e23b430 0x55b49e23d820 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fcb95adfe72029f server_cookie=13755346298739d8 in_seq=0 out_seq=0 2024-06-13T02:21:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.061+0000 7fc390c00640 10 client.25550 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:41.064 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.063+0000 7fc390c00640 1 -- 172.21.15.2:0/3423843669 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b49e191b50 con 0x55b49e23b430 2024-06-13T02:21:41.064 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.063+0000 7fc390c00640 10 client.25550 handle_command_reply: tid=0 2024-06-13T02:21:41.064 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.063+0000 7fc3b0b68740 1 client.25550 shutdown 2024-06-13T02:21:41.064 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.064+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3423843669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e2215e0 msgr2=0x55b49e228380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:41.064 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.064+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/3423843669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e2215e0 0x55b49e228380 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc39409bc20 tx=0x7fc3940056b0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.066+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3423843669 shutdown_connections 2024-06-13T02:21:41.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.066+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/3423843669 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b49e23b430 0x55b49e23d820 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.066+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/3423843669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e22adf0 0x55b49e2288c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.066+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/3423843669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e2215e0 0x55b49e228380 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.066+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/3423843669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e220070 0x55b49e227e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.066+0000 7fc390c00640 0 client.25550 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:41.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.066+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3423843669 >> 172.21.15.2:0/3423843669 conn(0x55b49e1e8fb0 msgr2=0x55b49e222460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:41.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.067+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3423843669 shutdown_connections 2024-06-13T02:21:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.067+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3423843669 wait complete. 2024-06-13T02:21:41.068 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.068+0000 7fc3b0b68740 20 client.25550 trim_cache size 0 max 16384 2024-06-13T02:21:41.108 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.108+0000 7fc3b0b68740 1 Processor -- start 2024-06-13T02:21:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.108+0000 7fc3b0b68740 1 -- start start 2024-06-13T02:21:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.109+0000 7fc3b0b68740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e220070 0x55b49e243130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.109 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.109+0000 7fc3b0b68740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e2215e0 0x55b49e243670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.109+0000 7fc3b0b68740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e22adf0 0x55b49e221bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.109+0000 7fc3b0b68740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81b7f70 con 0x55b49e220070 2024-06-13T02:21:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.109+0000 7fc3b0b68740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81b5840 con 0x55b49e2215e0 2024-06-13T02:21:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.109+0000 7fc3b0b68740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a80725d0 con 0x55b49e22adf0 2024-06-13T02:21:41.110 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.109+0000 7fc3a7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e22adf0 0x55b49e221bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.110+0000 7fc3a6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e2215e0 0x55b49e243670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.110+0000 7fc3a6000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e2215e0 0x55b49e243670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:56262/0 (socket says 172.21.15.2:56262) 2024-06-13T02:21:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.110+0000 7fc3a6000640 1 -- 172.21.15.2:0/2847756307 learned_addr learned my addr 172.21.15.2:0/2847756307 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:41.111 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.110+0000 7fc3a6a00640 1 --2- 172.21.15.2:0/2847756307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e220070 0x55b49e243130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.111+0000 7fc3a6000640 1 -- 172.21.15.2:0/2847756307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e22adf0 msgr2=0x55b49e221bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.111+0000 7fc3a6000640 1 --2- 172.21.15.2:0/2847756307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e22adf0 0x55b49e221bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.111+0000 7fc3a6000640 1 -- 172.21.15.2:0/2847756307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e220070 msgr2=0x55b49e243130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.111+0000 7fc3a6000640 1 --2- 172.21.15.2:0/2847756307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e220070 0x55b49e243130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.111+0000 7fc3a6000640 1 -- 172.21.15.2:0/2847756307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b49e226390 con 0x55b49e2215e0 2024-06-13T02:21:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.112+0000 7fc3a6000640 1 --2- 172.21.15.2:0/2847756307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e2215e0 0x55b49e243670 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc394098660 tx=0x7fc394005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a41d58ba750762f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:41.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.113+0000 7fc393400640 1 -- 172.21.15.2:0/2847756307 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3940d3030 con 0x55b49e2215e0 2024-06-13T02:21:41.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.113+0000 7fc393400640 1 -- 172.21.15.2:0/2847756307 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc39409c390 con 0x55b49e2215e0 2024-06-13T02:21:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.113+0000 7fc393400640 1 -- 172.21.15.2:0/2847756307 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3940b9080 con 0x55b49e2215e0 2024-06-13T02:21:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.114+0000 7fc3b0b68740 1 -- 172.21.15.2:0/2847756307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e2215e0 msgr2=0x55b49e243670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.114+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/2847756307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e2215e0 0x55b49e243670 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc394098660 tx=0x7fc394005720 comp rx=0 tx=0).stop 2024-06-13T02:21:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.114+0000 7fc3b0b68740 1 -- 172.21.15.2:0/2847756307 shutdown_connections 2024-06-13T02:21:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.114+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/2847756307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e22adf0 0x55b49e221bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.114+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/2847756307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e2215e0 0x55b49e243670 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.114+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/2847756307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e220070 0x55b49e243130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.114+0000 7fc3b0b68740 1 -- 172.21.15.2:0/2847756307 >> 172.21.15.2:0/2847756307 conn(0x55b49e1e8fb0 msgr2=0x55b49e21c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.115+0000 7fc3b0b68740 1 -- 172.21.15.2:0/2847756307 shutdown_connections 2024-06-13T02:21:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.115+0000 7fc3b0b68740 1 -- 172.21.15.2:0/2847756307 wait complete. 2024-06-13T02:21:41.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.115+0000 7fc3b0b68740 1 -- start start 2024-06-13T02:21:41.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.116+0000 7fc3b0b68740 1 Processor -- start 2024-06-13T02:21:41.118 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.118+0000 7fc3b0b68740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e220070 0x55b49e233340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.118+0000 7fc3b0b68740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e2215e0 0x55b49e233880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.118+0000 7fc3b0b68740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e22adf0 0x55b49e22e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.118+0000 7fc3b0b68740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8072c40 con 0x55b49e22adf0 2024-06-13T02:21:41.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.118+0000 7fc3b0b68740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a81b5170 con 0x55b49e220070 2024-06-13T02:21:41.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.118+0000 7fc3b0b68740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8073310 con 0x55b49e2215e0 2024-06-13T02:21:41.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.118+0000 7fc3b0b68740 10 client.0 _ll_register_callbacks cb 0x7fc394009790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:21:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.119+0000 7fc3a6000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e2215e0 0x55b49e233880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.119+0000 7fc3a6a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e220070 0x55b49e233340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.119+0000 7fc3a6000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e2215e0 0x55b49e233880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:32938/0 (socket says 172.21.15.2:32938) 2024-06-13T02:21:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.119+0000 7fc3a6000640 1 -- 172.21.15.2:0/3809852022 learned_addr learned my addr 172.21.15.2:0/3809852022 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.119+0000 7fc3a6a00640 1 -- 172.21.15.2:0/3809852022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e2215e0 msgr2=0x55b49e233880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.120+0000 7fc3a6a00640 1 --2- 172.21.15.2:0/3809852022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e2215e0 0x55b49e233880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.120+0000 7fc3a6a00640 1 -- 172.21.15.2:0/3809852022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e22adf0 msgr2=0x55b49e22e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:41.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.120+0000 7fc3a6a00640 1 --2- 172.21.15.2:0/3809852022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e22adf0 0x55b49e22e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.120+0000 7fc3a6a00640 1 -- 172.21.15.2:0/3809852022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b49e22f0b0 con 0x55b49e220070 2024-06-13T02:21:41.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.120+0000 7fc390c00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:21:41.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.120+0000 7fc3a6a00640 1 --2- 172.21.15.2:0/3809852022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e220070 0x55b49e233340 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc398005940 tx=0x7fc398009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=243ef927b3b3e465 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:41.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.121+0000 7fc390c00640 1 -- 172.21.15.2:0/3809852022 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398035040 con 0x55b49e220070 2024-06-13T02:21:41.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.121+0000 7fc390c00640 1 -- 172.21.15.2:0/3809852022 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9495+0+0 (secure 0 0 0) 0x7fc398003b80 con 0x55b49e220070 2024-06-13T02:21:41.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.121+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3809852022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc39409c390 con 0x55b49e220070 2024-06-13T02:21:41.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.122+0000 7fc390c00640 1 -- 172.21.15.2:0/3809852022 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc398003d80 con 0x55b49e220070 2024-06-13T02:21:41.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.122+0000 7fc3b0b68740 10 client.25556 fetch_fsmap learned FSMap version 29 2024-06-13T02:21:41.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.123+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3809852022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b49e2a5d80 con 0x55b49e220070 2024-06-13T02:21:41.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.123+0000 7fc390c00640 1 -- 172.21.15.2:0/3809852022 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc39409c390 con 0x55b49e220070 2024-06-13T02:21:41.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.123+0000 7fc390c00640 1 -- 172.21.15.2:0/3809852022 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 29) ==== 8346+0+0 (secure 0 0 0) 0x7fc39803d4e0 con 0x55b49e220070 2024-06-13T02:21:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.124+0000 7fc3b0b68740 10 client.25556 fetch_fsmap finished waiting for FSMap version 29 2024-06-13T02:21:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.124+0000 7fc3b0b68740 10 client.25556 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:21:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.124+0000 7fc3b0b68740 20 client.25556 populate_metadata read hostname 'smithi002' 2024-06-13T02:21:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.124+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/3809852022 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b49e2a6450 0x55b49e2a8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.124+0000 7fc3b0b68740 4 client.25556 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:21:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.124+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3809852022 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b49e18bea0 con 0x55b49e2a6450 2024-06-13T02:21:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.126+0000 7fc3a6000640 1 --2- 172.21.15.2:0/3809852022 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b49e2a6450 0x55b49e2a8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.129+0000 7fc3a6000640 1 --2- 172.21.15.2:0/3809852022 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b49e2a6450 0x55b49e2a8890 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6ea6bcf14f183c6 server_cookie=d8805f3445d6d13e in_seq=0 out_seq=0 2024-06-13T02:21:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.129+0000 7fc390c00640 10 client.25556 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:41.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:40 smithi002 ceph-mon[31960]: pgmap v118: 129 pgs: 129 active+clean; 51 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 241 op/s 2024-06-13T02:21:41.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:40 smithi084 ceph-mon[36833]: pgmap v118: 129 pgs: 129 active+clean; 51 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 241 op/s 2024-06-13T02:21:41.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:40 smithi175 ceph-mon[36977]: pgmap v118: 129 pgs: 129 active+clean; 51 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 241 op/s 2024-06-13T02:21:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.312+0000 7fc390c00640 1 -- 172.21.15.2:0/3809852022 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55b49e18bea0 con 0x55b49e2a6450 2024-06-13T02:21:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.312+0000 7fc390c00640 10 client.25556 handle_command_reply: tid=0 2024-06-13T02:21:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.312+0000 7fc3b0b68740 1 client.25556 shutdown 2024-06-13T02:21:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.312+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3809852022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e220070 msgr2=0x55b49e233340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.312+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/3809852022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e220070 0x55b49e233340 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc398005940 tx=0x7fc398009260 comp rx=0 tx=0).stop 2024-06-13T02:21:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.312+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3809852022 shutdown_connections 2024-06-13T02:21:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.313+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/3809852022 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b49e2a6450 0x55b49e2a8890 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.313+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/3809852022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b49e22adf0 0x55b49e22e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.313+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/3809852022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b49e2215e0 0x55b49e233880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.313+0000 7fc3b0b68740 1 --2- 172.21.15.2:0/3809852022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b49e220070 0x55b49e233340 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.313+0000 7fc390c00640 0 client.25556 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.313+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3809852022 >> 172.21.15.2:0/3809852022 conn(0x55b49e1e8fb0 msgr2=0x55b49e227e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.313+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3809852022 shutdown_connections 2024-06-13T02:21:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.313+0000 7fc3b0b68740 1 -- 172.21.15.2:0/3809852022 wait complete. 2024-06-13T02:21:41.315 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.314+0000 7fc3b0b68740 20 client.25556 trim_cache size 0 max 16384 2024-06-13T02:21:41.315 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:21:41.315 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:21:41.315 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:21:41.315 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.314+0000 7fc3ade00640 1 -- 172.21.15.2:0/758687654 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc38c0a2d70 msgr2=0x7fc38c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.314+0000 7fc3ade00640 1 --2- 172.21.15.2:0/758687654 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc38c0a2d70 0x7fc38c0a5230 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc398009230 tx=0x7fc3980058d0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.315+0000 7fc3ade00640 1 -- 172.21.15.2:0/758687654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a8108ee0 msgr2=0x7fc3a810da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.315+0000 7fc3ade00640 1 --2- 172.21.15.2:0/758687654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a8108ee0 0x7fc3a810da90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc39400e9c0 tx=0x7fc39400ee80 comp rx=0 tx=0).stop 2024-06-13T02:21:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.315+0000 7fc3ade00640 1 -- 172.21.15.2:0/758687654 shutdown_connections 2024-06-13T02:21:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.315+0000 7fc3ade00640 1 --2- 172.21.15.2:0/758687654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3a810dfd0 0x7fc3a810e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.315+0000 7fc3ade00640 1 --2- 172.21.15.2:0/758687654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3a8108ee0 0x7fc3a810da90 secure :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc39400e9c0 tx=0x7fc39400ee80 comp rx=0 tx=0).stop 2024-06-13T02:21:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.315+0000 7fc3ade00640 1 --2- 172.21.15.2:0/758687654 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc38c0a2d70 0x7fc38c0a5230 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.315+0000 7fc3ade00640 1 --2- 172.21.15.2:0/758687654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc3a8103e10 0x7fc3a81109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.315+0000 7fc3ade00640 1 -- 172.21.15.2:0/758687654 >> 172.21.15.2:0/758687654 conn(0x7fc3a80ff690 msgr2=0x7fc3a81019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.316+0000 7fc3ade00640 1 -- 172.21.15.2:0/758687654 shutdown_connections 2024-06-13T02:21:41.317 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:41.316+0000 7fc3ade00640 1 -- 172.21.15.2:0/758687654 wait complete. 2024-06-13T02:21:41.493 INFO:tasks.workunit.client.0.smithi002.stdout: 1 247189 8.53 MB/sec execute 45 sec latency 85.931 ms 2024-06-13T02:21:41.721 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:21:41 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: ignoring --setuser ceph since I am not root 2024-06-13T02:21:41.721 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:21:41 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: ignoring --setgroup ceph since I am not root 2024-06-13T02:21:41.721 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:21:41 smithi084 ceph-mds[66763]: -- 172.21.15.84:0/2444698509 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55afa8db3a40 con 0x55afa8d86c00 2024-06-13T02:21:41.721 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:21:41 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: starting mds.h at 2024-06-13T02:21:42.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:41 smithi002 ceph-mon[31960]: daemon mds.h restarted 2024-06-13T02:21:42.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:41 smithi084 ceph-mon[36833]: daemon mds.h restarted 2024-06-13T02:21:42.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:41 smithi175 ceph-mon[36977]: daemon mds.h restarted 2024-06-13T02:21:42.493 INFO:tasks.workunit.client.0.smithi002.stdout: 1 248949 8.61 MB/sec execute 46 sec latency 12.984 ms 2024-06-13T02:21:43.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:42 smithi002 ceph-mon[31960]: pgmap v119: 129 pgs: 129 active+clean; 54 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 323 op/s 2024-06-13T02:21:43.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:42 smithi002 ceph-mon[31960]: osdmap e102: 12 total, 12 up, 12 in 2024-06-13T02:21:43.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:42 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:21:43.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:42 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.84:6836/2734659556,v1:172.21.15.84:6837/2734659556] up:boot 2024-06-13T02:21:43.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:42 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-06-13T02:21:43.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:42 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:21:43.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:42 smithi084 ceph-mon[36833]: pgmap v119: 129 pgs: 129 active+clean; 54 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 323 op/s 2024-06-13T02:21:43.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:42 smithi084 ceph-mon[36833]: osdmap e102: 12 total, 12 up, 12 in 2024-06-13T02:21:43.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:42 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:21:43.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:42 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.84:6836/2734659556,v1:172.21.15.84:6837/2734659556] up:boot 2024-06-13T02:21:43.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:42 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-06-13T02:21:43.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:42 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:21:43.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:42 smithi175 ceph-mon[36977]: pgmap v119: 129 pgs: 129 active+clean; 54 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 323 op/s 2024-06-13T02:21:43.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:42 smithi175 ceph-mon[36977]: osdmap e102: 12 total, 12 up, 12 in 2024-06-13T02:21:43.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:42 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:21:43.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:42 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.84:6836/2734659556,v1:172.21.15.84:6837/2734659556] up:boot 2024-06-13T02:21:43.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:42 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-06-13T02:21:43.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:42 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:21:43.494 INFO:tasks.workunit.client.0.smithi002.stdout: 1 250706 8.58 MB/sec execute 47 sec latency 15.723 ms 2024-06-13T02:21:44.494 INFO:tasks.workunit.client.0.smithi002.stdout: 1 252456 8.65 MB/sec execute 48 sec latency 10.634 ms 2024-06-13T02:21:45.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:44 smithi002 ceph-mon[31960]: pgmap v121: 129 pgs: 129 active+clean; 54 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 193 op/s 2024-06-13T02:21:45.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:44 smithi084 ceph-mon[36833]: pgmap v121: 129 pgs: 129 active+clean; 54 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 193 op/s 2024-06-13T02:21:45.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:44 smithi175 ceph-mon[36977]: pgmap v121: 129 pgs: 129 active+clean; 54 MiB data, 1016 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 193 op/s 2024-06-13T02:21:45.494 INFO:tasks.workunit.client.0.smithi002.stdout: 1 254269 8.62 MB/sec execute 49 sec latency 15.718 ms 2024-06-13T02:21:46.494 INFO:tasks.workunit.client.0.smithi002.stdout: 1 255791 8.69 MB/sec execute 50 sec latency 59.500 ms 2024-06-13T02:21:47.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:46 smithi002 ceph-mon[31960]: pgmap v122: 129 pgs: 129 active+clean; 47 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 269 op/s 2024-06-13T02:21:47.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:46 smithi084 ceph-mon[36833]: pgmap v122: 129 pgs: 129 active+clean; 47 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 269 op/s 2024-06-13T02:21:47.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:46 smithi175 ceph-mon[36977]: pgmap v122: 129 pgs: 129 active+clean; 47 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 269 op/s 2024-06-13T02:21:47.494 INFO:tasks.workunit.client.0.smithi002.stdout: 1 256893 8.62 MB/sec execute 51 sec latency 26.276 ms 2024-06-13T02:21:48.494 INFO:tasks.workunit.client.0.smithi002.stdout: 1 258920 8.69 MB/sec execute 52 sec latency 15.993 ms 2024-06-13T02:21:49.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:48 smithi002 ceph-mon[31960]: pgmap v123: 129 pgs: 129 active+clean; 47 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 295 op/s 2024-06-13T02:21:49.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:48 smithi084 ceph-mon[36833]: pgmap v123: 129 pgs: 129 active+clean; 47 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 295 op/s 2024-06-13T02:21:49.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:48 smithi175 ceph-mon[36977]: pgmap v123: 129 pgs: 129 active+clean; 47 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 295 op/s 2024-06-13T02:21:49.494 INFO:tasks.workunit.client.0.smithi002.stdout: 1 259772 8.56 MB/sec execute 53 sec latency 21.101 ms 2024-06-13T02:21:50.495 INFO:tasks.workunit.client.0.smithi002.stdout: 1 261346 8.53 MB/sec execute 54 sec latency 25.257 ms 2024-06-13T02:21:51.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:50 smithi002 ceph-mon[31960]: pgmap v124: 129 pgs: 129 active+clean; 47 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 295 op/s 2024-06-13T02:21:51.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:50 smithi084 ceph-mon[36833]: pgmap v124: 129 pgs: 129 active+clean; 47 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 295 op/s 2024-06-13T02:21:51.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:50 smithi175 ceph-mon[36977]: pgmap v124: 129 pgs: 129 active+clean; 47 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 295 op/s 2024-06-13T02:21:51.495 INFO:tasks.workunit.client.0.smithi002.stdout: 1 262735 8.59 MB/sec execute 55 sec latency 53.605 ms 2024-06-13T02:21:52.495 INFO:tasks.workunit.client.0.smithi002.stdout: 1 263696 8.47 MB/sec execute 56 sec latency 14.056 ms 2024-06-13T02:21:53.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:52 smithi084 ceph-mon[36833]: pgmap v125: 129 pgs: 129 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 300 op/s 2024-06-13T02:21:53.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:52 smithi175 ceph-mon[36977]: pgmap v125: 129 pgs: 129 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 300 op/s 2024-06-13T02:21:53.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:52 smithi002 ceph-mon[31960]: pgmap v125: 129 pgs: 129 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 300 op/s 2024-06-13T02:21:53.495 INFO:tasks.workunit.client.0.smithi002.stdout: 1 266088 8.60 MB/sec execute 57 sec latency 11.611 ms 2024-06-13T02:21:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.465+0000 7f2b53e00640 1 -- 172.21.15.2:0/587984902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b54107e00 msgr2=0x7f2b54108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.465+0000 7f2b53e00640 1 --2- 172.21.15.2:0/587984902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b54107e00 0x7f2b54108260 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009900 tx=0x7f2b3c02a480 comp rx=0 tx=0).stop 2024-06-13T02:21:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.466+0000 7f2b53e00640 1 -- 172.21.15.2:0/587984902 shutdown_connections 2024-06-13T02:21:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.466+0000 7f2b53e00640 1 --2- 172.21.15.2:0/587984902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b541087a0 0x7f2b54114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.466+0000 7f2b53e00640 1 --2- 172.21.15.2:0/587984902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b54107e00 0x7f2b54108260 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.466+0000 7f2b53e00640 1 --2- 172.21.15.2:0/587984902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b5410dec0 0x7f2b5410e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.466+0000 7f2b53e00640 1 -- 172.21.15.2:0/587984902 >> 172.21.15.2:0/587984902 conn(0x7f2b54077550 msgr2=0x7f2b54079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.466+0000 7f2b53e00640 1 -- 172.21.15.2:0/587984902 shutdown_connections 2024-06-13T02:21:54.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.466+0000 7f2b53e00640 1 -- 172.21.15.2:0/587984902 wait complete. 2024-06-13T02:21:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.467+0000 7f2b53e00640 1 Processor -- start 2024-06-13T02:21:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.467+0000 7f2b53e00640 1 -- start start 2024-06-13T02:21:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b53e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b54107e00 0x7f2b5419e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b53e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b541087a0 0x7f2b5419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b53e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b5410dec0 0x7f2b541a2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b53e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2b541181f0 con 0x7f2b541087a0 2024-06-13T02:21:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b53e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2b54118070 con 0x7f2b54107e00 2024-06-13T02:21:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b53e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2b54118370 con 0x7f2b5410dec0 2024-06-13T02:21:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b53400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b5410dec0 0x7f2b541a2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b4be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b541087a0 0x7f2b5419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b53400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b5410dec0 0x7f2b541a2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:38078/0 (socket says 172.21.15.2:38078) 2024-06-13T02:21:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b53400640 1 -- 172.21.15.2:0/3362786991 learned_addr learned my addr 172.21.15.2:0/3362786991 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b52a00640 1 --2- 172.21.15.2:0/3362786991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b54107e00 0x7f2b5419e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b53400640 1 -- 172.21.15.2:0/3362786991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b54107e00 msgr2=0x7f2b5419e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b53400640 1 --2- 172.21.15.2:0/3362786991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b54107e00 0x7f2b5419e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b53400640 1 -- 172.21.15.2:0/3362786991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b541087a0 msgr2=0x7f2b5419eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b53400640 1 --2- 172.21.15.2:0/3362786991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b541087a0 0x7f2b5419eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.468+0000 7f2b53400640 1 -- 172.21.15.2:0/3362786991 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b541a3620 con 0x7f2b5410dec0 2024-06-13T02:21:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.469+0000 7f2b53400640 1 --2- 172.21.15.2:0/3362786991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b5410dec0 0x7f2b541a2ef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00eb10 tx=0x7f2b4c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.469+0000 7f2b4b400640 1 -- 172.21.15.2:0/3362786991 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c004b20 con 0x7f2b5410dec0 2024-06-13T02:21:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.469+0000 7f2b4b400640 1 -- 172.21.15.2:0/3362786991 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b4c004cc0 con 0x7f2b5410dec0 2024-06-13T02:21:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.469+0000 7f2b4b400640 1 -- 172.21.15.2:0/3362786991 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c010760 con 0x7f2b5410dec0 2024-06-13T02:21:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.469+0000 7f2b53e00640 1 -- 172.21.15.2:0/3362786991 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b541a3910 con 0x7f2b5410dec0 2024-06-13T02:21:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.469+0000 7f2b53e00640 1 -- 172.21.15.2:0/3362786991 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b541ab1a0 con 0x7f2b5410dec0 2024-06-13T02:21:54.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.473+0000 7f2b5cbb0740 1 Processor -- start 2024-06-13T02:21:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.473+0000 7f2b4b400640 1 -- 172.21.15.2:0/3362786991 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f2b4c005020 con 0x7f2b5410dec0 2024-06-13T02:21:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.473+0000 7f2b5cbb0740 1 -- start start 2024-06-13T02:21:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.473+0000 7f2b5cbb0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f8767a0 0x56127f874cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.473+0000 7f2b5cbb0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 0x56127f8756b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.473+0000 7f2b5cbb0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f87ffb0 0x56127f8823a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.473+0000 7f2b5cbb0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56127f7d9420 con 0x56127f875230 2024-06-13T02:21:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.473+0000 7f2b5cbb0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56127f780c50 con 0x56127f8767a0 2024-06-13T02:21:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.473+0000 7f2b5cbb0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56127f7d53e0 con 0x56127f87ffb0 2024-06-13T02:21:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.474+0000 7f2b4be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f8767a0 0x56127f874cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.474+0000 7f2b4be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f8767a0 0x56127f874cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:39066/0 (socket says 172.21.15.2:39066) 2024-06-13T02:21:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.474+0000 7f2b4be00640 1 -- 172.21.15.2:0/608461888 learned_addr learned my addr 172.21.15.2:0/608461888 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.474+0000 7f2b52a00640 1 --2- 172.21.15.2:0/608461888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 0x56127f8756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.474+0000 7f2b4be00640 1 --2- 172.21.15.2:0/608461888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f87ffb0 0x56127f8823a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.474+0000 7f2b52a00640 1 -- 172.21.15.2:0/608461888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f87ffb0 msgr2=0x56127f8823a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.474+0000 7f2b52a00640 1 --2- 172.21.15.2:0/608461888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f87ffb0 0x56127f8823a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.474+0000 7f2b52a00640 1 -- 172.21.15.2:0/608461888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f8767a0 msgr2=0x56127f874cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.474+0000 7f2b52a00640 1 --2- 172.21.15.2:0/608461888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f8767a0 0x56127f874cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.474+0000 7f2b52a00640 1 -- 172.21.15.2:0/608461888 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56127f4ed210 con 0x56127f875230 2024-06-13T02:21:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.474+0000 7f2b4be00640 1 --2- 172.21.15.2:0/608461888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f8767a0 0x56127f874cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:21:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.475+0000 7f2b52a00640 1 --2- 172.21.15.2:0/608461888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 0x56127f8756b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009c20 tx=0x7f2b44011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9da6187d90b84bb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.475+0000 7f2b43e00640 1 -- 172.21.15.2:0/608461888 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44004050 con 0x56127f875230 2024-06-13T02:21:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.475+0000 7f2b4b400640 1 --2- 172.21.15.2:0/3362786991 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2b340a2d60 0x7f2b340a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.475+0000 7f2b43e00640 1 -- 172.21.15.2:0/608461888 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b44005500 con 0x56127f875230 2024-06-13T02:21:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.475+0000 7f2b43e00640 1 -- 172.21.15.2:0/608461888 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44004da0 con 0x56127f875230 2024-06-13T02:21:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.475+0000 7f2b4b400640 1 -- 172.21.15.2:0/3362786991 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9495+0+0 (secure 0 0 0) 0x7f2b4c0cfea0 con 0x7f2b5410dec0 2024-06-13T02:21:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.475+0000 7f2b4be00640 1 --2- 172.21.15.2:0/3362786991 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2b340a2d60 0x7f2b340a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.476+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/608461888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 msgr2=0x56127f8756b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.476+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/608461888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 0x56127f8756b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009c20 tx=0x7f2b44011810 comp rx=0 tx=0).stop 2024-06-13T02:21:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.476+0000 7f2b4be00640 1 --2- 172.21.15.2:0/3362786991 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2b340a2d60 0x7f2b340a5220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x56127f8729b0 tx=0x7f2b3c005bc0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.476+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/608461888 shutdown_connections 2024-06-13T02:21:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.476+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/608461888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f87ffb0 0x56127f8823a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.476+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/608461888 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 0x56127f8756b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.483 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.476+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/608461888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f8767a0 0x56127f874cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.476+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/608461888 >> 172.21.15.2:0/608461888 conn(0x56127f83dfb0 msgr2=0x56127f871820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.476+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/608461888 shutdown_connections 2024-06-13T02:21:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.476+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/608461888 wait complete. 2024-06-13T02:21:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.477+0000 7f2b5cbb0740 1 -- start start 2024-06-13T02:21:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.477+0000 7f2b5cbb0740 1 Processor -- start 2024-06-13T02:21:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.477+0000 7f2b5cbb0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 0x56127f87cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.478+0000 7f2b5cbb0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f8767a0 0x56127f87d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.478+0000 7f2b5cbb0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f87ffb0 0x56127f87d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.478+0000 7f2b5cbb0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56127f882d80 con 0x56127f875230 2024-06-13T02:21:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.478+0000 7f2b5cbb0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56127f7940b0 con 0x56127f87ffb0 2024-06-13T02:21:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.478+0000 7f2b5cbb0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56127f882f00 con 0x56127f8767a0 2024-06-13T02:21:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.478+0000 7f2b5cbb0740 10 client.0 _ll_register_callbacks cb 0x56127f77ff40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:21:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.478+0000 7f2b52a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 0x56127f87cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.478+0000 7f2b4be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f8767a0 0x56127f87d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.478+0000 7f2b52a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 0x56127f87cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36512/0 (socket says 172.21.15.2:36512) 2024-06-13T02:21:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.478+0000 7f2b52a00640 1 -- 172.21.15.2:0/3514144318 learned_addr learned my addr 172.21.15.2:0/3514144318 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.478+0000 7f2b4be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f8767a0 0x56127f87d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:38094/0 (socket says 172.21.15.2:38094) 2024-06-13T02:21:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.478+0000 7f2b53400640 1 --2- 172.21.15.2:0/3514144318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f87ffb0 0x56127f87d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.478+0000 7f2b4be00640 1 -- 172.21.15.2:0/3514144318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f87ffb0 msgr2=0x56127f87d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.478+0000 7f2b4be00640 1 --2- 172.21.15.2:0/3514144318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f87ffb0 0x56127f87d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.479+0000 7f2b4be00640 1 -- 172.21.15.2:0/3514144318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 msgr2=0x56127f87cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.479+0000 7f2b4be00640 1 --2- 172.21.15.2:0/3514144318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 0x56127f87cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.479+0000 7f2b4be00640 1 -- 172.21.15.2:0/3514144318 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56127f5b9620 con 0x56127f8767a0 2024-06-13T02:21:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.479+0000 7f2b53400640 1 --2- 172.21.15.2:0/3514144318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f87ffb0 0x56127f87d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:21:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.479+0000 7f2b4be00640 1 --2- 172.21.15.2:0/3514144318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f8767a0 0x56127f87d460 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c005ec0 tx=0x7f2b3c005b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a84b11ed0ffd5e1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.479+0000 7f2b40c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:21:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.479+0000 7f2b40c00640 1 -- 172.21.15.2:0/3514144318 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c04f070 con 0x56127f8767a0 2024-06-13T02:21:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.479+0000 7f2b40c00640 1 -- 172.21.15.2:0/3514144318 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9495+0+0 (secure 0 0 0) 0x7f2b3c004c50 con 0x56127f8767a0 2024-06-13T02:21:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.479+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/3514144318 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b44005500 con 0x56127f8767a0 2024-06-13T02:21:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.480+0000 7f2b40c00640 1 -- 172.21.15.2:0/3514144318 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2b3c035040 con 0x56127f8767a0 2024-06-13T02:21:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.480+0000 7f2b5cbb0740 10 client.25561 fetch_fsmap learned FSMap version 31 2024-06-13T02:21:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.480+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/3514144318 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56127f88f0a0 con 0x56127f8767a0 2024-06-13T02:21:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.480+0000 7f2b40c00640 1 -- 172.21.15.2:0/3514144318 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b44005500 con 0x56127f8767a0 2024-06-13T02:21:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.480+0000 7f2b40c00640 1 -- 172.21.15.2:0/3514144318 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f2b3c052030 con 0x56127f8767a0 2024-06-13T02:21:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.480+0000 7f2b5cbb0740 10 client.25561 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T02:21:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.480+0000 7f2b5cbb0740 10 client.25561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:21:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.480+0000 7f2b5cbb0740 20 client.25561 populate_metadata read hostname 'smithi002' 2024-06-13T02:21:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.480+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/3514144318 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56127f8905b0 0x56127f8929c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.480+0000 7f2b5cbb0740 4 client.25561 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:21:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.480+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/3514144318 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56127f7e6b50 con 0x56127f8905b0 2024-06-13T02:21:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.480+0000 7f2b52a00640 1 --2- 172.21.15.2:0/3514144318 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56127f8905b0 0x56127f8929c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.481+0000 7f2b52a00640 1 --2- 172.21.15.2:0/3514144318 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56127f8905b0 0x56127f8929c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68264b41b395f882 server_cookie=289c3fd131d3125e in_seq=0 out_seq=0 2024-06-13T02:21:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.481+0000 7f2b40c00640 10 client.25561 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.482+0000 7f2b40c00640 1 -- 172.21.15.2:0/3514144318 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56127f7e6b50 con 0x56127f8905b0 2024-06-13T02:21:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.482+0000 7f2b40c00640 10 client.25561 handle_command_reply: tid=0 2024-06-13T02:21:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.482+0000 7f2b5cbb0740 1 client.25561 shutdown 2024-06-13T02:21:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.482+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/3514144318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f8767a0 msgr2=0x56127f87d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.482+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/3514144318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f8767a0 0x56127f87d460 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c005ec0 tx=0x7f2b3c005b50 comp rx=0 tx=0).stop 2024-06-13T02:21:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.482+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/3514144318 shutdown_connections 2024-06-13T02:21:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.482+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/3514144318 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56127f8905b0 0x56127f8929c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.482+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/3514144318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f87ffb0 0x56127f87d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.482+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/3514144318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f8767a0 0x56127f87d460 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.482+0000 7f2b40c00640 0 client.25561 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.482+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/3514144318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 0x56127f87cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.482+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/3514144318 >> 172.21.15.2:0/3514144318 conn(0x56127f83dfb0 msgr2=0x56127f877620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.483+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/3514144318 shutdown_connections 2024-06-13T02:21:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.483+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/3514144318 wait complete. 2024-06-13T02:21:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.483+0000 7f2b5cbb0740 20 client.25561 trim_cache size 0 max 16384 2024-06-13T02:21:54.495 INFO:tasks.workunit.client.0.smithi002.stdout: 1 267239 8.51 MB/sec execute 58 sec latency 30.405 ms 2024-06-13T02:21:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.501+0000 7f2b5cbb0740 1 Processor -- start 2024-06-13T02:21:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.501+0000 7f2b5cbb0740 1 -- start start 2024-06-13T02:21:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.502+0000 7f2b5cbb0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 0x56127f870820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.502+0000 7f2b5cbb0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f8767a0 0x56127f8982d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.502+0000 7f2b5cbb0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f87ffb0 0x56127f898810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.502+0000 7f2b5cbb0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2b541b7be0 con 0x56127f875230 2024-06-13T02:21:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.502+0000 7f2b5cbb0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2b541b54b0 con 0x56127f87ffb0 2024-06-13T02:21:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.502+0000 7f2b5cbb0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2b541b3300 con 0x56127f8767a0 2024-06-13T02:21:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.502+0000 7f2b52a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 0x56127f870820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.502+0000 7f2b4be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f8767a0 0x56127f8982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.502+0000 7f2b4be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f8767a0 0x56127f8982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:38110/0 (socket says 172.21.15.2:38110) 2024-06-13T02:21:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.502+0000 7f2b4be00640 1 -- 172.21.15.2:0/806206900 learned_addr learned my addr 172.21.15.2:0/806206900 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.502+0000 7f2b53400640 1 --2- 172.21.15.2:0/806206900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f87ffb0 0x56127f898810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.503+0000 7f2b4be00640 1 -- 172.21.15.2:0/806206900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f87ffb0 msgr2=0x56127f898810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.503+0000 7f2b4be00640 1 --2- 172.21.15.2:0/806206900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f87ffb0 0x56127f898810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.503+0000 7f2b4be00640 1 -- 172.21.15.2:0/806206900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 msgr2=0x56127f870820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.503+0000 7f2b4be00640 1 --2- 172.21.15.2:0/806206900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 0x56127f870820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.503+0000 7f2b4be00640 1 -- 172.21.15.2:0/806206900 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56127f882d80 con 0x56127f8767a0 2024-06-13T02:21:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.503+0000 7f2b52a00640 1 --2- 172.21.15.2:0/806206900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 0x56127f870820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:21:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.503+0000 7f2b4be00640 1 --2- 172.21.15.2:0/806206900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f8767a0 0x56127f8982d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009230 tx=0x7f2b3c004150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a21d7f8874cc28ca server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.503+0000 7f2b43400640 1 -- 172.21.15.2:0/806206900 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c04f030 con 0x56127f8767a0 2024-06-13T02:21:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.503+0000 7f2b43400640 1 -- 172.21.15.2:0/806206900 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b3c004f30 con 0x56127f8767a0 2024-06-13T02:21:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.503+0000 7f2b43400640 1 -- 172.21.15.2:0/806206900 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c032930 con 0x56127f8767a0 2024-06-13T02:21:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.504+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/806206900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f8767a0 msgr2=0x56127f8982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.504+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/806206900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f8767a0 0x56127f8982d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009230 tx=0x7f2b3c004150 comp rx=0 tx=0).stop 2024-06-13T02:21:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.504+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/806206900 shutdown_connections 2024-06-13T02:21:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.504+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/806206900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f87ffb0 0x56127f898810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.504+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/806206900 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f8767a0 0x56127f8982d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.504+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/806206900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f875230 0x56127f870820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.504+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/806206900 >> 172.21.15.2:0/806206900 conn(0x56127f83dfb0 msgr2=0x56127f870110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.505+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/806206900 shutdown_connections 2024-06-13T02:21:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.505+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/806206900 wait complete. 2024-06-13T02:21:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.505+0000 7f2b5cbb0740 1 -- start start 2024-06-13T02:21:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.505+0000 7f2b5cbb0740 1 Processor -- start 2024-06-13T02:21:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b5cbb0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f875230 0x56127f888590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b5cbb0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f8767a0 0x56127f888ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b5cbb0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f87ffb0 0x56127f879a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b5cbb0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2b541b3970 con 0x56127f87ffb0 2024-06-13T02:21:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b5cbb0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2b541b4de0 con 0x56127f8767a0 2024-06-13T02:21:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b5cbb0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2b541b4040 con 0x56127f875230 2024-06-13T02:21:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b5cbb0740 10 client.0 _ll_register_callbacks cb 0x7f2b3c0042a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:21:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b52a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f875230 0x56127f888590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b52a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f875230 0x56127f888590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:38120/0 (socket says 172.21.15.2:38120) 2024-06-13T02:21:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b52a00640 1 -- 172.21.15.2:0/1162531619 learned_addr learned my addr 172.21.15.2:0/1162531619 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:21:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b4be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f8767a0 0x56127f888ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b53400640 1 --2- 172.21.15.2:0/1162531619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f87ffb0 0x56127f879a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b52a00640 1 -- 172.21.15.2:0/1162531619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f8767a0 msgr2=0x56127f888ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b52a00640 1 --2- 172.21.15.2:0/1162531619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f8767a0 0x56127f888ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b52a00640 1 -- 172.21.15.2:0/1162531619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f87ffb0 msgr2=0x56127f879a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:21:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b52a00640 1 --2- 172.21.15.2:0/1162531619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f87ffb0 0x56127f879a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b52a00640 1 -- 172.21.15.2:0/1162531619 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56127f87a250 con 0x56127f875230 2024-06-13T02:21:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.506+0000 7f2b53400640 1 --2- 172.21.15.2:0/1162531619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f87ffb0 0x56127f879a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:21:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.507+0000 7f2b52a00640 1 --2- 172.21.15.2:0/1162531619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f875230 0x56127f888590 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2b44000c00 tx=0x7f2b44005db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a22c880daaa61f0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:21:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.507+0000 7f2b40c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:21:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.507+0000 7f2b40c00640 1 -- 172.21.15.2:0/1162531619 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44004040 con 0x56127f875230 2024-06-13T02:21:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.507+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/1162531619 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b3c004f30 con 0x56127f875230 2024-06-13T02:21:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.507+0000 7f2b40c00640 1 -- 172.21.15.2:0/1162531619 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9495+0+0 (secure 0 0 0) 0x7f2b440041e0 con 0x56127f875230 2024-06-13T02:21:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.507+0000 7f2b40c00640 1 -- 172.21.15.2:0/1162531619 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2b440043e0 con 0x56127f875230 2024-06-13T02:21:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.507+0000 7f2b5cbb0740 10 client.25567 fetch_fsmap learned FSMap version 31 2024-06-13T02:21:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.507+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/1162531619 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56127f8fae70 con 0x56127f875230 2024-06-13T02:21:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.507+0000 7f2b40c00640 1 -- 172.21.15.2:0/1162531619 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b3c004f30 con 0x56127f875230 2024-06-13T02:21:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.508+0000 7f2b40c00640 1 -- 172.21.15.2:0/1162531619 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f2b4402e400 con 0x56127f875230 2024-06-13T02:21:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.508+0000 7f2b5cbb0740 10 client.25567 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T02:21:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.508+0000 7f2b5cbb0740 10 client.25567 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:21:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.508+0000 7f2b5cbb0740 20 client.25567 populate_metadata read hostname 'smithi002' 2024-06-13T02:21:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.508+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/1162531619 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56127f8fb3a0 0x56127f8fd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:21:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.508+0000 7f2b5cbb0740 4 client.25567 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:21:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.508+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/1162531619 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56127f7e0ea0 con 0x56127f8fb3a0 2024-06-13T02:21:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.508+0000 7f2b4be00640 1 --2- 172.21.15.2:0/1162531619 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56127f8fb3a0 0x56127f8fd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:21:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.509+0000 7f2b4be00640 1 --2- 172.21.15.2:0/1162531619 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56127f8fb3a0 0x56127f8fd790 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=766fffbd0c3f655d server_cookie=a520a71470f27fff in_seq=0 out_seq=0 2024-06-13T02:21:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.509+0000 7f2b40c00640 10 client.25567 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.653+0000 7f2b40c00640 1 -- 172.21.15.2:0/1162531619 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56127f7e0ea0 con 0x56127f8fb3a0 2024-06-13T02:21:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.653+0000 7f2b40c00640 10 client.25567 handle_command_reply: tid=0 2024-06-13T02:21:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.653+0000 7f2b5cbb0740 1 client.25567 shutdown 2024-06-13T02:21:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.653+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/1162531619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f875230 msgr2=0x56127f888590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.653+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/1162531619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f875230 0x56127f888590 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2b44000c00 tx=0x7f2b44005db0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.653+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/1162531619 shutdown_connections 2024-06-13T02:21:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.653+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/1162531619 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56127f8fb3a0 0x56127f8fd790 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.653+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/1162531619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56127f87ffb0 0x56127f879a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.653+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/1162531619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56127f8767a0 0x56127f888ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.653+0000 7f2b5cbb0740 1 --2- 172.21.15.2:0/1162531619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56127f875230 0x56127f888590 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.653+0000 7f2b40c00640 0 client.25567 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:21:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.653+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/1162531619 >> 172.21.15.2:0/1162531619 conn(0x56127f83dfb0 msgr2=0x56127f87cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.654+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/1162531619 shutdown_connections 2024-06-13T02:21:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.654+0000 7f2b5cbb0740 1 -- 172.21.15.2:0/1162531619 wait complete. 2024-06-13T02:21:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.654+0000 7f2b5cbb0740 20 client.25567 trim_cache size 0 max 16384 2024-06-13T02:21:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:21:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:21:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:21:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.655+0000 7f2b53e00640 1 -- 172.21.15.2:0/3362786991 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2b340a2d60 msgr2=0x7f2b340a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.655+0000 7f2b53e00640 1 --2- 172.21.15.2:0/3362786991 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2b340a2d60 0x7f2b340a5220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x56127f8729b0 tx=0x7f2b3c005bc0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.655+0000 7f2b53e00640 1 -- 172.21.15.2:0/3362786991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b5410dec0 msgr2=0x7f2b541a2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:21:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.655+0000 7f2b53e00640 1 --2- 172.21.15.2:0/3362786991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b5410dec0 0x7f2b541a2ef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00eb10 tx=0x7f2b4c00c2d0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.655+0000 7f2b53e00640 1 -- 172.21.15.2:0/3362786991 shutdown_connections 2024-06-13T02:21:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.655+0000 7f2b53e00640 1 --2- 172.21.15.2:0/3362786991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b5410dec0 0x7f2b541a2ef0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.655+0000 7f2b53e00640 1 --2- 172.21.15.2:0/3362786991 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2b340a2d60 0x7f2b340a5220 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.655+0000 7f2b53e00640 1 --2- 172.21.15.2:0/3362786991 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b541087a0 0x7f2b5419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.655+0000 7f2b53e00640 1 --2- 172.21.15.2:0/3362786991 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b54107e00 0x7f2b5419e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:21:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.655+0000 7f2b53e00640 1 -- 172.21.15.2:0/3362786991 >> 172.21.15.2:0/3362786991 conn(0x7f2b54077550 msgr2=0x7f2b54078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:21:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.655+0000 7f2b53e00640 1 -- 172.21.15.2:0/3362786991 shutdown_connections 2024-06-13T02:21:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:21:54.655+0000 7f2b53e00640 1 -- 172.21.15.2:0/3362786991 wait complete. 2024-06-13T02:21:55.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:54 smithi084 ceph-mon[36833]: pgmap v126: 129 pgs: 129 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 2.2 MiB/s wr, 253 op/s 2024-06-13T02:21:55.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:54 smithi175 ceph-mon[36977]: pgmap v126: 129 pgs: 129 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 2.2 MiB/s wr, 253 op/s 2024-06-13T02:21:55.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:54 smithi002 ceph-mon[31960]: pgmap v126: 129 pgs: 129 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 2.2 MiB/s wr, 253 op/s 2024-06-13T02:21:55.495 INFO:tasks.workunit.client.0.smithi002.stdout: 1 269565 8.63 MB/sec execute 59 sec latency 102.199 ms 2024-06-13T02:21:56.495 INFO:tasks.workunit.client.0.smithi002.stdout: 1 270429 8.52 MB/sec execute 60 sec latency 44.184 ms 2024-06-13T02:21:57.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:56 smithi084 ceph-mon[36833]: pgmap v127: 129 pgs: 129 active+clean; 45 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 379 op/s 2024-06-13T02:21:57.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:56 smithi175 ceph-mon[36977]: pgmap v127: 129 pgs: 129 active+clean; 45 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 379 op/s 2024-06-13T02:21:57.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:56 smithi002 ceph-mon[31960]: pgmap v127: 129 pgs: 129 active+clean; 45 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 379 op/s 2024-06-13T02:21:57.495 INFO:tasks.workunit.client.0.smithi002.stdout: 1 272362 8.55 MB/sec execute 61 sec latency 30.049 ms 2024-06-13T02:21:58.496 INFO:tasks.workunit.client.0.smithi002.stdout: 1 273744 8.55 MB/sec execute 62 sec latency 12.458 ms 2024-06-13T02:21:59.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:21:58 smithi084 ceph-mon[36833]: pgmap v128: 129 pgs: 129 active+clean; 46 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 281 op/s 2024-06-13T02:21:59.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:21:58 smithi175 ceph-mon[36977]: pgmap v128: 129 pgs: 129 active+clean; 46 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 281 op/s 2024-06-13T02:21:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:21:58 smithi002 ceph-mon[31960]: pgmap v128: 129 pgs: 129 active+clean; 46 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 281 op/s 2024-06-13T02:21:59.495 INFO:tasks.workunit.client.0.smithi002.stdout: 1 275243 8.50 MB/sec execute 63 sec latency 16.520 ms 2024-06-13T02:22:00.496 INFO:tasks.workunit.client.0.smithi002.stdout: 1 276961 8.57 MB/sec execute 64 sec latency 16.452 ms 2024-06-13T02:22:01.183 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:00 smithi002 ceph-mon[31960]: pgmap v129: 129 pgs: 129 active+clean; 46 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 246 op/s 2024-06-13T02:22:01.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:00 smithi084 ceph-mon[36833]: pgmap v129: 129 pgs: 129 active+clean; 46 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 246 op/s 2024-06-13T02:22:01.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:00 smithi175 ceph-mon[36977]: pgmap v129: 129 pgs: 129 active+clean; 46 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 246 op/s 2024-06-13T02:22:01.496 INFO:tasks.workunit.client.0.smithi002.stdout: 1 277708 8.46 MB/sec execute 65 sec latency 89.052 ms 2024-06-13T02:22:02.496 INFO:tasks.workunit.client.0.smithi002.stdout: 1 277741 8.35 MB/sec execute 66 sec latency 108.540 ms 2024-06-13T02:22:03.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:02 smithi084 ceph-mon[36833]: pgmap v130: 129 pgs: 129 active+clean; 49 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 332 op/s 2024-06-13T02:22:03.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:02 smithi175 ceph-mon[36977]: pgmap v130: 129 pgs: 129 active+clean; 49 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 332 op/s 2024-06-13T02:22:03.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:02 smithi002 ceph-mon[31960]: pgmap v130: 129 pgs: 129 active+clean; 49 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 332 op/s 2024-06-13T02:22:03.496 INFO:tasks.workunit.client.0.smithi002.stdout: 1 279571 8.36 MB/sec execute 67 sec latency 25.303 ms 2024-06-13T02:22:04.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:03 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:22:04.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:03 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:22:04.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:03 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:22:04.496 INFO:tasks.workunit.client.0.smithi002.stdout: 1 280909 8.36 MB/sec execute 68 sec latency 17.844 ms 2024-06-13T02:22:05.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:04 smithi084 ceph-mon[36833]: pgmap v131: 129 pgs: 129 active+clean; 49 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 246 op/s 2024-06-13T02:22:05.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:04 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:22:05.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:04 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:22:05.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:04 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:22:05.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:04 smithi175 ceph-mon[36977]: pgmap v131: 129 pgs: 129 active+clean; 49 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 246 op/s 2024-06-13T02:22:05.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:04 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:22:05.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:04 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:22:05.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:04 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:22:05.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:04 smithi002 ceph-mon[31960]: pgmap v131: 129 pgs: 129 active+clean; 49 MiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 246 op/s 2024-06-13T02:22:05.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:04 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:22:05.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:04 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:22:05.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:04 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:22:05.496 INFO:tasks.workunit.client.0.smithi002.stdout: 1 282696 8.34 MB/sec execute 69 sec latency 19.169 ms 2024-06-13T02:22:06.496 INFO:tasks.workunit.client.0.smithi002.stdout: 1 284094 8.38 MB/sec execute 70 sec latency 23.801 ms 2024-06-13T02:22:07.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:06 smithi084 ceph-mon[36833]: pgmap v132: 129 pgs: 129 active+clean; 53 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 330 op/s 2024-06-13T02:22:07.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:06 smithi175 ceph-mon[36977]: pgmap v132: 129 pgs: 129 active+clean; 53 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 330 op/s 2024-06-13T02:22:07.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:06 smithi002 ceph-mon[31960]: pgmap v132: 129 pgs: 129 active+clean; 53 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 330 op/s 2024-06-13T02:22:07.496 INFO:tasks.workunit.client.0.smithi002.stdout: 1 285043 8.30 MB/sec execute 71 sec latency 30.157 ms 2024-06-13T02:22:07.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.810+0000 7f9337200640 1 -- 172.21.15.2:0/3194162612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93300746f0 msgr2=0x7f933010dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:07.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.810+0000 7f9337200640 1 --2- 172.21.15.2:0/3194162612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93300746f0 0x7f933010dac0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9320009900 tx=0x7f932002a480 comp rx=0 tx=0).stop 2024-06-13T02:22:07.811 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.810+0000 7f9337200640 1 -- 172.21.15.2:0/3194162612 shutdown_connections 2024-06-13T02:22:07.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.810+0000 7f9337200640 1 --2- 172.21.15.2:0/3194162612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f933010e000 0x7f9330110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.810+0000 7f9337200640 1 --2- 172.21.15.2:0/3194162612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93300746f0 0x7f933010dac0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.810+0000 7f9337200640 1 --2- 172.21.15.2:0/3194162612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9330073dd0 0x7f93300741b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.810+0000 7f9337200640 1 -- 172.21.15.2:0/3194162612 >> 172.21.15.2:0/3194162612 conn(0x7f93300fd2b0 msgr2=0x7f93300ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:07.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.810+0000 7f9337200640 1 -- 172.21.15.2:0/3194162612 shutdown_connections 2024-06-13T02:22:07.812 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.810+0000 7f9337200640 1 -- 172.21.15.2:0/3194162612 wait complete. 2024-06-13T02:22:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.811+0000 7f9337200640 1 Processor -- start 2024-06-13T02:22:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.811+0000 7f9337200640 1 -- start start 2024-06-13T02:22:07.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.811+0000 7f9337200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9330073dd0 0x7f933019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.811+0000 7f9337200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93300746f0 0x7f933019a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.811+0000 7f9337200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f933010e000 0x7f933019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.811+0000 7f9337200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9330113df0 con 0x7f9330073dd0 2024-06-13T02:22:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.811+0000 7f9337200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9330113c70 con 0x7f933010e000 2024-06-13T02:22:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.811+0000 7f9337200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9330113f70 con 0x7f93300746f0 2024-06-13T02:22:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.812+0000 7f9335e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9330073dd0 0x7f933019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.812+0000 7f9335400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93300746f0 0x7f933019a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.812+0000 7f9336800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f933010e000 0x7f933019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.812+0000 7f9336800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f933010e000 0x7f933019eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36766/0 (socket says 172.21.15.2:36766) 2024-06-13T02:22:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.812+0000 7f9335400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93300746f0 0x7f933019a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58184/0 (socket says 172.21.15.2:58184) 2024-06-13T02:22:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.812+0000 7f9336800640 1 -- 172.21.15.2:0/632115371 learned_addr learned my addr 172.21.15.2:0/632115371 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.812+0000 7f9336800640 1 -- 172.21.15.2:0/632115371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93300746f0 msgr2=0x7f933019a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.812+0000 7f9336800640 1 --2- 172.21.15.2:0/632115371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93300746f0 0x7f933019a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.812+0000 7f9336800640 1 -- 172.21.15.2:0/632115371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9330073dd0 msgr2=0x7f933019a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.812+0000 7f9336800640 1 --2- 172.21.15.2:0/632115371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9330073dd0 0x7f933019a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.812+0000 7f9336800640 1 -- 172.21.15.2:0/632115371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933019f2d0 con 0x7f933010e000 2024-06-13T02:22:07.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.812+0000 7f9336800640 1 --2- 172.21.15.2:0/632115371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f933010e000 0x7f933019eba0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f932c00e970 tx=0x7f932c00ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.813+0000 7f9326a00640 1 -- 172.21.15.2:0/632115371 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c00ccc0 con 0x7f933010e000 2024-06-13T02:22:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.813+0000 7f9326a00640 1 -- 172.21.15.2:0/632115371 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f932c00ce60 con 0x7f933010e000 2024-06-13T02:22:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.813+0000 7f9337200640 1 -- 172.21.15.2:0/632115371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933019f5c0 con 0x7f933010e000 2024-06-13T02:22:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.813+0000 7f9326a00640 1 -- 172.21.15.2:0/632115371 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c010490 con 0x7f933010e000 2024-06-13T02:22:07.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.813+0000 7f9337200640 1 -- 172.21.15.2:0/632115371 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93301a6e50 con 0x7f933010e000 2024-06-13T02:22:07.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.816+0000 7f933b56f740 1 Processor -- start 2024-06-13T02:22:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.817+0000 7f9326a00640 1 -- 172.21.15.2:0/632115371 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f932c005020 con 0x7f933010e000 2024-06-13T02:22:07.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.817+0000 7f933b56f740 1 -- start start 2024-06-13T02:22:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.817+0000 7f933b56f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc817a0 0x556aabc7fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.817+0000 7f933b56f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc80230 0x556aabc806b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.817+0000 7f933b56f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc8afb0 0x556aabc8d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.817+0000 7f933b56f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556aabbe4420 con 0x556aabc8afb0 2024-06-13T02:22:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.817+0000 7f933b56f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556aabb8bc50 con 0x556aabc817a0 2024-06-13T02:22:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.817+0000 7f933b56f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556aabbe03e0 con 0x556aabc80230 2024-06-13T02:22:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.818+0000 7f9335400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc817a0 0x556aabc7fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.818+0000 7f9335e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc80230 0x556aabc806b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.818+0000 7f9335e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc80230 0x556aabc806b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58192/0 (socket says 172.21.15.2:58192) 2024-06-13T02:22:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.818+0000 7f9335400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc817a0 0x556aabc7fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36774/0 (socket says 172.21.15.2:36774) 2024-06-13T02:22:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.818+0000 7f9335e00640 1 -- 172.21.15.2:0/1397710690 learned_addr learned my addr 172.21.15.2:0/1397710690 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.818+0000 7f9335400640 1 --2- 172.21.15.2:0/1397710690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc8afb0 0x556aabc8d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.818+0000 7f9335e00640 1 -- 172.21.15.2:0/1397710690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc817a0 msgr2=0x556aabc7fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.818+0000 7f9335e00640 1 --2- 172.21.15.2:0/1397710690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc817a0 0x556aabc7fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.818+0000 7f9335e00640 1 -- 172.21.15.2:0/1397710690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc8afb0 msgr2=0x556aabc8d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.818+0000 7f9335e00640 1 --2- 172.21.15.2:0/1397710690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc8afb0 0x556aabc8d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.818+0000 7f9335e00640 1 -- 172.21.15.2:0/1397710690 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aab8f8210 con 0x556aabc80230 2024-06-13T02:22:07.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.818+0000 7f9335e00640 1 --2- 172.21.15.2:0/1397710690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc80230 0x556aabc806b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9328011520 tx=0x7f93280119e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0efc81a78b87be8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.819+0000 7f9326a00640 1 --2- 172.21.15.2:0/632115371 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f931c0a2ce0 0x7f931c0a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.819+0000 7f931b000640 1 -- 172.21.15.2:0/1397710690 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932801e070 con 0x556aabc80230 2024-06-13T02:22:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.819+0000 7f931b000640 1 -- 172.21.15.2:0/1397710690 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9328011310 con 0x556aabc80230 2024-06-13T02:22:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.819+0000 7f9326a00640 1 -- 172.21.15.2:0/632115371 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9495+0+0 (secure 0 0 0) 0x7f932c0cfbf0 con 0x7f933010e000 2024-06-13T02:22:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.819+0000 7f931b000640 1 -- 172.21.15.2:0/1397710690 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328019a10 con 0x556aabc80230 2024-06-13T02:22:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.819+0000 7f9335400640 1 --2- 172.21.15.2:0/632115371 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f931c0a2ce0 0x7f931c0a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.820+0000 7f933b56f740 1 -- 172.21.15.2:0/1397710690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc80230 msgr2=0x556aabc806b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.820+0000 7f933b56f740 1 --2- 172.21.15.2:0/1397710690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc80230 0x556aabc806b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9328011520 tx=0x7f93280119e0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.820+0000 7f9335400640 1 --2- 172.21.15.2:0/632115371 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f931c0a2ce0 0x7f931c0a51a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9320000c00 tx=0x7f932002a480 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.820+0000 7f933b56f740 1 -- 172.21.15.2:0/1397710690 shutdown_connections 2024-06-13T02:22:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.820+0000 7f933b56f740 1 --2- 172.21.15.2:0/1397710690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc8afb0 0x556aabc8d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.820+0000 7f933b56f740 1 --2- 172.21.15.2:0/1397710690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc80230 0x556aabc806b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.820+0000 7f933b56f740 1 --2- 172.21.15.2:0/1397710690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc817a0 0x556aabc7fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.820+0000 7f933b56f740 1 -- 172.21.15.2:0/1397710690 >> 172.21.15.2:0/1397710690 conn(0x556aabc48fb0 msgr2=0x556aabc7c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.820+0000 7f933b56f740 1 -- 172.21.15.2:0/1397710690 shutdown_connections 2024-06-13T02:22:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.820+0000 7f933b56f740 1 -- 172.21.15.2:0/1397710690 wait complete. 2024-06-13T02:22:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.821+0000 7f933b56f740 1 -- start start 2024-06-13T02:22:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.821+0000 7f933b56f740 1 Processor -- start 2024-06-13T02:22:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.821+0000 7f933b56f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc80230 0x556aabc88000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.821+0000 7f933b56f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc817a0 0x556aabc88540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.821+0000 7f933b56f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc8afb0 0x556aabc88a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.821+0000 7f933b56f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556aabc8dd80 con 0x556aabc80230 2024-06-13T02:22:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.822+0000 7f933b56f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556aabb9f0b0 con 0x556aabc817a0 2024-06-13T02:22:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.822+0000 7f933b56f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556aabc8df00 con 0x556aabc8afb0 2024-06-13T02:22:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.822+0000 7f933b56f740 10 client.0 _ll_register_callbacks cb 0x556aabb8af40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:22:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.822+0000 7f9335400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc817a0 0x556aabc88540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.822+0000 7f9336800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc8afb0 0x556aabc88a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.822+0000 7f9335400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc817a0 0x556aabc88540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36782/0 (socket says 172.21.15.2:36782) 2024-06-13T02:22:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.822+0000 7f9335400640 1 -- 172.21.15.2:0/1019766112 learned_addr learned my addr 172.21.15.2:0/1019766112 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.822+0000 7f9335e00640 1 --2- 172.21.15.2:0/1019766112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc80230 0x556aabc88000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.822+0000 7f9335400640 1 -- 172.21.15.2:0/1019766112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc8afb0 msgr2=0x556aabc88a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.822+0000 7f9335400640 1 --2- 172.21.15.2:0/1019766112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc8afb0 0x556aabc88a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.822+0000 7f9335400640 1 -- 172.21.15.2:0/1019766112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc80230 msgr2=0x556aabc88000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.822+0000 7f9335400640 1 --2- 172.21.15.2:0/1019766112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc80230 0x556aabc88000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.822+0000 7f9335400640 1 -- 172.21.15.2:0/1019766112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aab9c4620 con 0x556aabc817a0 2024-06-13T02:22:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.823+0000 7f9335400640 1 --2- 172.21.15.2:0/1019766112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc817a0 0x556aabc88540 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9320033000 tx=0x7f9320005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdc7127fba06af73 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.823+0000 7f930f400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:22:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.823+0000 7f930f400640 1 -- 172.21.15.2:0/1019766112 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9320004b40 con 0x556aabc817a0 2024-06-13T02:22:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.823+0000 7f930f400640 1 -- 172.21.15.2:0/1019766112 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9495+0+0 (secure 0 0 0) 0x7f9320004ce0 con 0x556aabc817a0 2024-06-13T02:22:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.823+0000 7f933b56f740 1 -- 172.21.15.2:0/1019766112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9328011310 con 0x556aabc817a0 2024-06-13T02:22:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.823+0000 7f930f400640 1 -- 172.21.15.2:0/1019766112 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f93200325c0 con 0x556aabc817a0 2024-06-13T02:22:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.823+0000 7f933b56f740 10 client.25592 fetch_fsmap learned FSMap version 31 2024-06-13T02:22:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.823+0000 7f933b56f740 1 -- 172.21.15.2:0/1019766112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556aabc9a120 con 0x556aabc817a0 2024-06-13T02:22:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.823+0000 7f930f400640 1 -- 172.21.15.2:0/1019766112 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9328011310 con 0x556aabc817a0 2024-06-13T02:22:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.824+0000 7f930f400640 1 -- 172.21.15.2:0/1019766112 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f9320003a60 con 0x556aabc817a0 2024-06-13T02:22:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.824+0000 7f933b56f740 10 client.25592 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T02:22:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.824+0000 7f933b56f740 10 client.25592 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:22:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.824+0000 7f933b56f740 20 client.25592 populate_metadata read hostname 'smithi002' 2024-06-13T02:22:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.824+0000 7f933b56f740 1 --2- 172.21.15.2:0/1019766112 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556aabc9b5e0 0x556aabc9d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.824+0000 7f933b56f740 4 client.25592 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:22:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.824+0000 7f933b56f740 1 -- 172.21.15.2:0/1019766112 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556aabbf1b50 con 0x556aabc9b5e0 2024-06-13T02:22:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.824+0000 7f9335e00640 1 --2- 172.21.15.2:0/1019766112 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556aabc9b5e0 0x556aabc9d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.825+0000 7f9335e00640 1 --2- 172.21.15.2:0/1019766112 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556aabc9b5e0 0x556aabc9d9d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ab786ff4323386b server_cookie=883b0abe1792ac34 in_seq=0 out_seq=0 2024-06-13T02:22:07.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.825+0000 7f930f400640 10 client.25592 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.826+0000 7f930f400640 1 -- 172.21.15.2:0/1019766112 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556aabbf1b50 con 0x556aabc9b5e0 2024-06-13T02:22:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.826+0000 7f930f400640 10 client.25592 handle_command_reply: tid=0 2024-06-13T02:22:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.826+0000 7f933b56f740 1 client.25592 shutdown 2024-06-13T02:22:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.826+0000 7f933b56f740 1 -- 172.21.15.2:0/1019766112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc817a0 msgr2=0x556aabc88540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.826+0000 7f933b56f740 1 --2- 172.21.15.2:0/1019766112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc817a0 0x556aabc88540 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9320033000 tx=0x7f9320005b50 comp rx=0 tx=0).stop 2024-06-13T02:22:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.826+0000 7f933b56f740 1 -- 172.21.15.2:0/1019766112 shutdown_connections 2024-06-13T02:22:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.826+0000 7f933b56f740 1 --2- 172.21.15.2:0/1019766112 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556aabc9b5e0 0x556aabc9d9d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.826+0000 7f933b56f740 1 --2- 172.21.15.2:0/1019766112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc8afb0 0x556aabc88a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.826+0000 7f933b56f740 1 --2- 172.21.15.2:0/1019766112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc817a0 0x556aabc88540 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.826+0000 7f933b56f740 1 --2- 172.21.15.2:0/1019766112 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc80230 0x556aabc88000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.826+0000 7f930f400640 0 client.25592 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.826+0000 7f933b56f740 1 -- 172.21.15.2:0/1019766112 >> 172.21.15.2:0/1019766112 conn(0x556aabc48fb0 msgr2=0x556aabc82690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.826+0000 7f933b56f740 1 -- 172.21.15.2:0/1019766112 shutdown_connections 2024-06-13T02:22:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.826+0000 7f933b56f740 1 -- 172.21.15.2:0/1019766112 wait complete. 2024-06-13T02:22:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.826+0000 7f933b56f740 20 client.25592 trim_cache size 0 max 16384 2024-06-13T02:22:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.844+0000 7f933b56f740 1 Processor -- start 2024-06-13T02:22:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.845+0000 7f933b56f740 1 -- start start 2024-06-13T02:22:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.845+0000 7f933b56f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc80230 0x556aabc7c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.845+0000 7f933b56f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc817a0 0x556aabc7c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.847 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.845+0000 7f933b56f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc8afb0 0x556aabca3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.845+0000 7f933b56f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93301ab150 con 0x556aabc8afb0 2024-06-13T02:22:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.845+0000 7f933b56f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f93301a8a20 con 0x556aabc80230 2024-06-13T02:22:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.845+0000 7f933b56f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9330073410 con 0x556aabc817a0 2024-06-13T02:22:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.845+0000 7f9335e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc80230 0x556aabc7c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.845+0000 7f9335e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc80230 0x556aabc7c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36794/0 (socket says 172.21.15.2:36794) 2024-06-13T02:22:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.845+0000 7f9335e00640 1 -- 172.21.15.2:0/665028011 learned_addr learned my addr 172.21.15.2:0/665028011 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.845+0000 7f9336800640 1 --2- 172.21.15.2:0/665028011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc8afb0 0x556aabca3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.845+0000 7f9335400640 1 --2- 172.21.15.2:0/665028011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc817a0 0x556aabc7c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.846+0000 7f9335e00640 1 -- 172.21.15.2:0/665028011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc817a0 msgr2=0x556aabc7c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.846+0000 7f9335e00640 1 --2- 172.21.15.2:0/665028011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc817a0 0x556aabc7c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.846+0000 7f9335e00640 1 -- 172.21.15.2:0/665028011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc8afb0 msgr2=0x556aabca3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.846+0000 7f9335e00640 1 --2- 172.21.15.2:0/665028011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc8afb0 0x556aabca3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.848 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.846+0000 7f9335e00640 1 -- 172.21.15.2:0/665028011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556aabc813e0 con 0x556aabc80230 2024-06-13T02:22:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.846+0000 7f9336800640 1 --2- 172.21.15.2:0/665028011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc8afb0 0x556aabca3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:22:07.849 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.846+0000 7f9335e00640 1 --2- 172.21.15.2:0/665028011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc80230 0x556aabc7c120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9328009f70 tx=0x7f9328019570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53bf9cb3429482e4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:07.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.846+0000 7f931a600640 1 -- 172.21.15.2:0/665028011 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328041070 con 0x556aabc80230 2024-06-13T02:22:07.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.846+0000 7f931a600640 1 -- 172.21.15.2:0/665028011 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f932800fc60 con 0x556aabc80230 2024-06-13T02:22:07.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.846+0000 7f931a600640 1 -- 172.21.15.2:0/665028011 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932801e040 con 0x556aabc80230 2024-06-13T02:22:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.847+0000 7f933b56f740 1 -- 172.21.15.2:0/665028011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc80230 msgr2=0x556aabc7c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.847+0000 7f933b56f740 1 --2- 172.21.15.2:0/665028011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc80230 0x556aabc7c120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9328009f70 tx=0x7f9328019570 comp rx=0 tx=0).stop 2024-06-13T02:22:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.847+0000 7f933b56f740 1 -- 172.21.15.2:0/665028011 shutdown_connections 2024-06-13T02:22:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.847+0000 7f933b56f740 1 --2- 172.21.15.2:0/665028011 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc8afb0 0x556aabca3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.847+0000 7f933b56f740 1 --2- 172.21.15.2:0/665028011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc817a0 0x556aabc7c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.847+0000 7f933b56f740 1 --2- 172.21.15.2:0/665028011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc80230 0x556aabc7c120 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.847+0000 7f933b56f740 1 -- 172.21.15.2:0/665028011 >> 172.21.15.2:0/665028011 conn(0x556aabc48fb0 msgr2=0x556aabc88850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.847+0000 7f933b56f740 1 -- 172.21.15.2:0/665028011 shutdown_connections 2024-06-13T02:22:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.847+0000 7f933b56f740 1 -- 172.21.15.2:0/665028011 wait complete. 2024-06-13T02:22:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.848+0000 7f933b56f740 1 -- start start 2024-06-13T02:22:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.848+0000 7f933b56f740 1 Processor -- start 2024-06-13T02:22:07.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f933b56f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc80230 0x556aabc934e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f933b56f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc817a0 0x556aabc93a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f933b56f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc8afb0 0x556aabc8e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f933b56f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93301a7020 con 0x556aabc80230 2024-06-13T02:22:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f933b56f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f93301a8350 con 0x556aabc8afb0 2024-06-13T02:22:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f933b56f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93301a75b0 con 0x556aabc817a0 2024-06-13T02:22:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f933b56f740 10 client.0 _ll_register_callbacks cb 0x7f9320005110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:22:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f9336800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc8afb0 0x556aabc8e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f9336800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc8afb0 0x556aabc8e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36796/0 (socket says 172.21.15.2:36796) 2024-06-13T02:22:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f9336800640 1 -- 172.21.15.2:0/1546036202 learned_addr learned my addr 172.21.15.2:0/1546036202 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f9335e00640 1 --2- 172.21.15.2:0/1546036202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc80230 0x556aabc934e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f9335400640 1 --2- 172.21.15.2:0/1546036202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc817a0 0x556aabc93a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f9336800640 1 -- 172.21.15.2:0/1546036202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc817a0 msgr2=0x556aabc93a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f9336800640 1 --2- 172.21.15.2:0/1546036202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc817a0 0x556aabc93a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f9336800640 1 -- 172.21.15.2:0/1546036202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc80230 msgr2=0x556aabc934e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f9336800640 1 --2- 172.21.15.2:0/1546036202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc80230 0x556aabc934e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f9336800640 1 -- 172.21.15.2:0/1546036202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556aabc8f150 con 0x556aabc8afb0 2024-06-13T02:22:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.849+0000 7f9335400640 1 --2- 172.21.15.2:0/1546036202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc817a0 0x556aabc93a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:22:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.850+0000 7f9336800640 1 --2- 172.21.15.2:0/1546036202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc8afb0 0x556aabc8e920 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f932c09b9e0 tx=0x7f932c09c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4e7ef80fa9d050b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.850+0000 7f930f400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:22:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.850+0000 7f930f400640 1 -- 172.21.15.2:0/1546036202 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c0b8070 con 0x556aabc8afb0 2024-06-13T02:22:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.850+0000 7f930f400640 1 -- 172.21.15.2:0/1546036202 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9495+0+0 (secure 0 0 0) 0x7f932c005310 con 0x556aabc8afb0 2024-06-13T02:22:07.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.850+0000 7f933b56f740 1 -- 172.21.15.2:0/1546036202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f932800fc60 con 0x556aabc8afb0 2024-06-13T02:22:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.850+0000 7f930f400640 1 -- 172.21.15.2:0/1546036202 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f932c0a44c0 con 0x556aabc8afb0 2024-06-13T02:22:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.850+0000 7f933b56f740 10 client.25598 fetch_fsmap learned FSMap version 31 2024-06-13T02:22:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.850+0000 7f933b56f740 1 -- 172.21.15.2:0/1546036202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556aabd0e6d0 con 0x556aabc8afb0 2024-06-13T02:22:07.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.850+0000 7f930f400640 1 -- 172.21.15.2:0/1546036202 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f932800fc60 con 0x556aabc8afb0 2024-06-13T02:22:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.851+0000 7f930f400640 1 -- 172.21.15.2:0/1546036202 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f932c09aba0 con 0x556aabc8afb0 2024-06-13T02:22:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.851+0000 7f933b56f740 10 client.25598 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T02:22:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.851+0000 7f933b56f740 10 client.25598 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:22:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.851+0000 7f933b56f740 20 client.25598 populate_metadata read hostname 'smithi002' 2024-06-13T02:22:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.851+0000 7f933b56f740 1 --2- 172.21.15.2:0/1546036202 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556aabd0ee40 0x556aabd11230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.851+0000 7f933b56f740 4 client.25598 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:22:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.851+0000 7f933b56f740 1 -- 172.21.15.2:0/1546036202 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556aabbebea0 con 0x556aabd0ee40 2024-06-13T02:22:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.851+0000 7f9335e00640 1 --2- 172.21.15.2:0/1546036202 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556aabd0ee40 0x556aabd11230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.852+0000 7f9335e00640 1 --2- 172.21.15.2:0/1546036202 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556aabd0ee40 0x556aabd11230 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1bc632ec7387c17 server_cookie=c8864766ad5fc43 in_seq=0 out_seq=0 2024-06-13T02:22:07.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:07.852+0000 7f930f400640 10 client.25598 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.022+0000 7f930f400640 1 -- 172.21.15.2:0/1546036202 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x556aabbebea0 con 0x556aabd0ee40 2024-06-13T02:22:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.022+0000 7f930f400640 10 client.25598 handle_command_reply: tid=0 2024-06-13T02:22:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.022+0000 7f933b56f740 1 client.25598 shutdown 2024-06-13T02:22:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.022+0000 7f933b56f740 1 -- 172.21.15.2:0/1546036202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc8afb0 msgr2=0x556aabc8e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.022+0000 7f933b56f740 1 --2- 172.21.15.2:0/1546036202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc8afb0 0x556aabc8e920 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f932c09b9e0 tx=0x7f932c09c520 comp rx=0 tx=0).stop 2024-06-13T02:22:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.023+0000 7f933b56f740 1 -- 172.21.15.2:0/1546036202 shutdown_connections 2024-06-13T02:22:08.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.023+0000 7f933b56f740 1 --2- 172.21.15.2:0/1546036202 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556aabd0ee40 0x556aabd11230 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.023+0000 7f933b56f740 1 --2- 172.21.15.2:0/1546036202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556aabc8afb0 0x556aabc8e920 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.023+0000 7f933b56f740 1 --2- 172.21.15.2:0/1546036202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556aabc817a0 0x556aabc93a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.023+0000 7f933b56f740 1 --2- 172.21.15.2:0/1546036202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556aabc80230 0x556aabc934e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.023+0000 7f933b56f740 1 -- 172.21.15.2:0/1546036202 >> 172.21.15.2:0/1546036202 conn(0x556aabc48fb0 msgr2=0x556aabc87fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.023+0000 7f930f400640 0 client.25598 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.023+0000 7f933b56f740 1 -- 172.21.15.2:0/1546036202 shutdown_connections 2024-06-13T02:22:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.023+0000 7f933b56f740 1 -- 172.21.15.2:0/1546036202 wait complete. 2024-06-13T02:22:08.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.024+0000 7f933b56f740 20 client.25598 trim_cache size 0 max 16384 2024-06-13T02:22:08.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:22:08.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:22:08.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:22:08.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.024+0000 7f9337200640 1 -- 172.21.15.2:0/632115371 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f931c0a2ce0 msgr2=0x7f931c0a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:08.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.024+0000 7f9337200640 1 --2- 172.21.15.2:0/632115371 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f931c0a2ce0 0x7f931c0a51a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9320000c00 tx=0x7f932002a480 comp rx=0 tx=0).stop 2024-06-13T02:22:08.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.025+0000 7f9337200640 1 -- 172.21.15.2:0/632115371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f933010e000 msgr2=0x7f933019eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:08.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.025+0000 7f9337200640 1 --2- 172.21.15.2:0/632115371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f933010e000 0x7f933019eba0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f932c00e970 tx=0x7f932c00ed70 comp rx=0 tx=0).stop 2024-06-13T02:22:08.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.025+0000 7f9337200640 1 -- 172.21.15.2:0/632115371 shutdown_connections 2024-06-13T02:22:08.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.025+0000 7f9337200640 1 --2- 172.21.15.2:0/632115371 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f933010e000 0x7f933019eba0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:08.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.025+0000 7f9337200640 1 --2- 172.21.15.2:0/632115371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93300746f0 0x7f933019a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:08.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.025+0000 7f9337200640 1 --2- 172.21.15.2:0/632115371 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f931c0a2ce0 0x7f931c0a51a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:08.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.025+0000 7f9337200640 1 --2- 172.21.15.2:0/632115371 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9330073dd0 0x7f933019a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:08.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.025+0000 7f9337200640 1 -- 172.21.15.2:0/632115371 >> 172.21.15.2:0/632115371 conn(0x7f93300fd2b0 msgr2=0x7f93300fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:08.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.025+0000 7f9337200640 1 -- 172.21.15.2:0/632115371 shutdown_connections 2024-06-13T02:22:08.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:08.025+0000 7f9337200640 1 -- 172.21.15.2:0/632115371 wait complete. 2024-06-13T02:22:08.497 INFO:tasks.workunit.client.0.smithi002.stdout: 1 287294 8.40 MB/sec execute 72 sec latency 81.542 ms 2024-06-13T02:22:09.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:08 smithi084 ceph-mon[36833]: pgmap v133: 129 pgs: 129 active+clean; 53 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 226 op/s 2024-06-13T02:22:09.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:08 smithi175 ceph-mon[36977]: pgmap v133: 129 pgs: 129 active+clean; 53 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 226 op/s 2024-06-13T02:22:09.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:08 smithi002 ceph-mon[31960]: pgmap v133: 129 pgs: 129 active+clean; 53 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 226 op/s 2024-06-13T02:22:09.497 INFO:tasks.workunit.client.0.smithi002.stdout: 1 288401 8.33 MB/sec execute 73 sec latency 16.781 ms 2024-06-13T02:22:10.497 INFO:tasks.workunit.client.0.smithi002.stdout: 1 290682 8.39 MB/sec execute 74 sec latency 13.899 ms 2024-06-13T02:22:11.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:10 smithi084 ceph-mon[36833]: pgmap v134: 129 pgs: 129 active+clean; 53 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 194 op/s 2024-06-13T02:22:11.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:10 smithi175 ceph-mon[36977]: pgmap v134: 129 pgs: 129 active+clean; 53 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 194 op/s 2024-06-13T02:22:11.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:10 smithi002 ceph-mon[31960]: pgmap v134: 129 pgs: 129 active+clean; 53 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 194 op/s 2024-06-13T02:22:11.497 INFO:tasks.workunit.client.0.smithi002.stdout: 1 291799 8.35 MB/sec execute 75 sec latency 35.372 ms 2024-06-13T02:22:12.497 INFO:tasks.workunit.client.0.smithi002.stdout: 1 293753 8.38 MB/sec execute 76 sec latency 61.872 ms 2024-06-13T02:22:13.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:12 smithi084 ceph-mon[36833]: pgmap v135: 129 pgs: 129 active+clean; 50 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 359 op/s 2024-06-13T02:22:13.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:12 smithi175 ceph-mon[36977]: pgmap v135: 129 pgs: 129 active+clean; 50 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 359 op/s 2024-06-13T02:22:13.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:12 smithi002 ceph-mon[31960]: pgmap v135: 129 pgs: 129 active+clean; 50 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 359 op/s 2024-06-13T02:22:13.497 INFO:tasks.workunit.client.0.smithi002.stdout: 1 295130 8.37 MB/sec execute 77 sec latency 14.552 ms 2024-06-13T02:22:14.498 INFO:tasks.workunit.client.0.smithi002.stdout: 1 296833 8.35 MB/sec execute 78 sec latency 14.405 ms 2024-06-13T02:22:15.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:14 smithi084 ceph-mon[36833]: pgmap v136: 129 pgs: 129 active+clean; 50 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 274 op/s 2024-06-13T02:22:15.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:14 smithi175 ceph-mon[36977]: pgmap v136: 129 pgs: 129 active+clean; 50 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 274 op/s 2024-06-13T02:22:15.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:14 smithi002 ceph-mon[31960]: pgmap v136: 129 pgs: 129 active+clean; 50 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 274 op/s 2024-06-13T02:22:15.498 INFO:tasks.workunit.client.0.smithi002.stdout: 1 298319 8.40 MB/sec execute 79 sec latency 64.624 ms 2024-06-13T02:22:16.498 INFO:tasks.workunit.client.0.smithi002.stdout: 1 299426 8.36 MB/sec execute 80 sec latency 16.955 ms 2024-06-13T02:22:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:16 smithi084 ceph-mon[36833]: pgmap v137: 129 pgs: 129 active+clean; 54 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 351 op/s 2024-06-13T02:22:17.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:16 smithi175 ceph-mon[36977]: pgmap v137: 129 pgs: 129 active+clean; 54 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 351 op/s 2024-06-13T02:22:17.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:16 smithi002 ceph-mon[31960]: pgmap v137: 129 pgs: 129 active+clean; 54 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 351 op/s 2024-06-13T02:22:17.498 INFO:tasks.workunit.client.0.smithi002.stdout: 1 301591 8.41 MB/sec execute 81 sec latency 37.867 ms 2024-06-13T02:22:18.498 INFO:tasks.workunit.client.0.smithi002.stdout: 1 302591 8.35 MB/sec execute 82 sec latency 14.683 ms 2024-06-13T02:22:19.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:18 smithi084 ceph-mon[36833]: pgmap v138: 129 pgs: 129 active+clean; 56 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 284 op/s 2024-06-13T02:22:19.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:18 smithi175 ceph-mon[36977]: pgmap v138: 129 pgs: 129 active+clean; 56 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 284 op/s 2024-06-13T02:22:19.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:18 smithi002 ceph-mon[31960]: pgmap v138: 129 pgs: 129 active+clean; 56 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 284 op/s 2024-06-13T02:22:19.498 INFO:tasks.workunit.client.0.smithi002.stdout: 1 304497 8.38 MB/sec execute 83 sec latency 16.842 ms 2024-06-13T02:22:20.498 INFO:tasks.workunit.client.0.smithi002.stdout: 1 305803 8.36 MB/sec execute 84 sec latency 14.826 ms 2024-06-13T02:22:21.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.178+0000 7fec94c00640 1 -- 172.21.15.2:0/2191929059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec901029e0 msgr2=0x7fec90102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:21.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.178+0000 7fec94c00640 1 --2- 172.21.15.2:0/2191929059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec901029e0 0x7fec90102dc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fec80009860 tx=0x7fec8002a3d0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.178+0000 7fec94c00640 1 -- 172.21.15.2:0/2191929059 shutdown_connections 2024-06-13T02:22:21.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.178+0000 7fec94c00640 1 --2- 172.21.15.2:0/2191929059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec9010bdb0 0x7fec9010e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.178+0000 7fec94c00640 1 --2- 172.21.15.2:0/2191929059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec90103300 0x7fec9010b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.179 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.178+0000 7fec94c00640 1 --2- 172.21.15.2:0/2191929059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec901029e0 0x7fec90102dc0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.178+0000 7fec94c00640 1 -- 172.21.15.2:0/2191929059 >> 172.21.15.2:0/2191929059 conn(0x7fec900fc180 msgr2=0x7fec900fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.178+0000 7fec94c00640 1 -- 172.21.15.2:0/2191929059 shutdown_connections 2024-06-13T02:22:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.178+0000 7fec94c00640 1 -- 172.21.15.2:0/2191929059 wait complete. 2024-06-13T02:22:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.180+0000 7fec94c00640 1 Processor -- start 2024-06-13T02:22:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.180+0000 7fec94c00640 1 -- start start 2024-06-13T02:22:21.181 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.180+0000 7fec94c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec901029e0 0x7fec90198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.181 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.180+0000 7fec94c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec90103300 0x7fec90198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.181 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.180+0000 7fec94c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec9010bdb0 0x7fec9019c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.181 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.180+0000 7fec94c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec90111be0 con 0x7fec901029e0 2024-06-13T02:22:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.180+0000 7fec94c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fec90111a60 con 0x7fec9010bdb0 2024-06-13T02:22:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.180+0000 7fec94c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec90111d60 con 0x7fec90103300 2024-06-13T02:22:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.181+0000 7fec8f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec901029e0 0x7fec90198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.181+0000 7fec87e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec90103300 0x7fec90198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.181+0000 7fec8fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec9010bdb0 0x7fec9019c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.181+0000 7fec87e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec90103300 0x7fec90198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:44486/0 (socket says 172.21.15.2:44486) 2024-06-13T02:22:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.181+0000 7fec87e00640 1 -- 172.21.15.2:0/640589605 learned_addr learned my addr 172.21.15.2:0/640589605 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.181+0000 7fec8f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec901029e0 0x7fec90198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54662/0 (socket says 172.21.15.2:54662) 2024-06-13T02:22:21.182 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.181+0000 7fec8fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec9010bdb0 0x7fec9019c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:46052/0 (socket says 172.21.15.2:46052) 2024-06-13T02:22:21.183 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.181+0000 7fec87e00640 1 -- 172.21.15.2:0/640589605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec9010bdb0 msgr2=0x7fec9019c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:21.183 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.181+0000 7fec87e00640 1 --2- 172.21.15.2:0/640589605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec9010bdb0 0x7fec9019c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.183 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.181+0000 7fec87e00640 1 -- 172.21.15.2:0/640589605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec901029e0 msgr2=0x7fec90198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:21.183 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.181+0000 7fec87e00640 1 --2- 172.21.15.2:0/640589605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec901029e0 0x7fec90198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.183 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.181+0000 7fec87e00640 1 -- 172.21.15.2:0/640589605 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9019d0a0 con 0x7fec90103300 2024-06-13T02:22:21.184 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.182+0000 7fec87e00640 1 --2- 172.21.15.2:0/640589605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec90103300 0x7fec90198640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fec7800e9f0 tx=0x7fec7800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:21.184 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.182+0000 7fec8cc00640 1 -- 172.21.15.2:0/640589605 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7800cd80 con 0x7fec90103300 2024-06-13T02:22:21.184 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.182+0000 7fec94c00640 1 -- 172.21.15.2:0/640589605 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9019d390 con 0x7fec90103300 2024-06-13T02:22:21.184 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.182+0000 7fec8cc00640 1 -- 172.21.15.2:0/640589605 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec78010910 con 0x7fec90103300 2024-06-13T02:22:21.184 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.182+0000 7fec8cc00640 1 -- 172.21.15.2:0/640589605 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec780188f0 con 0x7fec90103300 2024-06-13T02:22:21.184 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.182+0000 7fec94c00640 1 -- 172.21.15.2:0/640589605 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec901a4c20 con 0x7fec90103300 2024-06-13T02:22:21.186 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.186+0000 7fec8cc00640 1 -- 172.21.15.2:0/640589605 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fec78010ac0 con 0x7fec90103300 2024-06-13T02:22:21.186 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.186+0000 7fec991cc740 1 Processor -- start 2024-06-13T02:22:21.186 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.186+0000 7fec991cc740 1 -- start start 2024-06-13T02:22:21.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.186+0000 7fec991cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90ff7a0 0x55c6f90fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.186+0000 7fec991cc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90fe230 0x55c6f90fe6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.187+0000 7fec991cc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f910d3c0 0x55c6f910f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.187+0000 7fec991cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c6f9062420 con 0x55c6f90ff7a0 2024-06-13T02:22:21.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.187+0000 7fec991cc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c6f9009c50 con 0x55c6f90fe230 2024-06-13T02:22:21.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.187+0000 7fec991cc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c6f905e3e0 con 0x55c6f910d3c0 2024-06-13T02:22:21.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.187+0000 7fec8f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90fe230 0x55c6f90fe6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.187+0000 7fec8f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90fe230 0x55c6f90fe6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:46054/0 (socket says 172.21.15.2:46054) 2024-06-13T02:22:21.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.187+0000 7fec8f400640 1 -- 172.21.15.2:0/973026331 learned_addr learned my addr 172.21.15.2:0/973026331 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:21.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.187+0000 7fec87e00640 1 --2- 172.21.15.2:0/973026331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f910d3c0 0x55c6f910f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.187+0000 7fec8fe00640 1 --2- 172.21.15.2:0/973026331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90ff7a0 0x55c6f90fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.187+0000 7fec8f400640 1 -- 172.21.15.2:0/973026331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f910d3c0 msgr2=0x55c6f910f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:21.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.187+0000 7fec8f400640 1 --2- 172.21.15.2:0/973026331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f910d3c0 0x55c6f910f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.189 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.187+0000 7fec8f400640 1 -- 172.21.15.2:0/973026331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90ff7a0 msgr2=0x55c6f90fdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.187+0000 7fec8f400640 1 --2- 172.21.15.2:0/973026331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90ff7a0 0x55c6f90fdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.187+0000 7fec8f400640 1 -- 172.21.15.2:0/973026331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6f8d76210 con 0x55c6f90fe230 2024-06-13T02:22:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.188+0000 7fec8f400640 1 --2- 172.21.15.2:0/973026331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90fe230 0x55c6f90fe6b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fec80032ff0 tx=0x7fec80030ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cb77fa8135f33da server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.188+0000 7fec8cc00640 1 --2- 172.21.15.2:0/640589605 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fec740a2ce0 0x7fec740a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.188+0000 7fec7fe00640 1 -- 172.21.15.2:0/973026331 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec80004030 con 0x55c6f90fe230 2024-06-13T02:22:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.188+0000 7fec7fe00640 1 -- 172.21.15.2:0/973026331 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec80030880 con 0x55c6f90fe230 2024-06-13T02:22:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.188+0000 7fec7fe00640 1 -- 172.21.15.2:0/973026331 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec800046c0 con 0x55c6f90fe230 2024-06-13T02:22:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.188+0000 7fec8cc00640 1 -- 172.21.15.2:0/640589605 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9495+0+0 (secure 0 0 0) 0x7fec780cfc60 con 0x7fec90103300 2024-06-13T02:22:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.188+0000 7fec8fe00640 1 --2- 172.21.15.2:0/640589605 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fec740a2ce0 0x7fec740a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.190 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.189+0000 7fec991cc740 1 -- 172.21.15.2:0/973026331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90fe230 msgr2=0x55c6f90fe6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.189+0000 7fec991cc740 1 --2- 172.21.15.2:0/973026331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90fe230 0x55c6f90fe6b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fec80032ff0 tx=0x7fec80030ab0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.189+0000 7fec991cc740 1 -- 172.21.15.2:0/973026331 shutdown_connections 2024-06-13T02:22:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.189+0000 7fec991cc740 1 --2- 172.21.15.2:0/973026331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f910d3c0 0x55c6f910f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.189+0000 7fec991cc740 1 --2- 172.21.15.2:0/973026331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90fe230 0x55c6f90fe6b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.189+0000 7fec991cc740 1 --2- 172.21.15.2:0/973026331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90ff7a0 0x55c6f90fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.191 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.190+0000 7fec991cc740 1 -- 172.21.15.2:0/973026331 >> 172.21.15.2:0/973026331 conn(0x55c6f90c6fb0 msgr2=0x55c6f90fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.190+0000 7fec991cc740 1 -- 172.21.15.2:0/973026331 shutdown_connections 2024-06-13T02:22:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.190+0000 7fec8fe00640 1 --2- 172.21.15.2:0/640589605 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fec740a2ce0 0x7fec740a51a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec88009a60 tx=0x7fec88010040 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.190+0000 7fec991cc740 1 -- 172.21.15.2:0/973026331 wait complete. 2024-06-13T02:22:21.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.191+0000 7fec991cc740 1 -- start start 2024-06-13T02:22:21.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.191+0000 7fec991cc740 1 Processor -- start 2024-06-13T02:22:21.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.192+0000 7fec991cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90fe230 0x55c6f910a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.192+0000 7fec991cc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f90ff7a0 0x55c6f910a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.192+0000 7fec991cc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f910d3c0 0x55c6f910ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.192+0000 7fec991cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c6f9110130 con 0x55c6f90fe230 2024-06-13T02:22:21.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.192+0000 7fec991cc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c6f901d0b0 con 0x55c6f910d3c0 2024-06-13T02:22:21.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.192+0000 7fec991cc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c6f91102b0 con 0x55c6f90ff7a0 2024-06-13T02:22:21.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.192+0000 7fec991cc740 10 client.0 _ll_register_callbacks cb 0x55c6f9008f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:22:21.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.192+0000 7fec8fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f910d3c0 0x55c6f910ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.192+0000 7fec87e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f90ff7a0 0x55c6f910a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.192+0000 7fec8fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f910d3c0 0x55c6f910ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:46070/0 (socket says 172.21.15.2:46070) 2024-06-13T02:22:21.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.192+0000 7fec8fe00640 1 -- 172.21.15.2:0/1778750835 learned_addr learned my addr 172.21.15.2:0/1778750835 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:21.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.192+0000 7fec8f400640 1 --2- 172.21.15.2:0/1778750835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90fe230 0x55c6f910a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.192+0000 7fec8fe00640 1 -- 172.21.15.2:0/1778750835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f90ff7a0 msgr2=0x55c6f910a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:21.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.192+0000 7fec8fe00640 1 --2- 172.21.15.2:0/1778750835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f90ff7a0 0x55c6f910a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.192+0000 7fec8fe00640 1 -- 172.21.15.2:0/1778750835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90fe230 msgr2=0x55c6f910a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:21.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.193+0000 7fec8fe00640 1 --2- 172.21.15.2:0/1778750835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90fe230 0x55c6f910a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.193+0000 7fec8fe00640 1 -- 172.21.15.2:0/1778750835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6f8e42620 con 0x55c6f910d3c0 2024-06-13T02:22:21.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.193+0000 7fec8f400640 1 --2- 172.21.15.2:0/1778750835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90fe230 0x55c6f910a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:22:21.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.193+0000 7fec8fe00640 1 --2- 172.21.15.2:0/1778750835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f910d3c0 0x55c6f910ae90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fec8801bdd0 tx=0x7fec88004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bbede19d0d4f6a2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:21.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.193+0000 7fec7cc00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:22:21.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.193+0000 7fec7cc00640 1 -- 172.21.15.2:0/1778750835 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88019d70 con 0x55c6f910d3c0 2024-06-13T02:22:21.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.193+0000 7fec991cc740 1 -- 172.21.15.2:0/1778750835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec80030880 con 0x55c6f910d3c0 2024-06-13T02:22:21.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.193+0000 7fec7cc00640 1 -- 172.21.15.2:0/1778750835 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9495+0+0 (secure 0 0 0) 0x7fec88021030 con 0x55c6f910d3c0 2024-06-13T02:22:21.196 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.194+0000 7fec7cc00640 1 -- 172.21.15.2:0/1778750835 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fec88031050 con 0x55c6f910d3c0 2024-06-13T02:22:21.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.194+0000 7fec991cc740 10 client.25610 fetch_fsmap learned FSMap version 31 2024-06-13T02:22:21.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.194+0000 7fec991cc740 1 -- 172.21.15.2:0/1778750835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c6f911c580 con 0x55c6f910d3c0 2024-06-13T02:22:21.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.194+0000 7fec7cc00640 1 -- 172.21.15.2:0/1778750835 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec80030880 con 0x55c6f910d3c0 2024-06-13T02:22:21.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.194+0000 7fec7cc00640 1 -- 172.21.15.2:0/1778750835 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fec8800b040 con 0x55c6f910d3c0 2024-06-13T02:22:21.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.194+0000 7fec991cc740 10 client.25610 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T02:22:21.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.194+0000 7fec991cc740 10 client.25610 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:22:21.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.194+0000 7fec991cc740 20 client.25610 populate_metadata read hostname 'smithi002' 2024-06-13T02:22:21.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.194+0000 7fec991cc740 1 --2- 172.21.15.2:0/1778750835 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c6f911da40 0x55c6f911fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.194+0000 7fec991cc740 4 client.25610 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:22:21.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.194+0000 7fec991cc740 1 -- 172.21.15.2:0/1778750835 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6f906fb50 con 0x55c6f911da40 2024-06-13T02:22:21.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.195+0000 7fec8f400640 1 --2- 172.21.15.2:0/1778750835 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c6f911da40 0x55c6f911fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.195+0000 7fec8f400640 1 --2- 172.21.15.2:0/1778750835 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c6f911da40 0x55c6f911fe70 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdcf24c47db491e6 server_cookie=bda6641ef7579daf in_seq=0 out_seq=0 2024-06-13T02:22:21.198 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.195+0000 7fec7cc00640 10 client.25610 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.197+0000 7fec7cc00640 1 -- 172.21.15.2:0/1778750835 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c6f906fb50 con 0x55c6f911da40 2024-06-13T02:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.197+0000 7fec7cc00640 10 client.25610 handle_command_reply: tid=0 2024-06-13T02:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.197+0000 7fec991cc740 1 client.25610 shutdown 2024-06-13T02:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.197+0000 7fec991cc740 1 -- 172.21.15.2:0/1778750835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f910d3c0 msgr2=0x55c6f910ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.197+0000 7fec991cc740 1 --2- 172.21.15.2:0/1778750835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f910d3c0 0x55c6f910ae90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fec8801bdd0 tx=0x7fec88004ab0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.197+0000 7fec991cc740 1 -- 172.21.15.2:0/1778750835 shutdown_connections 2024-06-13T02:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.197+0000 7fec991cc740 1 --2- 172.21.15.2:0/1778750835 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c6f911da40 0x55c6f911fe70 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.197+0000 7fec991cc740 1 --2- 172.21.15.2:0/1778750835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f910d3c0 0x55c6f910ae90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.197+0000 7fec991cc740 1 --2- 172.21.15.2:0/1778750835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f90ff7a0 0x55c6f910a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.197+0000 7fec991cc740 1 --2- 172.21.15.2:0/1778750835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90fe230 0x55c6f910a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.197+0000 7fec7cc00640 0 client.25610 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.197+0000 7fec991cc740 1 -- 172.21.15.2:0/1778750835 >> 172.21.15.2:0/1778750835 conn(0x55c6f90c6fb0 msgr2=0x55c6f9100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.198+0000 7fec991cc740 1 -- 172.21.15.2:0/1778750835 shutdown_connections 2024-06-13T02:22:21.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.198+0000 7fec991cc740 1 -- 172.21.15.2:0/1778750835 wait complete. 2024-06-13T02:22:21.200 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.198+0000 7fec991cc740 20 client.25610 trim_cache size 0 max 16384 2024-06-13T02:22:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.217+0000 7fec991cc740 1 Processor -- start 2024-06-13T02:22:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.217+0000 7fec991cc740 1 -- start start 2024-06-13T02:22:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.217+0000 7fec991cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90fe230 0x55c6f9108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.217+0000 7fec991cc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90ff7a0 0x55c6f9109220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.217+0000 7fec991cc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f910d3c0 0x55c6f910e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.217+0000 7fec991cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec901af530 con 0x55c6f90fe230 2024-06-13T02:22:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.217+0000 7fec991cc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fec901ace00 con 0x55c6f90ff7a0 2024-06-13T02:22:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.217+0000 7fec991cc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec901aac50 con 0x55c6f910d3c0 2024-06-13T02:22:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.218+0000 7fec87e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90ff7a0 0x55c6f9109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.218+0000 7fec87e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90ff7a0 0x55c6f9109220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:46080/0 (socket says 172.21.15.2:46080) 2024-06-13T02:22:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.218+0000 7fec8f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90fe230 0x55c6f9108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.218+0000 7fec87e00640 1 -- 172.21.15.2:0/2735139854 learned_addr learned my addr 172.21.15.2:0/2735139854 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:21.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.218+0000 7fec8fe00640 1 --2- 172.21.15.2:0/2735139854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f910d3c0 0x55c6f910e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.218+0000 7fec87e00640 1 -- 172.21.15.2:0/2735139854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f910d3c0 msgr2=0x55c6f910e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.218+0000 7fec87e00640 1 --2- 172.21.15.2:0/2735139854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f910d3c0 0x55c6f910e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.218+0000 7fec87e00640 1 -- 172.21.15.2:0/2735139854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90fe230 msgr2=0x55c6f9108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.218+0000 7fec87e00640 1 --2- 172.21.15.2:0/2735139854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90fe230 0x55c6f9108ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.218+0000 7fec87e00640 1 -- 172.21.15.2:0/2735139854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6f90fed00 con 0x55c6f90ff7a0 2024-06-13T02:22:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.218+0000 7fec8fe00640 1 --2- 172.21.15.2:0/2735139854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f910d3c0 0x55c6f910e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:22:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.219+0000 7fec87e00640 1 --2- 172.21.15.2:0/2735139854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90ff7a0 0x55c6f9109220 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fec7809bb00 tx=0x7fec7809b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbb0753c0d02650e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.219+0000 7fec7f400640 1 -- 172.21.15.2:0/2735139854 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec78098470 con 0x55c6f90ff7a0 2024-06-13T02:22:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.219+0000 7fec7f400640 1 -- 172.21.15.2:0/2735139854 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec780cd200 con 0x55c6f90ff7a0 2024-06-13T02:22:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.219+0000 7fec7f400640 1 -- 172.21.15.2:0/2735139854 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec78097db0 con 0x55c6f90ff7a0 2024-06-13T02:22:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.219+0000 7fec991cc740 1 -- 172.21.15.2:0/2735139854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90ff7a0 msgr2=0x55c6f9109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:21.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.219+0000 7fec991cc740 1 --2- 172.21.15.2:0/2735139854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90ff7a0 0x55c6f9109220 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fec7809bb00 tx=0x7fec7809b820 comp rx=0 tx=0).stop 2024-06-13T02:22:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.220+0000 7fec991cc740 1 -- 172.21.15.2:0/2735139854 shutdown_connections 2024-06-13T02:22:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.220+0000 7fec991cc740 1 --2- 172.21.15.2:0/2735139854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f910d3c0 0x55c6f910e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.220+0000 7fec991cc740 1 --2- 172.21.15.2:0/2735139854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90ff7a0 0x55c6f9109220 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.220+0000 7fec991cc740 1 --2- 172.21.15.2:0/2735139854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f90fe230 0x55c6f9108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.220+0000 7fec991cc740 1 -- 172.21.15.2:0/2735139854 >> 172.21.15.2:0/2735139854 conn(0x55c6f90c6fb0 msgr2=0x55c6f9105720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.220+0000 7fec991cc740 1 -- 172.21.15.2:0/2735139854 shutdown_connections 2024-06-13T02:22:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.220+0000 7fec991cc740 1 -- 172.21.15.2:0/2735139854 wait complete. 2024-06-13T02:22:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.220+0000 7fec991cc740 1 -- start start 2024-06-13T02:22:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.220+0000 7fec991cc740 1 Processor -- start 2024-06-13T02:22:21.223 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:20 smithi084 ceph-mon[36833]: pgmap v139: 129 pgs: 129 active+clean; 56 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 258 op/s 2024-06-13T02:22:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec991cc740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f90fe230 0x55c6f9124810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec991cc740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90ff7a0 0x55c6f9124d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec991cc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f910d3c0 0x55c6f9114540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec991cc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fec901ab2c0 con 0x55c6f910d3c0 2024-06-13T02:22:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec991cc740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fec901ac730 con 0x55c6f90ff7a0 2024-06-13T02:22:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec991cc740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec901ab990 con 0x55c6f90fe230 2024-06-13T02:22:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec991cc740 10 client.0 _ll_register_callbacks cb 0x7fec88009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:22:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec87e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90ff7a0 0x55c6f9124d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec87e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90ff7a0 0x55c6f9124d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:46086/0 (socket says 172.21.15.2:46086) 2024-06-13T02:22:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec87e00640 1 -- 172.21.15.2:0/2306596988 learned_addr learned my addr 172.21.15.2:0/2306596988 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec8fe00640 1 --2- 172.21.15.2:0/2306596988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f910d3c0 0x55c6f9114540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec8f400640 1 --2- 172.21.15.2:0/2306596988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f90fe230 0x55c6f9124810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec87e00640 1 -- 172.21.15.2:0/2306596988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f90fe230 msgr2=0x55c6f9124810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec87e00640 1 --2- 172.21.15.2:0/2306596988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f90fe230 0x55c6f9124810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec87e00640 1 -- 172.21.15.2:0/2306596988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f910d3c0 msgr2=0x55c6f9114540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec87e00640 1 --2- 172.21.15.2:0/2306596988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f910d3c0 0x55c6f9114540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec87e00640 1 -- 172.21.15.2:0/2306596988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6f91255e0 con 0x55c6f90ff7a0 2024-06-13T02:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.221+0000 7fec8fe00640 1 --2- 172.21.15.2:0/2306596988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f910d3c0 0x55c6f9114540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.222+0000 7fec87e00640 1 --2- 172.21.15.2:0/2306596988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90ff7a0 0x55c6f9124d50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fec780a4490 tx=0x7fec780a4af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4cc0b8e8ceb0cc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.222+0000 7fec7cc00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.222+0000 7fec7cc00640 1 -- 172.21.15.2:0/2306596988 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec78010430 con 0x55c6f90ff7a0 2024-06-13T02:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.222+0000 7fec991cc740 1 -- 172.21.15.2:0/2306596988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec780cd200 con 0x55c6f90ff7a0 2024-06-13T02:22:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.222+0000 7fec7cc00640 1 -- 172.21.15.2:0/2306596988 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9495+0+0 (secure 0 0 0) 0x7fec780ba6e0 con 0x55c6f90ff7a0 2024-06-13T02:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.222+0000 7fec7cc00640 1 -- 172.21.15.2:0/2306596988 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fec780105d0 con 0x55c6f90ff7a0 2024-06-13T02:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.222+0000 7fec991cc740 10 client.25616 fetch_fsmap learned FSMap version 31 2024-06-13T02:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.222+0000 7fec991cc740 1 -- 172.21.15.2:0/2306596988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c6f9115b30 con 0x55c6f90ff7a0 2024-06-13T02:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.222+0000 7fec7cc00640 1 -- 172.21.15.2:0/2306596988 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec780cd200 con 0x55c6f90ff7a0 2024-06-13T02:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.223+0000 7fec7cc00640 1 -- 172.21.15.2:0/2306596988 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fec7809aec0 con 0x55c6f90ff7a0 2024-06-13T02:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.223+0000 7fec991cc740 10 client.25616 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T02:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.223+0000 7fec991cc740 10 client.25616 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.223+0000 7fec991cc740 20 client.25616 populate_metadata read hostname 'smithi002' 2024-06-13T02:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.223+0000 7fec991cc740 1 --2- 172.21.15.2:0/2306596988 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c6f9188710 0x55c6f918ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.223+0000 7fec991cc740 4 client.25616 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.223+0000 7fec991cc740 1 -- 172.21.15.2:0/2306596988 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c6f9069ea0 con 0x55c6f9188710 2024-06-13T02:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.223+0000 7fec8f400640 1 --2- 172.21.15.2:0/2306596988 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c6f9188710 0x55c6f918ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.223+0000 7fec8f400640 1 --2- 172.21.15.2:0/2306596988 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c6f9188710 0x55c6f918ab00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d0a4f2e0b81c983 server_cookie=df8af0573729b595 in_seq=0 out_seq=0 2024-06-13T02:22:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.223+0000 7fec7cc00640 10 client.25616 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:21.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:20 smithi175 ceph-mon[36977]: pgmap v139: 129 pgs: 129 active+clean; 56 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 258 op/s 2024-06-13T02:22:21.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:20 smithi002 ceph-mon[31960]: pgmap v139: 129 pgs: 129 active+clean; 56 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 258 op/s 2024-06-13T02:22:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.439+0000 7fec7cc00640 1 -- 172.21.15.2:0/2306596988 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55c6f9069ea0 con 0x55c6f9188710 2024-06-13T02:22:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.439+0000 7fec7cc00640 10 client.25616 handle_command_reply: tid=0 2024-06-13T02:22:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.439+0000 7fec991cc740 1 client.25616 shutdown 2024-06-13T02:22:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.439+0000 7fec991cc740 1 -- 172.21.15.2:0/2306596988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90ff7a0 msgr2=0x55c6f9124d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.439+0000 7fec991cc740 1 --2- 172.21.15.2:0/2306596988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90ff7a0 0x55c6f9124d50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fec780a4490 tx=0x7fec780a4af0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.439+0000 7fec991cc740 1 -- 172.21.15.2:0/2306596988 shutdown_connections 2024-06-13T02:22:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.439+0000 7fec991cc740 1 --2- 172.21.15.2:0/2306596988 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c6f9188710 0x55c6f918ab00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.439+0000 7fec991cc740 1 --2- 172.21.15.2:0/2306596988 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c6f910d3c0 0x55c6f9114540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.439+0000 7fec991cc740 1 --2- 172.21.15.2:0/2306596988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c6f90ff7a0 0x55c6f9124d50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.439+0000 7fec7cc00640 0 client.25616 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.439+0000 7fec991cc740 1 --2- 172.21.15.2:0/2306596988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c6f90fe230 0x55c6f9124810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.440 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.439+0000 7fec991cc740 1 -- 172.21.15.2:0/2306596988 >> 172.21.15.2:0/2306596988 conn(0x55c6f90c6fb0 msgr2=0x55c6f90ffd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:21.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.439+0000 7fec991cc740 1 -- 172.21.15.2:0/2306596988 shutdown_connections 2024-06-13T02:22:21.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.440+0000 7fec991cc740 1 -- 172.21.15.2:0/2306596988 wait complete. 2024-06-13T02:22:21.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.440+0000 7fec991cc740 20 client.25616 trim_cache size 0 max 16384 2024-06-13T02:22:21.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:22:21.441 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:22:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:22:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.441+0000 7fec94c00640 1 -- 172.21.15.2:0/640589605 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fec740a2ce0 msgr2=0x7fec740a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.441+0000 7fec94c00640 1 --2- 172.21.15.2:0/640589605 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fec740a2ce0 0x7fec740a51a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec88009a60 tx=0x7fec88010040 comp rx=0 tx=0).stop 2024-06-13T02:22:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.441+0000 7fec94c00640 1 -- 172.21.15.2:0/640589605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec90103300 msgr2=0x7fec90198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.441+0000 7fec94c00640 1 --2- 172.21.15.2:0/640589605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec90103300 0x7fec90198640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fec7800e9f0 tx=0x7fec7800eeb0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.442 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.441+0000 7fec94c00640 1 -- 172.21.15.2:0/640589605 shutdown_connections 2024-06-13T02:22:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.441+0000 7fec94c00640 1 --2- 172.21.15.2:0/640589605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec9010bdb0 0x7fec9019c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.441+0000 7fec94c00640 1 --2- 172.21.15.2:0/640589605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec90103300 0x7fec90198640 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fec7800e9f0 tx=0x7fec7800eeb0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.441+0000 7fec94c00640 1 --2- 172.21.15.2:0/640589605 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fec740a2ce0 0x7fec740a51a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.441+0000 7fec94c00640 1 --2- 172.21.15.2:0/640589605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fec901029e0 0x7fec90198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.441+0000 7fec94c00640 1 -- 172.21.15.2:0/640589605 >> 172.21.15.2:0/640589605 conn(0x7fec900fc180 msgr2=0x7fec900fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.441+0000 7fec94c00640 1 -- 172.21.15.2:0/640589605 shutdown_connections 2024-06-13T02:22:21.443 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:21.441+0000 7fec94c00640 1 -- 172.21.15.2:0/640589605 wait complete. 2024-06-13T02:22:21.498 INFO:tasks.workunit.client.0.smithi002.stdout: 1 307315 8.33 MB/sec execute 85 sec latency 139.286 ms 2024-06-13T02:22:22.498 INFO:tasks.workunit.client.0.smithi002.stdout: 1 308905 8.38 MB/sec execute 86 sec latency 73.004 ms 2024-06-13T02:22:23.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:22 smithi084 ceph-mon[36833]: pgmap v140: 129 pgs: 129 active+clean; 60 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 342 op/s 2024-06-13T02:22:23.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:22 smithi175 ceph-mon[36977]: pgmap v140: 129 pgs: 129 active+clean; 60 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 342 op/s 2024-06-13T02:22:23.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:22 smithi002 ceph-mon[31960]: pgmap v140: 129 pgs: 129 active+clean; 60 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 342 op/s 2024-06-13T02:22:23.498 INFO:tasks.workunit.client.0.smithi002.stdout: 1 309821 8.31 MB/sec execute 87 sec latency 14.950 ms 2024-06-13T02:22:24.499 INFO:tasks.workunit.client.0.smithi002.stdout: 1 311953 8.36 MB/sec execute 88 sec latency 13.697 ms 2024-06-13T02:22:25.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:24 smithi175 ceph-mon[36977]: pgmap v141: 129 pgs: 129 active+clean; 60 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 177 op/s 2024-06-13T02:22:25.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:24 smithi002 ceph-mon[31960]: pgmap v141: 129 pgs: 129 active+clean; 60 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 177 op/s 2024-06-13T02:22:25.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:24 smithi084 ceph-mon[36833]: pgmap v141: 129 pgs: 129 active+clean; 60 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 177 op/s 2024-06-13T02:22:25.499 INFO:tasks.workunit.client.0.smithi002.stdout: 1 313039 8.32 MB/sec execute 89 sec latency 16.539 ms 2024-06-13T02:22:26.499 INFO:tasks.workunit.client.0.smithi002.stdout: 1 314735 8.31 MB/sec execute 90 sec latency 14.671 ms 2024-06-13T02:22:27.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:26 smithi175 ceph-mon[36977]: pgmap v142: 129 pgs: 129 active+clean; 52 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 356 op/s 2024-06-13T02:22:27.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:26 smithi002 ceph-mon[31960]: pgmap v142: 129 pgs: 129 active+clean; 52 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 356 op/s 2024-06-13T02:22:27.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:26 smithi084 ceph-mon[36833]: pgmap v142: 129 pgs: 129 active+clean; 52 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 356 op/s 2024-06-13T02:22:27.499 INFO:tasks.workunit.client.0.smithi002.stdout: 1 316076 8.34 MB/sec execute 91 sec latency 37.496 ms 2024-06-13T02:22:28.499 INFO:tasks.workunit.client.0.smithi002.stdout: 1 317263 8.31 MB/sec execute 92 sec latency 38.481 ms 2024-06-13T02:22:29.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:28 smithi175 ceph-mon[36977]: pgmap v143: 129 pgs: 129 active+clean; 52 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 312 op/s 2024-06-13T02:22:29.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:28 smithi002 ceph-mon[31960]: pgmap v143: 129 pgs: 129 active+clean; 52 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 312 op/s 2024-06-13T02:22:29.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:28 smithi084 ceph-mon[36833]: pgmap v143: 129 pgs: 129 active+clean; 52 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 312 op/s 2024-06-13T02:22:29.499 INFO:tasks.workunit.client.0.smithi002.stdout: 1 319321 8.35 MB/sec execute 93 sec latency 12.700 ms 2024-06-13T02:22:30.499 INFO:tasks.workunit.client.0.smithi002.stdout: 1 320284 8.30 MB/sec execute 94 sec latency 32.561 ms 2024-06-13T02:22:31.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:30 smithi175 ceph-mon[36977]: pgmap v144: 129 pgs: 129 active+clean; 52 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 296 op/s 2024-06-13T02:22:31.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:30 smithi002 ceph-mon[31960]: pgmap v144: 129 pgs: 129 active+clean; 52 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 296 op/s 2024-06-13T02:22:31.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:30 smithi084 ceph-mon[36833]: pgmap v144: 129 pgs: 129 active+clean; 52 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 296 op/s 2024-06-13T02:22:31.499 INFO:tasks.workunit.client.0.smithi002.stdout: 1 322129 8.31 MB/sec execute 95 sec latency 18.739 ms 2024-06-13T02:22:32.500 INFO:tasks.workunit.client.0.smithi002.stdout: 1 323329 8.31 MB/sec execute 96 sec latency 38.618 ms 2024-06-13T02:22:33.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:33 smithi175 ceph-mon[36977]: pgmap v145: 129 pgs: 129 active+clean; 57 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 377 op/s 2024-06-13T02:22:33.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:33 smithi002 ceph-mon[31960]: pgmap v145: 129 pgs: 129 active+clean; 57 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 377 op/s 2024-06-13T02:22:33.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:33 smithi084 ceph-mon[36833]: pgmap v145: 129 pgs: 129 active+clean; 57 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 377 op/s 2024-06-13T02:22:33.500 INFO:tasks.workunit.client.0.smithi002.stdout: 1 324833 8.28 MB/sec execute 97 sec latency 27.174 ms 2024-06-13T02:22:34.500 INFO:tasks.workunit.client.0.smithi002.stdout: 1 326693 8.33 MB/sec execute 98 sec latency 11.394 ms 2024-06-13T02:22:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.608+0000 7f93dea00640 1 -- 172.21.15.2:0/2777437146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d8102180 msgr2=0x7f93d810e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.608+0000 7f93dea00640 1 --2- 172.21.15.2:0/2777437146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d8102180 0x7f93d810e690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009ca0 tx=0x7f93d002a8c0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.608+0000 7f93dea00640 1 -- 172.21.15.2:0/2777437146 shutdown_connections 2024-06-13T02:22:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.608+0000 7f93dea00640 1 --2- 172.21.15.2:0/2777437146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d8102180 0x7f93d810e690 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.608+0000 7f93dea00640 1 --2- 172.21.15.2:0/2777437146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d81017c0 0x7f93d8101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.608+0000 7f93dea00640 1 --2- 172.21.15.2:0/2777437146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d81077d0 0x7f93d8107bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.608+0000 7f93dea00640 1 -- 172.21.15.2:0/2777437146 >> 172.21.15.2:0/2777437146 conn(0x7f93d80fd2b0 msgr2=0x7f93d80ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.608+0000 7f93dea00640 1 -- 172.21.15.2:0/2777437146 shutdown_connections 2024-06-13T02:22:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.608+0000 7f93dea00640 1 -- 172.21.15.2:0/2777437146 wait complete. 2024-06-13T02:22:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.609+0000 7f93dea00640 1 Processor -- start 2024-06-13T02:22:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.609+0000 7f93dea00640 1 -- start start 2024-06-13T02:22:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.610+0000 7f93dea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d81017c0 0x7f93d8198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.610+0000 7f93dea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d8102180 0x7f93d8198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.610+0000 7f93dea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d81077d0 0x7f93d819c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.610+0000 7f93dea00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93d8111c30 con 0x7f93d8102180 2024-06-13T02:22:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.610+0000 7f93dea00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f93d8111ab0 con 0x7f93d81017c0 2024-06-13T02:22:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.610+0000 7f93dea00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93d8111db0 con 0x7f93d81077d0 2024-06-13T02:22:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.610+0000 7f93dcc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d8102180 0x7f93d8198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.610+0000 7f93dd600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d81017c0 0x7f93d8198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.610+0000 7f93dcc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d8102180 0x7f93d8198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48288/0 (socket says 172.21.15.2:48288) 2024-06-13T02:22:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.610+0000 7f93de000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d81077d0 0x7f93d819c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.610+0000 7f93dcc00640 1 -- 172.21.15.2:0/1936210741 learned_addr learned my addr 172.21.15.2:0/1936210741 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.611+0000 7f93dcc00640 1 -- 172.21.15.2:0/1936210741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d81077d0 msgr2=0x7f93d819c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.611+0000 7f93dcc00640 1 --2- 172.21.15.2:0/1936210741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d81077d0 0x7f93d819c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.611+0000 7f93dcc00640 1 -- 172.21.15.2:0/1936210741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d81017c0 msgr2=0x7f93d8198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.611+0000 7f93dcc00640 1 --2- 172.21.15.2:0/1936210741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d81017c0 0x7f93d8198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.611+0000 7f93dcc00640 1 -- 172.21.15.2:0/1936210741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d819cff0 con 0x7f93d8102180 2024-06-13T02:22:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.611+0000 7f93de000640 1 --2- 172.21.15.2:0/1936210741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d81077d0 0x7f93d819c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:22:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.611+0000 7f93dd600640 1 --2- 172.21.15.2:0/1936210741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d81017c0 0x7f93d8198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:22:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.611+0000 7f93dcc00640 1 --2- 172.21.15.2:0/1936210741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d8102180 0x7f93d8198590 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f93c400ea60 tx=0x7f93c400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.611+0000 7f93d6000640 1 -- 172.21.15.2:0/1936210741 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c400cde0 con 0x7f93d8102180 2024-06-13T02:22:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.611+0000 7f93dea00640 1 -- 172.21.15.2:0/1936210741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d819d2e0 con 0x7f93d8102180 2024-06-13T02:22:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.611+0000 7f93d6000640 1 -- 172.21.15.2:0/1936210741 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93c40035f0 con 0x7f93d8102180 2024-06-13T02:22:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.611+0000 7f93d6000640 1 -- 172.21.15.2:0/1936210741 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c4010670 con 0x7f93d8102180 2024-06-13T02:22:34.616 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.612+0000 7f93dea00640 1 -- 172.21.15.2:0/1936210741 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d81a4b70 con 0x7f93d8102180 2024-06-13T02:22:34.616 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.615+0000 7f93d6000640 1 -- 172.21.15.2:0/1936210741 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f93c40037a0 con 0x7f93d8102180 2024-06-13T02:22:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.616+0000 7f93e2fd4740 1 Processor -- start 2024-06-13T02:22:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.616+0000 7f93e2fd4740 1 -- start start 2024-06-13T02:22:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.616+0000 7f93e2fd4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f437a0 0x565259f41cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.616+0000 7f93d6000640 1 --2- 172.21.15.2:0/1936210741 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f93c00a2ce0 0x7f93c00a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.616+0000 7f93e2fd4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f42230 0x565259f426b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93e2fd4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f4cfb0 0x565259f4f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93e2fd4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x565259ea6420 con 0x565259f4cfb0 2024-06-13T02:22:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93e2fd4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x565259e4dc50 con 0x565259f437a0 2024-06-13T02:22:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93e2fd4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x565259ea23e0 con 0x565259f42230 2024-06-13T02:22:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93d6000640 1 -- 172.21.15.2:0/1936210741 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9495+0+0 (secure 0 0 0) 0x7f93c40cfb30 con 0x7f93d8102180 2024-06-13T02:22:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93de000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f437a0 0x565259f41cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93de000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f437a0 0x565259f41cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:48008/0 (socket says 172.21.15.2:48008) 2024-06-13T02:22:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93de000640 1 -- 172.21.15.2:0/3681907487 learned_addr learned my addr 172.21.15.2:0/3681907487 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93dd600640 1 --2- 172.21.15.2:0/1936210741 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f93c00a2ce0 0x7f93c00a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93de000640 1 --2- 172.21.15.2:0/3681907487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f4cfb0 0x565259f4f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93dcc00640 1 --2- 172.21.15.2:0/3681907487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f42230 0x565259f426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93de000640 1 -- 172.21.15.2:0/3681907487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f42230 msgr2=0x565259f426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93de000640 1 --2- 172.21.15.2:0/3681907487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f42230 0x565259f426b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93de000640 1 -- 172.21.15.2:0/3681907487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f4cfb0 msgr2=0x565259f4f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93de000640 1 --2- 172.21.15.2:0/3681907487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f4cfb0 0x565259f4f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93de000640 1 -- 172.21.15.2:0/3681907487 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565259bba210 con 0x565259f437a0 2024-06-13T02:22:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.617+0000 7f93dcc00640 1 --2- 172.21.15.2:0/3681907487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f42230 0x565259f426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:22:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.618+0000 7f93de000640 1 --2- 172.21.15.2:0/3681907487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f437a0 0x565259f41cf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009430 tx=0x7f93d0009360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23c33977bcd76b06 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.618+0000 7f93dd600640 1 --2- 172.21.15.2:0/1936210741 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f93c00a2ce0 0x7f93c00a51a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009f40 tx=0x7f93cc005f90 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.618+0000 7f93ca600640 1 -- 172.21.15.2:0/3681907487 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0031450 con 0x565259f437a0 2024-06-13T02:22:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.618+0000 7f93ca600640 1 -- 172.21.15.2:0/3681907487 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d0036070 con 0x565259f437a0 2024-06-13T02:22:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.618+0000 7f93ca600640 1 -- 172.21.15.2:0/3681907487 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d00305c0 con 0x565259f437a0 2024-06-13T02:22:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.619+0000 7f93e2fd4740 1 -- 172.21.15.2:0/3681907487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f437a0 msgr2=0x565259f41cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.619+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/3681907487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f437a0 0x565259f41cf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009430 tx=0x7f93d0009360 comp rx=0 tx=0).stop 2024-06-13T02:22:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.619+0000 7f93e2fd4740 1 -- 172.21.15.2:0/3681907487 shutdown_connections 2024-06-13T02:22:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.619+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/3681907487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f4cfb0 0x565259f4f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.619+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/3681907487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f42230 0x565259f426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.619+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/3681907487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f437a0 0x565259f41cf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.619+0000 7f93e2fd4740 1 -- 172.21.15.2:0/3681907487 >> 172.21.15.2:0/3681907487 conn(0x565259f0afb0 msgr2=0x565259f3e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:34.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.619+0000 7f93e2fd4740 1 -- 172.21.15.2:0/3681907487 shutdown_connections 2024-06-13T02:22:34.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.619+0000 7f93e2fd4740 1 -- 172.21.15.2:0/3681907487 wait complete. 2024-06-13T02:22:34.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.620+0000 7f93e2fd4740 1 -- start start 2024-06-13T02:22:34.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.620+0000 7f93e2fd4740 1 Processor -- start 2024-06-13T02:22:34.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.620+0000 7f93e2fd4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f42230 0x565259f4a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93e2fd4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f437a0 0x565259f4a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93e2fd4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f4cfb0 0x565259f4aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93e2fd4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x565259f4fba0 con 0x565259f437a0 2024-06-13T02:22:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93e2fd4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x565259e610b0 con 0x565259f4cfb0 2024-06-13T02:22:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93e2fd4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x565259f4fd20 con 0x565259f42230 2024-06-13T02:22:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93e2fd4740 10 client.0 _ll_register_callbacks cb 0x565259e4cf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:22:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93de000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f4cfb0 0x565259f4aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93dd600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f42230 0x565259f4a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93de000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f4cfb0 0x565259f4aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:48014/0 (socket says 172.21.15.2:48014) 2024-06-13T02:22:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93de000640 1 -- 172.21.15.2:0/3688738806 learned_addr learned my addr 172.21.15.2:0/3688738806 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93dcc00640 1 --2- 172.21.15.2:0/3688738806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f437a0 0x565259f4a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93de000640 1 -- 172.21.15.2:0/3688738806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f42230 msgr2=0x565259f4a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:34.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93de000640 1 --2- 172.21.15.2:0/3688738806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f42230 0x565259f4a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93de000640 1 -- 172.21.15.2:0/3688738806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f437a0 msgr2=0x565259f4a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93de000640 1 --2- 172.21.15.2:0/3688738806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f437a0 0x565259f4a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93de000640 1 -- 172.21.15.2:0/3688738806 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565259c86620 con 0x565259f4cfb0 2024-06-13T02:22:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.621+0000 7f93dd600640 1 --2- 172.21.15.2:0/3688738806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f42230 0x565259f4a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:22:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.622+0000 7f93de000640 1 --2- 172.21.15.2:0/3688738806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f4cfb0 0x565259f4aa80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f93d002b060 tx=0x7f93d0005d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4c9eab4d57be214 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.622+0000 7f93bea00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:22:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.622+0000 7f93bea00640 1 -- 172.21.15.2:0/3688738806 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d002f610 con 0x565259f4cfb0 2024-06-13T02:22:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.622+0000 7f93e2fd4740 1 -- 172.21.15.2:0/3688738806 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93d0036070 con 0x565259f4cfb0 2024-06-13T02:22:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.622+0000 7f93bea00640 1 -- 172.21.15.2:0/3688738806 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9495+0+0 (secure 0 0 0) 0x7f93d002f7b0 con 0x565259f4cfb0 2024-06-13T02:22:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.622+0000 7f93bea00640 1 -- 172.21.15.2:0/3688738806 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f93d005c050 con 0x565259f4cfb0 2024-06-13T02:22:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.622+0000 7f93e2fd4740 10 client.25628 fetch_fsmap learned FSMap version 31 2024-06-13T02:22:34.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.622+0000 7f93e2fd4740 1 -- 172.21.15.2:0/3688738806 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x565259f4fba0 con 0x565259f4cfb0 2024-06-13T02:22:34.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.622+0000 7f93bea00640 1 -- 172.21.15.2:0/3688738806 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d0036070 con 0x565259f4cfb0 2024-06-13T02:22:34.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.623+0000 7f93bea00640 1 -- 172.21.15.2:0/3688738806 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f93d0030bc0 con 0x565259f4cfb0 2024-06-13T02:22:34.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.623+0000 7f93e2fd4740 10 client.25628 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T02:22:34.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.623+0000 7f93e2fd4740 10 client.25628 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:22:34.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.623+0000 7f93e2fd4740 20 client.25628 populate_metadata read hostname 'smithi002' 2024-06-13T02:22:34.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.623+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/3688738806 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565259f5d0c0 0x565259f5f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.623+0000 7f93e2fd4740 4 client.25628 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:22:34.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.623+0000 7f93e2fd4740 1 -- 172.21.15.2:0/3688738806 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565259eb3b50 con 0x565259f5d0c0 2024-06-13T02:22:34.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.623+0000 7f93dd600640 1 --2- 172.21.15.2:0/3688738806 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565259f5d0c0 0x565259f5f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.624+0000 7f93dd600640 1 --2- 172.21.15.2:0/3688738806 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565259f5d0c0 0x565259f5f4b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=387b6655f90a5418 server_cookie=95e0d5306017d6cd in_seq=0 out_seq=0 2024-06-13T02:22:34.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.624+0000 7f93bea00640 10 client.25628 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:34.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.624+0000 7f93bea00640 1 -- 172.21.15.2:0/3688738806 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x565259eb3b50 con 0x565259f5d0c0 2024-06-13T02:22:34.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.624+0000 7f93bea00640 10 client.25628 handle_command_reply: tid=0 2024-06-13T02:22:34.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.625+0000 7f93e2fd4740 1 client.25628 shutdown 2024-06-13T02:22:34.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.625+0000 7f93e2fd4740 1 -- 172.21.15.2:0/3688738806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f4cfb0 msgr2=0x565259f4aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:34.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.625+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/3688738806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f4cfb0 0x565259f4aa80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f93d002b060 tx=0x7f93d0005d80 comp rx=0 tx=0).stop 2024-06-13T02:22:34.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.625+0000 7f93e2fd4740 1 -- 172.21.15.2:0/3688738806 shutdown_connections 2024-06-13T02:22:34.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.625+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/3688738806 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565259f5d0c0 0x565259f5f4b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.625+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/3688738806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f4cfb0 0x565259f4aa80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.625+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/3688738806 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f437a0 0x565259f4a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.625+0000 7f93bea00640 0 client.25628 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:34.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.625+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/3688738806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f42230 0x565259f4a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.625+0000 7f93e2fd4740 1 -- 172.21.15.2:0/3688738806 >> 172.21.15.2:0/3688738806 conn(0x565259f0afb0 msgr2=0x565259f44650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:34.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.625+0000 7f93e2fd4740 1 -- 172.21.15.2:0/3688738806 shutdown_connections 2024-06-13T02:22:34.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.625+0000 7f93e2fd4740 1 -- 172.21.15.2:0/3688738806 wait complete. 2024-06-13T02:22:34.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.625+0000 7f93e2fd4740 20 client.25628 trim_cache size 0 max 16384 2024-06-13T02:22:34.649 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.646+0000 7f93e2fd4740 1 Processor -- start 2024-06-13T02:22:34.649 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.647+0000 7f93e2fd4740 1 -- start start 2024-06-13T02:22:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.647+0000 7f93e2fd4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f42230 0x565259f4a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.647+0000 7f93e2fd4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f437a0 0x565259f64d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.647+0000 7f93e2fd4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f4cfb0 0x565259f65270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.647+0000 7f93e2fd4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93d81b1670 con 0x565259f4cfb0 2024-06-13T02:22:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.647+0000 7f93e2fd4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f93d81aef40 con 0x565259f42230 2024-06-13T02:22:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.647+0000 7f93e2fd4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93d81acd90 con 0x565259f437a0 2024-06-13T02:22:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.647+0000 7f93dcc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f437a0 0x565259f64d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.647+0000 7f93dd600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f42230 0x565259f4a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.647+0000 7f93dcc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f437a0 0x565259f64d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:41366/0 (socket says 172.21.15.2:41366) 2024-06-13T02:22:34.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.647+0000 7f93dcc00640 1 -- 172.21.15.2:0/2053229720 learned_addr learned my addr 172.21.15.2:0/2053229720 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:34.651 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.647+0000 7f93de000640 1 --2- 172.21.15.2:0/2053229720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f4cfb0 0x565259f65270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.651 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.648+0000 7f93dcc00640 1 -- 172.21.15.2:0/2053229720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f42230 msgr2=0x565259f4a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:34.651 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.648+0000 7f93dcc00640 1 --2- 172.21.15.2:0/2053229720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f42230 0x565259f4a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.651 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.648+0000 7f93dcc00640 1 -- 172.21.15.2:0/2053229720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f4cfb0 msgr2=0x565259f65270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:34.651 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.648+0000 7f93dcc00640 1 --2- 172.21.15.2:0/2053229720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f4cfb0 0x565259f65270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.651 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.648+0000 7f93dcc00640 1 -- 172.21.15.2:0/2053229720 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565259f48550 con 0x565259f437a0 2024-06-13T02:22:34.651 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.648+0000 7f93dd600640 1 --2- 172.21.15.2:0/2053229720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f42230 0x565259f4a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:22:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.648+0000 7f93dcc00640 1 --2- 172.21.15.2:0/2053229720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f437a0 0x565259f64d30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f93c4098080 tx=0x7f93c4009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5df493845030d8c6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.648+0000 7f93c9c00640 1 -- 172.21.15.2:0/2053229720 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c409ffd0 con 0x565259f437a0 2024-06-13T02:22:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.649+0000 7f93c9c00640 1 -- 172.21.15.2:0/2053229720 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93c40a4890 con 0x565259f437a0 2024-06-13T02:22:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.649+0000 7f93c9c00640 1 -- 172.21.15.2:0/2053229720 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c40bff10 con 0x565259f437a0 2024-06-13T02:22:34.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.649+0000 7f93e2fd4740 1 -- 172.21.15.2:0/2053229720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f437a0 msgr2=0x565259f64d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.649+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/2053229720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f437a0 0x565259f64d30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f93c4098080 tx=0x7f93c4009510 comp rx=0 tx=0).stop 2024-06-13T02:22:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.649+0000 7f93e2fd4740 1 -- 172.21.15.2:0/2053229720 shutdown_connections 2024-06-13T02:22:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.649+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/2053229720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f4cfb0 0x565259f65270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.649+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/2053229720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f437a0 0x565259f64d30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.649+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/2053229720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f42230 0x565259f4a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.649+0000 7f93e2fd4740 1 -- 172.21.15.2:0/2053229720 >> 172.21.15.2:0/2053229720 conn(0x565259f0afb0 msgr2=0x565259f49030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.650+0000 7f93e2fd4740 1 -- 172.21.15.2:0/2053229720 shutdown_connections 2024-06-13T02:22:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.650+0000 7f93e2fd4740 1 -- 172.21.15.2:0/2053229720 wait complete. 2024-06-13T02:22:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.650+0000 7f93e2fd4740 1 -- start start 2024-06-13T02:22:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.650+0000 7f93e2fd4740 1 Processor -- start 2024-06-13T02:22:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.651+0000 7f93e2fd4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f42230 0x565259f55280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.656 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.651+0000 7f93e2fd4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f437a0 0x565259f557c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.651+0000 7f93e2fd4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f4cfb0 0x565259f506f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.651+0000 7f93e2fd4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93d81ad400 con 0x565259f42230 2024-06-13T02:22:34.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.651+0000 7f93e2fd4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f93d81ae870 con 0x565259f4cfb0 2024-06-13T02:22:34.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.651+0000 7f93e2fd4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93d81adad0 con 0x565259f437a0 2024-06-13T02:22:34.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.651+0000 7f93e2fd4740 10 client.0 _ll_register_callbacks cb 0x7f93d0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:22:34.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.651+0000 7f93dd600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f42230 0x565259f55280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.651+0000 7f93dd600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f42230 0x565259f55280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48338/0 (socket says 172.21.15.2:48338) 2024-06-13T02:22:34.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.651+0000 7f93dd600640 1 -- 172.21.15.2:0/1689936552 learned_addr learned my addr 172.21.15.2:0/1689936552 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:34.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.651+0000 7f93de000640 1 --2- 172.21.15.2:0/1689936552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f4cfb0 0x565259f506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.651+0000 7f93dcc00640 1 --2- 172.21.15.2:0/1689936552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f437a0 0x565259f557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.652+0000 7f93de000640 1 -- 172.21.15.2:0/1689936552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f437a0 msgr2=0x565259f557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:34.657 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.652+0000 7f93de000640 1 --2- 172.21.15.2:0/1689936552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f437a0 0x565259f557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.652+0000 7f93de000640 1 -- 172.21.15.2:0/1689936552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f42230 msgr2=0x565259f55280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.652+0000 7f93de000640 1 --2- 172.21.15.2:0/1689936552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f42230 0x565259f55280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.652+0000 7f93de000640 1 -- 172.21.15.2:0/1689936552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565259f50f20 con 0x565259f4cfb0 2024-06-13T02:22:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.652+0000 7f93de000640 1 --2- 172.21.15.2:0/1689936552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f4cfb0 0x565259f506f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009430 tx=0x7f93d002af40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12d8aaabd1f7aeb4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.652+0000 7f93bea00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:22:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.652+0000 7f93bea00640 1 -- 172.21.15.2:0/1689936552 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d00098a0 con 0x565259f4cfb0 2024-06-13T02:22:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.652+0000 7f93bea00640 1 -- 172.21.15.2:0/1689936552 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9495+0+0 (secure 0 0 0) 0x7f93d003cbb0 con 0x565259f4cfb0 2024-06-13T02:22:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.652+0000 7f93e2fd4740 1 -- 172.21.15.2:0/1689936552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93c40a4890 con 0x565259f4cfb0 2024-06-13T02:22:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.653+0000 7f93bea00640 1 -- 172.21.15.2:0/1689936552 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f93d006d050 con 0x565259f4cfb0 2024-06-13T02:22:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.653+0000 7f93e2fd4740 10 client.25634 fetch_fsmap learned FSMap version 31 2024-06-13T02:22:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.653+0000 7f93e2fd4740 1 -- 172.21.15.2:0/1689936552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x565259fc7890 con 0x565259f4cfb0 2024-06-13T02:22:34.658 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.653+0000 7f93bea00640 1 -- 172.21.15.2:0/1689936552 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93c40a4890 con 0x565259f4cfb0 2024-06-13T02:22:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.653+0000 7f93bea00640 1 -- 172.21.15.2:0/1689936552 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f93d0068030 con 0x565259f4cfb0 2024-06-13T02:22:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.653+0000 7f93e2fd4740 10 client.25634 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T02:22:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.653+0000 7f93e2fd4740 10 client.25634 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:22:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.653+0000 7f93e2fd4740 20 client.25634 populate_metadata read hostname 'smithi002' 2024-06-13T02:22:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.653+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/1689936552 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565259fc7fa0 0x565259fca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.653+0000 7f93e2fd4740 4 client.25634 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:22:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.653+0000 7f93e2fd4740 1 -- 172.21.15.2:0/1689936552 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x565259eadea0 con 0x565259fc7fa0 2024-06-13T02:22:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.653+0000 7f93dd600640 1 --2- 172.21.15.2:0/1689936552 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565259fc7fa0 0x565259fca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:34.659 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.654+0000 7f93dd600640 1 --2- 172.21.15.2:0/1689936552 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565259fc7fa0 0x565259fca3c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=962ba15bbc311e2d server_cookie=743f5acd85c92763 in_seq=0 out_seq=0 2024-06-13T02:22:34.660 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.654+0000 7f93bea00640 10 client.25634 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.850+0000 7f93bea00640 1 -- 172.21.15.2:0/1689936552 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x565259eadea0 con 0x565259fc7fa0 2024-06-13T02:22:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.850+0000 7f93bea00640 10 client.25634 handle_command_reply: tid=0 2024-06-13T02:22:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.850+0000 7f93e2fd4740 1 client.25634 shutdown 2024-06-13T02:22:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.850+0000 7f93e2fd4740 1 -- 172.21.15.2:0/1689936552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f4cfb0 msgr2=0x565259f506f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.850+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/1689936552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f4cfb0 0x565259f506f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009430 tx=0x7f93d002af40 comp rx=0 tx=0).stop 2024-06-13T02:22:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.851+0000 7f93e2fd4740 1 -- 172.21.15.2:0/1689936552 shutdown_connections 2024-06-13T02:22:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.851+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/1689936552 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x565259fc7fa0 0x565259fca3c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.851+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/1689936552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x565259f4cfb0 0x565259f506f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.851+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/1689936552 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x565259f437a0 0x565259f557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.851+0000 7f93e2fd4740 1 --2- 172.21.15.2:0/1689936552 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x565259f42230 0x565259f55280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.851+0000 7f93e2fd4740 1 -- 172.21.15.2:0/1689936552 >> 172.21.15.2:0/1689936552 conn(0x565259f0afb0 msgr2=0x565259f43d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.851+0000 7f93bea00640 0 client.25634 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.851+0000 7f93e2fd4740 1 -- 172.21.15.2:0/1689936552 shutdown_connections 2024-06-13T02:22:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.851+0000 7f93e2fd4740 1 -- 172.21.15.2:0/1689936552 wait complete. 2024-06-13T02:22:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.851+0000 7f93e2fd4740 20 client.25634 trim_cache size 0 max 16384 2024-06-13T02:22:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:22:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:22:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:22:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.852+0000 7f93dea00640 1 -- 172.21.15.2:0/1936210741 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f93c00a2ce0 msgr2=0x7f93c00a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.852+0000 7f93dea00640 1 --2- 172.21.15.2:0/1936210741 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f93c00a2ce0 0x7f93c00a51a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009f40 tx=0x7f93cc005f90 comp rx=0 tx=0).stop 2024-06-13T02:22:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.853+0000 7f93dea00640 1 -- 172.21.15.2:0/1936210741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d8102180 msgr2=0x7f93d8198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.853+0000 7f93dea00640 1 --2- 172.21.15.2:0/1936210741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d8102180 0x7f93d8198590 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f93c400ea60 tx=0x7f93c400ef20 comp rx=0 tx=0).stop 2024-06-13T02:22:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.853+0000 7f93dea00640 1 -- 172.21.15.2:0/1936210741 shutdown_connections 2024-06-13T02:22:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.853+0000 7f93dea00640 1 --2- 172.21.15.2:0/1936210741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93d81077d0 0x7f93d819c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.853+0000 7f93dea00640 1 --2- 172.21.15.2:0/1936210741 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f93c00a2ce0 0x7f93c00a51a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.853+0000 7f93dea00640 1 --2- 172.21.15.2:0/1936210741 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93d8102180 0x7f93d8198590 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.853+0000 7f93dea00640 1 --2- 172.21.15.2:0/1936210741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93d81017c0 0x7f93d8198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.853+0000 7f93dea00640 1 -- 172.21.15.2:0/1936210741 >> 172.21.15.2:0/1936210741 conn(0x7f93d80fd2b0 msgr2=0x7f93d80fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.853+0000 7f93dea00640 1 -- 172.21.15.2:0/1936210741 shutdown_connections 2024-06-13T02:22:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:34.854+0000 7f93dea00640 1 -- 172.21.15.2:0/1936210741 wait complete. 2024-06-13T02:22:35.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:35 smithi175 ceph-mon[36977]: pgmap v146: 129 pgs: 129 active+clean; 57 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 294 op/s 2024-06-13T02:22:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:35 smithi002 ceph-mon[31960]: pgmap v146: 129 pgs: 129 active+clean; 57 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 294 op/s 2024-06-13T02:22:35.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:35 smithi084 ceph-mon[36833]: pgmap v146: 129 pgs: 129 active+clean; 57 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 294 op/s 2024-06-13T02:22:35.500 INFO:tasks.workunit.client.0.smithi002.stdout: 1 327576 8.27 MB/sec execute 99 sec latency 97.646 ms 2024-06-13T02:22:36.500 INFO:tasks.workunit.client.0.smithi002.stdout: 1 329872 8.34 MB/sec execute 100 sec latency 10.716 ms 2024-06-13T02:22:37.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:37 smithi175 ceph-mon[36977]: pgmap v147: 129 pgs: 129 active+clean; 51 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 428 op/s 2024-06-13T02:22:37.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:37 smithi002 ceph-mon[31960]: pgmap v147: 129 pgs: 129 active+clean; 51 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 428 op/s 2024-06-13T02:22:37.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:37 smithi084 ceph-mon[36833]: pgmap v147: 129 pgs: 129 active+clean; 51 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 428 op/s 2024-06-13T02:22:37.500 INFO:tasks.workunit.client.0.smithi002.stdout: 1 330691 8.28 MB/sec execute 101 sec latency 74.769 ms 2024-06-13T02:22:38.501 INFO:tasks.workunit.client.0.smithi002.stdout: 1 332487 8.27 MB/sec execute 102 sec latency 26.402 ms 2024-06-13T02:22:39.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:39 smithi175 ceph-mon[36977]: pgmap v148: 129 pgs: 129 active+clean; 49 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 279 op/s 2024-06-13T02:22:39.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:39 smithi002 ceph-mon[31960]: pgmap v148: 129 pgs: 129 active+clean; 49 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 279 op/s 2024-06-13T02:22:39.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:39 smithi084 ceph-mon[36833]: pgmap v148: 129 pgs: 129 active+clean; 49 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 279 op/s 2024-06-13T02:22:39.501 INFO:tasks.workunit.client.0.smithi002.stdout: 1 334166 8.30 MB/sec execute 103 sec latency 11.784 ms 2024-06-13T02:22:40.501 INFO:tasks.workunit.client.0.smithi002.stdout: 1 336009 8.30 MB/sec execute 104 sec latency 13.905 ms 2024-06-13T02:22:41.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:41 smithi002 ceph-mon[31960]: pgmap v149: 129 pgs: 129 active+clean; 49 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 245 op/s 2024-06-13T02:22:41.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:41 smithi084 ceph-mon[36833]: pgmap v149: 129 pgs: 129 active+clean; 49 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 245 op/s 2024-06-13T02:22:41.501 INFO:tasks.workunit.client.0.smithi002.stdout: 1 337698 8.33 MB/sec execute 105 sec latency 12.035 ms 2024-06-13T02:22:41.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:41 smithi175 ceph-mon[36977]: pgmap v149: 129 pgs: 129 active+clean; 49 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 245 op/s 2024-06-13T02:22:42.501 INFO:tasks.workunit.client.0.smithi002.stdout: 1 339392 8.31 MB/sec execute 106 sec latency 47.203 ms 2024-06-13T02:22:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:43 smithi002 ceph-mon[31960]: pgmap v150: 129 pgs: 129 active+clean; 53 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 337 op/s 2024-06-13T02:22:43.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:43 smithi084 ceph-mon[36833]: pgmap v150: 129 pgs: 129 active+clean; 53 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 337 op/s 2024-06-13T02:22:43.501 INFO:tasks.workunit.client.0.smithi002.stdout: 1 340967 8.35 MB/sec execute 107 sec latency 36.658 ms 2024-06-13T02:22:43.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:43 smithi175 ceph-mon[36977]: pgmap v150: 129 pgs: 129 active+clean; 53 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 337 op/s 2024-06-13T02:22:44.501 INFO:tasks.workunit.client.0.smithi002.stdout: 1 342127 8.32 MB/sec execute 108 sec latency 40.685 ms 2024-06-13T02:22:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:45 smithi002 ceph-mon[31960]: pgmap v151: 129 pgs: 129 active+clean; 53 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 1.8 MiB/s wr, 255 op/s 2024-06-13T02:22:45.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:45 smithi084 ceph-mon[36833]: pgmap v151: 129 pgs: 129 active+clean; 53 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 1.8 MiB/s wr, 255 op/s 2024-06-13T02:22:45.501 INFO:tasks.workunit.client.0.smithi002.stdout: 1 344185 8.36 MB/sec execute 109 sec latency 22.017 ms 2024-06-13T02:22:45.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:45 smithi175 ceph-mon[36977]: pgmap v151: 129 pgs: 129 active+clean; 53 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 1.8 MiB/s wr, 255 op/s 2024-06-13T02:22:46.501 INFO:tasks.workunit.client.0.smithi002.stdout: 1 345160 8.31 MB/sec execute 110 sec latency 18.869 ms 2024-06-13T02:22:47.334 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:47 smithi175 ceph-mon[36977]: pgmap v152: 129 pgs: 129 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 337 op/s 2024-06-13T02:22:47.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:47 smithi002 ceph-mon[31960]: pgmap v152: 129 pgs: 129 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 337 op/s 2024-06-13T02:22:47.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:47 smithi084 ceph-mon[36833]: pgmap v152: 129 pgs: 129 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 337 op/s 2024-06-13T02:22:47.501 INFO:tasks.workunit.client.0.smithi002.stdout: 1 346833 8.32 MB/sec execute 111 sec latency 42.541 ms 2024-06-13T02:22:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.010+0000 7f76b5600640 1 -- 172.21.15.2:0/3835003636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76b0104370 msgr2=0x7f76b0110880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.010+0000 7f76b5600640 1 --2- 172.21.15.2:0/3835003636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76b0104370 0x7f76b0110880 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009cd0 tx=0x7f76a802a8f0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.010+0000 7f76b5600640 1 -- 172.21.15.2:0/3835003636 shutdown_connections 2024-06-13T02:22:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.010+0000 7f76b5600640 1 --2- 172.21.15.2:0/3835003636 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76b0104370 0x7f76b0110880 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.010+0000 7f76b5600640 1 --2- 172.21.15.2:0/3835003636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76b01039b0 0x7f76b0103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.010+0000 7f76b5600640 1 --2- 172.21.15.2:0/3835003636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b01099c0 0x7f76b0109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.010+0000 7f76b5600640 1 -- 172.21.15.2:0/3835003636 >> 172.21.15.2:0/3835003636 conn(0x7f76b00ff480 msgr2=0x7f76b01018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.010+0000 7f76b5600640 1 -- 172.21.15.2:0/3835003636 shutdown_connections 2024-06-13T02:22:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.010+0000 7f76b5600640 1 -- 172.21.15.2:0/3835003636 wait complete. 2024-06-13T02:22:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.011+0000 7f76b5600640 1 Processor -- start 2024-06-13T02:22:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.012+0000 7f76b5600640 1 -- start start 2024-06-13T02:22:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.012+0000 7f76b5600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76b01039b0 0x7f76b019a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.012+0000 7f76b5600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76b0104370 0x7f76b019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.012+0000 7f76b5600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b01099c0 0x7f76b019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.012+0000 7f76b5600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f76b0113dd0 con 0x7f76b0104370 2024-06-13T02:22:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.012+0000 7f76b5600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f76b0113c50 con 0x7f76b01099c0 2024-06-13T02:22:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.012+0000 7f76b5600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76b0113f50 con 0x7f76b01039b0 2024-06-13T02:22:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.012+0000 7f76af400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76b0104370 0x7f76b019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.012+0000 7f76b4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b01099c0 0x7f76b019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.012+0000 7f76af400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76b0104370 0x7f76b019a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:43478/0 (socket says 172.21.15.2:43478) 2024-06-13T02:22:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.012+0000 7f76b4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b01099c0 0x7f76b019eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:50800/0 (socket says 172.21.15.2:50800) 2024-06-13T02:22:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.012+0000 7f76af400640 1 -- 172.21.15.2:0/4196314797 learned_addr learned my addr 172.21.15.2:0/4196314797 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.012+0000 7f76afe00640 1 --2- 172.21.15.2:0/4196314797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76b01039b0 0x7f76b019a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.013+0000 7f76afe00640 1 -- 172.21.15.2:0/4196314797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b01099c0 msgr2=0x7f76b019eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.013+0000 7f76afe00640 1 --2- 172.21.15.2:0/4196314797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b01099c0 0x7f76b019eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.013+0000 7f76afe00640 1 -- 172.21.15.2:0/4196314797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76b0104370 msgr2=0x7f76b019a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.013+0000 7f76afe00640 1 --2- 172.21.15.2:0/4196314797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76b0104370 0x7f76b019a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.013+0000 7f76afe00640 1 -- 172.21.15.2:0/4196314797 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b019f230 con 0x7f76b01039b0 2024-06-13T02:22:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.013+0000 7f76afe00640 1 --2- 172.21.15.2:0/4196314797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76b01039b0 0x7f76b019a290 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f76a000e9f0 tx=0x7f76a000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.013+0000 7f76acc00640 1 -- 172.21.15.2:0/4196314797 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a000ccc0 con 0x7f76b01039b0 2024-06-13T02:22:48.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.013+0000 7f76acc00640 1 -- 172.21.15.2:0/4196314797 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76a0010910 con 0x7f76b01039b0 2024-06-13T02:22:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.014+0000 7f76b5600640 1 -- 172.21.15.2:0/4196314797 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b019f520 con 0x7f76b01039b0 2024-06-13T02:22:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.014+0000 7f76acc00640 1 -- 172.21.15.2:0/4196314797 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a0018960 con 0x7f76b01039b0 2024-06-13T02:22:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.014+0000 7f76b5600640 1 -- 172.21.15.2:0/4196314797 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b01a6db0 con 0x7f76b01039b0 2024-06-13T02:22:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.017+0000 7f76b99a6740 1 Processor -- start 2024-06-13T02:22:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.017+0000 7f76b99a6740 1 -- start start 2024-06-13T02:22:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.017+0000 7f76acc00640 1 -- 172.21.15.2:0/4196314797 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f76a0010ac0 con 0x7f76b01039b0 2024-06-13T02:22:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.018+0000 7f76b99a6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe307a0 0x55bacbe2ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.018+0000 7f76b99a6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe2f230 0x55bacbe2f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.018+0000 7f76b99a6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe39fb0 0x55bacbe3c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.018+0000 7f76b99a6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bacbd93420 con 0x55bacbe2f230 2024-06-13T02:22:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.018+0000 7f76b99a6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bacbd3ac50 con 0x55bacbe307a0 2024-06-13T02:22:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.018+0000 7f76b99a6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bacbd8f3e0 con 0x55bacbe39fb0 2024-06-13T02:22:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.018+0000 7f76b4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe307a0 0x55bacbe2ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.018+0000 7f76b4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe307a0 0x55bacbe2ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:50814/0 (socket says 172.21.15.2:50814) 2024-06-13T02:22:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.018+0000 7f76afe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe2f230 0x55bacbe2f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.018+0000 7f76b4c00640 1 -- 172.21.15.2:0/2734375897 learned_addr learned my addr 172.21.15.2:0/2734375897 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.018+0000 7f76af400640 1 --2- 172.21.15.2:0/2734375897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe39fb0 0x55bacbe3c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.018+0000 7f76b4c00640 1 -- 172.21.15.2:0/2734375897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe39fb0 msgr2=0x55bacbe3c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.018+0000 7f76b4c00640 1 --2- 172.21.15.2:0/2734375897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe39fb0 0x55bacbe3c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.018+0000 7f76b4c00640 1 -- 172.21.15.2:0/2734375897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe2f230 msgr2=0x55bacbe2f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.018+0000 7f76b4c00640 1 --2- 172.21.15.2:0/2734375897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe2f230 0x55bacbe2f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.019+0000 7f76b4c00640 1 -- 172.21.15.2:0/2734375897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bacbaa7210 con 0x55bacbe307a0 2024-06-13T02:22:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.019+0000 7f76afe00640 1 --2- 172.21.15.2:0/2734375897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe2f230 0x55bacbe2f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:22:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.019+0000 7f76b4c00640 1 --2- 172.21.15.2:0/2734375897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe307a0 0x55bacbe2ecf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f76a8004ad0 tx=0x7f76a8009360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b6fd33f876de2d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.019+0000 7f76a5200640 1 -- 172.21.15.2:0/2734375897 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8030660 con 0x55bacbe307a0 2024-06-13T02:22:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.019+0000 7f76a5200640 1 -- 172.21.15.2:0/2734375897 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76a8036070 con 0x55bacbe307a0 2024-06-13T02:22:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.019+0000 7f76a5200640 1 -- 172.21.15.2:0/2734375897 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a80043e0 con 0x55bacbe307a0 2024-06-13T02:22:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.019+0000 7f76acc00640 1 --2- 172.21.15.2:0/4196314797 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f76940a2ce0 0x7f76940a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.019+0000 7f76acc00640 1 -- 172.21.15.2:0/4196314797 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9495+0+0 (secure 0 0 0) 0x7f76a00cfb90 con 0x7f76b01039b0 2024-06-13T02:22:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.020+0000 7f76afe00640 1 --2- 172.21.15.2:0/4196314797 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f76940a2ce0 0x7f76940a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.020+0000 7f76b99a6740 1 -- 172.21.15.2:0/2734375897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe307a0 msgr2=0x55bacbe2ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.020+0000 7f76b99a6740 1 --2- 172.21.15.2:0/2734375897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe307a0 0x55bacbe2ecf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f76a8004ad0 tx=0x7f76a8009360 comp rx=0 tx=0).stop 2024-06-13T02:22:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.020+0000 7f76b99a6740 1 -- 172.21.15.2:0/2734375897 shutdown_connections 2024-06-13T02:22:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.020+0000 7f76b99a6740 1 --2- 172.21.15.2:0/2734375897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe39fb0 0x55bacbe3c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.020+0000 7f76b99a6740 1 --2- 172.21.15.2:0/2734375897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe2f230 0x55bacbe2f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.020+0000 7f76b99a6740 1 --2- 172.21.15.2:0/2734375897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe307a0 0x55bacbe2ecf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.020+0000 7f76b99a6740 1 -- 172.21.15.2:0/2734375897 >> 172.21.15.2:0/2734375897 conn(0x55bacbdf7fb0 msgr2=0x55bacbe2b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.020+0000 7f76b99a6740 1 -- 172.21.15.2:0/2734375897 shutdown_connections 2024-06-13T02:22:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.020+0000 7f76b99a6740 1 -- 172.21.15.2:0/2734375897 wait complete. 2024-06-13T02:22:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.020+0000 7f76afe00640 1 --2- 172.21.15.2:0/4196314797 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f76940a2ce0 0x7f76940a51a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55bacbe31f00 tx=0x7f76a0009700 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.021+0000 7f76b99a6740 1 -- start start 2024-06-13T02:22:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.021+0000 7f76b99a6740 1 Processor -- start 2024-06-13T02:22:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.021+0000 7f76b99a6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe2f230 0x55bacbe37020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.021+0000 7f76b99a6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe307a0 0x55bacbe37560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.022+0000 7f76b99a6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe39fb0 0x55bacbe37aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.022+0000 7f76b99a6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bacbe3cd20 con 0x55bacbe2f230 2024-06-13T02:22:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.022+0000 7f76b99a6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bacbd4e0b0 con 0x55bacbe39fb0 2024-06-13T02:22:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.022+0000 7f76b99a6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bacbe3cea0 con 0x55bacbe307a0 2024-06-13T02:22:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.022+0000 7f76b99a6740 10 client.0 _ll_register_callbacks cb 0x55bacbd39f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:22:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.022+0000 7f76af400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe307a0 0x55bacbe37560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.022+0000 7f76b4c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe2f230 0x55bacbe37020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.022+0000 7f76af400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe307a0 0x55bacbe37560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:46980/0 (socket says 172.21.15.2:46980) 2024-06-13T02:22:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.022+0000 7f76af400640 1 -- 172.21.15.2:0/833657510 learned_addr learned my addr 172.21.15.2:0/833657510 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.022+0000 7f76b4c00640 1 --2- 172.21.15.2:0/833657510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe39fb0 0x55bacbe37aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.022+0000 7f76af400640 1 -- 172.21.15.2:0/833657510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe39fb0 msgr2=0x55bacbe37aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.022+0000 7f76af400640 1 --2- 172.21.15.2:0/833657510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe39fb0 0x55bacbe37aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.022+0000 7f76af400640 1 -- 172.21.15.2:0/833657510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe2f230 msgr2=0x55bacbe37020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.022+0000 7f76af400640 1 --2- 172.21.15.2:0/833657510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe2f230 0x55bacbe37020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.022+0000 7f76af400640 1 -- 172.21.15.2:0/833657510 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bacbb73620 con 0x55bacbe307a0 2024-06-13T02:22:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.023+0000 7f76af400640 1 --2- 172.21.15.2:0/833657510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe307a0 0x55bacbe37560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f769c012770 tx=0x7f769c012c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86c8d9d73d8a52f2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.023+0000 7f7699600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:22:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.023+0000 7f7699600640 1 -- 172.21.15.2:0/833657510 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c004050 con 0x55bacbe307a0 2024-06-13T02:22:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.023+0000 7f7699600640 1 -- 172.21.15.2:0/833657510 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9495+0+0 (secure 0 0 0) 0x7f769c0041f0 con 0x55bacbe307a0 2024-06-13T02:22:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.023+0000 7f76b99a6740 1 -- 172.21.15.2:0/833657510 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76a8036070 con 0x55bacbe307a0 2024-06-13T02:22:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.023+0000 7f7699600640 1 -- 172.21.15.2:0/833657510 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f769c025050 con 0x55bacbe307a0 2024-06-13T02:22:48.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.023+0000 7f76b99a6740 10 client.25633 fetch_fsmap learned FSMap version 31 2024-06-13T02:22:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.023+0000 7f76b99a6740 1 -- 172.21.15.2:0/833657510 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55bacbe49140 con 0x55bacbe307a0 2024-06-13T02:22:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.024+0000 7f7699600640 1 -- 172.21.15.2:0/833657510 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76a8036070 con 0x55bacbe307a0 2024-06-13T02:22:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.024+0000 7f7699600640 1 -- 172.21.15.2:0/833657510 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f769c003b10 con 0x55bacbe307a0 2024-06-13T02:22:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.024+0000 7f76b99a6740 10 client.25633 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T02:22:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.024+0000 7f76b99a6740 10 client.25633 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:22:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.024+0000 7f76b99a6740 20 client.25633 populate_metadata read hostname 'smithi002' 2024-06-13T02:22:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.024+0000 7f76b99a6740 1 --2- 172.21.15.2:0/833657510 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bacbe4a600 0x55bacbe4c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.024+0000 7f76b99a6740 4 client.25633 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:22:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.024+0000 7f76b99a6740 1 -- 172.21.15.2:0/833657510 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bacbda0b50 con 0x55bacbe4a600 2024-06-13T02:22:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.024+0000 7f76b4c00640 1 --2- 172.21.15.2:0/833657510 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bacbe4a600 0x55bacbe4c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.025+0000 7f76b4c00640 1 --2- 172.21.15.2:0/833657510 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bacbe4a600 0x55bacbe4c9f0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b52e865b2e366ffd server_cookie=1d3e0df9b51757ea in_seq=0 out_seq=0 2024-06-13T02:22:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.025+0000 7f7699600640 10 client.25633 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:48.030 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.026+0000 7f7699600640 1 -- 172.21.15.2:0/833657510 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55bacbda0b50 con 0x55bacbe4a600 2024-06-13T02:22:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.026+0000 7f7699600640 10 client.25633 handle_command_reply: tid=0 2024-06-13T02:22:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.027+0000 7f76b99a6740 1 client.25633 shutdown 2024-06-13T02:22:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.027+0000 7f76b99a6740 1 -- 172.21.15.2:0/833657510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe307a0 msgr2=0x55bacbe37560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.027+0000 7f76b99a6740 1 --2- 172.21.15.2:0/833657510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe307a0 0x55bacbe37560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f769c012770 tx=0x7f769c012c30 comp rx=0 tx=0).stop 2024-06-13T02:22:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.027+0000 7f76b99a6740 1 -- 172.21.15.2:0/833657510 shutdown_connections 2024-06-13T02:22:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.027+0000 7f76b99a6740 1 --2- 172.21.15.2:0/833657510 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bacbe4a600 0x55bacbe4c9f0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.027+0000 7f76b99a6740 1 --2- 172.21.15.2:0/833657510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe39fb0 0x55bacbe37aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.027+0000 7f76b99a6740 1 --2- 172.21.15.2:0/833657510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe307a0 0x55bacbe37560 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.027+0000 7f76b99a6740 1 --2- 172.21.15.2:0/833657510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe2f230 0x55bacbe37020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.027+0000 7f76b99a6740 1 -- 172.21.15.2:0/833657510 >> 172.21.15.2:0/833657510 conn(0x55bacbdf7fb0 msgr2=0x55bacbe31690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.027+0000 7f7699600640 0 client.25633 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.027+0000 7f76b99a6740 1 -- 172.21.15.2:0/833657510 shutdown_connections 2024-06-13T02:22:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.027+0000 7f76b99a6740 1 -- 172.21.15.2:0/833657510 wait complete. 2024-06-13T02:22:48.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.027+0000 7f76b99a6740 20 client.25633 trim_cache size 0 max 16384 2024-06-13T02:22:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.046+0000 7f76b99a6740 1 Processor -- start 2024-06-13T02:22:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.046+0000 7f76b99a6740 1 -- start start 2024-06-13T02:22:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.046+0000 7f76b99a6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe2f230 0x55bacbe314a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.047+0000 7f76b99a6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe307a0 0x55bacbe52280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.047+0000 7f76b99a6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe39fb0 0x55bacbe527c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.047+0000 7f76b99a6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f76b01b37c0 con 0x55bacbe307a0 2024-06-13T02:22:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.047+0000 7f76b99a6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f76b01b1090 con 0x55bacbe2f230 2024-06-13T02:22:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.047+0000 7f76b99a6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76b01aeee0 con 0x55bacbe39fb0 2024-06-13T02:22:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.047+0000 7f76b4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe2f230 0x55bacbe314a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.047+0000 7f76af400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe307a0 0x55bacbe52280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.047+0000 7f76b4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe2f230 0x55bacbe314a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:50828/0 (socket says 172.21.15.2:50828) 2024-06-13T02:22:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.047+0000 7f76b4c00640 1 -- 172.21.15.2:0/1858399342 learned_addr learned my addr 172.21.15.2:0/1858399342 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:48.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.047+0000 7f76b4c00640 1 --2- 172.21.15.2:0/1858399342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe39fb0 0x55bacbe527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.047+0000 7f76af400640 1 -- 172.21.15.2:0/1858399342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe39fb0 msgr2=0x55bacbe527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.047+0000 7f76af400640 1 --2- 172.21.15.2:0/1858399342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe39fb0 0x55bacbe527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.047+0000 7f76af400640 1 -- 172.21.15.2:0/1858399342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe2f230 msgr2=0x55bacbe314a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.047+0000 7f76af400640 1 --2- 172.21.15.2:0/1858399342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe2f230 0x55bacbe314a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.047+0000 7f76af400640 1 -- 172.21.15.2:0/1858399342 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bacbe4d050 con 0x55bacbe307a0 2024-06-13T02:22:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.048+0000 7f76af400640 1 --2- 172.21.15.2:0/1858399342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe307a0 0x55bacbe52280 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f769c009620 tx=0x7f769c009fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de57584af77782d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.048+0000 7f769be00640 1 -- 172.21.15.2:0/1858399342 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c000e60 con 0x55bacbe307a0 2024-06-13T02:22:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.048+0000 7f769be00640 1 -- 172.21.15.2:0/1858399342 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f769c0055f0 con 0x55bacbe307a0 2024-06-13T02:22:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.048+0000 7f769be00640 1 -- 172.21.15.2:0/1858399342 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c00fb80 con 0x55bacbe307a0 2024-06-13T02:22:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.049+0000 7f76b99a6740 1 -- 172.21.15.2:0/1858399342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe307a0 msgr2=0x55bacbe52280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.049+0000 7f76b99a6740 1 --2- 172.21.15.2:0/1858399342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe307a0 0x55bacbe52280 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f769c009620 tx=0x7f769c009fb0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.049+0000 7f76b99a6740 1 -- 172.21.15.2:0/1858399342 shutdown_connections 2024-06-13T02:22:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.049+0000 7f76b99a6740 1 --2- 172.21.15.2:0/1858399342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe39fb0 0x55bacbe527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.049+0000 7f76b99a6740 1 --2- 172.21.15.2:0/1858399342 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe307a0 0x55bacbe52280 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.049+0000 7f76b99a6740 1 --2- 172.21.15.2:0/1858399342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe2f230 0x55bacbe314a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.049+0000 7f76b99a6740 1 -- 172.21.15.2:0/1858399342 >> 172.21.15.2:0/1858399342 conn(0x55bacbdf7fb0 msgr2=0x55bacbe30d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.049+0000 7f76b99a6740 1 -- 172.21.15.2:0/1858399342 shutdown_connections 2024-06-13T02:22:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.049+0000 7f76b99a6740 1 -- 172.21.15.2:0/1858399342 wait complete. 2024-06-13T02:22:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.050+0000 7f76b99a6740 1 -- start start 2024-06-13T02:22:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.050+0000 7f76b99a6740 1 Processor -- start 2024-06-13T02:22:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.051+0000 7f76b99a6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe2f230 0x55bacbe42490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.051+0000 7f76b99a6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe307a0 0x55bacbe429d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.051+0000 7f76b99a6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe39fb0 0x55bacbe3da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.051+0000 7f76b99a6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f76b01af550 con 0x55bacbe39fb0 2024-06-13T02:22:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.051+0000 7f76b99a6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f76b01b09c0 con 0x55bacbe307a0 2024-06-13T02:22:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.051+0000 7f76b99a6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76b01afc20 con 0x55bacbe2f230 2024-06-13T02:22:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.051+0000 7f76b99a6740 10 client.0 _ll_register_callbacks cb 0x7f769c0099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:22:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.051+0000 7f76af400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe307a0 0x55bacbe429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.051+0000 7f76b4c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe2f230 0x55bacbe42490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.051+0000 7f76af400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe307a0 0x55bacbe429d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:50840/0 (socket says 172.21.15.2:50840) 2024-06-13T02:22:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.051+0000 7f76af400640 1 -- 172.21.15.2:0/2488974189 learned_addr learned my addr 172.21.15.2:0/2488974189 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:22:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.051+0000 7f76b4c00640 1 --2- 172.21.15.2:0/2488974189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe39fb0 0x55bacbe3da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.052+0000 7f76af400640 1 -- 172.21.15.2:0/2488974189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe2f230 msgr2=0x55bacbe42490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.052+0000 7f76af400640 1 --2- 172.21.15.2:0/2488974189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe2f230 0x55bacbe42490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.052+0000 7f76af400640 1 -- 172.21.15.2:0/2488974189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe39fb0 msgr2=0x55bacbe3da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:22:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.052+0000 7f76af400640 1 --2- 172.21.15.2:0/2488974189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe39fb0 0x55bacbe3da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.052+0000 7f76af400640 1 -- 172.21.15.2:0/2488974189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bacbe3e230 con 0x55bacbe307a0 2024-06-13T02:22:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.052+0000 7f76b4c00640 1 --2- 172.21.15.2:0/2488974189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe39fb0 0x55bacbe3da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:22:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.052+0000 7f76af400640 1 --2- 172.21.15.2:0/2488974189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe307a0 0x55bacbe429d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f769c012c70 tx=0x7f769c010730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6852630450a51df server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:22:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.052+0000 7f7699600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:22:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.052+0000 7f7699600640 1 -- 172.21.15.2:0/2488974189 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c000e40 con 0x55bacbe307a0 2024-06-13T02:22:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.052+0000 7f7699600640 1 -- 172.21.15.2:0/2488974189 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9495+0+0 (secure 0 0 0) 0x7f769c022040 con 0x55bacbe307a0 2024-06-13T02:22:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.052+0000 7f76b99a6740 1 -- 172.21.15.2:0/2488974189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f769c0055f0 con 0x55bacbe307a0 2024-06-13T02:22:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.053+0000 7f7699600640 1 -- 172.21.15.2:0/2488974189 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f769c00fd10 con 0x55bacbe307a0 2024-06-13T02:22:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.053+0000 7f76b99a6740 10 client.25652 fetch_fsmap learned FSMap version 31 2024-06-13T02:22:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.053+0000 7f76b99a6740 1 -- 172.21.15.2:0/2488974189 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55bacbeb4e70 con 0x55bacbe307a0 2024-06-13T02:22:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.053+0000 7f7699600640 1 -- 172.21.15.2:0/2488974189 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f769c0055f0 con 0x55bacbe307a0 2024-06-13T02:22:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.053+0000 7f7699600640 1 -- 172.21.15.2:0/2488974189 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f769c0035f0 con 0x55bacbe307a0 2024-06-13T02:22:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.053+0000 7f76b99a6740 10 client.25652 fetch_fsmap finished waiting for FSMap version 31 2024-06-13T02:22:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.053+0000 7f76b99a6740 10 client.25652 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:22:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.053+0000 7f76b99a6740 20 client.25652 populate_metadata read hostname 'smithi002' 2024-06-13T02:22:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.053+0000 7f76b99a6740 1 --2- 172.21.15.2:0/2488974189 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bacbeb54b0 0x55bacbeb78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:22:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.053+0000 7f76b99a6740 4 client.25652 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:22:48.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.053+0000 7f76b99a6740 1 -- 172.21.15.2:0/2488974189 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bacbd9aea0 con 0x55bacbeb54b0 2024-06-13T02:22:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.054+0000 7f76b4c00640 1 --2- 172.21.15.2:0/2488974189 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bacbeb54b0 0x55bacbeb78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:22:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.054+0000 7f76b4c00640 1 --2- 172.21.15.2:0/2488974189 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bacbeb54b0 0x55bacbeb78d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7493dd7d5d16fe9a server_cookie=ff2827ffce1767dd in_seq=0 out_seq=0 2024-06-13T02:22:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.054+0000 7f7699600640 10 client.25652 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.271+0000 7f7699600640 1 -- 172.21.15.2:0/2488974189 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55bacbd9aea0 con 0x55bacbeb54b0 2024-06-13T02:22:48.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.271+0000 7f7699600640 10 client.25652 handle_command_reply: tid=0 2024-06-13T02:22:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.271+0000 7f76b99a6740 1 client.25652 shutdown 2024-06-13T02:22:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.272+0000 7f76b99a6740 1 -- 172.21.15.2:0/2488974189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe307a0 msgr2=0x55bacbe429d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.272+0000 7f76b99a6740 1 --2- 172.21.15.2:0/2488974189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe307a0 0x55bacbe429d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f769c012c70 tx=0x7f769c010730 comp rx=0 tx=0).stop 2024-06-13T02:22:48.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.272+0000 7f76b99a6740 1 -- 172.21.15.2:0/2488974189 shutdown_connections 2024-06-13T02:22:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.272+0000 7f76b99a6740 1 --2- 172.21.15.2:0/2488974189 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bacbeb54b0 0x55bacbeb78d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.272+0000 7f76b99a6740 1 --2- 172.21.15.2:0/2488974189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bacbe39fb0 0x55bacbe3da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.272+0000 7f76b99a6740 1 --2- 172.21.15.2:0/2488974189 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bacbe307a0 0x55bacbe429d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.272+0000 7f76b99a6740 1 --2- 172.21.15.2:0/2488974189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bacbe2f230 0x55bacbe42490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.272+0000 7f7699600640 0 client.25652 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:22:48.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.272+0000 7f76b99a6740 1 -- 172.21.15.2:0/2488974189 >> 172.21.15.2:0/2488974189 conn(0x55bacbdf7fb0 msgr2=0x55bacbe2a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:48.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.273+0000 7f76b99a6740 1 -- 172.21.15.2:0/2488974189 shutdown_connections 2024-06-13T02:22:48.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.273+0000 7f76b99a6740 1 -- 172.21.15.2:0/2488974189 wait complete. 2024-06-13T02:22:48.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.274+0000 7f76b99a6740 20 client.25652 trim_cache size 0 max 16384 2024-06-13T02:22:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:22:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:22:48.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:22:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.275+0000 7f76b5600640 1 -- 172.21.15.2:0/4196314797 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f76940a2ce0 msgr2=0x7f76940a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.275+0000 7f76b5600640 1 --2- 172.21.15.2:0/4196314797 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f76940a2ce0 0x7f76940a51a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55bacbe31f00 tx=0x7f76a0009700 comp rx=0 tx=0).stop 2024-06-13T02:22:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.275+0000 7f76b5600640 1 -- 172.21.15.2:0/4196314797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76b01039b0 msgr2=0x7f76b019a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:22:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.275+0000 7f76b5600640 1 --2- 172.21.15.2:0/4196314797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76b01039b0 0x7f76b019a290 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f76a000e9f0 tx=0x7f76a000eeb0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.275+0000 7f76b5600640 1 -- 172.21.15.2:0/4196314797 shutdown_connections 2024-06-13T02:22:48.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.275+0000 7f76b5600640 1 --2- 172.21.15.2:0/4196314797 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76b01099c0 0x7f76b019eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.275+0000 7f76b5600640 1 --2- 172.21.15.2:0/4196314797 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f76940a2ce0 0x7f76940a51a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.275+0000 7f76b5600640 1 --2- 172.21.15.2:0/4196314797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76b0104370 0x7f76b019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.275+0000 7f76b5600640 1 --2- 172.21.15.2:0/4196314797 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76b01039b0 0x7f76b019a290 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:22:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.275+0000 7f76b5600640 1 -- 172.21.15.2:0/4196314797 >> 172.21.15.2:0/4196314797 conn(0x7f76b00ff480 msgr2=0x7f76b00ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:22:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.276+0000 7f76b5600640 1 -- 172.21.15.2:0/4196314797 shutdown_connections 2024-06-13T02:22:48.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:22:48.276+0000 7f76b5600640 1 -- 172.21.15.2:0/4196314797 wait complete. 2024-06-13T02:22:48.501 INFO:tasks.workunit.client.0.smithi002.stdout: 1 348087 8.32 MB/sec execute 112 sec latency 111.977 ms 2024-06-13T02:22:49.055 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:22:48 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: ignoring --setuser ceph since I am not root 2024-06-13T02:22:49.056 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:22:48 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: ignoring --setgroup ceph since I am not root 2024-06-13T02:22:49.056 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:22:48 smithi084 ceph-mds[66763]: -- 172.21.15.84:0/2570694762 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cc9fc0da40 con 0x55cc9fbe0c00 2024-06-13T02:22:49.056 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:22:48 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: starting mds.h at 2024-06-13T02:22:49.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:49 smithi002 ceph-mon[31960]: pgmap v153: 129 pgs: 129 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 209 op/s 2024-06-13T02:22:49.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:49 smithi002 ceph-mon[31960]: daemon mds.h restarted 2024-06-13T02:22:49.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:49 smithi084 ceph-mon[36833]: pgmap v153: 129 pgs: 129 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 209 op/s 2024-06-13T02:22:49.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:49 smithi084 ceph-mon[36833]: daemon mds.h restarted 2024-06-13T02:22:49.502 INFO:tasks.workunit.client.0.smithi002.stdout: 1 349505 8.29 MB/sec execute 113 sec latency 21.662 ms 2024-06-13T02:22:49.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:49 smithi175 ceph-mon[36977]: pgmap v153: 129 pgs: 129 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 209 op/s 2024-06-13T02:22:49.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:49 smithi175 ceph-mon[36977]: daemon mds.h restarted 2024-06-13T02:22:50.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:50 smithi002 ceph-mon[31960]: osdmap e103: 12 total, 12 up, 12 in 2024-06-13T02:22:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:50 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:22:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:50 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.84:6836/2995489767,v1:172.21.15.84:6837/2995489767] up:boot 2024-06-13T02:22:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:50 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-06-13T02:22:50.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:50 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:22:50.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:50 smithi084 ceph-mon[36833]: osdmap e103: 12 total, 12 up, 12 in 2024-06-13T02:22:50.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:50 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:22:50.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:50 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.84:6836/2995489767,v1:172.21.15.84:6837/2995489767] up:boot 2024-06-13T02:22:50.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:50 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-06-13T02:22:50.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:50 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:22:50.502 INFO:tasks.workunit.client.0.smithi002.stdout: 1 351371 8.33 MB/sec execute 114 sec latency 86.431 ms 2024-06-13T02:22:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:50 smithi175 ceph-mon[36977]: osdmap e103: 12 total, 12 up, 12 in 2024-06-13T02:22:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:50 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:22:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:50 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.84:6836/2995489767,v1:172.21.15.84:6837/2995489767] up:boot 2024-06-13T02:22:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:50 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-06-13T02:22:50.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:50 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:22:51.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:51 smithi002 ceph-mon[31960]: pgmap v155: 129 pgs: 129 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 215 op/s 2024-06-13T02:22:51.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:51 smithi084 ceph-mon[36833]: pgmap v155: 129 pgs: 129 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 215 op/s 2024-06-13T02:22:51.536 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:51 smithi175 ceph-mon[36977]: pgmap v155: 129 pgs: 129 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 215 op/s 2024-06-13T02:22:51.536 INFO:tasks.workunit.client.0.smithi002.stdout: 1 352344 8.28 MB/sec execute 115 sec latency 16.546 ms 2024-06-13T02:22:52.504 INFO:tasks.workunit.client.0.smithi002.stdout: 1 354484 8.32 MB/sec execute 116 sec latency 17.404 ms 2024-06-13T02:22:53.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:53 smithi002 ceph-mon[31960]: pgmap v156: 129 pgs: 129 active+clean; 49 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 323 op/s 2024-06-13T02:22:53.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:53 smithi084 ceph-mon[36833]: pgmap v156: 129 pgs: 129 active+clean; 49 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 323 op/s 2024-06-13T02:22:53.504 INFO:tasks.workunit.client.0.smithi002.stdout: 1 355433 8.29 MB/sec execute 117 sec latency 34.645 ms 2024-06-13T02:22:53.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:53 smithi175 ceph-mon[36977]: pgmap v156: 129 pgs: 129 active+clean; 49 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 323 op/s 2024-06-13T02:22:54.504 INFO:tasks.workunit.client.0.smithi002.stdout: 1 356998 8.27 MB/sec execute 118 sec latency 43.914 ms 2024-06-13T02:22:55.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:55 smithi002 ceph-mon[31960]: pgmap v157: 129 pgs: 129 active+clean; 49 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 323 op/s 2024-06-13T02:22:55.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:55 smithi084 ceph-mon[36833]: pgmap v157: 129 pgs: 129 active+clean; 49 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 323 op/s 2024-06-13T02:22:55.504 INFO:tasks.workunit.client.0.smithi002.stdout: 1 358490 8.31 MB/sec execute 119 sec latency 18.332 ms 2024-06-13T02:22:55.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:55 smithi175 ceph-mon[36977]: pgmap v157: 129 pgs: 129 active+clean; 49 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 323 op/s 2024-06-13T02:22:56.504 INFO:tasks.workunit.client.0.smithi002.stdout: 1 359428 8.26 MB/sec execute 120 sec latency 14.287 ms 2024-06-13T02:22:57.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:57 smithi002 ceph-mon[31960]: pgmap v158: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 323 op/s 2024-06-13T02:22:57.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:57 smithi084 ceph-mon[36833]: pgmap v158: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 323 op/s 2024-06-13T02:22:57.504 INFO:tasks.workunit.client.0.smithi002.stdout: 1 361422 8.28 MB/sec execute 121 sec latency 13.806 ms 2024-06-13T02:22:57.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:57 smithi175 ceph-mon[36977]: pgmap v158: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 323 op/s 2024-06-13T02:22:58.504 INFO:tasks.workunit.client.0.smithi002.stdout: 1 362343 8.26 MB/sec execute 122 sec latency 60.962 ms 2024-06-13T02:22:59.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:22:59 smithi002 ceph-mon[31960]: pgmap v159: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 314 op/s 2024-06-13T02:22:59.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:22:59 smithi084 ceph-mon[36833]: pgmap v159: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 314 op/s 2024-06-13T02:22:59.505 INFO:tasks.workunit.client.0.smithi002.stdout: 1 363681 8.24 MB/sec execute 123 sec latency 21.630 ms 2024-06-13T02:22:59.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:22:59 smithi175 ceph-mon[36977]: pgmap v159: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 314 op/s 2024-06-13T02:23:00.505 INFO:tasks.workunit.client.0.smithi002.stdout: 1 365033 8.24 MB/sec execute 124 sec latency 109.435 ms 2024-06-13T02:23:01.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:01 smithi002 ceph-mon[31960]: pgmap v160: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 294 op/s 2024-06-13T02:23:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.452+0000 7fbfc4c00640 1 -- 172.21.15.2:0/3445443622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfc01069d0 msgr2=0x7fbfc0106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:01.453 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.452+0000 7fbfc4c00640 1 --2- 172.21.15.2:0/3445443622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfc01069d0 0x7fbfc0106db0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0009930 tx=0x7fbfb002a420 comp rx=0 tx=0).stop 2024-06-13T02:23:01.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.452+0000 7fbfc4c00640 1 -- 172.21.15.2:0/3445443622 shutdown_connections 2024-06-13T02:23:01.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.452+0000 7fbfc4c00640 1 --2- 172.21.15.2:0/3445443622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc0100cb0 0x7fbfc010e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.452+0000 7fbfc4c00640 1 --2- 172.21.15.2:0/3445443622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfc01002f0 0x7fbfc0100770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.452+0000 7fbfc4c00640 1 --2- 172.21.15.2:0/3445443622 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfc01069d0 0x7fbfc0106db0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.452+0000 7fbfc4c00640 1 -- 172.21.15.2:0/3445443622 >> 172.21.15.2:0/3445443622 conn(0x7fbfc0075c50 msgr2=0x7fbfc0076060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:01.454 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.452+0000 7fbfc4c00640 1 -- 172.21.15.2:0/3445443622 shutdown_connections 2024-06-13T02:23:01.455 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.452+0000 7fbfc4c00640 1 -- 172.21.15.2:0/3445443622 wait complete. 2024-06-13T02:23:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.453+0000 7fbfc4c00640 1 Processor -- start 2024-06-13T02:23:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.454+0000 7fbfc4c00640 1 -- start start 2024-06-13T02:23:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.454+0000 7fbfc4c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfc01002f0 0x7fbfc0198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.454+0000 7fbfc4c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfc0100cb0 0x7fbfc0198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.454+0000 7fbfc4c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc01069d0 0x7fbfc019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.454+0000 7fbfc4c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc0111f30 con 0x7fbfc01069d0 2024-06-13T02:23:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.454+0000 7fbfc4c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc0111db0 con 0x7fbfc01002f0 2024-06-13T02:23:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.454+0000 7fbfc4c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01120b0 con 0x7fbfc0100cb0 2024-06-13T02:23:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.454+0000 7fbfbde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfc01002f0 0x7fbfc0198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.454+0000 7fbfbe800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc01069d0 0x7fbfc019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.454+0000 7fbfb5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfc0100cb0 0x7fbfc0198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.454+0000 7fbfbde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfc01002f0 0x7fbfc0198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:60946/0 (socket says 172.21.15.2:60946) 2024-06-13T02:23:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.454+0000 7fbfbe800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc01069d0 0x7fbfc019cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59460/0 (socket says 172.21.15.2:59460) 2024-06-13T02:23:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.454+0000 7fbfbe800640 1 -- 172.21.15.2:0/3805453644 learned_addr learned my addr 172.21.15.2:0/3805453644 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:01.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.455+0000 7fbfbde00640 1 -- 172.21.15.2:0/3805453644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfc0100cb0 msgr2=0x7fbfc0198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.455+0000 7fbfbde00640 1 --2- 172.21.15.2:0/3805453644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfc0100cb0 0x7fbfc0198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.455+0000 7fbfbde00640 1 -- 172.21.15.2:0/3805453644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc01069d0 msgr2=0x7fbfc019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.455+0000 7fbfbde00640 1 --2- 172.21.15.2:0/3805453644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc01069d0 0x7fbfc019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.455+0000 7fbfbde00640 1 -- 172.21.15.2:0/3805453644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc019d300 con 0x7fbfc01002f0 2024-06-13T02:23:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.455+0000 7fbfb5400640 1 --2- 172.21.15.2:0/3805453644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfc0100cb0 0x7fbfc0198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:23:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.455+0000 7fbfbde00640 1 --2- 172.21.15.2:0/3805453644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfc01002f0 0x7fbfc0198310 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbfb002a940 tx=0x7fbfb0003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.455+0000 7fbfb7400640 1 -- 172.21.15.2:0/3805453644 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb003f070 con 0x7fbfc01002f0 2024-06-13T02:23:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.456+0000 7fbfb7400640 1 -- 172.21.15.2:0/3805453644 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfb0031c90 con 0x7fbfc01002f0 2024-06-13T02:23:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.456+0000 7fbfc4c00640 1 -- 172.21.15.2:0/3805453644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc019d590 con 0x7fbfc01002f0 2024-06-13T02:23:01.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.456+0000 7fbfb7400640 1 -- 172.21.15.2:0/3805453644 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0035030 con 0x7fbfc01002f0 2024-06-13T02:23:01.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.456+0000 7fbfc4c00640 1 -- 172.21.15.2:0/3805453644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc01a4e80 con 0x7fbfc01002f0 2024-06-13T02:23:01.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.460+0000 7fbfc7bc2740 1 Processor -- start 2024-06-13T02:23:01.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.460+0000 7fbfc7bc2740 1 -- start start 2024-06-13T02:23:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.460+0000 7fbfb7400640 1 -- 172.21.15.2:0/3805453644 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fbfb0042070 con 0x7fbfc01002f0 2024-06-13T02:23:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.460+0000 7fbfc7bc2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b58a9f0 0x560e5b588f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.460+0000 7fbfc7bc2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b589480 0x560e5b589900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.460+0000 7fbfc7bc2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b594200 0x560e5b5965f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.460+0000 7fbfc7bc2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560e5b4e9420 con 0x560e5b589480 2024-06-13T02:23:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.460+0000 7fbfc7bc2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560e5b490c50 con 0x560e5b594200 2024-06-13T02:23:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.461+0000 7fbfc7bc2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560e5b4e53e0 con 0x560e5b58a9f0 2024-06-13T02:23:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.461+0000 7fbfbe800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b58a9f0 0x560e5b588f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.461+0000 7fbfbde00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b589480 0x560e5b589900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.461+0000 7fbfbe800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b58a9f0 0x560e5b588f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:46348/0 (socket says 172.21.15.2:46348) 2024-06-13T02:23:01.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.461+0000 7fbfb5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b594200 0x560e5b5965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.464 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.461+0000 7fbfbe800640 1 -- 172.21.15.2:0/2014551992 learned_addr learned my addr 172.21.15.2:0/2014551992 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.461+0000 7fbfbe800640 1 -- 172.21.15.2:0/2014551992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b594200 msgr2=0x560e5b5965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.461+0000 7fbfbe800640 1 --2- 172.21.15.2:0/2014551992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b594200 0x560e5b5965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.461+0000 7fbfbe800640 1 -- 172.21.15.2:0/2014551992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b589480 msgr2=0x560e5b589900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.461+0000 7fbfbe800640 1 --2- 172.21.15.2:0/2014551992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b589480 0x560e5b589900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.461+0000 7fbfbe800640 1 -- 172.21.15.2:0/2014551992 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e5b1fd210 con 0x560e5b58a9f0 2024-06-13T02:23:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.461+0000 7fbfb5400640 1 --2- 172.21.15.2:0/2014551992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b594200 0x560e5b5965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:23:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.462+0000 7fbfbe800640 1 --2- 172.21.15.2:0/2014551992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b58a9f0 0x560e5b588f40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8011490 tx=0x7fbfb8011950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f7cf3dbaae98a8d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.462+0000 7fbfaf000640 1 -- 172.21.15.2:0/2014551992 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8012770 con 0x560e5b58a9f0 2024-06-13T02:23:01.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.462+0000 7fbfaf000640 1 -- 172.21.15.2:0/2014551992 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfb8012df0 con 0x560e5b58a9f0 2024-06-13T02:23:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.462+0000 7fbfaf000640 1 -- 172.21.15.2:0/2014551992 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb80193a0 con 0x560e5b58a9f0 2024-06-13T02:23:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.462+0000 7fbfb7400640 1 --2- 172.21.15.2:0/3805453644 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fbfa40a2d70 0x7fbfa40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.463+0000 7fbfb7400640 1 -- 172.21.15.2:0/3805453644 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9495+0+0 (secure 0 0 0) 0x7fbfb00efd50 con 0x7fbfc01002f0 2024-06-13T02:23:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.463+0000 7fbfbde00640 1 --2- 172.21.15.2:0/3805453644 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fbfa40a2d70 0x7fbfa40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.463+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2014551992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b58a9f0 msgr2=0x560e5b588f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.463+0000 7fbfbde00640 1 --2- 172.21.15.2:0/3805453644 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fbfa40a2d70 0x7fbfa40a5230 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00ed180 tx=0x7fbfb00f38a0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.463+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/2014551992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b58a9f0 0x560e5b588f40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8011490 tx=0x7fbfb8011950 comp rx=0 tx=0).stop 2024-06-13T02:23:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.463+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2014551992 shutdown_connections 2024-06-13T02:23:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.463+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/2014551992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b594200 0x560e5b5965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.463+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/2014551992 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b589480 0x560e5b589900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.463+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/2014551992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b58a9f0 0x560e5b588f40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.463+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2014551992 >> 172.21.15.2:0/2014551992 conn(0x560e5b54dfb0 msgr2=0x560e5b585a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.464+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2014551992 shutdown_connections 2024-06-13T02:23:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.464+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2014551992 wait complete. 2024-06-13T02:23:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.464+0000 7fbfc7bc2740 1 -- start start 2024-06-13T02:23:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.464+0000 7fbfc7bc2740 1 Processor -- start 2024-06-13T02:23:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfc7bc2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b589480 0x560e5b5912d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfc7bc2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b58a9f0 0x560e5b591810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfc7bc2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b594200 0x560e5b591d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfc7bc2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560e5b596fd0 con 0x560e5b589480 2024-06-13T02:23:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfc7bc2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560e5b4a40b0 con 0x560e5b58a9f0 2024-06-13T02:23:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfc7bc2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560e5b597150 con 0x560e5b594200 2024-06-13T02:23:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfc7bc2740 10 client.0 _ll_register_callbacks cb 0x560e5b48ff40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:23:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfb5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b58a9f0 0x560e5b591810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfbe800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b589480 0x560e5b5912d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfb5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b58a9f0 0x560e5b591810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:60970/0 (socket says 172.21.15.2:60970) 2024-06-13T02:23:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfb5400640 1 -- 172.21.15.2:0/2867938543 learned_addr learned my addr 172.21.15.2:0/2867938543 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfbe800640 1 --2- 172.21.15.2:0/2867938543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b594200 0x560e5b591d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfb5400640 1 -- 172.21.15.2:0/2867938543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b594200 msgr2=0x560e5b591d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:01.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfb5400640 1 --2- 172.21.15.2:0/2867938543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b594200 0x560e5b591d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfb5400640 1 -- 172.21.15.2:0/2867938543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b589480 msgr2=0x560e5b5912d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:01.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfb5400640 1 --2- 172.21.15.2:0/2867938543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b589480 0x560e5b5912d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.465+0000 7fbfb5400640 1 -- 172.21.15.2:0/2867938543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e5b2c9620 con 0x560e5b58a9f0 2024-06-13T02:23:01.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.466+0000 7fbfbe800640 1 --2- 172.21.15.2:0/2867938543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b594200 0x560e5b591d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:23:01.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.466+0000 7fbfb5400640 1 --2- 172.21.15.2:0/2867938543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b58a9f0 0x560e5b591810 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8012d20 tx=0x7fbfa800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=938606cdba3bc46a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:01.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.466+0000 7fbfa3400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:23:01.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.466+0000 7fbfa3400640 1 -- 172.21.15.2:0/2867938543 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8012110 con 0x560e5b58a9f0 2024-06-13T02:23:01.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.466+0000 7fbfa3400640 1 -- 172.21.15.2:0/2867938543 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9495+0+0 (secure 0 0 0) 0x7fbfa8004050 con 0x560e5b58a9f0 2024-06-13T02:23:01.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.466+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2867938543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfb8012df0 con 0x560e5b58a9f0 2024-06-13T02:23:01.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.466+0000 7fbfa3400640 1 -- 172.21.15.2:0/2867938543 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbfa8025050 con 0x560e5b58a9f0 2024-06-13T02:23:01.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.466+0000 7fbfc7bc2740 10 client.25670 fetch_fsmap learned FSMap version 33 2024-06-13T02:23:01.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.466+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2867938543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560e5b581210 con 0x560e5b58a9f0 2024-06-13T02:23:01.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.467+0000 7fbfa3400640 1 -- 172.21.15.2:0/2867938543 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfb8012df0 con 0x560e5b58a9f0 2024-06-13T02:23:01.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.467+0000 7fbfa3400640 1 -- 172.21.15.2:0/2867938543 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fbfa8010430 con 0x560e5b58a9f0 2024-06-13T02:23:01.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.467+0000 7fbfc7bc2740 10 client.25670 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:23:01.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.467+0000 7fbfc7bc2740 10 client.25670 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:23:01.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.467+0000 7fbfc7bc2740 20 client.25670 populate_metadata read hostname 'smithi002' 2024-06-13T02:23:01.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.467+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/2867938543 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560e5b5826d0 0x560e5b584b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.467+0000 7fbfc7bc2740 4 client.25670 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:23:01.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.467+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2867938543 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e5b4f6b50 con 0x560e5b5826d0 2024-06-13T02:23:01.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.468+0000 7fbfbe800640 1 --2- 172.21.15.2:0/2867938543 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560e5b5826d0 0x560e5b584b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.469+0000 7fbfbe800640 1 --2- 172.21.15.2:0/2867938543 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560e5b5826d0 0x560e5b584b30 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cb39143af3f2f58 server_cookie=53147d4b800c7e7 in_seq=0 out_seq=0 2024-06-13T02:23:01.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.469+0000 7fbfa3400640 10 client.25670 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:01.474 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:01 smithi084 ceph-mon[36833]: pgmap v160: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 294 op/s 2024-06-13T02:23:01.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.469+0000 7fbfa3400640 1 -- 172.21.15.2:0/2867938543 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560e5b4f6b50 con 0x560e5b5826d0 2024-06-13T02:23:01.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.469+0000 7fbfa3400640 10 client.25670 handle_command_reply: tid=0 2024-06-13T02:23:01.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.469+0000 7fbfc7bc2740 1 client.25670 shutdown 2024-06-13T02:23:01.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.470+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2867938543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b58a9f0 msgr2=0x560e5b591810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:01.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.470+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/2867938543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b58a9f0 0x560e5b591810 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8012d20 tx=0x7fbfa800f790 comp rx=0 tx=0).stop 2024-06-13T02:23:01.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.470+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2867938543 shutdown_connections 2024-06-13T02:23:01.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.470+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/2867938543 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560e5b5826d0 0x560e5b584b30 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.470+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/2867938543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b594200 0x560e5b591d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.470+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/2867938543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b58a9f0 0x560e5b591810 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.470+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/2867938543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b589480 0x560e5b5912d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.470+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2867938543 >> 172.21.15.2:0/2867938543 conn(0x560e5b54dfb0 msgr2=0x560e5b58b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:01.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.470+0000 7fbfa3400640 0 client.25670 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:01.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.470+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2867938543 shutdown_connections 2024-06-13T02:23:01.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.470+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2867938543 wait complete. 2024-06-13T02:23:01.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.470+0000 7fbfc7bc2740 20 client.25670 trim_cache size 0 max 16384 2024-06-13T02:23:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.491+0000 7fbfc7bc2740 1 Processor -- start 2024-06-13T02:23:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.492+0000 7fbfc7bc2740 1 -- start start 2024-06-13T02:23:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.492+0000 7fbfc7bc2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b589480 0x560e5b58b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.492+0000 7fbfc7bc2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b58a9f0 0x560e5b5b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.492+0000 7fbfc7bc2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b594200 0x560e5b5b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.492+0000 7fbfc7bc2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01af5d0 con 0x560e5b594200 2024-06-13T02:23:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.492+0000 7fbfc7bc2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01acea0 con 0x560e5b58a9f0 2024-06-13T02:23:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.492+0000 7fbfc7bc2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01aacf0 con 0x560e5b589480 2024-06-13T02:23:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.492+0000 7fbfb5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b58a9f0 0x560e5b5b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.492+0000 7fbfb5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b58a9f0 0x560e5b5b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:60984/0 (socket says 172.21.15.2:60984) 2024-06-13T02:23:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.492+0000 7fbfb5400640 1 -- 172.21.15.2:0/2808604775 learned_addr learned my addr 172.21.15.2:0/2808604775 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.492+0000 7fbfbe800640 1 --2- 172.21.15.2:0/2808604775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b589480 0x560e5b58b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.493+0000 7fbfbe800640 1 --2- 172.21.15.2:0/2808604775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b594200 0x560e5b5b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.493+0000 7fbfb5400640 1 -- 172.21.15.2:0/2808604775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b589480 msgr2=0x560e5b58b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.493+0000 7fbfb5400640 1 --2- 172.21.15.2:0/2808604775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b589480 0x560e5b58b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.493+0000 7fbfb5400640 1 -- 172.21.15.2:0/2808604775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b594200 msgr2=0x560e5b5b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.493+0000 7fbfb5400640 1 --2- 172.21.15.2:0/2808604775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b594200 0x560e5b5b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.493+0000 7fbfb5400640 1 -- 172.21.15.2:0/2808604775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e5b596a50 con 0x560e5b58a9f0 2024-06-13T02:23:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.493+0000 7fbfbe800640 1 --2- 172.21.15.2:0/2808604775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b594200 0x560e5b5b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:23:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.493+0000 7fbfb5400640 1 --2- 172.21.15.2:0/2808604775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b58a9f0 0x560e5b5b0ad0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009710 tx=0x7fbfa80123d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3c5a7399bb788b6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.493+0000 7fbfae600640 1 -- 172.21.15.2:0/2808604775 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8000e60 con 0x560e5b58a9f0 2024-06-13T02:23:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.493+0000 7fbfae600640 1 -- 172.21.15.2:0/2808604775 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfa8005590 con 0x560e5b58a9f0 2024-06-13T02:23:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.493+0000 7fbfae600640 1 -- 172.21.15.2:0/2808604775 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8003850 con 0x560e5b58a9f0 2024-06-13T02:23:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.494+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2808604775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b58a9f0 msgr2=0x560e5b5b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.494+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/2808604775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b58a9f0 0x560e5b5b0ad0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009710 tx=0x7fbfa80123d0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.494+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2808604775 shutdown_connections 2024-06-13T02:23:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.494+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/2808604775 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b594200 0x560e5b5b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.494+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/2808604775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b58a9f0 0x560e5b5b0ad0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.494+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/2808604775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b589480 0x560e5b58b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.494+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2808604775 >> 172.21.15.2:0/2808604775 conn(0x560e5b54dfb0 msgr2=0x560e5b58afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.494+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2808604775 shutdown_connections 2024-06-13T02:23:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.494+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/2808604775 wait complete. 2024-06-13T02:23:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.495+0000 7fbfc7bc2740 1 -- start start 2024-06-13T02:23:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.495+0000 7fbfc7bc2740 1 Processor -- start 2024-06-13T02:23:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.495+0000 7fbfc7bc2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b589480 0x560e5b5979a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.495+0000 7fbfc7bc2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b58a9f0 0x560e5b597ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.495+0000 7fbfc7bc2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b594200 0x560e5b611a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfc7bc2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01ab360 con 0x560e5b594200 2024-06-13T02:23:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfc7bc2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01ac7d0 con 0x560e5b589480 2024-06-13T02:23:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfc7bc2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01aba30 con 0x560e5b58a9f0 2024-06-13T02:23:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfc7bc2740 10 client.0 _ll_register_callbacks cb 0x7fbfa8009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:23:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfbe800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b589480 0x560e5b5979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfbe800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b589480 0x560e5b5979a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:60990/0 (socket says 172.21.15.2:60990) 2024-06-13T02:23:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfbe800640 1 -- 172.21.15.2:0/3504059262 learned_addr learned my addr 172.21.15.2:0/3504059262 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfbe800640 1 --2- 172.21.15.2:0/3504059262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b594200 0x560e5b611a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfb5400640 1 --2- 172.21.15.2:0/3504059262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b58a9f0 0x560e5b597ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfbe800640 1 -- 172.21.15.2:0/3504059262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b58a9f0 msgr2=0x560e5b597ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfbe800640 1 --2- 172.21.15.2:0/3504059262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b58a9f0 0x560e5b597ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfbe800640 1 -- 172.21.15.2:0/3504059262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b594200 msgr2=0x560e5b611a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfbe800640 1 --2- 172.21.15.2:0/3504059262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b594200 0x560e5b611a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfbe800640 1 -- 172.21.15.2:0/3504059262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e5b612080 con 0x560e5b589480 2024-06-13T02:23:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfbe800640 1 --2- 172.21.15.2:0/3504059262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b589480 0x560e5b5979a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009270 tx=0x7fbfb802ce80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7ba34c564d821d5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.496+0000 7fbfa3400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:23:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.497+0000 7fbfa3400640 1 -- 172.21.15.2:0/3504059262 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8029020 con 0x560e5b589480 2024-06-13T02:23:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.497+0000 7fbfa3400640 1 -- 172.21.15.2:0/3504059262 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9495+0+0 (secure 0 0 0) 0x7fbfb801a3f0 con 0x560e5b589480 2024-06-13T02:23:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.497+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/3504059262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfa8005590 con 0x560e5b589480 2024-06-13T02:23:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.497+0000 7fbfa3400640 1 -- 172.21.15.2:0/3504059262 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbfb801a5f0 con 0x560e5b589480 2024-06-13T02:23:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.497+0000 7fbfc7bc2740 10 client.25676 fetch_fsmap learned FSMap version 33 2024-06-13T02:23:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.497+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/3504059262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560e5b613370 con 0x560e5b589480 2024-06-13T02:23:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.497+0000 7fbfa3400640 1 -- 172.21.15.2:0/3504059262 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfa8005590 con 0x560e5b589480 2024-06-13T02:23:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.497+0000 7fbfa3400640 1 -- 172.21.15.2:0/3504059262 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fbfb800f040 con 0x560e5b589480 2024-06-13T02:23:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.498+0000 7fbfc7bc2740 10 client.25676 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:23:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.498+0000 7fbfc7bc2740 10 client.25676 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:23:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.498+0000 7fbfc7bc2740 20 client.25676 populate_metadata read hostname 'smithi002' 2024-06-13T02:23:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.498+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/3504059262 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560e5b613710 0x560e5b615b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.498+0000 7fbfc7bc2740 4 client.25676 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:23:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.498+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/3504059262 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560e5b4f0ea0 con 0x560e5b613710 2024-06-13T02:23:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.498+0000 7fbfb5400640 1 --2- 172.21.15.2:0/3504059262 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560e5b613710 0x560e5b615b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.498+0000 7fbfb5400640 1 --2- 172.21.15.2:0/3504059262 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560e5b613710 0x560e5b615b00 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fa2e4285fd8057e server_cookie=c03868de6dfb3fd4 in_seq=0 out_seq=0 2024-06-13T02:23:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.498+0000 7fbfa3400640 10 client.25676 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:01.505 INFO:tasks.workunit.client.0.smithi002.stdout: 1 365301 8.20 MB/sec execute 125 sec latency 104.134 ms 2024-06-13T02:23:01.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:01 smithi175 ceph-mon[36977]: pgmap v160: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 294 op/s 2024-06-13T02:23:01.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.664+0000 7fbfa3400640 1 -- 172.21.15.2:0/3504059262 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x560e5b4f0ea0 con 0x560e5b613710 2024-06-13T02:23:01.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.664+0000 7fbfa3400640 10 client.25676 handle_command_reply: tid=0 2024-06-13T02:23:01.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.665+0000 7fbfc7bc2740 1 client.25676 shutdown 2024-06-13T02:23:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.665+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/3504059262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b589480 msgr2=0x560e5b5979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.665+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/3504059262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b589480 0x560e5b5979a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009270 tx=0x7fbfb802ce80 comp rx=0 tx=0).stop 2024-06-13T02:23:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.665+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/3504059262 shutdown_connections 2024-06-13T02:23:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.665+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/3504059262 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560e5b613710 0x560e5b615b00 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.665+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/3504059262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e5b594200 0x560e5b611a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.665+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/3504059262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560e5b58a9f0 0x560e5b597ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.665+0000 7fbfc7bc2740 1 --2- 172.21.15.2:0/3504059262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560e5b589480 0x560e5b5979a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.665+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/3504059262 >> 172.21.15.2:0/3504059262 conn(0x560e5b54dfb0 msgr2=0x560e5b580840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.665+0000 7fbfa3400640 0 client.25676 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.666+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/3504059262 shutdown_connections 2024-06-13T02:23:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.666+0000 7fbfc7bc2740 1 -- 172.21.15.2:0/3504059262 wait complete. 2024-06-13T02:23:01.668 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.666+0000 7fbfc7bc2740 20 client.25676 trim_cache size 0 max 16384 2024-06-13T02:23:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:23:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:23:01.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:23:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.668+0000 7fbfc4c00640 1 -- 172.21.15.2:0/3805453644 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fbfa40a2d70 msgr2=0x7fbfa40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.668+0000 7fbfc4c00640 1 --2- 172.21.15.2:0/3805453644 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fbfa40a2d70 0x7fbfa40a5230 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00ed180 tx=0x7fbfb00f38a0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.668+0000 7fbfc4c00640 1 -- 172.21.15.2:0/3805453644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfc01002f0 msgr2=0x7fbfc0198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.668+0000 7fbfc4c00640 1 --2- 172.21.15.2:0/3805453644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfc01002f0 0x7fbfc0198310 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbfb002a940 tx=0x7fbfb0003b90 comp rx=0 tx=0).stop 2024-06-13T02:23:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.668+0000 7fbfc4c00640 1 -- 172.21.15.2:0/3805453644 shutdown_connections 2024-06-13T02:23:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.668+0000 7fbfc4c00640 1 --2- 172.21.15.2:0/3805453644 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fbfa40a2d70 0x7fbfa40a5230 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.668+0000 7fbfc4c00640 1 --2- 172.21.15.2:0/3805453644 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc01069d0 0x7fbfc019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.668+0000 7fbfc4c00640 1 --2- 172.21.15.2:0/3805453644 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbfc0100cb0 0x7fbfc0198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.668+0000 7fbfc4c00640 1 --2- 172.21.15.2:0/3805453644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbfc01002f0 0x7fbfc0198310 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.668+0000 7fbfc4c00640 1 -- 172.21.15.2:0/3805453644 >> 172.21.15.2:0/3805453644 conn(0x7fbfc0075c50 msgr2=0x7fbfc00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:01.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.668+0000 7fbfc4c00640 1 -- 172.21.15.2:0/3805453644 shutdown_connections 2024-06-13T02:23:01.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:01.668+0000 7fbfc4c00640 1 -- 172.21.15.2:0/3805453644 wait complete. 2024-06-13T02:23:02.505 INFO:tasks.workunit.client.0.smithi002.stdout: 1 366077 8.15 MB/sec execute 126 sec latency 82.734 ms 2024-06-13T02:23:03.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:03 smithi002 ceph-mon[31960]: pgmap v161: 129 pgs: 129 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 356 op/s 2024-06-13T02:23:03.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:03 smithi084 ceph-mon[36833]: pgmap v161: 129 pgs: 129 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 356 op/s 2024-06-13T02:23:03.505 INFO:tasks.workunit.client.0.smithi002.stdout: 1 367540 8.13 MB/sec execute 127 sec latency 72.819 ms 2024-06-13T02:23:03.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:03 smithi175 ceph-mon[36977]: pgmap v161: 129 pgs: 129 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 356 op/s 2024-06-13T02:23:04.505 INFO:tasks.workunit.client.0.smithi002.stdout: 1 369162 8.17 MB/sec execute 128 sec latency 16.676 ms 2024-06-13T02:23:05.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:05 smithi002 ceph-mon[31960]: pgmap v162: 129 pgs: 129 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 175 op/s 2024-06-13T02:23:05.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:05 smithi084 ceph-mon[36833]: pgmap v162: 129 pgs: 129 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 175 op/s 2024-06-13T02:23:05.505 INFO:tasks.workunit.client.0.smithi002.stdout: 1 370413 8.15 MB/sec execute 129 sec latency 12.862 ms 2024-06-13T02:23:05.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:05 smithi175 ceph-mon[36977]: pgmap v162: 129 pgs: 129 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 175 op/s 2024-06-13T02:23:06.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:06 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:23:06.505 INFO:tasks.workunit.client.0.smithi002.stdout: 1 372699 8.19 MB/sec execute 130 sec latency 11.588 ms 2024-06-13T02:23:06.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:06 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:23:06.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:06 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:23:07.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:07 smithi084 ceph-mon[36833]: pgmap v163: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 328 op/s 2024-06-13T02:23:07.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:07 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:23:07.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:07 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:23:07.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:07 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:23:07.506 INFO:tasks.workunit.client.0.smithi002.stdout: 1 373887 8.17 MB/sec execute 131 sec latency 21.193 ms 2024-06-13T02:23:07.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:07 smithi175 ceph-mon[36977]: pgmap v163: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 328 op/s 2024-06-13T02:23:07.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:07 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:23:07.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:07 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:23:07.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:07 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:23:07.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:07 smithi002 ceph-mon[31960]: pgmap v163: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 328 op/s 2024-06-13T02:23:07.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:07 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:23:07.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:07 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:23:07.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:07 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:23:08.506 INFO:tasks.workunit.client.0.smithi002.stdout: 1 375988 8.20 MB/sec execute 132 sec latency 59.518 ms 2024-06-13T02:23:09.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:09 smithi084 ceph-mon[36833]: pgmap v164: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 247 op/s 2024-06-13T02:23:09.506 INFO:tasks.workunit.client.0.smithi002.stdout: 1 377034 8.17 MB/sec execute 133 sec latency 18.750 ms 2024-06-13T02:23:09.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:09 smithi175 ceph-mon[36977]: pgmap v164: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 247 op/s 2024-06-13T02:23:09.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:09 smithi002 ceph-mon[31960]: pgmap v164: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 247 op/s 2024-06-13T02:23:10.506 INFO:tasks.workunit.client.0.smithi002.stdout: 1 379026 8.19 MB/sec execute 134 sec latency 12.622 ms 2024-06-13T02:23:11.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:11 smithi084 ceph-mon[36833]: pgmap v165: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 247 op/s 2024-06-13T02:23:11.506 INFO:tasks.workunit.client.0.smithi002.stdout: 1 380352 8.18 MB/sec execute 135 sec latency 13.663 ms 2024-06-13T02:23:11.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:11 smithi175 ceph-mon[36977]: pgmap v165: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 247 op/s 2024-06-13T02:23:11.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:11 smithi002 ceph-mon[31960]: pgmap v165: 129 pgs: 129 active+clean; 53 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 247 op/s 2024-06-13T02:23:12.506 INFO:tasks.workunit.client.0.smithi002.stdout: 1 382116 8.17 MB/sec execute 136 sec latency 17.437 ms 2024-06-13T02:23:13.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:13 smithi084 ceph-mon[36833]: pgmap v166: 129 pgs: 129 active+clean; 58 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 332 op/s 2024-06-13T02:23:13.506 INFO:tasks.workunit.client.0.smithi002.stdout: 1 383558 8.19 MB/sec execute 137 sec latency 64.407 ms 2024-06-13T02:23:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:13 smithi175 ceph-mon[36977]: pgmap v166: 129 pgs: 129 active+clean; 58 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 332 op/s 2024-06-13T02:23:13.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:13 smithi002 ceph-mon[31960]: pgmap v166: 129 pgs: 129 active+clean; 58 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 332 op/s 2024-06-13T02:23:14.506 INFO:tasks.workunit.client.0.smithi002.stdout: 1 385249 8.18 MB/sec execute 138 sec latency 21.915 ms 2024-06-13T02:23:14.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.816+0000 7fe0da800640 1 -- 172.21.15.2:0/300323326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d4103a00 msgr2=0x7fe0d4103e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.816+0000 7fe0da800640 1 --2- 172.21.15.2:0/300323326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d4103a00 0x7fe0d4103e80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009900 tx=0x7fe0c002a3f0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.817+0000 7fe0da800640 1 -- 172.21.15.2:0/300323326 shutdown_connections 2024-06-13T02:23:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.817+0000 7fe0da800640 1 --2- 172.21.15.2:0/300323326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0d41043c0 0x7fe0d41108d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.817+0000 7fe0da800640 1 --2- 172.21.15.2:0/300323326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d4103a00 0x7fe0d4103e80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.817+0000 7fe0da800640 1 --2- 172.21.15.2:0/300323326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d4109a10 0x7fe0d4109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.817+0000 7fe0da800640 1 -- 172.21.15.2:0/300323326 >> 172.21.15.2:0/300323326 conn(0x7fe0d40ff4b0 msgr2=0x7fe0d41018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.817+0000 7fe0da800640 1 -- 172.21.15.2:0/300323326 shutdown_connections 2024-06-13T02:23:14.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.817+0000 7fe0da800640 1 -- 172.21.15.2:0/300323326 wait complete. 2024-06-13T02:23:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.818+0000 7fe0da800640 1 Processor -- start 2024-06-13T02:23:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.818+0000 7fe0da800640 1 -- start start 2024-06-13T02:23:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.818+0000 7fe0da800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0d4103a00 0x7fe0d419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.818+0000 7fe0da800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d41043c0 0x7fe0d419a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.818+0000 7fe0da800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d4109a10 0x7fe0d419ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.818+0000 7fe0da800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d4113e70 con 0x7fe0d4103a00 2024-06-13T02:23:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.818+0000 7fe0da800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d4113cf0 con 0x7fe0d4109a10 2024-06-13T02:23:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.818+0000 7fe0da800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d4113ff0 con 0x7fe0d41043c0 2024-06-13T02:23:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.819+0000 7fe0d9400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0d4103a00 0x7fe0d419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.819+0000 7fe0d9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d4109a10 0x7fe0d419ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.819+0000 7fe0d8a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d41043c0 0x7fe0d419a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.819+0000 7fe0d9400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0d4103a00 0x7fe0d419a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41550/0 (socket says 172.21.15.2:41550) 2024-06-13T02:23:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.819+0000 7fe0d9400640 1 -- 172.21.15.2:0/4281445367 learned_addr learned my addr 172.21.15.2:0/4281445367 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.819+0000 7fe0d9e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d4109a10 0x7fe0d419ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:41842/0 (socket says 172.21.15.2:41842) 2024-06-13T02:23:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.819+0000 7fe0d9e00640 1 -- 172.21.15.2:0/4281445367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d41043c0 msgr2=0x7fe0d419a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.819+0000 7fe0d9e00640 1 --2- 172.21.15.2:0/4281445367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d41043c0 0x7fe0d419a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.819+0000 7fe0d9e00640 1 -- 172.21.15.2:0/4281445367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0d4103a00 msgr2=0x7fe0d419a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.819+0000 7fe0d9e00640 1 --2- 172.21.15.2:0/4281445367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0d4103a00 0x7fe0d419a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.819+0000 7fe0d9e00640 1 -- 172.21.15.2:0/4281445367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d419f300 con 0x7fe0d4109a10 2024-06-13T02:23:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.819+0000 7fe0d9400640 1 --2- 172.21.15.2:0/4281445367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0d4103a00 0x7fe0d419a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:23:14.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.820+0000 7fe0d9e00640 1 --2- 172.21.15.2:0/4281445367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d4109a10 0x7fe0d419ebd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00da10 tx=0x7fe0cc00ded0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:14.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.820+0000 7fe0d2000640 1 -- 172.21.15.2:0/4281445367 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc00bd70 con 0x7fe0d4109a10 2024-06-13T02:23:14.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.820+0000 7fe0da800640 1 -- 172.21.15.2:0/4281445367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d419f5f0 con 0x7fe0d4109a10 2024-06-13T02:23:14.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.820+0000 7fe0d2000640 1 -- 172.21.15.2:0/4281445367 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0cc003e50 con 0x7fe0d4109a10 2024-06-13T02:23:14.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.820+0000 7fe0d2000640 1 -- 172.21.15.2:0/4281445367 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0106a0 con 0x7fe0d4109a10 2024-06-13T02:23:14.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.820+0000 7fe0da800640 1 -- 172.21.15.2:0/4281445367 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d41a6e80 con 0x7fe0d4109a10 2024-06-13T02:23:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.825+0000 7fe0debfe740 1 Processor -- start 2024-06-13T02:23:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.825+0000 7fe0d2000640 1 -- 172.21.15.2:0/4281445367 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fe0cc003970 con 0x7fe0d4109a10 2024-06-13T02:23:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.825+0000 7fe0debfe740 1 -- start start 2024-06-13T02:23:14.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.825+0000 7fe0debfe740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef8bfb0 0x55ecfef8a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.825+0000 7fe0debfe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8aa40 0x55ecfef8aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.825+0000 7fe0debfe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef957c0 0x55ecfef97bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.825+0000 7fe0debfe740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ecfeee6420 con 0x55ecfef8bfb0 2024-06-13T02:23:14.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.825+0000 7fe0debfe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ecfee8dc50 con 0x55ecfef8aa40 2024-06-13T02:23:14.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.825+0000 7fe0debfe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ecfeee23e0 con 0x55ecfef957c0 2024-06-13T02:23:14.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.826+0000 7fe0d9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8aa40 0x55ecfef8aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.826+0000 7fe0d8a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef8bfb0 0x55ecfef8a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.826+0000 7fe0d9400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8aa40 0x55ecfef8aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:41846/0 (socket says 172.21.15.2:41846) 2024-06-13T02:23:14.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.826+0000 7fe0d9400640 1 -- 172.21.15.2:0/3892043628 learned_addr learned my addr 172.21.15.2:0/3892043628 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:14.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.826+0000 7fe0d8a00640 1 --2- 172.21.15.2:0/3892043628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef957c0 0x55ecfef97bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.826+0000 7fe0d9400640 1 -- 172.21.15.2:0/3892043628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef957c0 msgr2=0x55ecfef97bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:14.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.826+0000 7fe0d9400640 1 --2- 172.21.15.2:0/3892043628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef957c0 0x55ecfef97bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.826+0000 7fe0d9400640 1 -- 172.21.15.2:0/3892043628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef8bfb0 msgr2=0x55ecfef8a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:14.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.826+0000 7fe0d9400640 1 --2- 172.21.15.2:0/3892043628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef8bfb0 0x55ecfef8a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.826+0000 7fe0d9400640 1 -- 172.21.15.2:0/3892043628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfebfa210 con 0x55ecfef8aa40 2024-06-13T02:23:14.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.827+0000 7fe0d9400640 1 --2- 172.21.15.2:0/3892043628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8aa40 0x55ecfef8aec0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40115f0 tx=0x7fe0c4011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f3eda4951df6982 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:14.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.827+0000 7fe0ca600640 1 -- 172.21.15.2:0/3892043628 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c401e070 con 0x55ecfef8aa40 2024-06-13T02:23:14.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.827+0000 7fe0ca600640 1 -- 172.21.15.2:0/3892043628 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0c400fb40 con 0x55ecfef8aa40 2024-06-13T02:23:14.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.827+0000 7fe0ca600640 1 -- 172.21.15.2:0/3892043628 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4019c20 con 0x55ecfef8aa40 2024-06-13T02:23:14.831 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.827+0000 7fe0d2000640 1 --2- 172.21.15.2:0/4281445367 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fe0b80a2ce0 0x7fe0b80a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.827+0000 7fe0d2000640 1 -- 172.21.15.2:0/4281445367 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9495+0+0 (secure 0 0 0) 0x7fe0cc0cfc30 con 0x7fe0d4109a10 2024-06-13T02:23:14.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.827+0000 7fe0d8a00640 1 --2- 172.21.15.2:0/4281445367 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fe0b80a2ce0 0x7fe0b80a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.828+0000 7fe0debfe740 1 -- 172.21.15.2:0/3892043628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8aa40 msgr2=0x55ecfef8aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:14.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.828+0000 7fe0debfe740 1 --2- 172.21.15.2:0/3892043628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8aa40 0x55ecfef8aec0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40115f0 tx=0x7fe0c4011ab0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.828+0000 7fe0debfe740 1 -- 172.21.15.2:0/3892043628 shutdown_connections 2024-06-13T02:23:14.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.828+0000 7fe0debfe740 1 --2- 172.21.15.2:0/3892043628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef957c0 0x55ecfef97bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.828+0000 7fe0debfe740 1 --2- 172.21.15.2:0/3892043628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8aa40 0x55ecfef8aec0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.828+0000 7fe0debfe740 1 --2- 172.21.15.2:0/3892043628 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef8bfb0 0x55ecfef8a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.828+0000 7fe0debfe740 1 -- 172.21.15.2:0/3892043628 >> 172.21.15.2:0/3892043628 conn(0x55ecfef4afb0 msgr2=0x55ecfef87030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:14.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.828+0000 7fe0d8a00640 1 --2- 172.21.15.2:0/4281445367 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fe0b80a2ce0 0x7fe0b80a51a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0000c00 tx=0x7fe0c0041040 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:14.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.828+0000 7fe0debfe740 1 -- 172.21.15.2:0/3892043628 shutdown_connections 2024-06-13T02:23:14.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.828+0000 7fe0debfe740 1 -- 172.21.15.2:0/3892043628 wait complete. 2024-06-13T02:23:14.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.829+0000 7fe0debfe740 1 -- start start 2024-06-13T02:23:14.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.829+0000 7fe0debfe740 1 Processor -- start 2024-06-13T02:23:14.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.829+0000 7fe0debfe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef8aa40 0x55ecfef92770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.829+0000 7fe0debfe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 0x55ecfef92cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.829+0000 7fe0debfe740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef957c0 0x55ecfef931f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.829+0000 7fe0debfe740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ecfef98590 con 0x55ecfef957c0 2024-06-13T02:23:14.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.829+0000 7fe0debfe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ecfeea10b0 con 0x55ecfef8bfb0 2024-06-13T02:23:14.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.829+0000 7fe0debfe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ecfef98710 con 0x55ecfef8aa40 2024-06-13T02:23:14.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.829+0000 7fe0debfe740 10 client.0 _ll_register_callbacks cb 0x55ecfee8cf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:23:14.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.830+0000 7fe0d9400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef8aa40 0x55ecfef92770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.830+0000 7fe0d8a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 0x55ecfef92cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.830+0000 7fe0d9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef957c0 0x55ecfef931f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.830+0000 7fe0d9400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef8aa40 0x55ecfef92770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:47294/0 (socket says 172.21.15.2:47294) 2024-06-13T02:23:14.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.830+0000 7fe0d9400640 1 -- 172.21.15.2:0/1046304443 learned_addr learned my addr 172.21.15.2:0/1046304443 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:14.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.830+0000 7fe0d9400640 1 -- 172.21.15.2:0/1046304443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 msgr2=0x55ecfef92cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:14.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.830+0000 7fe0d9400640 1 --2- 172.21.15.2:0/1046304443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 0x55ecfef92cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.830+0000 7fe0d9400640 1 -- 172.21.15.2:0/1046304443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef957c0 msgr2=0x55ecfef931f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:14.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.830+0000 7fe0d9400640 1 --2- 172.21.15.2:0/1046304443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef957c0 0x55ecfef931f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.830+0000 7fe0d9400640 1 -- 172.21.15.2:0/1046304443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecfecc6620 con 0x55ecfef8aa40 2024-06-13T02:23:14.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.830+0000 7fe0d9e00640 1 --2- 172.21.15.2:0/1046304443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef957c0 0x55ecfef931f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:23:14.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.830+0000 7fe0d9400640 1 --2- 172.21.15.2:0/1046304443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef8aa40 0x55ecfef92770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400ff20 tx=0x7fe0c400ff50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d1542a40940f7f4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:14.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.830+0000 7fe0bea00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:23:14.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.831+0000 7fe0bea00640 1 -- 172.21.15.2:0/1046304443 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c401e040 con 0x55ecfef8aa40 2024-06-13T02:23:14.834 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.831+0000 7fe0bea00640 1 -- 172.21.15.2:0/1046304443 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9495+0+0 (secure 0 0 0) 0x7fe0c400f6e0 con 0x55ecfef8aa40 2024-06-13T02:23:14.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.831+0000 7fe0debfe740 1 -- 172.21.15.2:0/1046304443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0c400fb40 con 0x55ecfef8aa40 2024-06-13T02:23:14.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.831+0000 7fe0bea00640 1 -- 172.21.15.2:0/1046304443 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe0c402c050 con 0x55ecfef8aa40 2024-06-13T02:23:14.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.831+0000 7fe0debfe740 10 client.25672 fetch_fsmap learned FSMap version 33 2024-06-13T02:23:14.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.831+0000 7fe0debfe740 1 -- 172.21.15.2:0/1046304443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ecfefa4890 con 0x55ecfef8aa40 2024-06-13T02:23:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.831+0000 7fe0bea00640 1 -- 172.21.15.2:0/1046304443 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0c400fb40 con 0x55ecfef8aa40 2024-06-13T02:23:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.831+0000 7fe0bea00640 1 -- 172.21.15.2:0/1046304443 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fe0c4021020 con 0x55ecfef8aa40 2024-06-13T02:23:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.832+0000 7fe0debfe740 10 client.25672 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:23:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.832+0000 7fe0debfe740 10 client.25672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:23:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.832+0000 7fe0debfe740 20 client.25672 populate_metadata read hostname 'smithi002' 2024-06-13T02:23:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.832+0000 7fe0debfe740 1 --2- 172.21.15.2:0/1046304443 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ecfefa5c40 0x55ecfefa8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.832+0000 7fe0debfe740 4 client.25672 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:23:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.832+0000 7fe0debfe740 1 -- 172.21.15.2:0/1046304443 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecfeef3b50 con 0x55ecfefa5c40 2024-06-13T02:23:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.832+0000 7fe0d8a00640 1 --2- 172.21.15.2:0/1046304443 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ecfefa5c40 0x55ecfefa8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.832+0000 7fe0d8a00640 1 --2- 172.21.15.2:0/1046304443 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ecfefa5c40 0x55ecfefa8030 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2462f82f29d8f84 server_cookie=b57b2925fbab1e54 in_seq=0 out_seq=0 2024-06-13T02:23:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.832+0000 7fe0bea00640 10 client.25672 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:14.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.835+0000 7fe0bea00640 1 -- 172.21.15.2:0/1046304443 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ecfeef3b50 con 0x55ecfefa5c40 2024-06-13T02:23:14.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.835+0000 7fe0bea00640 10 client.25672 handle_command_reply: tid=0 2024-06-13T02:23:14.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.836+0000 7fe0debfe740 1 client.25672 shutdown 2024-06-13T02:23:14.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.836+0000 7fe0debfe740 1 -- 172.21.15.2:0/1046304443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef8aa40 msgr2=0x55ecfef92770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:14.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.836+0000 7fe0debfe740 1 --2- 172.21.15.2:0/1046304443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef8aa40 0x55ecfef92770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400ff20 tx=0x7fe0c400ff50 comp rx=0 tx=0).stop 2024-06-13T02:23:14.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.836+0000 7fe0debfe740 1 -- 172.21.15.2:0/1046304443 shutdown_connections 2024-06-13T02:23:14.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.836+0000 7fe0debfe740 1 --2- 172.21.15.2:0/1046304443 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ecfefa5c40 0x55ecfefa8030 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.836+0000 7fe0debfe740 1 --2- 172.21.15.2:0/1046304443 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef957c0 0x55ecfef931f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.836+0000 7fe0debfe740 1 --2- 172.21.15.2:0/1046304443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 0x55ecfef92cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.836+0000 7fe0debfe740 1 --2- 172.21.15.2:0/1046304443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef8aa40 0x55ecfef92770 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.836+0000 7fe0bea00640 0 client.25672 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:14.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.836+0000 7fe0debfe740 1 -- 172.21.15.2:0/1046304443 >> 172.21.15.2:0/1046304443 conn(0x55ecfef4afb0 msgr2=0x55ecfef8ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:14.838 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.836+0000 7fe0debfe740 1 -- 172.21.15.2:0/1046304443 shutdown_connections 2024-06-13T02:23:14.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.836+0000 7fe0debfe740 1 -- 172.21.15.2:0/1046304443 wait complete. 2024-06-13T02:23:14.839 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.836+0000 7fe0debfe740 20 client.25672 trim_cache size 0 max 16384 2024-06-13T02:23:14.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.857+0000 7fe0debfe740 1 Processor -- start 2024-06-13T02:23:14.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.857+0000 7fe0debfe740 1 -- start start 2024-06-13T02:23:14.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.857+0000 7fe0debfe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef8aa40 0x55ecfef97850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.858 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.857+0000 7fe0debfe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 0x55ecfef91040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.857+0000 7fe0debfe740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef957c0 0x55ecfef91580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.857+0000 7fe0debfe740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d41af570 con 0x55ecfef957c0 2024-06-13T02:23:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.857+0000 7fe0debfe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d41ace40 con 0x55ecfef8bfb0 2024-06-13T02:23:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.857+0000 7fe0debfe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d41aac90 con 0x55ecfef8aa40 2024-06-13T02:23:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.858+0000 7fe0d9400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef8aa40 0x55ecfef97850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.858+0000 7fe0d9400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef8aa40 0x55ecfef97850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:47296/0 (socket says 172.21.15.2:47296) 2024-06-13T02:23:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.858+0000 7fe0d9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef957c0 0x55ecfef91580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.858+0000 7fe0d9400640 1 -- 172.21.15.2:0/405091162 learned_addr learned my addr 172.21.15.2:0/405091162 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:14.859 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.858+0000 7fe0d8a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 0x55ecfef91040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.858+0000 7fe0d9400640 1 -- 172.21.15.2:0/405091162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 msgr2=0x55ecfef91040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.858+0000 7fe0d9400640 1 --2- 172.21.15.2:0/405091162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 0x55ecfef91040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.858+0000 7fe0d9400640 1 -- 172.21.15.2:0/405091162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef957c0 msgr2=0x55ecfef91580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.858+0000 7fe0d9400640 1 --2- 172.21.15.2:0/405091162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef957c0 0x55ecfef91580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.858+0000 7fe0d9400640 1 -- 172.21.15.2:0/405091162 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfef8e330 con 0x55ecfef8aa40 2024-06-13T02:23:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.858+0000 7fe0d8a00640 1 --2- 172.21.15.2:0/405091162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 0x55ecfef91040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:23:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.858+0000 7fe0d9400640 1 --2- 172.21.15.2:0/405091162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef8aa40 0x55ecfef97850 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40115f0 tx=0x7fe0c4005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d4a9644e27687b5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.859+0000 7fe0c9c00640 1 -- 172.21.15.2:0/405091162 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4015020 con 0x55ecfef8aa40 2024-06-13T02:23:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.859+0000 7fe0c9c00640 1 -- 172.21.15.2:0/405091162 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0c400f660 con 0x55ecfef8aa40 2024-06-13T02:23:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.859+0000 7fe0c9c00640 1 -- 172.21.15.2:0/405091162 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c401e040 con 0x55ecfef8aa40 2024-06-13T02:23:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.859+0000 7fe0debfe740 1 -- 172.21.15.2:0/405091162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef8aa40 msgr2=0x55ecfef97850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.859+0000 7fe0debfe740 1 --2- 172.21.15.2:0/405091162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef8aa40 0x55ecfef97850 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40115f0 tx=0x7fe0c4005970 comp rx=0 tx=0).stop 2024-06-13T02:23:14.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.859+0000 7fe0debfe740 1 -- 172.21.15.2:0/405091162 shutdown_connections 2024-06-13T02:23:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.859+0000 7fe0debfe740 1 --2- 172.21.15.2:0/405091162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef957c0 0x55ecfef91580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.859+0000 7fe0debfe740 1 --2- 172.21.15.2:0/405091162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 0x55ecfef91040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.859+0000 7fe0debfe740 1 --2- 172.21.15.2:0/405091162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef8aa40 0x55ecfef97850 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.859+0000 7fe0debfe740 1 -- 172.21.15.2:0/405091162 >> 172.21.15.2:0/405091162 conn(0x55ecfef4afb0 msgr2=0x55ecfef86a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.860+0000 7fe0debfe740 1 -- 172.21.15.2:0/405091162 shutdown_connections 2024-06-13T02:23:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.860+0000 7fe0debfe740 1 -- 172.21.15.2:0/405091162 wait complete. 2024-06-13T02:23:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.860+0000 7fe0debfe740 1 -- start start 2024-06-13T02:23:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.860+0000 7fe0debfe740 1 Processor -- start 2024-06-13T02:23:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0debfe740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef8aa40 0x55ecfef8e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0debfe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 0x55ecfef8ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0debfe740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef957c0 0x55ecfef8f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0debfe740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d41ab300 con 0x55ecfef8aa40 2024-06-13T02:23:14.863 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0debfe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d41ac770 con 0x55ecfef8bfb0 2024-06-13T02:23:14.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0debfe740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d41ab9d0 con 0x55ecfef957c0 2024-06-13T02:23:14.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0debfe740 10 client.0 _ll_register_callbacks cb 0x7fe0c401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:23:14.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0d9400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef8aa40 0x55ecfef8e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0d8a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 0x55ecfef8ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0d9400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef8aa40 0x55ecfef8e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:41570/0 (socket says 172.21.15.2:41570) 2024-06-13T02:23:14.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0d8a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 0x55ecfef8ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:41870/0 (socket says 172.21.15.2:41870) 2024-06-13T02:23:14.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0d9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef957c0 0x55ecfef8f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0d9400640 1 -- 172.21.15.2:0/3817633359 learned_addr learned my addr 172.21.15.2:0/3817633359 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:14.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0d8a00640 1 -- 172.21.15.2:0/3817633359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef957c0 msgr2=0x55ecfef8f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:14.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0d8a00640 1 --2- 172.21.15.2:0/3817633359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef957c0 0x55ecfef8f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0d8a00640 1 -- 172.21.15.2:0/3817633359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef8aa40 msgr2=0x55ecfef8e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:14.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0d8a00640 1 --2- 172.21.15.2:0/3817633359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef8aa40 0x55ecfef8e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:14.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0d8a00640 1 -- 172.21.15.2:0/3817633359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecfef9c970 con 0x55ecfef8bfb0 2024-06-13T02:23:14.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0d9e00640 1 --2- 172.21.15.2:0/3817633359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef957c0 0x55ecfef8f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:23:14.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.861+0000 7fe0d9400640 1 --2- 172.21.15.2:0/3817633359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef8aa40 0x55ecfef8e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:23:14.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.862+0000 7fe0d8a00640 1 --2- 172.21.15.2:0/3817633359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 0x55ecfef8ef20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe0c002a9e0 tx=0x7fe0c0005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a93d72d7dd8a753a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:14.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.862+0000 7fe0bea00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:23:14.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.862+0000 7fe0bea00640 1 -- 172.21.15.2:0/3817633359 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0035040 con 0x55ecfef8bfb0 2024-06-13T02:23:14.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.862+0000 7fe0debfe740 1 -- 172.21.15.2:0/3817633359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0c400f660 con 0x55ecfef8bfb0 2024-06-13T02:23:14.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.862+0000 7fe0bea00640 1 -- 172.21.15.2:0/3817633359 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9495+0+0 (secure 0 0 0) 0x7fe0c0003cd0 con 0x55ecfef8bfb0 2024-06-13T02:23:14.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.862+0000 7fe0bea00640 1 -- 172.21.15.2:0/3817633359 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe0c0062050 con 0x55ecfef8bfb0 2024-06-13T02:23:14.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.862+0000 7fe0debfe740 10 client.25694 fetch_fsmap learned FSMap version 33 2024-06-13T02:23:14.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.862+0000 7fe0debfe740 1 -- 172.21.15.2:0/3817633359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ecfef9dc80 con 0x55ecfef8bfb0 2024-06-13T02:23:14.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.863+0000 7fe0bea00640 1 -- 172.21.15.2:0/3817633359 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0c400f660 con 0x55ecfef8bfb0 2024-06-13T02:23:14.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.863+0000 7fe0bea00640 1 -- 172.21.15.2:0/3817633359 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fe0c4019410 con 0x55ecfef8bfb0 2024-06-13T02:23:14.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.863+0000 7fe0debfe740 10 client.25694 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:23:14.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.863+0000 7fe0debfe740 10 client.25694 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:23:14.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.863+0000 7fe0debfe740 20 client.25694 populate_metadata read hostname 'smithi002' 2024-06-13T02:23:14.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.863+0000 7fe0debfe740 1 --2- 172.21.15.2:0/3817633359 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ecfef9e3c0 0x55ecff012700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:14.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.863+0000 7fe0debfe740 4 client.25694 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:23:14.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.863+0000 7fe0debfe740 1 -- 172.21.15.2:0/3817633359 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ecfeeedea0 con 0x55ecfef9e3c0 2024-06-13T02:23:14.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.863+0000 7fe0d9400640 1 --2- 172.21.15.2:0/3817633359 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ecfef9e3c0 0x55ecff012700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:14.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.864+0000 7fe0d9400640 1 --2- 172.21.15.2:0/3817633359 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ecfef9e3c0 0x55ecff012700 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2e6b8754718372a server_cookie=8b34e69c4f4ed76d in_seq=0 out_seq=0 2024-06-13T02:23:14.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:14.864+0000 7fe0bea00640 10 client.25694 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:15.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.086+0000 7fe0bea00640 1 -- 172.21.15.2:0/3817633359 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55ecfeeedea0 con 0x55ecfef9e3c0 2024-06-13T02:23:15.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.086+0000 7fe0bea00640 10 client.25694 handle_command_reply: tid=0 2024-06-13T02:23:15.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.086+0000 7fe0debfe740 1 client.25694 shutdown 2024-06-13T02:23:15.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.086+0000 7fe0debfe740 1 -- 172.21.15.2:0/3817633359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 msgr2=0x55ecfef8ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:15.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.086+0000 7fe0debfe740 1 --2- 172.21.15.2:0/3817633359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 0x55ecfef8ef20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe0c002a9e0 tx=0x7fe0c0005b50 comp rx=0 tx=0).stop 2024-06-13T02:23:15.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.086+0000 7fe0debfe740 1 -- 172.21.15.2:0/3817633359 shutdown_connections 2024-06-13T02:23:15.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.086+0000 7fe0debfe740 1 --2- 172.21.15.2:0/3817633359 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ecfef9e3c0 0x55ecff012700 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.086+0000 7fe0debfe740 1 --2- 172.21.15.2:0/3817633359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ecfef957c0 0x55ecfef8f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.086+0000 7fe0debfe740 1 --2- 172.21.15.2:0/3817633359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ecfef8bfb0 0x55ecfef8ef20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.086+0000 7fe0bea00640 0 client.25694 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.086+0000 7fe0debfe740 1 --2- 172.21.15.2:0/3817633359 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ecfef8aa40 0x55ecfef8e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.086+0000 7fe0debfe740 1 -- 172.21.15.2:0/3817633359 >> 172.21.15.2:0/3817633359 conn(0x55ecfef4afb0 msgr2=0x55ecfef90fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.086+0000 7fe0debfe740 1 -- 172.21.15.2:0/3817633359 shutdown_connections 2024-06-13T02:23:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.086+0000 7fe0debfe740 1 -- 172.21.15.2:0/3817633359 wait complete. 2024-06-13T02:23:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.087+0000 7fe0debfe740 20 client.25694 trim_cache size 0 max 16384 2024-06-13T02:23:15.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:23:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:23:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:23:15.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.087+0000 7fe0da800640 1 -- 172.21.15.2:0/4281445367 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fe0b80a2ce0 msgr2=0x7fe0b80a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.087+0000 7fe0da800640 1 --2- 172.21.15.2:0/4281445367 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fe0b80a2ce0 0x7fe0b80a51a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0000c00 tx=0x7fe0c0041040 comp rx=0 tx=0).stop 2024-06-13T02:23:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.087+0000 7fe0da800640 1 -- 172.21.15.2:0/4281445367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d4109a10 msgr2=0x7fe0d419ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.087+0000 7fe0da800640 1 --2- 172.21.15.2:0/4281445367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d4109a10 0x7fe0d419ebd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00da10 tx=0x7fe0cc00ded0 comp rx=0 tx=0).stop 2024-06-13T02:23:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.088+0000 7fe0da800640 1 -- 172.21.15.2:0/4281445367 shutdown_connections 2024-06-13T02:23:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.088+0000 7fe0da800640 1 --2- 172.21.15.2:0/4281445367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0d4109a10 0x7fe0d419ebd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.088+0000 7fe0da800640 1 --2- 172.21.15.2:0/4281445367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d41043c0 0x7fe0d419a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.088+0000 7fe0da800640 1 --2- 172.21.15.2:0/4281445367 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fe0b80a2ce0 0x7fe0b80a51a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.088+0000 7fe0da800640 1 --2- 172.21.15.2:0/4281445367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe0d4103a00 0x7fe0d419a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.088+0000 7fe0da800640 1 -- 172.21.15.2:0/4281445367 >> 172.21.15.2:0/4281445367 conn(0x7fe0d40ff4b0 msgr2=0x7fe0d40ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.088+0000 7fe0da800640 1 -- 172.21.15.2:0/4281445367 shutdown_connections 2024-06-13T02:23:15.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:15.088+0000 7fe0da800640 1 -- 172.21.15.2:0/4281445367 wait complete. 2024-06-13T02:23:15.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:15 smithi084 ceph-mon[36833]: pgmap v167: 129 pgs: 129 active+clean; 58 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 238 op/s 2024-06-13T02:23:15.506 INFO:tasks.workunit.client.0.smithi002.stdout: 1 387007 8.21 MB/sec execute 139 sec latency 104.594 ms 2024-06-13T02:23:15.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:15 smithi175 ceph-mon[36977]: pgmap v167: 129 pgs: 129 active+clean; 58 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 238 op/s 2024-06-13T02:23:15.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:15 smithi002 ceph-mon[31960]: pgmap v167: 129 pgs: 129 active+clean; 58 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 238 op/s 2024-06-13T02:23:16.507 INFO:tasks.workunit.client.0.smithi002.stdout: 1 388295 8.19 MB/sec execute 140 sec latency 11.966 ms 2024-06-13T02:23:17.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:17 smithi084 ceph-mon[36833]: pgmap v168: 129 pgs: 129 active+clean; 53 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 435 op/s 2024-06-13T02:23:17.507 INFO:tasks.workunit.client.0.smithi002.stdout: 1 390379 8.22 MB/sec execute 141 sec latency 21.142 ms 2024-06-13T02:23:17.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:17 smithi175 ceph-mon[36977]: pgmap v168: 129 pgs: 129 active+clean; 53 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 435 op/s 2024-06-13T02:23:17.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:17 smithi002 ceph-mon[31960]: pgmap v168: 129 pgs: 129 active+clean; 53 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.6 MiB/s wr, 435 op/s 2024-06-13T02:23:18.507 INFO:tasks.workunit.client.0.smithi002.stdout: 1 391212 8.18 MB/sec execute 142 sec latency 69.974 ms 2024-06-13T02:23:19.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:19 smithi084 ceph-mon[36833]: pgmap v169: 129 pgs: 129 active+clean; 53 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 281 op/s 2024-06-13T02:23:19.507 INFO:tasks.workunit.client.0.smithi002.stdout: 1 393138 8.21 MB/sec execute 143 sec latency 25.721 ms 2024-06-13T02:23:19.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:19 smithi175 ceph-mon[36977]: pgmap v169: 129 pgs: 129 active+clean; 53 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 281 op/s 2024-06-13T02:23:19.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:19 smithi002 ceph-mon[31960]: pgmap v169: 129 pgs: 129 active+clean; 53 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 281 op/s 2024-06-13T02:23:20.507 INFO:tasks.workunit.client.0.smithi002.stdout: 1 394443 8.20 MB/sec execute 144 sec latency 14.970 ms 2024-06-13T02:23:21.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:21 smithi084 ceph-mon[36833]: pgmap v170: 129 pgs: 129 active+clean; 53 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 281 op/s 2024-06-13T02:23:21.507 INFO:tasks.workunit.client.0.smithi002.stdout: 1 396145 8.19 MB/sec execute 145 sec latency 12.698 ms 2024-06-13T02:23:21.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:21 smithi175 ceph-mon[36977]: pgmap v170: 129 pgs: 129 active+clean; 53 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 281 op/s 2024-06-13T02:23:21.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:21 smithi002 ceph-mon[31960]: pgmap v170: 129 pgs: 129 active+clean; 53 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 281 op/s 2024-06-13T02:23:22.507 INFO:tasks.workunit.client.0.smithi002.stdout: 1 397613 8.21 MB/sec execute 146 sec latency 21.646 ms 2024-06-13T02:23:23.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:23 smithi084 ceph-mon[36833]: pgmap v171: 129 pgs: 129 active+clean; 58 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 363 op/s 2024-06-13T02:23:23.507 INFO:tasks.workunit.client.0.smithi002.stdout: 1 398464 8.17 MB/sec execute 147 sec latency 93.183 ms 2024-06-13T02:23:23.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:23 smithi175 ceph-mon[36977]: pgmap v171: 129 pgs: 129 active+clean; 58 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 363 op/s 2024-06-13T02:23:23.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:23 smithi002 ceph-mon[31960]: pgmap v171: 129 pgs: 129 active+clean; 58 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 363 op/s 2024-06-13T02:23:24.507 INFO:tasks.workunit.client.0.smithi002.stdout: 1 400319 8.19 MB/sec execute 148 sec latency 22.759 ms 2024-06-13T02:23:25.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:25 smithi084 ceph-mon[36833]: pgmap v172: 129 pgs: 129 active+clean; 58 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 278 op/s 2024-06-13T02:23:25.508 INFO:tasks.workunit.client.0.smithi002.stdout: 1 401464 8.18 MB/sec execute 149 sec latency 33.605 ms 2024-06-13T02:23:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:25 smithi175 ceph-mon[36977]: pgmap v172: 129 pgs: 129 active+clean; 58 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 278 op/s 2024-06-13T02:23:25.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:25 smithi002 ceph-mon[31960]: pgmap v172: 129 pgs: 129 active+clean; 58 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 278 op/s 2024-06-13T02:23:26.508 INFO:tasks.workunit.client.0.smithi002.stdout: 1 402720 8.16 MB/sec execute 150 sec latency 22.539 ms 2024-06-13T02:23:27.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:27 smithi084 ceph-mon[36833]: pgmap v173: 129 pgs: 129 active+clean; 62 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 354 op/s 2024-06-13T02:23:27.508 INFO:tasks.workunit.client.0.smithi002.stdout: 1 404672 8.19 MB/sec execute 151 sec latency 14.272 ms 2024-06-13T02:23:27.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:27 smithi175 ceph-mon[36977]: pgmap v173: 129 pgs: 129 active+clean; 62 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 354 op/s 2024-06-13T02:23:27.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:27 smithi002 ceph-mon[31960]: pgmap v173: 129 pgs: 129 active+clean; 62 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 354 op/s 2024-06-13T02:23:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.251+0000 7fc17e000640 1 -- 172.21.15.2:0/1475135744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1781017c0 msgr2=0x7fc178101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.251+0000 7fc17e000640 1 --2- 172.21.15.2:0/1475135744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1781017c0 0x7fc178101c40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc164009900 tx=0x7fc16402a410 comp rx=0 tx=0).stop 2024-06-13T02:23:28.253 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.251+0000 7fc17e000640 1 -- 172.21.15.2:0/1475135744 shutdown_connections 2024-06-13T02:23:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.251+0000 7fc17e000640 1 --2- 172.21.15.2:0/1475135744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc178102180 0x7fc17810e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.251+0000 7fc17e000640 1 --2- 172.21.15.2:0/1475135744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1781017c0 0x7fc178101c40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.251+0000 7fc17e000640 1 --2- 172.21.15.2:0/1475135744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1781077d0 0x7fc178107bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.251+0000 7fc17e000640 1 -- 172.21.15.2:0/1475135744 >> 172.21.15.2:0/1475135744 conn(0x7fc1780fd2b0 msgr2=0x7fc1780ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.251+0000 7fc17e000640 1 -- 172.21.15.2:0/1475135744 shutdown_connections 2024-06-13T02:23:28.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.252+0000 7fc17e000640 1 -- 172.21.15.2:0/1475135744 wait complete. 2024-06-13T02:23:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.253+0000 7fc17e000640 1 Processor -- start 2024-06-13T02:23:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.253+0000 7fc17e000640 1 -- start start 2024-06-13T02:23:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.253+0000 7fc17e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1781017c0 0x7fc17810d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.253+0000 7fc17e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc178102180 0x7fc17810ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.253+0000 7fc17e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1781077d0 0x7fc1781a2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.253+0000 7fc17e000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc178111c30 con 0x7fc1781017c0 2024-06-13T02:23:28.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.253+0000 7fc17e000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc178111ab0 con 0x7fc1781077d0 2024-06-13T02:23:28.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.253+0000 7fc17e000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc178111db0 con 0x7fc178102180 2024-06-13T02:23:28.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.253+0000 7fc17cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1781017c0 0x7fc17810d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.254+0000 7fc177e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc178102180 0x7fc17810ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.254+0000 7fc17d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1781077d0 0x7fc1781a2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.254+0000 7fc17cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1781017c0 0x7fc17810d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35014/0 (socket says 172.21.15.2:35014) 2024-06-13T02:23:28.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.254+0000 7fc17cc00640 1 -- 172.21.15.2:0/4170888817 learned_addr learned my addr 172.21.15.2:0/4170888817 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:28.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.254+0000 7fc177e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc178102180 0x7fc17810ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:45584/0 (socket says 172.21.15.2:45584) 2024-06-13T02:23:28.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.254+0000 7fc177e00640 1 -- 172.21.15.2:0/4170888817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1781077d0 msgr2=0x7fc1781a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:28.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.254+0000 7fc177e00640 1 --2- 172.21.15.2:0/4170888817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1781077d0 0x7fc1781a2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.254+0000 7fc177e00640 1 -- 172.21.15.2:0/4170888817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1781017c0 msgr2=0x7fc17810d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:28.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.254+0000 7fc177e00640 1 --2- 172.21.15.2:0/4170888817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1781017c0 0x7fc17810d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.254+0000 7fc177e00640 1 -- 172.21.15.2:0/4170888817 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1781a3660 con 0x7fc178102180 2024-06-13T02:23:28.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.254+0000 7fc17cc00640 1 --2- 172.21.15.2:0/4170888817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1781017c0 0x7fc17810d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:23:28.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.254+0000 7fc177e00640 1 --2- 172.21.15.2:0/4170888817 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc178102180 0x7fc17810ded0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc16402a930 tx=0x7fc164003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:28.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.255+0000 7fc175600640 1 -- 172.21.15.2:0/4170888817 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16403f070 con 0x7fc178102180 2024-06-13T02:23:28.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.255+0000 7fc175600640 1 -- 172.21.15.2:0/4170888817 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc164031c20 con 0x7fc178102180 2024-06-13T02:23:28.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.255+0000 7fc175600640 1 -- 172.21.15.2:0/4170888817 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164035030 con 0x7fc178102180 2024-06-13T02:23:28.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.255+0000 7fc17e000640 1 -- 172.21.15.2:0/4170888817 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1781a38f0 con 0x7fc178102180 2024-06-13T02:23:28.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.255+0000 7fc17e000640 1 -- 172.21.15.2:0/4170888817 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1781ab1e0 con 0x7fc178102180 2024-06-13T02:23:28.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.258+0000 7fc175600640 1 -- 172.21.15.2:0/4170888817 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fc164042070 con 0x7fc178102180 2024-06-13T02:23:28.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.259+0000 7fc182376740 1 Processor -- start 2024-06-13T02:23:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.259+0000 7fc182376740 1 -- start start 2024-06-13T02:23:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.259+0000 7fc182376740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d993c7a0 0x5595d993acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.259+0000 7fc182376740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993b230 0x5595d993b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.259+0000 7fc182376740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d9945fb0 0x5595d99483a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.259+0000 7fc182376740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5595d989f420 con 0x5595d9945fb0 2024-06-13T02:23:28.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.259+0000 7fc182376740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5595d9846c50 con 0x5595d993b230 2024-06-13T02:23:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.259+0000 7fc182376740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5595d989b3e0 con 0x5595d993c7a0 2024-06-13T02:23:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.259+0000 7fc17cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993b230 0x5595d993b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.260+0000 7fc17d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d993c7a0 0x5595d993acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.260+0000 7fc17cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993b230 0x5595d993b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:40616/0 (socket says 172.21.15.2:40616) 2024-06-13T02:23:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.260+0000 7fc17cc00640 1 -- 172.21.15.2:0/932203424 learned_addr learned my addr 172.21.15.2:0/932203424 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.260+0000 7fc175600640 1 --2- 172.21.15.2:0/4170888817 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc1600a2ce0 0x7fc1600a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.262 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.260+0000 7fc177e00640 1 --2- 172.21.15.2:0/932203424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d9945fb0 0x5595d99483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.263 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.260+0000 7fc17cc00640 1 -- 172.21.15.2:0/932203424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d993c7a0 msgr2=0x5595d993acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.260+0000 7fc17cc00640 1 --2- 172.21.15.2:0/932203424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d993c7a0 0x5595d993acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.260+0000 7fc17cc00640 1 -- 172.21.15.2:0/932203424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d9945fb0 msgr2=0x5595d99483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.260+0000 7fc17cc00640 1 --2- 172.21.15.2:0/932203424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d9945fb0 0x5595d99483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.260+0000 7fc17cc00640 1 -- 172.21.15.2:0/932203424 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d95b3210 con 0x5595d993b230 2024-06-13T02:23:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.260+0000 7fc175600640 1 -- 172.21.15.2:0/4170888817 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9495+0+0 (secure 0 0 0) 0x7fc1640eff20 con 0x7fc178102180 2024-06-13T02:23:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.260+0000 7fc177e00640 1 --2- 172.21.15.2:0/932203424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d9945fb0 0x5595d99483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:23:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.260+0000 7fc17d600640 1 --2- 172.21.15.2:0/4170888817 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc1600a2ce0 0x7fc1600a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.260+0000 7fc17cc00640 1 --2- 172.21.15.2:0/932203424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993b230 0x5595d993b6b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc16c011620 tx=0x7fc16c011ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d620deaab7754a90 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.261+0000 7fc169c00640 1 -- 172.21.15.2:0/932203424 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c01e070 con 0x5595d993b230 2024-06-13T02:23:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.261+0000 7fc169c00640 1 -- 172.21.15.2:0/932203424 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc16c00fbd0 con 0x5595d993b230 2024-06-13T02:23:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.261+0000 7fc169c00640 1 -- 172.21.15.2:0/932203424 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c019d00 con 0x5595d993b230 2024-06-13T02:23:28.264 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.262+0000 7fc182376740 1 -- 172.21.15.2:0/932203424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993b230 msgr2=0x5595d993b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.262+0000 7fc182376740 1 --2- 172.21.15.2:0/932203424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993b230 0x5595d993b6b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc16c011620 tx=0x7fc16c011ae0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.262+0000 7fc17d600640 1 --2- 172.21.15.2:0/4170888817 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc1600a2ce0 0x7fc1600a51a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1700098b0 tx=0x7fc170004a40 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.262+0000 7fc182376740 1 -- 172.21.15.2:0/932203424 shutdown_connections 2024-06-13T02:23:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.262+0000 7fc182376740 1 --2- 172.21.15.2:0/932203424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d9945fb0 0x5595d99483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.262+0000 7fc182376740 1 --2- 172.21.15.2:0/932203424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993b230 0x5595d993b6b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.262+0000 7fc182376740 1 --2- 172.21.15.2:0/932203424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d993c7a0 0x5595d993acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.262+0000 7fc182376740 1 -- 172.21.15.2:0/932203424 >> 172.21.15.2:0/932203424 conn(0x5595d9903fb0 msgr2=0x5595d9937820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.262+0000 7fc182376740 1 -- 172.21.15.2:0/932203424 shutdown_connections 2024-06-13T02:23:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.262+0000 7fc182376740 1 -- 172.21.15.2:0/932203424 wait complete. 2024-06-13T02:23:28.265 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.262+0000 7fc182376740 1 -- start start 2024-06-13T02:23:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.263+0000 7fc182376740 1 Processor -- start 2024-06-13T02:23:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.263+0000 7fc182376740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d993b230 0x5595d9942f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.263+0000 7fc182376740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993c7a0 0x5595d99434c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.263+0000 7fc182376740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d9945fb0 0x5595d9943a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.263+0000 7fc182376740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5595d9948d80 con 0x5595d993b230 2024-06-13T02:23:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.263+0000 7fc182376740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5595d985a0b0 con 0x5595d993c7a0 2024-06-13T02:23:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.263+0000 7fc182376740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5595d9948f00 con 0x5595d9945fb0 2024-06-13T02:23:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.263+0000 7fc182376740 10 client.0 _ll_register_callbacks cb 0x5595d9845f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:23:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.263+0000 7fc177e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993c7a0 0x5595d99434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.263+0000 7fc17cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d993b230 0x5595d9942f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.263+0000 7fc17d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d9945fb0 0x5595d9943a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.263+0000 7fc177e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993c7a0 0x5595d99434c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:40628/0 (socket says 172.21.15.2:40628) 2024-06-13T02:23:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.263+0000 7fc177e00640 1 -- 172.21.15.2:0/1546110879 learned_addr learned my addr 172.21.15.2:0/1546110879 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.264+0000 7fc177e00640 1 -- 172.21.15.2:0/1546110879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d9945fb0 msgr2=0x5595d9943a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.264+0000 7fc177e00640 1 --2- 172.21.15.2:0/1546110879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d9945fb0 0x5595d9943a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.264+0000 7fc177e00640 1 -- 172.21.15.2:0/1546110879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d993b230 msgr2=0x5595d9942f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.264+0000 7fc177e00640 1 --2- 172.21.15.2:0/1546110879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d993b230 0x5595d9942f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.264+0000 7fc177e00640 1 -- 172.21.15.2:0/1546110879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d967f620 con 0x5595d993c7a0 2024-06-13T02:23:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.264+0000 7fc177e00640 1 --2- 172.21.15.2:0/1546110879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993c7a0 0x5595d99434c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc164009900 tx=0x7fc164005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a12cbfdc7d364d3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.264+0000 7fc15e000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:23:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.264+0000 7fc15e000640 1 -- 172.21.15.2:0/1546110879 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164049030 con 0x5595d993c7a0 2024-06-13T02:23:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.264+0000 7fc15e000640 1 -- 172.21.15.2:0/1546110879 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9495+0+0 (secure 0 0 0) 0x7fc1640b8730 con 0x5595d993c7a0 2024-06-13T02:23:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.264+0000 7fc182376740 1 -- 172.21.15.2:0/1546110879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc16c00fbd0 con 0x5595d993c7a0 2024-06-13T02:23:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.265+0000 7fc15e000640 1 -- 172.21.15.2:0/1546110879 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc1640bc0c0 con 0x5595d993c7a0 2024-06-13T02:23:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.265+0000 7fc182376740 10 client.25706 fetch_fsmap learned FSMap version 33 2024-06-13T02:23:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.265+0000 7fc182376740 1 -- 172.21.15.2:0/1546110879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5595d99550b0 con 0x5595d993c7a0 2024-06-13T02:23:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.265+0000 7fc15e000640 1 -- 172.21.15.2:0/1546110879 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc16c00fbd0 con 0x5595d993c7a0 2024-06-13T02:23:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.265+0000 7fc15e000640 1 -- 172.21.15.2:0/1546110879 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fc1640bc320 con 0x5595d993c7a0 2024-06-13T02:23:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.265+0000 7fc182376740 10 client.25706 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:23:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.265+0000 7fc182376740 10 client.25706 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:23:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.265+0000 7fc182376740 20 client.25706 populate_metadata read hostname 'smithi002' 2024-06-13T02:23:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.265+0000 7fc182376740 1 --2- 172.21.15.2:0/1546110879 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5595d99565b0 0x5595d9958a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.265+0000 7fc182376740 4 client.25706 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:23:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.265+0000 7fc182376740 1 -- 172.21.15.2:0/1546110879 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595d98acb50 con 0x5595d99565b0 2024-06-13T02:23:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.265+0000 7fc17cc00640 1 --2- 172.21.15.2:0/1546110879 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5595d99565b0 0x5595d9958a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.266+0000 7fc17cc00640 1 --2- 172.21.15.2:0/1546110879 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5595d99565b0 0x5595d9958a30 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e5281bc9c3eaf65 server_cookie=9ffe95c3863d0651 in_seq=0 out_seq=0 2024-06-13T02:23:28.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.266+0000 7fc15e000640 10 client.25706 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.267+0000 7fc15e000640 1 -- 172.21.15.2:0/1546110879 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5595d98acb50 con 0x5595d99565b0 2024-06-13T02:23:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.267+0000 7fc15e000640 10 client.25706 handle_command_reply: tid=0 2024-06-13T02:23:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.267+0000 7fc182376740 1 client.25706 shutdown 2024-06-13T02:23:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.267+0000 7fc182376740 1 -- 172.21.15.2:0/1546110879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993c7a0 msgr2=0x5595d99434c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.267+0000 7fc182376740 1 --2- 172.21.15.2:0/1546110879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993c7a0 0x5595d99434c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc164009900 tx=0x7fc164005de0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.267+0000 7fc182376740 1 -- 172.21.15.2:0/1546110879 shutdown_connections 2024-06-13T02:23:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.267+0000 7fc182376740 1 --2- 172.21.15.2:0/1546110879 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5595d99565b0 0x5595d9958a30 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.267+0000 7fc182376740 1 --2- 172.21.15.2:0/1546110879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d9945fb0 0x5595d9943a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.267+0000 7fc182376740 1 --2- 172.21.15.2:0/1546110879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993c7a0 0x5595d99434c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.267+0000 7fc182376740 1 --2- 172.21.15.2:0/1546110879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d993b230 0x5595d9942f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.267+0000 7fc182376740 1 -- 172.21.15.2:0/1546110879 >> 172.21.15.2:0/1546110879 conn(0x5595d9903fb0 msgr2=0x5595d993d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.267+0000 7fc15e000640 0 client.25706 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.268+0000 7fc182376740 1 -- 172.21.15.2:0/1546110879 shutdown_connections 2024-06-13T02:23:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.268+0000 7fc182376740 1 -- 172.21.15.2:0/1546110879 wait complete. 2024-06-13T02:23:28.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.268+0000 7fc182376740 20 client.25706 trim_cache size 0 max 16384 2024-06-13T02:23:28.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.289+0000 7fc182376740 1 Processor -- start 2024-06-13T02:23:28.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.289+0000 7fc182376740 1 -- start start 2024-06-13T02:23:28.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.289+0000 7fc182376740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d993b230 0x5595d99378d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.289+0000 7fc182376740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d993c7a0 0x5595d995e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.289+0000 7fc182376740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d9945fb0 0x5595d995e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.289+0000 7fc182376740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1781b7b90 con 0x5595d993c7a0 2024-06-13T02:23:28.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.289+0000 7fc182376740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc1781b5460 con 0x5595d9945fb0 2024-06-13T02:23:28.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.289+0000 7fc182376740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1781b32b0 con 0x5595d993b230 2024-06-13T02:23:28.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.289+0000 7fc17d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d9945fb0 0x5595d995e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.289+0000 7fc17d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d9945fb0 0x5595d995e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:40644/0 (socket says 172.21.15.2:40644) 2024-06-13T02:23:28.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.290+0000 7fc17d600640 1 -- 172.21.15.2:0/783467301 learned_addr learned my addr 172.21.15.2:0/783467301 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:28.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.290+0000 7fc17cc00640 1 --2- 172.21.15.2:0/783467301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d993b230 0x5595d99378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.290+0000 7fc177e00640 1 --2- 172.21.15.2:0/783467301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d993c7a0 0x5595d995e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.290+0000 7fc17d600640 1 -- 172.21.15.2:0/783467301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d993b230 msgr2=0x5595d99378d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:28.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.290+0000 7fc17d600640 1 --2- 172.21.15.2:0/783467301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d993b230 0x5595d99378d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.290+0000 7fc17d600640 1 -- 172.21.15.2:0/783467301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d993c7a0 msgr2=0x5595d995e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.290+0000 7fc17d600640 1 --2- 172.21.15.2:0/783467301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d993c7a0 0x5595d995e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.290+0000 7fc17d600640 1 -- 172.21.15.2:0/783467301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d9931db0 con 0x5595d9945fb0 2024-06-13T02:23:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.290+0000 7fc17cc00640 1 --2- 172.21.15.2:0/783467301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d993b230 0x5595d99378d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:23:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.290+0000 7fc17d600640 1 --2- 172.21.15.2:0/783467301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d9945fb0 0x5595d995e880 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc170013960 tx=0x7fc170015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f60f229a5f18deb1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.291+0000 7fc169200640 1 -- 172.21.15.2:0/783467301 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17001f950 con 0x5595d9945fb0 2024-06-13T02:23:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.291+0000 7fc169200640 1 -- 172.21.15.2:0/783467301 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc170017070 con 0x5595d9945fb0 2024-06-13T02:23:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.291+0000 7fc169200640 1 -- 172.21.15.2:0/783467301 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17001e450 con 0x5595d9945fb0 2024-06-13T02:23:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.291+0000 7fc182376740 1 -- 172.21.15.2:0/783467301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d9945fb0 msgr2=0x5595d995e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.291+0000 7fc182376740 1 --2- 172.21.15.2:0/783467301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d9945fb0 0x5595d995e880 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc170013960 tx=0x7fc170015000 comp rx=0 tx=0).stop 2024-06-13T02:23:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.292+0000 7fc182376740 1 -- 172.21.15.2:0/783467301 shutdown_connections 2024-06-13T02:23:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.292+0000 7fc182376740 1 --2- 172.21.15.2:0/783467301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d9945fb0 0x5595d995e880 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.292+0000 7fc182376740 1 --2- 172.21.15.2:0/783467301 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d993c7a0 0x5595d995e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.292+0000 7fc182376740 1 --2- 172.21.15.2:0/783467301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d993b230 0x5595d99378d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.292+0000 7fc182376740 1 -- 172.21.15.2:0/783467301 >> 172.21.15.2:0/783467301 conn(0x5595d9903fb0 msgr2=0x5595d99371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.292+0000 7fc182376740 1 -- 172.21.15.2:0/783467301 shutdown_connections 2024-06-13T02:23:28.295 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.292+0000 7fc182376740 1 -- 172.21.15.2:0/783467301 wait complete. 2024-06-13T02:23:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.292+0000 7fc182376740 1 -- start start 2024-06-13T02:23:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.293+0000 7fc182376740 1 Processor -- start 2024-06-13T02:23:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.293+0000 7fc182376740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d993b230 0x5595d994e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.293+0000 7fc182376740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993c7a0 0x5595d994e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.293+0000 7fc182376740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d9945fb0 0x5595d993f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.293+0000 7fc182376740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc1781b3920 con 0x5595d993b230 2024-06-13T02:23:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.293+0000 7fc182376740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc1781b4d90 con 0x5595d993c7a0 2024-06-13T02:23:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.293+0000 7fc182376740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1781b3ff0 con 0x5595d9945fb0 2024-06-13T02:23:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.293+0000 7fc182376740 10 client.0 _ll_register_callbacks cb 0x7fc164005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:23:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.293+0000 7fc177e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993c7a0 0x5595d994e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.293+0000 7fc17cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d993b230 0x5595d994e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.293+0000 7fc177e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993c7a0 0x5595d994e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:40660/0 (socket says 172.21.15.2:40660) 2024-06-13T02:23:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.293+0000 7fc17d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d9945fb0 0x5595d993f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.293+0000 7fc177e00640 1 -- 172.21.15.2:0/1290487746 learned_addr learned my addr 172.21.15.2:0/1290487746 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.294+0000 7fc177e00640 1 -- 172.21.15.2:0/1290487746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d9945fb0 msgr2=0x5595d993f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.294+0000 7fc177e00640 1 --2- 172.21.15.2:0/1290487746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d9945fb0 0x5595d993f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.294+0000 7fc177e00640 1 -- 172.21.15.2:0/1290487746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d993b230 msgr2=0x5595d994e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.294+0000 7fc177e00640 1 --2- 172.21.15.2:0/1290487746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d993b230 0x5595d994e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.294+0000 7fc177e00640 1 -- 172.21.15.2:0/1290487746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d993fb60 con 0x5595d993c7a0 2024-06-13T02:23:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.294+0000 7fc177e00640 1 --2- 172.21.15.2:0/1290487746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993c7a0 0x5595d994e6d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc1640bc050 tx=0x7fc1640bbac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15c061653b736fce server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.294+0000 7fc15e000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:23:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.294+0000 7fc15e000640 1 -- 172.21.15.2:0/1290487746 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1640d4030 con 0x5595d993c7a0 2024-06-13T02:23:28.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.294+0000 7fc15e000640 1 -- 172.21.15.2:0/1290487746 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9495+0+0 (secure 0 0 0) 0x7fc1640bb590 con 0x5595d993c7a0 2024-06-13T02:23:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.294+0000 7fc182376740 1 -- 172.21.15.2:0/1290487746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc170017070 con 0x5595d993c7a0 2024-06-13T02:23:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.294+0000 7fc15e000640 1 -- 172.21.15.2:0/1290487746 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc164049070 con 0x5595d993c7a0 2024-06-13T02:23:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.294+0000 7fc182376740 10 client.25712 fetch_fsmap learned FSMap version 33 2024-06-13T02:23:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.295+0000 7fc182376740 1 -- 172.21.15.2:0/1290487746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5595d99c0ac0 con 0x5595d993c7a0 2024-06-13T02:23:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.295+0000 7fc15e000640 1 -- 172.21.15.2:0/1290487746 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc170017070 con 0x5595d993c7a0 2024-06-13T02:23:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.295+0000 7fc15e000640 1 -- 172.21.15.2:0/1290487746 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7fc1640d8030 con 0x5595d993c7a0 2024-06-13T02:23:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.295+0000 7fc182376740 10 client.25712 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:23:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.295+0000 7fc182376740 10 client.25712 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:23:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.295+0000 7fc182376740 20 client.25712 populate_metadata read hostname 'smithi002' 2024-06-13T02:23:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.295+0000 7fc182376740 1 --2- 172.21.15.2:0/1290487746 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5595d99c1100 0x5595d99c3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.295+0000 7fc182376740 4 client.25712 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:23:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.295+0000 7fc182376740 1 -- 172.21.15.2:0/1290487746 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5595d98a6ea0 con 0x5595d99c1100 2024-06-13T02:23:28.299 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.295+0000 7fc17cc00640 1 --2- 172.21.15.2:0/1290487746 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5595d99c1100 0x5595d99c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:28.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.296+0000 7fc17cc00640 1 --2- 172.21.15.2:0/1290487746 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5595d99c1100 0x5595d99c3520 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2a80e830403eee7 server_cookie=45f006770ab211bc in_seq=0 out_seq=0 2024-06-13T02:23:28.300 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.296+0000 7fc15e000640 10 client.25712 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:28.509 INFO:tasks.workunit.client.0.smithi002.stdout: 1 405473 8.15 MB/sec execute 152 sec latency 209.584 ms 2024-06-13T02:23:28.583 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.582+0000 7fc15e000640 1 -- 172.21.15.2:0/1290487746 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5595d98a6ea0 con 0x5595d99c1100 2024-06-13T02:23:28.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.582+0000 7fc15e000640 10 client.25712 handle_command_reply: tid=0 2024-06-13T02:23:28.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.582+0000 7fc182376740 1 client.25712 shutdown 2024-06-13T02:23:28.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.582+0000 7fc182376740 1 -- 172.21.15.2:0/1290487746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993c7a0 msgr2=0x5595d994e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:28.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.582+0000 7fc182376740 1 --2- 172.21.15.2:0/1290487746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993c7a0 0x5595d994e6d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc1640bc050 tx=0x7fc1640bbac0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.582+0000 7fc182376740 1 -- 172.21.15.2:0/1290487746 shutdown_connections 2024-06-13T02:23:28.585 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.582+0000 7fc182376740 1 --2- 172.21.15.2:0/1290487746 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5595d99c1100 0x5595d99c3520 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.585 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.582+0000 7fc182376740 1 --2- 172.21.15.2:0/1290487746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5595d9945fb0 0x5595d993f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.585 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.582+0000 7fc182376740 1 --2- 172.21.15.2:0/1290487746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5595d993c7a0 0x5595d994e6d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.585 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.582+0000 7fc182376740 1 --2- 172.21.15.2:0/1290487746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5595d993b230 0x5595d994e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.585 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.582+0000 7fc15e000640 0 client.25712 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:28.585 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.582+0000 7fc182376740 1 -- 172.21.15.2:0/1290487746 >> 172.21.15.2:0/1290487746 conn(0x5595d9903fb0 msgr2=0x5595d993cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:28.585 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.583+0000 7fc182376740 1 -- 172.21.15.2:0/1290487746 shutdown_connections 2024-06-13T02:23:28.585 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.583+0000 7fc182376740 1 -- 172.21.15.2:0/1290487746 wait complete. 2024-06-13T02:23:28.585 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.583+0000 7fc182376740 20 client.25712 trim_cache size 0 max 16384 2024-06-13T02:23:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:23:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:23:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:23:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.584+0000 7fc17e000640 1 -- 172.21.15.2:0/4170888817 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc1600a2ce0 msgr2=0x7fc1600a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:28.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.584+0000 7fc17e000640 1 --2- 172.21.15.2:0/4170888817 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc1600a2ce0 0x7fc1600a51a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc1700098b0 tx=0x7fc170004a40 comp rx=0 tx=0).stop 2024-06-13T02:23:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.584+0000 7fc17e000640 1 -- 172.21.15.2:0/4170888817 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc178102180 msgr2=0x7fc17810ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.584+0000 7fc17e000640 1 --2- 172.21.15.2:0/4170888817 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc178102180 0x7fc17810ded0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc16402a930 tx=0x7fc164003b90 comp rx=0 tx=0).stop 2024-06-13T02:23:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.584+0000 7fc17e000640 1 -- 172.21.15.2:0/4170888817 shutdown_connections 2024-06-13T02:23:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.584+0000 7fc17e000640 1 --2- 172.21.15.2:0/4170888817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1781077d0 0x7fc1781a2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.584+0000 7fc17e000640 1 --2- 172.21.15.2:0/4170888817 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc178102180 0x7fc17810ded0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.584+0000 7fc17e000640 1 --2- 172.21.15.2:0/4170888817 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc1600a2ce0 0x7fc1600a51a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.584+0000 7fc17e000640 1 --2- 172.21.15.2:0/4170888817 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1781017c0 0x7fc17810d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.584+0000 7fc17e000640 1 -- 172.21.15.2:0/4170888817 >> 172.21.15.2:0/4170888817 conn(0x7fc1780fd2b0 msgr2=0x7fc1780fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.585+0000 7fc17e000640 1 -- 172.21.15.2:0/4170888817 shutdown_connections 2024-06-13T02:23:28.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:28.585+0000 7fc17e000640 1 -- 172.21.15.2:0/4170888817 wait complete. 2024-06-13T02:23:29.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:29 smithi084 ceph-mon[36833]: pgmap v174: 129 pgs: 129 active+clean; 62 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 157 op/s 2024-06-13T02:23:29.510 INFO:tasks.workunit.client.0.smithi002.stdout: 1 407167 8.16 MB/sec execute 153 sec latency 276.951 ms 2024-06-13T02:23:29.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:29 smithi175 ceph-mon[36977]: pgmap v174: 129 pgs: 129 active+clean; 62 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 157 op/s 2024-06-13T02:23:29.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:29 smithi002 ceph-mon[31960]: pgmap v174: 129 pgs: 129 active+clean; 62 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 157 op/s 2024-06-13T02:23:30.510 INFO:tasks.workunit.client.0.smithi002.stdout: 1 408524 8.16 MB/sec execute 154 sec latency 12.958 ms 2024-06-13T02:23:31.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:31 smithi084 ceph-mon[36833]: pgmap v175: 129 pgs: 129 active+clean; 62 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 157 op/s 2024-06-13T02:23:31.510 INFO:tasks.workunit.client.0.smithi002.stdout: 1 410040 8.14 MB/sec execute 155 sec latency 14.446 ms 2024-06-13T02:23:31.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:31 smithi175 ceph-mon[36977]: pgmap v175: 129 pgs: 129 active+clean; 62 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 157 op/s 2024-06-13T02:23:31.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:31 smithi002 ceph-mon[31960]: pgmap v175: 129 pgs: 129 active+clean; 62 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 157 op/s 2024-06-13T02:23:32.510 INFO:tasks.workunit.client.0.smithi002.stdout: 1 411892 8.18 MB/sec execute 156 sec latency 17.104 ms 2024-06-13T02:23:33.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:33 smithi084 ceph-mon[36833]: pgmap v176: 129 pgs: 129 active+clean; 55 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 359 op/s 2024-06-13T02:23:33.510 INFO:tasks.workunit.client.0.smithi002.stdout: 1 413386 8.16 MB/sec execute 157 sec latency 14.619 ms 2024-06-13T02:23:33.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:33 smithi175 ceph-mon[36977]: pgmap v176: 129 pgs: 129 active+clean; 55 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 359 op/s 2024-06-13T02:23:33.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:33 smithi002 ceph-mon[31960]: pgmap v176: 129 pgs: 129 active+clean; 55 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 359 op/s 2024-06-13T02:23:34.511 INFO:tasks.workunit.client.0.smithi002.stdout: 1 415412 8.19 MB/sec execute 158 sec latency 18.855 ms 2024-06-13T02:23:34.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:34 smithi175 ceph-mon[36977]: pgmap v177: 129 pgs: 129 active+clean; 55 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 2.1 MiB/s wr, 278 op/s 2024-06-13T02:23:34.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:34 smithi002 ceph-mon[31960]: pgmap v177: 129 pgs: 129 active+clean; 55 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 2.1 MiB/s wr, 278 op/s 2024-06-13T02:23:34.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:34 smithi084 ceph-mon[36833]: pgmap v177: 129 pgs: 129 active+clean; 55 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 2.1 MiB/s wr, 278 op/s 2024-06-13T02:23:35.511 INFO:tasks.workunit.client.0.smithi002.stdout: 1 416744 8.18 MB/sec execute 159 sec latency 16.838 ms 2024-06-13T02:23:36.511 INFO:tasks.workunit.client.0.smithi002.stdout: 1 418955 8.21 MB/sec execute 160 sec latency 10.310 ms 2024-06-13T02:23:37.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:36 smithi002 ceph-mon[31960]: pgmap v178: 129 pgs: 129 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 354 op/s 2024-06-13T02:23:37.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:36 smithi084 ceph-mon[36833]: pgmap v178: 129 pgs: 129 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 354 op/s 2024-06-13T02:23:37.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:36 smithi175 ceph-mon[36977]: pgmap v178: 129 pgs: 129 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 354 op/s 2024-06-13T02:23:37.511 INFO:tasks.workunit.client.0.smithi002.stdout: 1 420221 8.19 MB/sec execute 161 sec latency 13.697 ms 2024-06-13T02:23:38.511 INFO:tasks.workunit.client.0.smithi002.stdout: 1 422503 8.23 MB/sec execute 162 sec latency 12.022 ms 2024-06-13T02:23:39.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:38 smithi002 ceph-mon[31960]: pgmap v179: 129 pgs: 129 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 278 op/s 2024-06-13T02:23:39.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:38 smithi084 ceph-mon[36833]: pgmap v179: 129 pgs: 129 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 278 op/s 2024-06-13T02:23:39.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:38 smithi175 ceph-mon[36977]: pgmap v179: 129 pgs: 129 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 278 op/s 2024-06-13T02:23:39.511 INFO:tasks.workunit.client.0.smithi002.stdout: 1 423567 8.21 MB/sec execute 163 sec latency 42.169 ms 2024-06-13T02:23:40.511 INFO:tasks.workunit.client.0.smithi002.stdout: 1 425814 8.24 MB/sec execute 164 sec latency 13.647 ms 2024-06-13T02:23:41.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:40 smithi002 ceph-mon[31960]: pgmap v180: 129 pgs: 129 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 278 op/s 2024-06-13T02:23:41.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:40 smithi084 ceph-mon[36833]: pgmap v180: 129 pgs: 129 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 278 op/s 2024-06-13T02:23:41.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:40 smithi175 ceph-mon[36977]: pgmap v180: 129 pgs: 129 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 278 op/s 2024-06-13T02:23:41.511 INFO:tasks.workunit.client.0.smithi002.stdout: 1 426808 8.21 MB/sec execute 165 sec latency 15.578 ms 2024-06-13T02:23:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.734+0000 7f5fb7400640 1 -- 172.21.15.2:0/431489169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fb0103e30 msgr2=0x7f5fb0104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.734+0000 7f5fb7400640 1 --2- 172.21.15.2:0/431489169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fb0103e30 0x7f5fb0104210 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0009900 tx=0x7f5fa002a410 comp rx=0 tx=0).stop 2024-06-13T02:23:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.734+0000 7f5fb7400640 1 -- 172.21.15.2:0/431489169 shutdown_connections 2024-06-13T02:23:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.734+0000 7f5fb7400640 1 --2- 172.21.15.2:0/431489169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb0108f00 0x7f5fb0110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.734+0000 7f5fb7400640 1 --2- 172.21.15.2:0/431489169 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fb01047e0 0x7f5fb0108820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.734+0000 7f5fb7400640 1 --2- 172.21.15.2:0/431489169 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fb0103e30 0x7f5fb0104210 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.734+0000 7f5fb7400640 1 -- 172.21.15.2:0/431489169 >> 172.21.15.2:0/431489169 conn(0x7f5fb00ff650 msgr2=0x7f5fb0101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.734+0000 7f5fb7400640 1 -- 172.21.15.2:0/431489169 shutdown_connections 2024-06-13T02:23:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.735+0000 7f5fb7400640 1 -- 172.21.15.2:0/431489169 wait complete. 2024-06-13T02:23:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.736+0000 7f5fb7400640 1 Processor -- start 2024-06-13T02:23:41.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.736+0000 7f5fb7400640 1 -- start start 2024-06-13T02:23:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.736+0000 7f5fb7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fb0103e30 0x7f5fb019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.736+0000 7f5fb7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fb0108f00 0x7f5fb019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fb7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb019eda0 0x7f5fb019f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fb7400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb0114000 con 0x7f5fb0108f00 2024-06-13T02:23:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fb7400640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb0113e80 con 0x7f5fb0103e30 2024-06-13T02:23:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fb7400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb0114180 con 0x7f5fb019eda0 2024-06-13T02:23:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fb5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb019eda0 0x7f5fb019f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fb4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fb0103e30 0x7f5fb019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fb4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fb0103e30 0x7f5fb019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:52866/0 (socket says 172.21.15.2:52866) 2024-06-13T02:23:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fb5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb019eda0 0x7f5fb019f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:41418/0 (socket says 172.21.15.2:41418) 2024-06-13T02:23:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fb4a00640 1 -- 172.21.15.2:0/117470588 learned_addr learned my addr 172.21.15.2:0/117470588 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fa7e00640 1 --2- 172.21.15.2:0/117470588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fb0108f00 0x7f5fb019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fb4a00640 1 -- 172.21.15.2:0/117470588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb019eda0 msgr2=0x7f5fb019f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fb4a00640 1 --2- 172.21.15.2:0/117470588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb019eda0 0x7f5fb019f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fb4a00640 1 -- 172.21.15.2:0/117470588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fb0108f00 msgr2=0x7f5fb019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fb4a00640 1 --2- 172.21.15.2:0/117470588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fb0108f00 0x7f5fb019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fb4a00640 1 -- 172.21.15.2:0/117470588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb019f890 con 0x7f5fb0103e30 2024-06-13T02:23:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.737+0000 7f5fa7e00640 1 --2- 172.21.15.2:0/117470588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fb0108f00 0x7f5fb019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:23:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.738+0000 7f5fb4a00640 1 --2- 172.21.15.2:0/117470588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fb0103e30 0x7f5fb019a4e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0004770 tx=0x7f5fa0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.738+0000 7f5fae000640 1 -- 172.21.15.2:0/117470588 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa003f070 con 0x7f5fb0103e30 2024-06-13T02:23:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.738+0000 7f5fae000640 1 -- 172.21.15.2:0/117470588 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fa0031ca0 con 0x7f5fb0103e30 2024-06-13T02:23:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.738+0000 7f5fb7400640 1 -- 172.21.15.2:0/117470588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb019fb20 con 0x7f5fb0103e30 2024-06-13T02:23:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.738+0000 7f5fae000640 1 -- 172.21.15.2:0/117470588 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0035030 con 0x7f5fb0103e30 2024-06-13T02:23:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.738+0000 7f5fb7400640 1 -- 172.21.15.2:0/117470588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb01a7340 con 0x7f5fb0103e30 2024-06-13T02:23:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.741+0000 7f5fae000640 1 -- 172.21.15.2:0/117470588 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f5fa0042070 con 0x7f5fb0103e30 2024-06-13T02:23:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.742+0000 7f5fba369740 1 Processor -- start 2024-06-13T02:23:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.742+0000 7f5fba369740 1 -- start start 2024-06-13T02:23:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.742+0000 7f5fba369740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e961615e0 0x561e9615fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.742+0000 7f5fba369740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e96160070 0x561e961604f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.742+0000 7f5fba369740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e9616adf0 0x561e9616d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.742+0000 7f5fba369740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561e960c4420 con 0x561e96160070 2024-06-13T02:23:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.742+0000 7f5fba369740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561e9606bc50 con 0x561e9616adf0 2024-06-13T02:23:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.742+0000 7f5fba369740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561e960c03e0 con 0x561e961615e0 2024-06-13T02:23:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.743+0000 7f5fb5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e961615e0 0x561e9615fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.743+0000 7f5fb5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e961615e0 0x561e9615fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:41422/0 (socket says 172.21.15.2:41422) 2024-06-13T02:23:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.743+0000 7f5fb5400640 1 -- 172.21.15.2:0/3949460068 learned_addr learned my addr 172.21.15.2:0/3949460068 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.743+0000 7f5fa7e00640 1 --2- 172.21.15.2:0/3949460068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e9616adf0 0x561e9616d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.743+0000 7f5fb4a00640 1 --2- 172.21.15.2:0/3949460068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e96160070 0x561e961604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.743+0000 7f5fb5400640 1 -- 172.21.15.2:0/3949460068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e9616adf0 msgr2=0x561e9616d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.743+0000 7f5fb5400640 1 --2- 172.21.15.2:0/3949460068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e9616adf0 0x561e9616d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.743+0000 7f5fb5400640 1 -- 172.21.15.2:0/3949460068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e96160070 msgr2=0x561e961604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.743+0000 7f5fb5400640 1 --2- 172.21.15.2:0/3949460068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e96160070 0x561e961604f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.743+0000 7f5fb5400640 1 -- 172.21.15.2:0/3949460068 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e95dd8210 con 0x561e961615e0 2024-06-13T02:23:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.743+0000 7f5fae000640 1 --2- 172.21.15.2:0/117470588 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5f940a2d70 0x7f5f940a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.743+0000 7f5fb5400640 1 --2- 172.21.15.2:0/3949460068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e961615e0 0x561e9615fb30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009fa0 tx=0x7f5fa8010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90ef36fbce4b390e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.744+0000 7f5fae000640 1 -- 172.21.15.2:0/117470588 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9495+0+0 (secure 0 0 0) 0x7f5fa00effa0 con 0x7f5fb0103e30 2024-06-13T02:23:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.744+0000 7f5fa5c00640 1 -- 172.21.15.2:0/3949460068 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8016070 con 0x561e961615e0 2024-06-13T02:23:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.744+0000 7f5fa5c00640 1 -- 172.21.15.2:0/3949460068 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fa8004d20 con 0x561e961615e0 2024-06-13T02:23:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.744+0000 7f5fa5c00640 1 -- 172.21.15.2:0/3949460068 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa80129b0 con 0x561e961615e0 2024-06-13T02:23:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.744+0000 7f5fb4a00640 1 --2- 172.21.15.2:0/117470588 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5f940a2d70 0x7f5f940a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.745+0000 7f5fba369740 1 -- 172.21.15.2:0/3949460068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e961615e0 msgr2=0x561e9615fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:41.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.745+0000 7f5fba369740 1 --2- 172.21.15.2:0/3949460068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e961615e0 0x561e9615fb30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009fa0 tx=0x7f5fa8010800 comp rx=0 tx=0).stop 2024-06-13T02:23:41.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.745+0000 7f5fb4a00640 1 --2- 172.21.15.2:0/117470588 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5f940a2d70 0x7f5f940a5230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x561e96162d40 tx=0x7f5fa0009560 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:41.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.745+0000 7f5fba369740 1 -- 172.21.15.2:0/3949460068 shutdown_connections 2024-06-13T02:23:41.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.745+0000 7f5fba369740 1 --2- 172.21.15.2:0/3949460068 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e9616adf0 0x561e9616d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.745+0000 7f5fba369740 1 --2- 172.21.15.2:0/3949460068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e96160070 0x561e961604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.745+0000 7f5fba369740 1 --2- 172.21.15.2:0/3949460068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e961615e0 0x561e9615fb30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.745+0000 7f5fba369740 1 -- 172.21.15.2:0/3949460068 >> 172.21.15.2:0/3949460068 conn(0x561e96128fb0 msgr2=0x561e9615c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.745+0000 7f5fba369740 1 -- 172.21.15.2:0/3949460068 shutdown_connections 2024-06-13T02:23:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.745+0000 7f5fba369740 1 -- 172.21.15.2:0/3949460068 wait complete. 2024-06-13T02:23:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.746+0000 7f5fba369740 1 -- start start 2024-06-13T02:23:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.746+0000 7f5fba369740 1 Processor -- start 2024-06-13T02:23:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.746+0000 7f5fba369740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e96160070 0x561e96167e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.746+0000 7f5fba369740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e961615e0 0x561e961683a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.746+0000 7f5fba369740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e9616adf0 0x561e961688e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.746+0000 7f5fba369740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561e9616dbc0 con 0x561e961615e0 2024-06-13T02:23:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.746+0000 7f5fba369740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561e9607f0b0 con 0x561e96160070 2024-06-13T02:23:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.746+0000 7f5fba369740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561e9616dd40 con 0x561e9616adf0 2024-06-13T02:23:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.747+0000 7f5fba369740 10 client.0 _ll_register_callbacks cb 0x561e9606af40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:23:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.747+0000 7f5fb5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e96160070 0x561e96167e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.747+0000 7f5fb5400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e96160070 0x561e96167e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:52888/0 (socket says 172.21.15.2:52888) 2024-06-13T02:23:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.747+0000 7f5fb5400640 1 -- 172.21.15.2:0/2480636854 learned_addr learned my addr 172.21.15.2:0/2480636854 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.747+0000 7f5fa7e00640 1 --2- 172.21.15.2:0/2480636854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e961615e0 0x561e961683a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.747+0000 7f5fb5400640 1 --2- 172.21.15.2:0/2480636854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e9616adf0 0x561e961688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.747+0000 7f5fb5400640 1 -- 172.21.15.2:0/2480636854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e9616adf0 msgr2=0x561e961688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.747+0000 7f5fb5400640 1 --2- 172.21.15.2:0/2480636854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e9616adf0 0x561e961688e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.747+0000 7f5fb5400640 1 -- 172.21.15.2:0/2480636854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e961615e0 msgr2=0x561e961683a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.747+0000 7f5fb5400640 1 --2- 172.21.15.2:0/2480636854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e961615e0 0x561e961683a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.747+0000 7f5fb5400640 1 -- 172.21.15.2:0/2480636854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e95ea4620 con 0x561e96160070 2024-06-13T02:23:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.747+0000 7f5fb5400640 1 --2- 172.21.15.2:0/2480636854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e96160070 0x561e96167e60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x561e96160bd0 tx=0x7f5fa8005910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b71a193f487be2c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.747+0000 7f5f9e000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:23:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.748+0000 7f5f9e000640 1 -- 172.21.15.2:0/2480636854 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8016030 con 0x561e96160070 2024-06-13T02:23:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.748+0000 7f5f9e000640 1 -- 172.21.15.2:0/2480636854 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9495+0+0 (secure 0 0 0) 0x7f5fa8022040 con 0x561e96160070 2024-06-13T02:23:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.748+0000 7f5fba369740 1 -- 172.21.15.2:0/2480636854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fa8004d20 con 0x561e96160070 2024-06-13T02:23:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.748+0000 7f5f9e000640 1 -- 172.21.15.2:0/2480636854 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5fa8012940 con 0x561e96160070 2024-06-13T02:23:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.748+0000 7f5fba369740 10 client.25724 fetch_fsmap learned FSMap version 33 2024-06-13T02:23:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.748+0000 7f5fba369740 1 -- 172.21.15.2:0/2480636854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561e96179fb0 con 0x561e96160070 2024-06-13T02:23:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.748+0000 7f5f9e000640 1 -- 172.21.15.2:0/2480636854 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fa8004d20 con 0x561e96160070 2024-06-13T02:23:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.749+0000 7f5f9e000640 1 -- 172.21.15.2:0/2480636854 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f5fa8025070 con 0x561e96160070 2024-06-13T02:23:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.749+0000 7f5fba369740 10 client.25724 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:23:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.749+0000 7f5fba369740 10 client.25724 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:23:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.749+0000 7f5fba369740 20 client.25724 populate_metadata read hostname 'smithi002' 2024-06-13T02:23:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.749+0000 7f5fba369740 1 --2- 172.21.15.2:0/2480636854 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561e9617b360 0x561e9617d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.749+0000 7f5fba369740 4 client.25724 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:23:41.755 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.749+0000 7f5fba369740 1 -- 172.21.15.2:0/2480636854 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e960d1b50 con 0x561e9617b360 2024-06-13T02:23:41.755 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.749+0000 7f5fa7e00640 1 --2- 172.21.15.2:0/2480636854 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561e9617b360 0x561e9617d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.750+0000 7f5fa7e00640 1 --2- 172.21.15.2:0/2480636854 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561e9617b360 0x561e9617d750 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=847cc265a38c7548 server_cookie=5eef76067a9ed95b in_seq=0 out_seq=0 2024-06-13T02:23:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.750+0000 7f5f9e000640 10 client.25724 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.751+0000 7f5f9e000640 1 -- 172.21.15.2:0/2480636854 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561e960d1b50 con 0x561e9617b360 2024-06-13T02:23:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.751+0000 7f5f9e000640 10 client.25724 handle_command_reply: tid=0 2024-06-13T02:23:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.751+0000 7f5fba369740 1 client.25724 shutdown 2024-06-13T02:23:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.751+0000 7f5fba369740 1 -- 172.21.15.2:0/2480636854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e96160070 msgr2=0x561e96167e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.751+0000 7f5fba369740 1 --2- 172.21.15.2:0/2480636854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e96160070 0x561e96167e60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x561e96160bd0 tx=0x7f5fa8005910 comp rx=0 tx=0).stop 2024-06-13T02:23:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.752+0000 7f5fba369740 1 -- 172.21.15.2:0/2480636854 shutdown_connections 2024-06-13T02:23:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.752+0000 7f5fba369740 1 --2- 172.21.15.2:0/2480636854 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561e9617b360 0x561e9617d750 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.752+0000 7f5fba369740 1 --2- 172.21.15.2:0/2480636854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e9616adf0 0x561e961688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.752+0000 7f5fba369740 1 --2- 172.21.15.2:0/2480636854 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e961615e0 0x561e961683a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.752+0000 7f5f9e000640 0 client.25724 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.752+0000 7f5fba369740 1 --2- 172.21.15.2:0/2480636854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e96160070 0x561e96167e60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.752+0000 7f5fba369740 1 -- 172.21.15.2:0/2480636854 >> 172.21.15.2:0/2480636854 conn(0x561e96128fb0 msgr2=0x561e961624d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.752+0000 7f5fba369740 1 -- 172.21.15.2:0/2480636854 shutdown_connections 2024-06-13T02:23:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.752+0000 7f5fba369740 1 -- 172.21.15.2:0/2480636854 wait complete. 2024-06-13T02:23:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.752+0000 7f5fba369740 20 client.25724 trim_cache size 0 max 16384 2024-06-13T02:23:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.772+0000 7f5fba369740 1 Processor -- start 2024-06-13T02:23:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.773+0000 7f5fba369740 1 -- start start 2024-06-13T02:23:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.773+0000 7f5fba369740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e96160070 0x561e96168700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.773+0000 7f5fba369740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e961615e0 0x561e96182d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.773+0000 7f5fba369740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e9616adf0 0x561e96183260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.773+0000 7f5fba369740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb01b3b00 con 0x561e961615e0 2024-06-13T02:23:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.773+0000 7f5fba369740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb01b13d0 con 0x561e9616adf0 2024-06-13T02:23:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.773+0000 7f5fba369740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb01af220 con 0x561e96160070 2024-06-13T02:23:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.773+0000 7f5fa7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e961615e0 0x561e96182d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.773+0000 7f5fa7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e961615e0 0x561e96182d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45966/0 (socket says 172.21.15.2:45966) 2024-06-13T02:23:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.773+0000 7f5fa7e00640 1 -- 172.21.15.2:0/2426855914 learned_addr learned my addr 172.21.15.2:0/2426855914 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.773+0000 7f5fb5400640 1 --2- 172.21.15.2:0/2426855914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e96160070 0x561e96168700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.773+0000 7f5fb5400640 1 --2- 172.21.15.2:0/2426855914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e9616adf0 0x561e96183260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.774+0000 7f5fa7e00640 1 -- 172.21.15.2:0/2426855914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e96160070 msgr2=0x561e96168700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.774+0000 7f5fa7e00640 1 --2- 172.21.15.2:0/2426855914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e96160070 0x561e96168700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.774+0000 7f5fa7e00640 1 -- 172.21.15.2:0/2426855914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e9616adf0 msgr2=0x561e96183260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.774+0000 7f5fa7e00640 1 --2- 172.21.15.2:0/2426855914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e9616adf0 0x561e96183260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.774+0000 7f5fa7e00640 1 -- 172.21.15.2:0/2426855914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e96176e90 con 0x561e961615e0 2024-06-13T02:23:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.774+0000 7f5fa7e00640 1 --2- 172.21.15.2:0/2426855914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e961615e0 0x561e96182d20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x561e96160b10 tx=0x7f5f98011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667daed870cf0575 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.775+0000 7f5fa5200640 1 -- 172.21.15.2:0/2426855914 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f980042f0 con 0x561e961615e0 2024-06-13T02:23:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.775+0000 7f5fa5200640 1 -- 172.21.15.2:0/2426855914 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f98021070 con 0x561e961615e0 2024-06-13T02:23:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.775+0000 7f5fa5200640 1 -- 172.21.15.2:0/2426855914 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9801c8e0 con 0x561e961615e0 2024-06-13T02:23:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.776+0000 7f5fba369740 1 -- 172.21.15.2:0/2426855914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e961615e0 msgr2=0x561e96182d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.776+0000 7f5fba369740 1 --2- 172.21.15.2:0/2426855914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e961615e0 0x561e96182d20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x561e96160b10 tx=0x7f5f98011980 comp rx=0 tx=0).stop 2024-06-13T02:23:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.776+0000 7f5fba369740 1 -- 172.21.15.2:0/2426855914 shutdown_connections 2024-06-13T02:23:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.776+0000 7f5fba369740 1 --2- 172.21.15.2:0/2426855914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e9616adf0 0x561e96183260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.776+0000 7f5fba369740 1 --2- 172.21.15.2:0/2426855914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e961615e0 0x561e96182d20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.776+0000 7f5fba369740 1 --2- 172.21.15.2:0/2426855914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e96160070 0x561e96168700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.776+0000 7f5fba369740 1 -- 172.21.15.2:0/2426855914 >> 172.21.15.2:0/2426855914 conn(0x561e96128fb0 msgr2=0x561e961624d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.776+0000 7f5fba369740 1 -- 172.21.15.2:0/2426855914 shutdown_connections 2024-06-13T02:23:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.776+0000 7f5fba369740 1 -- 172.21.15.2:0/2426855914 wait complete. 2024-06-13T02:23:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.776+0000 7f5fba369740 1 -- start start 2024-06-13T02:23:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.777+0000 7f5fba369740 1 Processor -- start 2024-06-13T02:23:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.777+0000 7f5fba369740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e96160070 0x561e9616e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.777+0000 7f5fba369740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e961615e0 0x561e9616eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.777+0000 7f5fba369740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e9616adf0 0x561e961e3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.777+0000 7f5fba369740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb01af890 con 0x561e9616adf0 2024-06-13T02:23:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.777+0000 7f5fba369740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb01b0d00 con 0x561e961615e0 2024-06-13T02:23:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.777+0000 7f5fba369740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb01aff60 con 0x561e96160070 2024-06-13T02:23:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.777+0000 7f5fba369740 10 client.0 _ll_register_callbacks cb 0x7f5f9800b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:23:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.777+0000 7f5fa7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e961615e0 0x561e9616eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.777+0000 7f5fa7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e961615e0 0x561e9616eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:52900/0 (socket says 172.21.15.2:52900) 2024-06-13T02:23:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.777+0000 7f5fa7e00640 1 -- 172.21.15.2:0/1089275232 learned_addr learned my addr 172.21.15.2:0/1089275232 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.777+0000 7f5fb5400640 1 --2- 172.21.15.2:0/1089275232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e96160070 0x561e9616e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.777+0000 7f5fb5400640 1 --2- 172.21.15.2:0/1089275232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e9616adf0 0x561e961e3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.778+0000 7f5fa7e00640 1 -- 172.21.15.2:0/1089275232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e96160070 msgr2=0x561e9616e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.778+0000 7f5fa7e00640 1 --2- 172.21.15.2:0/1089275232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e96160070 0x561e9616e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.778+0000 7f5fa7e00640 1 -- 172.21.15.2:0/1089275232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e9616adf0 msgr2=0x561e961e3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:41.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.778+0000 7f5fa7e00640 1 --2- 172.21.15.2:0/1089275232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e9616adf0 0x561e961e3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.778+0000 7f5fa7e00640 1 -- 172.21.15.2:0/1089275232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e961e4250 con 0x561e961615e0 2024-06-13T02:23:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.778+0000 7f5fa7e00640 1 --2- 172.21.15.2:0/1089275232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e961615e0 0x561e9616eb00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800b7b0 tx=0x7f5f9800bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d54069ff9ae29fc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.778+0000 7f5f9e000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:23:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.778+0000 7f5f9e000640 1 -- 172.21.15.2:0/1089275232 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f98004440 con 0x561e961615e0 2024-06-13T02:23:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.778+0000 7f5fba369740 1 -- 172.21.15.2:0/1089275232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f98021070 con 0x561e961615e0 2024-06-13T02:23:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.779+0000 7f5f9e000640 1 -- 172.21.15.2:0/1089275232 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9495+0+0 (secure 0 0 0) 0x7f5f98005250 con 0x561e961615e0 2024-06-13T02:23:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.779+0000 7f5f9e000640 1 -- 172.21.15.2:0/1089275232 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5f98037050 con 0x561e961615e0 2024-06-13T02:23:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.779+0000 7f5fba369740 10 client.25730 fetch_fsmap learned FSMap version 33 2024-06-13T02:23:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.779+0000 7f5fba369740 1 -- 172.21.15.2:0/1089275232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561e961e5540 con 0x561e961615e0 2024-06-13T02:23:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.779+0000 7f5f9e000640 1 -- 172.21.15.2:0/1089275232 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f98021070 con 0x561e961615e0 2024-06-13T02:23:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.779+0000 7f5f9e000640 1 -- 172.21.15.2:0/1089275232 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f5f9801c720 con 0x561e961615e0 2024-06-13T02:23:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.779+0000 7f5fba369740 10 client.25730 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:23:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.779+0000 7f5fba369740 10 client.25730 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:23:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.779+0000 7f5fba369740 20 client.25730 populate_metadata read hostname 'smithi002' 2024-06-13T02:23:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.779+0000 7f5fba369740 1 --2- 172.21.15.2:0/1089275232 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561e961e5c40 0x561e961e8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.779+0000 7f5fba369740 4 client.25730 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:23:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.779+0000 7f5fba369740 1 -- 172.21.15.2:0/1089275232 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561e960cbea0 con 0x561e961e5c40 2024-06-13T02:23:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.780+0000 7f5fb5400640 1 --2- 172.21.15.2:0/1089275232 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561e961e5c40 0x561e961e8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.780+0000 7f5fb5400640 1 --2- 172.21.15.2:0/1089275232 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561e961e5c40 0x561e961e8060 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9971449950dc53c server_cookie=b4181643625dbfef in_seq=0 out_seq=0 2024-06-13T02:23:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.780+0000 7f5f9e000640 10 client.25730 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.986+0000 7f5f9e000640 1 -- 172.21.15.2:0/1089275232 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x561e960cbea0 con 0x561e961e5c40 2024-06-13T02:23:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.986+0000 7f5f9e000640 10 client.25730 handle_command_reply: tid=0 2024-06-13T02:23:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.986+0000 7f5fba369740 1 client.25730 shutdown 2024-06-13T02:23:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.986+0000 7f5fba369740 1 -- 172.21.15.2:0/1089275232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e961615e0 msgr2=0x561e9616eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.986+0000 7f5fba369740 1 --2- 172.21.15.2:0/1089275232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e961615e0 0x561e9616eb00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800b7b0 tx=0x7f5f9800bf40 comp rx=0 tx=0).stop 2024-06-13T02:23:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.986+0000 7f5fba369740 1 -- 172.21.15.2:0/1089275232 shutdown_connections 2024-06-13T02:23:41.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.986+0000 7f5fba369740 1 --2- 172.21.15.2:0/1089275232 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561e961e5c40 0x561e961e8060 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.986+0000 7f5fba369740 1 --2- 172.21.15.2:0/1089275232 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561e9616adf0 0x561e961e3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.986+0000 7f5fba369740 1 --2- 172.21.15.2:0/1089275232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e961615e0 0x561e9616eb00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.986+0000 7f5fba369740 1 --2- 172.21.15.2:0/1089275232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561e96160070 0x561e9616e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.986+0000 7f5f9e000640 0 client.25730 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.986+0000 7f5fba369740 1 -- 172.21.15.2:0/1089275232 >> 172.21.15.2:0/1089275232 conn(0x561e96128fb0 msgr2=0x561e96166600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.987+0000 7f5fba369740 1 -- 172.21.15.2:0/1089275232 shutdown_connections 2024-06-13T02:23:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.987+0000 7f5fba369740 1 -- 172.21.15.2:0/1089275232 wait complete. 2024-06-13T02:23:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.987+0000 7f5fba369740 20 client.25730 trim_cache size 0 max 16384 2024-06-13T02:23:41.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:23:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:23:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:23:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.988+0000 7f5fb7400640 1 -- 172.21.15.2:0/117470588 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5f940a2d70 msgr2=0x7f5f940a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.988+0000 7f5fb7400640 1 --2- 172.21.15.2:0/117470588 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5f940a2d70 0x7f5f940a5230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x561e96162d40 tx=0x7f5fa0009560 comp rx=0 tx=0).stop 2024-06-13T02:23:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.988+0000 7f5fb7400640 1 -- 172.21.15.2:0/117470588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fb0103e30 msgr2=0x7f5fb019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.988+0000 7f5fb7400640 1 --2- 172.21.15.2:0/117470588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fb0103e30 0x7f5fb019a4e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0004770 tx=0x7f5fa0003c10 comp rx=0 tx=0).stop 2024-06-13T02:23:41.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.988+0000 7f5fb7400640 1 -- 172.21.15.2:0/117470588 shutdown_connections 2024-06-13T02:23:41.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.988+0000 7f5fb7400640 1 --2- 172.21.15.2:0/117470588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5fb019eda0 0x7f5fb019f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.988+0000 7f5fb7400640 1 --2- 172.21.15.2:0/117470588 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5f940a2d70 0x7f5f940a5230 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.988+0000 7f5fb7400640 1 --2- 172.21.15.2:0/117470588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5fb0108f00 0x7f5fb019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.988+0000 7f5fb7400640 1 --2- 172.21.15.2:0/117470588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fb0103e30 0x7f5fb019a4e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:41.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.988+0000 7f5fb7400640 1 -- 172.21.15.2:0/117470588 >> 172.21.15.2:0/117470588 conn(0x7f5fb00ff650 msgr2=0x7f5fb0101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:41.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.988+0000 7f5fb7400640 1 -- 172.21.15.2:0/117470588 shutdown_connections 2024-06-13T02:23:41.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:41.988+0000 7f5fb7400640 1 -- 172.21.15.2:0/117470588 wait complete. 2024-06-13T02:23:42.511 INFO:tasks.workunit.client.0.smithi002.stdout: 1 428672 8.22 MB/sec execute 166 sec latency 114.513 ms 2024-06-13T02:23:43.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:42 smithi002 ceph-mon[31960]: pgmap v181: 129 pgs: 129 active+clean; 66 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 368 op/s 2024-06-13T02:23:43.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:42 smithi084 ceph-mon[36833]: pgmap v181: 129 pgs: 129 active+clean; 66 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 368 op/s 2024-06-13T02:23:43.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:42 smithi175 ceph-mon[36977]: pgmap v181: 129 pgs: 129 active+clean; 66 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 368 op/s 2024-06-13T02:23:43.511 INFO:tasks.workunit.client.0.smithi002.stdout: 1 429949 8.21 MB/sec execute 167 sec latency 18.466 ms 2024-06-13T02:23:44.512 INFO:tasks.workunit.client.0.smithi002.stdout: 1 431581 8.20 MB/sec execute 168 sec latency 87.275 ms 2024-06-13T02:23:44.883 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:44 smithi002 ceph-mon[31960]: pgmap v182: 129 pgs: 129 active+clean; 66 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 165 op/s 2024-06-13T02:23:44.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:44 smithi084 ceph-mon[36833]: pgmap v182: 129 pgs: 129 active+clean; 66 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 165 op/s 2024-06-13T02:23:45.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:44 smithi175 ceph-mon[36977]: pgmap v182: 129 pgs: 129 active+clean; 66 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 165 op/s 2024-06-13T02:23:45.512 INFO:tasks.workunit.client.0.smithi002.stdout: 1 433342 8.23 MB/sec execute 169 sec latency 12.835 ms 2024-06-13T02:23:46.512 INFO:tasks.workunit.client.0.smithi002.stdout: 1 435143 8.22 MB/sec execute 170 sec latency 12.929 ms 2024-06-13T02:23:47.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:46 smithi002 ceph-mon[31960]: pgmap v183: 129 pgs: 129 active+clean; 58 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 351 op/s 2024-06-13T02:23:47.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:46 smithi084 ceph-mon[36833]: pgmap v183: 129 pgs: 129 active+clean; 58 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 351 op/s 2024-06-13T02:23:47.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:46 smithi175 ceph-mon[36977]: pgmap v183: 129 pgs: 129 active+clean; 58 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 351 op/s 2024-06-13T02:23:47.512 INFO:tasks.workunit.client.0.smithi002.stdout: 1 436847 8.24 MB/sec execute 171 sec latency 11.203 ms 2024-06-13T02:23:48.512 INFO:tasks.workunit.client.0.smithi002.stdout: 1 437951 8.22 MB/sec execute 172 sec latency 260.154 ms 2024-06-13T02:23:49.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:48 smithi002 ceph-mon[31960]: pgmap v184: 129 pgs: 129 active+clean; 58 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 2.4 MiB/s wr, 275 op/s 2024-06-13T02:23:49.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:48 smithi084 ceph-mon[36833]: pgmap v184: 129 pgs: 129 active+clean; 58 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 2.4 MiB/s wr, 275 op/s 2024-06-13T02:23:49.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:48 smithi175 ceph-mon[36977]: pgmap v184: 129 pgs: 129 active+clean; 58 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 2.4 MiB/s wr, 275 op/s 2024-06-13T02:23:49.512 INFO:tasks.workunit.client.0.smithi002.stdout: 1 439995 8.25 MB/sec execute 173 sec latency 92.055 ms 2024-06-13T02:23:50.513 INFO:tasks.workunit.client.0.smithi002.stdout: 1 441039 8.22 MB/sec execute 174 sec latency 65.347 ms 2024-06-13T02:23:51.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:50 smithi002 ceph-mon[31960]: pgmap v185: 129 pgs: 129 active+clean; 58 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 2.4 MiB/s wr, 275 op/s 2024-06-13T02:23:51.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:50 smithi084 ceph-mon[36833]: pgmap v185: 129 pgs: 129 active+clean; 58 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 2.4 MiB/s wr, 275 op/s 2024-06-13T02:23:51.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:50 smithi175 ceph-mon[36977]: pgmap v185: 129 pgs: 129 active+clean; 58 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 2.4 MiB/s wr, 275 op/s 2024-06-13T02:23:51.512 INFO:tasks.workunit.client.0.smithi002.stdout: 1 443418 8.26 MB/sec execute 175 sec latency 10.455 ms 2024-06-13T02:23:52.513 INFO:tasks.workunit.client.0.smithi002.stdout: 1 444454 8.24 MB/sec execute 176 sec latency 12.091 ms 2024-06-13T02:23:53.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:52 smithi002 ceph-mon[31960]: pgmap v186: 129 pgs: 129 active+clean; 63 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 360 op/s 2024-06-13T02:23:53.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:52 smithi084 ceph-mon[36833]: pgmap v186: 129 pgs: 129 active+clean; 63 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 360 op/s 2024-06-13T02:23:53.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:52 smithi175 ceph-mon[36977]: pgmap v186: 129 pgs: 129 active+clean; 63 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 360 op/s 2024-06-13T02:23:53.513 INFO:tasks.workunit.client.0.smithi002.stdout: 1 446181 8.24 MB/sec execute 177 sec latency 17.858 ms 2024-06-13T02:23:54.513 INFO:tasks.workunit.client.0.smithi002.stdout: 1 447310 8.24 MB/sec execute 178 sec latency 31.220 ms 2024-06-13T02:23:55.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:54 smithi002 ceph-mon[31960]: pgmap v187: 129 pgs: 129 active+clean; 63 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 271 op/s 2024-06-13T02:23:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.152+0000 7f91e5200640 1 -- 172.21.15.2:0/2855241612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e0102c10 msgr2=0x7f91e0102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.152+0000 7f91e5200640 1 --2- 172.21.15.2:0/2855241612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e0102c10 0x7f91e0102ff0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009900 tx=0x7f91d002a480 comp rx=0 tx=0).stop 2024-06-13T02:23:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.152+0000 7f91e5200640 1 -- 172.21.15.2:0/2855241612 shutdown_connections 2024-06-13T02:23:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.152+0000 7f91e5200640 1 --2- 172.21.15.2:0/2855241612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91e010bfe0 0x7f91e010e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.152+0000 7f91e5200640 1 --2- 172.21.15.2:0/2855241612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e0103530 0x7f91e010ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.152+0000 7f91e5200640 1 --2- 172.21.15.2:0/2855241612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e0102c10 0x7f91e0102ff0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.152+0000 7f91e5200640 1 -- 172.21.15.2:0/2855241612 >> 172.21.15.2:0/2855241612 conn(0x7f91e00779c0 msgr2=0x7f91e0077dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.152+0000 7f91e5200640 1 -- 172.21.15.2:0/2855241612 shutdown_connections 2024-06-13T02:23:55.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.152+0000 7f91e5200640 1 -- 172.21.15.2:0/2855241612 wait complete. 2024-06-13T02:23:55.154 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.154+0000 7f91e5200640 1 Processor -- start 2024-06-13T02:23:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.154+0000 7f91e5200640 1 -- start start 2024-06-13T02:23:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.154+0000 7f91e5200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e0102c10 0x7f91e019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.154+0000 7f91e5200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91e0103530 0x7f91e019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.154+0000 7f91e5200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e010bfe0 0x7f91e019ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.154+0000 7f91e5200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f91e0111d70 con 0x7f91e0103530 2024-06-13T02:23:55.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.154+0000 7f91e5200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f91e0111bf0 con 0x7f91e010bfe0 2024-06-13T02:23:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.154+0000 7f91e5200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91e0111ef0 con 0x7f91e0102c10 2024-06-13T02:23:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.155+0000 7f91dde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e0102c10 0x7f91e019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.155+0000 7f91de800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e010bfe0 0x7f91e019ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.155+0000 7f91dde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e0102c10 0x7f91e019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:50258/0 (socket says 172.21.15.2:50258) 2024-06-13T02:23:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.155+0000 7f91dde00640 1 -- 172.21.15.2:0/3963924569 learned_addr learned my addr 172.21.15.2:0/3963924569 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:55.156 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.155+0000 7f91dd400640 1 --2- 172.21.15.2:0/3963924569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91e0103530 0x7f91e019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.157 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.155+0000 7f91dde00640 1 -- 172.21.15.2:0/3963924569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e010bfe0 msgr2=0x7f91e019ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:55.157 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.155+0000 7f91dde00640 1 --2- 172.21.15.2:0/3963924569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e010bfe0 0x7f91e019ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.157 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.155+0000 7f91dde00640 1 -- 172.21.15.2:0/3963924569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91e0103530 msgr2=0x7f91e019a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:55.157 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.155+0000 7f91dde00640 1 --2- 172.21.15.2:0/3963924569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91e0103530 0x7f91e019a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.157 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.155+0000 7f91dde00640 1 -- 172.21.15.2:0/3963924569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e019f460 con 0x7f91e0102c10 2024-06-13T02:23:55.157 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.155+0000 7f91de800640 1 --2- 172.21.15.2:0/3963924569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e010bfe0 0x7f91e019ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:23:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.155+0000 7f91dde00640 1 --2- 172.21.15.2:0/3963924569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e0102c10 0x7f91e019a470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f91d0006010 tx=0x7f91d00042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.156+0000 7f91d6a00640 1 -- 172.21.15.2:0/3963924569 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d003f030 con 0x7f91e0102c10 2024-06-13T02:23:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.156+0000 7f91d6a00640 1 -- 172.21.15.2:0/3963924569 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d0003ce0 con 0x7f91e0102c10 2024-06-13T02:23:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.156+0000 7f91d6a00640 1 -- 172.21.15.2:0/3963924569 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0035070 con 0x7f91e0102c10 2024-06-13T02:23:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.156+0000 7f91e5200640 1 -- 172.21.15.2:0/3963924569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e019f6f0 con 0x7f91e0102c10 2024-06-13T02:23:55.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.156+0000 7f91e5200640 1 -- 172.21.15.2:0/3963924569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e01a6fe0 con 0x7f91e0102c10 2024-06-13T02:23:55.160 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.159+0000 7f91d6a00640 1 -- 172.21.15.2:0/3963924569 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f91d0042030 con 0x7f91e0102c10 2024-06-13T02:23:55.160 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.160+0000 7f91e81bf740 1 Processor -- start 2024-06-13T02:23:55.160 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.160+0000 7f91e81bf740 1 -- start start 2024-06-13T02:23:55.161 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.160+0000 7f91e81bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e515e0 0x55f736e4fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.161 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.160+0000 7f91e81bf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.161 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.160+0000 7f91e81bf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e5adf0 0x55f736e5d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.160+0000 7f91e81bf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f736db4420 con 0x55f736e5adf0 2024-06-13T02:23:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.160+0000 7f91e81bf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f736d5bc50 con 0x55f736e50070 2024-06-13T02:23:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.160+0000 7f91e81bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f736db03e0 con 0x55f736e515e0 2024-06-13T02:23:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.161+0000 7f91dd400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e5adf0 0x55f736e5d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.161+0000 7f91de800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e515e0 0x55f736e4fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.161+0000 7f91dde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.161+0000 7f91de800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e515e0 0x55f736e4fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:50260/0 (socket says 172.21.15.2:50260) 2024-06-13T02:23:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.161+0000 7f91de800640 1 -- 172.21.15.2:0/1995654502 learned_addr learned my addr 172.21.15.2:0/1995654502 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:55.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.161+0000 7f91d6a00640 1 --2- 172.21.15.2:0/3963924569 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f91c40a2d70 0x7f91c40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.161+0000 7f91d6a00640 1 -- 172.21.15.2:0/3963924569 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9495+0+0 (secure 0 0 0) 0x7f91d00efd10 con 0x7f91e0102c10 2024-06-13T02:23:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.161+0000 7f91dde00640 1 -- 172.21.15.2:0/1995654502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e515e0 msgr2=0x55f736e4fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.161+0000 7f91dde00640 1 --2- 172.21.15.2:0/1995654502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e515e0 0x55f736e4fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.161+0000 7f91dde00640 1 -- 172.21.15.2:0/1995654502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e5adf0 msgr2=0x55f736e5d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.161+0000 7f91dde00640 1 --2- 172.21.15.2:0/1995654502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e5adf0 0x55f736e5d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.161+0000 7f91de800640 1 --2- 172.21.15.2:0/3963924569 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f91c40a2d70 0x7f91c40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.161+0000 7f91dde00640 1 -- 172.21.15.2:0/1995654502 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f736ac8210 con 0x55f736e50070 2024-06-13T02:23:55.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.162+0000 7f91dde00640 1 --2- 172.21.15.2:0/1995654502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e504f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f91d00ed000 tx=0x7f91d002a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d09edf181a192b6b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.162+0000 7f91cb400640 1 -- 172.21.15.2:0/1995654502 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0049070 con 0x55f736e50070 2024-06-13T02:23:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.162+0000 7f91cb400640 1 -- 172.21.15.2:0/1995654502 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d00bbf70 con 0x55f736e50070 2024-06-13T02:23:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.162+0000 7f91cb400640 1 -- 172.21.15.2:0/1995654502 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d00c4b30 con 0x55f736e50070 2024-06-13T02:23:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.163+0000 7f91e81bf740 1 -- 172.21.15.2:0/1995654502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 msgr2=0x55f736e504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.163+0000 7f91e81bf740 1 --2- 172.21.15.2:0/1995654502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e504f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f91d00ed000 tx=0x7f91d002a480 comp rx=0 tx=0).stop 2024-06-13T02:23:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.163+0000 7f91de800640 1 --2- 172.21.15.2:0/3963924569 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f91c40a2d70 0x7f91c40a5230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91d8012db0 tx=0x7f91d8004ab0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.163+0000 7f91e81bf740 1 -- 172.21.15.2:0/1995654502 shutdown_connections 2024-06-13T02:23:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.163+0000 7f91e81bf740 1 --2- 172.21.15.2:0/1995654502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e5adf0 0x55f736e5d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.163+0000 7f91e81bf740 1 --2- 172.21.15.2:0/1995654502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e504f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.163+0000 7f91e81bf740 1 --2- 172.21.15.2:0/1995654502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e515e0 0x55f736e4fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.163+0000 7f91e81bf740 1 -- 172.21.15.2:0/1995654502 >> 172.21.15.2:0/1995654502 conn(0x55f736e18fb0 msgr2=0x55f736e4c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.163+0000 7f91e81bf740 1 -- 172.21.15.2:0/1995654502 shutdown_connections 2024-06-13T02:23:55.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.163+0000 7f91e81bf740 1 -- 172.21.15.2:0/1995654502 wait complete. 2024-06-13T02:23:55.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.164+0000 7f91e81bf740 1 -- start start 2024-06-13T02:23:55.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.164+0000 7f91e81bf740 1 Processor -- start 2024-06-13T02:23:55.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.164+0000 7f91e81bf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e57e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91e81bf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e515e0 0x55f736e583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91e81bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e5adf0 0x55f736e58910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91e81bf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f736e5d8e0 con 0x55f736e515e0 2024-06-13T02:23:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91e81bf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f736d6f0b0 con 0x55f736e50070 2024-06-13T02:23:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91e81bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f736e5da60 con 0x55f736e5adf0 2024-06-13T02:23:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91e81bf740 10 client.0 _ll_register_callbacks cb 0x55f736d5af40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:23:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91dde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e57e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91dde00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e57e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36916/0 (socket says 172.21.15.2:36916) 2024-06-13T02:23:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91dde00640 1 -- 172.21.15.2:0/1142517059 learned_addr learned my addr 172.21.15.2:0/1142517059 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91de800640 1 --2- 172.21.15.2:0/1142517059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e5adf0 0x55f736e58910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91dd400640 1 --2- 172.21.15.2:0/1142517059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e515e0 0x55f736e583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91dde00640 1 -- 172.21.15.2:0/1142517059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e5adf0 msgr2=0x55f736e58910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91dde00640 1 --2- 172.21.15.2:0/1142517059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e5adf0 0x55f736e58910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91dde00640 1 -- 172.21.15.2:0/1142517059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e515e0 msgr2=0x55f736e583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91dde00640 1 --2- 172.21.15.2:0/1142517059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e515e0 0x55f736e583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91dde00640 1 -- 172.21.15.2:0/1142517059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f736b94620 con 0x55f736e50070 2024-06-13T02:23:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91dde00640 1 --2- 172.21.15.2:0/1142517059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e57e90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f91d0005ab0 tx=0x7f91d00b8810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a78ed79087bf9f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.165+0000 7f91bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:23:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.166+0000 7f91bfe00640 1 -- 172.21.15.2:0/1142517059 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0049070 con 0x55f736e50070 2024-06-13T02:23:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.166+0000 7f91bfe00640 1 -- 172.21.15.2:0/1142517059 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9495+0+0 (secure 0 0 0) 0x7f91d00da6e0 con 0x55f736e50070 2024-06-13T02:23:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.166+0000 7f91e81bf740 1 -- 172.21.15.2:0/1142517059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91d00bbf70 con 0x55f736e50070 2024-06-13T02:23:55.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.166+0000 7f91bfe00640 1 -- 172.21.15.2:0/1142517059 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f91d00bbab0 con 0x55f736e50070 2024-06-13T02:23:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.166+0000 7f91e81bf740 10 client.25742 fetch_fsmap learned FSMap version 33 2024-06-13T02:23:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.166+0000 7f91e81bf740 1 -- 172.21.15.2:0/1142517059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f736e5d8e0 con 0x55f736e50070 2024-06-13T02:23:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.166+0000 7f91bfe00640 1 -- 172.21.15.2:0/1142517059 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d00bbf70 con 0x55f736e50070 2024-06-13T02:23:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.166+0000 7f91bfe00640 1 -- 172.21.15.2:0/1142517059 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f91d00f4040 con 0x55f736e50070 2024-06-13T02:23:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.167+0000 7f91e81bf740 10 client.25742 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:23:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.167+0000 7f91e81bf740 10 client.25742 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:23:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.167+0000 7f91e81bf740 20 client.25742 populate_metadata read hostname 'smithi002' 2024-06-13T02:23:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.167+0000 7f91e81bf740 1 --2- 172.21.15.2:0/1142517059 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f736e6ae20 0x55f736e6d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.167+0000 7f91e81bf740 4 client.25742 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:23:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.167+0000 7f91e81bf740 1 -- 172.21.15.2:0/1142517059 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f736dc1b50 con 0x55f736e6ae20 2024-06-13T02:23:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.167+0000 7f91dd400640 1 --2- 172.21.15.2:0/1142517059 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f736e6ae20 0x55f736e6d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.167+0000 7f91bfe00640 10 client.25742 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:55.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.167+0000 7f91dd400640 1 --2- 172.21.15.2:0/1142517059 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f736e6ae20 0x55f736e6d230 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6da0e495857c4c69 server_cookie=dc93eaecf3fca241 in_seq=0 out_seq=0 2024-06-13T02:23:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.169+0000 7f91bfe00640 1 -- 172.21.15.2:0/1142517059 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f736dc1b50 con 0x55f736e6ae20 2024-06-13T02:23:55.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.169+0000 7f91bfe00640 10 client.25742 handle_command_reply: tid=0 2024-06-13T02:23:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.169+0000 7f91e81bf740 1 client.25742 shutdown 2024-06-13T02:23:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.169+0000 7f91e81bf740 1 -- 172.21.15.2:0/1142517059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 msgr2=0x55f736e57e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.169+0000 7f91e81bf740 1 --2- 172.21.15.2:0/1142517059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e57e90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f91d0005ab0 tx=0x7f91d00b8810 comp rx=0 tx=0).stop 2024-06-13T02:23:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.169+0000 7f91e81bf740 1 -- 172.21.15.2:0/1142517059 shutdown_connections 2024-06-13T02:23:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.169+0000 7f91e81bf740 1 --2- 172.21.15.2:0/1142517059 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f736e6ae20 0x55f736e6d230 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.169+0000 7f91e81bf740 1 --2- 172.21.15.2:0/1142517059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e5adf0 0x55f736e58910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.169+0000 7f91e81bf740 1 --2- 172.21.15.2:0/1142517059 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e515e0 0x55f736e583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.169+0000 7f91e81bf740 1 --2- 172.21.15.2:0/1142517059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e57e90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.169+0000 7f91e81bf740 1 -- 172.21.15.2:0/1142517059 >> 172.21.15.2:0/1142517059 conn(0x55f736e18fb0 msgr2=0x55f736e52490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.169+0000 7f91bfe00640 0 client.25742 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.169+0000 7f91e81bf740 1 -- 172.21.15.2:0/1142517059 shutdown_connections 2024-06-13T02:23:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.169+0000 7f91e81bf740 1 -- 172.21.15.2:0/1142517059 wait complete. 2024-06-13T02:23:55.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.170+0000 7f91e81bf740 20 client.25742 trim_cache size 0 max 16384 2024-06-13T02:23:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.192+0000 7f91e81bf740 1 Processor -- start 2024-06-13T02:23:55.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.192+0000 7f91e81bf740 1 -- start start 2024-06-13T02:23:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.192+0000 7f91e81bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e18fb0 0x55f736e586e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.192+0000 7f91e81bf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e522e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.192+0000 7f91e81bf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e515e0 0x55f736e52820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.192+0000 7f91e81bf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f91e01b3990 con 0x55f736e515e0 2024-06-13T02:23:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.192+0000 7f91e81bf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f91e01b1260 con 0x55f736e50070 2024-06-13T02:23:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.192+0000 7f91e81bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91e01af0b0 con 0x55f736e18fb0 2024-06-13T02:23:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.193+0000 7f91dd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.193+0000 7f91dd400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36918/0 (socket says 172.21.15.2:36918) 2024-06-13T02:23:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.193+0000 7f91dd400640 1 -- 172.21.15.2:0/1457215592 learned_addr learned my addr 172.21.15.2:0/1457215592 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.193+0000 7f91dde00640 1 --2- 172.21.15.2:0/1457215592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e18fb0 0x55f736e586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.193+0000 7f91de800640 1 --2- 172.21.15.2:0/1457215592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e515e0 0x55f736e52820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.193+0000 7f91dd400640 1 -- 172.21.15.2:0/1457215592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e18fb0 msgr2=0x55f736e586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.193+0000 7f91dd400640 1 --2- 172.21.15.2:0/1457215592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e18fb0 0x55f736e586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.193+0000 7f91dd400640 1 -- 172.21.15.2:0/1457215592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e515e0 msgr2=0x55f736e52820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.193+0000 7f91dd400640 1 --2- 172.21.15.2:0/1457215592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e515e0 0x55f736e52820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.193+0000 7f91dd400640 1 -- 172.21.15.2:0/1457215592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f736e6d880 con 0x55f736e50070 2024-06-13T02:23:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.193+0000 7f91dd400640 1 --2- 172.21.15.2:0/1457215592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e522e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55f736e4d7f0 tx=0x7f91cc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bed17aba5a69c7d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.194+0000 7f91caa00640 1 -- 172.21.15.2:0/1457215592 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91cc003e40 con 0x55f736e50070 2024-06-13T02:23:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.194+0000 7f91caa00640 1 -- 172.21.15.2:0/1457215592 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91cc010910 con 0x55f736e50070 2024-06-13T02:23:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.194+0000 7f91caa00640 1 -- 172.21.15.2:0/1457215592 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91cc01ea20 con 0x55f736e50070 2024-06-13T02:23:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.194+0000 7f91e81bf740 1 -- 172.21.15.2:0/1457215592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 msgr2=0x55f736e522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.194+0000 7f91e81bf740 1 --2- 172.21.15.2:0/1457215592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e522e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55f736e4d7f0 tx=0x7f91cc0046c0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.195+0000 7f91e81bf740 1 -- 172.21.15.2:0/1457215592 shutdown_connections 2024-06-13T02:23:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.195+0000 7f91e81bf740 1 --2- 172.21.15.2:0/1457215592 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e515e0 0x55f736e52820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.195+0000 7f91e81bf740 1 --2- 172.21.15.2:0/1457215592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e50070 0x55f736e522e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.195+0000 7f91e81bf740 1 --2- 172.21.15.2:0/1457215592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e18fb0 0x55f736e586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.195+0000 7f91e81bf740 1 -- 172.21.15.2:0/1457215592 >> 172.21.15.2:0/1457215592 conn(0x55f736e47bf0 msgr2=0x55f736e51bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.195+0000 7f91e81bf740 1 -- 172.21.15.2:0/1457215592 shutdown_connections 2024-06-13T02:23:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.195+0000 7f91e81bf740 1 -- 172.21.15.2:0/1457215592 wait complete. 2024-06-13T02:23:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.195+0000 7f91e81bf740 1 -- start start 2024-06-13T02:23:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.195+0000 7f91e81bf740 1 Processor -- start 2024-06-13T02:23:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.196+0000 7f91e81bf740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e18fb0 0x55f736e63380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.196+0000 7f91e81bf740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e50070 0x55f736e5e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.196+0000 7f91e81bf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e515e0 0x55f736e5ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.196+0000 7f91e81bf740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f91e01af720 con 0x55f736e50070 2024-06-13T02:23:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.196+0000 7f91e81bf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f91e01b0b90 con 0x55f736e515e0 2024-06-13T02:23:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.196+0000 7f91e81bf740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91e01afdf0 con 0x55f736e18fb0 2024-06-13T02:23:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.196+0000 7f91e81bf740 10 client.0 _ll_register_callbacks cb 0x7f91cc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:23:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.196+0000 7f91dd400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e50070 0x55f736e5e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.196+0000 7f91dd400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e50070 0x55f736e5e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51136/0 (socket says 172.21.15.2:51136) 2024-06-13T02:23:55.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.196+0000 7f91dd400640 1 -- 172.21.15.2:0/3508924120 learned_addr learned my addr 172.21.15.2:0/3508924120 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:23:55.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.196+0000 7f91de800640 1 --2- 172.21.15.2:0/3508924120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e515e0 0x55f736e5ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.196+0000 7f91dde00640 1 --2- 172.21.15.2:0/3508924120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e18fb0 0x55f736e63380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.197+0000 7f91de800640 1 -- 172.21.15.2:0/3508924120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e18fb0 msgr2=0x55f736e63380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:55.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.197+0000 7f91de800640 1 --2- 172.21.15.2:0/3508924120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e18fb0 0x55f736e63380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.197+0000 7f91de800640 1 -- 172.21.15.2:0/3508924120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e50070 msgr2=0x55f736e5e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:23:55.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.197+0000 7f91de800640 1 --2- 172.21.15.2:0/3508924120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e50070 0x55f736e5e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.197+0000 7f91de800640 1 -- 172.21.15.2:0/3508924120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f736e5f430 con 0x55f736e515e0 2024-06-13T02:23:55.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.197+0000 7f91dde00640 1 --2- 172.21.15.2:0/3508924120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e18fb0 0x55f736e63380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:23:55.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.197+0000 7f91de800640 1 --2- 172.21.15.2:0/3508924120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e515e0 0x55f736e5ec30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55f736dfb480 tx=0x7f91d8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c25dec723f2eb1b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:23:55.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.197+0000 7f91bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:23:55.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.197+0000 7f91bfe00640 1 -- 172.21.15.2:0/3508924120 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8004b20 con 0x55f736e515e0 2024-06-13T02:23:55.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.198+0000 7f91bfe00640 1 -- 172.21.15.2:0/3508924120 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9495+0+0 (secure 0 0 0) 0x7f91d8004cc0 con 0x55f736e515e0 2024-06-13T02:23:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.198+0000 7f91e81bf740 1 -- 172.21.15.2:0/3508924120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91cc010910 con 0x55f736e515e0 2024-06-13T02:23:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.198+0000 7f91bfe00640 1 -- 172.21.15.2:0/3508924120 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f91d8035050 con 0x55f736e515e0 2024-06-13T02:23:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.198+0000 7f91e81bf740 10 client.25748 fetch_fsmap learned FSMap version 33 2024-06-13T02:23:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.198+0000 7f91e81bf740 1 -- 172.21.15.2:0/3508924120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f736ed5af0 con 0x55f736e515e0 2024-06-13T02:23:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.198+0000 7f91bfe00640 1 -- 172.21.15.2:0/3508924120 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91cc010910 con 0x55f736e515e0 2024-06-13T02:23:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.198+0000 7f91bfe00640 1 -- 172.21.15.2:0/3508924120 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f91d802c710 con 0x55f736e515e0 2024-06-13T02:23:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.198+0000 7f91e81bf740 10 client.25748 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:23:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.198+0000 7f91e81bf740 10 client.25748 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:23:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.198+0000 7f91e81bf740 20 client.25748 populate_metadata read hostname 'smithi002' 2024-06-13T02:23:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.199+0000 7f91e81bf740 1 --2- 172.21.15.2:0/3508924120 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f736e5adf0 0x55f736ed82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:23:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.199+0000 7f91e81bf740 4 client.25748 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:23:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.199+0000 7f91e81bf740 1 -- 172.21.15.2:0/3508924120 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f736dbbea0 con 0x55f736e5adf0 2024-06-13T02:23:55.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.199+0000 7f91dde00640 1 --2- 172.21.15.2:0/3508924120 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f736e5adf0 0x55f736ed82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:23:55.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.199+0000 7f91dde00640 1 --2- 172.21.15.2:0/3508924120 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f736e5adf0 0x55f736ed82e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e6b97fe39e24075 server_cookie=74e634ac1780fddf in_seq=0 out_seq=0 2024-06-13T02:23:55.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.199+0000 7f91bfe00640 10 client.25748 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:55.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:54 smithi084 ceph-mon[36833]: pgmap v187: 129 pgs: 129 active+clean; 63 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 271 op/s 2024-06-13T02:23:55.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:54 smithi175 ceph-mon[36977]: pgmap v187: 129 pgs: 129 active+clean; 63 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 271 op/s 2024-06-13T02:23:55.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.393+0000 7f91bfe00640 1 -- 172.21.15.2:0/3508924120 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55f736dbbea0 con 0x55f736e5adf0 2024-06-13T02:23:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.393+0000 7f91bfe00640 10 client.25748 handle_command_reply: tid=0 2024-06-13T02:23:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.393+0000 7f91e81bf740 1 client.25748 shutdown 2024-06-13T02:23:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.393+0000 7f91e81bf740 1 -- 172.21.15.2:0/3508924120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e515e0 msgr2=0x55f736e5ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.393+0000 7f91e81bf740 1 --2- 172.21.15.2:0/3508924120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e515e0 0x55f736e5ec30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55f736dfb480 tx=0x7f91d8004a40 comp rx=0 tx=0).stop 2024-06-13T02:23:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.393+0000 7f91e81bf740 1 -- 172.21.15.2:0/3508924120 shutdown_connections 2024-06-13T02:23:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.393+0000 7f91e81bf740 1 --2- 172.21.15.2:0/3508924120 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f736e5adf0 0x55f736ed82e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.393+0000 7f91e81bf740 1 --2- 172.21.15.2:0/3508924120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f736e515e0 0x55f736e5ec30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.393+0000 7f91e81bf740 1 --2- 172.21.15.2:0/3508924120 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f736e50070 0x55f736e5e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.393+0000 7f91e81bf740 1 --2- 172.21.15.2:0/3508924120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f736e18fb0 0x55f736e63380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.393+0000 7f91bfe00640 0 client.25748 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.393+0000 7f91e81bf740 1 -- 172.21.15.2:0/3508924120 >> 172.21.15.2:0/3508924120 conn(0x55f736e47bf0 msgr2=0x55f736e51bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.394+0000 7f91e81bf740 1 -- 172.21.15.2:0/3508924120 shutdown_connections 2024-06-13T02:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.394+0000 7f91e81bf740 1 -- 172.21.15.2:0/3508924120 wait complete. 2024-06-13T02:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.394+0000 7f91e81bf740 20 client.25748 trim_cache size 0 max 16384 2024-06-13T02:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:23:55.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.395+0000 7f91e5200640 1 -- 172.21.15.2:0/3963924569 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f91c40a2d70 msgr2=0x7f91c40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.395+0000 7f91e5200640 1 --2- 172.21.15.2:0/3963924569 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f91c40a2d70 0x7f91c40a5230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91d8012db0 tx=0x7f91d8004ab0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.395+0000 7f91e5200640 1 -- 172.21.15.2:0/3963924569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e0102c10 msgr2=0x7f91e019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.395+0000 7f91e5200640 1 --2- 172.21.15.2:0/3963924569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e0102c10 0x7f91e019a470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f91d0006010 tx=0x7f91d00042f0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.395+0000 7f91e5200640 1 -- 172.21.15.2:0/3963924569 shutdown_connections 2024-06-13T02:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.395+0000 7f91e5200640 1 --2- 172.21.15.2:0/3963924569 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91e010bfe0 0x7f91e019ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.395+0000 7f91e5200640 1 --2- 172.21.15.2:0/3963924569 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f91c40a2d70 0x7f91c40a5230 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.395+0000 7f91e5200640 1 --2- 172.21.15.2:0/3963924569 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f91e0103530 0x7f91e019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.397 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.395+0000 7f91e5200640 1 --2- 172.21.15.2:0/3963924569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91e0102c10 0x7f91e019a470 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:23:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.395+0000 7f91e5200640 1 -- 172.21.15.2:0/3963924569 >> 172.21.15.2:0/3963924569 conn(0x7f91e00779c0 msgr2=0x7f91e00fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:23:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.395+0000 7f91e5200640 1 -- 172.21.15.2:0/3963924569 shutdown_connections 2024-06-13T02:23:55.398 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:23:55.395+0000 7f91e5200640 1 -- 172.21.15.2:0/3963924569 wait complete. 2024-06-13T02:23:55.513 INFO:tasks.workunit.client.0.smithi002.stdout: 1 448167 8.21 MB/sec execute 179 sec latency 138.628 ms 2024-06-13T02:23:56.513 INFO:tasks.workunit.client.0.smithi002.stdout: 1 449968 8.22 MB/sec execute 180 sec latency 35.197 ms 2024-06-13T02:23:57.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:56 smithi002 ceph-mon[31960]: pgmap v188: 129 pgs: 129 active+clean; 56 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 439 op/s 2024-06-13T02:23:57.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:56 smithi084 ceph-mon[36833]: pgmap v188: 129 pgs: 129 active+clean; 56 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 439 op/s 2024-06-13T02:23:57.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:56 smithi175 ceph-mon[36977]: pgmap v188: 129 pgs: 129 active+clean; 56 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 439 op/s 2024-06-13T02:23:57.513 INFO:tasks.workunit.client.0.smithi002.stdout: 1 451161 8.21 MB/sec execute 181 sec latency 17.601 ms 2024-06-13T02:23:58.513 INFO:tasks.workunit.client.0.smithi002.stdout: 1 452841 8.20 MB/sec execute 182 sec latency 14.266 ms 2024-06-13T02:23:59.132 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:23:58 smithi002 ceph-mon[31960]: pgmap v189: 129 pgs: 129 active+clean; 56 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 253 op/s 2024-06-13T02:23:59.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:23:58 smithi084 ceph-mon[36833]: pgmap v189: 129 pgs: 129 active+clean; 56 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 253 op/s 2024-06-13T02:23:59.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:23:58 smithi175 ceph-mon[36977]: pgmap v189: 129 pgs: 129 active+clean; 56 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 253 op/s 2024-06-13T02:23:59.513 INFO:tasks.workunit.client.0.smithi002.stdout: 1 454428 8.22 MB/sec execute 183 sec latency 27.952 ms 2024-06-13T02:24:00.513 INFO:tasks.workunit.client.0.smithi002.stdout: 1 455706 8.21 MB/sec execute 184 sec latency 23.991 ms 2024-06-13T02:24:01.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:00 smithi002 ceph-mon[31960]: pgmap v190: 129 pgs: 129 active+clean; 56 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 253 op/s 2024-06-13T02:24:01.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:00 smithi084 ceph-mon[36833]: pgmap v190: 129 pgs: 129 active+clean; 56 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 253 op/s 2024-06-13T02:24:01.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:00 smithi175 ceph-mon[36977]: pgmap v190: 129 pgs: 129 active+clean; 56 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 253 op/s 2024-06-13T02:24:01.513 INFO:tasks.workunit.client.0.smithi002.stdout: 1 456325 8.17 MB/sec execute 185 sec latency 109.036 ms 2024-06-13T02:24:02.514 INFO:tasks.workunit.client.0.smithi002.stdout: 1 457386 8.17 MB/sec execute 186 sec latency 105.311 ms 2024-06-13T02:24:03.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:02 smithi084 ceph-mon[36833]: pgmap v191: 129 pgs: 129 active+clean; 60 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 357 op/s 2024-06-13T02:24:03.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:02 smithi175 ceph-mon[36977]: pgmap v191: 129 pgs: 129 active+clean; 60 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 357 op/s 2024-06-13T02:24:03.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:02 smithi002 ceph-mon[31960]: pgmap v191: 129 pgs: 129 active+clean; 60 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 357 op/s 2024-06-13T02:24:03.514 INFO:tasks.workunit.client.0.smithi002.stdout: 1 458344 8.15 MB/sec execute 187 sec latency 125.181 ms 2024-06-13T02:24:04.514 INFO:tasks.workunit.client.0.smithi002.stdout: 1 459113 8.22 MB/sec execute 188 sec latency 89.991 ms 2024-06-13T02:24:05.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:04 smithi084 ceph-mon[36833]: pgmap v192: 129 pgs: 129 active+clean; 60 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 272 op/s 2024-06-13T02:24:05.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:04 smithi175 ceph-mon[36977]: pgmap v192: 129 pgs: 129 active+clean; 60 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 272 op/s 2024-06-13T02:24:05.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:04 smithi002 ceph-mon[31960]: pgmap v192: 129 pgs: 129 active+clean; 60 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 272 op/s 2024-06-13T02:24:05.514 INFO:tasks.workunit.client.0.smithi002.stdout: 1 460778 8.21 MB/sec execute 189 sec latency 28.451 ms 2024-06-13T02:24:06.514 INFO:tasks.workunit.client.0.smithi002.stdout: 1 462149 8.23 MB/sec execute 190 sec latency 24.974 ms 2024-06-13T02:24:07.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:06 smithi084 ceph-mon[36833]: pgmap v193: 129 pgs: 129 active+clean; 65 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 368 op/s 2024-06-13T02:24:07.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:06 smithi084 ceph-mon[36833]: osdmap e104: 12 total, 12 up, 12 in 2024-06-13T02:24:07.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:06 smithi175 ceph-mon[36977]: pgmap v193: 129 pgs: 129 active+clean; 65 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 368 op/s 2024-06-13T02:24:07.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:06 smithi175 ceph-mon[36977]: osdmap e104: 12 total, 12 up, 12 in 2024-06-13T02:24:07.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:06 smithi002 ceph-mon[31960]: pgmap v193: 129 pgs: 129 active+clean; 65 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 368 op/s 2024-06-13T02:24:07.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:06 smithi002 ceph-mon[31960]: osdmap e104: 12 total, 12 up, 12 in 2024-06-13T02:24:07.514 INFO:tasks.workunit.client.0.smithi002.stdout: 1 462636 8.19 MB/sec execute 191 sec latency 41.993 ms 2024-06-13T02:24:08.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:07 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:24:08.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:07 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:24:08.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:07 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:24:08.514 INFO:tasks.workunit.client.0.smithi002.stdout: 1 463591 8.18 MB/sec execute 192 sec latency 37.011 ms 2024-06-13T02:24:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.556+0000 7f67d5600640 1 -- 172.21.15.2:0/2468088035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d01047c0 msgr2=0x7f67d0108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.556+0000 7f67d5600640 1 --2- 172.21.15.2:0/2468088035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d01047c0 0x7f67d0108800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009860 tx=0x7f67bc02a340 comp rx=0 tx=0).stop 2024-06-13T02:24:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.556+0000 7f67d5600640 1 -- 172.21.15.2:0/2468088035 shutdown_connections 2024-06-13T02:24:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.556+0000 7f67d5600640 1 --2- 172.21.15.2:0/2468088035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d0108ee0 0x7f67d0110ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.556+0000 7f67d5600640 1 --2- 172.21.15.2:0/2468088035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d01047c0 0x7f67d0108800 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.556+0000 7f67d5600640 1 --2- 172.21.15.2:0/2468088035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67d0103e10 0x7f67d01041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.556+0000 7f67d5600640 1 -- 172.21.15.2:0/2468088035 >> 172.21.15.2:0/2468088035 conn(0x7f67d00ff690 msgr2=0x7f67d0101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.556+0000 7f67d5600640 1 -- 172.21.15.2:0/2468088035 shutdown_connections 2024-06-13T02:24:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.556+0000 7f67d5600640 1 -- 172.21.15.2:0/2468088035 wait complete. 2024-06-13T02:24:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.558+0000 7f67d5600640 1 Processor -- start 2024-06-13T02:24:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.558+0000 7f67d5600640 1 -- start start 2024-06-13T02:24:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.559+0000 7f67d5600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d0103e10 0x7f67d019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.559+0000 7f67d5600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67d0108ee0 0x7f67d019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.559+0000 7f67d5600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d019ed60 0x7f67d019f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.559+0000 7f67d5600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67d0113f90 con 0x7f67d0108ee0 2024-06-13T02:24:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.559+0000 7f67d5600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f67d0113e10 con 0x7f67d019ed60 2024-06-13T02:24:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.559+0000 7f67d5600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f67d0114110 con 0x7f67d0103e10 2024-06-13T02:24:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.559+0000 7f67cea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d0103e10 0x7f67d019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.559+0000 7f67cea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d0103e10 0x7f67d019a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:52580/0 (socket says 172.21.15.2:52580) 2024-06-13T02:24:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.559+0000 7f67cea00640 1 -- 172.21.15.2:0/789433366 learned_addr learned my addr 172.21.15.2:0/789433366 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.559+0000 7f67cf400640 1 --2- 172.21.15.2:0/789433366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d019ed60 0x7f67d019f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.560+0000 7f67cea00640 1 -- 172.21.15.2:0/789433366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d019ed60 msgr2=0x7f67d019f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.560+0000 7f67ce000640 1 --2- 172.21.15.2:0/789433366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67d0108ee0 0x7f67d019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.560+0000 7f67cea00640 1 --2- 172.21.15.2:0/789433366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d019ed60 0x7f67d019f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.560+0000 7f67cea00640 1 -- 172.21.15.2:0/789433366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67d0108ee0 msgr2=0x7f67d019aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.560+0000 7f67cea00640 1 --2- 172.21.15.2:0/789433366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67d0108ee0 0x7f67d019aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.560+0000 7f67cea00640 1 -- 172.21.15.2:0/789433366 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d019f850 con 0x7f67d0103e10 2024-06-13T02:24:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.560+0000 7f67ce000640 1 --2- 172.21.15.2:0/789433366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67d0108ee0 0x7f67d019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:24:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.560+0000 7f67cea00640 1 --2- 172.21.15.2:0/789433366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d0103e10 0x7f67d019a4f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f67c000ea60 tx=0x7f67c000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.560+0000 7f67c7400640 1 -- 172.21.15.2:0/789433366 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c000cde0 con 0x7f67d0103e10 2024-06-13T02:24:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.560+0000 7f67c7400640 1 -- 172.21.15.2:0/789433366 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67c00035f0 con 0x7f67d0103e10 2024-06-13T02:24:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.560+0000 7f67d5600640 1 -- 172.21.15.2:0/789433366 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d019fb40 con 0x7f67d0103e10 2024-06-13T02:24:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.561+0000 7f67c7400640 1 -- 172.21.15.2:0/789433366 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c0010690 con 0x7f67d0103e10 2024-06-13T02:24:08.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.561+0000 7f67d5600640 1 -- 172.21.15.2:0/789433366 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d01a7380 con 0x7f67d0103e10 2024-06-13T02:24:08.567 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.566+0000 7f67d85df740 1 Processor -- start 2024-06-13T02:24:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.566+0000 7f67c7400640 1 -- 172.21.15.2:0/789433366 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f67c0004020 con 0x7f67d0103e10 2024-06-13T02:24:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.566+0000 7f67d85df740 1 -- start start 2024-06-13T02:24:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.567+0000 7f67d85df740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eed5e0 0x563173eebb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.567+0000 7f67d85df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eec070 0x563173eec4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.567+0000 7f67d85df740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eff600 0x563173f019f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.567+0000 7f67d85df740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563173e50420 con 0x563173eed5e0 2024-06-13T02:24:08.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.567+0000 7f67d85df740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563173df7c50 con 0x563173eff600 2024-06-13T02:24:08.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.567+0000 7f67d85df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563173e4c3e0 con 0x563173eec070 2024-06-13T02:24:08.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.567+0000 7f67cea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eec070 0x563173eec4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.567+0000 7f67cea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eec070 0x563173eec4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:52596/0 (socket says 172.21.15.2:52596) 2024-06-13T02:24:08.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.567+0000 7f67cea00640 1 -- 172.21.15.2:0/1412276107 learned_addr learned my addr 172.21.15.2:0/1412276107 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:08.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.567+0000 7f67cea00640 1 -- 172.21.15.2:0/1412276107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eff600 msgr2=0x563173f019f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-13T02:24:08.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.568+0000 7f67cea00640 1 --2- 172.21.15.2:0/1412276107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eff600 0x563173f019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.568+0000 7f67cea00640 1 -- 172.21.15.2:0/1412276107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eed5e0 msgr2=0x563173eebb30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-13T02:24:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.568+0000 7f67cf400640 1 --2- 172.21.15.2:0/1412276107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eed5e0 0x563173eebb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.568+0000 7f67cea00640 1 --2- 172.21.15.2:0/1412276107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eed5e0 0x563173eebb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.568+0000 7f67cea00640 1 -- 172.21.15.2:0/1412276107 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563173b64210 con 0x563173eec070 2024-06-13T02:24:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.568+0000 7f67c7400640 1 --2- 172.21.15.2:0/789433366 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f67b40a2df0 0x7f67b40a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.568+0000 7f67cea00640 1 --2- 172.21.15.2:0/1412276107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eec070 0x563173eec4f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f67c00d3b40 tx=0x7f67c00d8250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bceb26e9f0e5cc9d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.569+0000 7f67c7400640 1 -- 172.21.15.2:0/789433366 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9671+0+0 (secure 0 0 0) 0x7f67c00cfbe0 con 0x7f67d0103e10 2024-06-13T02:24:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.569+0000 7f67bb400640 1 -- 172.21.15.2:0/1412276107 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c009b580 con 0x563173eec070 2024-06-13T02:24:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.569+0000 7f67bb400640 1 -- 172.21.15.2:0/1412276107 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67c00e1070 con 0x563173eec070 2024-06-13T02:24:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.569+0000 7f67bb400640 1 -- 172.21.15.2:0/1412276107 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c009b760 con 0x563173eec070 2024-06-13T02:24:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.570+0000 7f67cf400640 1 --2- 172.21.15.2:0/789433366 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f67b40a2df0 0x7f67b40a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.571+0000 7f67d85df740 1 -- 172.21.15.2:0/1412276107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eec070 msgr2=0x563173eec4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.571+0000 7f67d85df740 1 --2- 172.21.15.2:0/1412276107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eec070 0x563173eec4f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f67c00d3b40 tx=0x7f67c00d8250 comp rx=0 tx=0).stop 2024-06-13T02:24:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.571+0000 7f67cf400640 1 --2- 172.21.15.2:0/789433366 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f67b40a2df0 0x7f67b40a52b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f67c8005fd0 tx=0x7f67c80095c0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.571+0000 7f67d85df740 1 -- 172.21.15.2:0/1412276107 shutdown_connections 2024-06-13T02:24:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.571+0000 7f67d85df740 1 --2- 172.21.15.2:0/1412276107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eff600 0x563173f019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.571+0000 7f67d85df740 1 --2- 172.21.15.2:0/1412276107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eec070 0x563173eec4f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.571+0000 7f67d85df740 1 --2- 172.21.15.2:0/1412276107 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eed5e0 0x563173eebb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.571+0000 7f67d85df740 1 -- 172.21.15.2:0/1412276107 >> 172.21.15.2:0/1412276107 conn(0x563173eb4fb0 msgr2=0x563173ee8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.572+0000 7f67d85df740 1 -- 172.21.15.2:0/1412276107 shutdown_connections 2024-06-13T02:24:08.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.572+0000 7f67d85df740 1 -- 172.21.15.2:0/1412276107 wait complete. 2024-06-13T02:24:08.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.572+0000 7f67d85df740 1 -- start start 2024-06-13T02:24:08.574 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.573+0000 7f67d85df740 1 Processor -- start 2024-06-13T02:24:08.575 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.574+0000 7f67d85df740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eec070 0x563173efc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.574+0000 7f67d85df740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eed5e0 0x563173efcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.574+0000 7f67d85df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eff600 0x563173efd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.574+0000 7f67d85df740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563173f02370 con 0x563173eed5e0 2024-06-13T02:24:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.574+0000 7f67d85df740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563173e0b0b0 con 0x563173eec070 2024-06-13T02:24:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.574+0000 7f67d85df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563173f024f0 con 0x563173eff600 2024-06-13T02:24:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.574+0000 7f67d85df740 10 client.0 _ll_register_callbacks cb 0x563173df6f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:24:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.574+0000 7f67cea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eec070 0x563173efc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.574+0000 7f67cea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eec070 0x563173efc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36318/0 (socket says 172.21.15.2:36318) 2024-06-13T02:24:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.574+0000 7f67cea00640 1 -- 172.21.15.2:0/1125286566 learned_addr learned my addr 172.21.15.2:0/1125286566 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:08.576 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.574+0000 7f67cf400640 1 --2- 172.21.15.2:0/1125286566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eff600 0x563173efd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.577 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.575+0000 7f67cea00640 1 -- 172.21.15.2:0/1125286566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eff600 msgr2=0x563173efd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.574+0000 7f67ce000640 1 --2- 172.21.15.2:0/1125286566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eed5e0 0x563173efcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.575+0000 7f67cea00640 1 --2- 172.21.15.2:0/1125286566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eff600 0x563173efd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.575+0000 7f67cea00640 1 -- 172.21.15.2:0/1125286566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eed5e0 msgr2=0x563173efcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.575+0000 7f67cea00640 1 --2- 172.21.15.2:0/1125286566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eed5e0 0x563173efcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.575+0000 7f67cea00640 1 -- 172.21.15.2:0/1125286566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563173c30620 con 0x563173eec070 2024-06-13T02:24:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.575+0000 7f67ce000640 1 --2- 172.21.15.2:0/1125286566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eed5e0 0x563173efcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:24:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.575+0000 7f67cea00640 1 --2- 172.21.15.2:0/1125286566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eec070 0x563173efc630 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f67c0009230 tx=0x7f67c00cfeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71cea45ea3d99bcc server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.575+0000 7f67afe00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:24:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.575+0000 7f67afe00640 1 -- 172.21.15.2:0/1125286566 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c009b9f0 con 0x563173eec070 2024-06-13T02:24:08.579 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.575+0000 7f67afe00640 1 -- 172.21.15.2:0/1125286566 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9671+0+0 (secure 0 0 0) 0x7f67c00cd0d0 con 0x563173eec070 2024-06-13T02:24:08.579 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.575+0000 7f67d85df740 1 -- 172.21.15.2:0/1125286566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67c00e1070 con 0x563173eec070 2024-06-13T02:24:08.579 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.576+0000 7f67afe00640 1 -- 172.21.15.2:0/1125286566 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f67c0097ec0 con 0x563173eec070 2024-06-13T02:24:08.579 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.576+0000 7f67d85df740 10 client.25757 fetch_fsmap learned FSMap version 33 2024-06-13T02:24:08.579 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.576+0000 7f67d85df740 1 -- 172.21.15.2:0/1125286566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563173f0e6e0 con 0x563173eec070 2024-06-13T02:24:08.579 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.576+0000 7f67afe00640 1 -- 172.21.15.2:0/1125286566 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67c00e1070 con 0x563173eec070 2024-06-13T02:24:08.579 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.576+0000 7f67afe00640 1 -- 172.21.15.2:0/1125286566 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f67c0098290 con 0x563173eec070 2024-06-13T02:24:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.576+0000 7f67d85df740 10 client.25757 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:24:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.576+0000 7f67d85df740 10 client.25757 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:24:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.576+0000 7f67d85df740 20 client.25757 populate_metadata read hostname 'smithi002' 2024-06-13T02:24:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.576+0000 7f67d85df740 1 --2- 172.21.15.2:0/1125286566 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563173f0fa30 0x563173f11e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.576+0000 7f67d85df740 4 client.25757 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:24:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.576+0000 7f67d85df740 1 -- 172.21.15.2:0/1125286566 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563173e5db50 con 0x563173f0fa30 2024-06-13T02:24:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.577+0000 7f67ce000640 1 --2- 172.21.15.2:0/1125286566 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563173f0fa30 0x563173f11e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.577+0000 7f67ce000640 1 --2- 172.21.15.2:0/1125286566 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563173f0fa30 0x563173f11e20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6ba36801bbb1037 server_cookie=375d9c2567f70f6e in_seq=0 out_seq=0 2024-06-13T02:24:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.577+0000 7f67afe00640 10 client.25757 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.578+0000 7f67afe00640 1 -- 172.21.15.2:0/1125286566 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563173e5db50 con 0x563173f0fa30 2024-06-13T02:24:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.578+0000 7f67afe00640 10 client.25757 handle_command_reply: tid=0 2024-06-13T02:24:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.579+0000 7f67d85df740 1 client.25757 shutdown 2024-06-13T02:24:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.579+0000 7f67d85df740 1 -- 172.21.15.2:0/1125286566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eec070 msgr2=0x563173efc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.579+0000 7f67d85df740 1 --2- 172.21.15.2:0/1125286566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eec070 0x563173efc630 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f67c0009230 tx=0x7f67c00cfeb0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.579+0000 7f67d85df740 1 -- 172.21.15.2:0/1125286566 shutdown_connections 2024-06-13T02:24:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.579+0000 7f67d85df740 1 --2- 172.21.15.2:0/1125286566 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563173f0fa30 0x563173f11e20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.579+0000 7f67d85df740 1 --2- 172.21.15.2:0/1125286566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eff600 0x563173efd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.579+0000 7f67d85df740 1 --2- 172.21.15.2:0/1125286566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eed5e0 0x563173efcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.579+0000 7f67d85df740 1 --2- 172.21.15.2:0/1125286566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eec070 0x563173efc630 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.579+0000 7f67afe00640 0 client.25757 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.579+0000 7f67d85df740 1 -- 172.21.15.2:0/1125286566 >> 172.21.15.2:0/1125286566 conn(0x563173eb4fb0 msgr2=0x563173eee490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.579+0000 7f67d85df740 1 -- 172.21.15.2:0/1125286566 shutdown_connections 2024-06-13T02:24:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.580+0000 7f67d85df740 1 -- 172.21.15.2:0/1125286566 wait complete. 2024-06-13T02:24:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.580+0000 7f67d85df740 20 client.25757 trim_cache size 0 max 16384 2024-06-13T02:24:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.604+0000 7f67d85df740 1 Processor -- start 2024-06-13T02:24:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.604+0000 7f67d85df740 1 -- start start 2024-06-13T02:24:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.604+0000 7f67d85df740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eec070 0x563173efe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.604+0000 7f67d85df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eed5e0 0x563173ee7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.604+0000 7f67d85df740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eff600 0x563173f14e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.604+0000 7f67d85df740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67d01af9e0 con 0x563173eff600 2024-06-13T02:24:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.604+0000 7f67d85df740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f67d01ad2b0 con 0x563173eec070 2024-06-13T02:24:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.604+0000 7f67d85df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f67d01ab120 con 0x563173eed5e0 2024-06-13T02:24:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.605+0000 7f67ce000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eed5e0 0x563173ee7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.605+0000 7f67cf400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eff600 0x563173f14e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.605+0000 7f67ce000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eed5e0 0x563173ee7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:52608/0 (socket says 172.21.15.2:52608) 2024-06-13T02:24:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.605+0000 7f67ce000640 1 -- 172.21.15.2:0/4241141205 learned_addr learned my addr 172.21.15.2:0/4241141205 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.605+0000 7f67cea00640 1 --2- 172.21.15.2:0/4241141205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eec070 0x563173efe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.605+0000 7f67ce000640 1 -- 172.21.15.2:0/4241141205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eec070 msgr2=0x563173efe570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.605+0000 7f67ce000640 1 --2- 172.21.15.2:0/4241141205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eec070 0x563173efe570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.605+0000 7f67ce000640 1 -- 172.21.15.2:0/4241141205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eff600 msgr2=0x563173f14e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.605+0000 7f67ce000640 1 --2- 172.21.15.2:0/4241141205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eff600 0x563173f14e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.605+0000 7f67ce000640 1 -- 172.21.15.2:0/4241141205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563173eebad0 con 0x563173eed5e0 2024-06-13T02:24:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.606+0000 7f67ce000640 1 --2- 172.21.15.2:0/4241141205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eed5e0 0x563173ee7fc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f67bc02a860 tx=0x7f67bc030ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b0f39a7bce916fa server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.606+0000 7f67baa00640 1 -- 172.21.15.2:0/4241141205 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc037070 con 0x563173eed5e0 2024-06-13T02:24:08.609 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.606+0000 7f67baa00640 1 -- 172.21.15.2:0/4241141205 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67bc038040 con 0x563173eed5e0 2024-06-13T02:24:08.609 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.606+0000 7f67baa00640 1 -- 172.21.15.2:0/4241141205 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0054d0 con 0x563173eed5e0 2024-06-13T02:24:08.609 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.607+0000 7f67d85df740 1 -- 172.21.15.2:0/4241141205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eed5e0 msgr2=0x563173ee7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:08.609 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.607+0000 7f67d85df740 1 --2- 172.21.15.2:0/4241141205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eed5e0 0x563173ee7fc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f67bc02a860 tx=0x7f67bc030ce0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.609 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.607+0000 7f67d85df740 1 -- 172.21.15.2:0/4241141205 shutdown_connections 2024-06-13T02:24:08.609 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.607+0000 7f67d85df740 1 --2- 172.21.15.2:0/4241141205 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eff600 0x563173f14e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.609 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.607+0000 7f67d85df740 1 --2- 172.21.15.2:0/4241141205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eed5e0 0x563173ee7fc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.609 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.607+0000 7f67d85df740 1 --2- 172.21.15.2:0/4241141205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eec070 0x563173efe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.609 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.607+0000 7f67d85df740 1 -- 172.21.15.2:0/4241141205 >> 172.21.15.2:0/4241141205 conn(0x563173eb4fb0 msgr2=0x563173efde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:08.609 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.607+0000 7f67d85df740 1 -- 172.21.15.2:0/4241141205 shutdown_connections 2024-06-13T02:24:08.609 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.607+0000 7f67d85df740 1 -- 172.21.15.2:0/4241141205 wait complete. 2024-06-13T02:24:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.608+0000 7f67d85df740 1 -- start start 2024-06-13T02:24:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.608+0000 7f67d85df740 1 Processor -- start 2024-06-13T02:24:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.608+0000 7f67d85df740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eec070 0x563173f15680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.608+0000 7f67d85df740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eed5e0 0x563173f12a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67d85df740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eff600 0x563173f12fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67d85df740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67d01ab770 con 0x563173eec070 2024-06-13T02:24:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67d85df740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f67d01acbe0 con 0x563173eed5e0 2024-06-13T02:24:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67d85df740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f67d01abe40 con 0x563173eff600 2024-06-13T02:24:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67d85df740 10 client.0 _ll_register_callbacks cb 0x7f67c00d39c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:24:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67cf400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eff600 0x563173f12fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67ce000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eed5e0 0x563173f12a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67cf400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eff600 0x563173f12fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:52616/0 (socket says 172.21.15.2:52616) 2024-06-13T02:24:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67cf400640 1 -- 172.21.15.2:0/739972695 learned_addr learned my addr 172.21.15.2:0/739972695 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67ce000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eed5e0 0x563173f12a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36338/0 (socket says 172.21.15.2:36338) 2024-06-13T02:24:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67cea00640 1 --2- 172.21.15.2:0/739972695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eec070 0x563173f15680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67cf400640 1 -- 172.21.15.2:0/739972695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eed5e0 msgr2=0x563173f12a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67cf400640 1 --2- 172.21.15.2:0/739972695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eed5e0 0x563173f12a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67cf400640 1 -- 172.21.15.2:0/739972695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eec070 msgr2=0x563173f15680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67cf400640 1 --2- 172.21.15.2:0/739972695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eec070 0x563173f15680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67cf400640 1 -- 172.21.15.2:0/739972695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563173f137e0 con 0x563173eff600 2024-06-13T02:24:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.609+0000 7f67cea00640 1 --2- 172.21.15.2:0/739972695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eec070 0x563173f15680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:24:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.610+0000 7f67cf400640 1 --2- 172.21.15.2:0/739972695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eff600 0x563173f12fb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f67c801d6f0 tx=0x7f67c8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5288b4c1d02eefb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.610+0000 7f67afe00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:24:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.610+0000 7f67afe00640 1 -- 172.21.15.2:0/739972695 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c802d020 con 0x563173eff600 2024-06-13T02:24:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.610+0000 7f67afe00640 1 -- 172.21.15.2:0/739972695 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9671+0+0 (secure 0 0 0) 0x7f67c801a6d0 con 0x563173eff600 2024-06-13T02:24:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.610+0000 7f67d85df740 1 -- 172.21.15.2:0/739972695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67bc038040 con 0x563173eff600 2024-06-13T02:24:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.614+0000 7f67afe00640 1 -- 172.21.15.2:0/739972695 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f67c801a8d0 con 0x563173eff600 2024-06-13T02:24:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.614+0000 7f67d85df740 10 client.25750 fetch_fsmap learned FSMap version 33 2024-06-13T02:24:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.614+0000 7f67d85df740 1 -- 172.21.15.2:0/739972695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563173f7a4b0 con 0x563173eff600 2024-06-13T02:24:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.614+0000 7f67afe00640 1 -- 172.21.15.2:0/739972695 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67bc038040 con 0x563173eff600 2024-06-13T02:24:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.615+0000 7f67afe00640 1 -- 172.21.15.2:0/739972695 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f67c800b040 con 0x563173eff600 2024-06-13T02:24:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.615+0000 7f67d85df740 10 client.25750 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:24:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.615+0000 7f67d85df740 10 client.25750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:24:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.615+0000 7f67d85df740 20 client.25750 populate_metadata read hostname 'smithi002' 2024-06-13T02:24:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.615+0000 7f67d85df740 1 --2- 172.21.15.2:0/739972695 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563173f7ac60 0x563173f7d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.615+0000 7f67d85df740 4 client.25750 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:24:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.615+0000 7f67d85df740 1 -- 172.21.15.2:0/739972695 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563173e57ea0 con 0x563173f7ac60 2024-06-13T02:24:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.615+0000 7f67cea00640 1 --2- 172.21.15.2:0/739972695 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563173f7ac60 0x563173f7d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.616+0000 7f67cea00640 1 --2- 172.21.15.2:0/739972695 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563173f7ac60 0x563173f7d080 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39a3cbd87aa97481 server_cookie=c9e6258321bc408 in_seq=0 out_seq=0 2024-06-13T02:24:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.616+0000 7f67afe00640 10 client.25750 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:08.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.821+0000 7f67afe00640 1 -- 172.21.15.2:0/739972695 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x563173e57ea0 con 0x563173f7ac60 2024-06-13T02:24:08.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.821+0000 7f67afe00640 10 client.25750 handle_command_reply: tid=0 2024-06-13T02:24:08.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.821+0000 7f67d85df740 1 client.25750 shutdown 2024-06-13T02:24:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.821+0000 7f67d85df740 1 -- 172.21.15.2:0/739972695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eff600 msgr2=0x563173f12fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.821+0000 7f67d85df740 1 --2- 172.21.15.2:0/739972695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eff600 0x563173f12fb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f67c801d6f0 tx=0x7f67c8004a40 comp rx=0 tx=0).stop 2024-06-13T02:24:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.821+0000 7f67d85df740 1 -- 172.21.15.2:0/739972695 shutdown_connections 2024-06-13T02:24:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.821+0000 7f67d85df740 1 --2- 172.21.15.2:0/739972695 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563173f7ac60 0x563173f7d080 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.821+0000 7f67d85df740 1 --2- 172.21.15.2:0/739972695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563173eff600 0x563173f12fb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.821+0000 7f67d85df740 1 --2- 172.21.15.2:0/739972695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563173eed5e0 0x563173f12a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.821+0000 7f67d85df740 1 --2- 172.21.15.2:0/739972695 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563173eec070 0x563173f15680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.821+0000 7f67afe00640 0 client.25750 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.821+0000 7f67d85df740 1 -- 172.21.15.2:0/739972695 >> 172.21.15.2:0/739972695 conn(0x563173eb4fb0 msgr2=0x563173efe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.821+0000 7f67d85df740 1 -- 172.21.15.2:0/739972695 shutdown_connections 2024-06-13T02:24:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.822+0000 7f67d85df740 1 -- 172.21.15.2:0/739972695 wait complete. 2024-06-13T02:24:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.822+0000 7f67d85df740 20 client.25750 trim_cache size 0 max 16384 2024-06-13T02:24:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:24:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:24:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:24:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.823+0000 7f67d5600640 1 -- 172.21.15.2:0/789433366 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f67b40a2df0 msgr2=0x7f67b40a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.823+0000 7f67d5600640 1 --2- 172.21.15.2:0/789433366 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f67b40a2df0 0x7f67b40a52b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f67c8005fd0 tx=0x7f67c80095c0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.823+0000 7f67d5600640 1 -- 172.21.15.2:0/789433366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d0103e10 msgr2=0x7f67d019a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.823+0000 7f67d5600640 1 --2- 172.21.15.2:0/789433366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d0103e10 0x7f67d019a4f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f67c000ea60 tx=0x7f67c000ef20 comp rx=0 tx=0).stop 2024-06-13T02:24:08.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.823+0000 7f67d5600640 1 -- 172.21.15.2:0/789433366 shutdown_connections 2024-06-13T02:24:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.823+0000 7f67d5600640 1 --2- 172.21.15.2:0/789433366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67d019ed60 0x7f67d019f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.823+0000 7f67d5600640 1 --2- 172.21.15.2:0/789433366 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f67b40a2df0 0x7f67b40a52b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.823+0000 7f67d5600640 1 --2- 172.21.15.2:0/789433366 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67d0108ee0 0x7f67d019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.823+0000 7f67d5600640 1 --2- 172.21.15.2:0/789433366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d0103e10 0x7f67d019a4f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.823+0000 7f67d5600640 1 -- 172.21.15.2:0/789433366 >> 172.21.15.2:0/789433366 conn(0x7f67d00ff690 msgr2=0x7f67d01019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.823+0000 7f67d5600640 1 -- 172.21.15.2:0/789433366 shutdown_connections 2024-06-13T02:24:08.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:08.824+0000 7f67d5600640 1 -- 172.21.15.2:0/789433366 wait complete. 2024-06-13T02:24:09.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:08 smithi084 ceph-mon[36833]: pgmap v195: 129 pgs: 129 active+clean; 65 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 240 op/s 2024-06-13T02:24:09.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:08 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:24:09.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:08 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:24:09.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:08 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:24:09.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:08 smithi175 ceph-mon[36977]: pgmap v195: 129 pgs: 129 active+clean; 65 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 240 op/s 2024-06-13T02:24:09.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:08 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:24:09.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:08 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:24:09.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:08 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:24:09.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:08 smithi002 ceph-mon[31960]: pgmap v195: 129 pgs: 129 active+clean; 65 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 240 op/s 2024-06-13T02:24:09.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:08 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:24:09.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:08 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:24:09.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:08 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:24:09.514 INFO:tasks.workunit.client.0.smithi002.stdout: 1 465410 8.20 MB/sec execute 193 sec latency 124.769 ms 2024-06-13T02:24:10.514 INFO:tasks.workunit.client.0.smithi002.stdout: 1 466039 8.16 MB/sec execute 194 sec latency 381.200 ms 2024-06-13T02:24:11.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:10 smithi084 ceph-mon[36833]: pgmap v196: 129 pgs: 129 active+clean; 65 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 240 op/s 2024-06-13T02:24:11.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:10 smithi175 ceph-mon[36977]: pgmap v196: 129 pgs: 129 active+clean; 65 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 240 op/s 2024-06-13T02:24:11.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:10 smithi002 ceph-mon[31960]: pgmap v196: 129 pgs: 129 active+clean; 65 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 240 op/s 2024-06-13T02:24:11.515 INFO:tasks.workunit.client.0.smithi002.stdout: 1 466039 8.12 MB/sec execute 195 sec latency 1381.273 ms 2024-06-13T02:24:12.515 INFO:tasks.workunit.client.0.smithi002.stdout: 1 466039 8.08 MB/sec execute 196 sec latency 2381.432 ms 2024-06-13T02:24:13.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:12 smithi084 ceph-mon[36833]: pgmap v197: 129 pgs: 129 active+clean; 56 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 2.7 MiB/s wr, 282 op/s 2024-06-13T02:24:13.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:12 smithi175 ceph-mon[36977]: pgmap v197: 129 pgs: 129 active+clean; 56 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 2.7 MiB/s wr, 282 op/s 2024-06-13T02:24:13.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:12 smithi002 ceph-mon[31960]: pgmap v197: 129 pgs: 129 active+clean; 56 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 2.7 MiB/s wr, 282 op/s 2024-06-13T02:24:13.515 INFO:tasks.workunit.client.0.smithi002.stdout: 1 466039 8.04 MB/sec execute 197 sec latency 3381.577 ms 2024-06-13T02:24:14.515 INFO:tasks.workunit.client.0.smithi002.stdout: 1 466039 8.00 MB/sec execute 198 sec latency 4381.664 ms 2024-06-13T02:24:14.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:14 smithi002 ceph-mon[31960]: osdmap e105: 12 total, 12 up, 12 in 2024-06-13T02:24:14.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:14 smithi002 ceph-mon[31960]: pgmap v199: 129 pgs: 129 active+clean; 56 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 1.4 MiB/s wr, 209 op/s 2024-06-13T02:24:14.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:14 smithi084 ceph-mon[36833]: osdmap e105: 12 total, 12 up, 12 in 2024-06-13T02:24:14.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:14 smithi084 ceph-mon[36833]: pgmap v199: 129 pgs: 129 active+clean; 56 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 1.4 MiB/s wr, 209 op/s 2024-06-13T02:24:15.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:14 smithi175 ceph-mon[36977]: osdmap e105: 12 total, 12 up, 12 in 2024-06-13T02:24:15.033 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:14 smithi175 ceph-mon[36977]: pgmap v199: 129 pgs: 129 active+clean; 56 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 1.4 MiB/s wr, 209 op/s 2024-06-13T02:24:15.515 INFO:tasks.workunit.client.0.smithi002.stdout: 1 466504 7.97 MB/sec execute 199 sec latency 4939.953 ms 2024-06-13T02:24:16.515 INFO:tasks.workunit.client.0.smithi002.stdout: 1 467854 7.95 MB/sec execute 200 sec latency 26.285 ms 2024-06-13T02:24:17.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:16 smithi002 ceph-mon[31960]: pgmap v200: 129 pgs: 129 active+clean; 56 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.9 MiB/s wr, 227 op/s 2024-06-13T02:24:17.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:16 smithi084 ceph-mon[36833]: pgmap v200: 129 pgs: 129 active+clean; 56 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.9 MiB/s wr, 227 op/s 2024-06-13T02:24:17.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:16 smithi175 ceph-mon[36977]: pgmap v200: 129 pgs: 129 active+clean; 56 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.9 MiB/s wr, 227 op/s 2024-06-13T02:24:17.515 INFO:tasks.workunit.client.0.smithi002.stdout: 1 469409 7.97 MB/sec execute 201 sec latency 12.645 ms 2024-06-13T02:24:18.515 INFO:tasks.workunit.client.0.smithi002.stdout: 1 470446 7.96 MB/sec execute 202 sec latency 29.191 ms 2024-06-13T02:24:19.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:18 smithi002 ceph-mon[31960]: pgmap v201: 129 pgs: 129 active+clean; 56 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 1.9 MiB/s wr, 224 op/s 2024-06-13T02:24:19.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:18 smithi084 ceph-mon[36833]: pgmap v201: 129 pgs: 129 active+clean; 56 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 1.9 MiB/s wr, 224 op/s 2024-06-13T02:24:19.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:18 smithi175 ceph-mon[36977]: pgmap v201: 129 pgs: 129 active+clean; 56 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 1.9 MiB/s wr, 224 op/s 2024-06-13T02:24:19.516 INFO:tasks.workunit.client.0.smithi002.stdout: 1 471896 7.95 MB/sec execute 203 sec latency 25.755 ms 2024-06-13T02:24:20.516 INFO:tasks.workunit.client.0.smithi002.stdout: 1 473001 7.95 MB/sec execute 204 sec latency 55.376 ms 2024-06-13T02:24:21.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:20 smithi002 ceph-mon[31960]: pgmap v202: 129 pgs: 129 active+clean; 56 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 1.9 MiB/s wr, 224 op/s 2024-06-13T02:24:21.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:20 smithi084 ceph-mon[36833]: pgmap v202: 129 pgs: 129 active+clean; 56 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 1.9 MiB/s wr, 224 op/s 2024-06-13T02:24:21.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:20 smithi175 ceph-mon[36977]: pgmap v202: 129 pgs: 129 active+clean; 56 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 1.9 MiB/s wr, 224 op/s 2024-06-13T02:24:21.516 INFO:tasks.workunit.client.0.smithi002.stdout: 1 474148 7.94 MB/sec execute 205 sec latency 21.702 ms 2024-06-13T02:24:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.979+0000 7f5b5e200640 1 -- 172.21.15.2:0/2684656489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b58102980 msgr2=0x7f5b58102d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.979+0000 7f5b5e200640 1 --2- 172.21.15.2:0/2684656489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b58102980 0x7f5b58102d60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009900 tx=0x7f5b4c02a480 comp rx=0 tx=0).stop 2024-06-13T02:24:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.979+0000 7f5b5e200640 1 -- 172.21.15.2:0/2684656489 shutdown_connections 2024-06-13T02:24:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.979+0000 7f5b5e200640 1 --2- 172.21.15.2:0/2684656489 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b5810bda0 0x7f5b5810e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.979+0000 7f5b5e200640 1 --2- 172.21.15.2:0/2684656489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b581032a0 0x7f5b5810b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.979+0000 7f5b5e200640 1 --2- 172.21.15.2:0/2684656489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b58102980 0x7f5b58102d60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.979+0000 7f5b5e200640 1 -- 172.21.15.2:0/2684656489 >> 172.21.15.2:0/2684656489 conn(0x7f5b580fc180 msgr2=0x7f5b580fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.980+0000 7f5b5e200640 1 -- 172.21.15.2:0/2684656489 shutdown_connections 2024-06-13T02:24:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.980+0000 7f5b5e200640 1 -- 172.21.15.2:0/2684656489 wait complete. 2024-06-13T02:24:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.981+0000 7f5b5e200640 1 Processor -- start 2024-06-13T02:24:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.981+0000 7f5b5e200640 1 -- start start 2024-06-13T02:24:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.981+0000 7f5b5e200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58102980 0x7f5b5819a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.981+0000 7f5b5e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b581032a0 0x7f5b5819a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.981+0000 7f5b5e200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b5810bda0 0x7f5b5819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.981+0000 7f5b5e200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5b58111ba0 con 0x7f5b58102980 2024-06-13T02:24:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.981+0000 7f5b5e200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5b58111a20 con 0x7f5b581032a0 2024-06-13T02:24:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.981+0000 7f5b5e200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b58111d20 con 0x7f5b5810bda0 2024-06-13T02:24:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.981+0000 7f5b5ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58102980 0x7f5b5819a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.981+0000 7f5b5d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b5810bda0 0x7f5b5819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.982+0000 7f5b5d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b5810bda0 0x7f5b5819eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:45238/0 (socket says 172.21.15.2:45238) 2024-06-13T02:24:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.982+0000 7f5b5d800640 1 -- 172.21.15.2:0/1761365538 learned_addr learned my addr 172.21.15.2:0/1761365538 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.982+0000 7f5b57e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b581032a0 0x7f5b5819a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.982+0000 7f5b5d800640 1 -- 172.21.15.2:0/1761365538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b581032a0 msgr2=0x7f5b5819a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.982+0000 7f5b5d800640 1 --2- 172.21.15.2:0/1761365538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b581032a0 0x7f5b5819a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.982+0000 7f5b5d800640 1 -- 172.21.15.2:0/1761365538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58102980 msgr2=0x7f5b5819a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.982+0000 7f5b5d800640 1 --2- 172.21.15.2:0/1761365538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58102980 0x7f5b5819a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.982+0000 7f5b5d800640 1 -- 172.21.15.2:0/1761365538 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5819f280 con 0x7f5b5810bda0 2024-06-13T02:24:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.982+0000 7f5b5d800640 1 --2- 172.21.15.2:0/1761365538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b5810bda0 0x7f5b5819eb50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000eaa0 tx=0x7f5b5000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.982+0000 7f5b55600640 1 -- 172.21.15.2:0/1761365538 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5000cdb0 con 0x7f5b5810bda0 2024-06-13T02:24:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.983+0000 7f5b5e200640 1 -- 172.21.15.2:0/1761365538 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b5819f570 con 0x7f5b5810bda0 2024-06-13T02:24:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.983+0000 7f5b55600640 1 -- 172.21.15.2:0/1761365538 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b50005020 con 0x7f5b5810bda0 2024-06-13T02:24:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.983+0000 7f5b55600640 1 -- 172.21.15.2:0/1761365538 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b500116b0 con 0x7f5b5810bda0 2024-06-13T02:24:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.983+0000 7f5b5e200640 1 -- 172.21.15.2:0/1761365538 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b581a6e00 con 0x7f5b5810bda0 2024-06-13T02:24:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.986+0000 7f5b55600640 1 -- 172.21.15.2:0/1761365538 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f5b50005560 con 0x7f5b5810bda0 2024-06-13T02:24:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.986+0000 7f5b62625740 1 Processor -- start 2024-06-13T02:24:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.986+0000 7f5b62625740 1 -- start start 2024-06-13T02:24:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.986+0000 7f5b62625740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b9877a0 0x55b19b985cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.986+0000 7f5b62625740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b986230 0x55b19b9866b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.987+0000 7f5b62625740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b990fb0 0x55b19b9933a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.987+0000 7f5b62625740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b19b8ea420 con 0x55b19b990fb0 2024-06-13T02:24:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.987+0000 7f5b62625740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b19b891c50 con 0x55b19b986230 2024-06-13T02:24:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.987+0000 7f5b62625740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b19b8e63e0 con 0x55b19b9877a0 2024-06-13T02:24:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.987+0000 7f5b5ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b986230 0x55b19b9866b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.987+0000 7f5b5ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b986230 0x55b19b9866b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:40334/0 (socket says 172.21.15.2:40334) 2024-06-13T02:24:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.987+0000 7f5b5ce00640 1 -- 172.21.15.2:0/2335518294 learned_addr learned my addr 172.21.15.2:0/2335518294 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.987+0000 7f5b57e00640 1 --2- 172.21.15.2:0/2335518294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b9877a0 0x55b19b985cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.987+0000 7f5b57e00640 1 --2- 172.21.15.2:0/2335518294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b990fb0 0x55b19b9933a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.987+0000 7f5b5ce00640 1 -- 172.21.15.2:0/2335518294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b9877a0 msgr2=0x55b19b985cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.987+0000 7f5b5ce00640 1 --2- 172.21.15.2:0/2335518294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b9877a0 0x55b19b985cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.987+0000 7f5b5ce00640 1 -- 172.21.15.2:0/2335518294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b990fb0 msgr2=0x55b19b9933a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.987+0000 7f5b5ce00640 1 --2- 172.21.15.2:0/2335518294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b990fb0 0x55b19b9933a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.987+0000 7f5b5ce00640 1 -- 172.21.15.2:0/2335518294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19b5fe210 con 0x55b19b986230 2024-06-13T02:24:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.987+0000 7f5b57e00640 1 --2- 172.21.15.2:0/2335518294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b990fb0 0x55b19b9933a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:24:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.988+0000 7f5b5ce00640 1 --2- 172.21.15.2:0/2335518294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b986230 0x55b19b9866b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c033000 tx=0x7f5b4c005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd33185d76404680 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.988+0000 7f5b55600640 1 --2- 172.21.15.2:0/1761365538 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5b400a2ce0 0x7f5b400a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.988+0000 7f5b4a000640 1 -- 172.21.15.2:0/2335518294 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c040070 con 0x55b19b986230 2024-06-13T02:24:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.988+0000 7f5b55600640 1 -- 172.21.15.2:0/1761365538 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9583+0+0 (secure 0 0 0) 0x7f5b500cfa30 con 0x7f5b5810bda0 2024-06-13T02:24:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.988+0000 7f5b4a000640 1 -- 172.21.15.2:0/2335518294 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b4c031970 con 0x55b19b986230 2024-06-13T02:24:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.988+0000 7f5b4a000640 1 -- 172.21.15.2:0/2335518294 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c035040 con 0x55b19b986230 2024-06-13T02:24:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.988+0000 7f5b57e00640 1 --2- 172.21.15.2:0/1761365538 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5b400a2ce0 0x7f5b400a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.989+0000 7f5b62625740 1 -- 172.21.15.2:0/2335518294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b986230 msgr2=0x55b19b9866b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.989+0000 7f5b62625740 1 --2- 172.21.15.2:0/2335518294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b986230 0x55b19b9866b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c033000 tx=0x7f5b4c005e00 comp rx=0 tx=0).stop 2024-06-13T02:24:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.989+0000 7f5b57e00640 1 --2- 172.21.15.2:0/1761365538 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5b400a2ce0 0x7f5b400a51a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55b19b9839b0 tx=0x7f5b44005f90 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.989+0000 7f5b62625740 1 -- 172.21.15.2:0/2335518294 shutdown_connections 2024-06-13T02:24:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.989+0000 7f5b62625740 1 --2- 172.21.15.2:0/2335518294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b990fb0 0x55b19b9933a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.989+0000 7f5b62625740 1 --2- 172.21.15.2:0/2335518294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b986230 0x55b19b9866b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.989+0000 7f5b62625740 1 --2- 172.21.15.2:0/2335518294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b9877a0 0x55b19b985cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.989+0000 7f5b62625740 1 -- 172.21.15.2:0/2335518294 >> 172.21.15.2:0/2335518294 conn(0x55b19b94efb0 msgr2=0x55b19b982820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.989+0000 7f5b62625740 1 -- 172.21.15.2:0/2335518294 shutdown_connections 2024-06-13T02:24:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.989+0000 7f5b62625740 1 -- 172.21.15.2:0/2335518294 wait complete. 2024-06-13T02:24:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.990+0000 7f5b62625740 1 -- start start 2024-06-13T02:24:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.990+0000 7f5b62625740 1 Processor -- start 2024-06-13T02:24:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.990+0000 7f5b62625740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b986230 0x55b19b98dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.990+0000 7f5b62625740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b9877a0 0x55b19b98e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b62625740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b990fb0 0x55b19b98ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b62625740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b19b993d20 con 0x55b19b986230 2024-06-13T02:24:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b62625740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b19b8a50b0 con 0x55b19b9877a0 2024-06-13T02:24:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b62625740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b19b993ea0 con 0x55b19b990fb0 2024-06-13T02:24:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b62625740 10 client.0 _ll_register_callbacks cb 0x55b19b890f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:24:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b57e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b9877a0 0x55b19b98e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b5ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b986230 0x55b19b98dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b57e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b9877a0 0x55b19b98e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:40342/0 (socket says 172.21.15.2:40342) 2024-06-13T02:24:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b57e00640 1 -- 172.21.15.2:0/3786976543 learned_addr learned my addr 172.21.15.2:0/3786976543 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b5d800640 1 --2- 172.21.15.2:0/3786976543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b990fb0 0x55b19b98ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b57e00640 1 -- 172.21.15.2:0/3786976543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b990fb0 msgr2=0x55b19b98ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b57e00640 1 --2- 172.21.15.2:0/3786976543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b990fb0 0x55b19b98ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b57e00640 1 -- 172.21.15.2:0/3786976543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b986230 msgr2=0x55b19b98dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b57e00640 1 --2- 172.21.15.2:0/3786976543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b986230 0x55b19b98dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b57e00640 1 -- 172.21.15.2:0/3786976543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b19b6ca620 con 0x55b19b9877a0 2024-06-13T02:24:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b5d800640 1 --2- 172.21.15.2:0/3786976543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b990fb0 0x55b19b98ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:24:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.991+0000 7f5b5ce00640 1 --2- 172.21.15.2:0/3786976543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b986230 0x55b19b98dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:24:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.992+0000 7f5b57e00640 1 --2- 172.21.15.2:0/3786976543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b9877a0 0x55b19b98e510 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5b4401ebe0 tx=0x7f5b440096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7292a9f02b5cad24 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.992+0000 7f5b3ea00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:24:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.992+0000 7f5b3ea00640 1 -- 172.21.15.2:0/3786976543 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b44009e10 con 0x55b19b9877a0 2024-06-13T02:24:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.992+0000 7f5b3ea00640 1 -- 172.21.15.2:0/3786976543 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9583+0+0 (secure 0 0 0) 0x7f5b4401ecd0 con 0x55b19b9877a0 2024-06-13T02:24:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.992+0000 7f5b62625740 1 -- 172.21.15.2:0/3786976543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b4c031970 con 0x55b19b9877a0 2024-06-13T02:24:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.992+0000 7f5b3ea00640 1 -- 172.21.15.2:0/3786976543 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5b44034050 con 0x55b19b9877a0 2024-06-13T02:24:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.992+0000 7f5b62625740 10 client.25775 fetch_fsmap learned FSMap version 33 2024-06-13T02:24:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.992+0000 7f5b62625740 1 -- 172.21.15.2:0/3786976543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b19b9a0060 con 0x55b19b9877a0 2024-06-13T02:24:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.993+0000 7f5b3ea00640 1 -- 172.21.15.2:0/3786976543 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b4c031970 con 0x55b19b9877a0 2024-06-13T02:24:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.993+0000 7f5b3ea00640 1 -- 172.21.15.2:0/3786976543 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f5b44029ad0 con 0x55b19b9877a0 2024-06-13T02:24:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.993+0000 7f5b62625740 10 client.25775 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:24:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.993+0000 7f5b62625740 10 client.25775 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:24:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.993+0000 7f5b62625740 20 client.25775 populate_metadata read hostname 'smithi002' 2024-06-13T02:24:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.993+0000 7f5b62625740 1 --2- 172.21.15.2:0/3786976543 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b19b9a1520 0x55b19b9a3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.993+0000 7f5b62625740 4 client.25775 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:24:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.993+0000 7f5b62625740 1 -- 172.21.15.2:0/3786976543 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b19b8f7b50 con 0x55b19b9a1520 2024-06-13T02:24:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.993+0000 7f5b5ce00640 1 --2- 172.21.15.2:0/3786976543 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b19b9a1520 0x55b19b9a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.994+0000 7f5b5ce00640 1 --2- 172.21.15.2:0/3786976543 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b19b9a1520 0x55b19b9a3970 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56f7aa09df9ba4b2 server_cookie=23213840a763eb7a in_seq=0 out_seq=0 2024-06-13T02:24:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.994+0000 7f5b3ea00640 10 client.25775 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.995+0000 7f5b3ea00640 1 -- 172.21.15.2:0/3786976543 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b19b8f7b50 con 0x55b19b9a1520 2024-06-13T02:24:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.995+0000 7f5b3ea00640 10 client.25775 handle_command_reply: tid=0 2024-06-13T02:24:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.995+0000 7f5b62625740 1 client.25775 shutdown 2024-06-13T02:24:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.995+0000 7f5b62625740 1 -- 172.21.15.2:0/3786976543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b9877a0 msgr2=0x55b19b98e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.995+0000 7f5b62625740 1 --2- 172.21.15.2:0/3786976543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b9877a0 0x55b19b98e510 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5b4401ebe0 tx=0x7f5b440096c0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.995+0000 7f5b62625740 1 -- 172.21.15.2:0/3786976543 shutdown_connections 2024-06-13T02:24:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.995+0000 7f5b62625740 1 --2- 172.21.15.2:0/3786976543 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b19b9a1520 0x55b19b9a3970 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.995+0000 7f5b62625740 1 --2- 172.21.15.2:0/3786976543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b990fb0 0x55b19b98ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.995+0000 7f5b62625740 1 --2- 172.21.15.2:0/3786976543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b9877a0 0x55b19b98e510 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.995+0000 7f5b62625740 1 --2- 172.21.15.2:0/3786976543 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b986230 0x55b19b98dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.995+0000 7f5b62625740 1 -- 172.21.15.2:0/3786976543 >> 172.21.15.2:0/3786976543 conn(0x55b19b94efb0 msgr2=0x55b19b988690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.995+0000 7f5b3ea00640 0 client.25775 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.995+0000 7f5b62625740 1 -- 172.21.15.2:0/3786976543 shutdown_connections 2024-06-13T02:24:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.995+0000 7f5b62625740 1 -- 172.21.15.2:0/3786976543 wait complete. 2024-06-13T02:24:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:21.995+0000 7f5b62625740 20 client.25775 trim_cache size 0 max 16384 2024-06-13T02:24:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.014+0000 7f5b62625740 1 Processor -- start 2024-06-13T02:24:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.014+0000 7f5b62625740 1 -- start start 2024-06-13T02:24:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.015+0000 7f5b62625740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b986230 0x55b19b98e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.015+0000 7f5b62625740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b9877a0 0x55b19b982120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.015+0000 7f5b62625740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b990fb0 0x55b19b982660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.015+0000 7f5b62625740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581b3970 con 0x55b19b986230 2024-06-13T02:24:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.015+0000 7f5b62625740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581b1240 con 0x55b19b990fb0 2024-06-13T02:24:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.015+0000 7f5b62625740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581af0b0 con 0x55b19b9877a0 2024-06-13T02:24:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.015+0000 7f5b5d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b990fb0 0x55b19b982660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.015+0000 7f5b5d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b990fb0 0x55b19b982660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:40356/0 (socket says 172.21.15.2:40356) 2024-06-13T02:24:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.015+0000 7f5b5d800640 1 -- 172.21.15.2:0/4160883940 learned_addr learned my addr 172.21.15.2:0/4160883940 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.015+0000 7f5b57e00640 1 --2- 172.21.15.2:0/4160883940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b9877a0 0x55b19b982120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.015+0000 7f5b5ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b986230 0x55b19b98e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.016+0000 7f5b57e00640 1 -- 172.21.15.2:0/4160883940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b990fb0 msgr2=0x55b19b982660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.016+0000 7f5b57e00640 1 --2- 172.21.15.2:0/4160883940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b990fb0 0x55b19b982660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.016+0000 7f5b57e00640 1 -- 172.21.15.2:0/4160883940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b986230 msgr2=0x55b19b98e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.016+0000 7f5b57e00640 1 --2- 172.21.15.2:0/4160883940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b986230 0x55b19b98e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.016+0000 7f5b57e00640 1 -- 172.21.15.2:0/4160883940 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b19b985f30 con 0x55b19b9877a0 2024-06-13T02:24:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.016+0000 7f5b5d800640 1 --2- 172.21.15.2:0/4160883940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b990fb0 0x55b19b982660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:24:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.016+0000 7f5b57e00640 1 --2- 172.21.15.2:0/4160883940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b9877a0 0x55b19b982120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5b44009730 tx=0x7f5b44009e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2032329f7e6aa348 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.017+0000 7f5b49600640 1 -- 172.21.15.2:0/4160883940 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4403c030 con 0x55b19b9877a0 2024-06-13T02:24:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.017+0000 7f5b49600640 1 -- 172.21.15.2:0/4160883940 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b4401ed50 con 0x55b19b9877a0 2024-06-13T02:24:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.017+0000 7f5b49600640 1 -- 172.21.15.2:0/4160883940 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4400fdc0 con 0x55b19b9877a0 2024-06-13T02:24:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.018+0000 7f5b62625740 1 -- 172.21.15.2:0/4160883940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b9877a0 msgr2=0x55b19b982120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.018+0000 7f5b62625740 1 --2- 172.21.15.2:0/4160883940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b9877a0 0x55b19b982120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5b44009730 tx=0x7f5b44009e90 comp rx=0 tx=0).stop 2024-06-13T02:24:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.018+0000 7f5b62625740 1 -- 172.21.15.2:0/4160883940 shutdown_connections 2024-06-13T02:24:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.018+0000 7f5b62625740 1 --2- 172.21.15.2:0/4160883940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b990fb0 0x55b19b982660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.018+0000 7f5b62625740 1 --2- 172.21.15.2:0/4160883940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b9877a0 0x55b19b982120 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.018+0000 7f5b62625740 1 --2- 172.21.15.2:0/4160883940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b986230 0x55b19b98e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.018+0000 7f5b62625740 1 -- 172.21.15.2:0/4160883940 >> 172.21.15.2:0/4160883940 conn(0x55b19b94efb0 msgr2=0x55b19b98df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.018+0000 7f5b62625740 1 -- 172.21.15.2:0/4160883940 shutdown_connections 2024-06-13T02:24:22.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.018+0000 7f5b62625740 1 -- 172.21.15.2:0/4160883940 wait complete. 2024-06-13T02:24:22.021 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.019+0000 7f5b62625740 1 -- start start 2024-06-13T02:24:22.022 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.019+0000 7f5b62625740 1 Processor -- start 2024-06-13T02:24:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.019+0000 7f5b62625740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b986230 0x55b19b9946f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b62625740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b9877a0 0x55b19b994c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b62625740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b990fb0 0x55b19ba0a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b62625740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581af700 con 0x55b19b9877a0 2024-06-13T02:24:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b62625740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581b0b70 con 0x55b19b986230 2024-06-13T02:24:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b62625740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b581afdd0 con 0x55b19b990fb0 2024-06-13T02:24:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b62625740 10 client.0 _ll_register_callbacks cb 0x7f5b44009370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:24:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b5ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b986230 0x55b19b9946f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b5ce00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b986230 0x55b19b9946f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:40368/0 (socket says 172.21.15.2:40368) 2024-06-13T02:24:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b5ce00640 1 -- 172.21.15.2:0/3249690853 learned_addr learned my addr 172.21.15.2:0/3249690853 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:22.023 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b57e00640 1 --2- 172.21.15.2:0/3249690853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b9877a0 0x55b19b994c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b5d800640 1 --2- 172.21.15.2:0/3249690853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b990fb0 0x55b19ba0a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b5ce00640 1 -- 172.21.15.2:0/3249690853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b990fb0 msgr2=0x55b19ba0a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b5ce00640 1 --2- 172.21.15.2:0/3249690853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b990fb0 0x55b19ba0a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b5ce00640 1 -- 172.21.15.2:0/3249690853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b9877a0 msgr2=0x55b19b994c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b5ce00640 1 --2- 172.21.15.2:0/3249690853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b9877a0 0x55b19b994c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.020+0000 7f5b5ce00640 1 -- 172.21.15.2:0/3249690853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b19ba0a740 con 0x55b19b986230 2024-06-13T02:24:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.021+0000 7f5b5ce00640 1 --2- 172.21.15.2:0/3249690853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b986230 0x55b19b9946f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0096c0 tx=0x7f5b4c005500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b79de6cee0c36e5f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.021+0000 7f5b3ea00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:24:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.021+0000 7f5b3ea00640 1 -- 172.21.15.2:0/3249690853 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c040040 con 0x55b19b986230 2024-06-13T02:24:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.021+0000 7f5b3ea00640 1 -- 172.21.15.2:0/3249690853 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9583+0+0 (secure 0 0 0) 0x7f5b4c004240 con 0x55b19b986230 2024-06-13T02:24:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.021+0000 7f5b62625740 1 -- 172.21.15.2:0/3249690853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b4401ed50 con 0x55b19b986230 2024-06-13T02:24:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.021+0000 7f5b3ea00640 1 -- 172.21.15.2:0/3249690853 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5b4c060050 con 0x55b19b986230 2024-06-13T02:24:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.021+0000 7f5b62625740 10 client.25781 fetch_fsmap learned FSMap version 33 2024-06-13T02:24:22.024 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.021+0000 7f5b62625740 1 -- 172.21.15.2:0/3249690853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b19ba0ba50 con 0x55b19b986230 2024-06-13T02:24:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.022+0000 7f5b3ea00640 1 -- 172.21.15.2:0/3249690853 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b4401ed50 con 0x55b19b986230 2024-06-13T02:24:22.025 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.022+0000 7f5b3ea00640 1 -- 172.21.15.2:0/3249690853 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f5b4c050420 con 0x55b19b986230 2024-06-13T02:24:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.022+0000 7f5b62625740 10 client.25781 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:24:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.022+0000 7f5b62625740 10 client.25781 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:24:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.022+0000 7f5b62625740 20 client.25781 populate_metadata read hostname 'smithi002' 2024-06-13T02:24:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.022+0000 7f5b62625740 1 --2- 172.21.15.2:0/3249690853 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b19ba0bd90 0x55b19ba0e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.022+0000 7f5b62625740 4 client.25781 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:24:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.022+0000 7f5b62625740 1 -- 172.21.15.2:0/3249690853 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b19b8f1ea0 con 0x55b19ba0bd90 2024-06-13T02:24:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.022+0000 7f5b57e00640 1 --2- 172.21.15.2:0/3249690853 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b19ba0bd90 0x55b19ba0e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.023+0000 7f5b57e00640 1 --2- 172.21.15.2:0/3249690853 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b19ba0bd90 0x55b19ba0e180 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14913114be1645d2 server_cookie=ca0f4f73be1871a3 in_seq=0 out_seq=0 2024-06-13T02:24:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.023+0000 7f5b3ea00640 10 client.25781 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.182+0000 7f5b3ea00640 1 -- 172.21.15.2:0/3249690853 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55b19b8f1ea0 con 0x55b19ba0bd90 2024-06-13T02:24:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.182+0000 7f5b3ea00640 10 client.25781 handle_command_reply: tid=0 2024-06-13T02:24:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.182+0000 7f5b62625740 1 client.25781 shutdown 2024-06-13T02:24:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.183+0000 7f5b62625740 1 -- 172.21.15.2:0/3249690853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b986230 msgr2=0x55b19b9946f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.183+0000 7f5b62625740 1 --2- 172.21.15.2:0/3249690853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b986230 0x55b19b9946f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0096c0 tx=0x7f5b4c005500 comp rx=0 tx=0).stop 2024-06-13T02:24:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.183+0000 7f5b62625740 1 -- 172.21.15.2:0/3249690853 shutdown_connections 2024-06-13T02:24:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.183+0000 7f5b62625740 1 --2- 172.21.15.2:0/3249690853 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b19ba0bd90 0x55b19ba0e180 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.183+0000 7f5b62625740 1 --2- 172.21.15.2:0/3249690853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b19b990fb0 0x55b19ba0a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.183+0000 7f5b62625740 1 --2- 172.21.15.2:0/3249690853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b19b9877a0 0x55b19b994c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.183+0000 7f5b62625740 1 --2- 172.21.15.2:0/3249690853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b19b986230 0x55b19b9946f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.183+0000 7f5b62625740 1 -- 172.21.15.2:0/3249690853 >> 172.21.15.2:0/3249690853 conn(0x55b19b94efb0 msgr2=0x55b19b988620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:22.185 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.183+0000 7f5b3ea00640 0 client.25781 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.183+0000 7f5b62625740 1 -- 172.21.15.2:0/3249690853 shutdown_connections 2024-06-13T02:24:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.183+0000 7f5b62625740 1 -- 172.21.15.2:0/3249690853 wait complete. 2024-06-13T02:24:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.183+0000 7f5b62625740 20 client.25781 trim_cache size 0 max 16384 2024-06-13T02:24:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:24:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:24:22.186 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:24:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.184+0000 7f5b5e200640 1 -- 172.21.15.2:0/1761365538 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5b400a2ce0 msgr2=0x7f5b400a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.184+0000 7f5b5e200640 1 --2- 172.21.15.2:0/1761365538 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5b400a2ce0 0x7f5b400a51a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55b19b9839b0 tx=0x7f5b44005f90 comp rx=0 tx=0).stop 2024-06-13T02:24:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.184+0000 7f5b5e200640 1 -- 172.21.15.2:0/1761365538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b5810bda0 msgr2=0x7f5b5819eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.184+0000 7f5b5e200640 1 --2- 172.21.15.2:0/1761365538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b5810bda0 0x7f5b5819eb50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000eaa0 tx=0x7f5b5000ef60 comp rx=0 tx=0).stop 2024-06-13T02:24:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.184+0000 7f5b5e200640 1 -- 172.21.15.2:0/1761365538 shutdown_connections 2024-06-13T02:24:22.187 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.184+0000 7f5b5e200640 1 --2- 172.21.15.2:0/1761365538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b5810bda0 0x7f5b5819eb50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.184+0000 7f5b5e200640 1 --2- 172.21.15.2:0/1761365538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b581032a0 0x7f5b5819a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.184+0000 7f5b5e200640 1 --2- 172.21.15.2:0/1761365538 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f5b400a2ce0 0x7f5b400a51a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.184+0000 7f5b5e200640 1 --2- 172.21.15.2:0/1761365538 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5b58102980 0x7f5b5819a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.184+0000 7f5b5e200640 1 -- 172.21.15.2:0/1761365538 >> 172.21.15.2:0/1761365538 conn(0x7f5b580fc180 msgr2=0x7f5b581005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.185+0000 7f5b5e200640 1 -- 172.21.15.2:0/1761365538 shutdown_connections 2024-06-13T02:24:22.188 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:22.185+0000 7f5b5e200640 1 -- 172.21.15.2:0/1761365538 wait complete. 2024-06-13T02:24:22.516 INFO:tasks.workunit.client.0.smithi002.stdout: 1 476157 7.96 MB/sec execute 206 sec latency 33.360 ms 2024-06-13T02:24:23.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:22 smithi002 ceph-mon[31960]: pgmap v203: 129 pgs: 129 active+clean; 60 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 2.1 MiB/s wr, 145 op/s 2024-06-13T02:24:23.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:22 smithi084 ceph-mon[36833]: pgmap v203: 129 pgs: 129 active+clean; 60 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 2.1 MiB/s wr, 145 op/s 2024-06-13T02:24:23.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:22 smithi175 ceph-mon[36977]: pgmap v203: 129 pgs: 129 active+clean; 60 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 2.1 MiB/s wr, 145 op/s 2024-06-13T02:24:23.516 INFO:tasks.workunit.client.0.smithi002.stdout: 1 477191 7.94 MB/sec execute 207 sec latency 15.975 ms 2024-06-13T02:24:24.516 INFO:tasks.workunit.client.0.smithi002.stdout: 1 478723 7.93 MB/sec execute 208 sec latency 25.826 ms 2024-06-13T02:24:25.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:24 smithi002 ceph-mon[31960]: pgmap v204: 129 pgs: 129 active+clean; 60 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 2.1 MiB/s wr, 142 op/s 2024-06-13T02:24:25.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:24 smithi084 ceph-mon[36833]: pgmap v204: 129 pgs: 129 active+clean; 60 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 2.1 MiB/s wr, 142 op/s 2024-06-13T02:24:25.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:24 smithi175 ceph-mon[36977]: pgmap v204: 129 pgs: 129 active+clean; 60 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 2.1 MiB/s wr, 142 op/s 2024-06-13T02:24:25.516 INFO:tasks.workunit.client.0.smithi002.stdout: 1 480251 7.94 MB/sec execute 209 sec latency 45.719 ms 2024-06-13T02:24:26.517 INFO:tasks.workunit.client.0.smithi002.stdout: 1 481317 7.93 MB/sec execute 210 sec latency 25.261 ms 2024-06-13T02:24:27.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:26 smithi002 ceph-mon[31960]: pgmap v205: 129 pgs: 129 active+clean; 57 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 2.9 MiB/s wr, 272 op/s 2024-06-13T02:24:27.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:26 smithi084 ceph-mon[36833]: pgmap v205: 129 pgs: 129 active+clean; 57 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 2.9 MiB/s wr, 272 op/s 2024-06-13T02:24:27.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:26 smithi175 ceph-mon[36977]: pgmap v205: 129 pgs: 129 active+clean; 57 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 2.9 MiB/s wr, 272 op/s 2024-06-13T02:24:27.517 INFO:tasks.workunit.client.0.smithi002.stdout: 1 483019 7.94 MB/sec execute 211 sec latency 25.836 ms 2024-06-13T02:24:28.517 INFO:tasks.workunit.client.0.smithi002.stdout: 1 484019 7.92 MB/sec execute 212 sec latency 18.659 ms 2024-06-13T02:24:29.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:28 smithi084 ceph-mon[36833]: pgmap v206: 129 pgs: 129 active+clean; 57 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 2.2 MiB/s wr, 224 op/s 2024-06-13T02:24:29.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:28 smithi175 ceph-mon[36977]: pgmap v206: 129 pgs: 129 active+clean; 57 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 2.2 MiB/s wr, 224 op/s 2024-06-13T02:24:29.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:28 smithi002 ceph-mon[31960]: pgmap v206: 129 pgs: 129 active+clean; 57 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 2.2 MiB/s wr, 224 op/s 2024-06-13T02:24:29.517 INFO:tasks.workunit.client.0.smithi002.stdout: 1 484995 7.91 MB/sec execute 213 sec latency 58.010 ms 2024-06-13T02:24:30.517 INFO:tasks.workunit.client.0.smithi002.stdout: 1 486758 7.93 MB/sec execute 214 sec latency 56.382 ms 2024-06-13T02:24:31.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:30 smithi084 ceph-mon[36833]: pgmap v207: 129 pgs: 129 active+clean; 57 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 2.2 MiB/s wr, 224 op/s 2024-06-13T02:24:31.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:30 smithi175 ceph-mon[36977]: pgmap v207: 129 pgs: 129 active+clean; 57 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 2.2 MiB/s wr, 224 op/s 2024-06-13T02:24:31.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:30 smithi002 ceph-mon[31960]: pgmap v207: 129 pgs: 129 active+clean; 57 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 2.2 MiB/s wr, 224 op/s 2024-06-13T02:24:31.517 INFO:tasks.workunit.client.0.smithi002.stdout: 1 487687 7.90 MB/sec execute 215 sec latency 16.834 ms 2024-06-13T02:24:32.517 INFO:tasks.workunit.client.0.smithi002.stdout: 1 488903 7.89 MB/sec execute 216 sec latency 27.885 ms 2024-06-13T02:24:33.183 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:32 smithi002 ceph-mon[31960]: pgmap v208: 129 pgs: 129 active+clean; 60 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.2 MiB/s wr, 293 op/s 2024-06-13T02:24:33.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:32 smithi084 ceph-mon[36833]: pgmap v208: 129 pgs: 129 active+clean; 60 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.2 MiB/s wr, 293 op/s 2024-06-13T02:24:33.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:32 smithi175 ceph-mon[36977]: pgmap v208: 129 pgs: 129 active+clean; 60 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.2 MiB/s wr, 293 op/s 2024-06-13T02:24:33.517 INFO:tasks.workunit.client.0.smithi002.stdout: 1 490594 7.91 MB/sec execute 217 sec latency 21.314 ms 2024-06-13T02:24:34.517 INFO:tasks.workunit.client.0.smithi002.stdout: 1 491567 7.89 MB/sec execute 218 sec latency 18.220 ms 2024-06-13T02:24:35.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:34 smithi084 ceph-mon[36833]: pgmap v209: 129 pgs: 129 active+clean; 60 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 2.0 MiB/s wr, 220 op/s 2024-06-13T02:24:35.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:34 smithi175 ceph-mon[36977]: pgmap v209: 129 pgs: 129 active+clean; 60 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 2.0 MiB/s wr, 220 op/s 2024-06-13T02:24:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.348+0000 7f2f37200640 1 -- 172.21.15.2:0/2715436009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f30108f00 msgr2=0x7f2f30110ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.348+0000 7f2f37200640 1 --2- 172.21.15.2:0/2715436009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f30108f00 0x7f2f30110ad0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2f28009900 tx=0x7f2f2802a3f0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.348+0000 7f2f37200640 1 -- 172.21.15.2:0/2715436009 shutdown_connections 2024-06-13T02:24:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.348+0000 7f2f37200640 1 --2- 172.21.15.2:0/2715436009 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f30108f00 0x7f2f30110ad0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.348+0000 7f2f37200640 1 --2- 172.21.15.2:0/2715436009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f301047e0 0x7f2f30108820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.348+0000 7f2f37200640 1 --2- 172.21.15.2:0/2715436009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f30103e30 0x7f2f30104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.348+0000 7f2f37200640 1 -- 172.21.15.2:0/2715436009 >> 172.21.15.2:0/2715436009 conn(0x7f2f300ff650 msgr2=0x7f2f30101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.348+0000 7f2f37200640 1 -- 172.21.15.2:0/2715436009 shutdown_connections 2024-06-13T02:24:35.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.348+0000 7f2f37200640 1 -- 172.21.15.2:0/2715436009 wait complete. 2024-06-13T02:24:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.349+0000 7f2f37200640 1 Processor -- start 2024-06-13T02:24:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.349+0000 7f2f37200640 1 -- start start 2024-06-13T02:24:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.350+0000 7f2f37200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f30103e30 0x7f2f3019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.350+0000 7f2f37200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f30108f00 0x7f2f3019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.350+0000 7f2f37200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f3019ece0 0x7f2f3019f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.350+0000 7f2f37200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f30114000 con 0x7f2f30108f00 2024-06-13T02:24:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.350+0000 7f2f37200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2f30113e80 con 0x7f2f3019ece0 2024-06-13T02:24:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.350+0000 7f2f37200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2f30114180 con 0x7f2f30103e30 2024-06-13T02:24:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.350+0000 7f2f2f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f30108f00 0x7f2f3019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.350+0000 7f2f2f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f30108f00 0x7f2f3019a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:58140/0 (socket says 172.21.15.2:58140) 2024-06-13T02:24:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.350+0000 7f2f2fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f30103e30 0x7f2f3019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.350+0000 7f2f35200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f3019ece0 0x7f2f3019f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.350+0000 7f2f2f400640 1 -- 172.21.15.2:0/4084440115 learned_addr learned my addr 172.21.15.2:0/4084440115 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.351+0000 7f2f2f400640 1 -- 172.21.15.2:0/4084440115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f30103e30 msgr2=0x7f2f3019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.351+0000 7f2f2f400640 1 --2- 172.21.15.2:0/4084440115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f30103e30 0x7f2f3019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.351+0000 7f2f2f400640 1 -- 172.21.15.2:0/4084440115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f3019ece0 msgr2=0x7f2f3019f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.351+0000 7f2f2f400640 1 --2- 172.21.15.2:0/4084440115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f3019ece0 0x7f2f3019f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.351+0000 7f2f2f400640 1 -- 172.21.15.2:0/4084440115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f3019f7d0 con 0x7f2f30108f00 2024-06-13T02:24:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.351+0000 7f2f35200640 1 --2- 172.21.15.2:0/4084440115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f3019ece0 0x7f2f3019f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:24:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.351+0000 7f2f2f400640 1 --2- 172.21.15.2:0/4084440115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f30108f00 0x7f2f3019a960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00ec40 tx=0x7f2f1c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.351+0000 7f2f2cc00640 1 -- 172.21.15.2:0/4084440115 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c010630 con 0x7f2f30108f00 2024-06-13T02:24:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.351+0000 7f2f37200640 1 -- 172.21.15.2:0/4084440115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f3019fa60 con 0x7f2f30108f00 2024-06-13T02:24:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.351+0000 7f2f2cc00640 1 -- 172.21.15.2:0/4084440115 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f1c00ee80 con 0x7f2f30108f00 2024-06-13T02:24:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.351+0000 7f2f2cc00640 1 -- 172.21.15.2:0/4084440115 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c018bd0 con 0x7f2f30108f00 2024-06-13T02:24:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.351+0000 7f2f37200640 1 -- 172.21.15.2:0/4084440115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f301a7220 con 0x7f2f30108f00 2024-06-13T02:24:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.355+0000 7f2f3a04d740 1 Processor -- start 2024-06-13T02:24:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.355+0000 7f2f3a04d740 1 -- start start 2024-06-13T02:24:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.355+0000 7f2f3a04d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7d5e0 0x558de5d7bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.355+0000 7f2f3a04d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d7c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.355+0000 7f2f3a04d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d86df0 0x558de5d891e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.355+0000 7f2f3a04d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558de5ce0420 con 0x558de5d86df0 2024-06-13T02:24:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.355+0000 7f2f3a04d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558de5c87c50 con 0x558de5d7d5e0 2024-06-13T02:24:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.355+0000 7f2f3a04d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558de5cdc3e0 con 0x558de5d7c070 2024-06-13T02:24:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.356+0000 7f2f2fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d7c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.356+0000 7f2f2fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d7c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:52842/0 (socket says 172.21.15.2:52842) 2024-06-13T02:24:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.356+0000 7f2f2fe00640 1 -- 172.21.15.2:0/3551669350 learned_addr learned my addr 172.21.15.2:0/3551669350 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.356+0000 7f2f35200640 1 --2- 172.21.15.2:0/3551669350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7d5e0 0x558de5d7bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.356+0000 7f2f2fe00640 1 -- 172.21.15.2:0/3551669350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7d5e0 msgr2=0x558de5d7bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:35.358 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.356+0000 7f2f2fe00640 1 --2- 172.21.15.2:0/3551669350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7d5e0 0x558de5d7bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.356+0000 7f2f2fe00640 1 -- 172.21.15.2:0/3551669350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d86df0 msgr2=0x558de5d891e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-13T02:24:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.356+0000 7f2f2fe00640 1 --2- 172.21.15.2:0/3551669350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d86df0 0x558de5d891e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.356+0000 7f2f2fe00640 1 -- 172.21.15.2:0/3551669350 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558de59f4210 con 0x558de5d7c070 2024-06-13T02:24:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.356+0000 7f2f2fe00640 1 --2- 172.21.15.2:0/3551669350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d7c4f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000bd40 tx=0x7f2f200107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd32ff45c9627217 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.356+0000 7f2f2cc00640 1 -- 172.21.15.2:0/4084440115 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f2f1c0107d0 con 0x7f2f30108f00 2024-06-13T02:24:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.357+0000 7f2f25600640 1 -- 172.21.15.2:0/3551669350 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20004230 con 0x558de5d7c070 2024-06-13T02:24:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.357+0000 7f2f25600640 1 -- 172.21.15.2:0/3551669350 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f2000be30 con 0x558de5d7c070 2024-06-13T02:24:35.359 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.357+0000 7f2f25600640 1 -- 172.21.15.2:0/3551669350 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20011810 con 0x558de5d7c070 2024-06-13T02:24:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.357+0000 7f2f3a04d740 1 -- 172.21.15.2:0/3551669350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 msgr2=0x558de5d7c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.357+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/3551669350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d7c4f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000bd40 tx=0x7f2f200107a0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.358+0000 7f2f3a04d740 1 -- 172.21.15.2:0/3551669350 shutdown_connections 2024-06-13T02:24:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.358+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/3551669350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d86df0 0x558de5d891e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.358+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/3551669350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d7c4f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.358+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/3551669350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7d5e0 0x558de5d7bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.358+0000 7f2f3a04d740 1 -- 172.21.15.2:0/3551669350 >> 172.21.15.2:0/3551669350 conn(0x558de5d44fb0 msgr2=0x558de5d78660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.358+0000 7f2f3a04d740 1 -- 172.21.15.2:0/3551669350 shutdown_connections 2024-06-13T02:24:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.358+0000 7f2f3a04d740 1 -- 172.21.15.2:0/3551669350 wait complete. 2024-06-13T02:24:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.358+0000 7f2f2cc00640 1 --2- 172.21.15.2:0/4084440115 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2f140a2c10 0x7f2f140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.358+0000 7f2f2cc00640 1 -- 172.21.15.2:0/4084440115 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9583+0+0 (secure 0 0 0) 0x7f2f1c0cfef0 con 0x7f2f30108f00 2024-06-13T02:24:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.358+0000 7f2f3a04d740 1 -- start start 2024-06-13T02:24:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.359+0000 7f2f2fe00640 1 --2- 172.21.15.2:0/4084440115 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2f140a2c10 0x7f2f140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.359+0000 7f2f3a04d740 1 Processor -- start 2024-06-13T02:24:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.359+0000 7f2f3a04d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7c070 0x558de5d83e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.359+0000 7f2f3a04d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7d5e0 0x558de5d84370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.359+0000 7f2f3a04d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d86df0 0x558de5d848b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.360+0000 7f2f2fe00640 1 --2- 172.21.15.2:0/4084440115 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2f140a2c10 0x7f2f140a50d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2f20003f10 tx=0x7f2f20000bc0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.360+0000 7f2f3a04d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x558de5d89bc0 con 0x558de5d86df0 2024-06-13T02:24:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.360+0000 7f2f3a04d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558de5c9b0b0 con 0x558de5d7c070 2024-06-13T02:24:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.360+0000 7f2f3a04d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x558de5d89d40 con 0x558de5d7d5e0 2024-06-13T02:24:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.360+0000 7f2f3a04d740 10 client.0 _ll_register_callbacks cb 0x558de5c86f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:24:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.360+0000 7f2f2f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7d5e0 0x558de5d84370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.360+0000 7f2f35200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d86df0 0x558de5d848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.360+0000 7f2f2f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7d5e0 0x558de5d84370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:52858/0 (socket says 172.21.15.2:52858) 2024-06-13T02:24:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.360+0000 7f2f2f400640 1 -- 172.21.15.2:0/3252477687 learned_addr learned my addr 172.21.15.2:0/3252477687 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.360+0000 7f2f2fe00640 1 --2- 172.21.15.2:0/3252477687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7c070 0x558de5d83e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.360+0000 7f2f2f400640 1 -- 172.21.15.2:0/3252477687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7c070 msgr2=0x558de5d83e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.360+0000 7f2f2f400640 1 --2- 172.21.15.2:0/3252477687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7c070 0x558de5d83e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.360+0000 7f2f2f400640 1 -- 172.21.15.2:0/3252477687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d86df0 msgr2=0x558de5d848b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.360+0000 7f2f2f400640 1 --2- 172.21.15.2:0/3252477687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d86df0 0x558de5d848b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.360+0000 7f2f2f400640 1 -- 172.21.15.2:0/3252477687 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558de5ac0620 con 0x558de5d7d5e0 2024-06-13T02:24:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.361+0000 7f2f2f400640 1 --2- 172.21.15.2:0/3252477687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7d5e0 0x558de5d84370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c005fa0 tx=0x7f2f1c011e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca4752b8f7f5f474 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.361+0000 7f2f1a000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:24:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.361+0000 7f2f1a000640 1 -- 172.21.15.2:0/3252477687 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0a0340 con 0x558de5d7d5e0 2024-06-13T02:24:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.361+0000 7f2f3a04d740 1 -- 172.21.15.2:0/3252477687 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f2000be30 con 0x558de5d7d5e0 2024-06-13T02:24:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.361+0000 7f2f1a000640 1 -- 172.21.15.2:0/3252477687 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9583+0+0 (secure 0 0 0) 0x7f2f1c0a4770 con 0x558de5d7d5e0 2024-06-13T02:24:35.364 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.361+0000 7f2f1a000640 1 -- 172.21.15.2:0/3252477687 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2f1c0a4c00 con 0x558de5d7d5e0 2024-06-13T02:24:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.361+0000 7f2f3a04d740 10 client.25780 fetch_fsmap learned FSMap version 33 2024-06-13T02:24:35.365 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.362+0000 7f2f3a04d740 1 -- 172.21.15.2:0/3252477687 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558de5d95f30 con 0x558de5d7d5e0 2024-06-13T02:24:35.366 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.362+0000 7f2f1a000640 1 -- 172.21.15.2:0/3252477687 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f2000be30 con 0x558de5d7d5e0 2024-06-13T02:24:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.362+0000 7f2f1a000640 1 -- 172.21.15.2:0/3252477687 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f2f1c09b490 con 0x558de5d7d5e0 2024-06-13T02:24:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.362+0000 7f2f3a04d740 10 client.25780 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:24:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.362+0000 7f2f3a04d740 10 client.25780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:24:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.362+0000 7f2f3a04d740 20 client.25780 populate_metadata read hostname 'smithi002' 2024-06-13T02:24:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.363+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/3252477687 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x558de5d973f0 0x558de5d997e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.363+0000 7f2f3a04d740 4 client.25780 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:24:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.363+0000 7f2f3a04d740 1 -- 172.21.15.2:0/3252477687 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558de5cedb50 con 0x558de5d973f0 2024-06-13T02:24:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.363+0000 7f2f2fe00640 1 --2- 172.21.15.2:0/3252477687 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x558de5d973f0 0x558de5d997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.364+0000 7f2f2fe00640 1 --2- 172.21.15.2:0/3252477687 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x558de5d973f0 0x558de5d997e0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8da826f9feb7d1f server_cookie=2830417dcf76d34c in_seq=0 out_seq=0 2024-06-13T02:24:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.364+0000 7f2f1a000640 10 client.25780 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.364+0000 7f2f1a000640 1 -- 172.21.15.2:0/3252477687 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558de5cedb50 con 0x558de5d973f0 2024-06-13T02:24:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.364+0000 7f2f1a000640 10 client.25780 handle_command_reply: tid=0 2024-06-13T02:24:35.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.364+0000 7f2f3a04d740 1 client.25780 shutdown 2024-06-13T02:24:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.365+0000 7f2f3a04d740 1 -- 172.21.15.2:0/3252477687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7d5e0 msgr2=0x558de5d84370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.365+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/3252477687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7d5e0 0x558de5d84370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c005fa0 tx=0x7f2f1c011e50 comp rx=0 tx=0).stop 2024-06-13T02:24:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.365+0000 7f2f3a04d740 1 -- 172.21.15.2:0/3252477687 shutdown_connections 2024-06-13T02:24:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.365+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/3252477687 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x558de5d973f0 0x558de5d997e0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.365+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/3252477687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d86df0 0x558de5d848b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.365+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/3252477687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7d5e0 0x558de5d84370 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.365+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/3252477687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7c070 0x558de5d83e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.365+0000 7f2f1a000640 0 client.25780 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.365+0000 7f2f3a04d740 1 -- 172.21.15.2:0/3252477687 >> 172.21.15.2:0/3252477687 conn(0x558de5d44fb0 msgr2=0x558de5d7e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.365+0000 7f2f3a04d740 1 -- 172.21.15.2:0/3252477687 shutdown_connections 2024-06-13T02:24:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.365+0000 7f2f3a04d740 1 -- 172.21.15.2:0/3252477687 wait complete. 2024-06-13T02:24:35.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.365+0000 7f2f3a04d740 20 client.25780 trim_cache size 0 max 16384 2024-06-13T02:24:35.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:34 smithi002 ceph-mon[31960]: pgmap v209: 129 pgs: 129 active+clean; 60 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 2.0 MiB/s wr, 220 op/s 2024-06-13T02:24:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.385+0000 7f2f3a04d740 1 Processor -- start 2024-06-13T02:24:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.385+0000 7f2f3a04d740 1 -- start start 2024-06-13T02:24:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.385+0000 7f2f3a04d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d77fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.385+0000 7f2f3a04d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d7d5e0 0x558de5d78500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.385+0000 7f2f3a04d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d86df0 0x558de5d9f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.385+0000 7f2f3a04d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f301af640 con 0x558de5d7d5e0 2024-06-13T02:24:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.385+0000 7f2f3a04d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2f301acf10 con 0x558de5d86df0 2024-06-13T02:24:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.385+0000 7f2f3a04d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2f301aada0 con 0x558de5d7c070 2024-06-13T02:24:35.387 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.385+0000 7f2f2fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d77fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.386+0000 7f2f2fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d77fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:52860/0 (socket says 172.21.15.2:52860) 2024-06-13T02:24:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.386+0000 7f2f2f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d7d5e0 0x558de5d78500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.386+0000 7f2f2fe00640 1 -- 172.21.15.2:0/2109210210 learned_addr learned my addr 172.21.15.2:0/2109210210 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:35.388 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.386+0000 7f2f35200640 1 --2- 172.21.15.2:0/2109210210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d86df0 0x558de5d9f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.386+0000 7f2f2fe00640 1 -- 172.21.15.2:0/2109210210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d86df0 msgr2=0x558de5d9f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:35.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.386+0000 7f2f2fe00640 1 --2- 172.21.15.2:0/2109210210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d86df0 0x558de5d9f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.386+0000 7f2f2fe00640 1 -- 172.21.15.2:0/2109210210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d7d5e0 msgr2=0x558de5d78500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:35.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.386+0000 7f2f2fe00640 1 --2- 172.21.15.2:0/2109210210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d7d5e0 0x558de5d78500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.389 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.386+0000 7f2f2fe00640 1 -- 172.21.15.2:0/2109210210 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558de5d797f0 con 0x558de5d7c070 2024-06-13T02:24:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.386+0000 7f2f2fe00640 1 --2- 172.21.15.2:0/2109210210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d77fc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2f200043e0 tx=0x7f2f20021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d37a1c991df1f8a3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.387+0000 7f2f24c00640 1 -- 172.21.15.2:0/2109210210 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20004090 con 0x558de5d7c070 2024-06-13T02:24:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.387+0000 7f2f24c00640 1 -- 172.21.15.2:0/2109210210 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f20003ad0 con 0x558de5d7c070 2024-06-13T02:24:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.387+0000 7f2f24c00640 1 -- 172.21.15.2:0/2109210210 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20004e50 con 0x558de5d7c070 2024-06-13T02:24:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.387+0000 7f2f3a04d740 1 -- 172.21.15.2:0/2109210210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 msgr2=0x558de5d77fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.387+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/2109210210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d77fc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2f200043e0 tx=0x7f2f20021000 comp rx=0 tx=0).stop 2024-06-13T02:24:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.387+0000 7f2f3a04d740 1 -- 172.21.15.2:0/2109210210 shutdown_connections 2024-06-13T02:24:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.387+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/2109210210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d86df0 0x558de5d9f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.387+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/2109210210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d7d5e0 0x558de5d78500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.387+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/2109210210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d77fc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.387+0000 7f2f3a04d740 1 -- 172.21.15.2:0/2109210210 >> 172.21.15.2:0/2109210210 conn(0x558de5d44fb0 msgr2=0x558de5d85ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.388+0000 7f2f3a04d740 1 -- 172.21.15.2:0/2109210210 shutdown_connections 2024-06-13T02:24:35.390 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.388+0000 7f2f3a04d740 1 -- 172.21.15.2:0/2109210210 wait complete. 2024-06-13T02:24:35.391 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.388+0000 7f2f3a04d740 1 -- start start 2024-06-13T02:24:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.388+0000 7f2f3a04d740 1 Processor -- start 2024-06-13T02:24:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f3a04d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d80eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f3a04d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7d5e0 0x558de5d813f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f3a04d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d86df0 0x558de5d81930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f3a04d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f301ab3f0 con 0x558de5d86df0 2024-06-13T02:24:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f3a04d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2f301ac840 con 0x558de5d7d5e0 2024-06-13T02:24:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f3a04d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2f301abaa0 con 0x558de5d7c070 2024-06-13T02:24:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f3a04d740 10 client.0 _ll_register_callbacks cb 0x7f2f1c018530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:24:35.393 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f2fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d80eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f2f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7d5e0 0x558de5d813f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f35200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d86df0 0x558de5d81930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f2fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d80eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:52874/0 (socket says 172.21.15.2:52874) 2024-06-13T02:24:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f2fe00640 1 -- 172.21.15.2:0/806528128 learned_addr learned my addr 172.21.15.2:0/806528128 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f2fe00640 1 -- 172.21.15.2:0/806528128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7d5e0 msgr2=0x558de5d813f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f2fe00640 1 --2- 172.21.15.2:0/806528128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7d5e0 0x558de5d813f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f2fe00640 1 -- 172.21.15.2:0/806528128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d86df0 msgr2=0x558de5d81930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f2fe00640 1 --2- 172.21.15.2:0/806528128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d86df0 0x558de5d81930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f2fe00640 1 -- 172.21.15.2:0/806528128 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558de5e01030 con 0x558de5d7c070 2024-06-13T02:24:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.389+0000 7f2f2f400640 1 --2- 172.21.15.2:0/806528128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7d5e0 0x558de5d813f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:24:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.390+0000 7f2f2fe00640 1 --2- 172.21.15.2:0/806528128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d80eb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f200049f0 tx=0x7f2f20003c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55c6f0e018c59f55 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:35.394 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.390+0000 7f2f1a000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:24:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.390+0000 7f2f1a000640 1 -- 172.21.15.2:0/806528128 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20040020 con 0x558de5d7c070 2024-06-13T02:24:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.390+0000 7f2f3a04d740 1 -- 172.21.15.2:0/806528128 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f20003ad0 con 0x558de5d7c070 2024-06-13T02:24:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.390+0000 7f2f1a000640 1 -- 172.21.15.2:0/806528128 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9583+0+0 (secure 0 0 0) 0x7f2f20004490 con 0x558de5d7c070 2024-06-13T02:24:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.391+0000 7f2f1a000640 1 -- 172.21.15.2:0/806528128 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2f20004690 con 0x558de5d7c070 2024-06-13T02:24:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.391+0000 7f2f3a04d740 10 client.25786 fetch_fsmap learned FSMap version 33 2024-06-13T02:24:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.391+0000 7f2f3a04d740 1 -- 172.21.15.2:0/806528128 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558de5e02320 con 0x558de5d7c070 2024-06-13T02:24:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.391+0000 7f2f1a000640 1 -- 172.21.15.2:0/806528128 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f20003ad0 con 0x558de5d7c070 2024-06-13T02:24:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.391+0000 7f2f1a000640 1 -- 172.21.15.2:0/806528128 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 33) ==== 8346+0+0 (secure 0 0 0) 0x7f2f2001bc40 con 0x558de5d7c070 2024-06-13T02:24:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.391+0000 7f2f3a04d740 10 client.25786 fetch_fsmap finished waiting for FSMap version 33 2024-06-13T02:24:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.391+0000 7f2f3a04d740 10 client.25786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:24:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.391+0000 7f2f3a04d740 20 client.25786 populate_metadata read hostname 'smithi002' 2024-06-13T02:24:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.391+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/806528128 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x558de5e028b0 0x558de5e04cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.391+0000 7f2f3a04d740 4 client.25786 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:24:35.395 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.391+0000 7f2f3a04d740 1 -- 172.21.15.2:0/806528128 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558de5ce7ea0 con 0x558de5e028b0 2024-06-13T02:24:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.391+0000 7f2f2f400640 1 --2- 172.21.15.2:0/806528128 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x558de5e028b0 0x558de5e04cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.392+0000 7f2f2f400640 1 --2- 172.21.15.2:0/806528128 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x558de5e028b0 0x558de5e04cd0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b60f3e2c6d468d3 server_cookie=dcb3de9556e84a97 in_seq=0 out_seq=0 2024-06-13T02:24:35.396 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.392+0000 7f2f1a000640 10 client.25786 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:35.518 INFO:tasks.workunit.client.0.smithi002.stdout: 1 492716 7.87 MB/sec execute 219 sec latency 110.778 ms 2024-06-13T02:24:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.640+0000 7f2f1a000640 1 -- 172.21.15.2:0/806528128 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x558de5ce7ea0 con 0x558de5e028b0 2024-06-13T02:24:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.640+0000 7f2f1a000640 10 client.25786 handle_command_reply: tid=0 2024-06-13T02:24:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.640+0000 7f2f3a04d740 1 client.25786 shutdown 2024-06-13T02:24:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.640+0000 7f2f3a04d740 1 -- 172.21.15.2:0/806528128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 msgr2=0x558de5d80eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.640+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/806528128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d80eb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f200049f0 tx=0x7f2f20003c80 comp rx=0 tx=0).stop 2024-06-13T02:24:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.641+0000 7f2f3a04d740 1 -- 172.21.15.2:0/806528128 shutdown_connections 2024-06-13T02:24:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.641+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/806528128 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x558de5e028b0 0x558de5e04cd0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.641+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/806528128 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x558de5d86df0 0x558de5d81930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.641+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/806528128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558de5d7d5e0 0x558de5d813f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.641+0000 7f2f3a04d740 1 --2- 172.21.15.2:0/806528128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558de5d7c070 0x558de5d80eb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.641+0000 7f2f3a04d740 1 -- 172.21.15.2:0/806528128 >> 172.21.15.2:0/806528128 conn(0x558de5d44fb0 msgr2=0x558de5d7dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.641+0000 7f2f1a000640 0 client.25786 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.641+0000 7f2f3a04d740 1 -- 172.21.15.2:0/806528128 shutdown_connections 2024-06-13T02:24:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.641+0000 7f2f3a04d740 1 -- 172.21.15.2:0/806528128 wait complete. 2024-06-13T02:24:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.642+0000 7f2f3a04d740 20 client.25786 trim_cache size 0 max 16384 2024-06-13T02:24:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:24:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:24:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:24:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.643+0000 7f2f37200640 1 -- 172.21.15.2:0/4084440115 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2f140a2c10 msgr2=0x7f2f140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.643+0000 7f2f37200640 1 --2- 172.21.15.2:0/4084440115 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2f140a2c10 0x7f2f140a50d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2f20003f10 tx=0x7f2f20000bc0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.643+0000 7f2f37200640 1 -- 172.21.15.2:0/4084440115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f30108f00 msgr2=0x7f2f3019a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.643+0000 7f2f37200640 1 --2- 172.21.15.2:0/4084440115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f30108f00 0x7f2f3019a960 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00ec40 tx=0x7f2f1c00c6a0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.644+0000 7f2f37200640 1 -- 172.21.15.2:0/4084440115 shutdown_connections 2024-06-13T02:24:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.644+0000 7f2f37200640 1 --2- 172.21.15.2:0/4084440115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f3019ece0 0x7f2f3019f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.644+0000 7f2f37200640 1 --2- 172.21.15.2:0/4084440115 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f2f140a2c10 0x7f2f140a50d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.644+0000 7f2f37200640 1 --2- 172.21.15.2:0/4084440115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f30108f00 0x7f2f3019a960 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.644+0000 7f2f37200640 1 --2- 172.21.15.2:0/4084440115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f30103e30 0x7f2f3019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.644+0000 7f2f37200640 1 -- 172.21.15.2:0/4084440115 >> 172.21.15.2:0/4084440115 conn(0x7f2f300ff650 msgr2=0x7f2f30100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.645+0000 7f2f37200640 1 -- 172.21.15.2:0/4084440115 shutdown_connections 2024-06-13T02:24:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:35.645+0000 7f2f37200640 1 -- 172.21.15.2:0/4084440115 wait complete. 2024-06-13T02:24:36.471 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:24:36 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: ignoring --setuser ceph since I am not root 2024-06-13T02:24:36.471 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:24:36 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: ignoring --setgroup ceph since I am not root 2024-06-13T02:24:36.471 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:24:36 smithi084 ceph-mds[66763]: -- 172.21.15.84:0/55255543 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b19e15fa40 con 0x55b19e132c00 2024-06-13T02:24:36.471 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:24:36 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: starting mds.h at 2024-06-13T02:24:36.518 INFO:tasks.workunit.client.0.smithi002.stdout: 1 494266 7.89 MB/sec execute 220 sec latency 133.506 ms 2024-06-13T02:24:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:36 smithi084 ceph-mon[36833]: pgmap v210: 129 pgs: 129 active+clean; 82 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.4 MiB/s wr, 382 op/s 2024-06-13T02:24:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:36 smithi084 ceph-mon[36833]: daemon mds.h restarted 2024-06-13T02:24:37.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:36 smithi175 ceph-mon[36977]: pgmap v210: 129 pgs: 129 active+clean; 82 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.4 MiB/s wr, 382 op/s 2024-06-13T02:24:37.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:36 smithi175 ceph-mon[36977]: daemon mds.h restarted 2024-06-13T02:24:37.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:36 smithi002 ceph-mon[31960]: pgmap v210: 129 pgs: 129 active+clean; 82 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.4 MiB/s wr, 382 op/s 2024-06-13T02:24:37.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:36 smithi002 ceph-mon[31960]: daemon mds.h restarted 2024-06-13T02:24:37.518 INFO:tasks.workunit.client.0.smithi002.stdout: 1 495382 7.88 MB/sec execute 221 sec latency 20.677 ms 2024-06-13T02:24:38.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:37 smithi084 ceph-mon[36833]: osdmap e106: 12 total, 12 up, 12 in 2024-06-13T02:24:38.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:37 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:24:38.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:37 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.84:6836/1703173590,v1:172.21.15.84:6837/1703173590] up:boot 2024-06-13T02:24:38.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:37 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-06-13T02:24:38.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:37 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:24:38.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:37 smithi175 ceph-mon[36977]: osdmap e106: 12 total, 12 up, 12 in 2024-06-13T02:24:38.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:37 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:24:38.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:37 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.84:6836/1703173590,v1:172.21.15.84:6837/1703173590] up:boot 2024-06-13T02:24:38.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:37 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-06-13T02:24:38.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:37 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:24:38.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:37 smithi002 ceph-mon[31960]: osdmap e106: 12 total, 12 up, 12 in 2024-06-13T02:24:38.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:37 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:24:38.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:37 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.84:6836/1703173590,v1:172.21.15.84:6837/1703173590] up:boot 2024-06-13T02:24:38.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:37 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-06-13T02:24:38.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:37 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:24:38.518 INFO:tasks.workunit.client.0.smithi002.stdout: 1 497212 7.89 MB/sec execute 222 sec latency 24.637 ms 2024-06-13T02:24:39.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:38 smithi084 ceph-mon[36833]: pgmap v212: 129 pgs: 129 active+clean; 82 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 4.0 MiB/s wr, 277 op/s 2024-06-13T02:24:39.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:38 smithi175 ceph-mon[36977]: pgmap v212: 129 pgs: 129 active+clean; 82 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 4.0 MiB/s wr, 277 op/s 2024-06-13T02:24:39.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:38 smithi002 ceph-mon[31960]: pgmap v212: 129 pgs: 129 active+clean; 82 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 4.0 MiB/s wr, 277 op/s 2024-06-13T02:24:39.518 INFO:tasks.workunit.client.0.smithi002.stdout: 1 498323 7.88 MB/sec execute 223 sec latency 21.154 ms 2024-06-13T02:24:40.519 INFO:tasks.workunit.client.0.smithi002.stdout: 1 499380 7.86 MB/sec execute 224 sec latency 73.835 ms 2024-06-13T02:24:41.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:40 smithi084 ceph-mon[36833]: pgmap v213: 129 pgs: 129 active+clean; 82 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 4.0 MiB/s wr, 277 op/s 2024-06-13T02:24:41.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:40 smithi175 ceph-mon[36977]: pgmap v213: 129 pgs: 129 active+clean; 82 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 4.0 MiB/s wr, 277 op/s 2024-06-13T02:24:41.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:40 smithi002 ceph-mon[31960]: pgmap v213: 129 pgs: 129 active+clean; 82 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 885 KiB/s rd, 4.0 MiB/s wr, 277 op/s 2024-06-13T02:24:41.519 INFO:tasks.workunit.client.0.smithi002.stdout: 1 501321 7.89 MB/sec execute 225 sec latency 34.872 ms 2024-06-13T02:24:42.519 INFO:tasks.workunit.client.0.smithi002.stdout: 1 502447 7.88 MB/sec execute 226 sec latency 18.411 ms 2024-06-13T02:24:43.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:42 smithi084 ceph-mon[36833]: pgmap v214: 129 pgs: 129 active+clean; 77 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.1 MiB/s wr, 315 op/s 2024-06-13T02:24:43.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:42 smithi175 ceph-mon[36977]: pgmap v214: 129 pgs: 129 active+clean; 77 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.1 MiB/s wr, 315 op/s 2024-06-13T02:24:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:42 smithi002 ceph-mon[31960]: pgmap v214: 129 pgs: 129 active+clean; 77 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.1 MiB/s wr, 315 op/s 2024-06-13T02:24:43.519 INFO:tasks.workunit.client.0.smithi002.stdout: 1 504311 7.88 MB/sec execute 227 sec latency 22.580 ms 2024-06-13T02:24:44.519 INFO:tasks.workunit.client.0.smithi002.stdout: 1 505435 7.87 MB/sec execute 228 sec latency 23.359 ms 2024-06-13T02:24:45.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:44 smithi084 ceph-mon[36833]: pgmap v215: 129 pgs: 129 active+clean; 77 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.1 MiB/s wr, 315 op/s 2024-06-13T02:24:45.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:44 smithi175 ceph-mon[36977]: pgmap v215: 129 pgs: 129 active+clean; 77 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.1 MiB/s wr, 315 op/s 2024-06-13T02:24:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:44 smithi002 ceph-mon[31960]: pgmap v215: 129 pgs: 129 active+clean; 77 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.1 MiB/s wr, 315 op/s 2024-06-13T02:24:45.519 INFO:tasks.workunit.client.0.smithi002.stdout: 1 506385 7.86 MB/sec execute 229 sec latency 28.518 ms 2024-06-13T02:24:46.520 INFO:tasks.workunit.client.0.smithi002.stdout: 1 508171 7.88 MB/sec execute 230 sec latency 30.883 ms 2024-06-13T02:24:47.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:46 smithi084 ceph-mon[36833]: pgmap v216: 129 pgs: 129 active+clean; 83 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 183 op/s 2024-06-13T02:24:47.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:46 smithi175 ceph-mon[36977]: pgmap v216: 129 pgs: 129 active+clean; 83 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 183 op/s 2024-06-13T02:24:47.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:46 smithi002 ceph-mon[31960]: pgmap v216: 129 pgs: 129 active+clean; 83 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 183 op/s 2024-06-13T02:24:47.520 INFO:tasks.workunit.client.0.smithi002.stdout: 1 509070 7.86 MB/sec execute 231 sec latency 18.393 ms 2024-06-13T02:24:48.521 INFO:tasks.workunit.client.0.smithi002.stdout: 1 510179 7.84 MB/sec execute 232 sec latency 26.786 ms 2024-06-13T02:24:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.823+0000 7fdd13200640 1 -- 172.21.15.2:0/362053816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0c103e30 msgr2=0x7fdd0c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.823+0000 7fdd13200640 1 --2- 172.21.15.2:0/362053816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0c103e30 0x7fdd0c104210 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009ca0 tx=0x7fdd0402a8c0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.823+0000 7fdd13200640 1 -- 172.21.15.2:0/362053816 shutdown_connections 2024-06-13T02:24:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.823+0000 7fdd13200640 1 --2- 172.21.15.2:0/362053816 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd0c108f00 0x7fdd0c110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.823+0000 7fdd13200640 1 --2- 172.21.15.2:0/362053816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd0c1047e0 0x7fdd0c108820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.823+0000 7fdd13200640 1 --2- 172.21.15.2:0/362053816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0c103e30 0x7fdd0c104210 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.823+0000 7fdd13200640 1 -- 172.21.15.2:0/362053816 >> 172.21.15.2:0/362053816 conn(0x7fdd0c0ff650 msgr2=0x7fdd0c101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.823+0000 7fdd13200640 1 -- 172.21.15.2:0/362053816 shutdown_connections 2024-06-13T02:24:48.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.823+0000 7fdd13200640 1 -- 172.21.15.2:0/362053816 wait complete. 2024-06-13T02:24:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.824+0000 7fdd13200640 1 Processor -- start 2024-06-13T02:24:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.824+0000 7fdd13200640 1 -- start start 2024-06-13T02:24:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd13200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd0c103e30 0x7fdd0c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd13200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd0c108f00 0x7fdd0c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd13200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0c19ed60 0x7fdd0c19f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd13200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c113fb0 con 0x7fdd0c103e30 2024-06-13T02:24:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd13200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c113e30 con 0x7fdd0c19ed60 2024-06-13T02:24:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd13200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c114130 con 0x7fdd0c108f00 2024-06-13T02:24:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd0be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd0c103e30 0x7fdd0c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd0b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd0c108f00 0x7fdd0c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd11200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0c19ed60 0x7fdd0c19f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd0b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd0c108f00 0x7fdd0c19aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:54422/0 (socket says 172.21.15.2:54422) 2024-06-13T02:24:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd0b400640 1 -- 172.21.15.2:0/3151973612 learned_addr learned my addr 172.21.15.2:0/3151973612 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd11200640 1 --2- 172.21.15.2:0/3151973612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0c19ed60 0x7fdd0c19f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:57684/0 (socket says 172.21.15.2:57684) 2024-06-13T02:24:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd0b400640 1 -- 172.21.15.2:0/3151973612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0c19ed60 msgr2=0x7fdd0c19f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd0b400640 1 --2- 172.21.15.2:0/3151973612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0c19ed60 0x7fdd0c19f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd0b400640 1 -- 172.21.15.2:0/3151973612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd0c103e30 msgr2=0x7fdd0c19a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd0b400640 1 --2- 172.21.15.2:0/3151973612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd0c103e30 0x7fdd0c19a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.825+0000 7fdd0b400640 1 -- 172.21.15.2:0/3151973612 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd0c19f850 con 0x7fdd0c108f00 2024-06-13T02:24:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.826+0000 7fdd0b400640 1 --2- 172.21.15.2:0/3151973612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd0c108f00 0x7fdd0c19aa30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400d950 tx=0x7fdcf400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.826+0000 7fdd08c00640 1 -- 172.21.15.2:0/3151973612 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4017070 con 0x7fdd0c108f00 2024-06-13T02:24:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.826+0000 7fdd08c00640 1 -- 172.21.15.2:0/3151973612 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcf4009c30 con 0x7fdd0c108f00 2024-06-13T02:24:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.826+0000 7fdd08c00640 1 -- 172.21.15.2:0/3151973612 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf400f6b0 con 0x7fdd0c108f00 2024-06-13T02:24:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.826+0000 7fdd13200640 1 -- 172.21.15.2:0/3151973612 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd0c19fb40 con 0x7fdd0c108f00 2024-06-13T02:24:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.827+0000 7fdd13200640 1 -- 172.21.15.2:0/3151973612 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd0c1a72e0 con 0x7fdd0c108f00 2024-06-13T02:24:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.831+0000 7fdd08c00640 1 -- 172.21.15.2:0/3151973612 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fdcf401a070 con 0x7fdd0c108f00 2024-06-13T02:24:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.831+0000 7fdd161b4740 1 Processor -- start 2024-06-13T02:24:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.831+0000 7fdd161b4740 1 -- start start 2024-06-13T02:24:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.831+0000 7fdd161b4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7b25e0 0x5649ca7b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.831+0000 7fdd161b4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.831+0000 7fdd161b4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7bbdf0 0x5649ca7be1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.831+0000 7fdd161b4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5649ca715420 con 0x5649ca7b25e0 2024-06-13T02:24:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.831+0000 7fdd161b4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5649ca6bcc50 con 0x5649ca7bbdf0 2024-06-13T02:24:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.831+0000 7fdd161b4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5649ca7113e0 con 0x5649ca7b1070 2024-06-13T02:24:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.832+0000 7fdd0be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.832+0000 7fdd0b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7bbdf0 0x5649ca7be1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.832+0000 7fdd11200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7b25e0 0x5649ca7b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.832+0000 7fdd0be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:54438/0 (socket says 172.21.15.2:54438) 2024-06-13T02:24:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.832+0000 7fdd0be00640 1 -- 172.21.15.2:0/1336094148 learned_addr learned my addr 172.21.15.2:0/1336094148 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.832+0000 7fdd0be00640 1 -- 172.21.15.2:0/1336094148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7bbdf0 msgr2=0x5649ca7be1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.832+0000 7fdd0be00640 1 --2- 172.21.15.2:0/1336094148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7bbdf0 0x5649ca7be1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.832+0000 7fdd0be00640 1 -- 172.21.15.2:0/1336094148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7b25e0 msgr2=0x5649ca7b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.832+0000 7fdd0be00640 1 --2- 172.21.15.2:0/1336094148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7b25e0 0x5649ca7b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.832+0000 7fdd0be00640 1 -- 172.21.15.2:0/1336094148 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649ca429210 con 0x5649ca7b1070 2024-06-13T02:24:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.832+0000 7fdd08c00640 1 --2- 172.21.15.2:0/3151973612 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fdcf00a2d70 0x7fdcf00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.832+0000 7fdd0be00640 1 --2- 172.21.15.2:0/1336094148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7b14f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009ca0 tx=0x7fdd04005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3de1c42feaa808a6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.833+0000 7fdd11200640 1 --2- 172.21.15.2:0/3151973612 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fdcf00a2d70 0x7fdcf00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.833+0000 7fdd01600640 1 -- 172.21.15.2:0/1336094148 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd04049070 con 0x5649ca7b1070 2024-06-13T02:24:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.833+0000 7fdd08c00640 1 -- 172.21.15.2:0/3151973612 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9495+0+0 (secure 0 0 0) 0x7fdcf40cf1c0 con 0x7fdd0c108f00 2024-06-13T02:24:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.833+0000 7fdd01600640 1 -- 172.21.15.2:0/1336094148 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd04036040 con 0x5649ca7b1070 2024-06-13T02:24:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.833+0000 7fdd01600640 1 -- 172.21.15.2:0/1336094148 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0402fb50 con 0x5649ca7b1070 2024-06-13T02:24:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.834+0000 7fdd161b4740 1 -- 172.21.15.2:0/1336094148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 msgr2=0x5649ca7b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.834+0000 7fdd161b4740 1 --2- 172.21.15.2:0/1336094148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7b14f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009ca0 tx=0x7fdd04005fa0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.834+0000 7fdd11200640 1 --2- 172.21.15.2:0/3151973612 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fdcf00a2d70 0x7fdcf00a5230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00b650 tx=0x7fdcfc00b2e0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.834+0000 7fdd161b4740 1 -- 172.21.15.2:0/1336094148 shutdown_connections 2024-06-13T02:24:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.834+0000 7fdd161b4740 1 --2- 172.21.15.2:0/1336094148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7bbdf0 0x5649ca7be1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.834+0000 7fdd161b4740 1 --2- 172.21.15.2:0/1336094148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7b14f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.834+0000 7fdd161b4740 1 --2- 172.21.15.2:0/1336094148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7b25e0 0x5649ca7b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.834+0000 7fdd161b4740 1 -- 172.21.15.2:0/1336094148 >> 172.21.15.2:0/1336094148 conn(0x5649ca779fb0 msgr2=0x5649ca7ad660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.835+0000 7fdd161b4740 1 -- 172.21.15.2:0/1336094148 shutdown_connections 2024-06-13T02:24:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.835+0000 7fdd161b4740 1 -- 172.21.15.2:0/1336094148 wait complete. 2024-06-13T02:24:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.835+0000 7fdd161b4740 1 -- start start 2024-06-13T02:24:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.835+0000 7fdd161b4740 1 Processor -- start 2024-06-13T02:24:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.836+0000 7fdd161b4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7b8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.836+0000 7fdd161b4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b25e0 0x5649ca7b9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.836+0000 7fdd161b4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 0x5649ca7b98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.836+0000 7fdd161b4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5649ca7be9e0 con 0x5649ca7bbdf0 2024-06-13T02:24:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.836+0000 7fdd161b4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5649ca6d00b0 con 0x5649ca7b25e0 2024-06-13T02:24:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.836+0000 7fdd161b4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5649ca7beb60 con 0x5649ca7b1070 2024-06-13T02:24:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.836+0000 7fdd161b4740 10 client.0 _ll_register_callbacks cb 0x5649ca6bbf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:24:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.836+0000 7fdd0b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b25e0 0x5649ca7b9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.836+0000 7fdd0b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b25e0 0x5649ca7b9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:57696/0 (socket says 172.21.15.2:57696) 2024-06-13T02:24:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.836+0000 7fdd0b400640 1 -- 172.21.15.2:0/1869985532 learned_addr learned my addr 172.21.15.2:0/1869985532 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.836+0000 7fdd11200640 1 --2- 172.21.15.2:0/1869985532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 0x5649ca7b98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.836+0000 7fdd0be00640 1 --2- 172.21.15.2:0/1869985532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7b8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.837+0000 7fdd0b400640 1 -- 172.21.15.2:0/1869985532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 msgr2=0x5649ca7b8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.837+0000 7fdd0b400640 1 --2- 172.21.15.2:0/1869985532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7b8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.837+0000 7fdd0b400640 1 -- 172.21.15.2:0/1869985532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 msgr2=0x5649ca7b98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.837+0000 7fdd0b400640 1 --2- 172.21.15.2:0/1869985532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 0x5649ca7b98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.837+0000 7fdd0b400640 1 -- 172.21.15.2:0/1869985532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649ca4f5620 con 0x5649ca7b25e0 2024-06-13T02:24:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.837+0000 7fdd0b400640 1 --2- 172.21.15.2:0/1869985532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b25e0 0x5649ca7b9380 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40cc5a0 tx=0x7fdcf40d2f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac824dd90b8349de server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.837+0000 7fdcfa000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:24:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.837+0000 7fdcfa000640 1 -- 172.21.15.2:0/1869985532 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4021070 con 0x5649ca7b25e0 2024-06-13T02:24:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.837+0000 7fdcfa000640 1 -- 172.21.15.2:0/1869985532 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9495+0+0 (secure 0 0 0) 0x7fdcf4097a30 con 0x5649ca7b25e0 2024-06-13T02:24:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.837+0000 7fdd161b4740 1 -- 172.21.15.2:0/1869985532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd04036040 con 0x5649ca7b25e0 2024-06-13T02:24:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.837+0000 7fdcfa000640 1 -- 172.21.15.2:0/1869985532 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdcf409af00 con 0x5649ca7b25e0 2024-06-13T02:24:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.837+0000 7fdd161b4740 10 client.25817 fetch_fsmap learned FSMap version 35 2024-06-13T02:24:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.837+0000 7fdd161b4740 1 -- 172.21.15.2:0/1869985532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5649ca7cade0 con 0x5649ca7b25e0 2024-06-13T02:24:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.838+0000 7fdcfa000640 1 -- 172.21.15.2:0/1869985532 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd04036040 con 0x5649ca7b25e0 2024-06-13T02:24:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.838+0000 7fdcfa000640 1 -- 172.21.15.2:0/1869985532 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fdcf40bb0e0 con 0x5649ca7b25e0 2024-06-13T02:24:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.838+0000 7fdd161b4740 10 client.25817 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:24:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.838+0000 7fdd161b4740 10 client.25817 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:24:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.838+0000 7fdd161b4740 20 client.25817 populate_metadata read hostname 'smithi002' 2024-06-13T02:24:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.838+0000 7fdd161b4740 1 --2- 172.21.15.2:0/1869985532 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ca7cc2a0 0x5649ca7ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.838+0000 7fdd161b4740 4 client.25817 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:24:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.838+0000 7fdd161b4740 1 -- 172.21.15.2:0/1869985532 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649ca722b50 con 0x5649ca7cc2a0 2024-06-13T02:24:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.838+0000 7fdd0be00640 1 --2- 172.21.15.2:0/1869985532 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ca7cc2a0 0x5649ca7ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.839+0000 7fdd0be00640 1 --2- 172.21.15.2:0/1869985532 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ca7cc2a0 0x5649ca7ce690 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c25b38c6dc72aa3 server_cookie=a53c9916c5dd7aaf in_seq=0 out_seq=0 2024-06-13T02:24:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.839+0000 7fdcfa000640 10 client.25817 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.840+0000 7fdcfa000640 1 -- 172.21.15.2:0/1869985532 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5649ca722b50 con 0x5649ca7cc2a0 2024-06-13T02:24:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.840+0000 7fdcfa000640 10 client.25817 handle_command_reply: tid=0 2024-06-13T02:24:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.840+0000 7fdd161b4740 1 client.25817 shutdown 2024-06-13T02:24:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.840+0000 7fdd161b4740 1 -- 172.21.15.2:0/1869985532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b25e0 msgr2=0x5649ca7b9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.840+0000 7fdd161b4740 1 --2- 172.21.15.2:0/1869985532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b25e0 0x5649ca7b9380 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40cc5a0 tx=0x7fdcf40d2f80 comp rx=0 tx=0).stop 2024-06-13T02:24:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.840+0000 7fdd161b4740 1 -- 172.21.15.2:0/1869985532 shutdown_connections 2024-06-13T02:24:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.840+0000 7fdd161b4740 1 --2- 172.21.15.2:0/1869985532 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ca7cc2a0 0x5649ca7ce690 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.840+0000 7fdd161b4740 1 --2- 172.21.15.2:0/1869985532 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 0x5649ca7b98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.840+0000 7fdd161b4740 1 --2- 172.21.15.2:0/1869985532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b25e0 0x5649ca7b9380 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.840+0000 7fdd161b4740 1 --2- 172.21.15.2:0/1869985532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7b8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.840+0000 7fdcfa000640 0 client.25817 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.840+0000 7fdd161b4740 1 -- 172.21.15.2:0/1869985532 >> 172.21.15.2:0/1869985532 conn(0x5649ca779fb0 msgr2=0x5649ca7b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.840+0000 7fdd161b4740 1 -- 172.21.15.2:0/1869985532 shutdown_connections 2024-06-13T02:24:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.841+0000 7fdd161b4740 1 -- 172.21.15.2:0/1869985532 wait complete. 2024-06-13T02:24:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.841+0000 7fdd161b4740 20 client.25817 trim_cache size 0 max 16384 2024-06-13T02:24:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.859+0000 7fdd161b4740 1 Processor -- start 2024-06-13T02:24:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.860+0000 7fdd161b4740 1 -- start start 2024-06-13T02:24:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.860+0000 7fdd161b4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.860+0000 7fdd161b4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b25e0 0x5649ca7d3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.860+0000 7fdd161b4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 0x5649ca7d44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.860+0000 7fdd161b4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c1b3940 con 0x5649ca7bbdf0 2024-06-13T02:24:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.860+0000 7fdd161b4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c1b1210 con 0x5649ca7b25e0 2024-06-13T02:24:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.860+0000 7fdd161b4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c1af060 con 0x5649ca7b1070 2024-06-13T02:24:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.860+0000 7fdd0b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b25e0 0x5649ca7d3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.860+0000 7fdd0b400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b25e0 0x5649ca7d3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:57712/0 (socket says 172.21.15.2:57712) 2024-06-13T02:24:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.860+0000 7fdd0be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.860+0000 7fdd0b400640 1 -- 172.21.15.2:0/204552275 learned_addr learned my addr 172.21.15.2:0/204552275 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.861+0000 7fdd11200640 1 --2- 172.21.15.2:0/204552275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 0x5649ca7d44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.861+0000 7fdd0b400640 1 -- 172.21.15.2:0/204552275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 msgr2=0x5649ca7ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.861+0000 7fdd0b400640 1 --2- 172.21.15.2:0/204552275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7ac6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.861+0000 7fdd0b400640 1 -- 172.21.15.2:0/204552275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 msgr2=0x5649ca7d44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.861+0000 7fdd0b400640 1 --2- 172.21.15.2:0/204552275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 0x5649ca7d44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.861+0000 7fdd0b400640 1 -- 172.21.15.2:0/204552275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649ca7b7df0 con 0x5649ca7b25e0 2024-06-13T02:24:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.861+0000 7fdd0be00640 1 --2- 172.21.15.2:0/204552275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:24:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.861+0000 7fdd0b400640 1 --2- 172.21.15.2:0/204552275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b25e0 0x5649ca7d3f60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4097d90 tx=0x7fdcf40998d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57d3412b7d6b79c2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.862+0000 7fdd00c00640 1 -- 172.21.15.2:0/204552275 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4021070 con 0x5649ca7b25e0 2024-06-13T02:24:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.862+0000 7fdd00c00640 1 -- 172.21.15.2:0/204552275 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcf40d2a00 con 0x5649ca7b25e0 2024-06-13T02:24:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.862+0000 7fdd00c00640 1 -- 172.21.15.2:0/204552275 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf409ad20 con 0x5649ca7b25e0 2024-06-13T02:24:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.863+0000 7fdd161b4740 1 -- 172.21.15.2:0/204552275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b25e0 msgr2=0x5649ca7d3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.863+0000 7fdd161b4740 1 --2- 172.21.15.2:0/204552275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b25e0 0x5649ca7d3f60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4097d90 tx=0x7fdcf40998d0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.863+0000 7fdd161b4740 1 -- 172.21.15.2:0/204552275 shutdown_connections 2024-06-13T02:24:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.863+0000 7fdd161b4740 1 --2- 172.21.15.2:0/204552275 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 0x5649ca7d44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.863+0000 7fdd161b4740 1 --2- 172.21.15.2:0/204552275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b25e0 0x5649ca7d3f60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.863+0000 7fdd161b4740 1 --2- 172.21.15.2:0/204552275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.863+0000 7fdd161b4740 1 -- 172.21.15.2:0/204552275 >> 172.21.15.2:0/204552275 conn(0x5649ca779fb0 msgr2=0x5649ca7abfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.863+0000 7fdd161b4740 1 -- 172.21.15.2:0/204552275 shutdown_connections 2024-06-13T02:24:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.863+0000 7fdd161b4740 1 -- 172.21.15.2:0/204552275 wait complete. 2024-06-13T02:24:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.863+0000 7fdd161b4740 1 -- start start 2024-06-13T02:24:48.866 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.864+0000 7fdd161b4740 1 Processor -- start 2024-06-13T02:24:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.864+0000 7fdd161b4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.864+0000 7fdd161b4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 0x5649ca7b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.864+0000 7fdd161b4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b6830 0x5649ca835f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.864+0000 7fdd161b4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c1af6d0 con 0x5649ca7bbdf0 2024-06-13T02:24:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.864+0000 7fdd161b4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c1b0b40 con 0x5649ca7b6830 2024-06-13T02:24:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.864+0000 7fdd161b4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c1afda0 con 0x5649ca7b1070 2024-06-13T02:24:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.864+0000 7fdd161b4740 10 client.0 _ll_register_callbacks cb 0x7fdcf4010c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:24:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.864+0000 7fdd11200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b6830 0x5649ca835f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.864+0000 7fdd0b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 0x5649ca7b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.864+0000 7fdd11200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b6830 0x5649ca835f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:57724/0 (socket says 172.21.15.2:57724) 2024-06-13T02:24:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.864+0000 7fdd11200640 1 -- 172.21.15.2:0/265150042 learned_addr learned my addr 172.21.15.2:0/265150042 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:24:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.864+0000 7fdd0be00640 1 --2- 172.21.15.2:0/265150042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.865+0000 7fdd0b400640 1 -- 172.21.15.2:0/265150042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 msgr2=0x5649ca7b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.865+0000 7fdd0b400640 1 --2- 172.21.15.2:0/265150042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.865+0000 7fdd0b400640 1 -- 172.21.15.2:0/265150042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b6830 msgr2=0x5649ca835f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:24:48.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.865+0000 7fdd0b400640 1 --2- 172.21.15.2:0/265150042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b6830 0x5649ca835f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.865+0000 7fdd0b400640 1 -- 172.21.15.2:0/265150042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649ca836470 con 0x5649ca7bbdf0 2024-06-13T02:24:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.865+0000 7fdd11200640 1 --2- 172.21.15.2:0/265150042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b6830 0x5649ca835f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:24:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.865+0000 7fdd0be00640 1 --2- 172.21.15.2:0/265150042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:24:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.865+0000 7fdd0b400640 1 --2- 172.21.15.2:0/265150042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 0x5649ca7b62f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x5649ca7b1040 tx=0x7fdcf4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d794cd6b78922c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:24:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.865+0000 7fdcfa000640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:24:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.865+0000 7fdcfa000640 1 -- 172.21.15.2:0/265150042 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4021070 con 0x5649ca7bbdf0 2024-06-13T02:24:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.866+0000 7fdd161b4740 1 -- 172.21.15.2:0/265150042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcf40d2a00 con 0x5649ca7bbdf0 2024-06-13T02:24:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.866+0000 7fdcfa000640 1 -- 172.21.15.2:0/265150042 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9495+0+0 (secure 0 0 0) 0x7fdcf4097310 con 0x5649ca7bbdf0 2024-06-13T02:24:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.866+0000 7fdcfa000640 1 -- 172.21.15.2:0/265150042 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdcf409ad20 con 0x5649ca7bbdf0 2024-06-13T02:24:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.866+0000 7fdd161b4740 10 client.15642 fetch_fsmap learned FSMap version 35 2024-06-13T02:24:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.866+0000 7fdd161b4740 1 -- 172.21.15.2:0/265150042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5649ca8375a0 con 0x5649ca7bbdf0 2024-06-13T02:24:48.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.866+0000 7fdcfa000640 1 -- 172.21.15.2:0/265150042 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcf40d2a00 con 0x5649ca7bbdf0 2024-06-13T02:24:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.866+0000 7fdcfa000640 1 -- 172.21.15.2:0/265150042 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fdcf409a280 con 0x5649ca7bbdf0 2024-06-13T02:24:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.866+0000 7fdd161b4740 10 client.15642 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:24:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.866+0000 7fdd161b4740 10 client.15642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:24:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.866+0000 7fdd161b4740 20 client.15642 populate_metadata read hostname 'smithi002' 2024-06-13T02:24:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.866+0000 7fdd161b4740 1 --2- 172.21.15.2:0/265150042 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ca837a20 0x5649ca839e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:24:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.866+0000 7fdd161b4740 4 client.15642 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:24:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.866+0000 7fdd161b4740 1 -- 172.21.15.2:0/265150042 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5649ca71cea0 con 0x5649ca837a20 2024-06-13T02:24:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.867+0000 7fdd0be00640 1 --2- 172.21.15.2:0/265150042 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ca837a20 0x5649ca839e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:24:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.867+0000 7fdd0be00640 1 --2- 172.21.15.2:0/265150042 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ca837a20 0x5649ca839e10 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7edacb41a1435172 server_cookie=2607a40ee72981ff in_seq=0 out_seq=0 2024-06-13T02:24:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:48.867+0000 7fdcfa000640 10 client.15642 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.087+0000 7fdcfa000640 1 -- 172.21.15.2:0/265150042 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5649ca71cea0 con 0x5649ca837a20 2024-06-13T02:24:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.087+0000 7fdcfa000640 10 client.15642 handle_command_reply: tid=0 2024-06-13T02:24:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.087+0000 7fdd161b4740 1 client.15642 shutdown 2024-06-13T02:24:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.087+0000 7fdd161b4740 1 -- 172.21.15.2:0/265150042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 msgr2=0x5649ca7b62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.087+0000 7fdd161b4740 1 --2- 172.21.15.2:0/265150042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 0x5649ca7b62f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x5649ca7b1040 tx=0x7fdcf4000bc0 comp rx=0 tx=0).stop 2024-06-13T02:24:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.087+0000 7fdd161b4740 1 -- 172.21.15.2:0/265150042 shutdown_connections 2024-06-13T02:24:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.087+0000 7fdd161b4740 1 --2- 172.21.15.2:0/265150042 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ca837a20 0x5649ca839e10 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.087+0000 7fdd161b4740 1 --2- 172.21.15.2:0/265150042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ca7b6830 0x5649ca835f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.087+0000 7fdd161b4740 1 --2- 172.21.15.2:0/265150042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ca7bbdf0 0x5649ca7b62f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.087+0000 7fdd161b4740 1 --2- 172.21.15.2:0/265150042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ca7b1070 0x5649ca7b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.087+0000 7fdcfa000640 0 client.15642 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:24:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.087+0000 7fdd161b4740 1 -- 172.21.15.2:0/265150042 >> 172.21.15.2:0/265150042 conn(0x5649ca779fb0 msgr2=0x5649ca7b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.088+0000 7fdd161b4740 1 -- 172.21.15.2:0/265150042 shutdown_connections 2024-06-13T02:24:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.088+0000 7fdd161b4740 1 -- 172.21.15.2:0/265150042 wait complete. 2024-06-13T02:24:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.088+0000 7fdd161b4740 20 client.15642 trim_cache size 0 max 16384 2024-06-13T02:24:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:24:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:24:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:24:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.088+0000 7fdd13200640 1 -- 172.21.15.2:0/3151973612 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fdcf00a2d70 msgr2=0x7fdcf00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.088+0000 7fdd13200640 1 --2- 172.21.15.2:0/3151973612 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fdcf00a2d70 0x7fdcf00a5230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00b650 tx=0x7fdcfc00b2e0 comp rx=0 tx=0).stop 2024-06-13T02:24:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.088+0000 7fdd13200640 1 -- 172.21.15.2:0/3151973612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd0c108f00 msgr2=0x7fdd0c19aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:24:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.088+0000 7fdd13200640 1 --2- 172.21.15.2:0/3151973612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd0c108f00 0x7fdd0c19aa30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400d950 tx=0x7fdcf400de10 comp rx=0 tx=0).stop 2024-06-13T02:24:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.089+0000 7fdd13200640 1 -- 172.21.15.2:0/3151973612 shutdown_connections 2024-06-13T02:24:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.089+0000 7fdd13200640 1 --2- 172.21.15.2:0/3151973612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd0c19ed60 0x7fdd0c19f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.089+0000 7fdd13200640 1 --2- 172.21.15.2:0/3151973612 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd0c108f00 0x7fdd0c19aa30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.089+0000 7fdd13200640 1 --2- 172.21.15.2:0/3151973612 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fdcf00a2d70 0x7fdcf00a5230 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.089+0000 7fdd13200640 1 --2- 172.21.15.2:0/3151973612 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdd0c103e30 0x7fdd0c19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:24:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.089+0000 7fdd13200640 1 -- 172.21.15.2:0/3151973612 >> 172.21.15.2:0/3151973612 conn(0x7fdd0c0ff650 msgr2=0x7fdd0c1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:24:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.089+0000 7fdd13200640 1 -- 172.21.15.2:0/3151973612 shutdown_connections 2024-06-13T02:24:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:24:49.089+0000 7fdd13200640 1 -- 172.21.15.2:0/3151973612 wait complete. 2024-06-13T02:24:49.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:48 smithi175 ceph-mon[36977]: pgmap v217: 129 pgs: 129 active+clean; 83 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 168 op/s 2024-06-13T02:24:49.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:48 smithi002 ceph-mon[31960]: pgmap v217: 129 pgs: 129 active+clean; 83 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 168 op/s 2024-06-13T02:24:49.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:48 smithi084 ceph-mon[36833]: pgmap v217: 129 pgs: 129 active+clean; 83 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 168 op/s 2024-06-13T02:24:49.521 INFO:tasks.workunit.client.0.smithi002.stdout: 1 511814 7.86 MB/sec execute 233 sec latency 72.402 ms 2024-06-13T02:24:50.521 INFO:tasks.workunit.client.0.smithi002.stdout: 1 512570 7.83 MB/sec execute 234 sec latency 39.700 ms 2024-06-13T02:24:51.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:50 smithi175 ceph-mon[36977]: pgmap v218: 129 pgs: 129 active+clean; 83 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 152 op/s 2024-06-13T02:24:51.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:50 smithi002 ceph-mon[31960]: pgmap v218: 129 pgs: 129 active+clean; 83 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 152 op/s 2024-06-13T02:24:51.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:50 smithi084 ceph-mon[36833]: pgmap v218: 129 pgs: 129 active+clean; 83 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 152 op/s 2024-06-13T02:24:51.521 INFO:tasks.workunit.client.0.smithi002.stdout: 1 513919 7.83 MB/sec execute 235 sec latency 26.456 ms 2024-06-13T02:24:52.521 INFO:tasks.workunit.client.0.smithi002.stdout: 1 515481 7.84 MB/sec execute 236 sec latency 11.300 ms 2024-06-13T02:24:53.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:52 smithi175 ceph-mon[36977]: pgmap v219: 129 pgs: 129 active+clean; 81 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 316 op/s 2024-06-13T02:24:53.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:52 smithi002 ceph-mon[31960]: pgmap v219: 129 pgs: 129 active+clean; 81 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 316 op/s 2024-06-13T02:24:53.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:52 smithi084 ceph-mon[36833]: pgmap v219: 129 pgs: 129 active+clean; 81 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.5 MiB/s wr, 316 op/s 2024-06-13T02:24:53.521 INFO:tasks.workunit.client.0.smithi002.stdout: 1 516482 7.83 MB/sec execute 237 sec latency 18.581 ms 2024-06-13T02:24:54.521 INFO:tasks.workunit.client.0.smithi002.stdout: 1 517724 7.81 MB/sec execute 238 sec latency 25.453 ms 2024-06-13T02:24:55.272 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:54 smithi084 ceph-mon[36833]: pgmap v220: 129 pgs: 129 active+clean; 81 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.5 MiB/s wr, 215 op/s 2024-06-13T02:24:55.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:54 smithi175 ceph-mon[36977]: pgmap v220: 129 pgs: 129 active+clean; 81 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.5 MiB/s wr, 215 op/s 2024-06-13T02:24:55.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:54 smithi002 ceph-mon[31960]: pgmap v220: 129 pgs: 129 active+clean; 81 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.5 MiB/s wr, 215 op/s 2024-06-13T02:24:55.521 INFO:tasks.workunit.client.0.smithi002.stdout: 1 519060 7.83 MB/sec execute 239 sec latency 56.667 ms 2024-06-13T02:24:56.521 INFO:tasks.workunit.client.0.smithi002.stdout: 1 520108 7.81 MB/sec execute 240 sec latency 35.556 ms 2024-06-13T02:24:57.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:56 smithi175 ceph-mon[36977]: pgmap v221: 129 pgs: 129 active+clean; 86 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 281 op/s 2024-06-13T02:24:57.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:56 smithi002 ceph-mon[31960]: pgmap v221: 129 pgs: 129 active+clean; 86 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 281 op/s 2024-06-13T02:24:57.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:56 smithi084 ceph-mon[36833]: pgmap v221: 129 pgs: 129 active+clean; 86 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 281 op/s 2024-06-13T02:24:57.522 INFO:tasks.workunit.client.0.smithi002.stdout: 1 521659 7.81 MB/sec execute 241 sec latency 40.031 ms 2024-06-13T02:24:58.522 INFO:tasks.workunit.client.0.smithi002.stdout: 1 522890 7.81 MB/sec execute 242 sec latency 19.499 ms 2024-06-13T02:24:59.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:24:58 smithi175 ceph-mon[36977]: pgmap v222: 129 pgs: 129 active+clean; 86 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 1.9 MiB/s wr, 228 op/s 2024-06-13T02:24:59.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:24:58 smithi002 ceph-mon[31960]: pgmap v222: 129 pgs: 129 active+clean; 86 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 1.9 MiB/s wr, 228 op/s 2024-06-13T02:24:59.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:24:58 smithi084 ceph-mon[36833]: pgmap v222: 129 pgs: 129 active+clean; 86 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 1.9 MiB/s wr, 228 op/s 2024-06-13T02:24:59.522 INFO:tasks.workunit.client.0.smithi002.stdout: 1 523882 7.80 MB/sec execute 243 sec latency 23.479 ms 2024-06-13T02:25:00.522 INFO:tasks.workunit.client.0.smithi002.stdout: 1 525541 7.80 MB/sec execute 244 sec latency 29.029 ms 2024-06-13T02:25:01.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:01 smithi175 ceph-mon[36977]: pgmap v223: 129 pgs: 129 active+clean; 86 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 1.9 MiB/s wr, 228 op/s 2024-06-13T02:25:01.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:01 smithi002 ceph-mon[31960]: pgmap v223: 129 pgs: 129 active+clean; 86 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 1.9 MiB/s wr, 228 op/s 2024-06-13T02:25:01.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:01 smithi084 ceph-mon[36833]: pgmap v223: 129 pgs: 129 active+clean; 86 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 1.9 MiB/s wr, 228 op/s 2024-06-13T02:25:01.522 INFO:tasks.workunit.client.0.smithi002.stdout: 1 525953 7.79 MB/sec execute 245 sec latency 125.756 ms 2024-06-13T02:25:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.236+0000 7f327e000640 1 -- 172.21.15.2:0/309393670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781077d0 msgr2=0x7f3278107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.236+0000 7f327e000640 1 --2- 172.21.15.2:0/309393670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781077d0 0x7f3278107bb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f326c009900 tx=0x7f326c02a410 comp rx=0 tx=0).stop 2024-06-13T02:25:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.237+0000 7f327e000640 1 -- 172.21.15.2:0/309393670 shutdown_connections 2024-06-13T02:25:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.237+0000 7f327e000640 1 --2- 172.21.15.2:0/309393670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3278102180 0x7f327810e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.237+0000 7f327e000640 1 --2- 172.21.15.2:0/309393670 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32781017c0 0x7f3278101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.237+0000 7f327e000640 1 --2- 172.21.15.2:0/309393670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781077d0 0x7f3278107bb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.237+0000 7f327e000640 1 -- 172.21.15.2:0/309393670 >> 172.21.15.2:0/309393670 conn(0x7f32780fd2b0 msgr2=0x7f32780ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.237+0000 7f327e000640 1 -- 172.21.15.2:0/309393670 shutdown_connections 2024-06-13T02:25:02.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.237+0000 7f327e000640 1 -- 172.21.15.2:0/309393670 wait complete. 2024-06-13T02:25:02.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.238+0000 7f327e000640 1 Processor -- start 2024-06-13T02:25:02.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.238+0000 7f327e000640 1 -- start start 2024-06-13T02:25:02.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.239+0000 7f327e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32781017c0 0x7f327819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.239+0000 7f327e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3278102180 0x7f327819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.239+0000 7f327e000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781077d0 0x7f327819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.239+0000 7f327e000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3278111be0 con 0x7f32781017c0 2024-06-13T02:25:02.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.239+0000 7f327e000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3278111a60 con 0x7f32781077d0 2024-06-13T02:25:02.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.239+0000 7f327e000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3278111d60 con 0x7f3278102180 2024-06-13T02:25:02.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.239+0000 7f327cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32781017c0 0x7f327819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.239+0000 7f3277e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3278102180 0x7f327819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.239+0000 7f3277e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3278102180 0x7f327819a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:60578/0 (socket says 172.21.15.2:60578) 2024-06-13T02:25:02.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.239+0000 7f3277e00640 1 -- 172.21.15.2:0/2420169578 learned_addr learned my addr 172.21.15.2:0/2420169578 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:02.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.239+0000 7f327cc00640 1 --2- 172.21.15.2:0/2420169578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32781017c0 0x7f327819a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47612/0 (socket says 172.21.15.2:47612) 2024-06-13T02:25:02.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.239+0000 7f327d600640 1 --2- 172.21.15.2:0/2420169578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781077d0 0x7f327819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.240+0000 7f3277e00640 1 -- 172.21.15.2:0/2420169578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781077d0 msgr2=0x7f327819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:02.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.240+0000 7f3277e00640 1 --2- 172.21.15.2:0/2420169578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781077d0 0x7f327819eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.240+0000 7f3277e00640 1 -- 172.21.15.2:0/2420169578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32781017c0 msgr2=0x7f327819a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:02.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.240+0000 7f3277e00640 1 --2- 172.21.15.2:0/2420169578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32781017c0 0x7f327819a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.240+0000 7f3277e00640 1 -- 172.21.15.2:0/2420169578 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327819f290 con 0x7f3278102180 2024-06-13T02:25:02.243 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.240+0000 7f3277e00640 1 --2- 172.21.15.2:0/2420169578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3278102180 0x7f327819a7e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f326400e9f0 tx=0x7f326400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.240+0000 7f3275600640 1 -- 172.21.15.2:0/2420169578 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326400cd80 con 0x7f3278102180 2024-06-13T02:25:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.240+0000 7f327e000640 1 -- 172.21.15.2:0/2420169578 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f327819f580 con 0x7f3278102180 2024-06-13T02:25:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.240+0000 7f3275600640 1 -- 172.21.15.2:0/2420169578 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3264010910 con 0x7f3278102180 2024-06-13T02:25:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.240+0000 7f3275600640 1 -- 172.21.15.2:0/2420169578 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32640188f0 con 0x7f3278102180 2024-06-13T02:25:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.241+0000 7f327e000640 1 -- 172.21.15.2:0/2420169578 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32781a6e10 con 0x7f3278102180 2024-06-13T02:25:02.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.244+0000 7f328246a740 1 Processor -- start 2024-06-13T02:25:02.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.244+0000 7f3275600640 1 -- 172.21.15.2:0/2420169578 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f3264010ac0 con 0x7f3278102180 2024-06-13T02:25:02.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.244+0000 7f328246a740 1 -- start start 2024-06-13T02:25:02.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.244+0000 7f328246a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e49cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.244+0000 7f328246a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e4a230 0x562979e4a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.244+0000 7f328246a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e54fb0 0x562979e573a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.244+0000 7f328246a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562979dae420 con 0x562979e54fb0 2024-06-13T02:25:02.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.244+0000 7f328246a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562979d55c50 con 0x562979e4b7a0 2024-06-13T02:25:02.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.244+0000 7f328246a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562979daa3e0 con 0x562979e4a230 2024-06-13T02:25:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.245+0000 7f327d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e49cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.245+0000 7f327cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e4a230 0x562979e4a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.245+0000 7f327d600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e49cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36220/0 (socket says 172.21.15.2:36220) 2024-06-13T02:25:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.245+0000 7f327d600640 1 -- 172.21.15.2:0/1414608323 learned_addr learned my addr 172.21.15.2:0/1414608323 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.245+0000 7f3277e00640 1 --2- 172.21.15.2:0/1414608323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e54fb0 0x562979e573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.245+0000 7f327d600640 1 -- 172.21.15.2:0/1414608323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e4a230 msgr2=0x562979e4a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.245+0000 7f327d600640 1 --2- 172.21.15.2:0/1414608323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e4a230 0x562979e4a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.245+0000 7f327d600640 1 -- 172.21.15.2:0/1414608323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e54fb0 msgr2=0x562979e573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.245+0000 7f327d600640 1 --2- 172.21.15.2:0/1414608323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e54fb0 0x562979e573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.245+0000 7f327d600640 1 -- 172.21.15.2:0/1414608323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562979ac2210 con 0x562979e4b7a0 2024-06-13T02:25:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.246+0000 7f327d600640 1 --2- 172.21.15.2:0/1414608323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e49cf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3270009f80 tx=0x7f32700118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c05fb27093fdc42 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.246+0000 7f3269c00640 1 -- 172.21.15.2:0/1414608323 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270004d20 con 0x562979e4b7a0 2024-06-13T02:25:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.246+0000 7f3269c00640 1 -- 172.21.15.2:0/1414608323 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3270004050 con 0x562979e4b7a0 2024-06-13T02:25:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.246+0000 7f3269c00640 1 -- 172.21.15.2:0/1414608323 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270005220 con 0x562979e4b7a0 2024-06-13T02:25:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.246+0000 7f3275600640 1 --2- 172.21.15.2:0/2420169578 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f32600a2d60 0x7f32600a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.246+0000 7f3275600640 1 -- 172.21.15.2:0/2420169578 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9495+0+0 (secure 0 0 0) 0x7f32640cfb90 con 0x7f3278102180 2024-06-13T02:25:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.246+0000 7f327cc00640 1 --2- 172.21.15.2:0/2420169578 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f32600a2d60 0x7f32600a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.246+0000 7f328246a740 1 -- 172.21.15.2:0/1414608323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 msgr2=0x562979e49cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.246+0000 7f328246a740 1 --2- 172.21.15.2:0/1414608323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e49cf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3270009f80 tx=0x7f32700118d0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.247+0000 7f328246a740 1 -- 172.21.15.2:0/1414608323 shutdown_connections 2024-06-13T02:25:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.247+0000 7f328246a740 1 --2- 172.21.15.2:0/1414608323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e54fb0 0x562979e573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.247+0000 7f328246a740 1 --2- 172.21.15.2:0/1414608323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e4a230 0x562979e4a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.247+0000 7f328246a740 1 --2- 172.21.15.2:0/1414608323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e49cf0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.251 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.247+0000 7f328246a740 1 -- 172.21.15.2:0/1414608323 >> 172.21.15.2:0/1414608323 conn(0x562979e12fb0 msgr2=0x562979e46820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.247+0000 7f328246a740 1 -- 172.21.15.2:0/1414608323 shutdown_connections 2024-06-13T02:25:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.247+0000 7f328246a740 1 -- 172.21.15.2:0/1414608323 wait complete. 2024-06-13T02:25:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.247+0000 7f327cc00640 1 --2- 172.21.15.2:0/2420169578 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f32600a2d60 0x7f32600a5220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f326c009230 tx=0x7f326c0058d0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.247+0000 7f328246a740 1 -- start start 2024-06-13T02:25:02.252 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.248+0000 7f328246a740 1 Processor -- start 2024-06-13T02:25:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.248+0000 7f328246a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e4a230 0x562979e51fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.248+0000 7f328246a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e52510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.248+0000 7f328246a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e54fb0 0x562979e52a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.248+0000 7f328246a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x562979e57d80 con 0x562979e4a230 2024-06-13T02:25:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.248+0000 7f328246a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562979d690b0 con 0x562979e4b7a0 2024-06-13T02:25:02.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.248+0000 7f328246a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x562979e57f00 con 0x562979e54fb0 2024-06-13T02:25:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.248+0000 7f328246a740 10 client.0 _ll_register_callbacks cb 0x562979d54f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:25:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.249+0000 7f3277e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e52510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.249+0000 7f327d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e54fb0 0x562979e52a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.249+0000 7f327cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e4a230 0x562979e51fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.249+0000 7f327d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e54fb0 0x562979e52a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:60606/0 (socket says 172.21.15.2:60606) 2024-06-13T02:25:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.249+0000 7f327d600640 1 -- 172.21.15.2:0/2987049638 learned_addr learned my addr 172.21.15.2:0/2987049638 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.249+0000 7f3277e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e52510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36228/0 (socket says 172.21.15.2:36228) 2024-06-13T02:25:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.249+0000 7f327d600640 1 -- 172.21.15.2:0/2987049638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 msgr2=0x562979e52510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.249+0000 7f327d600640 1 --2- 172.21.15.2:0/2987049638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e52510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.249+0000 7f327d600640 1 -- 172.21.15.2:0/2987049638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e4a230 msgr2=0x562979e51fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.249+0000 7f327d600640 1 --2- 172.21.15.2:0/2987049638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e4a230 0x562979e51fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.249+0000 7f327d600640 1 -- 172.21.15.2:0/2987049638 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562979b8e620 con 0x562979e54fb0 2024-06-13T02:25:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.249+0000 7f3277e00640 1 --2- 172.21.15.2:0/2987049638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e52510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:25:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.249+0000 7f327d600640 1 --2- 172.21.15.2:0/2987049638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e54fb0 0x562979e52a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3270009250 tx=0x7f3270004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b429d1277a23c76 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.249+0000 7f325e000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:25:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.250+0000 7f325e000640 1 -- 172.21.15.2:0/2987049638 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270026020 con 0x562979e54fb0 2024-06-13T02:25:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.250+0000 7f328246a740 1 -- 172.21.15.2:0/2987049638 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3270004050 con 0x562979e54fb0 2024-06-13T02:25:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.250+0000 7f325e000640 1 -- 172.21.15.2:0/2987049638 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9495+0+0 (secure 0 0 0) 0x7f3270005040 con 0x562979e54fb0 2024-06-13T02:25:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.250+0000 7f325e000640 1 -- 172.21.15.2:0/2987049638 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3270031050 con 0x562979e54fb0 2024-06-13T02:25:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.250+0000 7f328246a740 10 client.25822 fetch_fsmap learned FSMap version 35 2024-06-13T02:25:02.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.250+0000 7f328246a740 1 -- 172.21.15.2:0/2987049638 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562979e640f0 con 0x562979e54fb0 2024-06-13T02:25:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.250+0000 7f325e000640 1 -- 172.21.15.2:0/2987049638 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3270004050 con 0x562979e54fb0 2024-06-13T02:25:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.250+0000 7f325e000640 1 -- 172.21.15.2:0/2987049638 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f327000f6a0 con 0x562979e54fb0 2024-06-13T02:25:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.251+0000 7f328246a740 10 client.25822 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:25:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.251+0000 7f328246a740 10 client.25822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:25:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.251+0000 7f328246a740 20 client.25822 populate_metadata read hostname 'smithi002' 2024-06-13T02:25:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.251+0000 7f328246a740 1 --2- 172.21.15.2:0/2987049638 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x562979e65550 0x562979e67940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.251+0000 7f328246a740 4 client.25822 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:25:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.251+0000 7f328246a740 1 -- 172.21.15.2:0/2987049638 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562979dbbb50 con 0x562979e65550 2024-06-13T02:25:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.251+0000 7f327cc00640 1 --2- 172.21.15.2:0/2987049638 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x562979e65550 0x562979e67940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.259 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.251+0000 7f327cc00640 1 --2- 172.21.15.2:0/2987049638 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x562979e65550 0x562979e67940 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1eeea8cc915e13a4 server_cookie=d28548700e9ba8ce in_seq=0 out_seq=0 2024-06-13T02:25:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.252+0000 7f325e000640 10 client.25822 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.253+0000 7f325e000640 1 -- 172.21.15.2:0/2987049638 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562979dbbb50 con 0x562979e65550 2024-06-13T02:25:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.253+0000 7f325e000640 10 client.25822 handle_command_reply: tid=0 2024-06-13T02:25:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.253+0000 7f328246a740 1 client.25822 shutdown 2024-06-13T02:25:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.253+0000 7f328246a740 1 -- 172.21.15.2:0/2987049638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e54fb0 msgr2=0x562979e52a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.253+0000 7f328246a740 1 --2- 172.21.15.2:0/2987049638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e54fb0 0x562979e52a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3270009250 tx=0x7f3270004430 comp rx=0 tx=0).stop 2024-06-13T02:25:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.253+0000 7f328246a740 1 -- 172.21.15.2:0/2987049638 shutdown_connections 2024-06-13T02:25:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.253+0000 7f328246a740 1 --2- 172.21.15.2:0/2987049638 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x562979e65550 0x562979e67940 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.253+0000 7f328246a740 1 --2- 172.21.15.2:0/2987049638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e54fb0 0x562979e52a50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.253+0000 7f328246a740 1 --2- 172.21.15.2:0/2987049638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e52510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.260 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.253+0000 7f328246a740 1 --2- 172.21.15.2:0/2987049638 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e4a230 0x562979e51fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.253+0000 7f325e000640 0 client.25822 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.253+0000 7f328246a740 1 -- 172.21.15.2:0/2987049638 >> 172.21.15.2:0/2987049638 conn(0x562979e12fb0 msgr2=0x562979e4c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.253+0000 7f328246a740 1 -- 172.21.15.2:0/2987049638 shutdown_connections 2024-06-13T02:25:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.253+0000 7f328246a740 1 -- 172.21.15.2:0/2987049638 wait complete. 2024-06-13T02:25:02.261 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.253+0000 7f328246a740 20 client.25822 trim_cache size 0 max 16384 2024-06-13T02:25:02.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.270+0000 7f328246a740 1 Processor -- start 2024-06-13T02:25:02.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.271+0000 7f328246a740 1 -- start start 2024-06-13T02:25:02.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.271+0000 7f328246a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e4a230 0x562979e52870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.271+0000 7f328246a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e6d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.271+0000 7f328246a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e54fb0 0x562979e6d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.271+0000 7f328246a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f32781b37e0 con 0x562979e4a230 2024-06-13T02:25:02.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.271+0000 7f328246a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f32781b10b0 con 0x562979e4b7a0 2024-06-13T02:25:02.273 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.271+0000 7f328246a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f32781aef00 con 0x562979e54fb0 2024-06-13T02:25:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.271+0000 7f327cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e4a230 0x562979e52870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.271+0000 7f327cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e4a230 0x562979e52870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47652/0 (socket says 172.21.15.2:47652) 2024-06-13T02:25:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.271+0000 7f327cc00640 1 -- 172.21.15.2:0/3960625808 learned_addr learned my addr 172.21.15.2:0/3960625808 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.271+0000 7f3277e00640 1 --2- 172.21.15.2:0/3960625808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e6d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.271+0000 7f327d600640 1 --2- 172.21.15.2:0/3960625808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e54fb0 0x562979e6d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.272+0000 7f327cc00640 1 -- 172.21.15.2:0/3960625808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e54fb0 msgr2=0x562979e6d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.272+0000 7f327cc00640 1 --2- 172.21.15.2:0/3960625808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e54fb0 0x562979e6d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.272+0000 7f327cc00640 1 -- 172.21.15.2:0/3960625808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 msgr2=0x562979e6d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.272+0000 7f327cc00640 1 --2- 172.21.15.2:0/3960625808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e6d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.272+0000 7f327cc00640 1 -- 172.21.15.2:0/3960625808 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562979e42000 con 0x562979e4a230 2024-06-13T02:25:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.272+0000 7f327cc00640 1 --2- 172.21.15.2:0/3960625808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e4a230 0x562979e52870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f326c0314e0 tx=0x7f326c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc9bc86c3c9f22e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.272+0000 7f3269200640 1 -- 172.21.15.2:0/3960625808 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c035040 con 0x562979e4a230 2024-06-13T02:25:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.272+0000 7f3269200640 1 -- 172.21.15.2:0/3960625808 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f326c003e10 con 0x562979e4a230 2024-06-13T02:25:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.272+0000 7f3269200640 1 -- 172.21.15.2:0/3960625808 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c03d450 con 0x562979e4a230 2024-06-13T02:25:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.273+0000 7f328246a740 1 -- 172.21.15.2:0/3960625808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e4a230 msgr2=0x562979e52870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.273+0000 7f328246a740 1 --2- 172.21.15.2:0/3960625808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e4a230 0x562979e52870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f326c0314e0 tx=0x7f326c040000 comp rx=0 tx=0).stop 2024-06-13T02:25:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.273+0000 7f328246a740 1 -- 172.21.15.2:0/3960625808 shutdown_connections 2024-06-13T02:25:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.273+0000 7f328246a740 1 --2- 172.21.15.2:0/3960625808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e54fb0 0x562979e6d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.273+0000 7f328246a740 1 --2- 172.21.15.2:0/3960625808 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4b7a0 0x562979e6d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.273+0000 7f328246a740 1 --2- 172.21.15.2:0/3960625808 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e4a230 0x562979e52870 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.273+0000 7f328246a740 1 -- 172.21.15.2:0/3960625808 >> 172.21.15.2:0/3960625808 conn(0x562979e12fb0 msgr2=0x562979e4c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.273+0000 7f328246a740 1 -- 172.21.15.2:0/3960625808 shutdown_connections 2024-06-13T02:25:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.273+0000 7f328246a740 1 -- 172.21.15.2:0/3960625808 wait complete. 2024-06-13T02:25:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.274+0000 7f328246a740 1 -- start start 2024-06-13T02:25:02.277 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.274+0000 7f328246a740 1 Processor -- start 2024-06-13T02:25:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.275+0000 7f328246a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4a230 0x562979e4fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.275+0000 7f328246a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e4b7a0 0x562979e5d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.275+0000 7f328246a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e54fb0 0x562979e5d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.275+0000 7f328246a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f32781af570 con 0x562979e54fb0 2024-06-13T02:25:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.275+0000 7f328246a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f32781b09e0 con 0x562979e4a230 2024-06-13T02:25:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.275+0000 7f328246a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f32781afc40 con 0x562979e4b7a0 2024-06-13T02:25:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.275+0000 7f328246a740 10 client.0 _ll_register_callbacks cb 0x7f32700093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:25:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.275+0000 7f327cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4a230 0x562979e4fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.275+0000 7f3277e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e4b7a0 0x562979e5d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.275+0000 7f327cc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4a230 0x562979e4fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36234/0 (socket says 172.21.15.2:36234) 2024-06-13T02:25:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.275+0000 7f327cc00640 1 -- 172.21.15.2:0/1557747106 learned_addr learned my addr 172.21.15.2:0/1557747106 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.275+0000 7f327d600640 1 --2- 172.21.15.2:0/1557747106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e54fb0 0x562979e5d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.275+0000 7f327cc00640 1 -- 172.21.15.2:0/1557747106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e4b7a0 msgr2=0x562979e5d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.276+0000 7f327cc00640 1 --2- 172.21.15.2:0/1557747106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e4b7a0 0x562979e5d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.276+0000 7f327cc00640 1 -- 172.21.15.2:0/1557747106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e54fb0 msgr2=0x562979e5d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.276+0000 7f327cc00640 1 --2- 172.21.15.2:0/1557747106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e54fb0 0x562979e5d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.276+0000 7f327cc00640 1 -- 172.21.15.2:0/1557747106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562979e4e240 con 0x562979e4a230 2024-06-13T02:25:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.276+0000 7f327d600640 1 --2- 172.21.15.2:0/1557747106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e54fb0 0x562979e5d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:25:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.276+0000 7f3277e00640 1 --2- 172.21.15.2:0/1557747106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e4b7a0 0x562979e5d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:25:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.276+0000 7f327cc00640 1 --2- 172.21.15.2:0/1557747106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4a230 0x562979e4fca0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f326c000c00 tx=0x7f326c031cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fe6fb6b6b6f1f23 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.276+0000 7f325e000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:25:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.276+0000 7f325e000640 1 -- 172.21.15.2:0/1557747106 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c060070 con 0x562979e4a230 2024-06-13T02:25:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.276+0000 7f328246a740 1 -- 172.21.15.2:0/1557747106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f326c003e10 con 0x562979e4a230 2024-06-13T02:25:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.276+0000 7f325e000640 1 -- 172.21.15.2:0/1557747106 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9495+0+0 (secure 0 0 0) 0x7f326c003930 con 0x562979e4a230 2024-06-13T02:25:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.276+0000 7f325e000640 1 -- 172.21.15.2:0/1557747106 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f326c035040 con 0x562979e4a230 2024-06-13T02:25:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.276+0000 7f328246a740 10 client.25841 fetch_fsmap learned FSMap version 35 2024-06-13T02:25:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.276+0000 7f328246a740 1 -- 172.21.15.2:0/1557747106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562979ecf2b0 con 0x562979e4a230 2024-06-13T02:25:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.277+0000 7f325e000640 1 -- 172.21.15.2:0/1557747106 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f326c003e10 con 0x562979e4a230 2024-06-13T02:25:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.277+0000 7f325e000640 1 -- 172.21.15.2:0/1557747106 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f326c044070 con 0x562979e4a230 2024-06-13T02:25:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.277+0000 7f328246a740 10 client.25841 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:25:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.277+0000 7f328246a740 10 client.25841 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:25:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.277+0000 7f328246a740 20 client.25841 populate_metadata read hostname 'smithi002' 2024-06-13T02:25:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.277+0000 7f328246a740 1 --2- 172.21.15.2:0/1557747106 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x562979ecfa60 0x562979ed1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.277+0000 7f328246a740 4 client.25841 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:25:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.277+0000 7f328246a740 1 -- 172.21.15.2:0/1557747106 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562979db5ea0 con 0x562979ecfa60 2024-06-13T02:25:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.277+0000 7f3277e00640 1 --2- 172.21.15.2:0/1557747106 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x562979ecfa60 0x562979ed1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.278+0000 7f3277e00640 1 --2- 172.21.15.2:0/1557747106 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x562979ecfa60 0x562979ed1e80 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dfc0aae8454bf20 server_cookie=8a5e1457239cbf9f in_seq=0 out_seq=0 2024-06-13T02:25:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.278+0000 7f325e000640 10 client.25841 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:02.523 INFO:tasks.workunit.client.0.smithi002.stdout: 1 526475 7.76 MB/sec execute 246 sec latency 106.021 ms 2024-06-13T02:25:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.555+0000 7f325e000640 1 -- 172.21.15.2:0/1557747106 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x562979db5ea0 con 0x562979ecfa60 2024-06-13T02:25:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.556+0000 7f325e000640 10 client.25841 handle_command_reply: tid=0 2024-06-13T02:25:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.556+0000 7f328246a740 1 client.25841 shutdown 2024-06-13T02:25:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.556+0000 7f328246a740 1 -- 172.21.15.2:0/1557747106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4a230 msgr2=0x562979e4fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.556+0000 7f328246a740 1 --2- 172.21.15.2:0/1557747106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4a230 0x562979e4fca0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f326c000c00 tx=0x7f326c031cd0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.557+0000 7f328246a740 1 -- 172.21.15.2:0/1557747106 shutdown_connections 2024-06-13T02:25:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.557+0000 7f328246a740 1 --2- 172.21.15.2:0/1557747106 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x562979ecfa60 0x562979ed1e80 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.557+0000 7f328246a740 1 --2- 172.21.15.2:0/1557747106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x562979e54fb0 0x562979e5d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.557+0000 7f328246a740 1 --2- 172.21.15.2:0/1557747106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562979e4b7a0 0x562979e5d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.557+0000 7f328246a740 1 --2- 172.21.15.2:0/1557747106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562979e4a230 0x562979e4fca0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.557+0000 7f328246a740 1 -- 172.21.15.2:0/1557747106 >> 172.21.15.2:0/1557747106 conn(0x562979e12fb0 msgr2=0x562979e4be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.557+0000 7f325e000640 0 client.25841 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.557+0000 7f328246a740 1 -- 172.21.15.2:0/1557747106 shutdown_connections 2024-06-13T02:25:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.557+0000 7f328246a740 1 -- 172.21.15.2:0/1557747106 wait complete. 2024-06-13T02:25:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.557+0000 7f328246a740 20 client.25841 trim_cache size 0 max 16384 2024-06-13T02:25:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:25:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:25:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:25:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.559+0000 7f327e000640 1 -- 172.21.15.2:0/2420169578 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f32600a2d60 msgr2=0x7f32600a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.559+0000 7f327e000640 1 --2- 172.21.15.2:0/2420169578 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f32600a2d60 0x7f32600a5220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f326c009230 tx=0x7f326c0058d0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.559+0000 7f327e000640 1 -- 172.21.15.2:0/2420169578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3278102180 msgr2=0x7f327819a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.559+0000 7f327e000640 1 --2- 172.21.15.2:0/2420169578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3278102180 0x7f327819a7e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f326400e9f0 tx=0x7f326400eeb0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.559+0000 7f327e000640 1 -- 172.21.15.2:0/2420169578 shutdown_connections 2024-06-13T02:25:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.559+0000 7f327e000640 1 --2- 172.21.15.2:0/2420169578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32781077d0 0x7f327819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.559+0000 7f327e000640 1 --2- 172.21.15.2:0/2420169578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3278102180 0x7f327819a7e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.559+0000 7f327e000640 1 --2- 172.21.15.2:0/2420169578 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f32600a2d60 0x7f32600a5220 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.559+0000 7f327e000640 1 --2- 172.21.15.2:0/2420169578 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32781017c0 0x7f327819a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.559+0000 7f327e000640 1 -- 172.21.15.2:0/2420169578 >> 172.21.15.2:0/2420169578 conn(0x7f32780fd2b0 msgr2=0x7f327810ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.560+0000 7f327e000640 1 -- 172.21.15.2:0/2420169578 shutdown_connections 2024-06-13T02:25:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:02.560+0000 7f327e000640 1 -- 172.21.15.2:0/2420169578 wait complete. 2024-06-13T02:25:03.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:03 smithi175 ceph-mon[36977]: pgmap v224: 129 pgs: 129 active+clean; 93 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 309 op/s 2024-06-13T02:25:03.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:03 smithi002 ceph-mon[31960]: pgmap v224: 129 pgs: 129 active+clean; 93 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 309 op/s 2024-06-13T02:25:03.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:03 smithi084 ceph-mon[36833]: pgmap v224: 129 pgs: 129 active+clean; 93 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 309 op/s 2024-06-13T02:25:03.523 INFO:tasks.workunit.client.0.smithi002.stdout: 1 527572 7.75 MB/sec execute 247 sec latency 23.231 ms 2024-06-13T02:25:04.523 INFO:tasks.workunit.client.0.smithi002.stdout: 1 529561 7.77 MB/sec execute 248 sec latency 18.388 ms 2024-06-13T02:25:05.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:05 smithi175 ceph-mon[36977]: pgmap v225: 129 pgs: 129 active+clean; 93 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 1.9 MiB/s wr, 146 op/s 2024-06-13T02:25:05.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:05 smithi002 ceph-mon[31960]: pgmap v225: 129 pgs: 129 active+clean; 93 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 1.9 MiB/s wr, 146 op/s 2024-06-13T02:25:05.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:05 smithi084 ceph-mon[36833]: pgmap v225: 129 pgs: 129 active+clean; 93 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 1.9 MiB/s wr, 146 op/s 2024-06-13T02:25:05.523 INFO:tasks.workunit.client.0.smithi002.stdout: 1 530190 7.74 MB/sec execute 249 sec latency 40.147 ms 2024-06-13T02:25:06.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:06 smithi002 ceph-mon[31960]: osdmap e107: 12 total, 12 up, 12 in 2024-06-13T02:25:06.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:06 smithi084 ceph-mon[36833]: osdmap e107: 12 total, 12 up, 12 in 2024-06-13T02:25:06.523 INFO:tasks.workunit.client.0.smithi002.stdout: 1 530692 7.73 MB/sec execute 250 sec latency 87.098 ms 2024-06-13T02:25:06.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:06 smithi175 ceph-mon[36977]: osdmap e107: 12 total, 12 up, 12 in 2024-06-13T02:25:07.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:07 smithi002 ceph-mon[31960]: pgmap v227: 129 pgs: 18 active+clean+snaptrim, 59 active+clean, 52 active+clean+snaptrim_wait; 83 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 268 op/s 2024-06-13T02:25:07.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:07 smithi084 ceph-mon[36833]: pgmap v227: 129 pgs: 18 active+clean+snaptrim, 59 active+clean, 52 active+clean+snaptrim_wait; 83 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 268 op/s 2024-06-13T02:25:07.523 INFO:tasks.workunit.client.0.smithi002.stdout: 1 531169 7.70 MB/sec execute 251 sec latency 40.408 ms 2024-06-13T02:25:07.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:07 smithi175 ceph-mon[36977]: pgmap v227: 129 pgs: 18 active+clean+snaptrim, 59 active+clean, 52 active+clean+snaptrim_wait; 83 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 268 op/s 2024-06-13T02:25:08.523 INFO:tasks.workunit.client.0.smithi002.stdout: 1 532709 7.71 MB/sec execute 252 sec latency 26.388 ms 2024-06-13T02:25:09.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:09 smithi002 ceph-mon[31960]: pgmap v228: 129 pgs: 20 active+clean+snaptrim, 52 active+clean, 57 active+clean+snaptrim_wait; 83 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 282 op/s 2024-06-13T02:25:09.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:09 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:25:09.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:09 smithi084 ceph-mon[36833]: pgmap v228: 129 pgs: 20 active+clean+snaptrim, 52 active+clean, 57 active+clean+snaptrim_wait; 83 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 282 op/s 2024-06-13T02:25:09.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:09 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:25:09.523 INFO:tasks.workunit.client.0.smithi002.stdout: 1 533771 7.70 MB/sec execute 253 sec latency 31.561 ms 2024-06-13T02:25:09.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:09 smithi175 ceph-mon[36977]: pgmap v228: 129 pgs: 20 active+clean+snaptrim, 52 active+clean, 57 active+clean+snaptrim_wait; 83 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 282 op/s 2024-06-13T02:25:09.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:09 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:25:10.523 INFO:tasks.workunit.client.0.smithi002.stdout: 1 535216 7.69 MB/sec execute 254 sec latency 30.555 ms 2024-06-13T02:25:11.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:10 smithi002 ceph-mon[31960]: pgmap v229: 129 pgs: 20 active+clean+snaptrim, 52 active+clean, 57 active+clean+snaptrim_wait; 83 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 282 op/s 2024-06-13T02:25:11.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:10 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:25:11.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:10 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:25:11.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:10 smithi084 ceph-mon[36833]: pgmap v229: 129 pgs: 20 active+clean+snaptrim, 52 active+clean, 57 active+clean+snaptrim_wait; 83 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 282 op/s 2024-06-13T02:25:11.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:10 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:25:11.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:10 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:25:11.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:10 smithi175 ceph-mon[36977]: pgmap v229: 129 pgs: 20 active+clean+snaptrim, 52 active+clean, 57 active+clean+snaptrim_wait; 83 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.2 MiB/s wr, 282 op/s 2024-06-13T02:25:11.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:10 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:25:11.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:10 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:25:11.523 INFO:tasks.workunit.client.0.smithi002.stdout: 1 536771 7.71 MB/sec execute 255 sec latency 56.901 ms 2024-06-13T02:25:12.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:11 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:25:12.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:11 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:25:12.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:11 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:25:12.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:11 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:25:12.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:11 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:25:12.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:11 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:25:12.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:11 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:25:12.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:11 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:25:12.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:11 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:25:12.524 INFO:tasks.workunit.client.0.smithi002.stdout: 1 537865 7.70 MB/sec execute 256 sec latency 22.137 ms 2024-06-13T02:25:13.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:12 smithi002 ceph-mon[31960]: pgmap v230: 129 pgs: 129 active+clean; 85 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 255 op/s 2024-06-13T02:25:13.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:12 smithi084 ceph-mon[36833]: pgmap v230: 129 pgs: 129 active+clean; 85 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 255 op/s 2024-06-13T02:25:13.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:12 smithi175 ceph-mon[36977]: pgmap v230: 129 pgs: 129 active+clean; 85 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 255 op/s 2024-06-13T02:25:13.526 INFO:tasks.workunit.client.0.smithi002.stdout: 1 539586 7.70 MB/sec execute 257 sec latency 24.459 ms 2024-06-13T02:25:14.526 INFO:tasks.workunit.client.0.smithi002.stdout: 1 540760 7.70 MB/sec execute 258 sec latency 19.471 ms 2024-06-13T02:25:14.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:14 smithi002 ceph-mon[31960]: osdmap e108: 12 total, 12 up, 12 in 2024-06-13T02:25:14.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:14 smithi002 ceph-mon[31960]: pgmap v232: 129 pgs: 129 active+clean; 85 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 290 op/s 2024-06-13T02:25:14.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:14 smithi084 ceph-mon[36833]: osdmap e108: 12 total, 12 up, 12 in 2024-06-13T02:25:14.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:14 smithi084 ceph-mon[36833]: pgmap v232: 129 pgs: 129 active+clean; 85 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 290 op/s 2024-06-13T02:25:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:14 smithi175 ceph-mon[36977]: osdmap e108: 12 total, 12 up, 12 in 2024-06-13T02:25:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:14 smithi175 ceph-mon[36977]: pgmap v232: 129 pgs: 129 active+clean; 85 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 290 op/s 2024-06-13T02:25:15.526 INFO:tasks.workunit.client.0.smithi002.stdout: 1 541897 7.69 MB/sec execute 259 sec latency 37.284 ms 2024-06-13T02:25:15.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.708+0000 7f25a4e00640 1 -- 172.21.15.2:0/3987652057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a0107e00 msgr2=0x7f25a0108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:15.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.708+0000 7f25a4e00640 1 --2- 172.21.15.2:0/3987652057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a0107e00 0x7f25a0108260 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2588009900 tx=0x7f258802a480 comp rx=0 tx=0).stop 2024-06-13T02:25:15.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.708+0000 7f25a4e00640 1 -- 172.21.15.2:0/3987652057 shutdown_connections 2024-06-13T02:25:15.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.708+0000 7f25a4e00640 1 --2- 172.21.15.2:0/3987652057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25a01087a0 0x7f25a0114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.708+0000 7f25a4e00640 1 --2- 172.21.15.2:0/3987652057 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a0107e00 0x7f25a0108260 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.708+0000 7f25a4e00640 1 --2- 172.21.15.2:0/3987652057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a010dec0 0x7f25a010e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.708+0000 7f25a4e00640 1 -- 172.21.15.2:0/3987652057 >> 172.21.15.2:0/3987652057 conn(0x7f25a0077550 msgr2=0x7f25a0079970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:15.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.708+0000 7f25a4e00640 1 -- 172.21.15.2:0/3987652057 shutdown_connections 2024-06-13T02:25:15.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.708+0000 7f25a4e00640 1 -- 172.21.15.2:0/3987652057 wait complete. 2024-06-13T02:25:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.709+0000 7f25a4e00640 1 Processor -- start 2024-06-13T02:25:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.709+0000 7f25a4e00640 1 -- start start 2024-06-13T02:25:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f25a4e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a0107e00 0x7f25a019e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f25a4e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25a01087a0 0x7f25a019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f25a4e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a010dec0 0x7f25a01a2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f25a4e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25a0118180 con 0x7f25a0107e00 2024-06-13T02:25:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f25a4e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f25a0118000 con 0x7f25a01087a0 2024-06-13T02:25:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f25a4e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25a0118300 con 0x7f25a010dec0 2024-06-13T02:25:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f259ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25a01087a0 0x7f25a019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f259ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25a01087a0 0x7f25a019eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:45452/0 (socket says 172.21.15.2:45452) 2024-06-13T02:25:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f259ea00640 1 -- 172.21.15.2:0/380824860 learned_addr learned my addr 172.21.15.2:0/380824860 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f259f400640 1 --2- 172.21.15.2:0/380824860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a0107e00 0x7f25a019e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f259fe00640 1 --2- 172.21.15.2:0/380824860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a010dec0 0x7f25a01a2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f259ea00640 1 -- 172.21.15.2:0/380824860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a010dec0 msgr2=0x7f25a01a2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f259ea00640 1 --2- 172.21.15.2:0/380824860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a010dec0 0x7f25a01a2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f259ea00640 1 -- 172.21.15.2:0/380824860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a0107e00 msgr2=0x7f25a019e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f259ea00640 1 --2- 172.21.15.2:0/380824860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a0107e00 0x7f25a019e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.710+0000 7f259ea00640 1 -- 172.21.15.2:0/380824860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a01a3630 con 0x7f25a01087a0 2024-06-13T02:25:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.711+0000 7f259f400640 1 --2- 172.21.15.2:0/380824860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a0107e00 0x7f25a019e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:25:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.711+0000 7f259ea00640 1 --2- 172.21.15.2:0/380824860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25a01087a0 0x7f25a019eb80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2588006010 tx=0x7f2588004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.711+0000 7f2597e00640 1 -- 172.21.15.2:0/380824860 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258803f030 con 0x7f25a01087a0 2024-06-13T02:25:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.711+0000 7f25a4e00640 1 -- 172.21.15.2:0/380824860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a01a38c0 con 0x7f25a01087a0 2024-06-13T02:25:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.711+0000 7f2597e00640 1 -- 172.21.15.2:0/380824860 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2588004440 con 0x7f25a01087a0 2024-06-13T02:25:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.711+0000 7f2597e00640 1 -- 172.21.15.2:0/380824860 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2588035070 con 0x7f25a01087a0 2024-06-13T02:25:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.711+0000 7f25a4e00640 1 -- 172.21.15.2:0/380824860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a01ab1b0 con 0x7f25a01087a0 2024-06-13T02:25:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.715+0000 7f2597e00640 1 -- 172.21.15.2:0/380824860 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f2588042030 con 0x7f25a01087a0 2024-06-13T02:25:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.715+0000 7f25a91f6740 1 Processor -- start 2024-06-13T02:25:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.715+0000 7f25a91f6740 1 -- start start 2024-06-13T02:25:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.715+0000 7f25a91f6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9eadcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.715+0000 7f25a91f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eae230 0x55d6e9eae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.715+0000 7f25a91f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9ebb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.715+0000 7f25a91f6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d6e9e12420 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.715+0000 7f25a91f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d6e9db9c50 con 0x55d6e9eae230 2024-06-13T02:25:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.715+0000 7f25a91f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d6e9e0e3e0 con 0x55d6e9eb8fb0 2024-06-13T02:25:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.716+0000 7f259ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9ebb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.716+0000 7f259fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9eadcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.716+0000 7f259ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9ebb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:35550/0 (socket says 172.21.15.2:35550) 2024-06-13T02:25:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.716+0000 7f259ea00640 1 -- 172.21.15.2:0/2643618982 learned_addr learned my addr 172.21.15.2:0/2643618982 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.716+0000 7f259f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eae230 0x55d6e9eae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.716+0000 7f259ea00640 1 -- 172.21.15.2:0/2643618982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eae230 msgr2=0x55d6e9eae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.716+0000 7f259ea00640 1 --2- 172.21.15.2:0/2643618982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eae230 0x55d6e9eae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.716+0000 7f259ea00640 1 -- 172.21.15.2:0/2643618982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eaf7a0 msgr2=0x55d6e9eadcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.716+0000 7f259ea00640 1 --2- 172.21.15.2:0/2643618982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9eadcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.716+0000 7f259ea00640 1 -- 172.21.15.2:0/2643618982 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e9b26210 con 0x55d6e9eb8fb0 2024-06-13T02:25:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.716+0000 7f259fe00640 1 --2- 172.21.15.2:0/2643618982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9eadcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:25:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.716+0000 7f259f400640 1 --2- 172.21.15.2:0/2643618982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eae230 0x55d6e9eae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:25:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.717+0000 7f259ea00640 1 --2- 172.21.15.2:0/2643618982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9ebb3a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f25880f3d30 tx=0x7f25880f3e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f21a9c3999a6e2f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.717+0000 7f2597e00640 1 --2- 172.21.15.2:0/380824860 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f25840a2ce0 0x7f25840a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.717+0000 7f2594c00640 1 -- 172.21.15.2:0/2643618982 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25880ff020 con 0x55d6e9eb8fb0 2024-06-13T02:25:15.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.717+0000 7f259fe00640 1 --2- 172.21.15.2:0/380824860 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f25840a2ce0 0x7f25840a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.717+0000 7f2597e00640 1 -- 172.21.15.2:0/380824860 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9583+0+0 (secure 0 0 0) 0x7f25880efbc0 con 0x7f25a01087a0 2024-06-13T02:25:15.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.717+0000 7f2594c00640 1 -- 172.21.15.2:0/2643618982 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25880bc360 con 0x55d6e9eb8fb0 2024-06-13T02:25:15.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.717+0000 7f2594c00640 1 -- 172.21.15.2:0/2643618982 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25880bb7a0 con 0x55d6e9eb8fb0 2024-06-13T02:25:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.718+0000 7f25a91f6740 1 -- 172.21.15.2:0/2643618982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eb8fb0 msgr2=0x55d6e9ebb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.718+0000 7f25a91f6740 1 --2- 172.21.15.2:0/2643618982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9ebb3a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f25880f3d30 tx=0x7f25880f3e20 comp rx=0 tx=0).stop 2024-06-13T02:25:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.718+0000 7f259fe00640 1 --2- 172.21.15.2:0/380824860 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f25840a2ce0 0x7f25840a51a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2598005fd0 tx=0x7f2598009500 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.718+0000 7f25a91f6740 1 -- 172.21.15.2:0/2643618982 shutdown_connections 2024-06-13T02:25:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.718+0000 7f25a91f6740 1 --2- 172.21.15.2:0/2643618982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9ebb3a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.718+0000 7f25a91f6740 1 --2- 172.21.15.2:0/2643618982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eae230 0x55d6e9eae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.718+0000 7f25a91f6740 1 --2- 172.21.15.2:0/2643618982 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9eadcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.718+0000 7f25a91f6740 1 -- 172.21.15.2:0/2643618982 >> 172.21.15.2:0/2643618982 conn(0x55d6e9e76fb0 msgr2=0x55d6e9eaa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.719+0000 7f25a91f6740 1 -- 172.21.15.2:0/2643618982 shutdown_connections 2024-06-13T02:25:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.719+0000 7f25a91f6740 1 -- 172.21.15.2:0/2643618982 wait complete. 2024-06-13T02:25:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.719+0000 7f25a91f6740 1 -- start start 2024-06-13T02:25:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.719+0000 7f25a91f6740 1 Processor -- start 2024-06-13T02:25:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.720+0000 7f25a91f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eae230 0x55d6e9eb6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.720+0000 7f25a91f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9eb6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.720+0000 7f25a91f6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9eb6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.720+0000 7f25a91f6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55d6e9ebbaa0 con 0x55d6e9eb8fb0 2024-06-13T02:25:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.720+0000 7f25a91f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d6e9dcd0b0 con 0x55d6e9eae230 2024-06-13T02:25:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.720+0000 7f25a91f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d6e9ebbc20 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.720+0000 7f25a91f6740 10 client.0 _ll_register_callbacks cb 0x55d6e9db8f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:25:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.720+0000 7f259f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eae230 0x55d6e9eb6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.720+0000 7f259f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eae230 0x55d6e9eb6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:45468/0 (socket says 172.21.15.2:45468) 2024-06-13T02:25:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.720+0000 7f259f400640 1 -- 172.21.15.2:0/3457820554 learned_addr learned my addr 172.21.15.2:0/3457820554 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.720+0000 7f259ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9eb6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.720+0000 7f259fe00640 1 --2- 172.21.15.2:0/3457820554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9eb6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.720+0000 7f259f400640 1 -- 172.21.15.2:0/3457820554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eaf7a0 msgr2=0x55d6e9eb6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.721+0000 7f259f400640 1 --2- 172.21.15.2:0/3457820554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9eb6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.721+0000 7f259f400640 1 -- 172.21.15.2:0/3457820554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eb8fb0 msgr2=0x55d6e9eb6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.721+0000 7f259f400640 1 --2- 172.21.15.2:0/3457820554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9eb6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.721+0000 7f259f400640 1 -- 172.21.15.2:0/3457820554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e9bf2620 con 0x55d6e9eae230 2024-06-13T02:25:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.721+0000 7f259ea00640 1 --2- 172.21.15.2:0/3457820554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9eb6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:25:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.721+0000 7f259f400640 1 --2- 172.21.15.2:0/3457820554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eae230 0x55d6e9eb6000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2590013760 tx=0x7f2590013c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a21c14673a914e3f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.721+0000 7f258d600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:25:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.721+0000 7f258d600640 1 -- 172.21.15.2:0/3457820554 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590011e30 con 0x55d6e9eae230 2024-06-13T02:25:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.721+0000 7f25a91f6740 1 -- 172.21.15.2:0/3457820554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25880bc360 con 0x55d6e9eae230 2024-06-13T02:25:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.721+0000 7f258d600640 1 -- 172.21.15.2:0/3457820554 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9583+0+0 (secure 0 0 0) 0x7f2590004020 con 0x55d6e9eae230 2024-06-13T02:25:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.722+0000 7f258d600640 1 -- 172.21.15.2:0/3457820554 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2590026050 con 0x55d6e9eae230 2024-06-13T02:25:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.722+0000 7f25a91f6740 10 client.25853 fetch_fsmap learned FSMap version 35 2024-06-13T02:25:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.722+0000 7f25a91f6740 1 -- 172.21.15.2:0/3457820554 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d6e9ec7f20 con 0x55d6e9eae230 2024-06-13T02:25:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.722+0000 7f258d600640 1 -- 172.21.15.2:0/3457820554 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25880bc360 con 0x55d6e9eae230 2024-06-13T02:25:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.722+0000 7f258d600640 1 -- 172.21.15.2:0/3457820554 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f259001a030 con 0x55d6e9eae230 2024-06-13T02:25:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.722+0000 7f25a91f6740 10 client.25853 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:25:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.722+0000 7f25a91f6740 10 client.25853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:25:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.722+0000 7f25a91f6740 20 client.25853 populate_metadata read hostname 'smithi002' 2024-06-13T02:25:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.722+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3457820554 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d6e9ec93e0 0x55d6e9ecb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.722+0000 7f25a91f6740 4 client.25853 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:25:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.722+0000 7f25a91f6740 1 -- 172.21.15.2:0/3457820554 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6e9e1fb50 con 0x55d6e9ec93e0 2024-06-13T02:25:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.722+0000 7f259ea00640 1 --2- 172.21.15.2:0/3457820554 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d6e9ec93e0 0x55d6e9ecb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.723+0000 7f259ea00640 1 --2- 172.21.15.2:0/3457820554 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d6e9ec93e0 0x55d6e9ecb810 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ac5b5b089218c49 server_cookie=64aaab51ef022b35 in_seq=0 out_seq=0 2024-06-13T02:25:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.723+0000 7f258d600640 10 client.25853 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.724+0000 7f258d600640 1 -- 172.21.15.2:0/3457820554 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d6e9e1fb50 con 0x55d6e9ec93e0 2024-06-13T02:25:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.724+0000 7f258d600640 10 client.25853 handle_command_reply: tid=0 2024-06-13T02:25:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.724+0000 7f25a91f6740 1 client.25853 shutdown 2024-06-13T02:25:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.724+0000 7f25a91f6740 1 -- 172.21.15.2:0/3457820554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eae230 msgr2=0x55d6e9eb6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.724+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3457820554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eae230 0x55d6e9eb6000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2590013760 tx=0x7f2590013c20 comp rx=0 tx=0).stop 2024-06-13T02:25:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.724+0000 7f25a91f6740 1 -- 172.21.15.2:0/3457820554 shutdown_connections 2024-06-13T02:25:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.724+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3457820554 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d6e9ec93e0 0x55d6e9ecb810 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.724+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3457820554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9eb6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.724+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3457820554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9eb6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.724+0000 7f258d600640 0 client.25853 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.724+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3457820554 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eae230 0x55d6e9eb6000 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.724+0000 7f25a91f6740 1 -- 172.21.15.2:0/3457820554 >> 172.21.15.2:0/3457820554 conn(0x55d6e9e76fb0 msgr2=0x55d6e9eb0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.724+0000 7f25a91f6740 1 -- 172.21.15.2:0/3457820554 shutdown_connections 2024-06-13T02:25:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.724+0000 7f25a91f6740 1 -- 172.21.15.2:0/3457820554 wait complete. 2024-06-13T02:25:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.725+0000 7f25a91f6740 20 client.25853 trim_cache size 0 max 16384 2024-06-13T02:25:15.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.742+0000 7f25a91f6740 1 Processor -- start 2024-06-13T02:25:15.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.742+0000 7f25a91f6740 1 -- start start 2024-06-13T02:25:15.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.743+0000 7f25a91f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eae230 0x55d6e9ed1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.743+0000 7f25a91f6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9ed1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.743+0000 7f25a91f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9eb5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.743+0000 7f25a91f6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01b7d60 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.743+0000 7f25a91f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01b5630 con 0x55d6e9eb8fb0 2024-06-13T02:25:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.743+0000 7f25a91f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01b34a0 con 0x55d6e9eae230 2024-06-13T02:25:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.743+0000 7f259f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eae230 0x55d6e9ed1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.743+0000 7f259ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9ed1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.743+0000 7f259f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eae230 0x55d6e9ed1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:35564/0 (socket says 172.21.15.2:35564) 2024-06-13T02:25:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.743+0000 7f259ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9ed1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40324/0 (socket says 172.21.15.2:40324) 2024-06-13T02:25:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.743+0000 7f259f400640 1 -- 172.21.15.2:0/3239567208 learned_addr learned my addr 172.21.15.2:0/3239567208 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.743+0000 7f259fe00640 1 --2- 172.21.15.2:0/3239567208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9eb5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.744+0000 7f259ea00640 1 -- 172.21.15.2:0/3239567208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eae230 msgr2=0x55d6e9ed1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:15.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.744+0000 7f259ea00640 1 --2- 172.21.15.2:0/3239567208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eae230 0x55d6e9ed1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.744+0000 7f259ea00640 1 -- 172.21.15.2:0/3239567208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eb8fb0 msgr2=0x55d6e9eb5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.744+0000 7f259ea00640 1 --2- 172.21.15.2:0/3239567208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9eb5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.744+0000 7f259ea00640 1 -- 172.21.15.2:0/3239567208 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e9eaba50 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.744+0000 7f259ea00640 1 --2- 172.21.15.2:0/3239567208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9ed1660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55d6e9eaecd0 tx=0x7f25880bba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c35957b7319b74 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.744+0000 7f258fe00640 1 -- 172.21.15.2:0/3239567208 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2588049070 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.744+0000 7f258fe00640 1 -- 172.21.15.2:0/3239567208 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25880f3950 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.744+0000 7f258fe00640 1 -- 172.21.15.2:0/3239567208 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25880ff070 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.745+0000 7f25a91f6740 1 -- 172.21.15.2:0/3239567208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eaf7a0 msgr2=0x55d6e9ed1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.745+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3239567208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9ed1660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55d6e9eaecd0 tx=0x7f25880bba30 comp rx=0 tx=0).stop 2024-06-13T02:25:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.745+0000 7f25a91f6740 1 -- 172.21.15.2:0/3239567208 shutdown_connections 2024-06-13T02:25:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.745+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3239567208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9eb5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.745+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3239567208 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9ed1660 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.745+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3239567208 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eae230 0x55d6e9ed1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.745+0000 7f25a91f6740 1 -- 172.21.15.2:0/3239567208 >> 172.21.15.2:0/3239567208 conn(0x55d6e9e76fb0 msgr2=0x55d6e9eb1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.745+0000 7f25a91f6740 1 -- 172.21.15.2:0/3239567208 shutdown_connections 2024-06-13T02:25:15.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.745+0000 7f25a91f6740 1 -- 172.21.15.2:0/3239567208 wait complete. 2024-06-13T02:25:15.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.746+0000 7f25a91f6740 1 -- start start 2024-06-13T02:25:15.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.746+0000 7f25a91f6740 1 Processor -- start 2024-06-13T02:25:15.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.746+0000 7f25a91f6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eae230 0x55d6e9ec0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.750 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.746+0000 7f25a91f6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9ec14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.746+0000 7f25a91f6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9ebc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.746+0000 7f25a91f6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01b3af0 con 0x55d6e9eb8fb0 2024-06-13T02:25:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.746+0000 7f25a91f6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01b4f60 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.746+0000 7f25a91f6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01b41c0 con 0x55d6e9eae230 2024-06-13T02:25:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.746+0000 7f25a91f6740 10 client.0 _ll_register_callbacks cb 0x7f2590009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:25:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.746+0000 7f259ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9ec14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.747+0000 7f259ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9ec14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:45484/0 (socket says 172.21.15.2:45484) 2024-06-13T02:25:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.747+0000 7f259ea00640 1 -- 172.21.15.2:0/3091672708 learned_addr learned my addr 172.21.15.2:0/3091672708 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.747+0000 7f259f400640 1 --2- 172.21.15.2:0/3091672708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eae230 0x55d6e9ec0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.747+0000 7f259fe00640 1 --2- 172.21.15.2:0/3091672708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9ebc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.747+0000 7f259ea00640 1 -- 172.21.15.2:0/3091672708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eae230 msgr2=0x55d6e9ec0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.747+0000 7f259ea00640 1 --2- 172.21.15.2:0/3091672708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eae230 0x55d6e9ec0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.747+0000 7f259ea00640 1 -- 172.21.15.2:0/3091672708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eb8fb0 msgr2=0x55d6e9ebc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.747+0000 7f259ea00640 1 --2- 172.21.15.2:0/3091672708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9ebc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.747+0000 7f259ea00640 1 -- 172.21.15.2:0/3091672708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e9ebcc80 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.747+0000 7f259fe00640 1 --2- 172.21.15.2:0/3091672708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9ebc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:25:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.747+0000 7f259ea00640 1 --2- 172.21.15.2:0/3091672708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9ec14e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2588031550 tx=0x7f258803b460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a64dbf7ddb93311 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.747+0000 7f258d600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:25:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.747+0000 7f258d600640 1 -- 172.21.15.2:0/3091672708 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2588049070 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.747+0000 7f258d600640 1 -- 172.21.15.2:0/3091672708 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9583+0+0 (secure 0 0 0) 0x7f25880b9f60 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.747+0000 7f25a91f6740 1 -- 172.21.15.2:0/3091672708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25880f3950 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.748+0000 7f258d600640 1 -- 172.21.15.2:0/3091672708 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f25880d9050 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.748+0000 7f25a91f6740 10 client.25859 fetch_fsmap learned FSMap version 35 2024-06-13T02:25:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.748+0000 7f25a91f6740 1 -- 172.21.15.2:0/3091672708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d6e9ebcc80 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.748+0000 7f258d600640 1 -- 172.21.15.2:0/3091672708 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25880f3950 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.748+0000 7f258d600640 1 -- 172.21.15.2:0/3091672708 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f2588003c60 con 0x55d6e9eaf7a0 2024-06-13T02:25:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.748+0000 7f25a91f6740 10 client.25859 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:25:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.748+0000 7f25a91f6740 10 client.25859 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:25:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.748+0000 7f25a91f6740 20 client.25859 populate_metadata read hostname 'smithi002' 2024-06-13T02:25:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.748+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3091672708 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d6e9f33cf0 0x55d6e9f360e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.748+0000 7f25a91f6740 4 client.25859 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:25:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.748+0000 7f25a91f6740 1 -- 172.21.15.2:0/3091672708 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d6e9e19ea0 con 0x55d6e9f33cf0 2024-06-13T02:25:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.748+0000 7f259f400640 1 --2- 172.21.15.2:0/3091672708 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d6e9f33cf0 0x55d6e9f360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.749+0000 7f259f400640 1 --2- 172.21.15.2:0/3091672708 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d6e9f33cf0 0x55d6e9f360e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7290569cfa345a6 server_cookie=736c4d5248e14ffd in_seq=0 out_seq=0 2024-06-13T02:25:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:15.749+0000 7f258d600640 10 client.25859 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.039+0000 7f258d600640 1 -- 172.21.15.2:0/3091672708 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d6e9e19ea0 con 0x55d6e9f33cf0 2024-06-13T02:25:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.039+0000 7f258d600640 10 client.25859 handle_command_reply: tid=0 2024-06-13T02:25:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.039+0000 7f25a91f6740 1 client.25859 shutdown 2024-06-13T02:25:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.039+0000 7f25a91f6740 1 -- 172.21.15.2:0/3091672708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eaf7a0 msgr2=0x55d6e9ec14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.039+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3091672708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9ec14e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2588031550 tx=0x7f258803b460 comp rx=0 tx=0).stop 2024-06-13T02:25:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.039+0000 7f25a91f6740 1 -- 172.21.15.2:0/3091672708 shutdown_connections 2024-06-13T02:25:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.039+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3091672708 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55d6e9f33cf0 0x55d6e9f360e0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.039+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3091672708 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55d6e9eb8fb0 0x55d6e9ebc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.039+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3091672708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d6e9eaf7a0 0x55d6e9ec14e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.039+0000 7f25a91f6740 1 --2- 172.21.15.2:0/3091672708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d6e9eae230 0x55d6e9ec0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.039+0000 7f25a91f6740 1 -- 172.21.15.2:0/3091672708 >> 172.21.15.2:0/3091672708 conn(0x55d6e9e76fb0 msgr2=0x55d6e9ea9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.039+0000 7f258d600640 0 client.25859 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.039+0000 7f25a91f6740 1 -- 172.21.15.2:0/3091672708 shutdown_connections 2024-06-13T02:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.039+0000 7f25a91f6740 1 -- 172.21.15.2:0/3091672708 wait complete. 2024-06-13T02:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.040+0000 7f25a91f6740 20 client.25859 trim_cache size 0 max 16384 2024-06-13T02:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:25:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:25:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.040+0000 7f25a4e00640 1 -- 172.21.15.2:0/380824860 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f25840a2ce0 msgr2=0x7f25840a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.040+0000 7f25a4e00640 1 --2- 172.21.15.2:0/380824860 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f25840a2ce0 0x7f25840a51a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2598005fd0 tx=0x7f2598009500 comp rx=0 tx=0).stop 2024-06-13T02:25:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.040+0000 7f25a4e00640 1 -- 172.21.15.2:0/380824860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25a01087a0 msgr2=0x7f25a019eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.040+0000 7f25a4e00640 1 --2- 172.21.15.2:0/380824860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25a01087a0 0x7f25a019eb80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2588006010 tx=0x7f2588004040 comp rx=0 tx=0).stop 2024-06-13T02:25:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.040+0000 7f25a4e00640 1 -- 172.21.15.2:0/380824860 shutdown_connections 2024-06-13T02:25:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.040+0000 7f25a4e00640 1 --2- 172.21.15.2:0/380824860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f25a010dec0 0x7f25a01a2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.040+0000 7f25a4e00640 1 --2- 172.21.15.2:0/380824860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25a01087a0 0x7f25a019eb80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.040+0000 7f25a4e00640 1 --2- 172.21.15.2:0/380824860 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f25840a2ce0 0x7f25840a51a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.040+0000 7f25a4e00640 1 --2- 172.21.15.2:0/380824860 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25a0107e00 0x7f25a019e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.040+0000 7f25a4e00640 1 -- 172.21.15.2:0/380824860 >> 172.21.15.2:0/380824860 conn(0x7f25a0077550 msgr2=0x7f25a0078cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.041+0000 7f25a4e00640 1 -- 172.21.15.2:0/380824860 shutdown_connections 2024-06-13T02:25:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:16.041+0000 7f25a4e00640 1 -- 172.21.15.2:0/380824860 wait complete. 2024-06-13T02:25:16.526 INFO:tasks.workunit.client.0.smithi002.stdout: 1 543530 7.70 MB/sec execute 260 sec latency 166.043 ms 2024-06-13T02:25:17.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:16 smithi084 ceph-mon[36833]: pgmap v233: 129 pgs: 129 active+clean; 90 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 160 op/s 2024-06-13T02:25:17.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:16 smithi175 ceph-mon[36977]: pgmap v233: 129 pgs: 129 active+clean; 90 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 160 op/s 2024-06-13T02:25:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:16 smithi002 ceph-mon[31960]: pgmap v233: 129 pgs: 129 active+clean; 90 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 160 op/s 2024-06-13T02:25:17.527 INFO:tasks.workunit.client.0.smithi002.stdout: 1 544423 7.68 MB/sec execute 261 sec latency 16.878 ms 2024-06-13T02:25:18.527 INFO:tasks.workunit.client.0.smithi002.stdout: 1 545498 7.67 MB/sec execute 262 sec latency 23.800 ms 2024-06-13T02:25:19.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:18 smithi084 ceph-mon[36833]: pgmap v234: 129 pgs: 129 active+clean; 90 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 181 op/s 2024-06-13T02:25:19.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:18 smithi175 ceph-mon[36977]: pgmap v234: 129 pgs: 129 active+clean; 90 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 181 op/s 2024-06-13T02:25:19.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:18 smithi002 ceph-mon[31960]: pgmap v234: 129 pgs: 129 active+clean; 90 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 181 op/s 2024-06-13T02:25:19.527 INFO:tasks.workunit.client.0.smithi002.stdout: 1 547154 7.69 MB/sec execute 263 sec latency 63.915 ms 2024-06-13T02:25:20.527 INFO:tasks.workunit.client.0.smithi002.stdout: 1 547953 7.67 MB/sec execute 264 sec latency 32.311 ms 2024-06-13T02:25:21.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:20 smithi084 ceph-mon[36833]: pgmap v235: 129 pgs: 129 active+clean; 90 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 181 op/s 2024-06-13T02:25:21.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:20 smithi175 ceph-mon[36977]: pgmap v235: 129 pgs: 129 active+clean; 90 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 181 op/s 2024-06-13T02:25:21.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:20 smithi002 ceph-mon[31960]: pgmap v235: 129 pgs: 129 active+clean; 90 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 181 op/s 2024-06-13T02:25:21.527 INFO:tasks.workunit.client.0.smithi002.stdout: 1 548896 7.66 MB/sec execute 265 sec latency 39.103 ms 2024-06-13T02:25:22.527 INFO:tasks.workunit.client.0.smithi002.stdout: 1 550558 7.67 MB/sec execute 266 sec latency 48.242 ms 2024-06-13T02:25:23.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:22 smithi084 ceph-mon[36833]: pgmap v236: 129 pgs: 129 active+clean; 87 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 259 op/s 2024-06-13T02:25:23.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:22 smithi175 ceph-mon[36977]: pgmap v236: 129 pgs: 129 active+clean; 87 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 259 op/s 2024-06-13T02:25:23.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:22 smithi002 ceph-mon[31960]: pgmap v236: 129 pgs: 129 active+clean; 87 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 259 op/s 2024-06-13T02:25:23.528 INFO:tasks.workunit.client.0.smithi002.stdout: 1 551346 7.65 MB/sec execute 267 sec latency 19.672 ms 2024-06-13T02:25:24.528 INFO:tasks.workunit.client.0.smithi002.stdout: 1 552272 7.64 MB/sec execute 268 sec latency 26.344 ms 2024-06-13T02:25:25.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:24 smithi084 ceph-mon[36833]: pgmap v237: 129 pgs: 129 active+clean; 87 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 253 op/s 2024-06-13T02:25:25.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:24 smithi175 ceph-mon[36977]: pgmap v237: 129 pgs: 129 active+clean; 87 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 253 op/s 2024-06-13T02:25:25.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:24 smithi002 ceph-mon[31960]: pgmap v237: 129 pgs: 129 active+clean; 87 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 253 op/s 2024-06-13T02:25:25.528 INFO:tasks.workunit.client.0.smithi002.stdout: 1 553808 7.64 MB/sec execute 269 sec latency 41.784 ms 2024-06-13T02:25:26.528 INFO:tasks.workunit.client.0.smithi002.stdout: 1 554780 7.64 MB/sec execute 270 sec latency 38.855 ms 2024-06-13T02:25:27.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:26 smithi084 ceph-mon[36833]: pgmap v238: 129 pgs: 129 active+clean; 87 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 239 op/s 2024-06-13T02:25:27.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:26 smithi175 ceph-mon[36977]: pgmap v238: 129 pgs: 129 active+clean; 87 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 239 op/s 2024-06-13T02:25:27.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:26 smithi002 ceph-mon[31960]: pgmap v238: 129 pgs: 129 active+clean; 87 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 239 op/s 2024-06-13T02:25:27.528 INFO:tasks.workunit.client.0.smithi002.stdout: 1 555819 7.63 MB/sec execute 271 sec latency 33.014 ms 2024-06-13T02:25:28.528 INFO:tasks.workunit.client.0.smithi002.stdout: 1 557497 7.63 MB/sec execute 272 sec latency 27.398 ms 2024-06-13T02:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.202+0000 7f9e36c00640 1 -- 172.21.15.2:0/3502282617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e30101990 msgr2=0x7f9e30101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.202+0000 7f9e36c00640 1 --2- 172.21.15.2:0/3502282617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e30101990 0x7f9e30101e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009900 tx=0x7f9e1802a400 comp rx=0 tx=0).stop 2024-06-13T02:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.202+0000 7f9e36c00640 1 -- 172.21.15.2:0/3502282617 shutdown_connections 2024-06-13T02:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.202+0000 7f9e36c00640 1 --2- 172.21.15.2:0/3502282617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e30102350 0x7f9e3010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.202+0000 7f9e36c00640 1 --2- 172.21.15.2:0/3502282617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e30101990 0x7f9e30101e10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.202+0000 7f9e36c00640 1 --2- 172.21.15.2:0/3502282617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e301079a0 0x7f9e30107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.202+0000 7f9e36c00640 1 -- 172.21.15.2:0/3502282617 >> 172.21.15.2:0/3502282617 conn(0x7f9e300fd460 msgr2=0x7f9e300ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.202+0000 7f9e36c00640 1 -- 172.21.15.2:0/3502282617 shutdown_connections 2024-06-13T02:25:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.202+0000 7f9e36c00640 1 -- 172.21.15.2:0/3502282617 wait complete. 2024-06-13T02:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.203+0000 7f9e36c00640 1 Processor -- start 2024-06-13T02:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.203+0000 7f9e36c00640 1 -- start start 2024-06-13T02:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.204+0000 7f9e36c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e30101990 0x7f9e30198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.204+0000 7f9e36c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e30102350 0x7f9e301987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.204+0000 7f9e36c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e301079a0 0x7f9e3019cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.204+0000 7f9e36c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9e30111e00 con 0x7f9e301079a0 2024-06-13T02:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.204+0000 7f9e36c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9e30111c80 con 0x7f9e30102350 2024-06-13T02:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.204+0000 7f9e36c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e30111f80 con 0x7f9e30101990 2024-06-13T02:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.204+0000 7f9e27e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e30102350 0x7f9e301987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.204+0000 7f9e27e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e30102350 0x7f9e301987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:52170/0 (socket says 172.21.15.2:52170) 2024-06-13T02:25:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.204+0000 7f9e27e00640 1 -- 172.21.15.2:0/314958555 learned_addr learned my addr 172.21.15.2:0/314958555 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.204+0000 7f9e34c00640 1 --2- 172.21.15.2:0/314958555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e301079a0 0x7f9e3019cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.204+0000 7f9e2fe00640 1 --2- 172.21.15.2:0/314958555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e30101990 0x7f9e30198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.205+0000 7f9e27e00640 1 -- 172.21.15.2:0/314958555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e30101990 msgr2=0x7f9e30198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.205+0000 7f9e27e00640 1 --2- 172.21.15.2:0/314958555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e30101990 0x7f9e30198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.205+0000 7f9e27e00640 1 -- 172.21.15.2:0/314958555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e301079a0 msgr2=0x7f9e3019cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.205+0000 7f9e27e00640 1 --2- 172.21.15.2:0/314958555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e301079a0 0x7f9e3019cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.205+0000 7f9e27e00640 1 -- 172.21.15.2:0/314958555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3019d250 con 0x7f9e30102350 2024-06-13T02:25:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.205+0000 7f9e27e00640 1 --2- 172.21.15.2:0/314958555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e30102350 0x7f9e301987a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9e1802a9f0 tx=0x7f9e18003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.205+0000 7f9e2d600640 1 -- 172.21.15.2:0/314958555 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1803f070 con 0x7f9e30102350 2024-06-13T02:25:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.205+0000 7f9e2d600640 1 -- 172.21.15.2:0/314958555 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e18031c30 con 0x7f9e30102350 2024-06-13T02:25:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.205+0000 7f9e36c00640 1 -- 172.21.15.2:0/314958555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3019d4e0 con 0x7f9e30102350 2024-06-13T02:25:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.205+0000 7f9e2d600640 1 -- 172.21.15.2:0/314958555 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e18035030 con 0x7f9e30102350 2024-06-13T02:25:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.205+0000 7f9e36c00640 1 -- 172.21.15.2:0/314958555 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e301a4dd0 con 0x7f9e30102350 2024-06-13T02:25:29.210 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.209+0000 7f9e2d600640 1 -- 172.21.15.2:0/314958555 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f9e18042070 con 0x7f9e30102350 2024-06-13T02:25:29.210 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.209+0000 7f9e3999e740 1 Processor -- start 2024-06-13T02:25:29.210 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.209+0000 7f9e3999e740 1 -- start start 2024-06-13T02:25:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.210+0000 7f9e3999e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e770499b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.210+0000 7f9e3999e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 0x55e77049a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.210+0000 7f9e3999e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7704a9200 0x55e7704ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.210+0000 7f9e3999e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e7703fe420 con 0x55e7704a9200 2024-06-13T02:25:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.210+0000 7f9e3999e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e7703a5c50 con 0x55e77049b5e0 2024-06-13T02:25:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.210+0000 7f9e3999e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e7703fa3e0 con 0x55e77049a070 2024-06-13T02:25:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.210+0000 7f9e34c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e770499b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.210+0000 7f9e34c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e770499b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:52178/0 (socket says 172.21.15.2:52178) 2024-06-13T02:25:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.210+0000 7f9e34c00640 1 -- 172.21.15.2:0/2768269851 learned_addr learned my addr 172.21.15.2:0/2768269851 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.210+0000 7f9e2fe00640 1 --2- 172.21.15.2:0/2768269851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 0x55e77049a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.210+0000 7f9e27e00640 1 --2- 172.21.15.2:0/2768269851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7704a9200 0x55e7704ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.210+0000 7f9e34c00640 1 -- 172.21.15.2:0/2768269851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 msgr2=0x55e77049a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.211+0000 7f9e34c00640 1 --2- 172.21.15.2:0/2768269851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 0x55e77049a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.211+0000 7f9e34c00640 1 -- 172.21.15.2:0/2768269851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7704a9200 msgr2=0x55e7704ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.211+0000 7f9e34c00640 1 --2- 172.21.15.2:0/2768269851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7704a9200 0x55e7704ab5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.211+0000 7f9e34c00640 1 -- 172.21.15.2:0/2768269851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e770112210 con 0x55e77049b5e0 2024-06-13T02:25:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.211+0000 7f9e2fe00640 1 --2- 172.21.15.2:0/2768269851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 0x55e77049a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:25:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.211+0000 7f9e2d600640 1 --2- 172.21.15.2:0/314958555 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f9e140a2d70 0x7f9e140a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.211+0000 7f9e2d600640 1 -- 172.21.15.2:0/314958555 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9583+0+0 (secure 0 0 0) 0x7f9e180efa90 con 0x7f9e30102350 2024-06-13T02:25:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.211+0000 7f9e34c00640 1 --2- 172.21.15.2:0/2768269851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e770499b30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9e28011440 tx=0x7f9e28011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44a76ff706b30f6b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.211+0000 7f9e2fe00640 1 --2- 172.21.15.2:0/314958555 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f9e140a2d70 0x7f9e140a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.211+0000 7f9e25200640 1 -- 172.21.15.2:0/2768269851 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28004d20 con 0x55e77049b5e0 2024-06-13T02:25:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.211+0000 7f9e25200640 1 -- 172.21.15.2:0/2768269851 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e28004050 con 0x55e77049b5e0 2024-06-13T02:25:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.211+0000 7f9e25200640 1 -- 172.21.15.2:0/2768269851 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800f780 con 0x55e77049b5e0 2024-06-13T02:25:29.216 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.212+0000 7f9e3999e740 1 -- 172.21.15.2:0/2768269851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 msgr2=0x55e770499b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.212+0000 7f9e2fe00640 1 --2- 172.21.15.2:0/314958555 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f9e140a2d70 0x7f9e140a5230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55e77049cd40 tx=0x7f9e20005f90 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.212+0000 7f9e3999e740 1 --2- 172.21.15.2:0/2768269851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e770499b30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9e28011440 tx=0x7f9e28011900 comp rx=0 tx=0).stop 2024-06-13T02:25:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.212+0000 7f9e3999e740 1 -- 172.21.15.2:0/2768269851 shutdown_connections 2024-06-13T02:25:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.212+0000 7f9e3999e740 1 --2- 172.21.15.2:0/2768269851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7704a9200 0x55e7704ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.212+0000 7f9e3999e740 1 --2- 172.21.15.2:0/2768269851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 0x55e77049a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.212+0000 7f9e3999e740 1 --2- 172.21.15.2:0/2768269851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e770499b30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.212+0000 7f9e3999e740 1 -- 172.21.15.2:0/2768269851 >> 172.21.15.2:0/2768269851 conn(0x55e770462fb0 msgr2=0x55e770496660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.212+0000 7f9e3999e740 1 -- 172.21.15.2:0/2768269851 shutdown_connections 2024-06-13T02:25:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.212+0000 7f9e3999e740 1 -- 172.21.15.2:0/2768269851 wait complete. 2024-06-13T02:25:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.213+0000 7f9e3999e740 1 -- start start 2024-06-13T02:25:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.213+0000 7f9e3999e740 1 Processor -- start 2024-06-13T02:25:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.214+0000 7f9e3999e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 0x55e7704a6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.217 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.214+0000 7f9e3999e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704a6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.214+0000 7f9e3999e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7704a9200 0x55e7704a6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.214+0000 7f9e3999e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55e7704abfd0 con 0x55e7704a9200 2024-06-13T02:25:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.214+0000 7f9e3999e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e7703b90b0 con 0x55e77049b5e0 2024-06-13T02:25:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.214+0000 7f9e3999e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e7704ac150 con 0x55e77049a070 2024-06-13T02:25:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.214+0000 7f9e3999e740 10 client.0 _ll_register_callbacks cb 0x55e7703a4f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:25:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.214+0000 7f9e27e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704a6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.214+0000 7f9e34c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7704a9200 0x55e7704a6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.214+0000 7f9e27e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704a6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:52190/0 (socket says 172.21.15.2:52190) 2024-06-13T02:25:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.214+0000 7f9e27e00640 1 -- 172.21.15.2:0/2526387769 learned_addr learned my addr 172.21.15.2:0/2526387769 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.214+0000 7f9e2fe00640 1 --2- 172.21.15.2:0/2526387769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 0x55e7704a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.215+0000 7f9e27e00640 1 -- 172.21.15.2:0/2526387769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 msgr2=0x55e7704a6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.215+0000 7f9e27e00640 1 --2- 172.21.15.2:0/2526387769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 0x55e7704a6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.215+0000 7f9e27e00640 1 -- 172.21.15.2:0/2526387769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7704a9200 msgr2=0x55e7704a6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.215+0000 7f9e27e00640 1 --2- 172.21.15.2:0/2526387769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7704a9200 0x55e7704a6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.215+0000 7f9e27e00640 1 -- 172.21.15.2:0/2526387769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7701de620 con 0x55e77049b5e0 2024-06-13T02:25:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.215+0000 7f9e27e00640 1 --2- 172.21.15.2:0/2526387769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704a6790 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9e18000c00 tx=0x7f9e180095e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2a16041b6ea5d80 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.215+0000 7f9e1d600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:25:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.215+0000 7f9e1d600640 1 -- 172.21.15.2:0/2526387769 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e18049070 con 0x55e77049b5e0 2024-06-13T02:25:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.215+0000 7f9e3999e740 1 -- 172.21.15.2:0/2526387769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e28004050 con 0x55e77049b5e0 2024-06-13T02:25:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.215+0000 7f9e1d600640 1 -- 172.21.15.2:0/2526387769 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9583+0+0 (secure 0 0 0) 0x7f9e180c4370 con 0x55e77049b5e0 2024-06-13T02:25:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.216+0000 7f9e1d600640 1 -- 172.21.15.2:0/2526387769 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9e180f7040 con 0x55e77049b5e0 2024-06-13T02:25:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.216+0000 7f9e3999e740 10 client.25871 fetch_fsmap learned FSMap version 35 2024-06-13T02:25:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.216+0000 7f9e3999e740 1 -- 172.21.15.2:0/2526387769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e7704b8370 con 0x55e77049b5e0 2024-06-13T02:25:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.216+0000 7f9e1d600640 1 -- 172.21.15.2:0/2526387769 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e28004050 con 0x55e77049b5e0 2024-06-13T02:25:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.216+0000 7f9e1d600640 1 -- 172.21.15.2:0/2526387769 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9e180bb090 con 0x55e77049b5e0 2024-06-13T02:25:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.216+0000 7f9e3999e740 10 client.25871 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:25:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.216+0000 7f9e3999e740 10 client.25871 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:25:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.216+0000 7f9e3999e740 20 client.25871 populate_metadata read hostname 'smithi002' 2024-06-13T02:25:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.216+0000 7f9e3999e740 1 --2- 172.21.15.2:0/2526387769 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e7704b9870 0x55e7704bbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.216+0000 7f9e3999e740 4 client.25871 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:25:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.216+0000 7f9e3999e740 1 -- 172.21.15.2:0/2526387769 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e77040bb50 con 0x55e7704b9870 2024-06-13T02:25:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.217+0000 7f9e2fe00640 1 --2- 172.21.15.2:0/2526387769 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e7704b9870 0x55e7704bbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:28 smithi084 ceph-mon[36833]: pgmap v239: 129 pgs: 129 active+clean; 89 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 214 op/s 2024-06-13T02:25:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.217+0000 7f9e2fe00640 1 --2- 172.21.15.2:0/2526387769 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e7704b9870 0x55e7704bbcb0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9db7a23c8f1c89f5 server_cookie=e70a66281b4bbeb0 in_seq=0 out_seq=0 2024-06-13T02:25:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.217+0000 7f9e1d600640 10 client.25871 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.219+0000 7f9e1d600640 1 -- 172.21.15.2:0/2526387769 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55e77040bb50 con 0x55e7704b9870 2024-06-13T02:25:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.219+0000 7f9e1d600640 10 client.25871 handle_command_reply: tid=0 2024-06-13T02:25:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.219+0000 7f9e3999e740 1 client.25871 shutdown 2024-06-13T02:25:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.219+0000 7f9e3999e740 1 -- 172.21.15.2:0/2526387769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 msgr2=0x55e7704a6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.219+0000 7f9e3999e740 1 --2- 172.21.15.2:0/2526387769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704a6790 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9e18000c00 tx=0x7f9e180095e0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.219+0000 7f9e3999e740 1 -- 172.21.15.2:0/2526387769 shutdown_connections 2024-06-13T02:25:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.219+0000 7f9e3999e740 1 --2- 172.21.15.2:0/2526387769 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e7704b9870 0x55e7704bbcb0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.219+0000 7f9e3999e740 1 --2- 172.21.15.2:0/2526387769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7704a9200 0x55e7704a6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.219+0000 7f9e3999e740 1 --2- 172.21.15.2:0/2526387769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704a6790 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.219+0000 7f9e3999e740 1 --2- 172.21.15.2:0/2526387769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 0x55e7704a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.219+0000 7f9e1d600640 0 client.25871 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.219+0000 7f9e3999e740 1 -- 172.21.15.2:0/2526387769 >> 172.21.15.2:0/2526387769 conn(0x55e770462fb0 msgr2=0x55e77049c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.219+0000 7f9e3999e740 1 -- 172.21.15.2:0/2526387769 shutdown_connections 2024-06-13T02:25:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.220+0000 7f9e3999e740 1 -- 172.21.15.2:0/2526387769 wait complete. 2024-06-13T02:25:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.220+0000 7f9e3999e740 20 client.25871 trim_cache size 0 max 16384 2024-06-13T02:25:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.238+0000 7f9e3999e740 1 Processor -- start 2024-06-13T02:25:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.238+0000 7f9e3999e740 1 -- start start 2024-06-13T02:25:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.239+0000 7f9e3999e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 0x55e77049c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.239+0000 7f9e3999e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704c15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.239 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.239+0000 7f9e3999e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7704a9200 0x55e7704c1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.239+0000 7f9e3999e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9e301af670 con 0x55e7704a9200 2024-06-13T02:25:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.239+0000 7f9e3999e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9e301acf40 con 0x55e77049b5e0 2024-06-13T02:25:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.239+0000 7f9e3999e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e301aadb0 con 0x55e77049a070 2024-06-13T02:25:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.239+0000 7f9e27e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704c15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.239+0000 7f9e27e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704c15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:52206/0 (socket says 172.21.15.2:52206) 2024-06-13T02:25:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.239+0000 7f9e27e00640 1 -- 172.21.15.2:0/3594083466 learned_addr learned my addr 172.21.15.2:0/3594083466 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.239+0000 7f9e34c00640 1 --2- 172.21.15.2:0/3594083466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7704a9200 0x55e7704c1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.239+0000 7f9e2fe00640 1 --2- 172.21.15.2:0/3594083466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 0x55e77049c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.240+0000 7f9e27e00640 1 -- 172.21.15.2:0/3594083466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 msgr2=0x55e77049c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.240+0000 7f9e27e00640 1 --2- 172.21.15.2:0/3594083466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 0x55e77049c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.240+0000 7f9e27e00640 1 -- 172.21.15.2:0/3594083466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7704a9200 msgr2=0x55e7704c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.240+0000 7f9e27e00640 1 --2- 172.21.15.2:0/3594083466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7704a9200 0x55e7704c1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.240+0000 7f9e27e00640 1 -- 172.21.15.2:0/3594083466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7704bc330 con 0x55e77049b5e0 2024-06-13T02:25:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.240+0000 7f9e27e00640 1 --2- 172.21.15.2:0/3594083466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704c15c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9e18005ec0 tx=0x7f9e1803b750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4620acb6fdd8779 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.240+0000 7f9e1fe00640 1 -- 172.21.15.2:0/3594083466 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e18049070 con 0x55e77049b5e0 2024-06-13T02:25:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.240+0000 7f9e1fe00640 1 -- 172.21.15.2:0/3594083466 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e180a6040 con 0x55e77049b5e0 2024-06-13T02:25:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.240+0000 7f9e1fe00640 1 -- 172.21.15.2:0/3594083466 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1803b460 con 0x55e77049b5e0 2024-06-13T02:25:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.241+0000 7f9e3999e740 1 -- 172.21.15.2:0/3594083466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 msgr2=0x55e7704c15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.241+0000 7f9e3999e740 1 --2- 172.21.15.2:0/3594083466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704c15c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9e18005ec0 tx=0x7f9e1803b750 comp rx=0 tx=0).stop 2024-06-13T02:25:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.241+0000 7f9e3999e740 1 -- 172.21.15.2:0/3594083466 shutdown_connections 2024-06-13T02:25:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.241+0000 7f9e3999e740 1 --2- 172.21.15.2:0/3594083466 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e7704a9200 0x55e7704c1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.241+0000 7f9e3999e740 1 --2- 172.21.15.2:0/3594083466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704c15c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.241+0000 7f9e3999e740 1 --2- 172.21.15.2:0/3594083466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e77049a070 0x55e77049c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.241+0000 7f9e3999e740 1 -- 172.21.15.2:0/3594083466 >> 172.21.15.2:0/3594083466 conn(0x55e770462fb0 msgr2=0x55e77049bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.241+0000 7f9e3999e740 1 -- 172.21.15.2:0/3594083466 shutdown_connections 2024-06-13T02:25:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.241+0000 7f9e3999e740 1 -- 172.21.15.2:0/3594083466 wait complete. 2024-06-13T02:25:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.242+0000 7f9e3999e740 1 -- start start 2024-06-13T02:25:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.242+0000 7f9e3999e740 1 Processor -- start 2024-06-13T02:25:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.242+0000 7f9e3999e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e77049a070 0x55e7704b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.242+0000 7f9e3999e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.242+0000 7f9e3999e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e7704a9200 0x55e7704ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.242+0000 7f9e3999e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9e301ab400 con 0x55e77049a070 2024-06-13T02:25:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.242+0000 7f9e3999e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9e301ac870 con 0x55e77049b5e0 2024-06-13T02:25:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.242+0000 7f9e3999e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e301abad0 con 0x55e7704a9200 2024-06-13T02:25:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.242+0000 7f9e3999e740 10 client.0 _ll_register_callbacks cb 0x7f9e180045a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:25:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.243+0000 7f9e2fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e77049a070 0x55e7704b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.243+0000 7f9e2fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e77049a070 0x55e7704b1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33518/0 (socket says 172.21.15.2:33518) 2024-06-13T02:25:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.243+0000 7f9e2fe00640 1 -- 172.21.15.2:0/3890297851 learned_addr learned my addr 172.21.15.2:0/3890297851 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.243+0000 7f9e34c00640 1 --2- 172.21.15.2:0/3890297851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e7704a9200 0x55e7704ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.243+0000 7f9e27e00640 1 --2- 172.21.15.2:0/3890297851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.243+0000 7f9e2fe00640 1 -- 172.21.15.2:0/3890297851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e7704a9200 msgr2=0x55e7704ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.243+0000 7f9e2fe00640 1 --2- 172.21.15.2:0/3890297851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e7704a9200 0x55e7704ad300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.243+0000 7f9e2fe00640 1 -- 172.21.15.2:0/3890297851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 msgr2=0x55e7704acdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.243+0000 7f9e2fe00640 1 --2- 172.21.15.2:0/3890297851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704acdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.243+0000 7f9e2fe00640 1 -- 172.21.15.2:0/3890297851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7704ad9f0 con 0x55e77049a070 2024-06-13T02:25:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.243+0000 7f9e27e00640 1 --2- 172.21.15.2:0/3890297851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704acdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:25:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.243+0000 7f9e2fe00640 1 --2- 172.21.15.2:0/3890297851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e77049a070 0x55e7704b1a50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55e7704bc530 tx=0x7f9e200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ad4d0c72881030 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.243+0000 7f9e1d600640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:25:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.244+0000 7f9e1d600640 1 -- 172.21.15.2:0/3890297851 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20003bc0 con 0x55e77049a070 2024-06-13T02:25:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.244+0000 7f9e1d600640 1 -- 172.21.15.2:0/3890297851 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9583+0+0 (secure 0 0 0) 0x7f9e20003d60 con 0x55e77049a070 2024-06-13T02:25:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.244+0000 7f9e3999e740 1 -- 172.21.15.2:0/3890297851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e180a6040 con 0x55e77049a070 2024-06-13T02:25:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.244+0000 7f9e1d600640 1 -- 172.21.15.2:0/3890297851 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9e2002b380 con 0x55e77049a070 2024-06-13T02:25:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.244+0000 7f9e3999e740 10 client.15696 fetch_fsmap learned FSMap version 35 2024-06-13T02:25:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.244+0000 7f9e3999e740 1 -- 172.21.15.2:0/3890297851 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e7705244a0 con 0x55e77049a070 2024-06-13T02:25:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.244+0000 7f9e1d600640 1 -- 172.21.15.2:0/3890297851 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e180a6040 con 0x55e77049a070 2024-06-13T02:25:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.245+0000 7f9e1d600640 1 -- 172.21.15.2:0/3890297851 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9e20034960 con 0x55e77049a070 2024-06-13T02:25:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.245+0000 7f9e3999e740 10 client.15696 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:25:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.245+0000 7f9e3999e740 10 client.15696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:25:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.245+0000 7f9e3999e740 20 client.15696 populate_metadata read hostname 'smithi002' 2024-06-13T02:25:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.245+0000 7f9e3999e740 1 --2- 172.21.15.2:0/3890297851 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e770524bd0 0x55e770526ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.245+0000 7f9e3999e740 4 client.15696 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:25:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.245+0000 7f9e3999e740 1 -- 172.21.15.2:0/3890297851 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e770405ea0 con 0x55e770524bd0 2024-06-13T02:25:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.245+0000 7f9e27e00640 1 --2- 172.21.15.2:0/3890297851 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e770524bd0 0x55e770526ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.246+0000 7f9e27e00640 1 --2- 172.21.15.2:0/3890297851 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e770524bd0 0x55e770526ff0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9180091713abc670 server_cookie=a21f2d15d117bc33 in_seq=0 out_seq=0 2024-06-13T02:25:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.246+0000 7f9e1d600640 10 client.15696 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:29.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:28 smithi175 ceph-mon[36977]: pgmap v239: 129 pgs: 129 active+clean; 89 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 214 op/s 2024-06-13T02:25:29.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:28 smithi002 ceph-mon[31960]: pgmap v239: 129 pgs: 129 active+clean; 89 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 214 op/s 2024-06-13T02:25:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.484+0000 7f9e1d600640 1 -- 172.21.15.2:0/3890297851 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55e770405ea0 con 0x55e770524bd0 2024-06-13T02:25:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.484+0000 7f9e1d600640 10 client.15696 handle_command_reply: tid=0 2024-06-13T02:25:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.484+0000 7f9e3999e740 1 client.15696 shutdown 2024-06-13T02:25:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.484+0000 7f9e3999e740 1 -- 172.21.15.2:0/3890297851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e77049a070 msgr2=0x55e7704b1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.484+0000 7f9e3999e740 1 --2- 172.21.15.2:0/3890297851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e77049a070 0x55e7704b1a50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55e7704bc530 tx=0x7f9e200046c0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.484+0000 7f9e3999e740 1 -- 172.21.15.2:0/3890297851 shutdown_connections 2024-06-13T02:25:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.484+0000 7f9e3999e740 1 --2- 172.21.15.2:0/3890297851 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55e770524bd0 0x55e770526ff0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.484+0000 7f9e3999e740 1 --2- 172.21.15.2:0/3890297851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e7704a9200 0x55e7704ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.484+0000 7f9e3999e740 1 --2- 172.21.15.2:0/3890297851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e77049b5e0 0x55e7704acdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.484+0000 7f9e3999e740 1 --2- 172.21.15.2:0/3890297851 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55e77049a070 0x55e7704b1a50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.484+0000 7f9e3999e740 1 -- 172.21.15.2:0/3890297851 >> 172.21.15.2:0/3890297851 conn(0x55e770462fb0 msgr2=0x55e7704a6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.484+0000 7f9e1d600640 0 client.15696 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.484+0000 7f9e3999e740 1 -- 172.21.15.2:0/3890297851 shutdown_connections 2024-06-13T02:25:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.485+0000 7f9e3999e740 1 -- 172.21.15.2:0/3890297851 wait complete. 2024-06-13T02:25:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.485+0000 7f9e3999e740 20 client.15696 trim_cache size 0 max 16384 2024-06-13T02:25:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:25:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:25:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:25:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.488+0000 7f9e36c00640 1 -- 172.21.15.2:0/314958555 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f9e140a2d70 msgr2=0x7f9e140a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.488+0000 7f9e36c00640 1 --2- 172.21.15.2:0/314958555 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f9e140a2d70 0x7f9e140a5230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55e77049cd40 tx=0x7f9e20005f90 comp rx=0 tx=0).stop 2024-06-13T02:25:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.488+0000 7f9e36c00640 1 -- 172.21.15.2:0/314958555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e30102350 msgr2=0x7f9e301987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.488+0000 7f9e36c00640 1 --2- 172.21.15.2:0/314958555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e30102350 0x7f9e301987a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9e1802a9f0 tx=0x7f9e18003c10 comp rx=0 tx=0).stop 2024-06-13T02:25:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.488+0000 7f9e36c00640 1 -- 172.21.15.2:0/314958555 shutdown_connections 2024-06-13T02:25:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.488+0000 7f9e36c00640 1 --2- 172.21.15.2:0/314958555 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f9e140a2d70 0x7f9e140a5230 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.488+0000 7f9e36c00640 1 --2- 172.21.15.2:0/314958555 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e301079a0 0x7f9e3019cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.488+0000 7f9e36c00640 1 --2- 172.21.15.2:0/314958555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9e30102350 0x7f9e301987a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.488+0000 7f9e36c00640 1 --2- 172.21.15.2:0/314958555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e30101990 0x7f9e30198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.488+0000 7f9e36c00640 1 -- 172.21.15.2:0/314958555 >> 172.21.15.2:0/314958555 conn(0x7f9e300fd460 msgr2=0x7f9e300fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.489+0000 7f9e36c00640 1 -- 172.21.15.2:0/314958555 shutdown_connections 2024-06-13T02:25:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:29.489+0000 7f9e36c00640 1 -- 172.21.15.2:0/314958555 wait complete. 2024-06-13T02:25:29.528 INFO:tasks.workunit.client.0.smithi002.stdout: 1 558394 7.62 MB/sec execute 273 sec latency 19.972 ms 2024-06-13T02:25:30.529 INFO:tasks.workunit.client.0.smithi002.stdout: 1 559397 7.61 MB/sec execute 274 sec latency 27.285 ms 2024-06-13T02:25:31.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:30 smithi084 ceph-mon[36833]: pgmap v240: 129 pgs: 129 active+clean; 89 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 185 op/s 2024-06-13T02:25:31.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:30 smithi175 ceph-mon[36977]: pgmap v240: 129 pgs: 129 active+clean; 89 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 185 op/s 2024-06-13T02:25:31.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:30 smithi002 ceph-mon[31960]: pgmap v240: 129 pgs: 129 active+clean; 89 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 185 op/s 2024-06-13T02:25:31.529 INFO:tasks.workunit.client.0.smithi002.stdout: 1 561006 7.62 MB/sec execute 275 sec latency 56.231 ms 2024-06-13T02:25:32.529 INFO:tasks.workunit.client.0.smithi002.stdout: 1 561930 7.61 MB/sec execute 276 sec latency 23.681 ms 2024-06-13T02:25:33.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:32 smithi084 ceph-mon[36833]: pgmap v241: 129 pgs: 129 active+clean; 81 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 349 op/s 2024-06-13T02:25:33.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:32 smithi175 ceph-mon[36977]: pgmap v241: 129 pgs: 129 active+clean; 81 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 349 op/s 2024-06-13T02:25:33.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:32 smithi002 ceph-mon[31960]: pgmap v241: 129 pgs: 129 active+clean; 81 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 349 op/s 2024-06-13T02:25:33.529 INFO:tasks.workunit.client.0.smithi002.stdout: 1 562913 7.60 MB/sec execute 277 sec latency 26.192 ms 2024-06-13T02:25:34.529 INFO:tasks.workunit.client.0.smithi002.stdout: 1 564448 7.60 MB/sec execute 278 sec latency 27.481 ms 2024-06-13T02:25:35.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:34 smithi084 ceph-mon[36833]: pgmap v242: 129 pgs: 129 active+clean; 81 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.7 MiB/s wr, 226 op/s 2024-06-13T02:25:35.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:34 smithi175 ceph-mon[36977]: pgmap v242: 129 pgs: 129 active+clean; 81 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.7 MiB/s wr, 226 op/s 2024-06-13T02:25:35.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:34 smithi002 ceph-mon[31960]: pgmap v242: 129 pgs: 129 active+clean; 81 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.7 MiB/s wr, 226 op/s 2024-06-13T02:25:35.529 INFO:tasks.workunit.client.0.smithi002.stdout: 1 565344 7.59 MB/sec execute 279 sec latency 20.932 ms 2024-06-13T02:25:36.529 INFO:tasks.workunit.client.0.smithi002.stdout: 1 566324 7.59 MB/sec execute 280 sec latency 52.303 ms 2024-06-13T02:25:37.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:36 smithi084 ceph-mon[36833]: pgmap v243: 129 pgs: 129 active+clean; 81 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 249 op/s 2024-06-13T02:25:37.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:36 smithi175 ceph-mon[36977]: pgmap v243: 129 pgs: 129 active+clean; 81 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 249 op/s 2024-06-13T02:25:37.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:36 smithi002 ceph-mon[31960]: pgmap v243: 129 pgs: 129 active+clean; 81 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 249 op/s 2024-06-13T02:25:37.529 INFO:tasks.workunit.client.0.smithi002.stdout: 1 567991 7.59 MB/sec execute 281 sec latency 30.795 ms 2024-06-13T02:25:38.529 INFO:tasks.workunit.client.0.smithi002.stdout: 1 569134 7.58 MB/sec execute 282 sec latency 18.402 ms 2024-06-13T02:25:39.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:38 smithi084 ceph-mon[36833]: pgmap v244: 129 pgs: 129 active+clean; 85 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 269 op/s 2024-06-13T02:25:39.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:38 smithi175 ceph-mon[36977]: pgmap v244: 129 pgs: 129 active+clean; 85 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 269 op/s 2024-06-13T02:25:39.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:38 smithi002 ceph-mon[31960]: pgmap v244: 129 pgs: 129 active+clean; 85 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 269 op/s 2024-06-13T02:25:39.530 INFO:tasks.workunit.client.0.smithi002.stdout: 1 570155 7.57 MB/sec execute 283 sec latency 22.953 ms 2024-06-13T02:25:40.530 INFO:tasks.workunit.client.0.smithi002.stdout: 1 571993 7.59 MB/sec execute 284 sec latency 19.255 ms 2024-06-13T02:25:41.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:40 smithi084 ceph-mon[36833]: pgmap v245: 129 pgs: 129 active+clean; 85 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 229 op/s 2024-06-13T02:25:41.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:40 smithi175 ceph-mon[36977]: pgmap v245: 129 pgs: 129 active+clean; 85 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 229 op/s 2024-06-13T02:25:41.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:40 smithi002 ceph-mon[31960]: pgmap v245: 129 pgs: 129 active+clean; 85 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 229 op/s 2024-06-13T02:25:41.531 INFO:tasks.workunit.client.0.smithi002.stdout: 1 572811 7.57 MB/sec execute 285 sec latency 41.243 ms 2024-06-13T02:25:42.531 INFO:tasks.workunit.client.0.smithi002.stdout: 1 574185 7.57 MB/sec execute 286 sec latency 51.174 ms 2024-06-13T02:25:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.673+0000 7fe260e00640 1 -- 172.21.15.2:0/2186933623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe25c073dd0 msgr2=0x7fe25c0741b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.673+0000 7fe260e00640 1 --2- 172.21.15.2:0/2186933623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe25c073dd0 0x7fe25c0741b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009900 tx=0x7fe24c02a490 comp rx=0 tx=0).stop 2024-06-13T02:25:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.673+0000 7fe260e00640 1 -- 172.21.15.2:0/2186933623 shutdown_connections 2024-06-13T02:25:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.673+0000 7fe260e00640 1 --2- 172.21.15.2:0/2186933623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c10e1d0 0x7fe25c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.673+0000 7fe260e00640 1 --2- 172.21.15.2:0/2186933623 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe25c0746f0 0x7fe25c10dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.673+0000 7fe260e00640 1 --2- 172.21.15.2:0/2186933623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe25c073dd0 0x7fe25c0741b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.673+0000 7fe260e00640 1 -- 172.21.15.2:0/2186933623 >> 172.21.15.2:0/2186933623 conn(0x7fe25c0fd460 msgr2=0x7fe25c0ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.673+0000 7fe260e00640 1 -- 172.21.15.2:0/2186933623 shutdown_connections 2024-06-13T02:25:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.673+0000 7fe260e00640 1 -- 172.21.15.2:0/2186933623 wait complete. 2024-06-13T02:25:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.674+0000 7fe260e00640 1 Processor -- start 2024-06-13T02:25:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.674+0000 7fe260e00640 1 -- start start 2024-06-13T02:25:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.675+0000 7fe260e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe25c073dd0 0x7fe25c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.675+0000 7fe260e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c0746f0 0x7fe25c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.675+0000 7fe260e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe25c10e1d0 0x7fe25c19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.675+0000 7fe260e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c113f70 con 0x7fe25c0746f0 2024-06-13T02:25:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.675+0000 7fe260e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c113df0 con 0x7fe25c073dd0 2024-06-13T02:25:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.675+0000 7fe260e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1140f0 con 0x7fe25c10e1d0 2024-06-13T02:25:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.675+0000 7fe259e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe25c073dd0 0x7fe25c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.675+0000 7fe25a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe25c10e1d0 0x7fe25c19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.675+0000 7fe259e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe25c073dd0 0x7fe25c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36484/0 (socket says 172.21.15.2:36484) 2024-06-13T02:25:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.675+0000 7fe259e00640 1 -- 172.21.15.2:0/2679183037 learned_addr learned my addr 172.21.15.2:0/2679183037 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.675+0000 7fe251400640 1 --2- 172.21.15.2:0/2679183037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c0746f0 0x7fe25c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.676+0000 7fe259e00640 1 -- 172.21.15.2:0/2679183037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe25c10e1d0 msgr2=0x7fe25c19ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.676+0000 7fe259e00640 1 --2- 172.21.15.2:0/2679183037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe25c10e1d0 0x7fe25c19ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.676+0000 7fe259e00640 1 -- 172.21.15.2:0/2679183037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c0746f0 msgr2=0x7fe25c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.676+0000 7fe259e00640 1 --2- 172.21.15.2:0/2679183037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c0746f0 0x7fe25c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.676+0000 7fe259e00640 1 -- 172.21.15.2:0/2679183037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25c19f450 con 0x7fe25c073dd0 2024-06-13T02:25:42.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.676+0000 7fe25a800640 1 --2- 172.21.15.2:0/2679183037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe25c10e1d0 0x7fe25c19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:25:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.676+0000 7fe259e00640 1 --2- 172.21.15.2:0/2679183037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe25c073dd0 0x7fe25c19a4b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe24c006010 tx=0x7fe24c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.676+0000 7fe253400640 1 -- 172.21.15.2:0/2679183037 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c03f030 con 0x7fe25c073dd0 2024-06-13T02:25:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.676+0000 7fe253400640 1 -- 172.21.15.2:0/2679183037 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe24c004440 con 0x7fe25c073dd0 2024-06-13T02:25:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.676+0000 7fe253400640 1 -- 172.21.15.2:0/2679183037 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c035070 con 0x7fe25c073dd0 2024-06-13T02:25:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.676+0000 7fe260e00640 1 -- 172.21.15.2:0/2679183037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25c19f6e0 con 0x7fe25c073dd0 2024-06-13T02:25:42.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.676+0000 7fe260e00640 1 -- 172.21.15.2:0/2679183037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe25c1a6fd0 con 0x7fe25c073dd0 2024-06-13T02:25:42.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.680+0000 7fe253400640 1 -- 172.21.15.2:0/2679183037 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fe24c042030 con 0x7fe25c073dd0 2024-06-13T02:25:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.681+0000 7fe263b85740 1 Processor -- start 2024-06-13T02:25:42.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.681+0000 7fe263b85740 1 -- start start 2024-06-13T02:25:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.681+0000 7fe263b85740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26d45e0 0x561cc26d2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.681+0000 7fe263b85740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.681+0000 7fe263b85740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26dddf0 0x561cc26e01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.681+0000 7fe253400640 1 --2- 172.21.15.2:0/2679183037 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fe2400a2d70 0x7fe2400a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.681+0000 7fe263b85740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561cc2637420 con 0x561cc26d3070 2024-06-13T02:25:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.681+0000 7fe263b85740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561cc25dec50 con 0x561cc26dddf0 2024-06-13T02:25:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.681+0000 7fe263b85740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561cc26333e0 con 0x561cc26d45e0 2024-06-13T02:25:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.682+0000 7fe253400640 1 -- 172.21.15.2:0/2679183037 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9583+0+0 (secure 0 0 0) 0x7fe24c0efb90 con 0x7fe25c073dd0 2024-06-13T02:25:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.682+0000 7fe25a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26dddf0 0x561cc26e01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.682+0000 7fe259e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.682+0000 7fe259e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45938/0 (socket says 172.21.15.2:45938) 2024-06-13T02:25:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.682+0000 7fe259e00640 1 -- 172.21.15.2:0/2560949317 learned_addr learned my addr 172.21.15.2:0/2560949317 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.682+0000 7fe25a800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26dddf0 0x561cc26e01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36494/0 (socket says 172.21.15.2:36494) 2024-06-13T02:25:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.682+0000 7fe251400640 1 --2- 172.21.15.2:0/2679183037 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fe2400a2d70 0x7fe2400a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.682+0000 7fe25a800640 1 --2- 172.21.15.2:0/2560949317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26d45e0 0x561cc26d2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.682+0000 7fe25a800640 1 -- 172.21.15.2:0/2560949317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26d45e0 msgr2=0x561cc26d2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:42.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.682+0000 7fe25a800640 1 --2- 172.21.15.2:0/2560949317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26d45e0 0x561cc26d2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.682+0000 7fe25a800640 1 -- 172.21.15.2:0/2560949317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 msgr2=0x561cc26d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.682+0000 7fe25a800640 1 --2- 172.21.15.2:0/2560949317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.682+0000 7fe25a800640 1 -- 172.21.15.2:0/2560949317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc234b210 con 0x561cc26dddf0 2024-06-13T02:25:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.683+0000 7fe25a800640 1 --2- 172.21.15.2:0/2560949317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26dddf0 0x561cc26e01e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe254013c90 tx=0x7fe254009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a20e80adc40cae12 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.683+0000 7fe24b400640 1 -- 172.21.15.2:0/2560949317 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254013e40 con 0x561cc26dddf0 2024-06-13T02:25:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.683+0000 7fe24b400640 1 -- 172.21.15.2:0/2560949317 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe254003e50 con 0x561cc26dddf0 2024-06-13T02:25:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.683+0000 7fe24b400640 1 -- 172.21.15.2:0/2560949317 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254004640 con 0x561cc26dddf0 2024-06-13T02:25:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.683+0000 7fe251400640 1 --2- 172.21.15.2:0/2679183037 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fe2400a2d70 0x7fe2400a5230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0ffaf0 tx=0x7fe244005f90 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.684+0000 7fe263b85740 1 -- 172.21.15.2:0/2560949317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26dddf0 msgr2=0x561cc26e01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.684+0000 7fe263b85740 1 --2- 172.21.15.2:0/2560949317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26dddf0 0x561cc26e01e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe254013c90 tx=0x7fe254009500 comp rx=0 tx=0).stop 2024-06-13T02:25:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.684+0000 7fe263b85740 1 -- 172.21.15.2:0/2560949317 shutdown_connections 2024-06-13T02:25:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.684+0000 7fe263b85740 1 --2- 172.21.15.2:0/2560949317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26dddf0 0x561cc26e01e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.684+0000 7fe263b85740 1 --2- 172.21.15.2:0/2560949317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.684+0000 7fe263b85740 1 --2- 172.21.15.2:0/2560949317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26d45e0 0x561cc26d2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.684+0000 7fe263b85740 1 -- 172.21.15.2:0/2560949317 >> 172.21.15.2:0/2560949317 conn(0x561cc269bfb0 msgr2=0x561cc26cf660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:42.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.684+0000 7fe263b85740 1 -- 172.21.15.2:0/2560949317 shutdown_connections 2024-06-13T02:25:42.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.684+0000 7fe263b85740 1 -- 172.21.15.2:0/2560949317 wait complete. 2024-06-13T02:25:42.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.684+0000 7fe263b85740 1 -- start start 2024-06-13T02:25:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.685+0000 7fe263b85740 1 Processor -- start 2024-06-13T02:25:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.685+0000 7fe263b85740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26dae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.685+0000 7fe263b85740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26d45e0 0x561cc26db3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.685+0000 7fe263b85740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26dddf0 0x561cc26db900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.685+0000 7fe263b85740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x561cc26e93d0 con 0x561cc26d3070 2024-06-13T02:25:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.685+0000 7fe263b85740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561cc25f20b0 con 0x561cc26dddf0 2024-06-13T02:25:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.685+0000 7fe263b85740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x561cc26e9550 con 0x561cc26d45e0 2024-06-13T02:25:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.685+0000 7fe263b85740 10 client.0 _ll_register_callbacks cb 0x561cc25ddf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:25:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.686+0000 7fe259e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26dae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.686+0000 7fe251400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26d45e0 0x561cc26db3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.686+0000 7fe251400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26d45e0 0x561cc26db3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:48470/0 (socket says 172.21.15.2:48470) 2024-06-13T02:25:42.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.686+0000 7fe251400640 1 -- 172.21.15.2:0/2712923294 learned_addr learned my addr 172.21.15.2:0/2712923294 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:42.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.686+0000 7fe25a800640 1 --2- 172.21.15.2:0/2712923294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26dddf0 0x561cc26db900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.686+0000 7fe251400640 1 -- 172.21.15.2:0/2712923294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26dddf0 msgr2=0x561cc26db900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:42.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.686+0000 7fe251400640 1 --2- 172.21.15.2:0/2712923294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26dddf0 0x561cc26db900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.686+0000 7fe251400640 1 -- 172.21.15.2:0/2712923294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 msgr2=0x561cc26dae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:42.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.686+0000 7fe251400640 1 --2- 172.21.15.2:0/2712923294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26dae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.686+0000 7fe251400640 1 -- 172.21.15.2:0/2712923294 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc2417620 con 0x561cc26d45e0 2024-06-13T02:25:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.686+0000 7fe259e00640 1 --2- 172.21.15.2:0/2712923294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26dae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:25:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.686+0000 7fe251400640 1 --2- 172.21.15.2:0/2712923294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26d45e0 0x561cc26db3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe244005f60 tx=0x7fe244004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac6357b7aa9cff8f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.686+0000 7fe23fe00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:25:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.686+0000 7fe23fe00640 1 -- 172.21.15.2:0/2712923294 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24400ecc0 con 0x561cc26d45e0 2024-06-13T02:25:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.687+0000 7fe263b85740 1 -- 172.21.15.2:0/2712923294 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe254003e50 con 0x561cc26d45e0 2024-06-13T02:25:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.687+0000 7fe23fe00640 1 -- 172.21.15.2:0/2712923294 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9583+0+0 (secure 0 0 0) 0x7fe244005020 con 0x561cc26d45e0 2024-06-13T02:25:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.687+0000 7fe23fe00640 1 -- 172.21.15.2:0/2712923294 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe24402e050 con 0x561cc26d45e0 2024-06-13T02:25:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.687+0000 7fe263b85740 10 client.25876 fetch_fsmap learned FSMap version 35 2024-06-13T02:25:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.687+0000 7fe263b85740 1 -- 172.21.15.2:0/2712923294 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561cc26f5870 con 0x561cc26d45e0 2024-06-13T02:25:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.687+0000 7fe23fe00640 1 -- 172.21.15.2:0/2712923294 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe254003e50 con 0x561cc26d45e0 2024-06-13T02:25:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.688+0000 7fe23fe00640 1 -- 172.21.15.2:0/2712923294 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe244005220 con 0x561cc26d45e0 2024-06-13T02:25:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.688+0000 7fe263b85740 10 client.25876 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:25:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.688+0000 7fe263b85740 10 client.25876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:25:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.688+0000 7fe263b85740 20 client.25876 populate_metadata read hostname 'smithi002' 2024-06-13T02:25:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.688+0000 7fe263b85740 1 --2- 172.21.15.2:0/2712923294 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561cc26f6ce0 0x561cc26f90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.688+0000 7fe263b85740 4 client.25876 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:25:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.688+0000 7fe263b85740 1 -- 172.21.15.2:0/2712923294 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cc2644b50 con 0x561cc26f6ce0 2024-06-13T02:25:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.688+0000 7fe259e00640 1 --2- 172.21.15.2:0/2712923294 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561cc26f6ce0 0x561cc26f90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.689+0000 7fe259e00640 1 --2- 172.21.15.2:0/2712923294 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561cc26f6ce0 0x561cc26f90d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57761c5838a6db65 server_cookie=6674e1ed6d67887e in_seq=0 out_seq=0 2024-06-13T02:25:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.689+0000 7fe23fe00640 10 client.25876 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:42.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.691+0000 7fe23fe00640 1 -- 172.21.15.2:0/2712923294 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561cc2644b50 con 0x561cc26f6ce0 2024-06-13T02:25:42.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.691+0000 7fe23fe00640 10 client.25876 handle_command_reply: tid=0 2024-06-13T02:25:42.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.691+0000 7fe263b85740 1 client.25876 shutdown 2024-06-13T02:25:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.691+0000 7fe263b85740 1 -- 172.21.15.2:0/2712923294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26d45e0 msgr2=0x561cc26db3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.691+0000 7fe263b85740 1 --2- 172.21.15.2:0/2712923294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26d45e0 0x561cc26db3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe244005f60 tx=0x7fe244004730 comp rx=0 tx=0).stop 2024-06-13T02:25:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.692+0000 7fe263b85740 1 -- 172.21.15.2:0/2712923294 shutdown_connections 2024-06-13T02:25:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.692+0000 7fe263b85740 1 --2- 172.21.15.2:0/2712923294 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561cc26f6ce0 0x561cc26f90d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.692+0000 7fe263b85740 1 --2- 172.21.15.2:0/2712923294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26dddf0 0x561cc26db900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.692+0000 7fe263b85740 1 --2- 172.21.15.2:0/2712923294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26d45e0 0x561cc26db3c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.692+0000 7fe263b85740 1 --2- 172.21.15.2:0/2712923294 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26dae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.692+0000 7fe263b85740 1 -- 172.21.15.2:0/2712923294 >> 172.21.15.2:0/2712923294 conn(0x561cc269bfb0 msgr2=0x561cc26d54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.692+0000 7fe23fe00640 0 client.25876 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.692+0000 7fe263b85740 1 -- 172.21.15.2:0/2712923294 shutdown_connections 2024-06-13T02:25:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.692+0000 7fe263b85740 1 -- 172.21.15.2:0/2712923294 wait complete. 2024-06-13T02:25:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.692+0000 7fe263b85740 20 client.25876 trim_cache size 0 max 16384 2024-06-13T02:25:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.709+0000 7fe263b85740 1 Processor -- start 2024-06-13T02:25:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.709+0000 7fe263b85740 1 -- start start 2024-06-13T02:25:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.709+0000 7fe263b85740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26db550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.709+0000 7fe263b85740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26d45e0 0x561cc26cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe263b85740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26dddf0 0x561cc26cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe263b85740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1af7c0 con 0x561cc26d3070 2024-06-13T02:25:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe263b85740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1ad090 con 0x561cc26d45e0 2024-06-13T02:25:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe263b85740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1aaf00 con 0x561cc26dddf0 2024-06-13T02:25:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe259e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26db550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe25a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26dddf0 0x561cc26cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe251400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26d45e0 0x561cc26cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe251400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26d45e0 0x561cc26cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36520/0 (socket says 172.21.15.2:36520) 2024-06-13T02:25:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe25a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26dddf0 0x561cc26cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:48474/0 (socket says 172.21.15.2:48474) 2024-06-13T02:25:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe251400640 1 -- 172.21.15.2:0/2929261323 learned_addr learned my addr 172.21.15.2:0/2929261323 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe259e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26db550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:45946/0 (socket says 172.21.15.2:45946) 2024-06-13T02:25:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe251400640 1 -- 172.21.15.2:0/2929261323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26dddf0 msgr2=0x561cc26cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe251400640 1 --2- 172.21.15.2:0/2929261323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26dddf0 0x561cc26cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe251400640 1 -- 172.21.15.2:0/2929261323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 msgr2=0x561cc26db550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe251400640 1 --2- 172.21.15.2:0/2929261323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26db550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.710+0000 7fe251400640 1 -- 172.21.15.2:0/2929261323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cc26d3b40 con 0x561cc26d45e0 2024-06-13T02:25:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.711+0000 7fe251400640 1 --2- 172.21.15.2:0/2929261323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26d45e0 0x561cc26cefc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe244009a90 tx=0x7fe24400e820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c762bfa72aaa73a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.711+0000 7fe24aa00640 1 -- 172.21.15.2:0/2929261323 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24400ecc0 con 0x561cc26d45e0 2024-06-13T02:25:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.711+0000 7fe24aa00640 1 -- 172.21.15.2:0/2929261323 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe24402b050 con 0x561cc26d45e0 2024-06-13T02:25:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.711+0000 7fe24aa00640 1 -- 172.21.15.2:0/2929261323 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244032400 con 0x561cc26d45e0 2024-06-13T02:25:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.711+0000 7fe263b85740 1 -- 172.21.15.2:0/2929261323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26d45e0 msgr2=0x561cc26cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.711+0000 7fe263b85740 1 --2- 172.21.15.2:0/2929261323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26d45e0 0x561cc26cefc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe244009a90 tx=0x7fe24400e820 comp rx=0 tx=0).stop 2024-06-13T02:25:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.712+0000 7fe263b85740 1 -- 172.21.15.2:0/2929261323 shutdown_connections 2024-06-13T02:25:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.712+0000 7fe263b85740 1 --2- 172.21.15.2:0/2929261323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26dddf0 0x561cc26cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.712+0000 7fe263b85740 1 --2- 172.21.15.2:0/2929261323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26d45e0 0x561cc26cefc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.712+0000 7fe263b85740 1 --2- 172.21.15.2:0/2929261323 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26db550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.712+0000 7fe263b85740 1 -- 172.21.15.2:0/2929261323 >> 172.21.15.2:0/2929261323 conn(0x561cc269bfb0 msgr2=0x561cc26dae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.712+0000 7fe263b85740 1 -- 172.21.15.2:0/2929261323 shutdown_connections 2024-06-13T02:25:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.712+0000 7fe263b85740 1 -- 172.21.15.2:0/2929261323 wait complete. 2024-06-13T02:25:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.712+0000 7fe263b85740 1 -- start start 2024-06-13T02:25:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.712+0000 7fe263b85740 1 Processor -- start 2024-06-13T02:25:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe263b85740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26e9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe263b85740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26d45e0 0x561cc26e9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe263b85740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26dddf0 0x561cc275f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe263b85740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1ab550 con 0x561cc26d3070 2024-06-13T02:25:42.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe263b85740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1ac9c0 con 0x561cc26d45e0 2024-06-13T02:25:42.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe263b85740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1abc20 con 0x561cc26dddf0 2024-06-13T02:25:42.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe263b85740 10 client.0 _ll_register_callbacks cb 0x7fe244009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:25:42.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe259e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26e9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe251400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26d45e0 0x561cc26e9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe251400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26d45e0 0x561cc26e9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:36530/0 (socket says 172.21.15.2:36530) 2024-06-13T02:25:42.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe251400640 1 -- 172.21.15.2:0/1056665753 learned_addr learned my addr 172.21.15.2:0/1056665753 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:42.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe25a800640 1 --2- 172.21.15.2:0/1056665753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26dddf0 0x561cc275f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe251400640 1 -- 172.21.15.2:0/1056665753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26dddf0 msgr2=0x561cc275f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:42.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe251400640 1 --2- 172.21.15.2:0/1056665753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26dddf0 0x561cc275f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe251400640 1 -- 172.21.15.2:0/1056665753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 msgr2=0x561cc26e9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:42.718 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe251400640 1 --2- 172.21.15.2:0/1056665753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26e9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.713+0000 7fe251400640 1 -- 172.21.15.2:0/1056665753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cc275fee0 con 0x561cc26d45e0 2024-06-13T02:25:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.714+0000 7fe251400640 1 --2- 172.21.15.2:0/1056665753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26d45e0 0x561cc26e9e80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe2440118d0 tx=0x7fe244011a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62d090b64a58a436 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.714+0000 7fe23fe00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:25:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.714+0000 7fe23fe00640 1 -- 172.21.15.2:0/1056665753 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244048060 con 0x561cc26d45e0 2024-06-13T02:25:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.714+0000 7fe263b85740 1 -- 172.21.15.2:0/1056665753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe24402b050 con 0x561cc26d45e0 2024-06-13T02:25:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.714+0000 7fe23fe00640 1 -- 172.21.15.2:0/1056665753 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9583+0+0 (secure 0 0 0) 0x7fe24400ecc0 con 0x561cc26d45e0 2024-06-13T02:25:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.714+0000 7fe23fe00640 1 -- 172.21.15.2:0/1056665753 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe24404f050 con 0x561cc26d45e0 2024-06-13T02:25:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.714+0000 7fe263b85740 10 client.25895 fetch_fsmap learned FSMap version 35 2024-06-13T02:25:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.714+0000 7fe263b85740 1 -- 172.21.15.2:0/1056665753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561cc2761030 con 0x561cc26d45e0 2024-06-13T02:25:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.714+0000 7fe23fe00640 1 -- 172.21.15.2:0/1056665753 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe24402b050 con 0x561cc26d45e0 2024-06-13T02:25:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.715+0000 7fe23fe00640 1 -- 172.21.15.2:0/1056665753 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe24403b800 con 0x561cc26d45e0 2024-06-13T02:25:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.715+0000 7fe263b85740 10 client.25895 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:25:42.719 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.715+0000 7fe263b85740 10 client.25895 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:25:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.715+0000 7fe263b85740 20 client.25895 populate_metadata read hostname 'smithi002' 2024-06-13T02:25:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.715+0000 7fe263b85740 1 --2- 172.21.15.2:0/1056665753 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561cc2761610 0x561cc2763a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.715+0000 7fe263b85740 4 client.25895 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:25:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.715+0000 7fe263b85740 1 -- 172.21.15.2:0/1056665753 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561cc26cae20 con 0x561cc2761610 2024-06-13T02:25:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.715+0000 7fe259e00640 1 --2- 172.21.15.2:0/1056665753 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561cc2761610 0x561cc2763a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.716+0000 7fe259e00640 1 --2- 172.21.15.2:0/1056665753 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561cc2761610 0x561cc2763a30 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aabf48503d4e9375 server_cookie=b0db7354eb76982c in_seq=0 out_seq=0 2024-06-13T02:25:42.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.716+0000 7fe23fe00640 10 client.25895 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:42.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.894+0000 7fe23fe00640 1 -- 172.21.15.2:0/1056665753 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x561cc26cae20 con 0x561cc2761610 2024-06-13T02:25:42.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.895+0000 7fe23fe00640 10 client.25895 handle_command_reply: tid=0 2024-06-13T02:25:42.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.895+0000 7fe263b85740 1 client.25895 shutdown 2024-06-13T02:25:42.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.896+0000 7fe263b85740 1 -- 172.21.15.2:0/1056665753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26d45e0 msgr2=0x561cc26e9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:42.898 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.896+0000 7fe263b85740 1 --2- 172.21.15.2:0/1056665753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26d45e0 0x561cc26e9e80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe2440118d0 tx=0x7fe244011a10 comp rx=0 tx=0).stop 2024-06-13T02:25:42.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.896+0000 7fe263b85740 1 -- 172.21.15.2:0/1056665753 shutdown_connections 2024-06-13T02:25:42.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.896+0000 7fe263b85740 1 --2- 172.21.15.2:0/1056665753 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x561cc2761610 0x561cc2763a30 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.896+0000 7fe263b85740 1 --2- 172.21.15.2:0/1056665753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561cc26dddf0 0x561cc275f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.896+0000 7fe263b85740 1 --2- 172.21.15.2:0/1056665753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561cc26d45e0 0x561cc26e9e80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.896+0000 7fe263b85740 1 --2- 172.21.15.2:0/1056665753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x561cc26d3070 0x561cc26e9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.896+0000 7fe263b85740 1 -- 172.21.15.2:0/1056665753 >> 172.21.15.2:0/1056665753 conn(0x561cc269bfb0 msgr2=0x561cc26d54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:42.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.897+0000 7fe23fe00640 0 client.25895 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:42.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.897+0000 7fe263b85740 1 -- 172.21.15.2:0/1056665753 shutdown_connections 2024-06-13T02:25:42.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.897+0000 7fe263b85740 1 -- 172.21.15.2:0/1056665753 wait complete. 2024-06-13T02:25:42.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.897+0000 7fe263b85740 20 client.25895 trim_cache size 0 max 16384 2024-06-13T02:25:42.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:25:42.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:25:42.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:25:42.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.898+0000 7fe260e00640 1 -- 172.21.15.2:0/2679183037 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fe2400a2d70 msgr2=0x7fe2400a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:42.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.898+0000 7fe260e00640 1 --2- 172.21.15.2:0/2679183037 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fe2400a2d70 0x7fe2400a5230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0ffaf0 tx=0x7fe244005f90 comp rx=0 tx=0).stop 2024-06-13T02:25:42.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.898+0000 7fe260e00640 1 -- 172.21.15.2:0/2679183037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe25c073dd0 msgr2=0x7fe25c19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:42.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.898+0000 7fe260e00640 1 --2- 172.21.15.2:0/2679183037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe25c073dd0 0x7fe25c19a4b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe24c006010 tx=0x7fe24c004040 comp rx=0 tx=0).stop 2024-06-13T02:25:42.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.899+0000 7fe260e00640 1 -- 172.21.15.2:0/2679183037 shutdown_connections 2024-06-13T02:25:42.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.899+0000 7fe260e00640 1 --2- 172.21.15.2:0/2679183037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe25c10e1d0 0x7fe25c19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.899+0000 7fe260e00640 1 --2- 172.21.15.2:0/2679183037 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fe2400a2d70 0x7fe2400a5230 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.899+0000 7fe260e00640 1 --2- 172.21.15.2:0/2679183037 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe25c0746f0 0x7fe25c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.899+0000 7fe260e00640 1 --2- 172.21.15.2:0/2679183037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe25c073dd0 0x7fe25c19a4b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:42.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.899+0000 7fe260e00640 1 -- 172.21.15.2:0/2679183037 >> 172.21.15.2:0/2679183037 conn(0x7fe25c0fd460 msgr2=0x7fe25c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:42.902 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.899+0000 7fe260e00640 1 -- 172.21.15.2:0/2679183037 shutdown_connections 2024-06-13T02:25:42.902 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:42.899+0000 7fe260e00640 1 -- 172.21.15.2:0/2679183037 wait complete. 2024-06-13T02:25:43.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:42 smithi084 ceph-mon[36833]: pgmap v246: 129 pgs: 129 active+clean; 89 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 287 op/s 2024-06-13T02:25:43.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:42 smithi175 ceph-mon[36977]: pgmap v246: 129 pgs: 129 active+clean; 89 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 287 op/s 2024-06-13T02:25:43.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:42 smithi002 ceph-mon[31960]: pgmap v246: 129 pgs: 129 active+clean; 89 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 287 op/s 2024-06-13T02:25:43.531 INFO:tasks.workunit.client.0.smithi002.stdout: 1 575893 7.58 MB/sec execute 287 sec latency 98.033 ms 2024-06-13T02:25:44.531 INFO:tasks.workunit.client.0.smithi002.stdout: 1 576993 7.57 MB/sec execute 288 sec latency 21.842 ms 2024-06-13T02:25:45.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:44 smithi175 ceph-mon[36977]: pgmap v247: 129 pgs: 129 active+clean; 89 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 1.5 MiB/s wr, 123 op/s 2024-06-13T02:25:45.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:44 smithi002 ceph-mon[31960]: pgmap v247: 129 pgs: 129 active+clean; 89 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 1.5 MiB/s wr, 123 op/s 2024-06-13T02:25:45.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:44 smithi084 ceph-mon[36833]: pgmap v247: 129 pgs: 129 active+clean; 89 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 1.5 MiB/s wr, 123 op/s 2024-06-13T02:25:45.531 INFO:tasks.workunit.client.0.smithi002.stdout: 1 578961 7.59 MB/sec execute 289 sec latency 20.208 ms 2024-06-13T02:25:46.532 INFO:tasks.workunit.client.0.smithi002.stdout: 1 579921 7.57 MB/sec execute 290 sec latency 24.257 ms 2024-06-13T02:25:47.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:46 smithi175 ceph-mon[36977]: pgmap v248: 129 pgs: 129 active+clean; 90 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 230 op/s 2024-06-13T02:25:47.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:46 smithi002 ceph-mon[31960]: pgmap v248: 129 pgs: 129 active+clean; 90 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 230 op/s 2024-06-13T02:25:47.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:46 smithi084 ceph-mon[36833]: pgmap v248: 129 pgs: 129 active+clean; 90 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 230 op/s 2024-06-13T02:25:47.532 INFO:tasks.workunit.client.0.smithi002.stdout: 1 580838 7.56 MB/sec execute 291 sec latency 64.810 ms 2024-06-13T02:25:48.532 INFO:tasks.workunit.client.0.smithi002.stdout: 1 582600 7.58 MB/sec execute 292 sec latency 51.345 ms 2024-06-13T02:25:49.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:48 smithi175 ceph-mon[36977]: pgmap v249: 129 pgs: 129 active+clean; 82 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 241 op/s 2024-06-13T02:25:49.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:48 smithi002 ceph-mon[31960]: pgmap v249: 129 pgs: 129 active+clean; 82 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 241 op/s 2024-06-13T02:25:49.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:48 smithi084 ceph-mon[36833]: pgmap v249: 129 pgs: 129 active+clean; 82 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 241 op/s 2024-06-13T02:25:49.532 INFO:tasks.workunit.client.0.smithi002.stdout: 1 583332 7.56 MB/sec execute 293 sec latency 30.631 ms 2024-06-13T02:25:50.532 INFO:tasks.workunit.client.0.smithi002.stdout: 1 584306 7.55 MB/sec execute 294 sec latency 27.517 ms 2024-06-13T02:25:51.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:50 smithi175 ceph-mon[36977]: pgmap v250: 129 pgs: 129 active+clean; 82 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 1.8 MiB/s wr, 198 op/s 2024-06-13T02:25:51.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:50 smithi002 ceph-mon[31960]: pgmap v250: 129 pgs: 129 active+clean; 82 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 1.8 MiB/s wr, 198 op/s 2024-06-13T02:25:51.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:50 smithi084 ceph-mon[36833]: pgmap v250: 129 pgs: 129 active+clean; 82 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 1.8 MiB/s wr, 198 op/s 2024-06-13T02:25:51.532 INFO:tasks.workunit.client.0.smithi002.stdout: 1 585904 7.56 MB/sec execute 295 sec latency 24.204 ms 2024-06-13T02:25:52.532 INFO:tasks.workunit.client.0.smithi002.stdout: 1 586812 7.55 MB/sec execute 296 sec latency 31.086 ms 2024-06-13T02:25:53.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:52 smithi175 ceph-mon[36977]: pgmap v251: 129 pgs: 129 active+clean; 86 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 269 op/s 2024-06-13T02:25:53.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:52 smithi002 ceph-mon[31960]: pgmap v251: 129 pgs: 129 active+clean; 86 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 269 op/s 2024-06-13T02:25:53.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:52 smithi084 ceph-mon[36833]: pgmap v251: 129 pgs: 129 active+clean; 86 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 269 op/s 2024-06-13T02:25:53.532 INFO:tasks.workunit.client.0.smithi002.stdout: 1 587850 7.54 MB/sec execute 297 sec latency 27.861 ms 2024-06-13T02:25:54.533 INFO:tasks.workunit.client.0.smithi002.stdout: 1 589618 7.55 MB/sec execute 298 sec latency 23.322 ms 2024-06-13T02:25:55.273 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:54 smithi084 ceph-mon[36833]: pgmap v252: 129 pgs: 129 active+clean; 86 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 1.9 MiB/s wr, 211 op/s 2024-06-13T02:25:55.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:54 smithi175 ceph-mon[36977]: pgmap v252: 129 pgs: 129 active+clean; 86 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 1.9 MiB/s wr, 211 op/s 2024-06-13T02:25:55.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:54 smithi002 ceph-mon[31960]: pgmap v252: 129 pgs: 129 active+clean; 86 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 1.9 MiB/s wr, 211 op/s 2024-06-13T02:25:55.533 INFO:tasks.workunit.client.0.smithi002.stdout: 1 590504 7.54 MB/sec execute 299 sec latency 19.800 ms 2024-06-13T02:25:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.054+0000 7fa324e00640 1 -- 172.21.15.2:0/1218421730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3201039b0 msgr2=0x7fa320103e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.054+0000 7fa324e00640 1 --2- 172.21.15.2:0/1218421730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3201039b0 0x7fa320103e30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa308009900 tx=0x7fa30802a3f0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.054+0000 7fa324e00640 1 -- 172.21.15.2:0/1218421730 shutdown_connections 2024-06-13T02:25:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.054+0000 7fa324e00640 1 --2- 172.21.15.2:0/1218421730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa320104370 0x7fa320110880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.054+0000 7fa324e00640 1 --2- 172.21.15.2:0/1218421730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3201039b0 0x7fa320103e30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.054+0000 7fa324e00640 1 --2- 172.21.15.2:0/1218421730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3201099c0 0x7fa320109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.054+0000 7fa324e00640 1 -- 172.21.15.2:0/1218421730 >> 172.21.15.2:0/1218421730 conn(0x7fa3200ff480 msgr2=0x7fa3201018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.054+0000 7fa324e00640 1 -- 172.21.15.2:0/1218421730 shutdown_connections 2024-06-13T02:25:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.054+0000 7fa324e00640 1 -- 172.21.15.2:0/1218421730 wait complete. 2024-06-13T02:25:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.055+0000 7fa324e00640 1 Processor -- start 2024-06-13T02:25:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.055+0000 7fa324e00640 1 -- start start 2024-06-13T02:25:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.056+0000 7fa324e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3201039b0 0x7fa32019a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.056+0000 7fa324e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa320104370 0x7fa32019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.056+0000 7fa324e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3201099c0 0x7fa32019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.056+0000 7fa324e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa320113e20 con 0x7fa320104370 2024-06-13T02:25:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.056+0000 7fa324e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa320113ca0 con 0x7fa3201099c0 2024-06-13T02:25:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.056+0000 7fa324e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa320113fa0 con 0x7fa3201039b0 2024-06-13T02:25:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.056+0000 7fa31f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3201039b0 0x7fa32019a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.056+0000 7fa316a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa320104370 0x7fa32019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.056+0000 7fa31fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3201099c0 0x7fa32019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.056+0000 7fa31f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3201039b0 0x7fa32019a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:34392/0 (socket says 172.21.15.2:34392) 2024-06-13T02:25:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.056+0000 7fa31f400640 1 -- 172.21.15.2:0/713926321 learned_addr learned my addr 172.21.15.2:0/713926321 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.056+0000 7fa31f400640 1 -- 172.21.15.2:0/713926321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3201099c0 msgr2=0x7fa32019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.056+0000 7fa31f400640 1 --2- 172.21.15.2:0/713926321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3201099c0 0x7fa32019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.056+0000 7fa31f400640 1 -- 172.21.15.2:0/713926321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa320104370 msgr2=0x7fa32019a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.056+0000 7fa31f400640 1 --2- 172.21.15.2:0/713926321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa320104370 0x7fa32019a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.057+0000 7fa31f400640 1 -- 172.21.15.2:0/713926321 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32019f280 con 0x7fa3201039b0 2024-06-13T02:25:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.057+0000 7fa31f400640 1 --2- 172.21.15.2:0/713926321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3201039b0 0x7fa32019a2e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa31000e9f0 tx=0x7fa31000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.057+0000 7fa31cc00640 1 -- 172.21.15.2:0/713926321 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31000cd80 con 0x7fa3201039b0 2024-06-13T02:25:56.059 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.057+0000 7fa324e00640 1 -- 172.21.15.2:0/713926321 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa32019f570 con 0x7fa3201039b0 2024-06-13T02:25:56.060 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.057+0000 7fa31cc00640 1 -- 172.21.15.2:0/713926321 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa310010910 con 0x7fa3201039b0 2024-06-13T02:25:56.060 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.057+0000 7fa31cc00640 1 -- 172.21.15.2:0/713926321 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3100188f0 con 0x7fa3201039b0 2024-06-13T02:25:56.060 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.057+0000 7fa324e00640 1 -- 172.21.15.2:0/713926321 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3201a6e00 con 0x7fa3201039b0 2024-06-13T02:25:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.061+0000 7fa31cc00640 1 -- 172.21.15.2:0/713926321 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fa310010ac0 con 0x7fa3201039b0 2024-06-13T02:25:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.061+0000 7fa32918f740 1 Processor -- start 2024-06-13T02:25:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.061+0000 7fa32918f740 1 -- start start 2024-06-13T02:25:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.061+0000 7fa32918f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55799983f7a0 0x55799983dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.061+0000 7fa32918f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983e230 0x55799983e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.061+0000 7fa32918f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579998517c0 0x557999853bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.061+0000 7fa32918f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5579997a2420 con 0x55799983e230 2024-06-13T02:25:56.063 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.061+0000 7fa32918f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557999749c50 con 0x5579998517c0 2024-06-13T02:25:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.061+0000 7fa32918f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55799979e3e0 con 0x55799983f7a0 2024-06-13T02:25:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.062+0000 7fa31fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55799983f7a0 0x55799983dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.062+0000 7fa31fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55799983f7a0 0x55799983dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:34402/0 (socket says 172.21.15.2:34402) 2024-06-13T02:25:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.062+0000 7fa31fe00640 1 -- 172.21.15.2:0/3912914976 learned_addr learned my addr 172.21.15.2:0/3912914976 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.062+0000 7fa31f400640 1 --2- 172.21.15.2:0/3912914976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983e230 0x55799983e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.064 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.062+0000 7fa316a00640 1 --2- 172.21.15.2:0/3912914976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579998517c0 0x557999853bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.062+0000 7fa31fe00640 1 -- 172.21.15.2:0/3912914976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579998517c0 msgr2=0x557999853bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:56.065 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.062+0000 7fa31fe00640 1 --2- 172.21.15.2:0/3912914976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579998517c0 0x557999853bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.062+0000 7fa31fe00640 1 -- 172.21.15.2:0/3912914976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983e230 msgr2=0x55799983e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.062+0000 7fa31fe00640 1 --2- 172.21.15.2:0/3912914976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983e230 0x55799983e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.062+0000 7fa31fe00640 1 -- 172.21.15.2:0/3912914976 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579994b6210 con 0x55799983f7a0 2024-06-13T02:25:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.063+0000 7fa31cc00640 1 --2- 172.21.15.2:0/713926321 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa3000a2ce0 0x7fa3000a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.063+0000 7fa31fe00640 1 --2- 172.21.15.2:0/3912914976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55799983f7a0 0x55799983dcf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa318011440 tx=0x7fa318011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=165c16c31644b5f4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.063+0000 7fa31cc00640 1 -- 172.21.15.2:0/713926321 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9583+0+0 (secure 0 0 0) 0x7fa3100cfc30 con 0x7fa3201039b0 2024-06-13T02:25:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.063+0000 7fa31f400640 1 --2- 172.21.15.2:0/713926321 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa3000a2ce0 0x7fa3000a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.063+0000 7fa314c00640 1 -- 172.21.15.2:0/3912914976 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318004d20 con 0x55799983f7a0 2024-06-13T02:25:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.063+0000 7fa314c00640 1 -- 172.21.15.2:0/3912914976 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa318004050 con 0x55799983f7a0 2024-06-13T02:25:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.063+0000 7fa314c00640 1 -- 172.21.15.2:0/3912914976 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31800f760 con 0x55799983f7a0 2024-06-13T02:25:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.064+0000 7fa32918f740 1 -- 172.21.15.2:0/3912914976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55799983f7a0 msgr2=0x55799983dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:56.066 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.064+0000 7fa32918f740 1 --2- 172.21.15.2:0/3912914976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55799983f7a0 0x55799983dcf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa318011440 tx=0x7fa318011900 comp rx=0 tx=0).stop 2024-06-13T02:25:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.064+0000 7fa31f400640 1 --2- 172.21.15.2:0/713926321 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa3000a2ce0 0x7fa3000a51a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x557999840f00 tx=0x7fa3100d36e0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.064+0000 7fa32918f740 1 -- 172.21.15.2:0/3912914976 shutdown_connections 2024-06-13T02:25:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.064+0000 7fa32918f740 1 --2- 172.21.15.2:0/3912914976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579998517c0 0x557999853bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.064+0000 7fa32918f740 1 --2- 172.21.15.2:0/3912914976 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983e230 0x55799983e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.064+0000 7fa32918f740 1 --2- 172.21.15.2:0/3912914976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55799983f7a0 0x55799983dcf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.064+0000 7fa32918f740 1 -- 172.21.15.2:0/3912914976 >> 172.21.15.2:0/3912914976 conn(0x557999806fb0 msgr2=0x55799983a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.064+0000 7fa32918f740 1 -- 172.21.15.2:0/3912914976 shutdown_connections 2024-06-13T02:25:56.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.064+0000 7fa32918f740 1 -- 172.21.15.2:0/3912914976 wait complete. 2024-06-13T02:25:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.065+0000 7fa32918f740 1 -- start start 2024-06-13T02:25:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.065+0000 7fa32918f740 1 Processor -- start 2024-06-13T02:25:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.065+0000 7fa32918f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55799983e230 0x55799984e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.065+0000 7fa32918f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983f7a0 0x55799984ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.065+0000 7fa32918f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579998517c0 0x55799984f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.065+0000 7fa32918f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557999854590 con 0x55799983f7a0 2024-06-13T02:25:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.066+0000 7fa32918f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55799975d0b0 con 0x55799983e230 2024-06-13T02:25:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.066+0000 7fa32918f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557999854710 con 0x5579998517c0 2024-06-13T02:25:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.066+0000 7fa32918f740 10 client.0 _ll_register_callbacks cb 0x557999748f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:25:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.066+0000 7fa316a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983f7a0 0x55799984ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.066+0000 7fa316a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983f7a0 0x55799984ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39268/0 (socket says 172.21.15.2:39268) 2024-06-13T02:25:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.066+0000 7fa31fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55799983e230 0x55799984e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.066+0000 7fa316a00640 1 -- 172.21.15.2:0/2303316995 learned_addr learned my addr 172.21.15.2:0/2303316995 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.066+0000 7fa31fe00640 1 --2- 172.21.15.2:0/2303316995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579998517c0 0x55799984f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.066+0000 7fa316a00640 1 -- 172.21.15.2:0/2303316995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579998517c0 msgr2=0x55799984f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.066+0000 7fa316a00640 1 --2- 172.21.15.2:0/2303316995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579998517c0 0x55799984f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.066+0000 7fa316a00640 1 -- 172.21.15.2:0/2303316995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55799983e230 msgr2=0x55799984e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.066+0000 7fa316a00640 1 --2- 172.21.15.2:0/2303316995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55799983e230 0x55799984e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.066+0000 7fa316a00640 1 -- 172.21.15.2:0/2303316995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557999582620 con 0x55799983f7a0 2024-06-13T02:25:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.066+0000 7fa31fe00640 1 --2- 172.21.15.2:0/2303316995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579998517c0 0x55799984f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:25:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.067+0000 7fa316a00640 1 --2- 172.21.15.2:0/2303316995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983f7a0 0x55799984ed80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa308009900 tx=0x7fa3080043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcaad337737a49da server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.067+0000 7fa30d600640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:25:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.067+0000 7fa30d600640 1 -- 172.21.15.2:0/2303316995 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa308035040 con 0x55799983f7a0 2024-06-13T02:25:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.067+0000 7fa32918f740 1 -- 172.21.15.2:0/2303316995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa318004050 con 0x55799983f7a0 2024-06-13T02:25:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.067+0000 7fa30d600640 1 -- 172.21.15.2:0/2303316995 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9583+0+0 (secure 0 0 0) 0x7fa308005450 con 0x55799983f7a0 2024-06-13T02:25:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.067+0000 7fa30d600640 1 -- 172.21.15.2:0/2303316995 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa308005650 con 0x55799983f7a0 2024-06-13T02:25:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.067+0000 7fa32918f740 10 client.15726 fetch_fsmap learned FSMap version 35 2024-06-13T02:25:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.067+0000 7fa32918f740 1 -- 172.21.15.2:0/2303316995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557999860970 con 0x55799983f7a0 2024-06-13T02:25:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.068+0000 7fa30d600640 1 -- 172.21.15.2:0/2303316995 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa318004050 con 0x55799983f7a0 2024-06-13T02:25:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.068+0000 7fa30d600640 1 -- 172.21.15.2:0/2303316995 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa3080039d0 con 0x55799983f7a0 2024-06-13T02:25:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.068+0000 7fa32918f740 10 client.15726 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:25:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.068+0000 7fa32918f740 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:25:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.068+0000 7fa32918f740 20 client.15726 populate_metadata read hostname 'smithi002' 2024-06-13T02:25:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.068+0000 7fa32918f740 1 --2- 172.21.15.2:0/2303316995 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557999861e30 0x557999864220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.068+0000 7fa32918f740 4 client.15726 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:25:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.068+0000 7fa32918f740 1 -- 172.21.15.2:0/2303316995 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579997afb50 con 0x557999861e30 2024-06-13T02:25:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.068+0000 7fa31fe00640 1 --2- 172.21.15.2:0/2303316995 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557999861e30 0x557999864220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.069+0000 7fa31fe00640 1 --2- 172.21.15.2:0/2303316995 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557999861e30 0x557999864220 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12ce9b3f292a7227 server_cookie=35c5f184d5cf99e7 in_seq=0 out_seq=0 2024-06-13T02:25:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.069+0000 7fa30d600640 10 client.15726 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.071+0000 7fa30d600640 1 -- 172.21.15.2:0/2303316995 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5579997afb50 con 0x557999861e30 2024-06-13T02:25:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.071+0000 7fa30d600640 10 client.15726 handle_command_reply: tid=0 2024-06-13T02:25:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.071+0000 7fa32918f740 1 client.15726 shutdown 2024-06-13T02:25:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.072+0000 7fa32918f740 1 -- 172.21.15.2:0/2303316995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983f7a0 msgr2=0x55799984ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.072+0000 7fa32918f740 1 --2- 172.21.15.2:0/2303316995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983f7a0 0x55799984ed80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa308009900 tx=0x7fa3080043b0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.072+0000 7fa32918f740 1 -- 172.21.15.2:0/2303316995 shutdown_connections 2024-06-13T02:25:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.072+0000 7fa32918f740 1 --2- 172.21.15.2:0/2303316995 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557999861e30 0x557999864220 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.072+0000 7fa32918f740 1 --2- 172.21.15.2:0/2303316995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579998517c0 0x55799984f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.072+0000 7fa32918f740 1 --2- 172.21.15.2:0/2303316995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983f7a0 0x55799984ed80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.072+0000 7fa32918f740 1 --2- 172.21.15.2:0/2303316995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55799983e230 0x55799984e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.072+0000 7fa30d600640 0 client.15726 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.072+0000 7fa32918f740 1 -- 172.21.15.2:0/2303316995 >> 172.21.15.2:0/2303316995 conn(0x557999806fb0 msgr2=0x557999840690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.072+0000 7fa32918f740 1 -- 172.21.15.2:0/2303316995 shutdown_connections 2024-06-13T02:25:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.072+0000 7fa32918f740 1 -- 172.21.15.2:0/2303316995 wait complete. 2024-06-13T02:25:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.072+0000 7fa32918f740 20 client.15726 trim_cache size 0 max 16384 2024-06-13T02:25:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.091+0000 7fa32918f740 1 Processor -- start 2024-06-13T02:25:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.091+0000 7fa32918f740 1 -- start start 2024-06-13T02:25:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa32918f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983e230 0x557999869ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa32918f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55799983f7a0 0x557999869ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa32918f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579998517c0 0x557999839110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa32918f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201af5c0 con 0x55799983e230 2024-06-13T02:25:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa32918f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201ace90 con 0x55799983f7a0 2024-06-13T02:25:56.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa32918f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201aad00 con 0x5579998517c0 2024-06-13T02:25:56.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa31fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983e230 0x557999869ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa316a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55799983f7a0 0x557999869ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa316a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55799983f7a0 0x557999869ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:59846/0 (socket says 172.21.15.2:59846) 2024-06-13T02:25:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa316a00640 1 -- 172.21.15.2:0/1745071402 learned_addr learned my addr 172.21.15.2:0/1745071402 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa31fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983e230 0x557999869ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39280/0 (socket says 172.21.15.2:39280) 2024-06-13T02:25:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa31fe00640 1 --2- 172.21.15.2:0/1745071402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579998517c0 0x557999839110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa31fe00640 1 -- 172.21.15.2:0/1745071402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579998517c0 msgr2=0x557999839110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa31fe00640 1 --2- 172.21.15.2:0/1745071402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579998517c0 0x557999839110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa31fe00640 1 -- 172.21.15.2:0/1745071402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55799983f7a0 msgr2=0x557999869ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa31fe00640 1 --2- 172.21.15.2:0/1745071402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55799983f7a0 0x557999869ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa31fe00640 1 -- 172.21.15.2:0/1745071402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557999864880 con 0x55799983e230 2024-06-13T02:25:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.092+0000 7fa316a00640 1 --2- 172.21.15.2:0/1745071402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55799983f7a0 0x557999869ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:25:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.093+0000 7fa31fe00640 1 --2- 172.21.15.2:0/1745071402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983e230 0x557999869ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa318014040 tx=0x7fa318000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb389061103e2c45 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.093+0000 7fa30fe00640 1 -- 172.21.15.2:0/1745071402 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318033070 con 0x55799983e230 2024-06-13T02:25:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.093+0000 7fa30fe00640 1 -- 172.21.15.2:0/1745071402 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa318004c00 con 0x55799983e230 2024-06-13T02:25:56.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.093+0000 7fa30fe00640 1 -- 172.21.15.2:0/1745071402 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31801d040 con 0x55799983e230 2024-06-13T02:25:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.094+0000 7fa32918f740 1 -- 172.21.15.2:0/1745071402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983e230 msgr2=0x557999869ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.094+0000 7fa32918f740 1 --2- 172.21.15.2:0/1745071402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983e230 0x557999869ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa318014040 tx=0x7fa318000f40 comp rx=0 tx=0).stop 2024-06-13T02:25:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.094+0000 7fa32918f740 1 -- 172.21.15.2:0/1745071402 shutdown_connections 2024-06-13T02:25:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.094+0000 7fa32918f740 1 --2- 172.21.15.2:0/1745071402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5579998517c0 0x557999839110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.094+0000 7fa32918f740 1 --2- 172.21.15.2:0/1745071402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55799983f7a0 0x557999869ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.094+0000 7fa32918f740 1 --2- 172.21.15.2:0/1745071402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983e230 0x557999869ab0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.094+0000 7fa32918f740 1 -- 172.21.15.2:0/1745071402 >> 172.21.15.2:0/1745071402 conn(0x557999806fb0 msgr2=0x55799983a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.094+0000 7fa32918f740 1 -- 172.21.15.2:0/1745071402 shutdown_connections 2024-06-13T02:25:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.094+0000 7fa32918f740 1 -- 172.21.15.2:0/1745071402 wait complete. 2024-06-13T02:25:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.094+0000 7fa32918f740 1 -- start start 2024-06-13T02:25:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.095+0000 7fa32918f740 1 Processor -- start 2024-06-13T02:25:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.095+0000 7fa32918f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55799983e230 0x557999859fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.095+0000 7fa32918f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983f7a0 0x55799984b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.095+0000 7fa32918f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579998517c0 0x55799984b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.095+0000 7fa32918f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201ab350 con 0x55799983f7a0 2024-06-13T02:25:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.095+0000 7fa32918f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201ac7c0 con 0x5579998517c0 2024-06-13T02:25:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.095+0000 7fa32918f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201aba20 con 0x55799983e230 2024-06-13T02:25:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.095+0000 7fa32918f740 10 client.0 _ll_register_callbacks cb 0x7fa308009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:25:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.096+0000 7fa31fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55799983e230 0x557999859fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.096+0000 7fa31fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55799983e230 0x557999859fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:34438/0 (socket says 172.21.15.2:34438) 2024-06-13T02:25:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.096+0000 7fa31fe00640 1 -- 172.21.15.2:0/431967058 learned_addr learned my addr 172.21.15.2:0/431967058 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:25:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.096+0000 7fa316a00640 1 --2- 172.21.15.2:0/431967058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983f7a0 0x55799984b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.096+0000 7fa31fe00640 1 --2- 172.21.15.2:0/431967058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579998517c0 0x55799984b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.096+0000 7fa31fe00640 1 -- 172.21.15.2:0/431967058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579998517c0 msgr2=0x55799984b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.096+0000 7fa31fe00640 1 --2- 172.21.15.2:0/431967058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579998517c0 0x55799984b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.096+0000 7fa31fe00640 1 -- 172.21.15.2:0/431967058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983f7a0 msgr2=0x55799984b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:25:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.096+0000 7fa31fe00640 1 --2- 172.21.15.2:0/431967058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983f7a0 0x55799984b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.096+0000 7fa31fe00640 1 -- 172.21.15.2:0/431967058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55799984bfc0 con 0x55799983e230 2024-06-13T02:25:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.096+0000 7fa316a00640 1 --2- 172.21.15.2:0/431967058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983f7a0 0x55799984b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:25:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.096+0000 7fa31fe00640 1 --2- 172.21.15.2:0/431967058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55799983e230 0x557999859fa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa31800f450 tx=0x7fa318013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f5d08f3ac7adaf3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:25:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.096+0000 7fa30d600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:25:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.097+0000 7fa30d600640 1 -- 172.21.15.2:0/431967058 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318033020 con 0x55799983e230 2024-06-13T02:25:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.097+0000 7fa32918f740 1 -- 172.21.15.2:0/431967058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa318004c00 con 0x55799983e230 2024-06-13T02:25:56.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.097+0000 7fa30d600640 1 -- 172.21.15.2:0/431967058 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9583+0+0 (secure 0 0 0) 0x7fa3180052c0 con 0x55799983e230 2024-06-13T02:25:56.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.097+0000 7fa30d600640 1 -- 172.21.15.2:0/431967058 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa31801d070 con 0x55799983e230 2024-06-13T02:25:56.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.097+0000 7fa32918f740 10 client.25900 fetch_fsmap learned FSMap version 35 2024-06-13T02:25:56.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.097+0000 7fa32918f740 1 -- 172.21.15.2:0/431967058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5579998cc8a0 con 0x55799983e230 2024-06-13T02:25:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.097+0000 7fa30d600640 1 -- 172.21.15.2:0/431967058 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa318004c00 con 0x55799983e230 2024-06-13T02:25:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.097+0000 7fa30d600640 1 -- 172.21.15.2:0/431967058 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa318004530 con 0x55799983e230 2024-06-13T02:25:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.098+0000 7fa32918f740 10 client.25900 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:25:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.098+0000 7fa32918f740 10 client.25900 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:25:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.098+0000 7fa32918f740 20 client.25900 populate_metadata read hostname 'smithi002' 2024-06-13T02:25:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.098+0000 7fa32918f740 1 --2- 172.21.15.2:0/431967058 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5579998ccd20 0x5579998cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:25:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.098+0000 7fa32918f740 4 client.25900 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:25:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.098+0000 7fa32918f740 1 -- 172.21.15.2:0/431967058 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5579997a9ea0 con 0x5579998ccd20 2024-06-13T02:25:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.098+0000 7fa316a00640 1 --2- 172.21.15.2:0/431967058 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5579998ccd20 0x5579998cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:25:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.098+0000 7fa316a00640 1 --2- 172.21.15.2:0/431967058 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5579998ccd20 0x5579998cf140 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a074b79e1bcf445 server_cookie=227b61561a79cb87 in_seq=0 out_seq=0 2024-06-13T02:25:56.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.098+0000 7fa30d600640 10 client.25900 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.303+0000 7fa30d600640 1 -- 172.21.15.2:0/431967058 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5579997a9ea0 con 0x5579998ccd20 2024-06-13T02:25:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.303+0000 7fa30d600640 10 client.25900 handle_command_reply: tid=0 2024-06-13T02:25:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.303+0000 7fa32918f740 1 client.25900 shutdown 2024-06-13T02:25:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.303+0000 7fa32918f740 1 -- 172.21.15.2:0/431967058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55799983e230 msgr2=0x557999859fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.303+0000 7fa32918f740 1 --2- 172.21.15.2:0/431967058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55799983e230 0x557999859fa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa31800f450 tx=0x7fa318013040 comp rx=0 tx=0).stop 2024-06-13T02:25:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.303+0000 7fa32918f740 1 -- 172.21.15.2:0/431967058 shutdown_connections 2024-06-13T02:25:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.303+0000 7fa32918f740 1 --2- 172.21.15.2:0/431967058 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5579998ccd20 0x5579998cf140 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.303+0000 7fa32918f740 1 --2- 172.21.15.2:0/431967058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5579998517c0 0x55799984b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.303+0000 7fa32918f740 1 --2- 172.21.15.2:0/431967058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55799983f7a0 0x55799984b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.303+0000 7fa30d600640 0 client.25900 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:25:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.303+0000 7fa32918f740 1 --2- 172.21.15.2:0/431967058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55799983e230 0x557999859fa0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.303+0000 7fa32918f740 1 -- 172.21.15.2:0/431967058 >> 172.21.15.2:0/431967058 conn(0x557999806fb0 msgr2=0x55799983fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.303+0000 7fa32918f740 1 -- 172.21.15.2:0/431967058 shutdown_connections 2024-06-13T02:25:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.304+0000 7fa32918f740 1 -- 172.21.15.2:0/431967058 wait complete. 2024-06-13T02:25:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.304+0000 7fa32918f740 20 client.25900 trim_cache size 0 max 16384 2024-06-13T02:25:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:25:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:25:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:25:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.305+0000 7fa324e00640 1 -- 172.21.15.2:0/713926321 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa3000a2ce0 msgr2=0x7fa3000a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.305+0000 7fa324e00640 1 --2- 172.21.15.2:0/713926321 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa3000a2ce0 0x7fa3000a51a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x557999840f00 tx=0x7fa3100d36e0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.305+0000 7fa324e00640 1 -- 172.21.15.2:0/713926321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3201039b0 msgr2=0x7fa32019a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:25:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.305+0000 7fa324e00640 1 --2- 172.21.15.2:0/713926321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3201039b0 0x7fa32019a2e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa31000e9f0 tx=0x7fa31000eeb0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.305+0000 7fa324e00640 1 -- 172.21.15.2:0/713926321 shutdown_connections 2024-06-13T02:25:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.305+0000 7fa324e00640 1 --2- 172.21.15.2:0/713926321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3201099c0 0x7fa32019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.305+0000 7fa324e00640 1 --2- 172.21.15.2:0/713926321 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa3000a2ce0 0x7fa3000a51a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.305+0000 7fa324e00640 1 --2- 172.21.15.2:0/713926321 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa320104370 0x7fa32019a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.305+0000 7fa324e00640 1 --2- 172.21.15.2:0/713926321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3201039b0 0x7fa32019a2e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:25:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.305+0000 7fa324e00640 1 -- 172.21.15.2:0/713926321 >> 172.21.15.2:0/713926321 conn(0x7fa3200ff480 msgr2=0x7fa3200ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:25:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.306+0000 7fa324e00640 1 -- 172.21.15.2:0/713926321 shutdown_connections 2024-06-13T02:25:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:25:56.306+0000 7fa324e00640 1 -- 172.21.15.2:0/713926321 wait complete. 2024-06-13T02:25:56.533 INFO:tasks.workunit.client.0.smithi002.stdout: 1 591510 7.53 MB/sec execute 300 sec latency 124.731 ms 2024-06-13T02:25:57.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:57 smithi175 ceph-mon[36977]: pgmap v253: 129 pgs: 129 active+clean; 89 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 256 op/s 2024-06-13T02:25:57.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:57 smithi002 ceph-mon[31960]: pgmap v253: 129 pgs: 129 active+clean; 89 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 256 op/s 2024-06-13T02:25:57.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:57 smithi084 ceph-mon[36833]: pgmap v253: 129 pgs: 129 active+clean; 89 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 256 op/s 2024-06-13T02:25:57.533 INFO:tasks.workunit.client.0.smithi002.stdout: 1 593242 7.54 MB/sec execute 301 sec latency 54.301 ms 2024-06-13T02:25:58.533 INFO:tasks.workunit.client.0.smithi002.stdout: 1 594077 7.53 MB/sec execute 302 sec latency 61.475 ms 2024-06-13T02:25:59.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:25:59 smithi175 ceph-mon[36977]: pgmap v254: 129 pgs: 129 active+clean; 90 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 168 op/s 2024-06-13T02:25:59.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:25:59 smithi002 ceph-mon[31960]: pgmap v254: 129 pgs: 129 active+clean; 90 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 168 op/s 2024-06-13T02:25:59.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:25:59 smithi084 ceph-mon[36833]: pgmap v254: 129 pgs: 129 active+clean; 90 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 168 op/s 2024-06-13T02:25:59.533 INFO:tasks.workunit.client.0.smithi002.stdout: 1 595256 7.52 MB/sec execute 303 sec latency 22.968 ms 2024-06-13T02:26:00.533 INFO:tasks.workunit.client.0.smithi002.stdout: 1 596827 7.53 MB/sec execute 304 sec latency 19.734 ms 2024-06-13T02:26:01.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:01 smithi175 ceph-mon[36977]: pgmap v255: 129 pgs: 129 active+clean; 90 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 1.7 MiB/s wr, 134 op/s 2024-06-13T02:26:01.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:01 smithi002 ceph-mon[31960]: pgmap v255: 129 pgs: 129 active+clean; 90 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 1.7 MiB/s wr, 134 op/s 2024-06-13T02:26:01.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:01 smithi084 ceph-mon[36833]: pgmap v255: 129 pgs: 129 active+clean; 90 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 1.7 MiB/s wr, 134 op/s 2024-06-13T02:26:01.533 INFO:tasks.workunit.client.0.smithi002.stdout: 1 597638 7.51 MB/sec execute 305 sec latency 24.016 ms 2024-06-13T02:26:02.534 INFO:tasks.workunit.client.0.smithi002.stdout: 1 597745 7.49 MB/sec execute 306 sec latency 166.677 ms 2024-06-13T02:26:03.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:03 smithi175 ceph-mon[36977]: pgmap v256: 129 pgs: 129 active+clean; 85 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 293 op/s 2024-06-13T02:26:03.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:03 smithi002 ceph-mon[31960]: pgmap v256: 129 pgs: 129 active+clean; 85 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 293 op/s 2024-06-13T02:26:03.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:03 smithi084 ceph-mon[36833]: pgmap v256: 129 pgs: 129 active+clean; 85 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 293 op/s 2024-06-13T02:26:03.534 INFO:tasks.workunit.client.0.smithi002.stdout: 1 598690 7.48 MB/sec execute 307 sec latency 75.622 ms 2024-06-13T02:26:04.534 INFO:tasks.workunit.client.0.smithi002.stdout: 1 600318 7.50 MB/sec execute 308 sec latency 37.642 ms 2024-06-13T02:26:05.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:05 smithi002 ceph-mon[31960]: pgmap v257: 129 pgs: 129 active+clean; 85 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 223 op/s 2024-06-13T02:26:05.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:05 smithi084 ceph-mon[36833]: pgmap v257: 129 pgs: 129 active+clean; 85 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 223 op/s 2024-06-13T02:26:05.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:05 smithi175 ceph-mon[36977]: pgmap v257: 129 pgs: 129 active+clean; 85 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 223 op/s 2024-06-13T02:26:05.534 INFO:tasks.workunit.client.0.smithi002.stdout: 1 600848 7.48 MB/sec execute 309 sec latency 75.781 ms 2024-06-13T02:26:06.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:06 smithi002 ceph-mon[31960]: osdmap e109: 12 total, 12 up, 12 in 2024-06-13T02:26:06.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:06 smithi084 ceph-mon[36833]: osdmap e109: 12 total, 12 up, 12 in 2024-06-13T02:26:06.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:06 smithi175 ceph-mon[36977]: osdmap e109: 12 total, 12 up, 12 in 2024-06-13T02:26:06.534 INFO:tasks.workunit.client.0.smithi002.stdout: 1 601064 7.45 MB/sec execute 310 sec latency 72.310 ms 2024-06-13T02:26:07.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:07 smithi002 ceph-mon[31960]: pgmap v259: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 87 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 271 op/s 2024-06-13T02:26:07.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:07 smithi084 ceph-mon[36833]: pgmap v259: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 87 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 271 op/s 2024-06-13T02:26:07.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:07 smithi175 ceph-mon[36977]: pgmap v259: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 87 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 271 op/s 2024-06-13T02:26:07.534 INFO:tasks.workunit.client.0.smithi002.stdout: 1 601391 7.43 MB/sec execute 311 sec latency 114.398 ms 2024-06-13T02:26:08.534 INFO:tasks.workunit.client.0.smithi002.stdout: 1 602240 7.42 MB/sec execute 312 sec latency 44.343 ms 2024-06-13T02:26:09.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:09 smithi002 ceph-mon[31960]: pgmap v260: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 89 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2024-06-13T02:26:09.457 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.457+0000 7f6833200640 1 -- 172.21.15.2:0/1020867947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6834102180 msgr2=0x7f683410e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.457+0000 7f6833200640 1 --2- 172.21.15.2:0/1020867947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6834102180 0x7f683410e690 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f682c009ca0 tx=0x7f682c02a8c0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.457+0000 7f6833200640 1 -- 172.21.15.2:0/1020867947 shutdown_connections 2024-06-13T02:26:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.457+0000 7f6833200640 1 --2- 172.21.15.2:0/1020867947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6834102180 0x7f683410e690 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.457+0000 7f6833200640 1 --2- 172.21.15.2:0/1020867947 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68341017c0 0x7f6834101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.457+0000 7f6833200640 1 --2- 172.21.15.2:0/1020867947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68341077d0 0x7f6834107bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.457+0000 7f6833200640 1 -- 172.21.15.2:0/1020867947 >> 172.21.15.2:0/1020867947 conn(0x7f68340fd2b0 msgr2=0x7f68340ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.457+0000 7f6833200640 1 -- 172.21.15.2:0/1020867947 shutdown_connections 2024-06-13T02:26:09.458 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.457+0000 7f6833200640 1 -- 172.21.15.2:0/1020867947 wait complete. 2024-06-13T02:26:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.459+0000 7f6833200640 1 Processor -- start 2024-06-13T02:26:09.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.459+0000 7f6833200640 1 -- start start 2024-06-13T02:26:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.460+0000 7f6833200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68341017c0 0x7f6834073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.460+0000 7f6833200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6834102180 0x7f68340741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.460+0000 7f6833200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68341077d0 0x7f6834074720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.460+0000 7f6833200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6834111be0 con 0x7f68341077d0 2024-06-13T02:26:09.460 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.460+0000 7f6833200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6834111a60 con 0x7f6834102180 2024-06-13T02:26:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.460+0000 7f6833200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6834111d60 con 0x7f68341017c0 2024-06-13T02:26:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.460+0000 7f6831e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68341017c0 0x7f6834073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.460+0000 7f6831400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6834102180 0x7f68340741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.460+0000 7f6831400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6834102180 0x7f68340741e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:34092/0 (socket says 172.21.15.2:34092) 2024-06-13T02:26:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.460+0000 7f6831400640 1 -- 172.21.15.2:0/1551084165 learned_addr learned my addr 172.21.15.2:0/1551084165 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:09.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.460+0000 7f6832800640 1 --2- 172.21.15.2:0/1551084165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68341077d0 0x7f6834074720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.460+0000 7f6831400640 1 -- 172.21.15.2:0/1551084165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68341017c0 msgr2=0x7f6834073ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.460+0000 7f6831400640 1 --2- 172.21.15.2:0/1551084165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68341017c0 0x7f6834073ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.460+0000 7f6831400640 1 -- 172.21.15.2:0/1551084165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68341077d0 msgr2=0x7f6834074720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:09.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.460+0000 7f6831400640 1 --2- 172.21.15.2:0/1551084165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68341077d0 0x7f6834074720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.461+0000 7f6831400640 1 -- 172.21.15.2:0/1551084165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68341a6540 con 0x7f6834102180 2024-06-13T02:26:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.461+0000 7f6831e00640 1 --2- 172.21.15.2:0/1551084165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68341017c0 0x7f6834073ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:26:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.461+0000 7f6831400640 1 --2- 172.21.15.2:0/1551084165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6834102180 0x7f68340741e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f682000d950 tx=0x7f682000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.461+0000 7f682aa00640 1 -- 172.21.15.2:0/1551084165 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6820017070 con 0x7f6834102180 2024-06-13T02:26:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.461+0000 7f682aa00640 1 -- 172.21.15.2:0/1551084165 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6820009c30 con 0x7f6834102180 2024-06-13T02:26:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.461+0000 7f682aa00640 1 -- 172.21.15.2:0/1551084165 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682000f6b0 con 0x7f6834102180 2024-06-13T02:26:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.461+0000 7f6833200640 1 -- 172.21.15.2:0/1551084165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68341a6830 con 0x7f6834102180 2024-06-13T02:26:09.463 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.461+0000 7f6833200640 1 -- 172.21.15.2:0/1551084165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68341a6d30 con 0x7f6834102180 2024-06-13T02:26:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.465+0000 7f682aa00640 1 -- 172.21.15.2:0/1551084165 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f68200109d0 con 0x7f6834102180 2024-06-13T02:26:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.465+0000 7f683b7f9740 1 Processor -- start 2024-06-13T02:26:09.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.465+0000 7f683b7f9740 1 -- start start 2024-06-13T02:26:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.465+0000 7f683b7f9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc37a0 0x55ea80cc1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.466+0000 7f683b7f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc2230 0x55ea80cc26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.466+0000 7f683b7f9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80ccf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.466+0000 7f683b7f9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ea80c26420 con 0x55ea80cc37a0 2024-06-13T02:26:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.466+0000 7f683b7f9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ea80bcdc50 con 0x55ea80cccfb0 2024-06-13T02:26:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.466+0000 7f683b7f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ea80c223e0 con 0x55ea80cc2230 2024-06-13T02:26:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.466+0000 7f6832800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc37a0 0x55ea80cc1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.466+0000 7f6832800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc37a0 0x55ea80cc1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48702/0 (socket says 172.21.15.2:48702) 2024-06-13T02:26:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.466+0000 7f6832800640 1 -- 172.21.15.2:0/1424193509 learned_addr learned my addr 172.21.15.2:0/1424193509 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.466+0000 7f6831400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80ccf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.466+0000 7f6831e00640 1 --2- 172.21.15.2:0/1424193509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc2230 0x55ea80cc26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.466+0000 7f6832800640 1 -- 172.21.15.2:0/1424193509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc2230 msgr2=0x55ea80cc26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.466+0000 7f6832800640 1 --2- 172.21.15.2:0/1424193509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc2230 0x55ea80cc26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.466+0000 7f6832800640 1 -- 172.21.15.2:0/1424193509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 msgr2=0x55ea80ccf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.466+0000 7f6832800640 1 --2- 172.21.15.2:0/1424193509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80ccf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.466+0000 7f6832800640 1 -- 172.21.15.2:0/1424193509 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea8093a210 con 0x55ea80cc37a0 2024-06-13T02:26:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.467+0000 7f682aa00640 1 --2- 172.21.15.2:0/1551084165 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f68180a2d60 0x7f68180a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.467+0000 7f6831e00640 1 --2- 172.21.15.2:0/1424193509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc2230 0x55ea80cc26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:26:09.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.467+0000 7f682aa00640 1 -- 172.21.15.2:0/1551084165 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9671+0+0 (secure 0 0 0) 0x7f68200cf470 con 0x7f6834102180 2024-06-13T02:26:09.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.467+0000 7f6832800640 1 --2- 172.21.15.2:0/1424193509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc37a0 0x55ea80cc1cf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f682c035000 tx=0x7f682c005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e011bd69d91174f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:09.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.467+0000 7f6831e00640 1 --2- 172.21.15.2:0/1551084165 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f68180a2d60 0x7f68180a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.468+0000 7f681f000640 1 -- 172.21.15.2:0/1424193509 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c031da0 con 0x55ea80cc37a0 2024-06-13T02:26:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.468+0000 7f681f000640 1 -- 172.21.15.2:0/1424193509 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f682c036070 con 0x55ea80cc37a0 2024-06-13T02:26:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.468+0000 7f681f000640 1 -- 172.21.15.2:0/1424193509 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c004460 con 0x55ea80cc37a0 2024-06-13T02:26:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.468+0000 7f683b7f9740 1 -- 172.21.15.2:0/1424193509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc37a0 msgr2=0x55ea80cc1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.468+0000 7f6831e00640 1 --2- 172.21.15.2:0/1551084165 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f68180a2d60 0x7f68180a5220 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6824009fd0 tx=0x7f6824005f90 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.468+0000 7f683b7f9740 1 --2- 172.21.15.2:0/1424193509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc37a0 0x55ea80cc1cf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f682c035000 tx=0x7f682c005fa0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.469+0000 7f683b7f9740 1 -- 172.21.15.2:0/1424193509 shutdown_connections 2024-06-13T02:26:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.469+0000 7f683b7f9740 1 --2- 172.21.15.2:0/1424193509 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80ccf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.469+0000 7f683b7f9740 1 --2- 172.21.15.2:0/1424193509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc2230 0x55ea80cc26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.469+0000 7f683b7f9740 1 --2- 172.21.15.2:0/1424193509 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc37a0 0x55ea80cc1cf0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.469+0000 7f683b7f9740 1 -- 172.21.15.2:0/1424193509 >> 172.21.15.2:0/1424193509 conn(0x55ea80c8afb0 msgr2=0x55ea80cbe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.469+0000 7f683b7f9740 1 -- 172.21.15.2:0/1424193509 shutdown_connections 2024-06-13T02:26:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.469+0000 7f683b7f9740 1 -- 172.21.15.2:0/1424193509 wait complete. 2024-06-13T02:26:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.469+0000 7f683b7f9740 1 -- start start 2024-06-13T02:26:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.469+0000 7f683b7f9740 1 Processor -- start 2024-06-13T02:26:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.470+0000 7f683b7f9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc2230 0x55ea80cc9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.470+0000 7f683b7f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc37a0 0x55ea80cca530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.470+0000 7f683b7f9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80ccaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.470+0000 7f683b7f9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55ea80ccfba0 con 0x55ea80cc2230 2024-06-13T02:26:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.470+0000 7f683b7f9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ea80be10b0 con 0x55ea80cccfb0 2024-06-13T02:26:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.470+0000 7f683b7f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ea80ccfd20 con 0x55ea80cc37a0 2024-06-13T02:26:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.470+0000 7f683b7f9740 10 client.0 _ll_register_callbacks cb 0x55ea80bccf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:26:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.470+0000 7f6831e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc2230 0x55ea80cc9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.470+0000 7f6832800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80ccaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.470+0000 7f6831400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc37a0 0x55ea80cca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.470+0000 7f6831e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc2230 0x55ea80cc9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48712/0 (socket says 172.21.15.2:48712) 2024-06-13T02:26:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.470+0000 7f6831e00640 1 -- 172.21.15.2:0/1460217451 learned_addr learned my addr 172.21.15.2:0/1460217451 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.471+0000 7f6832800640 1 -- 172.21.15.2:0/1460217451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc37a0 msgr2=0x55ea80cca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.471+0000 7f6832800640 1 --2- 172.21.15.2:0/1460217451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc37a0 0x55ea80cca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.471+0000 7f6832800640 1 -- 172.21.15.2:0/1460217451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc2230 msgr2=0x55ea80cc9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.471+0000 7f6832800640 1 --2- 172.21.15.2:0/1460217451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc2230 0x55ea80cc9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.471+0000 7f6832800640 1 -- 172.21.15.2:0/1460217451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea80a06620 con 0x55ea80cccfb0 2024-06-13T02:26:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.471+0000 7f6832800640 1 --2- 172.21.15.2:0/1460217451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80ccaa70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f682c009a60 tx=0x7f682c031dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eed665f2c02856b8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.471+0000 7f6813400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:26:09.475 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:09 smithi084 ceph-mon[36833]: pgmap v260: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 89 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2024-06-13T02:26:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.472+0000 7f6813400640 1 -- 172.21.15.2:0/1460217451 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c051020 con 0x55ea80cccfb0 2024-06-13T02:26:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.472+0000 7f6813400640 1 -- 172.21.15.2:0/1460217451 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9671+0+0 (secure 0 0 0) 0x7f682c003d80 con 0x55ea80cccfb0 2024-06-13T02:26:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.472+0000 7f683b7f9740 1 -- 172.21.15.2:0/1460217451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f682c036070 con 0x55ea80cccfb0 2024-06-13T02:26:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.472+0000 7f6813400640 1 -- 172.21.15.2:0/1460217451 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f682c0041e0 con 0x55ea80cccfb0 2024-06-13T02:26:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.472+0000 7f683b7f9740 10 client.25925 fetch_fsmap learned FSMap version 35 2024-06-13T02:26:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.472+0000 7f683b7f9740 1 -- 172.21.15.2:0/1460217451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ea80ccfba0 con 0x55ea80cccfb0 2024-06-13T02:26:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.472+0000 7f6813400640 1 -- 172.21.15.2:0/1460217451 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f682c036070 con 0x55ea80cccfb0 2024-06-13T02:26:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.472+0000 7f6813400640 1 -- 172.21.15.2:0/1460217451 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f682c043020 con 0x55ea80cccfb0 2024-06-13T02:26:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.472+0000 7f683b7f9740 10 client.25925 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:26:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.472+0000 7f683b7f9740 10 client.25925 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:26:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.472+0000 7f683b7f9740 20 client.25925 populate_metadata read hostname 'smithi002' 2024-06-13T02:26:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.472+0000 7f683b7f9740 1 --2- 172.21.15.2:0/1460217451 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ea80cdd110 0x55ea80cdf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.472+0000 7f683b7f9740 4 client.25925 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:26:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.472+0000 7f683b7f9740 1 -- 172.21.15.2:0/1460217451 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea80c33b50 con 0x55ea80cdd110 2024-06-13T02:26:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.473+0000 7f6831e00640 1 --2- 172.21.15.2:0/1460217451 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ea80cdd110 0x55ea80cdf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.473+0000 7f6831e00640 1 --2- 172.21.15.2:0/1460217451 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ea80cdd110 0x55ea80cdf500 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df327c965a5c7c70 server_cookie=5428f8e94b3b1bd in_seq=0 out_seq=0 2024-06-13T02:26:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.473+0000 7f6813400640 10 client.25925 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.479+0000 7f6813400640 1 -- 172.21.15.2:0/1460217451 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ea80c33b50 con 0x55ea80cdd110 2024-06-13T02:26:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.479+0000 7f6813400640 10 client.25925 handle_command_reply: tid=0 2024-06-13T02:26:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.479+0000 7f683b7f9740 1 client.25925 shutdown 2024-06-13T02:26:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.479+0000 7f683b7f9740 1 -- 172.21.15.2:0/1460217451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 msgr2=0x55ea80ccaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.479+0000 7f683b7f9740 1 --2- 172.21.15.2:0/1460217451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80ccaa70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f682c009a60 tx=0x7f682c031dd0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.480+0000 7f683b7f9740 1 -- 172.21.15.2:0/1460217451 shutdown_connections 2024-06-13T02:26:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.480+0000 7f683b7f9740 1 --2- 172.21.15.2:0/1460217451 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ea80cdd110 0x55ea80cdf500 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.480+0000 7f683b7f9740 1 --2- 172.21.15.2:0/1460217451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80ccaa70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.480+0000 7f683b7f9740 1 --2- 172.21.15.2:0/1460217451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc37a0 0x55ea80cca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.480+0000 7f683b7f9740 1 --2- 172.21.15.2:0/1460217451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc2230 0x55ea80cc9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.480+0000 7f6813400640 0 client.25925 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.480+0000 7f683b7f9740 1 -- 172.21.15.2:0/1460217451 >> 172.21.15.2:0/1460217451 conn(0x55ea80c8afb0 msgr2=0x55ea80cc4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.480+0000 7f683b7f9740 1 -- 172.21.15.2:0/1460217451 shutdown_connections 2024-06-13T02:26:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.480+0000 7f683b7f9740 1 -- 172.21.15.2:0/1460217451 wait complete. 2024-06-13T02:26:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.480+0000 7f683b7f9740 20 client.25925 trim_cache size 0 max 16384 2024-06-13T02:26:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.500+0000 7f683b7f9740 1 Processor -- start 2024-06-13T02:26:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.500+0000 7f683b7f9740 1 -- start start 2024-06-13T02:26:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.501+0000 7f683b7f9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc2230 0x55ea80cc9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.501+0000 7f683b7f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc37a0 0x55ea80cca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.501+0000 7f683b7f9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80cbd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.501+0000 7f683b7f9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f68341b3a10 con 0x55ea80cc2230 2024-06-13T02:26:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.501+0000 7f683b7f9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f68341b12e0 con 0x55ea80cccfb0 2024-06-13T02:26:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.501+0000 7f683b7f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f68341af150 con 0x55ea80cc37a0 2024-06-13T02:26:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.501+0000 7f6832800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80cbd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.501+0000 7f6832800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80cbd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:34106/0 (socket says 172.21.15.2:34106) 2024-06-13T02:26:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.501+0000 7f6832800640 1 -- 172.21.15.2:0/1535012627 learned_addr learned my addr 172.21.15.2:0/1535012627 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.501+0000 7f6831400640 1 --2- 172.21.15.2:0/1535012627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc37a0 0x55ea80cca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.501+0000 7f6831e00640 1 --2- 172.21.15.2:0/1535012627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc2230 0x55ea80cc9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.502+0000 7f6832800640 1 -- 172.21.15.2:0/1535012627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc37a0 msgr2=0x55ea80cca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.502+0000 7f6832800640 1 --2- 172.21.15.2:0/1535012627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc37a0 0x55ea80cca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.502+0000 7f6832800640 1 -- 172.21.15.2:0/1535012627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc2230 msgr2=0x55ea80cc9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.502+0000 7f6832800640 1 --2- 172.21.15.2:0/1535012627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc2230 0x55ea80cc9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.502+0000 7f6832800640 1 -- 172.21.15.2:0/1535012627 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea80cba000 con 0x55ea80cccfb0 2024-06-13T02:26:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.502+0000 7f6831e00640 1 --2- 172.21.15.2:0/1535012627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc2230 0x55ea80cc9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:26:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.502+0000 7f6832800640 1 --2- 172.21.15.2:0/1535012627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80cbd820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f682c02a900 tx=0x7f682c009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2708a4e8b51e099 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.502+0000 7f681e600640 1 -- 172.21.15.2:0/1535012627 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c051070 con 0x55ea80cccfb0 2024-06-13T02:26:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.502+0000 7f681e600640 1 -- 172.21.15.2:0/1535012627 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f682c036070 con 0x55ea80cccfb0 2024-06-13T02:26:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.502+0000 7f681e600640 1 -- 172.21.15.2:0/1535012627 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c0309f0 con 0x55ea80cccfb0 2024-06-13T02:26:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.503+0000 7f683b7f9740 1 -- 172.21.15.2:0/1535012627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 msgr2=0x55ea80cbd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.503+0000 7f683b7f9740 1 --2- 172.21.15.2:0/1535012627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80cbd820 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f682c02a900 tx=0x7f682c009b20 comp rx=0 tx=0).stop 2024-06-13T02:26:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.503+0000 7f683b7f9740 1 -- 172.21.15.2:0/1535012627 shutdown_connections 2024-06-13T02:26:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.503+0000 7f683b7f9740 1 --2- 172.21.15.2:0/1535012627 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80cbd820 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.503+0000 7f683b7f9740 1 --2- 172.21.15.2:0/1535012627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc37a0 0x55ea80cca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.503+0000 7f683b7f9740 1 --2- 172.21.15.2:0/1535012627 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc2230 0x55ea80cc9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.503+0000 7f683b7f9740 1 -- 172.21.15.2:0/1535012627 >> 172.21.15.2:0/1535012627 conn(0x55ea80c8afb0 msgr2=0x55ea80cbd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.503+0000 7f683b7f9740 1 -- 172.21.15.2:0/1535012627 shutdown_connections 2024-06-13T02:26:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.503+0000 7f683b7f9740 1 -- 172.21.15.2:0/1535012627 wait complete. 2024-06-13T02:26:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.504+0000 7f683b7f9740 1 -- start start 2024-06-13T02:26:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.504+0000 7f683b7f9740 1 Processor -- start 2024-06-13T02:26:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.504+0000 7f683b7f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc2230 0x55ea80d3ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.504+0000 7f683b7f9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc37a0 0x55ea80d404f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.504+0000 7f683b7f9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80cd0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.504+0000 7f683b7f9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f68341af7a0 con 0x55ea80cc37a0 2024-06-13T02:26:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.504+0000 7f683b7f9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f68341b0c10 con 0x55ea80cccfb0 2024-06-13T02:26:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.504+0000 7f683b7f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f68341afe70 con 0x55ea80cc2230 2024-06-13T02:26:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.505+0000 7f683b7f9740 10 client.0 _ll_register_callbacks cb 0x7f68200d2df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:26:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.505+0000 7f6831400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc37a0 0x55ea80d404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.505+0000 7f6832800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80cd0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.505+0000 7f6831e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc2230 0x55ea80d3ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.505+0000 7f6831400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc37a0 0x55ea80d404f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:48732/0 (socket says 172.21.15.2:48732) 2024-06-13T02:26:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.505+0000 7f6831400640 1 -- 172.21.15.2:0/185904907 learned_addr learned my addr 172.21.15.2:0/185904907 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.505+0000 7f6831e00640 1 -- 172.21.15.2:0/185904907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 msgr2=0x55ea80cd0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.505+0000 7f6831e00640 1 --2- 172.21.15.2:0/185904907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80cd0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.505+0000 7f6831e00640 1 -- 172.21.15.2:0/185904907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc37a0 msgr2=0x55ea80d404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.505+0000 7f6831e00640 1 --2- 172.21.15.2:0/185904907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc37a0 0x55ea80d404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.505+0000 7f6831e00640 1 -- 172.21.15.2:0/185904907 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea80cd0d30 con 0x55ea80cc2230 2024-06-13T02:26:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.505+0000 7f6831e00640 1 --2- 172.21.15.2:0/185904907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc2230 0x55ea80d3ffb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55ea80cc9850 tx=0x7f68240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c11c397743ad7cd server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.505+0000 7f6813400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:26:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.506+0000 7f6813400640 1 -- 172.21.15.2:0/185904907 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682400fcd0 con 0x55ea80cc2230 2024-06-13T02:26:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.506+0000 7f6813400640 1 -- 172.21.15.2:0/185904907 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9671+0+0 (secure 0 0 0) 0x7f682402b380 con 0x55ea80cc2230 2024-06-13T02:26:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.506+0000 7f683b7f9740 1 -- 172.21.15.2:0/185904907 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f682c036070 con 0x55ea80cc2230 2024-06-13T02:26:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.506+0000 7f6813400640 1 -- 172.21.15.2:0/185904907 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f682403d050 con 0x55ea80cc2230 2024-06-13T02:26:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.506+0000 7f683b7f9740 10 client.25918 fetch_fsmap learned FSMap version 35 2024-06-13T02:26:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.506+0000 7f683b7f9740 1 -- 172.21.15.2:0/185904907 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ea80d47770 con 0x55ea80cc2230 2024-06-13T02:26:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.506+0000 7f6813400640 1 -- 172.21.15.2:0/185904907 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f682c036070 con 0x55ea80cc2230 2024-06-13T02:26:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.507+0000 7f6813400640 1 -- 172.21.15.2:0/185904907 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f682401f800 con 0x55ea80cc2230 2024-06-13T02:26:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.507+0000 7f683b7f9740 10 client.25918 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:26:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.507+0000 7f683b7f9740 10 client.25918 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:26:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.507+0000 7f683b7f9740 20 client.25918 populate_metadata read hostname 'smithi002' 2024-06-13T02:26:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.507+0000 7f683b7f9740 1 --2- 172.21.15.2:0/185904907 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ea80d47e40 0x55ea80d4a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.507+0000 7f683b7f9740 4 client.25918 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:26:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.507+0000 7f683b7f9740 1 -- 172.21.15.2:0/185904907 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ea80c2dea0 con 0x55ea80d47e40 2024-06-13T02:26:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.507+0000 7f6831400640 1 --2- 172.21.15.2:0/185904907 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ea80d47e40 0x55ea80d4a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.507+0000 7f6831400640 1 --2- 172.21.15.2:0/185904907 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ea80d47e40 0x55ea80d4a260 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3f8866c32a42d41 server_cookie=b99886e1b31f6ee5 in_seq=0 out_seq=0 2024-06-13T02:26:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.507+0000 7f6813400640 10 client.25918 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:09.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:09 smithi175 ceph-mon[36977]: pgmap v260: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 89 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2024-06-13T02:26:09.535 INFO:tasks.workunit.client.0.smithi002.stdout: 1 603917 7.44 MB/sec execute 313 sec latency 22.225 ms 2024-06-13T02:26:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.675+0000 7f6813400640 1 -- 172.21.15.2:0/185904907 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55ea80c2dea0 con 0x55ea80d47e40 2024-06-13T02:26:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.675+0000 7f6813400640 10 client.25918 handle_command_reply: tid=0 2024-06-13T02:26:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.675+0000 7f683b7f9740 1 client.25918 shutdown 2024-06-13T02:26:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.675+0000 7f683b7f9740 1 -- 172.21.15.2:0/185904907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc2230 msgr2=0x55ea80d3ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.675+0000 7f683b7f9740 1 --2- 172.21.15.2:0/185904907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc2230 0x55ea80d3ffb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55ea80cc9850 tx=0x7f68240046c0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.676+0000 7f683b7f9740 1 -- 172.21.15.2:0/185904907 shutdown_connections 2024-06-13T02:26:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.676+0000 7f683b7f9740 1 --2- 172.21.15.2:0/185904907 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55ea80d47e40 0x55ea80d4a260 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.676+0000 7f683b7f9740 1 --2- 172.21.15.2:0/185904907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea80cccfb0 0x55ea80cd0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.676+0000 7f683b7f9740 1 --2- 172.21.15.2:0/185904907 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55ea80cc37a0 0x55ea80d404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.676+0000 7f683b7f9740 1 --2- 172.21.15.2:0/185904907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea80cc2230 0x55ea80d3ffb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.676+0000 7f683b7f9740 1 -- 172.21.15.2:0/185904907 >> 172.21.15.2:0/185904907 conn(0x55ea80c8afb0 msgr2=0x55ea80cc4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.676+0000 7f6813400640 0 client.25918 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.676+0000 7f683b7f9740 1 -- 172.21.15.2:0/185904907 shutdown_connections 2024-06-13T02:26:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.676+0000 7f683b7f9740 1 -- 172.21.15.2:0/185904907 wait complete. 2024-06-13T02:26:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.676+0000 7f683b7f9740 20 client.25918 trim_cache size 0 max 16384 2024-06-13T02:26:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:26:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:26:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:26:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.677+0000 7f6833200640 1 -- 172.21.15.2:0/1551084165 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f68180a2d60 msgr2=0x7f68180a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.677+0000 7f6833200640 1 --2- 172.21.15.2:0/1551084165 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f68180a2d60 0x7f68180a5220 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6824009fd0 tx=0x7f6824005f90 comp rx=0 tx=0).stop 2024-06-13T02:26:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.677+0000 7f6833200640 1 -- 172.21.15.2:0/1551084165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6834102180 msgr2=0x7f68340741e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.677+0000 7f6833200640 1 --2- 172.21.15.2:0/1551084165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6834102180 0x7f68340741e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f682000d950 tx=0x7f682000de10 comp rx=0 tx=0).stop 2024-06-13T02:26:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.678+0000 7f6833200640 1 -- 172.21.15.2:0/1551084165 shutdown_connections 2024-06-13T02:26:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.678+0000 7f6833200640 1 --2- 172.21.15.2:0/1551084165 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f68180a2d60 0x7f68180a5220 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.678+0000 7f6833200640 1 --2- 172.21.15.2:0/1551084165 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f68341077d0 0x7f6834074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.678+0000 7f6833200640 1 --2- 172.21.15.2:0/1551084165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6834102180 0x7f68340741e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.678+0000 7f6833200640 1 --2- 172.21.15.2:0/1551084165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68341017c0 0x7f6834073ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.678+0000 7f6833200640 1 -- 172.21.15.2:0/1551084165 >> 172.21.15.2:0/1551084165 conn(0x7f68340fd2b0 msgr2=0x7f68340fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.678+0000 7f6833200640 1 -- 172.21.15.2:0/1551084165 shutdown_connections 2024-06-13T02:26:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:09.678+0000 7f6833200640 1 -- 172.21.15.2:0/1551084165 wait complete. 2024-06-13T02:26:10.534 INFO:tasks.workunit.client.0.smithi002.stdout: 1 604751 7.42 MB/sec execute 314 sec latency 81.427 ms 2024-06-13T02:26:11.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:11 smithi002 ceph-mon[31960]: pgmap v261: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 89 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2024-06-13T02:26:11.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:11 smithi084 ceph-mon[36833]: pgmap v261: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 89 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2024-06-13T02:26:11.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:11 smithi175 ceph-mon[36977]: pgmap v261: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 89 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2024-06-13T02:26:11.535 INFO:tasks.workunit.client.0.smithi002.stdout: 1 605988 7.41 MB/sec execute 315 sec latency 27.048 ms 2024-06-13T02:26:12.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:12 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:26:12.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:12 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:26:12.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:12 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:26:12.535 INFO:tasks.workunit.client.0.smithi002.stdout: 1 607624 7.43 MB/sec execute 316 sec latency 56.806 ms 2024-06-13T02:26:13.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:13 smithi084 ceph-mon[36833]: pgmap v262: 129 pgs: 129 active+clean; 78 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 238 op/s 2024-06-13T02:26:13.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:13 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:26:13.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:13 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:26:13.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:13 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:26:13.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:13 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:26:13.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:13 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:26:13.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:13 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:26:13.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:13 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:26:13.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:13 smithi175 ceph-mon[36977]: pgmap v262: 129 pgs: 129 active+clean; 78 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 238 op/s 2024-06-13T02:26:13.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:13 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:26:13.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:13 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:26:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:13 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:26:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:13 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:26:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:13 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:26:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:13 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:26:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:13 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:26:13.535 INFO:tasks.workunit.client.0.smithi002.stdout: 1 608528 7.41 MB/sec execute 317 sec latency 20.061 ms 2024-06-13T02:26:13.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:13 smithi002 ceph-mon[31960]: pgmap v262: 129 pgs: 129 active+clean; 78 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 238 op/s 2024-06-13T02:26:13.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:13 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:26:13.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:13 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:26:13.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:13 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:26:13.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:13 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:26:13.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:13 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:26:13.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:13 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:26:13.633 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:13 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:26:14.535 INFO:tasks.workunit.client.0.smithi002.stdout: 1 609940 7.41 MB/sec execute 318 sec latency 57.412 ms 2024-06-13T02:26:14.880 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:14 smithi002 ceph-mon[31960]: osdmap e110: 12 total, 12 up, 12 in 2024-06-13T02:26:14.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:14 smithi002 ceph-mon[31960]: pgmap v264: 129 pgs: 129 active+clean; 78 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 269 op/s 2024-06-13T02:26:14.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:14 smithi084 ceph-mon[36833]: osdmap e110: 12 total, 12 up, 12 in 2024-06-13T02:26:14.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:14 smithi084 ceph-mon[36833]: pgmap v264: 129 pgs: 129 active+clean; 78 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 269 op/s 2024-06-13T02:26:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:14 smithi175 ceph-mon[36977]: osdmap e110: 12 total, 12 up, 12 in 2024-06-13T02:26:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:14 smithi175 ceph-mon[36977]: pgmap v264: 129 pgs: 129 active+clean; 78 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 269 op/s 2024-06-13T02:26:15.535 INFO:tasks.workunit.client.0.smithi002.stdout: 1 611496 7.42 MB/sec execute 319 sec latency 15.180 ms 2024-06-13T02:26:16.535 INFO:tasks.workunit.client.0.smithi002.stdout: 1 612586 7.41 MB/sec execute 320 sec latency 22.922 ms 2024-06-13T02:26:17.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:16 smithi084 ceph-mon[36833]: pgmap v265: 129 pgs: 129 active+clean; 84 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 254 op/s 2024-06-13T02:26:17.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:16 smithi175 ceph-mon[36977]: pgmap v265: 129 pgs: 129 active+clean; 84 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 254 op/s 2024-06-13T02:26:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:16 smithi002 ceph-mon[31960]: pgmap v265: 129 pgs: 129 active+clean; 84 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 254 op/s 2024-06-13T02:26:17.535 INFO:tasks.workunit.client.0.smithi002.stdout: 1 614418 7.43 MB/sec execute 321 sec latency 64.387 ms 2024-06-13T02:26:18.535 INFO:tasks.workunit.client.0.smithi002.stdout: 1 615451 7.42 MB/sec execute 322 sec latency 14.386 ms 2024-06-13T02:26:19.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:18 smithi084 ceph-mon[36833]: pgmap v266: 129 pgs: 129 active+clean; 85 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 231 op/s 2024-06-13T02:26:19.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:18 smithi175 ceph-mon[36977]: pgmap v266: 129 pgs: 129 active+clean; 85 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 231 op/s 2024-06-13T02:26:19.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:18 smithi002 ceph-mon[31960]: pgmap v266: 129 pgs: 129 active+clean; 85 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 231 op/s 2024-06-13T02:26:19.535 INFO:tasks.workunit.client.0.smithi002.stdout: 1 616815 7.41 MB/sec execute 323 sec latency 26.996 ms 2024-06-13T02:26:20.536 INFO:tasks.workunit.client.0.smithi002.stdout: 1 618539 7.43 MB/sec execute 324 sec latency 11.468 ms 2024-06-13T02:26:21.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:20 smithi084 ceph-mon[36833]: pgmap v267: 129 pgs: 129 active+clean; 85 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 231 op/s 2024-06-13T02:26:21.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:20 smithi175 ceph-mon[36977]: pgmap v267: 129 pgs: 129 active+clean; 85 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 231 op/s 2024-06-13T02:26:21.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:20 smithi002 ceph-mon[31960]: pgmap v267: 129 pgs: 129 active+clean; 85 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 231 op/s 2024-06-13T02:26:21.536 INFO:tasks.workunit.client.0.smithi002.stdout: 1 619651 7.42 MB/sec execute 325 sec latency 20.976 ms 2024-06-13T02:26:22.536 INFO:tasks.workunit.client.0.smithi002.stdout: 1 621529 7.43 MB/sec execute 326 sec latency 21.962 ms 2024-06-13T02:26:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.884+0000 7eff9fe00640 1 -- 172.21.15.2:0/2887703316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effa01099d0 msgr2=0x7effa0109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.884+0000 7eff9fe00640 1 --2- 172.21.15.2:0/2887703316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effa01099d0 0x7effa0109db0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7eff90009900 tx=0x7eff9002a3f0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.885+0000 7eff9fe00640 1 -- 172.21.15.2:0/2887703316 shutdown_connections 2024-06-13T02:26:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.885+0000 7eff9fe00640 1 --2- 172.21.15.2:0/2887703316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa0104380 0x7effa0110890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.885+0000 7eff9fe00640 1 --2- 172.21.15.2:0/2887703316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa01039c0 0x7effa0103e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.885+0000 7eff9fe00640 1 --2- 172.21.15.2:0/2887703316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effa01099d0 0x7effa0109db0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.885+0000 7eff9fe00640 1 -- 172.21.15.2:0/2887703316 >> 172.21.15.2:0/2887703316 conn(0x7effa00ff470 msgr2=0x7effa0101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.885+0000 7eff9fe00640 1 -- 172.21.15.2:0/2887703316 shutdown_connections 2024-06-13T02:26:22.887 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.885+0000 7eff9fe00640 1 -- 172.21.15.2:0/2887703316 wait complete. 2024-06-13T02:26:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.886+0000 7eff9fe00640 1 Processor -- start 2024-06-13T02:26:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.886+0000 7eff9fe00640 1 -- start start 2024-06-13T02:26:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.886+0000 7eff9fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effa01039c0 0x7effa019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.886+0000 7eff9fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa0104380 0x7effa019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa01099d0 0x7effa019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9fe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7effa0113e30 con 0x7effa01099d0 2024-06-13T02:26:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9fe00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7effa0113cb0 con 0x7effa01039c0 2024-06-13T02:26:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9fe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7effa0113fb0 con 0x7effa0104380 2024-06-13T02:26:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effa01039c0 0x7effa019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effa01039c0 0x7effa019a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:42976/0 (socket says 172.21.15.2:42976) 2024-06-13T02:26:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9ea00640 1 -- 172.21.15.2:0/382654328 learned_addr learned my addr 172.21.15.2:0/382654328 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9f400640 1 --2- 172.21.15.2:0/382654328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa01099d0 0x7effa019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9e000640 1 --2- 172.21.15.2:0/382654328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa0104380 0x7effa019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9ea00640 1 -- 172.21.15.2:0/382654328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa0104380 msgr2=0x7effa019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9ea00640 1 --2- 172.21.15.2:0/382654328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa0104380 0x7effa019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9ea00640 1 -- 172.21.15.2:0/382654328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa01099d0 msgr2=0x7effa019eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9ea00640 1 --2- 172.21.15.2:0/382654328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa01099d0 0x7effa019eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9ea00640 1 -- 172.21.15.2:0/382654328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa019f220 con 0x7effa01039c0 2024-06-13T02:26:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9e000640 1 --2- 172.21.15.2:0/382654328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa0104380 0x7effa019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:26:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.887+0000 7eff9ea00640 1 --2- 172.21.15.2:0/382654328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effa01039c0 0x7effa019a230 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7eff9002a9e0 tx=0x7eff90003b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.888+0000 7effa4a00640 1 -- 172.21.15.2:0/382654328 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9003f070 con 0x7effa01039c0 2024-06-13T02:26:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.888+0000 7effa4a00640 1 -- 172.21.15.2:0/382654328 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff90031c20 con 0x7effa01039c0 2024-06-13T02:26:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.888+0000 7effa4a00640 1 -- 172.21.15.2:0/382654328 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff90035030 con 0x7effa01039c0 2024-06-13T02:26:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.888+0000 7eff9fe00640 1 -- 172.21.15.2:0/382654328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa019f4b0 con 0x7effa01039c0 2024-06-13T02:26:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.888+0000 7eff9fe00640 1 -- 172.21.15.2:0/382654328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa01a6da0 con 0x7effa01039c0 2024-06-13T02:26:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.891+0000 7effa4a00640 1 -- 172.21.15.2:0/382654328 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7eff90042070 con 0x7effa01039c0 2024-06-13T02:26:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.891+0000 7effa8c2f740 1 Processor -- start 2024-06-13T02:26:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.892+0000 7effa8c2f740 1 -- start start 2024-06-13T02:26:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.892+0000 7effa8c2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf63a7a0 0x55c1bf638cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.892+0000 7effa8c2f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf639230 0x55c1bf6396b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.892+0000 7effa8c2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf64c7c0 0x55c1bf64ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.892+0000 7effa8c2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c1bf59d420 con 0x55c1bf64c7c0 2024-06-13T02:26:22.893 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.892+0000 7effa8c2f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c1bf544c50 con 0x55c1bf639230 2024-06-13T02:26:22.894 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.892+0000 7effa8c2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c1bf5993e0 con 0x55c1bf63a7a0 2024-06-13T02:26:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.892+0000 7eff9f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf63a7a0 0x55c1bf638cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.892+0000 7eff9ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf639230 0x55c1bf6396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.892+0000 7eff9f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf63a7a0 0x55c1bf638cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:33438/0 (socket says 172.21.15.2:33438) 2024-06-13T02:26:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.892+0000 7eff9f400640 1 -- 172.21.15.2:0/4151753048 learned_addr learned my addr 172.21.15.2:0/4151753048 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.893+0000 7eff9e000640 1 --2- 172.21.15.2:0/4151753048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf64c7c0 0x55c1bf64ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.893+0000 7eff9f400640 1 -- 172.21.15.2:0/4151753048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf639230 msgr2=0x55c1bf6396b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.893+0000 7eff9f400640 1 --2- 172.21.15.2:0/4151753048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf639230 0x55c1bf6396b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.893+0000 7eff9f400640 1 -- 172.21.15.2:0/4151753048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf64c7c0 msgr2=0x55c1bf64ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.893+0000 7eff9f400640 1 --2- 172.21.15.2:0/4151753048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf64c7c0 0x55c1bf64ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.893+0000 7eff9f400640 1 -- 172.21.15.2:0/4151753048 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1bf2b1210 con 0x55c1bf63a7a0 2024-06-13T02:26:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.893+0000 7eff9f400640 1 --2- 172.21.15.2:0/4151753048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf63a7a0 0x55c1bf638cf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7eff98007e00 tx=0x7eff9800e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5140278350c51074 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.893+0000 7effa4a00640 1 --2- 172.21.15.2:0/382654328 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7eff840a2d60 0x7eff840a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.894+0000 7effa4a00640 1 -- 172.21.15.2:0/382654328 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9583+0+0 (secure 0 0 0) 0x7eff900f0060 con 0x7effa01039c0 2024-06-13T02:26:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.894+0000 7eff8be00640 1 -- 172.21.15.2:0/4151753048 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98014070 con 0x55c1bf63a7a0 2024-06-13T02:26:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.894+0000 7eff9ea00640 1 --2- 172.21.15.2:0/382654328 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7eff840a2d60 0x7eff840a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.894+0000 7eff8be00640 1 -- 172.21.15.2:0/4151753048 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff98004d20 con 0x55c1bf63a7a0 2024-06-13T02:26:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.894+0000 7eff8be00640 1 -- 172.21.15.2:0/4151753048 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff980054e0 con 0x55c1bf63a7a0 2024-06-13T02:26:22.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.894+0000 7effa8c2f740 1 -- 172.21.15.2:0/4151753048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf63a7a0 msgr2=0x55c1bf638cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:22.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.894+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4151753048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf63a7a0 0x55c1bf638cf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7eff98007e00 tx=0x7eff9800e720 comp rx=0 tx=0).stop 2024-06-13T02:26:22.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.894+0000 7eff9ea00640 1 --2- 172.21.15.2:0/382654328 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7eff840a2d60 0x7eff840a5220 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff900ed440 tx=0x7eff900f3ba0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:22.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.895+0000 7effa8c2f740 1 -- 172.21.15.2:0/4151753048 shutdown_connections 2024-06-13T02:26:22.899 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.895+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4151753048 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf64c7c0 0x55c1bf64ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.895+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4151753048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf639230 0x55c1bf6396b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.895+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4151753048 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf63a7a0 0x55c1bf638cf0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.895+0000 7effa8c2f740 1 -- 172.21.15.2:0/4151753048 >> 172.21.15.2:0/4151753048 conn(0x55c1bf601fb0 msgr2=0x55c1bf635820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.895+0000 7effa8c2f740 1 -- 172.21.15.2:0/4151753048 shutdown_connections 2024-06-13T02:26:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.895+0000 7effa8c2f740 1 -- 172.21.15.2:0/4151753048 wait complete. 2024-06-13T02:26:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.895+0000 7effa8c2f740 1 -- start start 2024-06-13T02:26:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.895+0000 7effa8c2f740 1 Processor -- start 2024-06-13T02:26:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.896+0000 7effa8c2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf639230 0x55c1bf6465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.896+0000 7effa8c2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf63a7a0 0x55c1bf646b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.896+0000 7effa8c2f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf64c7c0 0x55c1bf641920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.896+0000 7effa8c2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c1bf63c3f0 con 0x55c1bf63a7a0 2024-06-13T02:26:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.896+0000 7effa8c2f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c1bf5580b0 con 0x55c1bf64c7c0 2024-06-13T02:26:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.896+0000 7effa8c2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c1bf63c570 con 0x55c1bf639230 2024-06-13T02:26:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.896+0000 7effa8c2f740 10 client.0 _ll_register_callbacks cb 0x55c1bf543f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:26:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.896+0000 7eff9f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf639230 0x55c1bf6465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.896+0000 7eff9e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf63a7a0 0x55c1bf646b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.896+0000 7eff9f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf639230 0x55c1bf6465c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:33444/0 (socket says 172.21.15.2:33444) 2024-06-13T02:26:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.896+0000 7eff9f400640 1 -- 172.21.15.2:0/4144163996 learned_addr learned my addr 172.21.15.2:0/4144163996 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.896+0000 7eff9f400640 1 --2- 172.21.15.2:0/4144163996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf64c7c0 0x55c1bf641920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.897+0000 7eff9e000640 1 -- 172.21.15.2:0/4144163996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf639230 msgr2=0x55c1bf6465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.897+0000 7eff9e000640 1 --2- 172.21.15.2:0/4144163996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf639230 0x55c1bf6465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.897+0000 7eff9e000640 1 -- 172.21.15.2:0/4144163996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf64c7c0 msgr2=0x55c1bf641920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.897+0000 7eff9e000640 1 --2- 172.21.15.2:0/4144163996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf64c7c0 0x55c1bf641920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.897+0000 7eff9e000640 1 -- 172.21.15.2:0/4144163996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1bf37d620 con 0x55c1bf63a7a0 2024-06-13T02:26:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.897+0000 7eff9f400640 1 --2- 172.21.15.2:0/4144163996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf639230 0x55c1bf6465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:26:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.897+0000 7eff9e000640 1 --2- 172.21.15.2:0/4144163996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf63a7a0 0x55c1bf646b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55c1bf6369b0 tx=0x7eff8c010b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3875cd989a4334cb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.897+0000 7eff88c00640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:26:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.897+0000 7eff88c00640 1 -- 172.21.15.2:0/4144163996 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c012920 con 0x55c1bf63a7a0 2024-06-13T02:26:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.898+0000 7eff88c00640 1 -- 172.21.15.2:0/4144163996 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9583+0+0 (secure 0 0 0) 0x7eff8c012ac0 con 0x55c1bf63a7a0 2024-06-13T02:26:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.898+0000 7effa8c2f740 1 -- 172.21.15.2:0/4144163996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff98004d20 con 0x55c1bf63a7a0 2024-06-13T02:26:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.898+0000 7eff88c00640 1 -- 172.21.15.2:0/4144163996 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7eff8c012cc0 con 0x55c1bf63a7a0 2024-06-13T02:26:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.898+0000 7effa8c2f740 10 client.15759 fetch_fsmap learned FSMap version 35 2024-06-13T02:26:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.898+0000 7effa8c2f740 1 -- 172.21.15.2:0/4144163996 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c1bf6641b0 con 0x55c1bf63a7a0 2024-06-13T02:26:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.898+0000 7eff88c00640 1 -- 172.21.15.2:0/4144163996 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff98004d20 con 0x55c1bf63a7a0 2024-06-13T02:26:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.898+0000 7eff88c00640 1 -- 172.21.15.2:0/4144163996 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7eff8c00f040 con 0x55c1bf63a7a0 2024-06-13T02:26:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.898+0000 7effa8c2f740 10 client.15759 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:26:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.898+0000 7effa8c2f740 10 client.15759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:26:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.898+0000 7effa8c2f740 20 client.15759 populate_metadata read hostname 'smithi002' 2024-06-13T02:26:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.898+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4144163996 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c1bf665670 0x55c1bf667a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.898+0000 7effa8c2f740 4 client.15759 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:26:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.898+0000 7effa8c2f740 1 -- 172.21.15.2:0/4144163996 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1bf5aab50 con 0x55c1bf665670 2024-06-13T02:26:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.899+0000 7eff9f400640 1 --2- 172.21.15.2:0/4144163996 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c1bf665670 0x55c1bf667a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.899+0000 7eff9f400640 1 --2- 172.21.15.2:0/4144163996 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c1bf665670 0x55c1bf667a60 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ef5d2c8bdec2a83 server_cookie=79398d3b7deb10f in_seq=0 out_seq=0 2024-06-13T02:26:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.899+0000 7eff88c00640 10 client.15759 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.900+0000 7eff88c00640 1 -- 172.21.15.2:0/4144163996 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c1bf5aab50 con 0x55c1bf665670 2024-06-13T02:26:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.900+0000 7eff88c00640 10 client.15759 handle_command_reply: tid=0 2024-06-13T02:26:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.900+0000 7effa8c2f740 1 client.15759 shutdown 2024-06-13T02:26:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.900+0000 7effa8c2f740 1 -- 172.21.15.2:0/4144163996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf63a7a0 msgr2=0x55c1bf646b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.900+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4144163996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf63a7a0 0x55c1bf646b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55c1bf6369b0 tx=0x7eff8c010b00 comp rx=0 tx=0).stop 2024-06-13T02:26:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.900+0000 7effa8c2f740 1 -- 172.21.15.2:0/4144163996 shutdown_connections 2024-06-13T02:26:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.900+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4144163996 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c1bf665670 0x55c1bf667a60 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.900+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4144163996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf64c7c0 0x55c1bf641920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.900+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4144163996 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf63a7a0 0x55c1bf646b00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.900+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4144163996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf639230 0x55c1bf6465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.900+0000 7eff88c00640 0 client.15759 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.900+0000 7effa8c2f740 1 -- 172.21.15.2:0/4144163996 >> 172.21.15.2:0/4144163996 conn(0x55c1bf601fb0 msgr2=0x55c1bf63b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.901+0000 7effa8c2f740 1 -- 172.21.15.2:0/4144163996 shutdown_connections 2024-06-13T02:26:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.901+0000 7effa8c2f740 1 -- 172.21.15.2:0/4144163996 wait complete. 2024-06-13T02:26:22.905 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.901+0000 7effa8c2f740 20 client.15759 trim_cache size 0 max 16384 2024-06-13T02:26:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.918+0000 7effa8c2f740 1 Processor -- start 2024-06-13T02:26:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.918+0000 7effa8c2f740 1 -- start start 2024-06-13T02:26:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.918+0000 7effa8c2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf639230 0x55c1bf64b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.918+0000 7effa8c2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf63a7a0 0x55c1bf66d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.918+0000 7effa8c2f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf64c7c0 0x55c1bf66d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.918+0000 7effa8c2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7effa01af540 con 0x55c1bf639230 2024-06-13T02:26:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.918+0000 7effa8c2f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7effa01ace10 con 0x55c1bf64c7c0 2024-06-13T02:26:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.918+0000 7effa8c2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7effa01aac80 con 0x55c1bf63a7a0 2024-06-13T02:26:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.918+0000 7eff9e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf63a7a0 0x55c1bf66d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.919+0000 7eff9e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf63a7a0 0x55c1bf66d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:33450/0 (socket says 172.21.15.2:33450) 2024-06-13T02:26:22.920 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.919+0000 7eff9e000640 1 -- 172.21.15.2:0/2490695404 learned_addr learned my addr 172.21.15.2:0/2490695404 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.919+0000 7eff9f400640 1 --2- 172.21.15.2:0/2490695404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf639230 0x55c1bf64b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.919+0000 7eff9f400640 1 --2- 172.21.15.2:0/2490695404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf64c7c0 0x55c1bf66d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.919+0000 7eff9e000640 1 -- 172.21.15.2:0/2490695404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf64c7c0 msgr2=0x55c1bf66d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.919+0000 7eff9e000640 1 --2- 172.21.15.2:0/2490695404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf64c7c0 0x55c1bf66d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.919+0000 7eff9e000640 1 -- 172.21.15.2:0/2490695404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf639230 msgr2=0x55c1bf64b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.919+0000 7eff9e000640 1 --2- 172.21.15.2:0/2490695404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf639230 0x55c1bf64b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.921 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.919+0000 7eff9e000640 1 -- 172.21.15.2:0/2490695404 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1bf6680c0 con 0x55c1bf63a7a0 2024-06-13T02:26:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.919+0000 7eff9e000640 1 --2- 172.21.15.2:0/2490695404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf63a7a0 0x55c1bf66d350 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009ce0 tx=0x7eff8c005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=951321e761e3a7e0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.919+0000 7eff8b400640 1 -- 172.21.15.2:0/2490695404 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c02d020 con 0x55c1bf63a7a0 2024-06-13T02:26:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.920+0000 7eff8b400640 1 -- 172.21.15.2:0/2490695404 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff8c01c830 con 0x55c1bf63a7a0 2024-06-13T02:26:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.920+0000 7eff8b400640 1 -- 172.21.15.2:0/2490695404 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c005630 con 0x55c1bf63a7a0 2024-06-13T02:26:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.920+0000 7effa8c2f740 1 -- 172.21.15.2:0/2490695404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf63a7a0 msgr2=0x55c1bf66d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:22.922 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.920+0000 7effa8c2f740 1 --2- 172.21.15.2:0/2490695404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf63a7a0 0x55c1bf66d350 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009ce0 tx=0x7eff8c005fd0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.920+0000 7effa8c2f740 1 -- 172.21.15.2:0/2490695404 shutdown_connections 2024-06-13T02:26:22.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.920+0000 7effa8c2f740 1 --2- 172.21.15.2:0/2490695404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf64c7c0 0x55c1bf66d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.920+0000 7effa8c2f740 1 --2- 172.21.15.2:0/2490695404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf63a7a0 0x55c1bf66d350 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.920+0000 7effa8c2f740 1 --2- 172.21.15.2:0/2490695404 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf639230 0x55c1bf64b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.920+0000 7effa8c2f740 1 -- 172.21.15.2:0/2490695404 >> 172.21.15.2:0/2490695404 conn(0x55c1bf601fb0 msgr2=0x55c1bf64b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:22.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.920+0000 7effa8c2f740 1 -- 172.21.15.2:0/2490695404 shutdown_connections 2024-06-13T02:26:22.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.921+0000 7effa8c2f740 1 -- 172.21.15.2:0/2490695404 wait complete. 2024-06-13T02:26:22.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.921+0000 7effa8c2f740 1 -- start start 2024-06-13T02:26:22.923 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.921+0000 7effa8c2f740 1 Processor -- start 2024-06-13T02:26:22.925 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.921+0000 7effa8c2f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf639230 0x55c1bf679440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.925 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7effa8c2f740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf63a7a0 0x55c1bf679980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.925 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7effa8c2f740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf64c7c0 0x55c1bf6749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.925 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7effa8c2f740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7effa01ab2d0 con 0x55c1bf63a7a0 2024-06-13T02:26:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7effa8c2f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7effa01ac740 con 0x55c1bf639230 2024-06-13T02:26:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7effa8c2f740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7effa01ab9a0 con 0x55c1bf64c7c0 2024-06-13T02:26:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7effa8c2f740 10 client.0 _ll_register_callbacks cb 0x7eff8c009470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:26:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7eff9f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf639230 0x55c1bf679440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7eff9f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf639230 0x55c1bf679440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:42994/0 (socket says 172.21.15.2:42994) 2024-06-13T02:26:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7eff9f400640 1 -- 172.21.15.2:0/4117692326 learned_addr learned my addr 172.21.15.2:0/4117692326 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7eff9e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf63a7a0 0x55c1bf679980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7eff9f400640 1 --2- 172.21.15.2:0/4117692326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf64c7c0 0x55c1bf6749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7eff9e000640 1 -- 172.21.15.2:0/4117692326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf64c7c0 msgr2=0x55c1bf6749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7eff9e000640 1 --2- 172.21.15.2:0/4117692326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf64c7c0 0x55c1bf6749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7eff9e000640 1 -- 172.21.15.2:0/4117692326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf639230 msgr2=0x55c1bf679440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7eff9e000640 1 --2- 172.21.15.2:0/4117692326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf639230 0x55c1bf679440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7eff9e000640 1 -- 172.21.15.2:0/4117692326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1bf675180 con 0x55c1bf63a7a0 2024-06-13T02:26:22.926 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.922+0000 7eff9f400640 1 --2- 172.21.15.2:0/4117692326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf639230 0x55c1bf679440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:26:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.923+0000 7eff9e000640 1 --2- 172.21.15.2:0/4117692326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf63a7a0 0x55c1bf679980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55c1bf642a30 tx=0x7eff8c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fac8b1a7338b26 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.923+0000 7eff88c00640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:26:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.923+0000 7eff88c00640 1 -- 172.21.15.2:0/4117692326 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0095a0 con 0x55c1bf63a7a0 2024-06-13T02:26:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.923+0000 7eff88c00640 1 -- 172.21.15.2:0/4117692326 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9583+0+0 (secure 0 0 0) 0x7eff8c01c9e0 con 0x55c1bf63a7a0 2024-06-13T02:26:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.923+0000 7effa8c2f740 1 -- 172.21.15.2:0/4117692326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff8c01c830 con 0x55c1bf63a7a0 2024-06-13T02:26:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.923+0000 7eff88c00640 1 -- 172.21.15.2:0/4117692326 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7eff8c043050 con 0x55c1bf63a7a0 2024-06-13T02:26:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.923+0000 7effa8c2f740 10 client.15765 fetch_fsmap learned FSMap version 35 2024-06-13T02:26:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.923+0000 7effa8c2f740 1 -- 172.21.15.2:0/4117692326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c1bf6cfe10 con 0x55c1bf63a7a0 2024-06-13T02:26:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.923+0000 7eff88c00640 1 -- 172.21.15.2:0/4117692326 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff8c01c830 con 0x55c1bf63a7a0 2024-06-13T02:26:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.924+0000 7eff88c00640 1 -- 172.21.15.2:0/4117692326 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7eff8c00e050 con 0x55c1bf63a7a0 2024-06-13T02:26:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.924+0000 7effa8c2f740 10 client.15765 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:26:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.924+0000 7effa8c2f740 10 client.15765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:26:22.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.924+0000 7effa8c2f740 20 client.15765 populate_metadata read hostname 'smithi002' 2024-06-13T02:26:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.924+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4117692326 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c1bf6d0420 0x55c1bf6d2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.924+0000 7effa8c2f740 4 client.15765 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:26:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.924+0000 7effa8c2f740 1 -- 172.21.15.2:0/4117692326 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c1bf5a4ea0 con 0x55c1bf6d0420 2024-06-13T02:26:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.924+0000 7eff9f400640 1 --2- 172.21.15.2:0/4117692326 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c1bf6d0420 0x55c1bf6d2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.925+0000 7eff9f400640 1 --2- 172.21.15.2:0/4117692326 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c1bf6d0420 0x55c1bf6d2810 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41b504511f89fc69 server_cookie=5c108d8f953b00a9 in_seq=0 out_seq=0 2024-06-13T02:26:22.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:22.925+0000 7eff88c00640 10 client.15765 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:23.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.148+0000 7eff88c00640 1 -- 172.21.15.2:0/4117692326 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55c1bf5a4ea0 con 0x55c1bf6d0420 2024-06-13T02:26:23.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.148+0000 7eff88c00640 10 client.15765 handle_command_reply: tid=0 2024-06-13T02:26:23.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.148+0000 7effa8c2f740 1 client.15765 shutdown 2024-06-13T02:26:23.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.148+0000 7effa8c2f740 1 -- 172.21.15.2:0/4117692326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf63a7a0 msgr2=0x55c1bf679980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:23.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.148+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4117692326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf63a7a0 0x55c1bf679980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55c1bf642a30 tx=0x7eff8c009310 comp rx=0 tx=0).stop 2024-06-13T02:26:23.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.148+0000 7effa8c2f740 1 -- 172.21.15.2:0/4117692326 shutdown_connections 2024-06-13T02:26:23.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.148+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4117692326 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c1bf6d0420 0x55c1bf6d2810 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:23.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.148+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4117692326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c1bf64c7c0 0x55c1bf6749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.148+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4117692326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c1bf63a7a0 0x55c1bf679980 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.148+0000 7effa8c2f740 1 --2- 172.21.15.2:0/4117692326 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c1bf639230 0x55c1bf679440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.148+0000 7effa8c2f740 1 -- 172.21.15.2:0/4117692326 >> 172.21.15.2:0/4117692326 conn(0x55c1bf601fb0 msgr2=0x55c1bf64bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.148+0000 7eff88c00640 0 client.15765 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.149+0000 7effa8c2f740 1 -- 172.21.15.2:0/4117692326 shutdown_connections 2024-06-13T02:26:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.149+0000 7effa8c2f740 1 -- 172.21.15.2:0/4117692326 wait complete. 2024-06-13T02:26:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.149+0000 7effa8c2f740 20 client.15765 trim_cache size 0 max 16384 2024-06-13T02:26:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:26:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:26:23.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:26:23.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.150+0000 7eff9fe00640 1 -- 172.21.15.2:0/382654328 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7eff840a2d60 msgr2=0x7eff840a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:23.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.150+0000 7eff9fe00640 1 --2- 172.21.15.2:0/382654328 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7eff840a2d60 0x7eff840a5220 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff900ed440 tx=0x7eff900f3ba0 comp rx=0 tx=0).stop 2024-06-13T02:26:23.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.150+0000 7eff9fe00640 1 -- 172.21.15.2:0/382654328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effa01039c0 msgr2=0x7effa019a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:23.152 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.150+0000 7eff9fe00640 1 --2- 172.21.15.2:0/382654328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effa01039c0 0x7effa019a230 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7eff9002a9e0 tx=0x7eff90003b60 comp rx=0 tx=0).stop 2024-06-13T02:26:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.150+0000 7eff9fe00640 1 -- 172.21.15.2:0/382654328 shutdown_connections 2024-06-13T02:26:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.150+0000 7eff9fe00640 1 --2- 172.21.15.2:0/382654328 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7eff840a2d60 0x7eff840a5220 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.150+0000 7eff9fe00640 1 --2- 172.21.15.2:0/382654328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7effa01099d0 0x7effa019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.150+0000 7eff9fe00640 1 --2- 172.21.15.2:0/382654328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effa0104380 0x7effa019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.150+0000 7eff9fe00640 1 --2- 172.21.15.2:0/382654328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7effa01039c0 0x7effa019a230 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.150+0000 7eff9fe00640 1 -- 172.21.15.2:0/382654328 >> 172.21.15.2:0/382654328 conn(0x7effa00ff470 msgr2=0x7effa00ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.150+0000 7eff9fe00640 1 -- 172.21.15.2:0/382654328 shutdown_connections 2024-06-13T02:26:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:23.150+0000 7eff9fe00640 1 -- 172.21.15.2:0/382654328 wait complete. 2024-06-13T02:26:23.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:22 smithi084 ceph-mon[36833]: pgmap v268: 129 pgs: 129 active+clean; 90 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 183 op/s 2024-06-13T02:26:23.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:22 smithi175 ceph-mon[36977]: pgmap v268: 129 pgs: 129 active+clean; 90 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 183 op/s 2024-06-13T02:26:23.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:22 smithi002 ceph-mon[31960]: pgmap v268: 129 pgs: 129 active+clean; 90 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 183 op/s 2024-06-13T02:26:23.536 INFO:tasks.workunit.client.0.smithi002.stdout: 1 622250 7.42 MB/sec execute 327 sec latency 129.975 ms 2024-06-13T02:26:24.536 INFO:tasks.workunit.client.0.smithi002.stdout: 1 623219 7.41 MB/sec execute 328 sec latency 26.311 ms 2024-06-13T02:26:25.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:24 smithi084 ceph-mon[36833]: pgmap v269: 129 pgs: 129 active+clean; 90 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 178 op/s 2024-06-13T02:26:25.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:24 smithi175 ceph-mon[36977]: pgmap v269: 129 pgs: 129 active+clean; 90 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 178 op/s 2024-06-13T02:26:25.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:24 smithi002 ceph-mon[31960]: pgmap v269: 129 pgs: 129 active+clean; 90 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 178 op/s 2024-06-13T02:26:25.536 INFO:tasks.workunit.client.0.smithi002.stdout: 1 625033 7.42 MB/sec execute 329 sec latency 25.459 ms 2024-06-13T02:26:26.536 INFO:tasks.workunit.client.0.smithi002.stdout: 1 625903 7.41 MB/sec execute 330 sec latency 22.844 ms 2024-06-13T02:26:27.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:26 smithi084 ceph-mon[36833]: pgmap v270: 129 pgs: 129 active+clean; 82 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 263 op/s 2024-06-13T02:26:27.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:26 smithi175 ceph-mon[36977]: pgmap v270: 129 pgs: 129 active+clean; 82 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 263 op/s 2024-06-13T02:26:27.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:26 smithi002 ceph-mon[31960]: pgmap v270: 129 pgs: 129 active+clean; 82 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 263 op/s 2024-06-13T02:26:27.536 INFO:tasks.workunit.client.0.smithi002.stdout: 1 626967 7.40 MB/sec execute 331 sec latency 24.271 ms 2024-06-13T02:26:28.536 INFO:tasks.workunit.client.0.smithi002.stdout: 1 628736 7.41 MB/sec execute 332 sec latency 102.721 ms 2024-06-13T02:26:29.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:28 smithi084 ceph-mon[36833]: pgmap v271: 129 pgs: 129 active+clean; 82 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 237 op/s 2024-06-13T02:26:29.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:28 smithi175 ceph-mon[36977]: pgmap v271: 129 pgs: 129 active+clean; 82 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 237 op/s 2024-06-13T02:26:29.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:28 smithi002 ceph-mon[31960]: pgmap v271: 129 pgs: 129 active+clean; 82 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 237 op/s 2024-06-13T02:26:29.537 INFO:tasks.workunit.client.0.smithi002.stdout: 1 629689 7.40 MB/sec execute 333 sec latency 18.288 ms 2024-06-13T02:26:30.537 INFO:tasks.workunit.client.0.smithi002.stdout: 1 631019 7.40 MB/sec execute 334 sec latency 28.996 ms 2024-06-13T02:26:31.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:30 smithi084 ceph-mon[36833]: pgmap v272: 129 pgs: 129 active+clean; 82 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-06-13T02:26:31.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:30 smithi175 ceph-mon[36977]: pgmap v272: 129 pgs: 129 active+clean; 82 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-06-13T02:26:31.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:30 smithi002 ceph-mon[31960]: pgmap v272: 129 pgs: 129 active+clean; 82 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-06-13T02:26:31.537 INFO:tasks.workunit.client.0.smithi002.stdout: 1 632506 7.41 MB/sec execute 335 sec latency 15.744 ms 2024-06-13T02:26:32.537 INFO:tasks.workunit.client.0.smithi002.stdout: 1 633417 7.39 MB/sec execute 336 sec latency 19.196 ms 2024-06-13T02:26:33.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:32 smithi175 ceph-mon[36977]: pgmap v273: 129 pgs: 129 active+clean; 86 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 296 op/s 2024-06-13T02:26:33.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:32 smithi002 ceph-mon[31960]: pgmap v273: 129 pgs: 129 active+clean; 86 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 296 op/s 2024-06-13T02:26:33.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:32 smithi084 ceph-mon[36833]: pgmap v273: 129 pgs: 129 active+clean; 86 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 296 op/s 2024-06-13T02:26:33.537 INFO:tasks.workunit.client.0.smithi002.stdout: 1 634591 7.39 MB/sec execute 337 sec latency 48.900 ms 2024-06-13T02:26:34.537 INFO:tasks.workunit.client.0.smithi002.stdout: 1 635959 7.40 MB/sec execute 338 sec latency 24.395 ms 2024-06-13T02:26:35.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:34 smithi175 ceph-mon[36977]: pgmap v274: 129 pgs: 129 active+clean; 86 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 1.9 MiB/s wr, 219 op/s 2024-06-13T02:26:35.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:34 smithi002 ceph-mon[31960]: pgmap v274: 129 pgs: 129 active+clean; 86 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 1.9 MiB/s wr, 219 op/s 2024-06-13T02:26:35.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:34 smithi084 ceph-mon[36833]: pgmap v274: 129 pgs: 129 active+clean; 86 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 1.9 MiB/s wr, 219 op/s 2024-06-13T02:26:35.537 INFO:tasks.workunit.client.0.smithi002.stdout: 1 636747 7.38 MB/sec execute 339 sec latency 30.885 ms 2024-06-13T02:26:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.307+0000 7f5259200640 1 -- 172.21.15.2:0/1930414455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5254100540 msgr2=0x7f525410d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.307+0000 7f5259200640 1 --2- 172.21.15.2:0/1930414455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5254100540 0x7f525410d920 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5240009860 tx=0x7f524002a340 comp rx=0 tx=0).stop 2024-06-13T02:26:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.307+0000 7f5259200640 1 -- 172.21.15.2:0/1930414455 shutdown_connections 2024-06-13T02:26:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.307+0000 7f5259200640 1 --2- 172.21.15.2:0/1930414455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f525410df90 0x7f5254110430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.307+0000 7f5259200640 1 --2- 172.21.15.2:0/1930414455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5254100540 0x7f525410d920 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.307+0000 7f5259200640 1 --2- 172.21.15.2:0/1930414455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52540ffb90 0x7f52540fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.307+0000 7f5259200640 1 -- 172.21.15.2:0/1930414455 >> 172.21.15.2:0/1930414455 conn(0x7f52540768e0 msgr2=0x7f52540fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.308+0000 7f5259200640 1 -- 172.21.15.2:0/1930414455 shutdown_connections 2024-06-13T02:26:36.310 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.308+0000 7f5259200640 1 -- 172.21.15.2:0/1930414455 wait complete. 2024-06-13T02:26:36.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.309+0000 7f5259200640 1 Processor -- start 2024-06-13T02:26:36.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.309+0000 7f5259200640 1 -- start start 2024-06-13T02:26:36.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.309+0000 7f5259200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52540ffb90 0x7f525419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.309+0000 7f5259200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f525410df90 0x7f525419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.309+0000 7f5259200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525419eaa0 0x7f525419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.309+0000 7f5259200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5254113d90 con 0x7f525419eaa0 2024-06-13T02:26:36.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.309+0000 7f5259200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5254113c10 con 0x7f52540ffb90 2024-06-13T02:26:36.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.309+0000 7f5259200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5254113f10 con 0x7f525410df90 2024-06-13T02:26:36.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.309+0000 7f5253400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52540ffb90 0x7f525419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.309+0000 7f5253400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52540ffb90 0x7f525419a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:59308/0 (socket says 172.21.15.2:59308) 2024-06-13T02:26:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.309+0000 7f5253400640 1 -- 172.21.15.2:0/3568580879 learned_addr learned my addr 172.21.15.2:0/3568580879 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.309+0000 7f5252a00640 1 --2- 172.21.15.2:0/3568580879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f525410df90 0x7f525419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.310+0000 7f5253e00640 1 --2- 172.21.15.2:0/3568580879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525419eaa0 0x7f525419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.310+0000 7f5253400640 1 -- 172.21.15.2:0/3568580879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f525410df90 msgr2=0x7f525419a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.310+0000 7f5253400640 1 --2- 172.21.15.2:0/3568580879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f525410df90 0x7f525419a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.310+0000 7f5253400640 1 -- 172.21.15.2:0/3568580879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525419eaa0 msgr2=0x7f525419ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.310+0000 7f5253400640 1 --2- 172.21.15.2:0/3568580879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525419eaa0 0x7f525419ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.310+0000 7f5253400640 1 -- 172.21.15.2:0/3568580879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525419f590 con 0x7f52540ffb90 2024-06-13T02:26:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.310+0000 7f5253e00640 1 --2- 172.21.15.2:0/3568580879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525419eaa0 0x7f525419ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:26:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.310+0000 7f5253400640 1 --2- 172.21.15.2:0/3568580879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52540ffb90 0x7f525419a230 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f524400e9f0 tx=0x7f524400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.311+0000 7f524be00640 1 -- 172.21.15.2:0/3568580879 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524400ccc0 con 0x7f52540ffb90 2024-06-13T02:26:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.311+0000 7f524be00640 1 -- 172.21.15.2:0/3568580879 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52440035f0 con 0x7f52540ffb90 2024-06-13T02:26:36.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.311+0000 7f524be00640 1 -- 172.21.15.2:0/3568580879 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524400ce60 con 0x7f52540ffb90 2024-06-13T02:26:36.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.311+0000 7f5259200640 1 -- 172.21.15.2:0/3568580879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525419f880 con 0x7f52540ffb90 2024-06-13T02:26:36.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.311+0000 7f5259200640 1 -- 172.21.15.2:0/3568580879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52541a6ff0 con 0x7f52540ffb90 2024-06-13T02:26:36.315 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.314+0000 7f524be00640 1 -- 172.21.15.2:0/3568580879 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f52440037a0 con 0x7f52540ffb90 2024-06-13T02:26:36.315 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.314+0000 7f525d7e3740 1 Processor -- start 2024-06-13T02:26:36.316 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.315+0000 7f525d7e3740 1 -- start start 2024-06-13T02:26:36.317 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.315+0000 7f525d7e3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.317 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.315+0000 7f525d7e3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a5230 0x55cd5f5a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.315+0000 7f525d7e3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.315+0000 7f525d7e3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cd5f509420 con 0x55cd5f5a5230 2024-06-13T02:26:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.315+0000 7f525d7e3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cd5f4b0c50 con 0x55cd5f5a67a0 2024-06-13T02:26:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.315+0000 7f525d7e3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cd5f5053e0 con 0x55cd5f5affb0 2024-06-13T02:26:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.315+0000 7f5253e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.315+0000 7f5253e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5a4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:59320/0 (socket says 172.21.15.2:59320) 2024-06-13T02:26:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.315+0000 7f5253e00640 1 -- 172.21.15.2:0/755942857 learned_addr learned my addr 172.21.15.2:0/755942857 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.315+0000 7f5252a00640 1 --2- 172.21.15.2:0/755942857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.316+0000 7f5253400640 1 --2- 172.21.15.2:0/755942857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a5230 0x55cd5f5a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.316+0000 7f5253e00640 1 -- 172.21.15.2:0/755942857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 msgr2=0x55cd5f5b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.316+0000 7f5253e00640 1 --2- 172.21.15.2:0/755942857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.316+0000 7f5253e00640 1 -- 172.21.15.2:0/755942857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a5230 msgr2=0x55cd5f5a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.316+0000 7f5253e00640 1 --2- 172.21.15.2:0/755942857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a5230 0x55cd5f5a56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.316+0000 7f5253e00640 1 -- 172.21.15.2:0/755942857 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd5f21d210 con 0x55cd5f5a67a0 2024-06-13T02:26:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.316+0000 7f5253400640 1 --2- 172.21.15.2:0/755942857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a5230 0x55cd5f5a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:26:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.316+0000 7f5252a00640 1 --2- 172.21.15.2:0/755942857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:26:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.316+0000 7f524be00640 1 --2- 172.21.15.2:0/3568580879 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f52380a2d60 0x7f52380a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.316+0000 7f524be00640 1 -- 172.21.15.2:0/3568580879 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9583+0+0 (secure 0 0 0) 0x7f52440cfb20 con 0x7f52540ffb90 2024-06-13T02:26:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.316+0000 7f5253e00640 1 --2- 172.21.15.2:0/755942857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5a4cf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f524c010480 tx=0x7f524c010940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46b6daae82c3d113 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.316+0000 7f5253400640 1 --2- 172.21.15.2:0/3568580879 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f52380a2d60 0x7f52380a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.317+0000 7f5248c00640 1 -- 172.21.15.2:0/755942857 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c017070 con 0x55cd5f5a67a0 2024-06-13T02:26:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.317+0000 7f5248c00640 1 -- 172.21.15.2:0/755942857 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f524c011c40 con 0x55cd5f5a67a0 2024-06-13T02:26:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.317+0000 7f5248c00640 1 -- 172.21.15.2:0/755942857 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c00ee50 con 0x55cd5f5a67a0 2024-06-13T02:26:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.318+0000 7f525d7e3740 1 -- 172.21.15.2:0/755942857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a67a0 msgr2=0x55cd5f5a4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.318+0000 7f525d7e3740 1 --2- 172.21.15.2:0/755942857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5a4cf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f524c010480 tx=0x7f524c010940 comp rx=0 tx=0).stop 2024-06-13T02:26:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.318+0000 7f5253400640 1 --2- 172.21.15.2:0/3568580879 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f52380a2d60 0x7f52380a5220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55cd5f5a7f00 tx=0x7f5244003f10 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.318+0000 7f525d7e3740 1 -- 172.21.15.2:0/755942857 shutdown_connections 2024-06-13T02:26:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.318+0000 7f525d7e3740 1 --2- 172.21.15.2:0/755942857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.318+0000 7f525d7e3740 1 --2- 172.21.15.2:0/755942857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a5230 0x55cd5f5a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.318+0000 7f525d7e3740 1 --2- 172.21.15.2:0/755942857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5a4cf0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.318+0000 7f525d7e3740 1 -- 172.21.15.2:0/755942857 >> 172.21.15.2:0/755942857 conn(0x55cd5f56dfb0 msgr2=0x55cd5f5a1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.318+0000 7f525d7e3740 1 -- 172.21.15.2:0/755942857 shutdown_connections 2024-06-13T02:26:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.318+0000 7f525d7e3740 1 -- 172.21.15.2:0/755942857 wait complete. 2024-06-13T02:26:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.318+0000 7f525d7e3740 1 -- start start 2024-06-13T02:26:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.319+0000 7f525d7e3740 1 Processor -- start 2024-06-13T02:26:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.319+0000 7f525d7e3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a5230 0x55cd5f5ad000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.319+0000 7f525d7e3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.319+0000 7f525d7e3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5ada80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.319+0000 7f525d7e3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cd5f5b2d80 con 0x55cd5f5a5230 2024-06-13T02:26:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.319+0000 7f525d7e3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cd5f4c40b0 con 0x55cd5f5a67a0 2024-06-13T02:26:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.319+0000 7f525d7e3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cd5f5b2f00 con 0x55cd5f5affb0 2024-06-13T02:26:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.319+0000 7f525d7e3740 10 client.0 _ll_register_callbacks cb 0x55cd5f4aff40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:26:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.320+0000 7f5252a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.320+0000 7f5253e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a5230 0x55cd5f5ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.320+0000 7f5252a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5ad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:59326/0 (socket says 172.21.15.2:59326) 2024-06-13T02:26:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.320+0000 7f5252a00640 1 -- 172.21.15.2:0/3201655449 learned_addr learned my addr 172.21.15.2:0/3201655449 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.320+0000 7f5253e00640 1 --2- 172.21.15.2:0/3201655449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.320+0000 7f5252a00640 1 -- 172.21.15.2:0/3201655449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 msgr2=0x55cd5f5ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.320+0000 7f5252a00640 1 --2- 172.21.15.2:0/3201655449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5ada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.320+0000 7f5252a00640 1 -- 172.21.15.2:0/3201655449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a5230 msgr2=0x55cd5f5ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.320+0000 7f5252a00640 1 --2- 172.21.15.2:0/3201655449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a5230 0x55cd5f5ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.320+0000 7f5252a00640 1 -- 172.21.15.2:0/3201655449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd5f2e9620 con 0x55cd5f5a67a0 2024-06-13T02:26:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.320+0000 7f5253e00640 1 --2- 172.21.15.2:0/3201655449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:26:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.320+0000 7f5252a00640 1 --2- 172.21.15.2:0/3201655449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5ad540 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f52400057c0 tx=0x7f52400303d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6cf556c90a89348 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.320+0000 7f523d600640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:26:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.321+0000 7f523d600640 1 -- 172.21.15.2:0/3201655449 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240037040 con 0x55cd5f5a67a0 2024-06-13T02:26:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.321+0000 7f525d7e3740 1 -- 172.21.15.2:0/3201655449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f524c011c40 con 0x55cd5f5a67a0 2024-06-13T02:26:36.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.321+0000 7f523d600640 1 -- 172.21.15.2:0/3201655449 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9583+0+0 (secure 0 0 0) 0x7f5240030550 con 0x55cd5f5a67a0 2024-06-13T02:26:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.321+0000 7f523d600640 1 -- 172.21.15.2:0/3201655449 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f524004c050 con 0x55cd5f5a67a0 2024-06-13T02:26:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.321+0000 7f525d7e3740 10 client.25961 fetch_fsmap learned FSMap version 35 2024-06-13T02:26:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.321+0000 7f525d7e3740 1 -- 172.21.15.2:0/3201655449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55cd5f5bf0e0 con 0x55cd5f5a67a0 2024-06-13T02:26:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.321+0000 7f523d600640 1 -- 172.21.15.2:0/3201655449 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f524c011c40 con 0x55cd5f5a67a0 2024-06-13T02:26:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.322+0000 7f523d600640 1 -- 172.21.15.2:0/3201655449 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f524003d450 con 0x55cd5f5a67a0 2024-06-13T02:26:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.322+0000 7f525d7e3740 10 client.25961 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:26:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.322+0000 7f525d7e3740 10 client.25961 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:26:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.322+0000 7f525d7e3740 20 client.25961 populate_metadata read hostname 'smithi002' 2024-06-13T02:26:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.322+0000 7f525d7e3740 1 --2- 172.21.15.2:0/3201655449 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd5f5c0550 0x55cd5f5c2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.322+0000 7f525d7e3740 4 client.25961 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:26:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.322+0000 7f525d7e3740 1 -- 172.21.15.2:0/3201655449 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd5f516b50 con 0x55cd5f5c0550 2024-06-13T02:26:36.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.322+0000 7f5253e00640 1 --2- 172.21.15.2:0/3201655449 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd5f5c0550 0x55cd5f5c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.323+0000 7f5253e00640 1 --2- 172.21.15.2:0/3201655449 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd5f5c0550 0x55cd5f5c2940 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32b3f0293be95fce server_cookie=e2149ee5e74918e0 in_seq=0 out_seq=0 2024-06-13T02:26:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.323+0000 7f523d600640 10 client.25961 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.324+0000 7f523d600640 1 -- 172.21.15.2:0/3201655449 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55cd5f516b50 con 0x55cd5f5c0550 2024-06-13T02:26:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.324+0000 7f523d600640 10 client.25961 handle_command_reply: tid=0 2024-06-13T02:26:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.324+0000 7f525d7e3740 1 client.25961 shutdown 2024-06-13T02:26:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.324+0000 7f525d7e3740 1 -- 172.21.15.2:0/3201655449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a67a0 msgr2=0x55cd5f5ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.324+0000 7f525d7e3740 1 --2- 172.21.15.2:0/3201655449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5ad540 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f52400057c0 tx=0x7f52400303d0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.324+0000 7f525d7e3740 1 -- 172.21.15.2:0/3201655449 shutdown_connections 2024-06-13T02:26:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.324+0000 7f525d7e3740 1 --2- 172.21.15.2:0/3201655449 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd5f5c0550 0x55cd5f5c2940 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.324+0000 7f525d7e3740 1 --2- 172.21.15.2:0/3201655449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.324+0000 7f525d7e3740 1 --2- 172.21.15.2:0/3201655449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5ad540 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.324+0000 7f525d7e3740 1 --2- 172.21.15.2:0/3201655449 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a5230 0x55cd5f5ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.324+0000 7f525d7e3740 1 -- 172.21.15.2:0/3201655449 >> 172.21.15.2:0/3201655449 conn(0x55cd5f56dfb0 msgr2=0x55cd5f5a7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:36.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.324+0000 7f523d600640 0 client.25961 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:36.329 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.325+0000 7f525d7e3740 1 -- 172.21.15.2:0/3201655449 shutdown_connections 2024-06-13T02:26:36.329 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.325+0000 7f525d7e3740 1 -- 172.21.15.2:0/3201655449 wait complete. 2024-06-13T02:26:36.329 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.325+0000 7f525d7e3740 20 client.25961 trim_cache size 0 max 16384 2024-06-13T02:26:36.348 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.346+0000 7f525d7e3740 1 Processor -- start 2024-06-13T02:26:36.348 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.346+0000 7f525d7e3740 1 -- start start 2024-06-13T02:26:36.348 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.346+0000 7f525d7e3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a5230 0x55cd5f5ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.348 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.346+0000 7f525d7e3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5c8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.348 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.346+0000 7f525d7e3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5c8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.348 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.346+0000 7f525d7e3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f52541b3920 con 0x55cd5f5a67a0 2024-06-13T02:26:36.348 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.346+0000 7f525d7e3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f52541b11f0 con 0x55cd5f5a5230 2024-06-13T02:26:36.348 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.346+0000 7f525d7e3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f52541af060 con 0x55cd5f5affb0 2024-06-13T02:26:36.348 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.347+0000 7f5253e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a5230 0x55cd5f5ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.348 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.347+0000 7f5252a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.349 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.347+0000 7f5252a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50096/0 (socket says 172.21.15.2:50096) 2024-06-13T02:26:36.349 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.347+0000 7f5252a00640 1 -- 172.21.15.2:0/1214395230 learned_addr learned my addr 172.21.15.2:0/1214395230 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.347+0000 7f5253e00640 1 --2- 172.21.15.2:0/1214395230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.348+0000 7f5253e00640 1 -- 172.21.15.2:0/1214395230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 msgr2=0x55cd5f5c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.348+0000 7f5253e00640 1 --2- 172.21.15.2:0/1214395230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.348+0000 7f5253e00640 1 -- 172.21.15.2:0/1214395230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a67a0 msgr2=0x55cd5f5c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.348+0000 7f5253e00640 1 --2- 172.21.15.2:0/1214395230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.348+0000 7f5253e00640 1 -- 172.21.15.2:0/1214395230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd5f5c2cb0 con 0x55cd5f5a5230 2024-06-13T02:26:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.348+0000 7f5252a00640 1 --2- 172.21.15.2:0/1214395230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:26:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.348+0000 7f5253e00640 1 --2- 172.21.15.2:0/1214395230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a5230 0x55cd5f5ad6d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f524c0099a0 tx=0x7f524c00e990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b08aa871fc6ba2e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.348+0000 7f523fe00640 1 -- 172.21.15.2:0/1214395230 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c020040 con 0x55cd5f5a5230 2024-06-13T02:26:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.348+0000 7f523fe00640 1 -- 172.21.15.2:0/1214395230 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f524c00ee80 con 0x55cd5f5a5230 2024-06-13T02:26:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.348+0000 7f523fe00640 1 -- 172.21.15.2:0/1214395230 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c017040 con 0x55cd5f5a5230 2024-06-13T02:26:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.349+0000 7f525d7e3740 1 -- 172.21.15.2:0/1214395230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a5230 msgr2=0x55cd5f5ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.349+0000 7f525d7e3740 1 --2- 172.21.15.2:0/1214395230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a5230 0x55cd5f5ad6d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f524c0099a0 tx=0x7f524c00e990 comp rx=0 tx=0).stop 2024-06-13T02:26:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.349+0000 7f525d7e3740 1 -- 172.21.15.2:0/1214395230 shutdown_connections 2024-06-13T02:26:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.349+0000 7f525d7e3740 1 --2- 172.21.15.2:0/1214395230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.349+0000 7f525d7e3740 1 --2- 172.21.15.2:0/1214395230 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.349+0000 7f525d7e3740 1 --2- 172.21.15.2:0/1214395230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a5230 0x55cd5f5ad6d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.349+0000 7f525d7e3740 1 -- 172.21.15.2:0/1214395230 >> 172.21.15.2:0/1214395230 conn(0x55cd5f56dfb0 msgr2=0x55cd5f5acfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.349+0000 7f525d7e3740 1 -- 172.21.15.2:0/1214395230 shutdown_connections 2024-06-13T02:26:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.349+0000 7f525d7e3740 1 -- 172.21.15.2:0/1214395230 wait complete. 2024-06-13T02:26:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.350+0000 7f525d7e3740 1 -- start start 2024-06-13T02:26:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.350+0000 7f525d7e3740 1 Processor -- start 2024-06-13T02:26:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.350+0000 7f525d7e3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a5230 0x55cd5f5b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.350+0000 7f525d7e3740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.350+0000 7f525d7e3740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.350+0000 7f525d7e3740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f52541af6b0 con 0x55cd5f5a67a0 2024-06-13T02:26:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.350+0000 7f525d7e3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f52541b0b20 con 0x55cd5f5a5230 2024-06-13T02:26:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.350+0000 7f525d7e3740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f52541afd80 con 0x55cd5f5affb0 2024-06-13T02:26:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.350+0000 7f525d7e3740 10 client.0 _ll_register_callbacks cb 0x7f5244005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:26:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.351+0000 7f5253e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a5230 0x55cd5f5b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.351+0000 7f5252a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.351+0000 7f5253e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a5230 0x55cd5f5b4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:59342/0 (socket says 172.21.15.2:59342) 2024-06-13T02:26:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.351+0000 7f5253e00640 1 -- 172.21.15.2:0/1507923613 learned_addr learned my addr 172.21.15.2:0/1507923613 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.351+0000 7f5253e00640 1 --2- 172.21.15.2:0/1507923613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.351+0000 7f5252a00640 1 -- 172.21.15.2:0/1507923613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 msgr2=0x55cd5f5b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.351+0000 7f5252a00640 1 --2- 172.21.15.2:0/1507923613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.351+0000 7f5252a00640 1 -- 172.21.15.2:0/1507923613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a5230 msgr2=0x55cd5f5b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.351+0000 7f5252a00640 1 --2- 172.21.15.2:0/1507923613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a5230 0x55cd5f5b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.351+0000 7f5252a00640 1 -- 172.21.15.2:0/1507923613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd5f62a390 con 0x55cd5f5a67a0 2024-06-13T02:26:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.351+0000 7f5253e00640 1 --2- 172.21.15.2:0/1507923613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a5230 0x55cd5f5b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:26:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.351+0000 7f5252a00640 1 --2- 172.21.15.2:0/1507923613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5b4650 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f52400303a0 tx=0x7f52400096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbcb79d16851752 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.351+0000 7f523d600640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:26:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.352+0000 7f523d600640 1 -- 172.21.15.2:0/1507923613 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240037050 con 0x55cd5f5a67a0 2024-06-13T02:26:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.352+0000 7f523d600640 1 -- 172.21.15.2:0/1507923613 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9583+0+0 (secure 0 0 0) 0x7f5240030550 con 0x55cd5f5a67a0 2024-06-13T02:26:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.352+0000 7f525d7e3740 1 -- 172.21.15.2:0/1507923613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cd5f510ea0 con 0x55cd5f5a67a0 2024-06-13T02:26:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.352+0000 7f523d600640 1 -- 172.21.15.2:0/1507923613 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5240060050 con 0x55cd5f5a67a0 2024-06-13T02:26:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.352+0000 7f525d7e3740 10 client.15780 fetch_fsmap learned FSMap version 35 2024-06-13T02:26:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.352+0000 7f525d7e3740 1 -- 172.21.15.2:0/1507923613 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55cd5f62b660 con 0x55cd5f5a67a0 2024-06-13T02:26:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.352+0000 7f523d600640 1 -- 172.21.15.2:0/1507923613 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55cd5f510ea0 con 0x55cd5f5a67a0 2024-06-13T02:26:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.353+0000 7f523d600640 1 -- 172.21.15.2:0/1507923613 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f5240030800 con 0x55cd5f5a67a0 2024-06-13T02:26:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.353+0000 7f525d7e3740 10 client.15780 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:26:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.353+0000 7f525d7e3740 10 client.15780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:26:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.353+0000 7f525d7e3740 20 client.15780 populate_metadata read hostname 'smithi002' 2024-06-13T02:26:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.353+0000 7f525d7e3740 1 --2- 172.21.15.2:0/1507923613 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd5f62bde0 0x55cd5f62e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.353+0000 7f525d7e3740 4 client.15780 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:26:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.353+0000 7f525d7e3740 1 -- 172.21.15.2:0/1507923613 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cd5f48e7a0 con 0x55cd5f62bde0 2024-06-13T02:26:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.353+0000 7f5253e00640 1 --2- 172.21.15.2:0/1507923613 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd5f62bde0 0x55cd5f62e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.353+0000 7f5253e00640 1 --2- 172.21.15.2:0/1507923613 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd5f62bde0 0x55cd5f62e200 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52205abf4bcb94b2 server_cookie=e3117b2395147dd0 in_seq=0 out_seq=0 2024-06-13T02:26:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.354+0000 7f523d600640 10 client.15780 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:36.538 INFO:tasks.workunit.client.0.smithi002.stdout: 1 637602 7.37 MB/sec execute 340 sec latency 75.674 ms 2024-06-13T02:26:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.561+0000 7f523d600640 1 -- 172.21.15.2:0/1507923613 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55cd5f48e7a0 con 0x55cd5f62bde0 2024-06-13T02:26:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.561+0000 7f523d600640 10 client.15780 handle_command_reply: tid=0 2024-06-13T02:26:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.561+0000 7f525d7e3740 1 client.15780 shutdown 2024-06-13T02:26:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.561+0000 7f525d7e3740 1 -- 172.21.15.2:0/1507923613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a67a0 msgr2=0x55cd5f5b4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.561+0000 7f525d7e3740 1 --2- 172.21.15.2:0/1507923613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5b4650 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f52400303a0 tx=0x7f52400096b0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.562+0000 7f525d7e3740 1 -- 172.21.15.2:0/1507923613 shutdown_connections 2024-06-13T02:26:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.562+0000 7f525d7e3740 1 --2- 172.21.15.2:0/1507923613 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd5f62bde0 0x55cd5f62e200 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.562+0000 7f525d7e3740 1 --2- 172.21.15.2:0/1507923613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd5f5affb0 0x55cd5f5b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.562+0000 7f525d7e3740 1 --2- 172.21.15.2:0/1507923613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd5f5a67a0 0x55cd5f5b4650 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.562+0000 7f525d7e3740 1 --2- 172.21.15.2:0/1507923613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd5f5a5230 0x55cd5f5b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.562+0000 7f523d600640 0 client.15780 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.562+0000 7f525d7e3740 1 -- 172.21.15.2:0/1507923613 >> 172.21.15.2:0/1507923613 conn(0x55cd5f56dfb0 msgr2=0x55cd5f5a7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.562+0000 7f525d7e3740 1 -- 172.21.15.2:0/1507923613 shutdown_connections 2024-06-13T02:26:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.562+0000 7f525d7e3740 1 -- 172.21.15.2:0/1507923613 wait complete. 2024-06-13T02:26:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.562+0000 7f525d7e3740 20 client.15780 trim_cache size 0 max 16384 2024-06-13T02:26:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:26:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:26:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:26:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.563+0000 7f5259200640 1 -- 172.21.15.2:0/3568580879 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f52380a2d60 msgr2=0x7f52380a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.563+0000 7f5259200640 1 --2- 172.21.15.2:0/3568580879 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f52380a2d60 0x7f52380a5220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55cd5f5a7f00 tx=0x7f5244003f10 comp rx=0 tx=0).stop 2024-06-13T02:26:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.563+0000 7f5259200640 1 -- 172.21.15.2:0/3568580879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52540ffb90 msgr2=0x7f525419a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.563+0000 7f5259200640 1 --2- 172.21.15.2:0/3568580879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52540ffb90 0x7f525419a230 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f524400e9f0 tx=0x7f524400eeb0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.563+0000 7f5259200640 1 -- 172.21.15.2:0/3568580879 shutdown_connections 2024-06-13T02:26:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.563+0000 7f5259200640 1 --2- 172.21.15.2:0/3568580879 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f52380a2d60 0x7f52380a5220 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.563+0000 7f5259200640 1 --2- 172.21.15.2:0/3568580879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f525419eaa0 0x7f525419ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.563+0000 7f5259200640 1 --2- 172.21.15.2:0/3568580879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f525410df90 0x7f525419a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.563+0000 7f5259200640 1 --2- 172.21.15.2:0/3568580879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52540ffb90 0x7f525419a230 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.563+0000 7f5259200640 1 -- 172.21.15.2:0/3568580879 >> 172.21.15.2:0/3568580879 conn(0x7f52540768e0 msgr2=0x7f52540fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.563+0000 7f5259200640 1 -- 172.21.15.2:0/3568580879 shutdown_connections 2024-06-13T02:26:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:36.563+0000 7f5259200640 1 -- 172.21.15.2:0/3568580879 wait complete. 2024-06-13T02:26:37.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:36 smithi175 ceph-mon[36977]: pgmap v275: 129 pgs: 129 active+clean; 88 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 247 op/s 2024-06-13T02:26:37.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:36 smithi002 ceph-mon[31960]: pgmap v275: 129 pgs: 129 active+clean; 88 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 247 op/s 2024-06-13T02:26:37.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:36 smithi084 ceph-mon[36833]: pgmap v275: 129 pgs: 129 active+clean; 88 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 247 op/s 2024-06-13T02:26:37.538 INFO:tasks.workunit.client.0.smithi002.stdout: 1 639339 7.39 MB/sec execute 341 sec latency 54.068 ms 2024-06-13T02:26:38.538 INFO:tasks.workunit.client.0.smithi002.stdout: 1 640159 7.37 MB/sec execute 342 sec latency 53.127 ms 2024-06-13T02:26:39.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:38 smithi175 ceph-mon[36977]: pgmap v276: 129 pgs: 129 active+clean; 91 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.7 MiB/s wr, 164 op/s 2024-06-13T02:26:39.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:38 smithi002 ceph-mon[31960]: pgmap v276: 129 pgs: 129 active+clean; 91 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.7 MiB/s wr, 164 op/s 2024-06-13T02:26:39.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:38 smithi084 ceph-mon[36833]: pgmap v276: 129 pgs: 129 active+clean; 91 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.7 MiB/s wr, 164 op/s 2024-06-13T02:26:39.538 INFO:tasks.workunit.client.0.smithi002.stdout: 1 641456 7.37 MB/sec execute 343 sec latency 23.945 ms 2024-06-13T02:26:40.538 INFO:tasks.workunit.client.0.smithi002.stdout: 1 643224 7.38 MB/sec execute 344 sec latency 17.308 ms 2024-06-13T02:26:41.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:40 smithi175 ceph-mon[36977]: pgmap v277: 129 pgs: 129 active+clean; 91 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 1.5 MiB/s wr, 128 op/s 2024-06-13T02:26:41.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:40 smithi002 ceph-mon[31960]: pgmap v277: 129 pgs: 129 active+clean; 91 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 1.5 MiB/s wr, 128 op/s 2024-06-13T02:26:41.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:40 smithi084 ceph-mon[36833]: pgmap v277: 129 pgs: 129 active+clean; 91 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 1.5 MiB/s wr, 128 op/s 2024-06-13T02:26:41.538 INFO:tasks.workunit.client.0.smithi002.stdout: 1 644306 7.38 MB/sec execute 345 sec latency 21.305 ms 2024-06-13T02:26:42.538 INFO:tasks.workunit.client.0.smithi002.stdout: 1 646162 7.38 MB/sec execute 346 sec latency 31.240 ms 2024-06-13T02:26:43.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:43 smithi175 ceph-mon[36977]: pgmap v278: 129 pgs: 129 active+clean; 87 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 249 op/s 2024-06-13T02:26:43.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:43 smithi002 ceph-mon[31960]: pgmap v278: 129 pgs: 129 active+clean; 87 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 249 op/s 2024-06-13T02:26:43.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:43 smithi084 ceph-mon[36833]: pgmap v278: 129 pgs: 129 active+clean; 87 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 249 op/s 2024-06-13T02:26:43.538 INFO:tasks.workunit.client.0.smithi002.stdout: 1 647159 7.38 MB/sec execute 347 sec latency 48.898 ms 2024-06-13T02:26:44.538 INFO:tasks.workunit.client.0.smithi002.stdout: 1 648054 7.37 MB/sec execute 348 sec latency 31.699 ms 2024-06-13T02:26:45.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:45 smithi175 ceph-mon[36977]: pgmap v279: 129 pgs: 129 active+clean; 87 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 176 op/s 2024-06-13T02:26:45.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:45 smithi002 ceph-mon[31960]: pgmap v279: 129 pgs: 129 active+clean; 87 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 176 op/s 2024-06-13T02:26:45.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:45 smithi084 ceph-mon[36833]: pgmap v279: 129 pgs: 129 active+clean; 87 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 176 op/s 2024-06-13T02:26:45.539 INFO:tasks.workunit.client.0.smithi002.stdout: 1 649629 7.37 MB/sec execute 349 sec latency 31.317 ms 2024-06-13T02:26:46.539 INFO:tasks.workunit.client.0.smithi002.stdout: 1 650567 7.37 MB/sec execute 350 sec latency 20.341 ms 2024-06-13T02:26:47.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:47 smithi175 ceph-mon[36977]: pgmap v280: 129 pgs: 129 active+clean; 89 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 219 op/s 2024-06-13T02:26:47.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:47 smithi002 ceph-mon[31960]: pgmap v280: 129 pgs: 129 active+clean; 89 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 219 op/s 2024-06-13T02:26:47.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:47 smithi084 ceph-mon[36833]: pgmap v280: 129 pgs: 129 active+clean; 89 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 219 op/s 2024-06-13T02:26:47.539 INFO:tasks.workunit.client.0.smithi002.stdout: 1 651421 7.36 MB/sec execute 351 sec latency 24.084 ms 2024-06-13T02:26:48.539 INFO:tasks.workunit.client.0.smithi002.stdout: 1 653058 7.36 MB/sec execute 352 sec latency 64.650 ms 2024-06-13T02:26:49.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:49 smithi175 ceph-mon[36977]: pgmap v281: 129 pgs: 129 active+clean; 91 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2024-06-13T02:26:49.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:49 smithi002 ceph-mon[31960]: pgmap v281: 129 pgs: 129 active+clean; 91 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2024-06-13T02:26:49.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:49 smithi084 ceph-mon[36833]: pgmap v281: 129 pgs: 129 active+clean; 91 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2024-06-13T02:26:49.539 INFO:tasks.workunit.client.0.smithi002.stdout: 1 654230 7.36 MB/sec execute 353 sec latency 16.054 ms 2024-06-13T02:26:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.721+0000 7f236d800640 1 -- 172.21.15.2:0/1672275786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23681077d0 msgr2=0x7f2368107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.721+0000 7f236d800640 1 --2- 172.21.15.2:0/1672275786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23681077d0 0x7f2368107bb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2358009900 tx=0x7f235802a3f0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.721+0000 7f236d800640 1 -- 172.21.15.2:0/1672275786 shutdown_connections 2024-06-13T02:26:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.721+0000 7f236d800640 1 --2- 172.21.15.2:0/1672275786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2368102180 0x7f236810e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.721+0000 7f236d800640 1 --2- 172.21.15.2:0/1672275786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23681017c0 0x7f2368101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.721+0000 7f236d800640 1 --2- 172.21.15.2:0/1672275786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23681077d0 0x7f2368107bb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.721+0000 7f236d800640 1 -- 172.21.15.2:0/1672275786 >> 172.21.15.2:0/1672275786 conn(0x7f23680fd2b0 msgr2=0x7f23680ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.721+0000 7f236d800640 1 -- 172.21.15.2:0/1672275786 shutdown_connections 2024-06-13T02:26:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.721+0000 7f236d800640 1 -- 172.21.15.2:0/1672275786 wait complete. 2024-06-13T02:26:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.722+0000 7f236d800640 1 Processor -- start 2024-06-13T02:26:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.723+0000 7f236d800640 1 -- start start 2024-06-13T02:26:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.723+0000 7f236d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23681017c0 0x7f23681982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.723+0000 7f236d800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2368102180 0x7f2368198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.723+0000 7f236d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f236819cb90 0x7f236819d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.723+0000 7f236d800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2368111c30 con 0x7f2368102180 2024-06-13T02:26:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.723+0000 7f236d800640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2368111ab0 con 0x7f23681017c0 2024-06-13T02:26:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.723+0000 7f236d800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2368111db0 con 0x7f236819cb90 2024-06-13T02:26:49.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.723+0000 7f236ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f236819cb90 0x7f236819d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.723+0000 7f2367e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23681017c0 0x7f23681982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.723+0000 7f235fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2368102180 0x7f2368198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.723+0000 7f236ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f236819cb90 0x7f236819d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:35856/0 (socket says 172.21.15.2:35856) 2024-06-13T02:26:49.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.723+0000 7f236ce00640 1 -- 172.21.15.2:0/3947170036 learned_addr learned my addr 172.21.15.2:0/3947170036 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:49.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.724+0000 7f236ce00640 1 -- 172.21.15.2:0/3947170036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23681017c0 msgr2=0x7f23681982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:49.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.724+0000 7f236ce00640 1 --2- 172.21.15.2:0/3947170036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23681017c0 0x7f23681982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.724+0000 7f236ce00640 1 -- 172.21.15.2:0/3947170036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2368102180 msgr2=0x7f2368198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:49.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.724+0000 7f236ce00640 1 --2- 172.21.15.2:0/3947170036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2368102180 0x7f2368198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.724+0000 7f236ce00640 1 -- 172.21.15.2:0/3947170036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236819d680 con 0x7f236819cb90 2024-06-13T02:26:49.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.724+0000 7f236ce00640 1 --2- 172.21.15.2:0/3947170036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f236819cb90 0x7f236819d040 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f236000eb10 tx=0x7f236000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:49.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.724+0000 7f2365600640 1 -- 172.21.15.2:0/3947170036 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2360004b20 con 0x7f236819cb90 2024-06-13T02:26:49.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.725+0000 7f236d800640 1 -- 172.21.15.2:0/3947170036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236819d970 con 0x7f236819cb90 2024-06-13T02:26:49.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.725+0000 7f2365600640 1 -- 172.21.15.2:0/3947170036 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2360004cc0 con 0x7f236819cb90 2024-06-13T02:26:49.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.725+0000 7f2365600640 1 -- 172.21.15.2:0/3947170036 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2360010760 con 0x7f236819cb90 2024-06-13T02:26:49.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.725+0000 7f236d800640 1 -- 172.21.15.2:0/3947170036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23681a5160 con 0x7f236819cb90 2024-06-13T02:26:49.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.729+0000 7f2371b6b740 1 Processor -- start 2024-06-13T02:26:49.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.730+0000 7f2365600640 1 -- 172.21.15.2:0/3947170036 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f2360005020 con 0x7f236819cb90 2024-06-13T02:26:49.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.730+0000 7f2371b6b740 1 -- start start 2024-06-13T02:26:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.730+0000 7f2371b6b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d07438cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.730+0000 7f2371b6b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d074396b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.730+0000 7f2371b6b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d074463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.730+0000 7f2371b6b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557d0739d420 con 0x557d07443fb0 2024-06-13T02:26:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.730+0000 7f2371b6b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557d07344c50 con 0x557d0743a7a0 2024-06-13T02:26:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.730+0000 7f2371b6b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557d073993e0 con 0x557d07439230 2024-06-13T02:26:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.730+0000 7f2367e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d074396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.731+0000 7f2367e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d074396b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:35864/0 (socket says 172.21.15.2:35864) 2024-06-13T02:26:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.731+0000 7f2367e00640 1 -- 172.21.15.2:0/2177574589 learned_addr learned my addr 172.21.15.2:0/2177574589 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.731+0000 7f235fe00640 1 --2- 172.21.15.2:0/2177574589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d074463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.731+0000 7f235fe00640 1 --2- 172.21.15.2:0/2177574589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d07438cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.731+0000 7f2367e00640 1 -- 172.21.15.2:0/2177574589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 msgr2=0x557d07438cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.731+0000 7f2367e00640 1 --2- 172.21.15.2:0/2177574589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d07438cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.731+0000 7f2367e00640 1 -- 172.21.15.2:0/2177574589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 msgr2=0x557d074463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.731+0000 7f2367e00640 1 --2- 172.21.15.2:0/2177574589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d074463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.731+0000 7f2367e00640 1 -- 172.21.15.2:0/2177574589 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d070b1210 con 0x557d07439230 2024-06-13T02:26:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.731+0000 7f235fe00640 1 --2- 172.21.15.2:0/2177574589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d074463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:26:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.731+0000 7f2365600640 1 --2- 172.21.15.2:0/3947170036 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f234c0a2d60 0x7f234c0a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.731+0000 7f2365600640 1 -- 172.21.15.2:0/3947170036 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9583+0+0 (secure 0 0 0) 0x7f23600cfd60 con 0x7f236819cb90 2024-06-13T02:26:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.731+0000 7f2367e00640 1 --2- 172.21.15.2:0/2177574589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d074396b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2358009900 tx=0x7f2358005e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5154289e131df1b1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.732+0000 7f235fe00640 1 --2- 172.21.15.2:0/3947170036 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f234c0a2d60 0x7f234c0a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.732+0000 7f235d600640 1 -- 172.21.15.2:0/2177574589 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2358040020 con 0x557d07439230 2024-06-13T02:26:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.732+0000 7f235d600640 1 -- 172.21.15.2:0/2177574589 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23580043c0 con 0x557d07439230 2024-06-13T02:26:49.737 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.732+0000 7f235d600640 1 -- 172.21.15.2:0/2177574589 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2358035040 con 0x557d07439230 2024-06-13T02:26:49.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.733+0000 7f2371b6b740 1 -- 172.21.15.2:0/2177574589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 msgr2=0x557d074396b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:49.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.733+0000 7f235fe00640 1 --2- 172.21.15.2:0/3947170036 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f234c0a2d60 0x7f234c0a5220 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x557d074369b0 tx=0x7f2350013040 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:49.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.733+0000 7f2371b6b740 1 --2- 172.21.15.2:0/2177574589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d074396b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2358009900 tx=0x7f2358005e10 comp rx=0 tx=0).stop 2024-06-13T02:26:49.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.733+0000 7f2371b6b740 1 -- 172.21.15.2:0/2177574589 shutdown_connections 2024-06-13T02:26:49.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.733+0000 7f2371b6b740 1 --2- 172.21.15.2:0/2177574589 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d074463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.733+0000 7f2371b6b740 1 --2- 172.21.15.2:0/2177574589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d074396b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.733+0000 7f2371b6b740 1 --2- 172.21.15.2:0/2177574589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d07438cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.733+0000 7f2371b6b740 1 -- 172.21.15.2:0/2177574589 >> 172.21.15.2:0/2177574589 conn(0x557d07401fb0 msgr2=0x557d07435820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.733+0000 7f2371b6b740 1 -- 172.21.15.2:0/2177574589 shutdown_connections 2024-06-13T02:26:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.733+0000 7f2371b6b740 1 -- 172.21.15.2:0/2177574589 wait complete. 2024-06-13T02:26:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.733+0000 7f2371b6b740 1 -- start start 2024-06-13T02:26:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.734+0000 7f2371b6b740 1 Processor -- start 2024-06-13T02:26:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.734+0000 7f2371b6b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d07440fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.734+0000 7f2371b6b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d07441500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.734+0000 7f2371b6b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d07441a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.734+0000 7f2371b6b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x557d07446d20 con 0x557d07443fb0 2024-06-13T02:26:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.734+0000 7f2371b6b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557d073580b0 con 0x557d0743a7a0 2024-06-13T02:26:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.734+0000 7f2371b6b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x557d07446ea0 con 0x557d07439230 2024-06-13T02:26:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.734+0000 7f2371b6b740 10 client.0 _ll_register_callbacks cb 0x557d07343f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:26:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.734+0000 7f2367e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d07440fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.734+0000 7f235fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d07441500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.740 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.735+0000 7f2367e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d07440fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:35872/0 (socket says 172.21.15.2:35872) 2024-06-13T02:26:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.735+0000 7f2367e00640 1 -- 172.21.15.2:0/3036222805 learned_addr learned my addr 172.21.15.2:0/3036222805 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.735+0000 7f236ce00640 1 --2- 172.21.15.2:0/3036222805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d07441a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.735+0000 7f2367e00640 1 -- 172.21.15.2:0/3036222805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 msgr2=0x557d07441500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.735+0000 7f2367e00640 1 --2- 172.21.15.2:0/3036222805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d07441500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.735+0000 7f2367e00640 1 -- 172.21.15.2:0/3036222805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 msgr2=0x557d07441a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.735+0000 7f2367e00640 1 --2- 172.21.15.2:0/3036222805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d07441a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.735+0000 7f2367e00640 1 -- 172.21.15.2:0/3036222805 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d0717d620 con 0x557d07439230 2024-06-13T02:26:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.735+0000 7f235fe00640 1 --2- 172.21.15.2:0/3036222805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d07441500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:26:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.735+0000 7f236ce00640 1 --2- 172.21.15.2:0/3036222805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d07441a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:26:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.735+0000 7f2367e00640 1 --2- 172.21.15.2:0/3036222805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d07440fc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2358004a60 tx=0x7f23580058c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9e6c0cfd161fe99 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.735+0000 7f2356000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:26:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.736+0000 7f2356000640 1 -- 172.21.15.2:0/3036222805 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235804e060 con 0x557d07439230 2024-06-13T02:26:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.736+0000 7f2356000640 1 -- 172.21.15.2:0/3036222805 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9583+0+0 (secure 0 0 0) 0x7f2358003800 con 0x557d07439230 2024-06-13T02:26:49.741 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.736+0000 7f2371b6b740 1 -- 172.21.15.2:0/3036222805 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23580043c0 con 0x557d07439230 2024-06-13T02:26:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.736+0000 7f2356000640 1 -- 172.21.15.2:0/3036222805 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2358055050 con 0x557d07439230 2024-06-13T02:26:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.736+0000 7f2371b6b740 10 client.25963 fetch_fsmap learned FSMap version 35 2024-06-13T02:26:49.742 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.736+0000 7f2371b6b740 1 -- 172.21.15.2:0/3036222805 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557d07446d20 con 0x557d07439230 2024-06-13T02:26:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.736+0000 7f2356000640 1 -- 172.21.15.2:0/3036222805 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23580043c0 con 0x557d07439230 2024-06-13T02:26:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.737+0000 7f2356000640 1 -- 172.21.15.2:0/3036222805 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f2358031c70 con 0x557d07439230 2024-06-13T02:26:49.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.737+0000 7f2371b6b740 10 client.25963 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:26:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.737+0000 7f2371b6b740 10 client.25963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:26:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.737+0000 7f2371b6b740 20 client.25963 populate_metadata read hostname 'smithi002' 2024-06-13T02:26:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.737+0000 7f2371b6b740 1 --2- 172.21.15.2:0/3036222805 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557d07458620 0x557d0745aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.737+0000 7f2371b6b740 4 client.25963 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:26:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.737+0000 7f2371b6b740 1 -- 172.21.15.2:0/3036222805 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d073aab50 con 0x557d07458620 2024-06-13T02:26:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.737+0000 7f235fe00640 1 --2- 172.21.15.2:0/3036222805 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557d07458620 0x557d0745aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.738+0000 7f235fe00640 1 --2- 172.21.15.2:0/3036222805 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557d07458620 0x557d0745aa10 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc777176b999d1f9 server_cookie=8e72e3baf7c0e2b7 in_seq=0 out_seq=0 2024-06-13T02:26:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.738+0000 7f2356000640 10 client.25963 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.739+0000 7f2356000640 1 -- 172.21.15.2:0/3036222805 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557d073aab50 con 0x557d07458620 2024-06-13T02:26:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.739+0000 7f2356000640 10 client.25963 handle_command_reply: tid=0 2024-06-13T02:26:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.739+0000 7f2371b6b740 1 client.25963 shutdown 2024-06-13T02:26:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.739+0000 7f2371b6b740 1 -- 172.21.15.2:0/3036222805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 msgr2=0x557d07440fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.739+0000 7f2371b6b740 1 --2- 172.21.15.2:0/3036222805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d07440fc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2358004a60 tx=0x7f23580058c0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.739+0000 7f2371b6b740 1 -- 172.21.15.2:0/3036222805 shutdown_connections 2024-06-13T02:26:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.739+0000 7f2371b6b740 1 --2- 172.21.15.2:0/3036222805 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557d07458620 0x557d0745aa10 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.739+0000 7f2371b6b740 1 --2- 172.21.15.2:0/3036222805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d07441a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.739+0000 7f2371b6b740 1 --2- 172.21.15.2:0/3036222805 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d07441500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.739+0000 7f2356000640 0 client.25963 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:49.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.739+0000 7f2371b6b740 1 --2- 172.21.15.2:0/3036222805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d07440fc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.739+0000 7f2371b6b740 1 -- 172.21.15.2:0/3036222805 >> 172.21.15.2:0/3036222805 conn(0x557d07401fb0 msgr2=0x557d0743b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:49.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.739+0000 7f2371b6b740 1 -- 172.21.15.2:0/3036222805 shutdown_connections 2024-06-13T02:26:49.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.740+0000 7f2371b6b740 1 -- 172.21.15.2:0/3036222805 wait complete. 2024-06-13T02:26:49.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.740+0000 7f2371b6b740 20 client.25963 trim_cache size 0 max 16384 2024-06-13T02:26:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.758+0000 7f2371b6b740 1 Processor -- start 2024-06-13T02:26:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.758+0000 7f2371b6b740 1 -- start start 2024-06-13T02:26:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.758+0000 7f2371b6b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d07440120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.758+0000 7f2371b6b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d07441690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.758+0000 7f2371b6b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d074453a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.758+0000 7f2371b6b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23681afa90 con 0x557d07443fb0 2024-06-13T02:26:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.758+0000 7f2371b6b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f23681ad360 con 0x557d0743a7a0 2024-06-13T02:26:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.758+0000 7f2371b6b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f23681ab1d0 con 0x557d07439230 2024-06-13T02:26:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.759+0000 7f2367e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d07440120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.759+0000 7f2367e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d07440120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:35888/0 (socket says 172.21.15.2:35888) 2024-06-13T02:26:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.759+0000 7f235fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d07441690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.759+0000 7f2367e00640 1 -- 172.21.15.2:0/1585374202 learned_addr learned my addr 172.21.15.2:0/1585374202 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.759+0000 7f236ce00640 1 --2- 172.21.15.2:0/1585374202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d074453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.759+0000 7f235fe00640 1 -- 172.21.15.2:0/1585374202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 msgr2=0x557d07440120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.759+0000 7f235fe00640 1 --2- 172.21.15.2:0/1585374202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d07440120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.759+0000 7f235fe00640 1 -- 172.21.15.2:0/1585374202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 msgr2=0x557d074453a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.759+0000 7f235fe00640 1 --2- 172.21.15.2:0/1585374202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d074453a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.759+0000 7f235fe00640 1 -- 172.21.15.2:0/1585374202 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d0743f510 con 0x557d0743a7a0 2024-06-13T02:26:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.759+0000 7f2367e00640 1 --2- 172.21.15.2:0/1585374202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d07440120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:26:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.760+0000 7f235fe00640 1 --2- 172.21.15.2:0/1585374202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d07441690 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x557d0745b0f0 tx=0x7f2350015040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f86e1b8827ee9fec server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.760+0000 7f235cc00640 1 -- 172.21.15.2:0/1585374202 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350005020 con 0x557d0743a7a0 2024-06-13T02:26:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.760+0000 7f235cc00640 1 -- 172.21.15.2:0/1585374202 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23500047a0 con 0x557d0743a7a0 2024-06-13T02:26:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.760+0000 7f235cc00640 1 -- 172.21.15.2:0/1585374202 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350022730 con 0x557d0743a7a0 2024-06-13T02:26:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.761+0000 7f2371b6b740 1 -- 172.21.15.2:0/1585374202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 msgr2=0x557d07441690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.761+0000 7f2371b6b740 1 --2- 172.21.15.2:0/1585374202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d07441690 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x557d0745b0f0 tx=0x7f2350015040 comp rx=0 tx=0).stop 2024-06-13T02:26:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.761+0000 7f2371b6b740 1 -- 172.21.15.2:0/1585374202 shutdown_connections 2024-06-13T02:26:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.761+0000 7f2371b6b740 1 --2- 172.21.15.2:0/1585374202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d074453a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.761+0000 7f2371b6b740 1 --2- 172.21.15.2:0/1585374202 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d07441690 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.761+0000 7f2371b6b740 1 --2- 172.21.15.2:0/1585374202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d07440120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.761+0000 7f2371b6b740 1 -- 172.21.15.2:0/1585374202 >> 172.21.15.2:0/1585374202 conn(0x557d07401fb0 msgr2=0x557d07440f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.761+0000 7f2371b6b740 1 -- 172.21.15.2:0/1585374202 shutdown_connections 2024-06-13T02:26:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.761+0000 7f2371b6b740 1 -- 172.21.15.2:0/1585374202 wait complete. 2024-06-13T02:26:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.761+0000 7f2371b6b740 1 -- start start 2024-06-13T02:26:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.761+0000 7f2371b6b740 1 Processor -- start 2024-06-13T02:26:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f2371b6b740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d0745f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f2371b6b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d0745f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f2371b6b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d0745fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f2371b6b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f23681ab820 con 0x557d07443fb0 2024-06-13T02:26:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f2371b6b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f23681acc90 con 0x557d0743a7a0 2024-06-13T02:26:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f2371b6b740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f23681abef0 con 0x557d07439230 2024-06-13T02:26:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f2371b6b740 10 client.0 _ll_register_callbacks cb 0x7f23500099f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:26:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f2367e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d0745f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f235fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d0745f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f236ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d0745fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f2367e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d0745f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:35896/0 (socket says 172.21.15.2:35896) 2024-06-13T02:26:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f236ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d0745fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36396/0 (socket says 172.21.15.2:36396) 2024-06-13T02:26:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f2367e00640 1 -- 172.21.15.2:0/2985528724 learned_addr learned my addr 172.21.15.2:0/2985528724 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:26:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f235fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d0745f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:45654/0 (socket says 172.21.15.2:45654) 2024-06-13T02:26:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f2367e00640 1 -- 172.21.15.2:0/2985528724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 msgr2=0x557d0745f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f2367e00640 1 --2- 172.21.15.2:0/2985528724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d0745f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f2367e00640 1 -- 172.21.15.2:0/2985528724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 msgr2=0x557d0745fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:26:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.762+0000 7f2367e00640 1 --2- 172.21.15.2:0/2985528724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d0745fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.763+0000 7f2367e00640 1 -- 172.21.15.2:0/2985528724 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d0744f7e0 con 0x557d07439230 2024-06-13T02:26:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.763+0000 7f2367e00640 1 --2- 172.21.15.2:0/2985528724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d0745f140 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2358009900 tx=0x7f2358005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27f8c5515ae228b6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:26:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.763+0000 7f2356000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:26:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.763+0000 7f2356000640 1 -- 172.21.15.2:0/2985528724 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235805e060 con 0x557d07439230 2024-06-13T02:26:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.763+0000 7f2371b6b740 1 -- 172.21.15.2:0/2985528724 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23500047a0 con 0x557d07439230 2024-06-13T02:26:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.763+0000 7f2356000640 1 -- 172.21.15.2:0/2985528724 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9583+0+0 (secure 0 0 0) 0x7f23580054f0 con 0x557d07439230 2024-06-13T02:26:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.763+0000 7f2356000640 1 -- 172.21.15.2:0/2985528724 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2358065050 con 0x557d07439230 2024-06-13T02:26:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.763+0000 7f2371b6b740 10 client.25969 fetch_fsmap learned FSMap version 35 2024-06-13T02:26:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.763+0000 7f2371b6b740 1 -- 172.21.15.2:0/2985528724 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557d07450af0 con 0x557d07439230 2024-06-13T02:26:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.764+0000 7f2356000640 1 -- 172.21.15.2:0/2985528724 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23500047a0 con 0x557d07439230 2024-06-13T02:26:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.764+0000 7f2356000640 1 -- 172.21.15.2:0/2985528724 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f235803c440 con 0x557d07439230 2024-06-13T02:26:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.764+0000 7f2371b6b740 10 client.25969 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:26:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.764+0000 7f2371b6b740 10 client.25969 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:26:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.764+0000 7f2371b6b740 20 client.25969 populate_metadata read hostname 'smithi002' 2024-06-13T02:26:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.764+0000 7f2371b6b740 1 --2- 172.21.15.2:0/2985528724 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557d074c3120 0x557d074c5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:26:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.764+0000 7f2371b6b740 4 client.25969 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:26:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.764+0000 7f2371b6b740 1 -- 172.21.15.2:0/2985528724 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557d073a4ea0 con 0x557d074c3120 2024-06-13T02:26:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.764+0000 7f235fe00640 1 --2- 172.21.15.2:0/2985528724 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557d074c3120 0x557d074c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:26:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.765+0000 7f235fe00640 1 --2- 172.21.15.2:0/2985528724 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557d074c3120 0x557d074c5510 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd35d6babe749254 server_cookie=f47fb16784b50b59 in_seq=0 out_seq=0 2024-06-13T02:26:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.765+0000 7f2356000640 10 client.25969 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.995+0000 7f2356000640 1 -- 172.21.15.2:0/2985528724 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x557d073a4ea0 con 0x557d074c3120 2024-06-13T02:26:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.995+0000 7f2356000640 10 client.25969 handle_command_reply: tid=0 2024-06-13T02:26:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.995+0000 7f2371b6b740 1 client.25969 shutdown 2024-06-13T02:26:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.995+0000 7f2371b6b740 1 -- 172.21.15.2:0/2985528724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 msgr2=0x557d0745f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.995+0000 7f2371b6b740 1 --2- 172.21.15.2:0/2985528724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d0745f140 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2358009900 tx=0x7f2358005fd0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.995+0000 7f2371b6b740 1 -- 172.21.15.2:0/2985528724 shutdown_connections 2024-06-13T02:26:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.995+0000 7f2371b6b740 1 --2- 172.21.15.2:0/2985528724 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x557d074c3120 0x557d074c5510 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.995+0000 7f2371b6b740 1 --2- 172.21.15.2:0/2985528724 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557d07443fb0 0x557d0745fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.995+0000 7f2356000640 0 client.25969 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:26:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.995+0000 7f2371b6b740 1 --2- 172.21.15.2:0/2985528724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557d0743a7a0 0x557d0745f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.995+0000 7f2371b6b740 1 --2- 172.21.15.2:0/2985528724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557d07439230 0x557d0745f140 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.995+0000 7f2371b6b740 1 -- 172.21.15.2:0/2985528724 >> 172.21.15.2:0/2985528724 conn(0x557d07401fb0 msgr2=0x557d0743ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.996+0000 7f2371b6b740 1 -- 172.21.15.2:0/2985528724 shutdown_connections 2024-06-13T02:26:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.996+0000 7f2371b6b740 1 -- 172.21.15.2:0/2985528724 wait complete. 2024-06-13T02:26:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.996+0000 7f2371b6b740 20 client.25969 trim_cache size 0 max 16384 2024-06-13T02:26:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:26:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:26:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:26:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.997+0000 7f236d800640 1 -- 172.21.15.2:0/3947170036 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f234c0a2d60 msgr2=0x7f234c0a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.997+0000 7f236d800640 1 --2- 172.21.15.2:0/3947170036 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f234c0a2d60 0x7f234c0a5220 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x557d074369b0 tx=0x7f2350013040 comp rx=0 tx=0).stop 2024-06-13T02:26:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.997+0000 7f236d800640 1 -- 172.21.15.2:0/3947170036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f236819cb90 msgr2=0x7f236819d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:26:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.997+0000 7f236d800640 1 --2- 172.21.15.2:0/3947170036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f236819cb90 0x7f236819d040 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f236000eb10 tx=0x7f236000c2d0 comp rx=0 tx=0).stop 2024-06-13T02:26:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.997+0000 7f236d800640 1 -- 172.21.15.2:0/3947170036 shutdown_connections 2024-06-13T02:26:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.997+0000 7f236d800640 1 --2- 172.21.15.2:0/3947170036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f236819cb90 0x7f236819d040 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.997+0000 7f236d800640 1 --2- 172.21.15.2:0/3947170036 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f234c0a2d60 0x7f234c0a5220 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.997+0000 7f236d800640 1 --2- 172.21.15.2:0/3947170036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2368102180 0x7f2368198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.997+0000 7f236d800640 1 --2- 172.21.15.2:0/3947170036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23681017c0 0x7f23681982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:26:50.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.997+0000 7f236d800640 1 -- 172.21.15.2:0/3947170036 >> 172.21.15.2:0/3947170036 conn(0x7f23680fd2b0 msgr2=0x7f23680fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:26:50.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.997+0000 7f236d800640 1 -- 172.21.15.2:0/3947170036 shutdown_connections 2024-06-13T02:26:50.001 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:26:49.997+0000 7f236d800640 1 -- 172.21.15.2:0/3947170036 wait complete. 2024-06-13T02:26:50.539 INFO:tasks.workunit.client.0.smithi002.stdout: 1 655251 7.35 MB/sec execute 354 sec latency 151.124 ms 2024-06-13T02:26:51.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:51 smithi175 ceph-mon[36977]: pgmap v282: 129 pgs: 129 active+clean; 91 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 1.7 MiB/s wr, 191 op/s 2024-06-13T02:26:51.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:51 smithi002 ceph-mon[31960]: pgmap v282: 129 pgs: 129 active+clean; 91 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 1.7 MiB/s wr, 191 op/s 2024-06-13T02:26:51.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:51 smithi084 ceph-mon[36833]: pgmap v282: 129 pgs: 129 active+clean; 91 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 1.7 MiB/s wr, 191 op/s 2024-06-13T02:26:51.539 INFO:tasks.workunit.client.0.smithi002.stdout: 1 657226 7.37 MB/sec execute 355 sec latency 27.330 ms 2024-06-13T02:26:52.540 INFO:tasks.workunit.client.0.smithi002.stdout: 1 658241 7.35 MB/sec execute 356 sec latency 17.085 ms 2024-06-13T02:26:53.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:53 smithi002 ceph-mon[31960]: pgmap v283: 129 pgs: 129 active+clean; 83 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 341 op/s 2024-06-13T02:26:53.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:53 smithi084 ceph-mon[36833]: pgmap v283: 129 pgs: 129 active+clean; 83 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 341 op/s 2024-06-13T02:26:53.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:53 smithi175 ceph-mon[36977]: pgmap v283: 129 pgs: 129 active+clean; 83 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 341 op/s 2024-06-13T02:26:53.540 INFO:tasks.workunit.client.0.smithi002.stdout: 1 659892 7.36 MB/sec execute 357 sec latency 57.601 ms 2024-06-13T02:26:54.540 INFO:tasks.workunit.client.0.smithi002.stdout: 1 661149 7.36 MB/sec execute 358 sec latency 20.087 ms 2024-06-13T02:26:55.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:55 smithi002 ceph-mon[31960]: pgmap v284: 129 pgs: 129 active+clean; 83 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 1.9 MiB/s wr, 219 op/s 2024-06-13T02:26:55.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:55 smithi084 ceph-mon[36833]: pgmap v284: 129 pgs: 129 active+clean; 83 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 1.9 MiB/s wr, 219 op/s 2024-06-13T02:26:55.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:55 smithi175 ceph-mon[36977]: pgmap v284: 129 pgs: 129 active+clean; 83 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 1.9 MiB/s wr, 219 op/s 2024-06-13T02:26:55.540 INFO:tasks.workunit.client.0.smithi002.stdout: 1 662225 7.35 MB/sec execute 359 sec latency 24.336 ms 2024-06-13T02:26:56.540 INFO:tasks.workunit.client.0.smithi002.stdout: 1 664148 7.37 MB/sec execute 360 sec latency 26.306 ms 2024-06-13T02:26:57.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:57 smithi002 ceph-mon[31960]: pgmap v285: 129 pgs: 129 active+clean; 87 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.7 MiB/s wr, 287 op/s 2024-06-13T02:26:57.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:57 smithi084 ceph-mon[36833]: pgmap v285: 129 pgs: 129 active+clean; 87 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.7 MiB/s wr, 287 op/s 2024-06-13T02:26:57.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:57 smithi175 ceph-mon[36977]: pgmap v285: 129 pgs: 129 active+clean; 87 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.7 MiB/s wr, 287 op/s 2024-06-13T02:26:57.540 INFO:tasks.workunit.client.0.smithi002.stdout: 1 665053 7.35 MB/sec execute 361 sec latency 60.407 ms 2024-06-13T02:26:58.540 INFO:tasks.workunit.client.0.smithi002.stdout: 1 666051 7.35 MB/sec execute 362 sec latency 67.884 ms 2024-06-13T02:26:59.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:26:59 smithi002 ceph-mon[31960]: pgmap v286: 129 pgs: 129 active+clean; 88 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 265 op/s 2024-06-13T02:26:59.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:26:59 smithi084 ceph-mon[36833]: pgmap v286: 129 pgs: 129 active+clean; 88 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 265 op/s 2024-06-13T02:26:59.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:26:59 smithi175 ceph-mon[36977]: pgmap v286: 129 pgs: 129 active+clean; 88 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 265 op/s 2024-06-13T02:26:59.540 INFO:tasks.workunit.client.0.smithi002.stdout: 1 667835 7.36 MB/sec execute 363 sec latency 30.032 ms 2024-06-13T02:27:00.541 INFO:tasks.workunit.client.0.smithi002.stdout: 1 668748 7.35 MB/sec execute 364 sec latency 16.445 ms 2024-06-13T02:27:01.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:01 smithi002 ceph-mon[31960]: pgmap v287: 129 pgs: 129 active+clean; 88 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 KiB/s rd, 1.9 MiB/s wr, 237 op/s 2024-06-13T02:27:01.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:01 smithi084 ceph-mon[36833]: pgmap v287: 129 pgs: 129 active+clean; 88 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 KiB/s rd, 1.9 MiB/s wr, 237 op/s 2024-06-13T02:27:01.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:01 smithi175 ceph-mon[36977]: pgmap v287: 129 pgs: 129 active+clean; 88 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 KiB/s rd, 1.9 MiB/s wr, 237 op/s 2024-06-13T02:27:01.540 INFO:tasks.workunit.client.0.smithi002.stdout: 1 669764 7.34 MB/sec execute 365 sec latency 42.964 ms 2024-06-13T02:27:02.541 INFO:tasks.workunit.client.0.smithi002.stdout: 1 669911 7.32 MB/sec execute 366 sec latency 141.079 ms 2024-06-13T02:27:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.153+0000 7f7f39600640 1 -- 172.21.15.2:0/4021071295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f34101990 msgr2=0x7f7f34101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.153+0000 7f7f39600640 1 --2- 172.21.15.2:0/4021071295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f34101990 0x7f7f34101e10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009900 tx=0x7f7f1c02a410 comp rx=0 tx=0).stop 2024-06-13T02:27:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.154+0000 7f7f39600640 1 -- 172.21.15.2:0/4021071295 shutdown_connections 2024-06-13T02:27:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.154+0000 7f7f39600640 1 --2- 172.21.15.2:0/4021071295 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f34102350 0x7f7f3410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.154+0000 7f7f39600640 1 --2- 172.21.15.2:0/4021071295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f34101990 0x7f7f34101e10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.154+0000 7f7f39600640 1 --2- 172.21.15.2:0/4021071295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f341079a0 0x7f7f34107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.154+0000 7f7f39600640 1 -- 172.21.15.2:0/4021071295 >> 172.21.15.2:0/4021071295 conn(0x7f7f340fd460 msgr2=0x7f7f340ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.154+0000 7f7f39600640 1 -- 172.21.15.2:0/4021071295 shutdown_connections 2024-06-13T02:27:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.154+0000 7f7f39600640 1 -- 172.21.15.2:0/4021071295 wait complete. 2024-06-13T02:27:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.155+0000 7f7f39600640 1 Processor -- start 2024-06-13T02:27:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.155+0000 7f7f39600640 1 -- start start 2024-06-13T02:27:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.155+0000 7f7f39600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f34101990 0x7f7f3419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.155+0000 7f7f39600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f34102350 0x7f7f3419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.155+0000 7f7f39600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f341079a0 0x7f7f3419ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.155+0000 7f7f39600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f34111dd0 con 0x7f7f341079a0 2024-06-13T02:27:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.155+0000 7f7f39600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7f34111c50 con 0x7f7f34102350 2024-06-13T02:27:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.155+0000 7f7f39600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7f34111f50 con 0x7f7f34101990 2024-06-13T02:27:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.156+0000 7f7f2be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f34102350 0x7f7f3419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.156+0000 7f7f33400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f341079a0 0x7f7f3419ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.156+0000 7f7f2be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f34102350 0x7f7f3419a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:59956/0 (socket says 172.21.15.2:59956) 2024-06-13T02:27:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.156+0000 7f7f2be00640 1 -- 172.21.15.2:0/2969608958 learned_addr learned my addr 172.21.15.2:0/2969608958 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.156+0000 7f7f32a00640 1 --2- 172.21.15.2:0/2969608958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f34101990 0x7f7f3419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.156+0000 7f7f2be00640 1 -- 172.21.15.2:0/2969608958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f34101990 msgr2=0x7f7f3419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.156+0000 7f7f2be00640 1 --2- 172.21.15.2:0/2969608958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f34101990 0x7f7f3419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.156+0000 7f7f2be00640 1 -- 172.21.15.2:0/2969608958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f341079a0 msgr2=0x7f7f3419ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.156+0000 7f7f2be00640 1 --2- 172.21.15.2:0/2969608958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f341079a0 0x7f7f3419ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.156+0000 7f7f2be00640 1 -- 172.21.15.2:0/2969608958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f3419f440 con 0x7f7f34102350 2024-06-13T02:27:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.156+0000 7f7f32a00640 1 --2- 172.21.15.2:0/2969608958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f34101990 0x7f7f3419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:27:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.157+0000 7f7f2be00640 1 --2- 172.21.15.2:0/2969608958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f34102350 0x7f7f3419a990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c02aa00 tx=0x7f7f1c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.157+0000 7f7f2b400640 1 -- 172.21.15.2:0/2969608958 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c03f070 con 0x7f7f34102350 2024-06-13T02:27:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.157+0000 7f7f2b400640 1 -- 172.21.15.2:0/2969608958 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f1c031c30 con 0x7f7f34102350 2024-06-13T02:27:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.157+0000 7f7f2b400640 1 -- 172.21.15.2:0/2969608958 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c035030 con 0x7f7f34102350 2024-06-13T02:27:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.157+0000 7f7f39600640 1 -- 172.21.15.2:0/2969608958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f3419f6d0 con 0x7f7f34102350 2024-06-13T02:27:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.157+0000 7f7f39600640 1 -- 172.21.15.2:0/2969608958 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f341a6fc0 con 0x7f7f34102350 2024-06-13T02:27:03.161 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.160+0000 7f7f2b400640 1 -- 172.21.15.2:0/2969608958 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f7f1c042070 con 0x7f7f34102350 2024-06-13T02:27:03.161 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.160+0000 7f7f3c400740 1 Processor -- start 2024-06-13T02:27:03.161 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.161+0000 7f7f3c400740 1 -- start start 2024-06-13T02:27:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.161+0000 7f7f3c400740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68d5e0 0x563efd68bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.161+0000 7f7f3c400740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68c070 0x563efd68c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.161+0000 7f7f3c400740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd696df0 0x563efd6991e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.161+0000 7f7f3c400740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563efd5f0420 con 0x563efd68d5e0 2024-06-13T02:27:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.161+0000 7f7f3c400740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563efd597c50 con 0x563efd68c070 2024-06-13T02:27:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.161+0000 7f7f3c400740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563efd5ec3e0 con 0x563efd696df0 2024-06-13T02:27:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.161+0000 7f7f32a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68c070 0x563efd68c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.162+0000 7f7f32a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68c070 0x563efd68c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:59962/0 (socket says 172.21.15.2:59962) 2024-06-13T02:27:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.162+0000 7f7f32a00640 1 -- 172.21.15.2:0/2803564276 learned_addr learned my addr 172.21.15.2:0/2803564276 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.162+0000 7f7f2be00640 1 --2- 172.21.15.2:0/2803564276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd696df0 0x563efd6991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.162+0000 7f7f33400640 1 --2- 172.21.15.2:0/2803564276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68d5e0 0x563efd68bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.162+0000 7f7f2b400640 1 --2- 172.21.15.2:0/2969608958 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f7f180a2d70 0x7f7f180a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.162+0000 7f7f32a00640 1 -- 172.21.15.2:0/2803564276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd696df0 msgr2=0x563efd6991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.162+0000 7f7f32a00640 1 --2- 172.21.15.2:0/2803564276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd696df0 0x563efd6991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.162+0000 7f7f32a00640 1 -- 172.21.15.2:0/2803564276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68d5e0 msgr2=0x563efd68bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.162+0000 7f7f32a00640 1 --2- 172.21.15.2:0/2803564276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68d5e0 0x563efd68bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.162+0000 7f7f32a00640 1 -- 172.21.15.2:0/2803564276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563efd304210 con 0x563efd68c070 2024-06-13T02:27:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.162+0000 7f7f33400640 1 --2- 172.21.15.2:0/2803564276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68d5e0 0x563efd68bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:27:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.162+0000 7f7f2b400640 1 -- 172.21.15.2:0/2969608958 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9583+0+0 (secure 0 0 0) 0x7f7f1c0efde0 con 0x7f7f34102350 2024-06-13T02:27:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.162+0000 7f7f33400640 1 --2- 172.21.15.2:0/2969608958 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f7f180a2d70 0x7f7f180a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.162+0000 7f7f32a00640 1 --2- 172.21.15.2:0/2803564276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68c070 0x563efd68c4f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7f24011520 tx=0x7f7f240119e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83a077f529c75e61 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:03.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.163+0000 7f7f23400640 1 -- 172.21.15.2:0/2803564276 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2401e070 con 0x563efd68c070 2024-06-13T02:27:03.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.163+0000 7f7f23400640 1 -- 172.21.15.2:0/2803564276 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f2400fac0 con 0x563efd68c070 2024-06-13T02:27:03.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.163+0000 7f7f23400640 1 -- 172.21.15.2:0/2803564276 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f24019c60 con 0x563efd68c070 2024-06-13T02:27:03.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.164+0000 7f7f3c400740 1 -- 172.21.15.2:0/2803564276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68c070 msgr2=0x563efd68c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:03.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.164+0000 7f7f3c400740 1 --2- 172.21.15.2:0/2803564276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68c070 0x563efd68c4f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7f24011520 tx=0x7f7f240119e0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.164+0000 7f7f33400640 1 --2- 172.21.15.2:0/2969608958 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f7f180a2d70 0x7f7f180a5230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c005fd0 tx=0x7f7f2c014040 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:03.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.164+0000 7f7f3c400740 1 -- 172.21.15.2:0/2803564276 shutdown_connections 2024-06-13T02:27:03.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.164+0000 7f7f3c400740 1 --2- 172.21.15.2:0/2803564276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd696df0 0x563efd6991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.164+0000 7f7f3c400740 1 --2- 172.21.15.2:0/2803564276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68c070 0x563efd68c4f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.164+0000 7f7f3c400740 1 --2- 172.21.15.2:0/2803564276 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68d5e0 0x563efd68bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.164+0000 7f7f3c400740 1 -- 172.21.15.2:0/2803564276 >> 172.21.15.2:0/2803564276 conn(0x563efd654fb0 msgr2=0x563efd688660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:03.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.164+0000 7f7f3c400740 1 -- 172.21.15.2:0/2803564276 shutdown_connections 2024-06-13T02:27:03.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.164+0000 7f7f3c400740 1 -- 172.21.15.2:0/2803564276 wait complete. 2024-06-13T02:27:03.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.164+0000 7f7f3c400740 1 -- start start 2024-06-13T02:27:03.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.165+0000 7f7f3c400740 1 Processor -- start 2024-06-13T02:27:03.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.165+0000 7f7f3c400740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd68c070 0x563efd693df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.165+0000 7f7f3c400740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68d5e0 0x563efd694330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.165+0000 7f7f3c400740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd696df0 0x563efd694870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.165+0000 7f7f3c400740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x563efd699bc0 con 0x563efd696df0 2024-06-13T02:27:03.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.165+0000 7f7f3c400740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563efd5ab0b0 con 0x563efd68d5e0 2024-06-13T02:27:03.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.165+0000 7f7f3c400740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x563efd699d40 con 0x563efd68c070 2024-06-13T02:27:03.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.165+0000 7f7f3c400740 10 client.0 _ll_register_callbacks cb 0x563efd596f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:27:03.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.165+0000 7f7f32a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd68c070 0x563efd693df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.166+0000 7f7f32a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd68c070 0x563efd693df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:60886/0 (socket says 172.21.15.2:60886) 2024-06-13T02:27:03.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.166+0000 7f7f32a00640 1 -- 172.21.15.2:0/1706495939 learned_addr learned my addr 172.21.15.2:0/1706495939 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:03.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.166+0000 7f7f2be00640 1 --2- 172.21.15.2:0/1706495939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68d5e0 0x563efd694330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.166+0000 7f7f33400640 1 --2- 172.21.15.2:0/1706495939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd696df0 0x563efd694870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.166+0000 7f7f32a00640 1 -- 172.21.15.2:0/1706495939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68d5e0 msgr2=0x563efd694330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:03.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.166+0000 7f7f32a00640 1 --2- 172.21.15.2:0/1706495939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68d5e0 0x563efd694330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.166+0000 7f7f32a00640 1 -- 172.21.15.2:0/1706495939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd696df0 msgr2=0x563efd694870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:03.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.166+0000 7f7f32a00640 1 --2- 172.21.15.2:0/1706495939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd696df0 0x563efd694870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.166+0000 7f7f32a00640 1 -- 172.21.15.2:0/1706495939 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563efd3d0620 con 0x563efd68c070 2024-06-13T02:27:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.166+0000 7f7f33400640 1 --2- 172.21.15.2:0/1706495939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd696df0 0x563efd694870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:27:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.166+0000 7f7f32a00640 1 --2- 172.21.15.2:0/1706495939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd68c070 0x563efd693df0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7f240197e0 tx=0x7f7f2400f810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=162c7de22d47a35f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.166+0000 7f7f17e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:27:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.166+0000 7f7f17e00640 1 -- 172.21.15.2:0/1706495939 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2401e040 con 0x563efd68c070 2024-06-13T02:27:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.167+0000 7f7f17e00640 1 -- 172.21.15.2:0/1706495939 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9583+0+0 (secure 0 0 0) 0x7f7f240199e0 con 0x563efd68c070 2024-06-13T02:27:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.167+0000 7f7f3c400740 1 -- 172.21.15.2:0/1706495939 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f2400fac0 con 0x563efd68c070 2024-06-13T02:27:03.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.167+0000 7f7f17e00640 1 -- 172.21.15.2:0/1706495939 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7f24019410 con 0x563efd68c070 2024-06-13T02:27:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.167+0000 7f7f3c400740 10 client.25981 fetch_fsmap learned FSMap version 35 2024-06-13T02:27:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.167+0000 7f7f3c400740 1 -- 172.21.15.2:0/1706495939 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563efd6a5f30 con 0x563efd68c070 2024-06-13T02:27:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.167+0000 7f7f17e00640 1 -- 172.21.15.2:0/1706495939 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f2400fac0 con 0x563efd68c070 2024-06-13T02:27:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.167+0000 7f7f17e00640 1 -- 172.21.15.2:0/1706495939 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f7f24021070 con 0x563efd68c070 2024-06-13T02:27:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.167+0000 7f7f3c400740 10 client.25981 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:27:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.167+0000 7f7f3c400740 10 client.25981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:27:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.167+0000 7f7f3c400740 20 client.25981 populate_metadata read hostname 'smithi002' 2024-06-13T02:27:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.168+0000 7f7f3c400740 1 --2- 172.21.15.2:0/1706495939 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563efd6a72e0 0x563efd6a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.168+0000 7f7f3c400740 4 client.25981 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:27:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.168+0000 7f7f3c400740 1 -- 172.21.15.2:0/1706495939 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563efd5fdb50 con 0x563efd6a72e0 2024-06-13T02:27:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.168+0000 7f7f2be00640 1 --2- 172.21.15.2:0/1706495939 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563efd6a72e0 0x563efd6a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.168+0000 7f7f2be00640 1 --2- 172.21.15.2:0/1706495939 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563efd6a72e0 0x563efd6a96d0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5dbfb2f232376e9 server_cookie=b91c3f2c7680d36e in_seq=0 out_seq=0 2024-06-13T02:27:03.174 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.168+0000 7f7f17e00640 10 client.25981 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.170+0000 7f7f17e00640 1 -- 172.21.15.2:0/1706495939 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563efd5fdb50 con 0x563efd6a72e0 2024-06-13T02:27:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.170+0000 7f7f17e00640 10 client.25981 handle_command_reply: tid=0 2024-06-13T02:27:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.170+0000 7f7f3c400740 1 client.25981 shutdown 2024-06-13T02:27:03.175 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.170+0000 7f7f3c400740 1 -- 172.21.15.2:0/1706495939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd68c070 msgr2=0x563efd693df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:03.176 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.170+0000 7f7f3c400740 1 --2- 172.21.15.2:0/1706495939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd68c070 0x563efd693df0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7f240197e0 tx=0x7f7f2400f810 comp rx=0 tx=0).stop 2024-06-13T02:27:03.176 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.170+0000 7f7f3c400740 1 -- 172.21.15.2:0/1706495939 shutdown_connections 2024-06-13T02:27:03.176 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.170+0000 7f7f3c400740 1 --2- 172.21.15.2:0/1706495939 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563efd6a72e0 0x563efd6a96d0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.176 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.170+0000 7f7f3c400740 1 --2- 172.21.15.2:0/1706495939 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd696df0 0x563efd694870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.176 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.170+0000 7f7f3c400740 1 --2- 172.21.15.2:0/1706495939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68d5e0 0x563efd694330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.176 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.170+0000 7f7f3c400740 1 --2- 172.21.15.2:0/1706495939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd68c070 0x563efd693df0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.176 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.170+0000 7f7f17e00640 0 client.25981 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:03.176 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.170+0000 7f7f3c400740 1 -- 172.21.15.2:0/1706495939 >> 172.21.15.2:0/1706495939 conn(0x563efd654fb0 msgr2=0x563efd68e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:03.176 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.170+0000 7f7f3c400740 1 -- 172.21.15.2:0/1706495939 shutdown_connections 2024-06-13T02:27:03.177 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.170+0000 7f7f3c400740 1 -- 172.21.15.2:0/1706495939 wait complete. 2024-06-13T02:27:03.177 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.170+0000 7f7f3c400740 20 client.25981 trim_cache size 0 max 16384 2024-06-13T02:27:03.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.192+0000 7f7f3c400740 1 Processor -- start 2024-06-13T02:27:03.192 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.192+0000 7f7f3c400740 1 -- start start 2024-06-13T02:27:03.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.193+0000 7f7f3c400740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68c070 0x563efd6944c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.193+0000 7f7f3c400740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd68d5e0 0x563efd687fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.193+0000 7f7f3c400740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd696df0 0x563efd688500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.193+0000 7f7f3c400740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f341b3c60 con 0x563efd68c070 2024-06-13T02:27:03.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.193+0000 7f7f3c400740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7f341b1530 con 0x563efd696df0 2024-06-13T02:27:03.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.193+0000 7f7f3c400740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7f341af3a0 con 0x563efd68d5e0 2024-06-13T02:27:03.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.193+0000 7f7f2be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd68d5e0 0x563efd687fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.193+0000 7f7f33400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd696df0 0x563efd688500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.194 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.193+0000 7f7f2be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd68d5e0 0x563efd687fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:60888/0 (socket says 172.21.15.2:60888) 2024-06-13T02:27:03.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.193+0000 7f7f32a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68c070 0x563efd6944c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.193+0000 7f7f2be00640 1 -- 172.21.15.2:0/2221752574 learned_addr learned my addr 172.21.15.2:0/2221752574 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:03.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.193+0000 7f7f33400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd696df0 0x563efd688500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:59980/0 (socket says 172.21.15.2:59980) 2024-06-13T02:27:03.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.194+0000 7f7f2be00640 1 -- 172.21.15.2:0/2221752574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd696df0 msgr2=0x563efd688500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:03.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.194+0000 7f7f2be00640 1 --2- 172.21.15.2:0/2221752574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd696df0 0x563efd688500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.194+0000 7f7f2be00640 1 -- 172.21.15.2:0/2221752574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68c070 msgr2=0x563efd6944c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:03.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.194+0000 7f7f2be00640 1 --2- 172.21.15.2:0/2221752574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68c070 0x563efd6944c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.194+0000 7f7f2be00640 1 -- 172.21.15.2:0/2221752574 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563efd68cb10 con 0x563efd68d5e0 2024-06-13T02:27:03.195 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.194+0000 7f7f2be00640 1 --2- 172.21.15.2:0/2221752574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd68d5e0 0x563efd687fc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c005ec0 tx=0x7f7f1c0f2230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bed73f7ccfb82214 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.194+0000 7f7f22a00640 1 -- 172.21.15.2:0/2221752574 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c049040 con 0x563efd68d5e0 2024-06-13T02:27:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.194+0000 7f7f22a00640 1 -- 172.21.15.2:0/2221752574 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f1c03b460 con 0x563efd68d5e0 2024-06-13T02:27:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.194+0000 7f7f22a00640 1 -- 172.21.15.2:0/2221752574 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0bbf30 con 0x563efd68d5e0 2024-06-13T02:27:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.195+0000 7f7f3c400740 1 -- 172.21.15.2:0/2221752574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd68d5e0 msgr2=0x563efd687fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.195+0000 7f7f3c400740 1 --2- 172.21.15.2:0/2221752574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd68d5e0 0x563efd687fc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c005ec0 tx=0x7f7f1c0f2230 comp rx=0 tx=0).stop 2024-06-13T02:27:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.195+0000 7f7f3c400740 1 -- 172.21.15.2:0/2221752574 shutdown_connections 2024-06-13T02:27:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.195+0000 7f7f3c400740 1 --2- 172.21.15.2:0/2221752574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd696df0 0x563efd688500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.195+0000 7f7f3c400740 1 --2- 172.21.15.2:0/2221752574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd68d5e0 0x563efd687fc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.195+0000 7f7f3c400740 1 --2- 172.21.15.2:0/2221752574 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68c070 0x563efd6944c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.195+0000 7f7f3c400740 1 -- 172.21.15.2:0/2221752574 >> 172.21.15.2:0/2221752574 conn(0x563efd654fb0 msgr2=0x563efd693db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.195+0000 7f7f3c400740 1 -- 172.21.15.2:0/2221752574 shutdown_connections 2024-06-13T02:27:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.195+0000 7f7f3c400740 1 -- 172.21.15.2:0/2221752574 wait complete. 2024-06-13T02:27:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.196+0000 7f7f3c400740 1 -- start start 2024-06-13T02:27:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.196+0000 7f7f3c400740 1 Processor -- start 2024-06-13T02:27:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f3c400740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68c070 0x563efd69f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f3c400740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68d5e0 0x563efd69f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f3c400740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd696df0 0x563efd690660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f3c400740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f341af9f0 con 0x563efd68c070 2024-06-13T02:27:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f3c400740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7f341b0e60 con 0x563efd68d5e0 2024-06-13T02:27:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f3c400740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7f341b00c0 con 0x563efd696df0 2024-06-13T02:27:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f3c400740 10 client.0 _ll_register_callbacks cb 0x7f7f2401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:27:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f2be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68d5e0 0x563efd69f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f2be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68d5e0 0x563efd69f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:59994/0 (socket says 172.21.15.2:59994) 2024-06-13T02:27:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f2be00640 1 -- 172.21.15.2:0/388339296 learned_addr learned my addr 172.21.15.2:0/388339296 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f33400640 1 --2- 172.21.15.2:0/388339296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd696df0 0x563efd690660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f32a00640 1 --2- 172.21.15.2:0/388339296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68c070 0x563efd69f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f2be00640 1 -- 172.21.15.2:0/388339296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd696df0 msgr2=0x563efd690660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f2be00640 1 --2- 172.21.15.2:0/388339296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd696df0 0x563efd690660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f2be00640 1 -- 172.21.15.2:0/388339296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68c070 msgr2=0x563efd69f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f2be00640 1 --2- 172.21.15.2:0/388339296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68c070 0x563efd69f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.197+0000 7f7f2be00640 1 -- 172.21.15.2:0/388339296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563efd690d50 con 0x563efd68d5e0 2024-06-13T02:27:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.198+0000 7f7f2be00640 1 --2- 172.21.15.2:0/388339296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68d5e0 0x563efd69f730 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009320 tx=0x7f7f1c0ed020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=670cc4f15279f29c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.198+0000 7f7f17e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:27:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.198+0000 7f7f17e00640 1 -- 172.21.15.2:0/388339296 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c049040 con 0x563efd68d5e0 2024-06-13T02:27:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.198+0000 7f7f3c400740 1 -- 172.21.15.2:0/388339296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563efd5f7ea0 con 0x563efd68d5e0 2024-06-13T02:27:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.198+0000 7f7f17e00640 1 -- 172.21.15.2:0/388339296 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9583+0+0 (secure 0 0 0) 0x7f7f1c0b85a0 con 0x563efd68d5e0 2024-06-13T02:27:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.198+0000 7f7f17e00640 1 -- 172.21.15.2:0/388339296 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7f1c0bbd00 con 0x563efd68d5e0 2024-06-13T02:27:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.198+0000 7f7f3c400740 10 client.26003 fetch_fsmap learned FSMap version 35 2024-06-13T02:27:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.198+0000 7f7f3c400740 1 -- 172.21.15.2:0/388339296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563efd711710 con 0x563efd68d5e0 2024-06-13T02:27:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.198+0000 7f7f17e00640 1 -- 172.21.15.2:0/388339296 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563efd5f7ea0 con 0x563efd68d5e0 2024-06-13T02:27:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.198+0000 7f7f17e00640 1 -- 172.21.15.2:0/388339296 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f7f1c0ed330 con 0x563efd68d5e0 2024-06-13T02:27:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.199+0000 7f7f3c400740 10 client.26003 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:27:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.199+0000 7f7f3c400740 10 client.26003 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:27:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.199+0000 7f7f3c400740 20 client.26003 populate_metadata read hostname 'smithi002' 2024-06-13T02:27:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.199+0000 7f7f3c400740 1 --2- 172.21.15.2:0/388339296 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563efd711db0 0x563efd7141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.199+0000 7f7f3c400740 4 client.26003 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:27:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.199+0000 7f7f3c400740 1 -- 172.21.15.2:0/388339296 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563efd5757a0 con 0x563efd711db0 2024-06-13T02:27:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.199+0000 7f7f32a00640 1 --2- 172.21.15.2:0/388339296 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563efd711db0 0x563efd7141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.199+0000 7f7f32a00640 1 --2- 172.21.15.2:0/388339296 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563efd711db0 0x563efd7141d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22292ddcf26105e server_cookie=8af075d7b5d1b0da in_seq=0 out_seq=0 2024-06-13T02:27:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.199+0000 7f7f17e00640 10 client.26003 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:03.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:03 smithi002 ceph-mon[31960]: pgmap v288: 129 pgs: 129 active+clean; 92 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 326 op/s 2024-06-13T02:27:03.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:03 smithi084 ceph-mon[36833]: pgmap v288: 129 pgs: 129 active+clean; 92 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 326 op/s 2024-06-13T02:27:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.509+0000 7f7f17e00640 1 -- 172.21.15.2:0/388339296 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x563efd5757a0 con 0x563efd711db0 2024-06-13T02:27:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.509+0000 7f7f17e00640 10 client.26003 handle_command_reply: tid=0 2024-06-13T02:27:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.509+0000 7f7f3c400740 1 client.26003 shutdown 2024-06-13T02:27:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.510+0000 7f7f3c400740 1 -- 172.21.15.2:0/388339296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68d5e0 msgr2=0x563efd69f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.510+0000 7f7f3c400740 1 --2- 172.21.15.2:0/388339296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68d5e0 0x563efd69f730 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009320 tx=0x7f7f1c0ed020 comp rx=0 tx=0).stop 2024-06-13T02:27:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.510+0000 7f7f3c400740 1 -- 172.21.15.2:0/388339296 shutdown_connections 2024-06-13T02:27:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.510+0000 7f7f3c400740 1 --2- 172.21.15.2:0/388339296 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x563efd711db0 0x563efd7141d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.510+0000 7f7f3c400740 1 --2- 172.21.15.2:0/388339296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563efd696df0 0x563efd690660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.510+0000 7f7f3c400740 1 --2- 172.21.15.2:0/388339296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563efd68d5e0 0x563efd69f730 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.510+0000 7f7f3c400740 1 --2- 172.21.15.2:0/388339296 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x563efd68c070 0x563efd69f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.510+0000 7f7f3c400740 1 -- 172.21.15.2:0/388339296 >> 172.21.15.2:0/388339296 conn(0x563efd654fb0 msgr2=0x563efd694640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.510+0000 7f7f17e00640 0 client.26003 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.510+0000 7f7f3c400740 1 -- 172.21.15.2:0/388339296 shutdown_connections 2024-06-13T02:27:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.510+0000 7f7f3c400740 1 -- 172.21.15.2:0/388339296 wait complete. 2024-06-13T02:27:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.511+0000 7f7f3c400740 20 client.26003 trim_cache size 0 max 16384 2024-06-13T02:27:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:27:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:27:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:27:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.512+0000 7f7f39600640 1 -- 172.21.15.2:0/2969608958 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f7f180a2d70 msgr2=0x7f7f180a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.512+0000 7f7f39600640 1 --2- 172.21.15.2:0/2969608958 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f7f180a2d70 0x7f7f180a5230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c005fd0 tx=0x7f7f2c014040 comp rx=0 tx=0).stop 2024-06-13T02:27:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.512+0000 7f7f39600640 1 -- 172.21.15.2:0/2969608958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f34102350 msgr2=0x7f7f3419a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.512+0000 7f7f39600640 1 --2- 172.21.15.2:0/2969608958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f34102350 0x7f7f3419a990 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c02aa00 tx=0x7f7f1c003c10 comp rx=0 tx=0).stop 2024-06-13T02:27:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.512+0000 7f7f39600640 1 -- 172.21.15.2:0/2969608958 shutdown_connections 2024-06-13T02:27:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.512+0000 7f7f39600640 1 --2- 172.21.15.2:0/2969608958 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f7f180a2d70 0x7f7f180a5230 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.512+0000 7f7f39600640 1 --2- 172.21.15.2:0/2969608958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f341079a0 0x7f7f3419ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.512+0000 7f7f39600640 1 --2- 172.21.15.2:0/2969608958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f34102350 0x7f7f3419a990 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.512+0000 7f7f39600640 1 --2- 172.21.15.2:0/2969608958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f34101990 0x7f7f3419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.512+0000 7f7f39600640 1 -- 172.21.15.2:0/2969608958 >> 172.21.15.2:0/2969608958 conn(0x7f7f340fd460 msgr2=0x7f7f3410cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.512+0000 7f7f39600640 1 -- 172.21.15.2:0/2969608958 shutdown_connections 2024-06-13T02:27:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:03.512+0000 7f7f39600640 1 -- 172.21.15.2:0/2969608958 wait complete. 2024-06-13T02:27:03.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:03 smithi175 ceph-mon[36977]: pgmap v288: 129 pgs: 129 active+clean; 92 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 326 op/s 2024-06-13T02:27:03.540 INFO:tasks.workunit.client.0.smithi002.stdout: 1 670828 7.32 MB/sec execute 367 sec latency 151.016 ms 2024-06-13T02:27:04.541 INFO:tasks.workunit.client.0.smithi002.stdout: 1 671897 7.32 MB/sec execute 368 sec latency 26.373 ms 2024-06-13T02:27:05.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:05 smithi002 ceph-mon[31960]: pgmap v289: 129 pgs: 129 active+clean; 92 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 176 op/s 2024-06-13T02:27:05.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:05 smithi084 ceph-mon[36833]: pgmap v289: 129 pgs: 129 active+clean; 92 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 176 op/s 2024-06-13T02:27:05.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:05 smithi175 ceph-mon[36977]: pgmap v289: 129 pgs: 129 active+clean; 92 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 176 op/s 2024-06-13T02:27:05.541 INFO:tasks.workunit.client.0.smithi002.stdout: 1 672683 7.31 MB/sec execute 369 sec latency 42.721 ms 2024-06-13T02:27:06.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:06 smithi002 ceph-mon[31960]: osdmap e111: 12 total, 12 up, 12 in 2024-06-13T02:27:06.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:06 smithi084 ceph-mon[36833]: osdmap e111: 12 total, 12 up, 12 in 2024-06-13T02:27:06.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:06 smithi175 ceph-mon[36977]: osdmap e111: 12 total, 12 up, 12 in 2024-06-13T02:27:06.541 INFO:tasks.workunit.client.0.smithi002.stdout: 1 673565 7.30 MB/sec execute 370 sec latency 69.291 ms 2024-06-13T02:27:07.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:07 smithi002 ceph-mon[31960]: pgmap v291: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 87 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 271 op/s 2024-06-13T02:27:07.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:07 smithi084 ceph-mon[36833]: pgmap v291: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 87 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 271 op/s 2024-06-13T02:27:07.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:07 smithi175 ceph-mon[36977]: pgmap v291: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 87 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 271 op/s 2024-06-13T02:27:07.541 INFO:tasks.workunit.client.0.smithi002.stdout: 1 674209 7.29 MB/sec execute 371 sec latency 55.939 ms 2024-06-13T02:27:08.542 INFO:tasks.workunit.client.0.smithi002.stdout: 1 675159 7.29 MB/sec execute 372 sec latency 48.621 ms 2024-06-13T02:27:09.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:09 smithi002 ceph-mon[31960]: pgmap v292: 129 pgs: 20 active+clean+snaptrim, 57 active+clean+snaptrim_wait, 52 active+clean; 87 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 300 op/s 2024-06-13T02:27:09.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:09 smithi084 ceph-mon[36833]: pgmap v292: 129 pgs: 20 active+clean+snaptrim, 57 active+clean+snaptrim_wait, 52 active+clean; 87 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 300 op/s 2024-06-13T02:27:09.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:09 smithi175 ceph-mon[36977]: pgmap v292: 129 pgs: 20 active+clean+snaptrim, 57 active+clean+snaptrim_wait, 52 active+clean; 87 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 300 op/s 2024-06-13T02:27:09.542 INFO:tasks.workunit.client.0.smithi002.stdout: 1 676167 7.28 MB/sec execute 373 sec latency 37.060 ms 2024-06-13T02:27:10.542 INFO:tasks.workunit.client.0.smithi002.stdout: 1 676545 7.26 MB/sec execute 374 sec latency 25.946 ms 2024-06-13T02:27:11.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:11 smithi002 ceph-mon[31960]: pgmap v293: 129 pgs: 20 active+clean+snaptrim, 57 active+clean+snaptrim_wait, 52 active+clean; 87 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 300 op/s 2024-06-13T02:27:11.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:11 smithi084 ceph-mon[36833]: pgmap v293: 129 pgs: 20 active+clean+snaptrim, 57 active+clean+snaptrim_wait, 52 active+clean; 87 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 300 op/s 2024-06-13T02:27:11.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:11 smithi175 ceph-mon[36977]: pgmap v293: 129 pgs: 20 active+clean+snaptrim, 57 active+clean+snaptrim_wait, 52 active+clean; 87 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 300 op/s 2024-06-13T02:27:11.542 INFO:tasks.workunit.client.0.smithi002.stdout: 1 677686 7.26 MB/sec execute 375 sec latency 22.941 ms 2024-06-13T02:27:12.542 INFO:tasks.workunit.client.0.smithi002.stdout: 1 678563 7.26 MB/sec execute 376 sec latency 89.382 ms 2024-06-13T02:27:13.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:13 smithi002 ceph-mon[31960]: pgmap v294: 129 pgs: 129 active+clean; 88 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 258 op/s 2024-06-13T02:27:13.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:13 smithi084 ceph-mon[36833]: pgmap v294: 129 pgs: 129 active+clean; 88 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 258 op/s 2024-06-13T02:27:13.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:13 smithi175 ceph-mon[36977]: pgmap v294: 129 pgs: 129 active+clean; 88 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 258 op/s 2024-06-13T02:27:13.542 INFO:tasks.workunit.client.0.smithi002.stdout: 1 679451 7.25 MB/sec execute 377 sec latency 37.278 ms 2024-06-13T02:27:14.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:14 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:27:14.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:14 smithi002 ceph-mon[31960]: osdmap e112: 12 total, 12 up, 12 in 2024-06-13T02:27:14.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:14 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:27:14.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:14 smithi084 ceph-mon[36833]: osdmap e112: 12 total, 12 up, 12 in 2024-06-13T02:27:14.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:14 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:27:14.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:14 smithi175 ceph-mon[36977]: osdmap e112: 12 total, 12 up, 12 in 2024-06-13T02:27:14.542 INFO:tasks.workunit.client.0.smithi002.stdout: 1 680777 7.24 MB/sec execute 378 sec latency 120.491 ms 2024-06-13T02:27:15.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:15 smithi002 ceph-mon[31960]: pgmap v296: 129 pgs: 129 active+clean; 88 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 293 op/s 2024-06-13T02:27:15.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:15 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:27:15.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:15 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:27:15.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:15 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:27:15.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:15 smithi084 ceph-mon[36833]: pgmap v296: 129 pgs: 129 active+clean; 88 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 293 op/s 2024-06-13T02:27:15.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:15 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:27:15.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:15 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:27:15.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:15 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:27:15.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:15 smithi175 ceph-mon[36977]: pgmap v296: 129 pgs: 129 active+clean; 88 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 293 op/s 2024-06-13T02:27:15.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:15 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:27:15.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:15 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:27:15.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:15 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:27:15.542 INFO:tasks.workunit.client.0.smithi002.stdout: 1 682169 7.25 MB/sec execute 379 sec latency 25.800 ms 2024-06-13T02:27:16.543 INFO:tasks.workunit.client.0.smithi002.stdout: 1 683108 7.24 MB/sec execute 380 sec latency 17.908 ms 2024-06-13T02:27:16.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.664+0000 7f8b37200640 1 -- 172.21.15.2:0/2736369769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b381017c0 msgr2=0x7f8b38101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:16.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.664+0000 7f8b37200640 1 --2- 172.21.15.2:0/2736369769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b381017c0 0x7f8b38101c40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009900 tx=0x7f8b2802a3f0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.664+0000 7f8b37200640 1 -- 172.21.15.2:0/2736369769 shutdown_connections 2024-06-13T02:27:16.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.664+0000 7f8b37200640 1 --2- 172.21.15.2:0/2736369769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b38102180 0x7f8b3810e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.664+0000 7f8b37200640 1 --2- 172.21.15.2:0/2736369769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b381017c0 0x7f8b38101c40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.664+0000 7f8b37200640 1 --2- 172.21.15.2:0/2736369769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b381077d0 0x7f8b38107bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.664+0000 7f8b37200640 1 -- 172.21.15.2:0/2736369769 >> 172.21.15.2:0/2736369769 conn(0x7f8b380fd2b0 msgr2=0x7f8b380ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:16.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.665+0000 7f8b37200640 1 -- 172.21.15.2:0/2736369769 shutdown_connections 2024-06-13T02:27:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.665+0000 7f8b37200640 1 -- 172.21.15.2:0/2736369769 wait complete. 2024-06-13T02:27:16.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.666+0000 7f8b37200640 1 Processor -- start 2024-06-13T02:27:16.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.666+0000 7f8b37200640 1 -- start start 2024-06-13T02:27:16.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.666+0000 7f8b37200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b381017c0 0x7f8b38073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.666+0000 7f8b37200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b38102180 0x7f8b380741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.666+0000 7f8b37200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b381077d0 0x7f8b38074720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.666+0000 7f8b37200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8b38111c30 con 0x7f8b381077d0 2024-06-13T02:27:16.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.666+0000 7f8b37200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8b38111ab0 con 0x7f8b38102180 2024-06-13T02:27:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.666+0000 7f8b37200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b38111db0 con 0x7f8b381017c0 2024-06-13T02:27:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.667+0000 7f8b35400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b38102180 0x7f8b380741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.667+0000 7f8b35400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b38102180 0x7f8b380741e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:58378/0 (socket says 172.21.15.2:58378) 2024-06-13T02:27:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.667+0000 7f8b35400640 1 -- 172.21.15.2:0/3974591075 learned_addr learned my addr 172.21.15.2:0/3974591075 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.667+0000 7f8b35e00640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b381017c0 0x7f8b38073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.667+0000 7f8b36800640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b381077d0 0x7f8b38074720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.667+0000 7f8b35e00640 1 -- 172.21.15.2:0/3974591075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b38102180 msgr2=0x7f8b380741e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.667+0000 7f8b35e00640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b38102180 0x7f8b380741e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.667+0000 7f8b35e00640 1 -- 172.21.15.2:0/3974591075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b381077d0 msgr2=0x7f8b38074720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.667+0000 7f8b35e00640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b381077d0 0x7f8b38074720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.667+0000 7f8b35e00640 1 -- 172.21.15.2:0/3974591075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b381a6550 con 0x7f8b381017c0 2024-06-13T02:27:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.667+0000 7f8b36800640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b381077d0 0x7f8b38074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:27:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.667+0000 7f8b35400640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b38102180 0x7f8b380741e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:27:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.668+0000 7f8b35e00640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b381017c0 0x7f8b38073ca0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400e9f0 tx=0x7f8b2400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.668+0000 7f8b2ea00640 1 -- 172.21.15.2:0/3974591075 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2400ccc0 con 0x7f8b381017c0 2024-06-13T02:27:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.668+0000 7f8b2ea00640 1 -- 172.21.15.2:0/3974591075 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b24010910 con 0x7f8b381017c0 2024-06-13T02:27:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.668+0000 7f8b37200640 1 -- 172.21.15.2:0/3974591075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b381a6840 con 0x7f8b381017c0 2024-06-13T02:27:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.668+0000 7f8b2ea00640 1 -- 172.21.15.2:0/3974591075 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24018960 con 0x7f8b381017c0 2024-06-13T02:27:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.668+0000 7f8b37200640 1 -- 172.21.15.2:0/3974591075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b381a6de0 con 0x7f8b381017c0 2024-06-13T02:27:16.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.671+0000 7f8b3ffb2740 1 Processor -- start 2024-06-13T02:27:16.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.672+0000 7f8b3ffb2740 1 -- start start 2024-06-13T02:27:16.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.672+0000 7f8b2ea00640 1 -- 172.21.15.2:0/3974591075 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f8b24010ac0 con 0x7f8b381017c0 2024-06-13T02:27:16.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.672+0000 7f8b3ffb2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9c7a0 0x5597dfe9acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.673 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.672+0000 7f8b3ffb2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfe9b230 0x5597dfe9b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.672+0000 7f8b3ffb2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfea5fb0 0x5597dfea83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.672+0000 7f8b3ffb2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5597dfdff420 con 0x5597dfe9b230 2024-06-13T02:27:16.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.672+0000 7f8b3ffb2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5597dfda6c50 con 0x5597dfea5fb0 2024-06-13T02:27:16.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.672+0000 7f8b3ffb2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5597dfdfb3e0 con 0x5597dfe9c7a0 2024-06-13T02:27:16.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.672+0000 7f8b35400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfea5fb0 0x5597dfea83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.674 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.672+0000 7f8b35e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfe9b230 0x5597dfe9b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.672+0000 7f8b35400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfea5fb0 0x5597dfea83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:58380/0 (socket says 172.21.15.2:58380) 2024-06-13T02:27:16.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.672+0000 7f8b35400640 1 -- 172.21.15.2:0/111833729 learned_addr learned my addr 172.21.15.2:0/111833729 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:16.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.673+0000 7f8b36800640 1 --2- 172.21.15.2:0/111833729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9c7a0 0x5597dfe9acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.673+0000 7f8b35400640 1 -- 172.21.15.2:0/111833729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9c7a0 msgr2=0x5597dfe9acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:16.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.673+0000 7f8b35400640 1 --2- 172.21.15.2:0/111833729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9c7a0 0x5597dfe9acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.673+0000 7f8b35400640 1 -- 172.21.15.2:0/111833729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfe9b230 msgr2=0x5597dfe9b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:16.676 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.673+0000 7f8b35400640 1 --2- 172.21.15.2:0/111833729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfe9b230 0x5597dfe9b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.673+0000 7f8b35400640 1 -- 172.21.15.2:0/111833729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597dfb13210 con 0x5597dfea5fb0 2024-06-13T02:27:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.673+0000 7f8b35400640 1 --2- 172.21.15.2:0/111833729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfea5fb0 0x5597dfea83a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8b28005e10 tx=0x7f8b28005e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a2e481c6049a64 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.674+0000 7f8b23400640 1 -- 172.21.15.2:0/111833729 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28035040 con 0x5597dfea5fb0 2024-06-13T02:27:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.674+0000 7f8b2ea00640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8b1c0a2d60 0x7f8b1c0a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.674+0000 7f8b23400640 1 -- 172.21.15.2:0/111833729 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b280047a0 con 0x5597dfea5fb0 2024-06-13T02:27:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.674+0000 7f8b23400640 1 -- 172.21.15.2:0/111833729 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28003ab0 con 0x5597dfea5fb0 2024-06-13T02:27:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.674+0000 7f8b2ea00640 1 -- 172.21.15.2:0/3974591075 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9583+0+0 (secure 0 0 0) 0x7f8b240cfc30 con 0x7f8b381017c0 2024-06-13T02:27:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.674+0000 7f8b36800640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8b1c0a2d60 0x7f8b1c0a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.675+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/111833729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfea5fb0 msgr2=0x5597dfea83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:16.677 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.675+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/111833729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfea5fb0 0x5597dfea83a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8b28005e10 tx=0x7f8b28005e40 comp rx=0 tx=0).stop 2024-06-13T02:27:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.675+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/111833729 shutdown_connections 2024-06-13T02:27:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.675+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/111833729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfea5fb0 0x5597dfea83a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.675+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/111833729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfe9b230 0x5597dfe9b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.675+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/111833729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9c7a0 0x5597dfe9acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.675+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/111833729 >> 172.21.15.2:0/111833729 conn(0x5597dfe63fb0 msgr2=0x5597dfe97820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.675+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/111833729 shutdown_connections 2024-06-13T02:27:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.675+0000 7f8b36800640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8b1c0a2d60 0x7f8b1c0a5220 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8b30005fd0 tx=0x7f8b30009500 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.675+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/111833729 wait complete. 2024-06-13T02:27:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.675+0000 7f8b3ffb2740 1 -- start start 2024-06-13T02:27:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.676+0000 7f8b3ffb2740 1 Processor -- start 2024-06-13T02:27:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.676+0000 7f8b3ffb2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9b230 0x5597dfea2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.676+0000 7f8b3ffb2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfe9c7a0 0x5597dfea34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.676+0000 7f8b3ffb2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfea5fb0 0x5597dfea3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.676+0000 7f8b3ffb2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5597dfea8d70 con 0x5597dfea5fb0 2024-06-13T02:27:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.676+0000 7f8b3ffb2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5597dfdba0b0 con 0x5597dfe9c7a0 2024-06-13T02:27:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.676+0000 7f8b3ffb2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5597dfea8ef0 con 0x5597dfe9b230 2024-06-13T02:27:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.676+0000 7f8b3ffb2740 10 client.0 _ll_register_callbacks cb 0x5597dfda5f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:27:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.677+0000 7f8b35e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9b230 0x5597dfea2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.677+0000 7f8b35400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfe9c7a0 0x5597dfea34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.677+0000 7f8b35e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9b230 0x5597dfea2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:40470/0 (socket says 172.21.15.2:40470) 2024-06-13T02:27:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.677+0000 7f8b35400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfe9c7a0 0x5597dfea34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:58386/0 (socket says 172.21.15.2:58386) 2024-06-13T02:27:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.677+0000 7f8b35e00640 1 -- 172.21.15.2:0/2314368277 learned_addr learned my addr 172.21.15.2:0/2314368277 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.677+0000 7f8b36800640 1 --2- 172.21.15.2:0/2314368277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfea5fb0 0x5597dfea3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.677+0000 7f8b35e00640 1 -- 172.21.15.2:0/2314368277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfe9c7a0 msgr2=0x5597dfea34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.677+0000 7f8b35e00640 1 --2- 172.21.15.2:0/2314368277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfe9c7a0 0x5597dfea34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.677+0000 7f8b35e00640 1 -- 172.21.15.2:0/2314368277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfea5fb0 msgr2=0x5597dfea3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.677+0000 7f8b35e00640 1 --2- 172.21.15.2:0/2314368277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfea5fb0 0x5597dfea3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.677+0000 7f8b35e00640 1 -- 172.21.15.2:0/2314368277 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597dfbdf620 con 0x5597dfe9b230 2024-06-13T02:27:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.677+0000 7f8b35400640 1 --2- 172.21.15.2:0/2314368277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfe9c7a0 0x5597dfea34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:27:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.677+0000 7f8b36800640 1 --2- 172.21.15.2:0/2314368277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfea5fb0 0x5597dfea3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:27:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.677+0000 7f8b35e00640 1 --2- 172.21.15.2:0/2314368277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9b230 0x5597dfea2f90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400c6a0 tx=0x7f8b24098030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89d26d4404bfba92 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.677+0000 7f8b17e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:27:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.678+0000 7f8b17e00640 1 -- 172.21.15.2:0/2314368277 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2409b630 con 0x5597dfe9b230 2024-06-13T02:27:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.678+0000 7f8b17e00640 1 -- 172.21.15.2:0/2314368277 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9583+0+0 (secure 0 0 0) 0x7f8b2409b320 con 0x5597dfe9b230 2024-06-13T02:27:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.678+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2314368277 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b280047a0 con 0x5597dfe9b230 2024-06-13T02:27:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.678+0000 7f8b17e00640 1 -- 172.21.15.2:0/2314368277 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8b240cd390 con 0x5597dfe9b230 2024-06-13T02:27:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.678+0000 7f8b3ffb2740 10 client.25999 fetch_fsmap learned FSMap version 35 2024-06-13T02:27:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.678+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2314368277 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5597dfeb50a0 con 0x5597dfe9b230 2024-06-13T02:27:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.678+0000 7f8b17e00640 1 -- 172.21.15.2:0/2314368277 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b280047a0 con 0x5597dfe9b230 2024-06-13T02:27:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.678+0000 7f8b17e00640 1 -- 172.21.15.2:0/2314368277 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f8b24018c20 con 0x5597dfe9b230 2024-06-13T02:27:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.678+0000 7f8b3ffb2740 10 client.25999 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:27:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.678+0000 7f8b3ffb2740 10 client.25999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:27:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.678+0000 7f8b3ffb2740 20 client.25999 populate_metadata read hostname 'smithi002' 2024-06-13T02:27:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.679+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2314368277 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5597dfeb6560 0x5597dfeb8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.679+0000 7f8b3ffb2740 4 client.25999 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:27:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.679+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2314368277 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597dfe0cb50 con 0x5597dfeb6560 2024-06-13T02:27:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.679+0000 7f8b35400640 1 --2- 172.21.15.2:0/2314368277 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5597dfeb6560 0x5597dfeb8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.679+0000 7f8b35400640 1 --2- 172.21.15.2:0/2314368277 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5597dfeb6560 0x5597dfeb8950 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a59368384b0d241 server_cookie=5d8bc26c0ee51f6b in_seq=0 out_seq=0 2024-06-13T02:27:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.679+0000 7f8b17e00640 10 client.25999 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.681+0000 7f8b17e00640 1 -- 172.21.15.2:0/2314368277 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5597dfe0cb50 con 0x5597dfeb6560 2024-06-13T02:27:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.681+0000 7f8b17e00640 10 client.25999 handle_command_reply: tid=0 2024-06-13T02:27:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.681+0000 7f8b3ffb2740 1 client.25999 shutdown 2024-06-13T02:27:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.681+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2314368277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9b230 msgr2=0x5597dfea2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.681+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2314368277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9b230 0x5597dfea2f90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400c6a0 tx=0x7f8b24098030 comp rx=0 tx=0).stop 2024-06-13T02:27:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.681+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2314368277 shutdown_connections 2024-06-13T02:27:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.681+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2314368277 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5597dfeb6560 0x5597dfeb8950 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.681+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2314368277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfea5fb0 0x5597dfea3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.681+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2314368277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfe9c7a0 0x5597dfea34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.681+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2314368277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9b230 0x5597dfea2f90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.681+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2314368277 >> 172.21.15.2:0/2314368277 conn(0x5597dfe63fb0 msgr2=0x5597dfe9d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.681+0000 7f8b17e00640 0 client.25999 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.681+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2314368277 shutdown_connections 2024-06-13T02:27:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.681+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2314368277 wait complete. 2024-06-13T02:27:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.681+0000 7f8b3ffb2740 20 client.25999 trim_cache size 0 max 16384 2024-06-13T02:27:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.699+0000 7f8b3ffb2740 1 Processor -- start 2024-06-13T02:27:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.699+0000 7f8b3ffb2740 1 -- start start 2024-06-13T02:27:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.700+0000 7f8b3ffb2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9b230 0x5597dfe96820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.700+0000 7f8b3ffb2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfe9c7a0 0x5597dfebe1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.700+0000 7f8b3ffb2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfea5fb0 0x5597dfebe710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.700+0000 7f8b3ffb2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8b381b3950 con 0x5597dfe9c7a0 2024-06-13T02:27:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.700+0000 7f8b3ffb2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8b381b1220 con 0x5597dfea5fb0 2024-06-13T02:27:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.700+0000 7f8b3ffb2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b381af090 con 0x5597dfe9b230 2024-06-13T02:27:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.700+0000 7f8b36800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfea5fb0 0x5597dfebe710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.700+0000 7f8b36800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfea5fb0 0x5597dfebe710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:58398/0 (socket says 172.21.15.2:58398) 2024-06-13T02:27:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.700+0000 7f8b36800640 1 -- 172.21.15.2:0/2334136437 learned_addr learned my addr 172.21.15.2:0/2334136437 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.700+0000 7f8b35400640 1 --2- 172.21.15.2:0/2334136437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfe9c7a0 0x5597dfebe1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.700+0000 7f8b35e00640 1 --2- 172.21.15.2:0/2334136437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9b230 0x5597dfe96820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.701+0000 7f8b36800640 1 -- 172.21.15.2:0/2334136437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9b230 msgr2=0x5597dfe96820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.701+0000 7f8b36800640 1 --2- 172.21.15.2:0/2334136437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9b230 0x5597dfe96820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.701+0000 7f8b36800640 1 -- 172.21.15.2:0/2334136437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfe9c7a0 msgr2=0x5597dfebe1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.701+0000 7f8b36800640 1 --2- 172.21.15.2:0/2334136437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfe9c7a0 0x5597dfebe1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.701+0000 7f8b36800640 1 -- 172.21.15.2:0/2334136437 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597dfe9b840 con 0x5597dfea5fb0 2024-06-13T02:27:16.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.701+0000 7f8b36800640 1 --2- 172.21.15.2:0/2334136437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfea5fb0 0x5597dfebe710 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8b30010920 tx=0x7f8b30011f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15893cfdf3e1f32a server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:16.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.701+0000 7f8b22a00640 1 -- 172.21.15.2:0/2334136437 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3002d070 con 0x5597dfea5fb0 2024-06-13T02:27:16.706 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.701+0000 7f8b22a00640 1 -- 172.21.15.2:0/2334136437 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b3001fe10 con 0x5597dfea5fb0 2024-06-13T02:27:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.701+0000 7f8b22a00640 1 -- 172.21.15.2:0/2334136437 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b30028d40 con 0x5597dfea5fb0 2024-06-13T02:27:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.702+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2334136437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfea5fb0 msgr2=0x5597dfebe710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.702+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2334136437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfea5fb0 0x5597dfebe710 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8b30010920 tx=0x7f8b30011f90 comp rx=0 tx=0).stop 2024-06-13T02:27:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.702+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2334136437 shutdown_connections 2024-06-13T02:27:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.702+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2334136437 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfea5fb0 0x5597dfebe710 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.702+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2334136437 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfe9c7a0 0x5597dfebe1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.702+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2334136437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9b230 0x5597dfe96820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.702+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2334136437 >> 172.21.15.2:0/2334136437 conn(0x5597dfe63fb0 msgr2=0x5597dfe96110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.702+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2334136437 shutdown_connections 2024-06-13T02:27:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.702+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2334136437 wait complete. 2024-06-13T02:27:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.703+0000 7f8b3ffb2740 1 -- start start 2024-06-13T02:27:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.703+0000 7f8b3ffb2740 1 Processor -- start 2024-06-13T02:27:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b3ffb2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfe9b230 0x5597dfeae180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b3ffb2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9c7a0 0x5597dfeae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b3ffb2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfea5fb0 0x5597dfe9f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b3ffb2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8b381af6e0 con 0x5597dfea5fb0 2024-06-13T02:27:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b3ffb2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8b381b0b50 con 0x5597dfe9b230 2024-06-13T02:27:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b3ffb2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b381afdb0 con 0x5597dfe9c7a0 2024-06-13T02:27:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b3ffb2740 10 client.0 _ll_register_callbacks cb 0x7f8b240d33d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:27:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b35e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfe9b230 0x5597dfeae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b35e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfe9b230 0x5597dfeae180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:58402/0 (socket says 172.21.15.2:58402) 2024-06-13T02:27:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b35e00640 1 -- 172.21.15.2:0/2193516825 learned_addr learned my addr 172.21.15.2:0/2193516825 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b36800640 1 --2- 172.21.15.2:0/2193516825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfea5fb0 0x5597dfe9f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b35400640 1 --2- 172.21.15.2:0/2193516825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9c7a0 0x5597dfeae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b35e00640 1 -- 172.21.15.2:0/2193516825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9c7a0 msgr2=0x5597dfeae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b35e00640 1 --2- 172.21.15.2:0/2193516825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9c7a0 0x5597dfeae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b35e00640 1 -- 172.21.15.2:0/2193516825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfea5fb0 msgr2=0x5597dfe9f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b35e00640 1 --2- 172.21.15.2:0/2193516825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfea5fb0 0x5597dfe9f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b35e00640 1 -- 172.21.15.2:0/2193516825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597dfe9fb50 con 0x5597dfe9b230 2024-06-13T02:27:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.704+0000 7f8b35400640 1 --2- 172.21.15.2:0/2193516825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9c7a0 0x5597dfeae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:27:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.705+0000 7f8b35e00640 1 --2- 172.21.15.2:0/2193516825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfe9b230 0x5597dfeae180 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8b240a4410 tx=0x7f8b2409bbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11a07401b3bea0aa server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.705+0000 7f8b17e00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:27:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.705+0000 7f8b17e00640 1 -- 172.21.15.2:0/2193516825 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2409b630 con 0x5597dfe9b230 2024-06-13T02:27:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.705+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2193516825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b3001fe10 con 0x5597dfe9b230 2024-06-13T02:27:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.705+0000 7f8b17e00640 1 -- 172.21.15.2:0/2193516825 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9583+0+0 (secure 0 0 0) 0x7f8b24010430 con 0x5597dfe9b230 2024-06-13T02:27:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.705+0000 7f8b17e00640 1 -- 172.21.15.2:0/2193516825 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8b2409c3d0 con 0x5597dfe9b230 2024-06-13T02:27:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.705+0000 7f8b3ffb2740 10 client.26021 fetch_fsmap learned FSMap version 35 2024-06-13T02:27:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.705+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2193516825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5597dff209b0 con 0x5597dfe9b230 2024-06-13T02:27:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.705+0000 7f8b17e00640 1 -- 172.21.15.2:0/2193516825 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b3001fe10 con 0x5597dfe9b230 2024-06-13T02:27:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.706+0000 7f8b17e00640 1 -- 172.21.15.2:0/2193516825 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f8b240a1210 con 0x5597dfe9b230 2024-06-13T02:27:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.706+0000 7f8b3ffb2740 10 client.26021 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:27:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.706+0000 7f8b3ffb2740 10 client.26021 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:27:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.706+0000 7f8b3ffb2740 20 client.26021 populate_metadata read hostname 'smithi002' 2024-06-13T02:27:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.706+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2193516825 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5597dff20f20 0x5597dff23340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.706+0000 7f8b3ffb2740 4 client.26021 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:27:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.706+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2193516825 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5597dfe06ea0 con 0x5597dff20f20 2024-06-13T02:27:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.706+0000 7f8b35400640 1 --2- 172.21.15.2:0/2193516825 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5597dff20f20 0x5597dff23340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.707+0000 7f8b35400640 1 --2- 172.21.15.2:0/2193516825 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5597dff20f20 0x5597dff23340 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d80ec5e4838c8fa9 server_cookie=6bf2ce81f3ddee8d in_seq=0 out_seq=0 2024-06-13T02:27:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.707+0000 7f8b17e00640 10 client.26021 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.925+0000 7f8b17e00640 1 -- 172.21.15.2:0/2193516825 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5597dfe06ea0 con 0x5597dff20f20 2024-06-13T02:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.925+0000 7f8b17e00640 10 client.26021 handle_command_reply: tid=0 2024-06-13T02:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.925+0000 7f8b3ffb2740 1 client.26021 shutdown 2024-06-13T02:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.925+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2193516825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfe9b230 msgr2=0x5597dfeae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.925+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2193516825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfe9b230 0x5597dfeae180 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8b240a4410 tx=0x7f8b2409bbd0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.926+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2193516825 shutdown_connections 2024-06-13T02:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.926+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2193516825 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5597dff20f20 0x5597dff23340 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.926+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2193516825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5597dfea5fb0 0x5597dfe9f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.926+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2193516825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5597dfe9c7a0 0x5597dfeae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.926+0000 7f8b3ffb2740 1 --2- 172.21.15.2:0/2193516825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5597dfe9b230 0x5597dfeae180 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.926+0000 7f8b17e00640 0 client.26021 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.926+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2193516825 >> 172.21.15.2:0/2193516825 conn(0x5597dfe63fb0 msgr2=0x5597dfea1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.926+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2193516825 shutdown_connections 2024-06-13T02:27:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.926+0000 7f8b3ffb2740 1 -- 172.21.15.2:0/2193516825 wait complete. 2024-06-13T02:27:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.926+0000 7f8b3ffb2740 20 client.26021 trim_cache size 0 max 16384 2024-06-13T02:27:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:27:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:27:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:27:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.927+0000 7f8b37200640 1 -- 172.21.15.2:0/3974591075 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8b1c0a2d60 msgr2=0x7f8b1c0a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.927+0000 7f8b37200640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8b1c0a2d60 0x7f8b1c0a5220 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8b30005fd0 tx=0x7f8b30009500 comp rx=0 tx=0).stop 2024-06-13T02:27:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.927+0000 7f8b37200640 1 -- 172.21.15.2:0/3974591075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b381017c0 msgr2=0x7f8b38073ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.927+0000 7f8b37200640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b381017c0 0x7f8b38073ca0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400e9f0 tx=0x7f8b2400eeb0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.928+0000 7f8b37200640 1 -- 172.21.15.2:0/3974591075 shutdown_connections 2024-06-13T02:27:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.928+0000 7f8b37200640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8b1c0a2d60 0x7f8b1c0a5220 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.928+0000 7f8b37200640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b381077d0 0x7f8b38074720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.928+0000 7f8b37200640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8b38102180 0x7f8b380741e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.928+0000 7f8b37200640 1 --2- 172.21.15.2:0/3974591075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b381017c0 0x7f8b38073ca0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.928+0000 7f8b37200640 1 -- 172.21.15.2:0/3974591075 >> 172.21.15.2:0/3974591075 conn(0x7f8b380fd2b0 msgr2=0x7f8b380fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.928+0000 7f8b37200640 1 -- 172.21.15.2:0/3974591075 shutdown_connections 2024-06-13T02:27:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:16.928+0000 7f8b37200640 1 -- 172.21.15.2:0/3974591075 wait complete. 2024-06-13T02:27:17.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:17 smithi002 ceph-mon[31960]: pgmap v297: 129 pgs: 129 active+clean; 92 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 179 op/s 2024-06-13T02:27:17.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:17 smithi084 ceph-mon[36833]: pgmap v297: 129 pgs: 129 active+clean; 92 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 179 op/s 2024-06-13T02:27:17.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:17 smithi175 ceph-mon[36977]: pgmap v297: 129 pgs: 129 active+clean; 92 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 179 op/s 2024-06-13T02:27:17.543 INFO:tasks.workunit.client.0.smithi002.stdout: 1 684308 7.24 MB/sec execute 381 sec latency 82.311 ms 2024-06-13T02:27:18.543 INFO:tasks.workunit.client.0.smithi002.stdout: 1 685710 7.25 MB/sec execute 382 sec latency 21.048 ms 2024-06-13T02:27:19.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:19 smithi002 ceph-mon[31960]: pgmap v298: 129 pgs: 129 active+clean; 93 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 145 op/s 2024-06-13T02:27:19.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:19 smithi084 ceph-mon[36833]: pgmap v298: 129 pgs: 129 active+clean; 93 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 145 op/s 2024-06-13T02:27:19.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:19 smithi175 ceph-mon[36977]: pgmap v298: 129 pgs: 129 active+clean; 93 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 145 op/s 2024-06-13T02:27:19.543 INFO:tasks.workunit.client.0.smithi002.stdout: 1 686583 7.24 MB/sec execute 383 sec latency 24.105 ms 2024-06-13T02:27:20.543 INFO:tasks.workunit.client.0.smithi002.stdout: 1 687841 7.23 MB/sec execute 384 sec latency 39.607 ms 2024-06-13T02:27:21.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:21 smithi002 ceph-mon[31960]: pgmap v299: 129 pgs: 129 active+clean; 93 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 145 op/s 2024-06-13T02:27:21.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:21 smithi084 ceph-mon[36833]: pgmap v299: 129 pgs: 129 active+clean; 93 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 145 op/s 2024-06-13T02:27:21.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:21 smithi175 ceph-mon[36977]: pgmap v299: 129 pgs: 129 active+clean; 93 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 145 op/s 2024-06-13T02:27:21.543 INFO:tasks.workunit.client.0.smithi002.stdout: 1 689272 7.24 MB/sec execute 385 sec latency 24.689 ms 2024-06-13T02:27:22.543 INFO:tasks.workunit.client.0.smithi002.stdout: 1 690180 7.23 MB/sec execute 386 sec latency 21.728 ms 2024-06-13T02:27:23.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:23 smithi084 ceph-mon[36833]: pgmap v300: 129 pgs: 129 active+clean; 85 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 249 op/s 2024-06-13T02:27:23.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:23 smithi175 ceph-mon[36977]: pgmap v300: 129 pgs: 129 active+clean; 85 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 249 op/s 2024-06-13T02:27:23.544 INFO:tasks.workunit.client.0.smithi002.stdout: 1 691519 7.23 MB/sec execute 387 sec latency 27.063 ms 2024-06-13T02:27:23.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:23 smithi002 ceph-mon[31960]: pgmap v300: 129 pgs: 129 active+clean; 85 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 249 op/s 2024-06-13T02:27:24.544 INFO:tasks.workunit.client.0.smithi002.stdout: 1 692613 7.23 MB/sec execute 388 sec latency 98.124 ms 2024-06-13T02:27:25.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:25 smithi084 ceph-mon[36833]: pgmap v301: 129 pgs: 129 active+clean; 85 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 243 op/s 2024-06-13T02:27:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:25 smithi175 ceph-mon[36977]: pgmap v301: 129 pgs: 129 active+clean; 85 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 243 op/s 2024-06-13T02:27:25.544 INFO:tasks.workunit.client.0.smithi002.stdout: 1 693358 7.22 MB/sec execute 389 sec latency 28.909 ms 2024-06-13T02:27:25.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:25 smithi002 ceph-mon[31960]: pgmap v301: 129 pgs: 129 active+clean; 85 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 243 op/s 2024-06-13T02:27:26.544 INFO:tasks.workunit.client.0.smithi002.stdout: 1 694470 7.21 MB/sec execute 390 sec latency 36.550 ms 2024-06-13T02:27:27.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:27 smithi084 ceph-mon[36833]: pgmap v302: 129 pgs: 129 active+clean; 89 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 260 op/s 2024-06-13T02:27:27.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:27 smithi175 ceph-mon[36977]: pgmap v302: 129 pgs: 129 active+clean; 89 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 260 op/s 2024-06-13T02:27:27.544 INFO:tasks.workunit.client.0.smithi002.stdout: 1 696154 7.23 MB/sec execute 391 sec latency 26.122 ms 2024-06-13T02:27:27.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:27 smithi002 ceph-mon[31960]: pgmap v302: 129 pgs: 129 active+clean; 89 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 260 op/s 2024-06-13T02:27:28.544 INFO:tasks.workunit.client.0.smithi002.stdout: 1 696984 7.21 MB/sec execute 392 sec latency 20.023 ms 2024-06-13T02:27:29.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:29 smithi084 ceph-mon[36833]: pgmap v303: 129 pgs: 129 active+clean; 89 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 226 op/s 2024-06-13T02:27:29.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:29 smithi175 ceph-mon[36977]: pgmap v303: 129 pgs: 129 active+clean; 89 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 226 op/s 2024-06-13T02:27:29.544 INFO:tasks.workunit.client.0.smithi002.stdout: 1 698124 7.21 MB/sec execute 393 sec latency 83.676 ms 2024-06-13T02:27:29.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:29 smithi002 ceph-mon[31960]: pgmap v303: 129 pgs: 129 active+clean; 89 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 226 op/s 2024-06-13T02:27:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.082+0000 7fdc5f200640 1 -- 172.21.15.2:0/1986503558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc601077d0 msgr2=0x7fdc60107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.082+0000 7fdc5f200640 1 --2- 172.21.15.2:0/1986503558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc601077d0 0x7fdc60107bb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009900 tx=0x7fdc5002a3f0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.082+0000 7fdc5f200640 1 -- 172.21.15.2:0/1986503558 shutdown_connections 2024-06-13T02:27:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.082+0000 7fdc5f200640 1 --2- 172.21.15.2:0/1986503558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc60102180 0x7fdc6010e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.082+0000 7fdc5f200640 1 --2- 172.21.15.2:0/1986503558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc601017c0 0x7fdc60101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.082+0000 7fdc5f200640 1 --2- 172.21.15.2:0/1986503558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc601077d0 0x7fdc60107bb0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.082+0000 7fdc5f200640 1 -- 172.21.15.2:0/1986503558 >> 172.21.15.2:0/1986503558 conn(0x7fdc600fd2b0 msgr2=0x7fdc600ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.083+0000 7fdc5f200640 1 -- 172.21.15.2:0/1986503558 shutdown_connections 2024-06-13T02:27:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.083+0000 7fdc5f200640 1 -- 172.21.15.2:0/1986503558 wait complete. 2024-06-13T02:27:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.084+0000 7fdc5f200640 1 Processor -- start 2024-06-13T02:27:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.084+0000 7fdc5f200640 1 -- start start 2024-06-13T02:27:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.084+0000 7fdc5f200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc601017c0 0x7fdc6019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.084+0000 7fdc5f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc60102180 0x7fdc6019a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.084+0000 7fdc5f200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc601077d0 0x7fdc6019ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.084+0000 7fdc5f200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc60111c30 con 0x7fdc601077d0 2024-06-13T02:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.084+0000 7fdc5f200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdc60111ab0 con 0x7fdc601017c0 2024-06-13T02:27:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.084+0000 7fdc5f200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdc60111db0 con 0x7fdc60102180 2024-06-13T02:27:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.085+0000 7fdc5de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc601017c0 0x7fdc6019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.085+0000 7fdc5de00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc601017c0 0x7fdc6019a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37390/0 (socket says 172.21.15.2:37390) 2024-06-13T02:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.085+0000 7fdc5de00640 1 -- 172.21.15.2:0/1492356447 learned_addr learned my addr 172.21.15.2:0/1492356447 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.085+0000 7fdc5d400640 1 --2- 172.21.15.2:0/1492356447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc60102180 0x7fdc6019a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.085+0000 7fdc5e800640 1 --2- 172.21.15.2:0/1492356447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc601077d0 0x7fdc6019ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.085+0000 7fdc5de00640 1 -- 172.21.15.2:0/1492356447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc60102180 msgr2=0x7fdc6019a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.085+0000 7fdc5de00640 1 --2- 172.21.15.2:0/1492356447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc60102180 0x7fdc6019a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.085+0000 7fdc5de00640 1 -- 172.21.15.2:0/1492356447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc601077d0 msgr2=0x7fdc6019ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.085+0000 7fdc5de00640 1 --2- 172.21.15.2:0/1492356447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc601077d0 0x7fdc6019ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.085+0000 7fdc5de00640 1 -- 172.21.15.2:0/1492356447 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc6019f320 con 0x7fdc601017c0 2024-06-13T02:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.085+0000 7fdc5e800640 1 --2- 172.21.15.2:0/1492356447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc601077d0 0x7fdc6019ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.086+0000 7fdc5de00640 1 --2- 172.21.15.2:0/1492356447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc601017c0 0x7fdc6019a330 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdc5002a9e0 tx=0x7fdc50003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.086+0000 7fdc56a00640 1 -- 172.21.15.2:0/1492356447 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5003f070 con 0x7fdc601017c0 2024-06-13T02:27:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.086+0000 7fdc56a00640 1 -- 172.21.15.2:0/1492356447 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc50031c30 con 0x7fdc601017c0 2024-06-13T02:27:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.086+0000 7fdc56a00640 1 -- 172.21.15.2:0/1492356447 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50035030 con 0x7fdc601017c0 2024-06-13T02:27:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.086+0000 7fdc5f200640 1 -- 172.21.15.2:0/1492356447 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc6019f5b0 con 0x7fdc601017c0 2024-06-13T02:27:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.087+0000 7fdc5f200640 1 -- 172.21.15.2:0/1492356447 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc601a6ea0 con 0x7fdc601017c0 2024-06-13T02:27:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.090+0000 7fdc67a42740 1 Processor -- start 2024-06-13T02:27:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.090+0000 7fdc56a00640 1 -- 172.21.15.2:0/1492356447 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fdc50042070 con 0x7fdc601017c0 2024-06-13T02:27:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.090+0000 7fdc67a42740 1 -- start start 2024-06-13T02:27:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.090+0000 7fdc67a42740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b8e7a0 0x560af0b8ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.091+0000 7fdc67a42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0b8d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.091+0000 7fdc67a42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b97fb0 0x560af0b9a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.091+0000 7fdc67a42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560af0af1420 con 0x560af0b8d230 2024-06-13T02:27:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.091+0000 7fdc67a42740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560af0a98c50 con 0x560af0b8e7a0 2024-06-13T02:27:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.091+0000 7fdc67a42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560af0aed3e0 con 0x560af0b97fb0 2024-06-13T02:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.091+0000 7fdc5e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b8e7a0 0x560af0b8ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.091+0000 7fdc5e800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b8e7a0 0x560af0b8ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37394/0 (socket says 172.21.15.2:37394) 2024-06-13T02:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.091+0000 7fdc5e800640 1 -- 172.21.15.2:0/3491693227 learned_addr learned my addr 172.21.15.2:0/3491693227 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.091+0000 7fdc5d400640 1 --2- 172.21.15.2:0/3491693227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b97fb0 0x560af0b9a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.091+0000 7fdc5de00640 1 --2- 172.21.15.2:0/3491693227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0b8d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.091+0000 7fdc5e800640 1 -- 172.21.15.2:0/3491693227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b97fb0 msgr2=0x560af0b9a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.091+0000 7fdc5e800640 1 --2- 172.21.15.2:0/3491693227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b97fb0 0x560af0b9a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.091+0000 7fdc5e800640 1 -- 172.21.15.2:0/3491693227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 msgr2=0x560af0b8d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.091+0000 7fdc5e800640 1 --2- 172.21.15.2:0/3491693227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0b8d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.091+0000 7fdc5e800640 1 -- 172.21.15.2:0/3491693227 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560af0805210 con 0x560af0b8e7a0 2024-06-13T02:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.092+0000 7fdc5e800640 1 --2- 172.21.15.2:0/3491693227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b8e7a0 0x560af0b8ccf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009f10 tx=0x7fdc5800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=299a1736e06c88df server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.092+0000 7fdc4b000640 1 -- 172.21.15.2:0/3491693227 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc58011640 con 0x560af0b8e7a0 2024-06-13T02:27:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.092+0000 7fdc4b000640 1 -- 172.21.15.2:0/3491693227 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc58011cc0 con 0x560af0b8e7a0 2024-06-13T02:27:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.092+0000 7fdc4b000640 1 -- 172.21.15.2:0/3491693227 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5801be60 con 0x560af0b8e7a0 2024-06-13T02:27:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.092+0000 7fdc56a00640 1 --2- 172.21.15.2:0/1492356447 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fdc440a2d60 0x7fdc440a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.092+0000 7fdc56a00640 1 -- 172.21.15.2:0/1492356447 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9583+0+0 (secure 0 0 0) 0x7fdc500efeb0 con 0x7fdc601017c0 2024-06-13T02:27:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.092+0000 7fdc5de00640 1 --2- 172.21.15.2:0/1492356447 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fdc440a2d60 0x7fdc440a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.093+0000 7fdc67a42740 1 -- 172.21.15.2:0/3491693227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b8e7a0 msgr2=0x560af0b8ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.093+0000 7fdc67a42740 1 --2- 172.21.15.2:0/3491693227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b8e7a0 0x560af0b8ccf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009f10 tx=0x7fdc5800f730 comp rx=0 tx=0).stop 2024-06-13T02:27:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.093+0000 7fdc67a42740 1 -- 172.21.15.2:0/3491693227 shutdown_connections 2024-06-13T02:27:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.093+0000 7fdc67a42740 1 --2- 172.21.15.2:0/3491693227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b97fb0 0x560af0b9a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.093+0000 7fdc67a42740 1 --2- 172.21.15.2:0/3491693227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0b8d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.093+0000 7fdc67a42740 1 --2- 172.21.15.2:0/3491693227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b8e7a0 0x560af0b8ccf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.093+0000 7fdc67a42740 1 -- 172.21.15.2:0/3491693227 >> 172.21.15.2:0/3491693227 conn(0x560af0b55fb0 msgr2=0x560af0b89820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.093+0000 7fdc67a42740 1 -- 172.21.15.2:0/3491693227 shutdown_connections 2024-06-13T02:27:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.093+0000 7fdc5de00640 1 --2- 172.21.15.2:0/1492356447 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fdc440a2d60 0x7fdc440a5220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x560af0b8ff00 tx=0x7fdc50009260 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.093+0000 7fdc67a42740 1 -- 172.21.15.2:0/3491693227 wait complete. 2024-06-13T02:27:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.094+0000 7fdc67a42740 1 -- start start 2024-06-13T02:27:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.094+0000 7fdc67a42740 1 Processor -- start 2024-06-13T02:27:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.094+0000 7fdc67a42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8d230 0x560af0b94ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.094+0000 7fdc67a42740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b8e7a0 0x560af0b95530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.094+0000 7fdc67a42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b97fb0 0x560af0b95a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.094+0000 7fdc67a42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x560af0b9ad80 con 0x560af0b97fb0 2024-06-13T02:27:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.094+0000 7fdc67a42740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560af0aac0b0 con 0x560af0b8e7a0 2024-06-13T02:27:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.094+0000 7fdc67a42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x560af0b9af00 con 0x560af0b8d230 2024-06-13T02:27:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.095+0000 7fdc67a42740 10 client.0 _ll_register_callbacks cb 0x560af0a97f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:27:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.095+0000 7fdc5d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b8e7a0 0x560af0b95530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.095+0000 7fdc5d400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b8e7a0 0x560af0b95530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:37408/0 (socket says 172.21.15.2:37408) 2024-06-13T02:27:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.095+0000 7fdc5d400640 1 -- 172.21.15.2:0/3755321233 learned_addr learned my addr 172.21.15.2:0/3755321233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.095+0000 7fdc5e800640 1 --2- 172.21.15.2:0/3755321233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8d230 0x560af0b94ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.095+0000 7fdc5e800640 1 --2- 172.21.15.2:0/3755321233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b97fb0 0x560af0b95a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.095+0000 7fdc5d400640 1 -- 172.21.15.2:0/3755321233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8d230 msgr2=0x560af0b94ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.095+0000 7fdc5d400640 1 --2- 172.21.15.2:0/3755321233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8d230 0x560af0b94ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.095+0000 7fdc5d400640 1 -- 172.21.15.2:0/3755321233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b97fb0 msgr2=0x560af0b95a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.095+0000 7fdc5d400640 1 --2- 172.21.15.2:0/3755321233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b97fb0 0x560af0b95a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.095+0000 7fdc5d400640 1 -- 172.21.15.2:0/3755321233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560af08d1620 con 0x560af0b8e7a0 2024-06-13T02:27:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.095+0000 7fdc5e800640 1 --2- 172.21.15.2:0/3755321233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b97fb0 0x560af0b95a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:27:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.096+0000 7fdc5d400640 1 --2- 172.21.15.2:0/3755321233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b8e7a0 0x560af0b95530 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0126e0 tx=0x7fdc4c012ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db55b286c124217f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.096+0000 7fdc3f400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:27:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.096+0000 7fdc3f400640 1 -- 172.21.15.2:0/3755321233 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c012190 con 0x560af0b8e7a0 2024-06-13T02:27:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.096+0000 7fdc3f400640 1 -- 172.21.15.2:0/3755321233 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9583+0+0 (secure 0 0 0) 0x7fdc4c004020 con 0x560af0b8e7a0 2024-06-13T02:27:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.096+0000 7fdc67a42740 1 -- 172.21.15.2:0/3755321233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc58011cc0 con 0x560af0b8e7a0 2024-06-13T02:27:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.096+0000 7fdc3f400640 1 -- 172.21.15.2:0/3755321233 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdc4c004220 con 0x560af0b8e7a0 2024-06-13T02:27:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.096+0000 7fdc67a42740 10 client.26033 fetch_fsmap learned FSMap version 35 2024-06-13T02:27:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.096+0000 7fdc67a42740 1 -- 172.21.15.2:0/3755321233 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560af0ba71e0 con 0x560af0b8e7a0 2024-06-13T02:27:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.097+0000 7fdc3f400640 1 -- 172.21.15.2:0/3755321233 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc58011cc0 con 0x560af0b8e7a0 2024-06-13T02:27:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.097+0000 7fdc3f400640 1 -- 172.21.15.2:0/3755321233 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fdc4c0038f0 con 0x560af0b8e7a0 2024-06-13T02:27:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.097+0000 7fdc67a42740 10 client.26033 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:27:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.097+0000 7fdc67a42740 10 client.26033 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:27:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.097+0000 7fdc67a42740 20 client.26033 populate_metadata read hostname 'smithi002' 2024-06-13T02:27:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.097+0000 7fdc67a42740 1 --2- 172.21.15.2:0/3755321233 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560af0ba8650 0x560af0baaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.097+0000 7fdc67a42740 4 client.26033 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:27:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.097+0000 7fdc67a42740 1 -- 172.21.15.2:0/3755321233 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560af0afeb50 con 0x560af0ba8650 2024-06-13T02:27:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.098+0000 7fdc5e800640 1 --2- 172.21.15.2:0/3755321233 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560af0ba8650 0x560af0baaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.098+0000 7fdc3f400640 10 client.26033 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.098+0000 7fdc5e800640 1 --2- 172.21.15.2:0/3755321233 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560af0ba8650 0x560af0baaa40 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ae925ce55be9aa server_cookie=85da96188c00416d in_seq=0 out_seq=0 2024-06-13T02:27:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.099+0000 7fdc3f400640 1 -- 172.21.15.2:0/3755321233 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560af0afeb50 con 0x560af0ba8650 2024-06-13T02:27:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.099+0000 7fdc3f400640 10 client.26033 handle_command_reply: tid=0 2024-06-13T02:27:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.099+0000 7fdc67a42740 1 client.26033 shutdown 2024-06-13T02:27:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.099+0000 7fdc67a42740 1 -- 172.21.15.2:0/3755321233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b8e7a0 msgr2=0x560af0b95530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.099+0000 7fdc67a42740 1 --2- 172.21.15.2:0/3755321233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b8e7a0 0x560af0b95530 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0126e0 tx=0x7fdc4c012ba0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.099+0000 7fdc67a42740 1 -- 172.21.15.2:0/3755321233 shutdown_connections 2024-06-13T02:27:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.099+0000 7fdc67a42740 1 --2- 172.21.15.2:0/3755321233 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560af0ba8650 0x560af0baaa40 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.099+0000 7fdc67a42740 1 --2- 172.21.15.2:0/3755321233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b97fb0 0x560af0b95a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.099+0000 7fdc67a42740 1 --2- 172.21.15.2:0/3755321233 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b8e7a0 0x560af0b95530 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.099+0000 7fdc67a42740 1 --2- 172.21.15.2:0/3755321233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8d230 0x560af0b94ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.099+0000 7fdc67a42740 1 -- 172.21.15.2:0/3755321233 >> 172.21.15.2:0/3755321233 conn(0x560af0b55fb0 msgr2=0x560af0b8f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.099+0000 7fdc3f400640 0 client.26033 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.100+0000 7fdc67a42740 1 -- 172.21.15.2:0/3755321233 shutdown_connections 2024-06-13T02:27:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.100+0000 7fdc67a42740 1 -- 172.21.15.2:0/3755321233 wait complete. 2024-06-13T02:27:30.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.100+0000 7fdc67a42740 20 client.26033 trim_cache size 0 max 16384 2024-06-13T02:27:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.117+0000 7fdc67a42740 1 Processor -- start 2024-06-13T02:27:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.118+0000 7fdc67a42740 1 -- start start 2024-06-13T02:27:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.118+0000 7fdc67a42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0b956c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.118+0000 7fdc67a42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8e7a0 0x560af0b89120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.118+0000 7fdc67a42740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b97fb0 0x560af0b89660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.118+0000 7fdc67a42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc601b3a10 con 0x560af0b8d230 2024-06-13T02:27:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.118+0000 7fdc67a42740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdc601b12e0 con 0x560af0b97fb0 2024-06-13T02:27:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.118+0000 7fdc67a42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdc601af150 con 0x560af0b8e7a0 2024-06-13T02:27:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.118+0000 7fdc5e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0b956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.118+0000 7fdc5e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0b956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42300/0 (socket says 172.21.15.2:42300) 2024-06-13T02:27:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.118+0000 7fdc5e800640 1 -- 172.21.15.2:0/3237254729 learned_addr learned my addr 172.21.15.2:0/3237254729 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.118+0000 7fdc5d400640 1 --2- 172.21.15.2:0/3237254729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8e7a0 0x560af0b89120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.118+0000 7fdc5e800640 1 --2- 172.21.15.2:0/3237254729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b97fb0 0x560af0b89660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.119+0000 7fdc5d400640 1 -- 172.21.15.2:0/3237254729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b97fb0 msgr2=0x560af0b89660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.119+0000 7fdc5d400640 1 --2- 172.21.15.2:0/3237254729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b97fb0 0x560af0b89660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.119+0000 7fdc5d400640 1 -- 172.21.15.2:0/3237254729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 msgr2=0x560af0b956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.119+0000 7fdc5d400640 1 --2- 172.21.15.2:0/3237254729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0b956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.119+0000 7fdc5d400640 1 -- 172.21.15.2:0/3237254729 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560af0b93540 con 0x560af0b8e7a0 2024-06-13T02:27:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.119+0000 7fdc5e800640 1 --2- 172.21.15.2:0/3237254729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0b956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:27:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.119+0000 7fdc5d400640 1 --2- 172.21.15.2:0/3237254729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8e7a0 0x560af0b89120 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c003cc0 tx=0x7fdc4c00f810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6701f489c6ef360 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.119+0000 7fdc4a600640 1 -- 172.21.15.2:0/3237254729 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c012250 con 0x560af0b8e7a0 2024-06-13T02:27:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.120+0000 7fdc4a600640 1 -- 172.21.15.2:0/3237254729 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc4c003f30 con 0x560af0b8e7a0 2024-06-13T02:27:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.120+0000 7fdc4a600640 1 -- 172.21.15.2:0/3237254729 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c00fde0 con 0x560af0b8e7a0 2024-06-13T02:27:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.120+0000 7fdc67a42740 1 -- 172.21.15.2:0/3237254729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8e7a0 msgr2=0x560af0b89120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.120+0000 7fdc67a42740 1 --2- 172.21.15.2:0/3237254729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8e7a0 0x560af0b89120 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c003cc0 tx=0x7fdc4c00f810 comp rx=0 tx=0).stop 2024-06-13T02:27:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.120+0000 7fdc67a42740 1 -- 172.21.15.2:0/3237254729 shutdown_connections 2024-06-13T02:27:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.120+0000 7fdc67a42740 1 --2- 172.21.15.2:0/3237254729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b97fb0 0x560af0b89660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.120+0000 7fdc67a42740 1 --2- 172.21.15.2:0/3237254729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8e7a0 0x560af0b89120 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.120+0000 7fdc67a42740 1 --2- 172.21.15.2:0/3237254729 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0b956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.120+0000 7fdc67a42740 1 -- 172.21.15.2:0/3237254729 >> 172.21.15.2:0/3237254729 conn(0x560af0b55fb0 msgr2=0x560af0b94fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.121+0000 7fdc67a42740 1 -- 172.21.15.2:0/3237254729 shutdown_connections 2024-06-13T02:27:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.121+0000 7fdc67a42740 1 -- 172.21.15.2:0/3237254729 wait complete. 2024-06-13T02:27:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.121+0000 7fdc67a42740 1 -- start start 2024-06-13T02:27:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.121+0000 7fdc67a42740 1 Processor -- start 2024-06-13T02:27:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc67a42740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0ba08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc67a42740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8e7a0 0x560af0b91c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc67a42740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b97fb0 0x560af0b92190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc67a42740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc601af7a0 con 0x560af0b8d230 2024-06-13T02:27:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc67a42740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdc601b0c10 con 0x560af0b97fb0 2024-06-13T02:27:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc67a42740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdc601afe70 con 0x560af0b8e7a0 2024-06-13T02:27:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc67a42740 10 client.0 _ll_register_callbacks cb 0x7fdc4c009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:27:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc5e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0ba08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc5e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0ba08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42312/0 (socket says 172.21.15.2:42312) 2024-06-13T02:27:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc5d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8e7a0 0x560af0b91c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc5e800640 1 -- 172.21.15.2:0/525134341 learned_addr learned my addr 172.21.15.2:0/525134341 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc5e800640 1 --2- 172.21.15.2:0/525134341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b97fb0 0x560af0b92190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc5e800640 1 -- 172.21.15.2:0/525134341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8e7a0 msgr2=0x560af0b91c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc5e800640 1 --2- 172.21.15.2:0/525134341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8e7a0 0x560af0b91c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc5e800640 1 -- 172.21.15.2:0/525134341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b97fb0 msgr2=0x560af0b92190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.122+0000 7fdc5e800640 1 --2- 172.21.15.2:0/525134341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b97fb0 0x560af0b92190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.123+0000 7fdc5e800640 1 -- 172.21.15.2:0/525134341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560af0b929c0 con 0x560af0b8d230 2024-06-13T02:27:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.123+0000 7fdc5d400640 1 --2- 172.21.15.2:0/525134341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8e7a0 0x560af0b91c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:27:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.123+0000 7fdc5e800640 1 --2- 172.21.15.2:0/525134341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0ba08b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009ee0 tx=0x7fdc5801b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a945f6ffbbb3979 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.123+0000 7fdc3f400640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:27:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.123+0000 7fdc3f400640 1 -- 172.21.15.2:0/525134341 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5802d070 con 0x560af0b8d230 2024-06-13T02:27:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.123+0000 7fdc3f400640 1 -- 172.21.15.2:0/525134341 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9583+0+0 (secure 0 0 0) 0x7fdc580050c0 con 0x560af0b8d230 2024-06-13T02:27:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.123+0000 7fdc67a42740 1 -- 172.21.15.2:0/525134341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc4c003f30 con 0x560af0b8d230 2024-06-13T02:27:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.124+0000 7fdc3f400640 1 -- 172.21.15.2:0/525134341 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdc5801b990 con 0x560af0b8d230 2024-06-13T02:27:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.124+0000 7fdc67a42740 10 client.15849 fetch_fsmap learned FSMap version 35 2024-06-13T02:27:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.124+0000 7fdc67a42740 1 -- 172.21.15.2:0/525134341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560af0c131f0 con 0x560af0b8d230 2024-06-13T02:27:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.124+0000 7fdc3f400640 1 -- 172.21.15.2:0/525134341 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc4c003f30 con 0x560af0b8d230 2024-06-13T02:27:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.124+0000 7fdc3f400640 1 -- 172.21.15.2:0/525134341 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fdc58033070 con 0x560af0b8d230 2024-06-13T02:27:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.124+0000 7fdc67a42740 10 client.15849 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:27:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.124+0000 7fdc67a42740 10 client.15849 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:27:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.124+0000 7fdc67a42740 20 client.15849 populate_metadata read hostname 'smithi002' 2024-06-13T02:27:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.124+0000 7fdc67a42740 1 --2- 172.21.15.2:0/525134341 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560af0c13780 0x560af0c15b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.125+0000 7fdc67a42740 4 client.15849 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:27:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.125+0000 7fdc67a42740 1 -- 172.21.15.2:0/525134341 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560af0af8ea0 con 0x560af0c13780 2024-06-13T02:27:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.125+0000 7fdc5d400640 1 --2- 172.21.15.2:0/525134341 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560af0c13780 0x560af0c15b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.125+0000 7fdc5d400640 1 --2- 172.21.15.2:0/525134341 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560af0c13780 0x560af0c15b70 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c0a9a414800dc52 server_cookie=464c1192befc5a8d in_seq=0 out_seq=0 2024-06-13T02:27:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.125+0000 7fdc3f400640 10 client.15849 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.334+0000 7fdc3f400640 1 -- 172.21.15.2:0/525134341 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x560af0af8ea0 con 0x560af0c13780 2024-06-13T02:27:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.334+0000 7fdc3f400640 10 client.15849 handle_command_reply: tid=0 2024-06-13T02:27:30.335 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.334+0000 7fdc67a42740 1 client.15849 shutdown 2024-06-13T02:27:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.334+0000 7fdc67a42740 1 -- 172.21.15.2:0/525134341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 msgr2=0x560af0ba08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.334+0000 7fdc67a42740 1 --2- 172.21.15.2:0/525134341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0ba08b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009ee0 tx=0x7fdc5801b920 comp rx=0 tx=0).stop 2024-06-13T02:27:30.336 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.335+0000 7fdc67a42740 1 -- 172.21.15.2:0/525134341 shutdown_connections 2024-06-13T02:27:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.335+0000 7fdc67a42740 1 --2- 172.21.15.2:0/525134341 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x560af0c13780 0x560af0c15b70 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.335+0000 7fdc67a42740 1 --2- 172.21.15.2:0/525134341 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560af0b97fb0 0x560af0b92190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.335+0000 7fdc67a42740 1 --2- 172.21.15.2:0/525134341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560af0b8e7a0 0x560af0b91c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.335+0000 7fdc67a42740 1 --2- 172.21.15.2:0/525134341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560af0b8d230 0x560af0ba08b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.335+0000 7fdc67a42740 1 -- 172.21.15.2:0/525134341 >> 172.21.15.2:0/525134341 conn(0x560af0b55fb0 msgr2=0x560af0b8f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.335+0000 7fdc3f400640 0 client.15849 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.335+0000 7fdc67a42740 1 -- 172.21.15.2:0/525134341 shutdown_connections 2024-06-13T02:27:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.335+0000 7fdc67a42740 1 -- 172.21.15.2:0/525134341 wait complete. 2024-06-13T02:27:30.337 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.336+0000 7fdc67a42740 20 client.15849 trim_cache size 0 max 16384 2024-06-13T02:27:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:27:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:27:30.338 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:27:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.336+0000 7fdc5f200640 1 -- 172.21.15.2:0/1492356447 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fdc440a2d60 msgr2=0x7fdc440a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.336+0000 7fdc5f200640 1 --2- 172.21.15.2:0/1492356447 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fdc440a2d60 0x7fdc440a5220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x560af0b8ff00 tx=0x7fdc50009260 comp rx=0 tx=0).stop 2024-06-13T02:27:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.337+0000 7fdc5f200640 1 -- 172.21.15.2:0/1492356447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc601017c0 msgr2=0x7fdc6019a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.337+0000 7fdc5f200640 1 --2- 172.21.15.2:0/1492356447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc601017c0 0x7fdc6019a330 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdc5002a9e0 tx=0x7fdc50003c10 comp rx=0 tx=0).stop 2024-06-13T02:27:30.339 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.337+0000 7fdc5f200640 1 -- 172.21.15.2:0/1492356447 shutdown_connections 2024-06-13T02:27:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.337+0000 7fdc5f200640 1 --2- 172.21.15.2:0/1492356447 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fdc440a2d60 0x7fdc440a5220 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.337+0000 7fdc5f200640 1 --2- 172.21.15.2:0/1492356447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc601077d0 0x7fdc6019ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.337+0000 7fdc5f200640 1 --2- 172.21.15.2:0/1492356447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc60102180 0x7fdc6019a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.337+0000 7fdc5f200640 1 --2- 172.21.15.2:0/1492356447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdc601017c0 0x7fdc6019a330 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.337+0000 7fdc5f200640 1 -- 172.21.15.2:0/1492356447 >> 172.21.15.2:0/1492356447 conn(0x7fdc600fd2b0 msgr2=0x7fdc600fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.337+0000 7fdc5f200640 1 -- 172.21.15.2:0/1492356447 shutdown_connections 2024-06-13T02:27:30.340 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:30.337+0000 7fdc5f200640 1 -- 172.21.15.2:0/1492356447 wait complete. 2024-06-13T02:27:30.544 INFO:tasks.workunit.client.0.smithi002.stdout: 1 699645 7.22 MB/sec execute 394 sec latency 119.754 ms 2024-06-13T02:27:31.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:31 smithi084 ceph-mon[36833]: pgmap v304: 129 pgs: 129 active+clean; 89 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 2.0 MiB/s wr, 208 op/s 2024-06-13T02:27:31.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:31 smithi175 ceph-mon[36977]: pgmap v304: 129 pgs: 129 active+clean; 89 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 2.0 MiB/s wr, 208 op/s 2024-06-13T02:27:31.545 INFO:tasks.workunit.client.0.smithi002.stdout: 1 700202 7.20 MB/sec execute 395 sec latency 26.861 ms 2024-06-13T02:27:31.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:31 smithi002 ceph-mon[31960]: pgmap v304: 129 pgs: 129 active+clean; 89 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 2.0 MiB/s wr, 208 op/s 2024-06-13T02:27:32.545 INFO:tasks.workunit.client.0.smithi002.stdout: 1 701223 7.20 MB/sec execute 396 sec latency 25.414 ms 2024-06-13T02:27:33.433 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:33 smithi002 ceph-mon[31960]: pgmap v305: 129 pgs: 129 active+clean; 84 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 340 op/s 2024-06-13T02:27:33.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:33 smithi084 ceph-mon[36833]: pgmap v305: 129 pgs: 129 active+clean; 84 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 340 op/s 2024-06-13T02:27:33.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:33 smithi175 ceph-mon[36977]: pgmap v305: 129 pgs: 129 active+clean; 84 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 340 op/s 2024-06-13T02:27:33.545 INFO:tasks.workunit.client.0.smithi002.stdout: 1 702784 7.20 MB/sec execute 397 sec latency 25.252 ms 2024-06-13T02:27:34.545 INFO:tasks.workunit.client.0.smithi002.stdout: 1 703542 7.20 MB/sec execute 398 sec latency 35.204 ms 2024-06-13T02:27:35.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:35 smithi084 ceph-mon[36833]: pgmap v306: 129 pgs: 129 active+clean; 84 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 1.8 MiB/s wr, 199 op/s 2024-06-13T02:27:35.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:35 smithi175 ceph-mon[36977]: pgmap v306: 129 pgs: 129 active+clean; 84 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 1.8 MiB/s wr, 199 op/s 2024-06-13T02:27:35.545 INFO:tasks.workunit.client.0.smithi002.stdout: 1 704533 7.19 MB/sec execute 399 sec latency 33.584 ms 2024-06-13T02:27:35.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:35 smithi002 ceph-mon[31960]: pgmap v306: 129 pgs: 129 active+clean; 84 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1018 KiB/s rd, 1.8 MiB/s wr, 199 op/s 2024-06-13T02:27:36.545 INFO:tasks.workunit.client.0.smithi002.stdout: 1 705737 7.18 MB/sec execute 400 sec latency 23.924 ms 2024-06-13T02:27:37.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:37 smithi084 ceph-mon[36833]: pgmap v307: 129 pgs: 129 active+clean; 88 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 247 op/s 2024-06-13T02:27:37.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:37 smithi175 ceph-mon[36977]: pgmap v307: 129 pgs: 129 active+clean; 88 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 247 op/s 2024-06-13T02:27:37.545 INFO:tasks.workunit.client.0.smithi002.stdout: 1 707091 7.19 MB/sec execute 401 sec latency 22.208 ms 2024-06-13T02:27:37.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:37 smithi002 ceph-mon[31960]: pgmap v307: 129 pgs: 129 active+clean; 88 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 247 op/s 2024-06-13T02:27:38.546 INFO:tasks.workunit.client.0.smithi002.stdout: 1 708192 7.19 MB/sec execute 402 sec latency 21.381 ms 2024-06-13T02:27:39.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:39 smithi084 ceph-mon[36833]: pgmap v308: 129 pgs: 129 active+clean; 89 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 208 op/s 2024-06-13T02:27:39.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:39 smithi175 ceph-mon[36977]: pgmap v308: 129 pgs: 129 active+clean; 89 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 208 op/s 2024-06-13T02:27:39.545 INFO:tasks.workunit.client.0.smithi002.stdout: 1 709967 7.19 MB/sec execute 403 sec latency 26.940 ms 2024-06-13T02:27:39.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:39 smithi002 ceph-mon[31960]: pgmap v308: 129 pgs: 129 active+clean; 89 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 208 op/s 2024-06-13T02:27:40.546 INFO:tasks.workunit.client.0.smithi002.stdout: 1 710781 7.19 MB/sec execute 404 sec latency 35.774 ms 2024-06-13T02:27:41.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:41 smithi084 ceph-mon[36833]: pgmap v309: 129 pgs: 129 active+clean; 89 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 193 op/s 2024-06-13T02:27:41.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:41 smithi175 ceph-mon[36977]: pgmap v309: 129 pgs: 129 active+clean; 89 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 193 op/s 2024-06-13T02:27:41.546 INFO:tasks.workunit.client.0.smithi002.stdout: 1 711786 7.18 MB/sec execute 405 sec latency 25.813 ms 2024-06-13T02:27:41.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:41 smithi002 ceph-mon[31960]: pgmap v309: 129 pgs: 129 active+clean; 89 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 193 op/s 2024-06-13T02:27:42.546 INFO:tasks.workunit.client.0.smithi002.stdout: 1 713591 7.19 MB/sec execute 406 sec latency 21.478 ms 2024-06-13T02:27:43.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:43 smithi084 ceph-mon[36833]: pgmap v310: 129 pgs: 129 active+clean; 93 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 252 op/s 2024-06-13T02:27:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.490+0000 7ff287000640 1 -- 172.21.15.2:0/624435071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2801008a0 msgr2=0x7ff280100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.490+0000 7ff287000640 1 --2- 172.21.15.2:0/624435071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2801008a0 0x7ff280100d20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009860 tx=0x7ff26c02a340 comp rx=0 tx=0).stop 2024-06-13T02:27:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.491+0000 7ff287000640 1 -- 172.21.15.2:0/624435071 shutdown_connections 2024-06-13T02:27:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.491+0000 7ff287000640 1 --2- 172.21.15.2:0/624435071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff280101260 0x7ff28010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.491+0000 7ff287000640 1 --2- 172.21.15.2:0/624435071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2801008a0 0x7ff280100d20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.491+0000 7ff287000640 1 --2- 172.21.15.2:0/624435071 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2801068b0 0x7ff280106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.491+0000 7ff287000640 1 -- 172.21.15.2:0/624435071 >> 172.21.15.2:0/624435071 conn(0x7ff280077a20 msgr2=0x7ff280077e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:43.491 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.491+0000 7ff287000640 1 -- 172.21.15.2:0/624435071 shutdown_connections 2024-06-13T02:27:43.492 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.491+0000 7ff287000640 1 -- 172.21.15.2:0/624435071 wait complete. 2024-06-13T02:27:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.492+0000 7ff287000640 1 Processor -- start 2024-06-13T02:27:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.492+0000 7ff287000640 1 -- start start 2024-06-13T02:27:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.492+0000 7ff287000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2801008a0 0x7ff28019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.492+0000 7ff287000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff280101260 0x7ff28019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.492+0000 7ff287000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2801068b0 0x7ff28019ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.493+0000 7ff287000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff280110c80 con 0x7ff2801068b0 2024-06-13T02:27:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.493+0000 7ff287000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff280110b00 con 0x7ff280101260 2024-06-13T02:27:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.493+0000 7ff287000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff280110e00 con 0x7ff2801008a0 2024-06-13T02:27:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.493+0000 7ff27f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff280101260 0x7ff28019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.493+0000 7ff27fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2801008a0 0x7ff28019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.493+0000 7ff27fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2801008a0 0x7ff28019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:44864/0 (socket says 172.21.15.2:44864) 2024-06-13T02:27:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.493+0000 7ff27fe00640 1 -- 172.21.15.2:0/2989875713 learned_addr learned my addr 172.21.15.2:0/2989875713 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.493+0000 7ff285000640 1 --2- 172.21.15.2:0/2989875713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2801068b0 0x7ff28019ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.493+0000 7ff27f400640 1 -- 172.21.15.2:0/2989875713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2801008a0 msgr2=0x7ff28019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.493+0000 7ff27f400640 1 --2- 172.21.15.2:0/2989875713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2801008a0 0x7ff28019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.493+0000 7ff27f400640 1 -- 172.21.15.2:0/2989875713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2801068b0 msgr2=0x7ff28019ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.493+0000 7ff27f400640 1 --2- 172.21.15.2:0/2989875713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2801068b0 0x7ff28019ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.493+0000 7ff27f400640 1 -- 172.21.15.2:0/2989875713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff28019f480 con 0x7ff280101260 2024-06-13T02:27:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.493+0000 7ff285000640 1 --2- 172.21.15.2:0/2989875713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2801068b0 0x7ff28019ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:27:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.494+0000 7ff27f400640 1 --2- 172.21.15.2:0/2989875713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff280101260 0x7ff28019aa20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff26c02a860 tx=0x7ff26c033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.494+0000 7ff27cc00640 1 -- 172.21.15.2:0/2989875713 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c037040 con 0x7ff280101260 2024-06-13T02:27:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.494+0000 7ff27cc00640 1 -- 172.21.15.2:0/2989875713 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c033d50 con 0x7ff280101260 2024-06-13T02:27:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.494+0000 7ff287000640 1 -- 172.21.15.2:0/2989875713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff28019f710 con 0x7ff280101260 2024-06-13T02:27:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.494+0000 7ff27cc00640 1 -- 172.21.15.2:0/2989875713 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0039e0 con 0x7ff280101260 2024-06-13T02:27:43.496 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.494+0000 7ff287000640 1 -- 172.21.15.2:0/2989875713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2801a7000 con 0x7ff280101260 2024-06-13T02:27:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.499+0000 7ff289fc4740 1 Processor -- start 2024-06-13T02:27:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.499+0000 7ff289fc4740 1 -- start start 2024-06-13T02:27:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.499+0000 7ff27cc00640 1 -- 172.21.15.2:0/2989875713 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7ff26c042020 con 0x7ff280101260 2024-06-13T02:27:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.499+0000 7ff289fc4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b85e0 0x55661e2b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.499+0000 7ff289fc4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b7070 0x55661e2b74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.499+0000 7ff289fc4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 0x55661e2c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.499+0000 7ff289fc4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55661e21b420 con 0x55661e2b7070 2024-06-13T02:27:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.499+0000 7ff289fc4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55661e1c2c50 con 0x55661e2b85e0 2024-06-13T02:27:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.499+0000 7ff289fc4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55661e2173e0 con 0x55661e2c1df0 2024-06-13T02:27:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.500+0000 7ff285000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b85e0 0x55661e2b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.500+0000 7ff27f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 0x55661e2c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.500+0000 7ff285000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b85e0 0x55661e2b6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:57024/0 (socket says 172.21.15.2:57024) 2024-06-13T02:27:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.500+0000 7ff285000640 1 -- 172.21.15.2:0/754844594 learned_addr learned my addr 172.21.15.2:0/754844594 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:43.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.500+0000 7ff27fe00640 1 --2- 172.21.15.2:0/754844594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b7070 0x55661e2b74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.502 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.500+0000 7ff27f400640 1 -- 172.21.15.2:0/754844594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b85e0 msgr2=0x55661e2b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.500+0000 7ff27f400640 1 --2- 172.21.15.2:0/754844594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b85e0 0x55661e2b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.500+0000 7ff27f400640 1 -- 172.21.15.2:0/754844594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b7070 msgr2=0x55661e2b74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.500+0000 7ff27f400640 1 --2- 172.21.15.2:0/754844594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b7070 0x55661e2b74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.500+0000 7ff27f400640 1 -- 172.21.15.2:0/754844594 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661df2f210 con 0x55661e2c1df0 2024-06-13T02:27:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.500+0000 7ff27fe00640 1 --2- 172.21.15.2:0/754844594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b7070 0x55661e2b74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:27:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.500+0000 7ff27f400640 1 --2- 172.21.15.2:0/754844594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 0x55661e2c41e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0ec100 tx=0x7ff26c0f2e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74193c5a792f80fe server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.501+0000 7ff275600640 1 -- 172.21.15.2:0/754844594 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0fe070 con 0x55661e2c1df0 2024-06-13T02:27:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.501+0000 7ff275600640 1 -- 172.21.15.2:0/754844594 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c0f4920 con 0x55661e2c1df0 2024-06-13T02:27:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.501+0000 7ff275600640 1 -- 172.21.15.2:0/754844594 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0f3890 con 0x55661e2c1df0 2024-06-13T02:27:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.501+0000 7ff27cc00640 1 --2- 172.21.15.2:0/2989875713 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff2640a2d70 0x7ff2640a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.501+0000 7ff289fc4740 1 -- 172.21.15.2:0/754844594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 msgr2=0x55661e2c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.501+0000 7ff289fc4740 1 --2- 172.21.15.2:0/754844594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 0x55661e2c41e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0ec100 tx=0x7ff26c0f2e30 comp rx=0 tx=0).stop 2024-06-13T02:27:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.501+0000 7ff27cc00640 1 -- 172.21.15.2:0/2989875713 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9583+0+0 (secure 0 0 0) 0x7ff26c0eecf0 con 0x7ff280101260 2024-06-13T02:27:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.501+0000 7ff285000640 1 --2- 172.21.15.2:0/2989875713 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff2640a2d70 0x7ff2640a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.502+0000 7ff289fc4740 1 -- 172.21.15.2:0/754844594 shutdown_connections 2024-06-13T02:27:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.502+0000 7ff289fc4740 1 --2- 172.21.15.2:0/754844594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 0x55661e2c41e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.502+0000 7ff289fc4740 1 --2- 172.21.15.2:0/754844594 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b7070 0x55661e2b74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.502+0000 7ff289fc4740 1 --2- 172.21.15.2:0/754844594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b85e0 0x55661e2b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.502+0000 7ff289fc4740 1 -- 172.21.15.2:0/754844594 >> 172.21.15.2:0/754844594 conn(0x55661e27ffb0 msgr2=0x55661e2b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.502+0000 7ff289fc4740 1 -- 172.21.15.2:0/754844594 shutdown_connections 2024-06-13T02:27:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.502+0000 7ff289fc4740 1 -- 172.21.15.2:0/754844594 wait complete. 2024-06-13T02:27:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.502+0000 7ff285000640 1 --2- 172.21.15.2:0/2989875713 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff2640a2d70 0x7ff2640a5230 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff27800f570 tx=0x7ff278011040 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.503+0000 7ff289fc4740 1 -- start start 2024-06-13T02:27:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.503+0000 7ff289fc4740 1 Processor -- start 2024-06-13T02:27:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.503+0000 7ff289fc4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2b7070 0x55661e2bee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.503+0000 7ff289fc4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b85e0 0x55661e2bf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.503+0000 7ff289fc4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2c1df0 0x55661e2bf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.503+0000 7ff289fc4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55661e2c48e0 con 0x55661e2b85e0 2024-06-13T02:27:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.503+0000 7ff289fc4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55661e1d60b0 con 0x55661e2c1df0 2024-06-13T02:27:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.503+0000 7ff289fc4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55661e2c4a60 con 0x55661e2b7070 2024-06-13T02:27:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.503+0000 7ff289fc4740 10 client.0 _ll_register_callbacks cb 0x55661e1c1f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:27:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.504+0000 7ff27fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2b7070 0x55661e2bee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.504+0000 7ff285000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2c1df0 0x55661e2bf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.504+0000 7ff27fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2b7070 0x55661e2bee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:44886/0 (socket says 172.21.15.2:44886) 2024-06-13T02:27:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.504+0000 7ff27fe00640 1 -- 172.21.15.2:0/263962502 learned_addr learned my addr 172.21.15.2:0/263962502 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.504+0000 7ff27f400640 1 --2- 172.21.15.2:0/263962502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b85e0 0x55661e2bf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.504+0000 7ff27fe00640 1 -- 172.21.15.2:0/263962502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2c1df0 msgr2=0x55661e2bf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.504+0000 7ff27fe00640 1 --2- 172.21.15.2:0/263962502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2c1df0 0x55661e2bf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.504+0000 7ff27fe00640 1 -- 172.21.15.2:0/263962502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b85e0 msgr2=0x55661e2bf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.504+0000 7ff27fe00640 1 --2- 172.21.15.2:0/263962502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b85e0 0x55661e2bf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.504+0000 7ff27fe00640 1 -- 172.21.15.2:0/263962502 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55661dffb620 con 0x55661e2b7070 2024-06-13T02:27:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.504+0000 7ff27f400640 1 --2- 172.21.15.2:0/263962502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b85e0 0x55661e2bf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:27:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.504+0000 7ff285000640 1 --2- 172.21.15.2:0/263962502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2c1df0 0x55661e2bf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:27:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.504+0000 7ff27fe00640 1 --2- 172.21.15.2:0/263962502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2b7070 0x55661e2bee30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff2700126d0 tx=0x7ff270012ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27840379f9f11b19 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.504+0000 7ff26a000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:27:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.505+0000 7ff26a000640 1 -- 172.21.15.2:0/263962502 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270004050 con 0x55661e2b7070 2024-06-13T02:27:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.505+0000 7ff26a000640 1 -- 172.21.15.2:0/263962502 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9583+0+0 (secure 0 0 0) 0x7ff2700041f0 con 0x55661e2b7070 2024-06-13T02:27:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.505+0000 7ff289fc4740 1 -- 172.21.15.2:0/263962502 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff26c0f4920 con 0x55661e2b7070 2024-06-13T02:27:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.505+0000 7ff26a000640 1 -- 172.21.15.2:0/263962502 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff2700043f0 con 0x55661e2b7070 2024-06-13T02:27:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.505+0000 7ff289fc4740 10 client.26035 fetch_fsmap learned FSMap version 35 2024-06-13T02:27:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.505+0000 7ff289fc4740 1 -- 172.21.15.2:0/263962502 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55661e2d0ce0 con 0x55661e2b7070 2024-06-13T02:27:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.505+0000 7ff26a000640 1 -- 172.21.15.2:0/263962502 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c0f4920 con 0x55661e2b7070 2024-06-13T02:27:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.506+0000 7ff26a000640 1 -- 172.21.15.2:0/263962502 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff27000f970 con 0x55661e2b7070 2024-06-13T02:27:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.506+0000 7ff289fc4740 10 client.26035 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:27:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.506+0000 7ff289fc4740 10 client.26035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:27:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.506+0000 7ff289fc4740 20 client.26035 populate_metadata read hostname 'smithi002' 2024-06-13T02:27:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.506+0000 7ff289fc4740 1 --2- 172.21.15.2:0/263962502 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55661e2d21a0 0x55661e2d45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.506+0000 7ff289fc4740 4 client.26035 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:27:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.506+0000 7ff289fc4740 1 -- 172.21.15.2:0/263962502 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55661e228b50 con 0x55661e2d21a0 2024-06-13T02:27:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.506+0000 7ff27f400640 1 --2- 172.21.15.2:0/263962502 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55661e2d21a0 0x55661e2d45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.507+0000 7ff27f400640 1 --2- 172.21.15.2:0/263962502 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55661e2d21a0 0x55661e2d45f0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c272cf2ef551ed6 server_cookie=e89019b776d4163b in_seq=0 out_seq=0 2024-06-13T02:27:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.507+0000 7ff26a000640 10 client.26035 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.508+0000 7ff26a000640 1 -- 172.21.15.2:0/263962502 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55661e228b50 con 0x55661e2d21a0 2024-06-13T02:27:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.508+0000 7ff26a000640 10 client.26035 handle_command_reply: tid=0 2024-06-13T02:27:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.508+0000 7ff289fc4740 1 client.26035 shutdown 2024-06-13T02:27:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.509+0000 7ff289fc4740 1 -- 172.21.15.2:0/263962502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2b7070 msgr2=0x55661e2bee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.509+0000 7ff289fc4740 1 --2- 172.21.15.2:0/263962502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2b7070 0x55661e2bee30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff2700126d0 tx=0x7ff270012ad0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.509+0000 7ff289fc4740 1 -- 172.21.15.2:0/263962502 shutdown_connections 2024-06-13T02:27:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.509+0000 7ff289fc4740 1 --2- 172.21.15.2:0/263962502 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55661e2d21a0 0x55661e2d45f0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.509+0000 7ff289fc4740 1 --2- 172.21.15.2:0/263962502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2c1df0 0x55661e2bf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.509+0000 7ff289fc4740 1 --2- 172.21.15.2:0/263962502 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b85e0 0x55661e2bf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.509+0000 7ff289fc4740 1 --2- 172.21.15.2:0/263962502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2b7070 0x55661e2bee30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.509+0000 7ff26a000640 0 client.26035 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.509+0000 7ff289fc4740 1 -- 172.21.15.2:0/263962502 >> 172.21.15.2:0/263962502 conn(0x55661e27ffb0 msgr2=0x55661e2b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.509+0000 7ff289fc4740 1 -- 172.21.15.2:0/263962502 shutdown_connections 2024-06-13T02:27:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.509+0000 7ff289fc4740 1 -- 172.21.15.2:0/263962502 wait complete. 2024-06-13T02:27:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.509+0000 7ff289fc4740 20 client.26035 trim_cache size 0 max 16384 2024-06-13T02:27:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.528+0000 7ff289fc4740 1 Processor -- start 2024-06-13T02:27:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.528+0000 7ff289fc4740 1 -- start start 2024-06-13T02:27:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.528+0000 7ff289fc4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b7070 0x55661e2b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.528+0000 7ff289fc4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b85e0 0x55661e2d9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.528+0000 7ff289fc4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 0x55661e2da440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.528+0000 7ff289fc4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff2801b3bc0 con 0x55661e2b7070 2024-06-13T02:27:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.528+0000 7ff289fc4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff2801b1490 con 0x55661e2b85e0 2024-06-13T02:27:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.528+0000 7ff289fc4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2801af300 con 0x55661e2c1df0 2024-06-13T02:27:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.529+0000 7ff27f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b85e0 0x55661e2d9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.529+0000 7ff27f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b85e0 0x55661e2d9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:57036/0 (socket says 172.21.15.2:57036) 2024-06-13T02:27:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.529+0000 7ff27f400640 1 -- 172.21.15.2:0/1702187010 learned_addr learned my addr 172.21.15.2:0/1702187010 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.529+0000 7ff27fe00640 1 --2- 172.21.15.2:0/1702187010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b7070 0x55661e2b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.529+0000 7ff285000640 1 --2- 172.21.15.2:0/1702187010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 0x55661e2da440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.529+0000 7ff27f400640 1 -- 172.21.15.2:0/1702187010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 msgr2=0x55661e2da440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.529+0000 7ff27f400640 1 --2- 172.21.15.2:0/1702187010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 0x55661e2da440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.529+0000 7ff27f400640 1 -- 172.21.15.2:0/1702187010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b7070 msgr2=0x55661e2b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.529+0000 7ff27f400640 1 --2- 172.21.15.2:0/1702187010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b7070 0x55661e2b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.529+0000 7ff27f400640 1 -- 172.21.15.2:0/1702187010 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661e2bdde0 con 0x55661e2b85e0 2024-06-13T02:27:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.529+0000 7ff27f400640 1 --2- 172.21.15.2:0/1702187010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b85e0 0x55661e2d9f00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff26c02a930 tx=0x7ff26c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9457370d8264361b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.530+0000 7ff274c00640 1 -- 172.21.15.2:0/1702187010 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0fe070 con 0x55661e2b85e0 2024-06-13T02:27:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.530+0000 7ff274c00640 1 -- 172.21.15.2:0/1702187010 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c0f2610 con 0x55661e2b85e0 2024-06-13T02:27:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.530+0000 7ff274c00640 1 -- 172.21.15.2:0/1702187010 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0baa40 con 0x55661e2b85e0 2024-06-13T02:27:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.530+0000 7ff289fc4740 1 -- 172.21.15.2:0/1702187010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b85e0 msgr2=0x55661e2d9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:43.531 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.530+0000 7ff289fc4740 1 --2- 172.21.15.2:0/1702187010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b85e0 0x55661e2d9f00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff26c02a930 tx=0x7ff26c005f90 comp rx=0 tx=0).stop 2024-06-13T02:27:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.531+0000 7ff289fc4740 1 -- 172.21.15.2:0/1702187010 shutdown_connections 2024-06-13T02:27:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.531+0000 7ff289fc4740 1 --2- 172.21.15.2:0/1702187010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 0x55661e2da440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.531+0000 7ff289fc4740 1 --2- 172.21.15.2:0/1702187010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b85e0 0x55661e2d9f00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.531+0000 7ff289fc4740 1 --2- 172.21.15.2:0/1702187010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b7070 0x55661e2b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.531+0000 7ff289fc4740 1 -- 172.21.15.2:0/1702187010 >> 172.21.15.2:0/1702187010 conn(0x55661e27ffb0 msgr2=0x55661e2b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.531+0000 7ff289fc4740 1 -- 172.21.15.2:0/1702187010 shutdown_connections 2024-06-13T02:27:43.532 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.531+0000 7ff289fc4740 1 -- 172.21.15.2:0/1702187010 wait complete. 2024-06-13T02:27:43.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:43 smithi175 ceph-mon[36977]: pgmap v310: 129 pgs: 129 active+clean; 93 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 252 op/s 2024-06-13T02:27:43.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.531+0000 7ff289fc4740 1 -- start start 2024-06-13T02:27:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.532+0000 7ff289fc4740 1 Processor -- start 2024-06-13T02:27:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.532+0000 7ff289fc4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b7070 0x55661e2ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.532+0000 7ff289fc4740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b85e0 0x55661e2c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.532+0000 7ff289fc4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 0x55661e2c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.532+0000 7ff289fc4740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff2801af950 con 0x55661e2b85e0 2024-06-13T02:27:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.532+0000 7ff289fc4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff2801b0dc0 con 0x55661e2b7070 2024-06-13T02:27:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.532+0000 7ff289fc4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2801b0020 con 0x55661e2c1df0 2024-06-13T02:27:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.532+0000 7ff289fc4740 10 client.0 _ll_register_callbacks cb 0x7ff270009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:27:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.532+0000 7ff27fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b7070 0x55661e2ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.532+0000 7ff27fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b7070 0x55661e2ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:57040/0 (socket says 172.21.15.2:57040) 2024-06-13T02:27:43.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.532+0000 7ff27fe00640 1 -- 172.21.15.2:0/1274785629 learned_addr learned my addr 172.21.15.2:0/1274785629 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.532+0000 7ff285000640 1 --2- 172.21.15.2:0/1274785629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 0x55661e2c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.532+0000 7ff27f400640 1 --2- 172.21.15.2:0/1274785629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b85e0 0x55661e2c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.533+0000 7ff27fe00640 1 -- 172.21.15.2:0/1274785629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 msgr2=0x55661e2c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.533+0000 7ff27fe00640 1 --2- 172.21.15.2:0/1274785629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 0x55661e2c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.533+0000 7ff27fe00640 1 -- 172.21.15.2:0/1274785629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b85e0 msgr2=0x55661e2c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.533+0000 7ff27fe00640 1 --2- 172.21.15.2:0/1274785629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b85e0 0x55661e2c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.537 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.533+0000 7ff27fe00640 1 -- 172.21.15.2:0/1274785629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55661e2c6300 con 0x55661e2b7070 2024-06-13T02:27:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.533+0000 7ff27fe00640 1 --2- 172.21.15.2:0/1274785629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b7070 0x55661e2ca360 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff270014000 tx=0x7ff27000f420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36f59bc911b79ec6 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.533+0000 7ff26a000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:27:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.533+0000 7ff26a000640 1 -- 172.21.15.2:0/1274785629 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270005250 con 0x55661e2b7070 2024-06-13T02:27:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.533+0000 7ff26a000640 1 -- 172.21.15.2:0/1274785629 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9583+0+0 (secure 0 0 0) 0x7ff2700053f0 con 0x55661e2b7070 2024-06-13T02:27:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.533+0000 7ff289fc4740 1 -- 172.21.15.2:0/1274785629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff26c0f2610 con 0x55661e2b7070 2024-06-13T02:27:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.534+0000 7ff26a000640 1 -- 172.21.15.2:0/1274785629 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff2700055f0 con 0x55661e2b7070 2024-06-13T02:27:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.534+0000 7ff289fc4740 10 client.26057 fetch_fsmap learned FSMap version 35 2024-06-13T02:27:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.534+0000 7ff289fc4740 1 -- 172.21.15.2:0/1274785629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55661e33ce40 con 0x55661e2b7070 2024-06-13T02:27:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.534+0000 7ff26a000640 1 -- 172.21.15.2:0/1274785629 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c0f2610 con 0x55661e2b7070 2024-06-13T02:27:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.534+0000 7ff26a000640 1 -- 172.21.15.2:0/1274785629 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff2700105d0 con 0x55661e2b7070 2024-06-13T02:27:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.534+0000 7ff289fc4740 10 client.26057 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:27:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.534+0000 7ff289fc4740 10 client.26057 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.534+0000 7ff289fc4740 20 client.26057 populate_metadata read hostname 'smithi002' 2024-06-13T02:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.534+0000 7ff289fc4740 1 --2- 172.21.15.2:0/1274785629 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55661e33d5f0 0x55661e33fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.534+0000 7ff289fc4740 4 client.26057 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.534+0000 7ff289fc4740 1 -- 172.21.15.2:0/1274785629 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55661e222ea0 con 0x55661e33d5f0 2024-06-13T02:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.534+0000 7ff27f400640 1 --2- 172.21.15.2:0/1274785629 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55661e33d5f0 0x55661e33fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.535+0000 7ff27f400640 1 --2- 172.21.15.2:0/1274785629 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55661e33d5f0 0x55661e33fa10 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fe884f55540c3e8 server_cookie=294598938b3242c5 in_seq=0 out_seq=0 2024-06-13T02:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.535+0000 7ff26a000640 10 client.26057 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:43.546 INFO:tasks.workunit.client.0.smithi002.stdout: 1 714375 7.18 MB/sec execute 407 sec latency 35.954 ms 2024-06-13T02:27:43.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:43 smithi002 ceph-mon[31960]: pgmap v310: 129 pgs: 129 active+clean; 93 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 252 op/s 2024-06-13T02:27:43.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.813+0000 7ff26a000640 1 -- 172.21.15.2:0/1274785629 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55661e222ea0 con 0x55661e33d5f0 2024-06-13T02:27:43.813 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.813+0000 7ff26a000640 10 client.26057 handle_command_reply: tid=0 2024-06-13T02:27:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.813+0000 7ff289fc4740 1 client.26057 shutdown 2024-06-13T02:27:43.814 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.813+0000 7ff289fc4740 1 -- 172.21.15.2:0/1274785629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b7070 msgr2=0x55661e2ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.813+0000 7ff289fc4740 1 --2- 172.21.15.2:0/1274785629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b7070 0x55661e2ca360 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff270014000 tx=0x7ff27000f420 comp rx=0 tx=0).stop 2024-06-13T02:27:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.813+0000 7ff289fc4740 1 -- 172.21.15.2:0/1274785629 shutdown_connections 2024-06-13T02:27:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.814+0000 7ff289fc4740 1 --2- 172.21.15.2:0/1274785629 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55661e33d5f0 0x55661e33fa10 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.814+0000 7ff289fc4740 1 --2- 172.21.15.2:0/1274785629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55661e2c1df0 0x55661e2c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.814+0000 7ff289fc4740 1 --2- 172.21.15.2:0/1274785629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55661e2b85e0 0x55661e2c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.814+0000 7ff289fc4740 1 --2- 172.21.15.2:0/1274785629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55661e2b7070 0x55661e2ca360 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.814+0000 7ff289fc4740 1 -- 172.21.15.2:0/1274785629 >> 172.21.15.2:0/1274785629 conn(0x55661e27ffb0 msgr2=0x55661e2b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.814+0000 7ff26a000640 0 client.26057 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.814+0000 7ff289fc4740 1 -- 172.21.15.2:0/1274785629 shutdown_connections 2024-06-13T02:27:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.814+0000 7ff289fc4740 1 -- 172.21.15.2:0/1274785629 wait complete. 2024-06-13T02:27:43.815 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.814+0000 7ff289fc4740 20 client.26057 trim_cache size 0 max 16384 2024-06-13T02:27:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:27:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:27:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:27:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.815+0000 7ff287000640 1 -- 172.21.15.2:0/2989875713 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff2640a2d70 msgr2=0x7ff2640a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.815+0000 7ff287000640 1 --2- 172.21.15.2:0/2989875713 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff2640a2d70 0x7ff2640a5230 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff27800f570 tx=0x7ff278011040 comp rx=0 tx=0).stop 2024-06-13T02:27:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.815+0000 7ff287000640 1 -- 172.21.15.2:0/2989875713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff280101260 msgr2=0x7ff28019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.815+0000 7ff287000640 1 --2- 172.21.15.2:0/2989875713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff280101260 0x7ff28019aa20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff26c02a860 tx=0x7ff26c033b60 comp rx=0 tx=0).stop 2024-06-13T02:27:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.815+0000 7ff287000640 1 -- 172.21.15.2:0/2989875713 shutdown_connections 2024-06-13T02:27:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.815+0000 7ff287000640 1 --2- 172.21.15.2:0/2989875713 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff2640a2d70 0x7ff2640a5230 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.815+0000 7ff287000640 1 --2- 172.21.15.2:0/2989875713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2801068b0 0x7ff28019ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.815+0000 7ff287000640 1 --2- 172.21.15.2:0/2989875713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff280101260 0x7ff28019aa20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.815+0000 7ff287000640 1 --2- 172.21.15.2:0/2989875713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2801008a0 0x7ff28019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:43.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.815+0000 7ff287000640 1 -- 172.21.15.2:0/2989875713 >> 172.21.15.2:0/2989875713 conn(0x7ff280077a20 msgr2=0x7ff28006a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:43.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.815+0000 7ff287000640 1 -- 172.21.15.2:0/2989875713 shutdown_connections 2024-06-13T02:27:43.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:43.815+0000 7ff287000640 1 -- 172.21.15.2:0/2989875713 wait complete. 2024-06-13T02:27:44.546 INFO:tasks.workunit.client.0.smithi002.stdout: 1 715284 7.17 MB/sec execute 408 sec latency 147.641 ms 2024-06-13T02:27:45.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:45 smithi084 ceph-mon[36833]: pgmap v311: 129 pgs: 129 active+clean; 93 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 120 op/s 2024-06-13T02:27:45.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:45 smithi175 ceph-mon[36977]: pgmap v311: 129 pgs: 129 active+clean; 93 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 120 op/s 2024-06-13T02:27:45.546 INFO:tasks.workunit.client.0.smithi002.stdout: 1 716775 7.17 MB/sec execute 409 sec latency 41.375 ms 2024-06-13T02:27:45.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:45 smithi002 ceph-mon[31960]: pgmap v311: 129 pgs: 129 active+clean; 93 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 120 op/s 2024-06-13T02:27:46.546 INFO:tasks.workunit.client.0.smithi002.stdout: 1 717864 7.17 MB/sec execute 410 sec latency 23.554 ms 2024-06-13T02:27:47.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:47 smithi084 ceph-mon[36833]: pgmap v312: 129 pgs: 129 active+clean; 85 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 230 op/s 2024-06-13T02:27:47.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:47 smithi175 ceph-mon[36977]: pgmap v312: 129 pgs: 129 active+clean; 85 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 230 op/s 2024-06-13T02:27:47.546 INFO:tasks.workunit.client.0.smithi002.stdout: 1 718782 7.17 MB/sec execute 411 sec latency 95.822 ms 2024-06-13T02:27:47.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:47 smithi002 ceph-mon[31960]: pgmap v312: 129 pgs: 129 active+clean; 85 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 230 op/s 2024-06-13T02:27:48.547 INFO:tasks.workunit.client.0.smithi002.stdout: 1 720242 7.17 MB/sec execute 412 sec latency 24.749 ms 2024-06-13T02:27:49.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:49 smithi084 ceph-mon[36833]: pgmap v313: 129 pgs: 129 active+clean; 85 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 216 op/s 2024-06-13T02:27:49.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:49 smithi175 ceph-mon[36977]: pgmap v313: 129 pgs: 129 active+clean; 85 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 216 op/s 2024-06-13T02:27:49.546 INFO:tasks.workunit.client.0.smithi002.stdout: 1 721015 7.16 MB/sec execute 413 sec latency 80.692 ms 2024-06-13T02:27:49.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:49 smithi002 ceph-mon[31960]: pgmap v313: 129 pgs: 129 active+clean; 85 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 216 op/s 2024-06-13T02:27:50.547 INFO:tasks.workunit.client.0.smithi002.stdout: 1 721925 7.15 MB/sec execute 414 sec latency 26.976 ms 2024-06-13T02:27:51.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:51 smithi084 ceph-mon[36833]: pgmap v314: 129 pgs: 129 active+clean; 85 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 203 op/s 2024-06-13T02:27:51.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:51 smithi175 ceph-mon[36977]: pgmap v314: 129 pgs: 129 active+clean; 85 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 203 op/s 2024-06-13T02:27:51.547 INFO:tasks.workunit.client.0.smithi002.stdout: 1 723153 7.15 MB/sec execute 415 sec latency 28.406 ms 2024-06-13T02:27:51.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:51 smithi002 ceph-mon[31960]: pgmap v314: 129 pgs: 129 active+clean; 85 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 203 op/s 2024-06-13T02:27:52.547 INFO:tasks.workunit.client.0.smithi002.stdout: 1 724540 7.16 MB/sec execute 416 sec latency 22.658 ms 2024-06-13T02:27:53.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:53 smithi084 ceph-mon[36833]: pgmap v315: 129 pgs: 129 active+clean; 89 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 266 op/s 2024-06-13T02:27:53.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:53 smithi175 ceph-mon[36977]: pgmap v315: 129 pgs: 129 active+clean; 89 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 266 op/s 2024-06-13T02:27:53.547 INFO:tasks.workunit.client.0.smithi002.stdout: 1 725349 7.15 MB/sec execute 417 sec latency 22.612 ms 2024-06-13T02:27:53.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:53 smithi002 ceph-mon[31960]: pgmap v315: 129 pgs: 129 active+clean; 89 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 266 op/s 2024-06-13T02:27:54.548 INFO:tasks.workunit.client.0.smithi002.stdout: 1 726488 7.14 MB/sec execute 418 sec latency 41.984 ms 2024-06-13T02:27:55.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:55 smithi084 ceph-mon[36833]: pgmap v316: 129 pgs: 129 active+clean; 89 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 1.7 MiB/s wr, 207 op/s 2024-06-13T02:27:55.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:55 smithi175 ceph-mon[36977]: pgmap v316: 129 pgs: 129 active+clean; 89 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 1.7 MiB/s wr, 207 op/s 2024-06-13T02:27:55.547 INFO:tasks.workunit.client.0.smithi002.stdout: 1 728026 7.15 MB/sec execute 419 sec latency 83.961 ms 2024-06-13T02:27:55.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:55 smithi002 ceph-mon[31960]: pgmap v316: 129 pgs: 129 active+clean; 89 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 1.7 MiB/s wr, 207 op/s 2024-06-13T02:27:56.548 INFO:tasks.workunit.client.0.smithi002.stdout: 1 728769 7.14 MB/sec execute 420 sec latency 24.113 ms 2024-06-13T02:27:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.967+0000 7f81fdc00640 1 -- 172.21.15.2:0/2683206343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f8102980 msgr2=0x7f81f8102d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.967+0000 7f81fdc00640 1 --2- 172.21.15.2:0/2683206343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f8102980 0x7f81f8102d60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009900 tx=0x7f81e802a480 comp rx=0 tx=0).stop 2024-06-13T02:27:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.967+0000 7f81fdc00640 1 -- 172.21.15.2:0/2683206343 shutdown_connections 2024-06-13T02:27:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.967+0000 7f81fdc00640 1 --2- 172.21.15.2:0/2683206343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81f810bda0 0x7f81f810e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.967+0000 7f81fdc00640 1 --2- 172.21.15.2:0/2683206343 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81f81032a0 0x7f81f810b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.967+0000 7f81fdc00640 1 --2- 172.21.15.2:0/2683206343 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f8102980 0x7f81f8102d60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.967+0000 7f81fdc00640 1 -- 172.21.15.2:0/2683206343 >> 172.21.15.2:0/2683206343 conn(0x7f81f80fc180 msgr2=0x7f81f80fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.967+0000 7f81fdc00640 1 -- 172.21.15.2:0/2683206343 shutdown_connections 2024-06-13T02:27:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.967+0000 7f81fdc00640 1 -- 172.21.15.2:0/2683206343 wait complete. 2024-06-13T02:27:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.968+0000 7f81fdc00640 1 Processor -- start 2024-06-13T02:27:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.968+0000 7f81fdc00640 1 -- start start 2024-06-13T02:27:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.969+0000 7f81fdc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81f8102980 0x7f81f819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.969+0000 7f81fdc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81f81032a0 0x7f81f819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.969+0000 7f81fdc00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f810bda0 0x7f81f819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.969+0000 7f81fdc00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f81f8111bf0 con 0x7f81f8102980 2024-06-13T02:27:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.969+0000 7f81fdc00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f81f8111a70 con 0x7f81f810bda0 2024-06-13T02:27:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.969+0000 7f81fdc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81f8111d70 con 0x7f81f81032a0 2024-06-13T02:27:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.969+0000 7f81f7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81f81032a0 0x7f81f819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.969+0000 7f81f7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81f81032a0 0x7f81f819a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:54336/0 (socket says 172.21.15.2:54336) 2024-06-13T02:27:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.969+0000 7f81f7400640 1 -- 172.21.15.2:0/3784335664 learned_addr learned my addr 172.21.15.2:0/3784335664 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.969+0000 7f81fd200640 1 --2- 172.21.15.2:0/3784335664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f810bda0 0x7f81f819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.969+0000 7f81f7e00640 1 --2- 172.21.15.2:0/3784335664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81f8102980 0x7f81f819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.970+0000 7f81f7400640 1 -- 172.21.15.2:0/3784335664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f810bda0 msgr2=0x7f81f819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.970+0000 7f81f7400640 1 --2- 172.21.15.2:0/3784335664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f810bda0 0x7f81f819eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.970+0000 7f81f7400640 1 -- 172.21.15.2:0/3784335664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81f8102980 msgr2=0x7f81f819a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.970+0000 7f81f7400640 1 --2- 172.21.15.2:0/3784335664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81f8102980 0x7f81f819a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.970+0000 7f81f7400640 1 -- 172.21.15.2:0/3784335664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f819f290 con 0x7f81f81032a0 2024-06-13T02:27:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.970+0000 7f81fd200640 1 --2- 172.21.15.2:0/3784335664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f810bda0 0x7f81f819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:27:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.970+0000 7f81f7400640 1 --2- 172.21.15.2:0/3784335664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81f81032a0 0x7f81f819a7e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f81e400d740 tx=0x7f81e400dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.970+0000 7f81f4c00640 1 -- 172.21.15.2:0/3784335664 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4017070 con 0x7f81f81032a0 2024-06-13T02:27:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.970+0000 7f81f4c00640 1 -- 172.21.15.2:0/3784335664 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e400de50 con 0x7f81f81032a0 2024-06-13T02:27:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.970+0000 7f81f4c00640 1 -- 172.21.15.2:0/3784335664 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e400f620 con 0x7f81f81032a0 2024-06-13T02:27:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.970+0000 7f81fdc00640 1 -- 172.21.15.2:0/3784335664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f819f580 con 0x7f81f81032a0 2024-06-13T02:27:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.970+0000 7f81fdc00640 1 -- 172.21.15.2:0/3784335664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f81a6e10 con 0x7f81f81032a0 2024-06-13T02:27:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.974+0000 7f820207e740 1 Processor -- start 2024-06-13T02:27:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.974+0000 7f820207e740 1 -- start start 2024-06-13T02:27:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.974+0000 7f81f4c00640 1 -- 172.21.15.2:0/3784335664 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f81e4009c30 con 0x7f81f81032a0 2024-06-13T02:27:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.974+0000 7f820207e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c57a0 0x55f4b13c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.975+0000 7f820207e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c4230 0x55f4b13c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.975+0000 7f820207e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.975+0000 7f820207e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f4b1328420 con 0x55f4b13cefb0 2024-06-13T02:27:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.975+0000 7f820207e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f4b12cfc50 con 0x55f4b13c4230 2024-06-13T02:27:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.975+0000 7f820207e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f4b13243e0 con 0x55f4b13c57a0 2024-06-13T02:27:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.975+0000 7f81f7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c4230 0x55f4b13c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.975+0000 7f81f7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c4230 0x55f4b13c46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:46452/0 (socket says 172.21.15.2:46452) 2024-06-13T02:27:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.975+0000 7f81f7e00640 1 -- 172.21.15.2:0/3466187698 learned_addr learned my addr 172.21.15.2:0/3466187698 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.975+0000 7f81fd200640 1 --2- 172.21.15.2:0/3466187698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c57a0 0x55f4b13c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.975+0000 7f81f7400640 1 --2- 172.21.15.2:0/3466187698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.975+0000 7f81fd200640 1 -- 172.21.15.2:0/3466187698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c4230 msgr2=0x55f4b13c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.975+0000 7f81fd200640 1 --2- 172.21.15.2:0/3466187698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c4230 0x55f4b13c46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.975+0000 7f81fd200640 1 -- 172.21.15.2:0/3466187698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 msgr2=0x55f4b13d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.975+0000 7f81fd200640 1 --2- 172.21.15.2:0/3466187698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.976+0000 7f81fd200640 1 -- 172.21.15.2:0/3466187698 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b103c210 con 0x55f4b13c57a0 2024-06-13T02:27:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.976+0000 7f81f7e00640 1 --2- 172.21.15.2:0/3466187698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c4230 0x55f4b13c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:27:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.976+0000 7f81fd200640 1 --2- 172.21.15.2:0/3466187698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c57a0 0x55f4b13c3cf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f81f0011760 tx=0x7f81f0011c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4cee6d9e3f3b3cb server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.976+0000 7f81f4c00640 1 --2- 172.21.15.2:0/3784335664 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f81dc0a2d60 0x7f81dc0a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.976+0000 7f81ed600640 1 -- 172.21.15.2:0/3466187698 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f0004d20 con 0x55f4b13c57a0 2024-06-13T02:27:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.976+0000 7f81ed600640 1 -- 172.21.15.2:0/3466187698 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81f000f9a0 con 0x55f4b13c57a0 2024-06-13T02:27:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.976+0000 7f81ed600640 1 -- 172.21.15.2:0/3466187698 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f00045b0 con 0x55f4b13c57a0 2024-06-13T02:27:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.976+0000 7f81f4c00640 1 -- 172.21.15.2:0/3784335664 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9583+0+0 (secure 0 0 0) 0x7f81e40cf360 con 0x7f81f81032a0 2024-06-13T02:27:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.977+0000 7f81f7e00640 1 --2- 172.21.15.2:0/3784335664 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f81dc0a2d60 0x7f81dc0a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.977+0000 7f820207e740 1 -- 172.21.15.2:0/3466187698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c57a0 msgr2=0x55f4b13c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.977+0000 7f820207e740 1 --2- 172.21.15.2:0/3466187698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c57a0 0x55f4b13c3cf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f81f0011760 tx=0x7f81f0011c20 comp rx=0 tx=0).stop 2024-06-13T02:27:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.977+0000 7f820207e740 1 -- 172.21.15.2:0/3466187698 shutdown_connections 2024-06-13T02:27:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.977+0000 7f820207e740 1 --2- 172.21.15.2:0/3466187698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.977+0000 7f820207e740 1 --2- 172.21.15.2:0/3466187698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c4230 0x55f4b13c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.977+0000 7f820207e740 1 --2- 172.21.15.2:0/3466187698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c57a0 0x55f4b13c3cf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.977+0000 7f820207e740 1 -- 172.21.15.2:0/3466187698 >> 172.21.15.2:0/3466187698 conn(0x55f4b138cfb0 msgr2=0x55f4b13c0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.977+0000 7f81f7e00640 1 --2- 172.21.15.2:0/3784335664 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f81dc0a2d60 0x7f81dc0a5220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f81e8005c40 tx=0x7f81e8005b50 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.978+0000 7f820207e740 1 -- 172.21.15.2:0/3466187698 shutdown_connections 2024-06-13T02:27:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.978+0000 7f820207e740 1 -- 172.21.15.2:0/3466187698 wait complete. 2024-06-13T02:27:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.978+0000 7f820207e740 1 -- start start 2024-06-13T02:27:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.978+0000 7f820207e740 1 Processor -- start 2024-06-13T02:27:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.979+0000 7f820207e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c4230 0x55f4b13cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.979+0000 7f820207e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c57a0 0x55f4b13cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.979+0000 7f820207e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.979+0000 7f820207e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55f4b13d1d80 con 0x55f4b13cefb0 2024-06-13T02:27:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.979+0000 7f820207e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f4b12e30b0 con 0x55f4b13c57a0 2024-06-13T02:27:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.979+0000 7f820207e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f4b13d1f00 con 0x55f4b13c4230 2024-06-13T02:27:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.979+0000 7f820207e740 10 client.0 _ll_register_callbacks cb 0x55f4b12cef40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:27:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.979+0000 7f81f7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c57a0 0x55f4b13cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.979+0000 7f81f7400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c57a0 0x55f4b13cc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:46456/0 (socket says 172.21.15.2:46456) 2024-06-13T02:27:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.979+0000 7f81f7400640 1 -- 172.21.15.2:0/762499930 learned_addr learned my addr 172.21.15.2:0/762499930 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:56.984 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.979+0000 7f81f7e00640 1 --2- 172.21.15.2:0/762499930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c4230 0x55f4b13cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.979+0000 7f81fd200640 1 --2- 172.21.15.2:0/762499930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.979+0000 7f81f7400640 1 -- 172.21.15.2:0/762499930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c4230 msgr2=0x55f4b13cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.979+0000 7f81f7400640 1 --2- 172.21.15.2:0/762499930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c4230 0x55f4b13cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.980+0000 7f81f7400640 1 -- 172.21.15.2:0/762499930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 msgr2=0x55f4b13ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.980+0000 7f81f7400640 1 --2- 172.21.15.2:0/762499930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.980+0000 7f81f7400640 1 -- 172.21.15.2:0/762499930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4b1108620 con 0x55f4b13c57a0 2024-06-13T02:27:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.980+0000 7f81fd200640 1 --2- 172.21.15.2:0/762499930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:27:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.980+0000 7f81f7400640 1 --2- 172.21.15.2:0/762499930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c57a0 0x55f4b13cc5a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f81e4005fd0 tx=0x7f81e4097810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4ca4b22a6ef15b2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.980+0000 7f81e2000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:27:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.980+0000 7f81e2000640 1 -- 172.21.15.2:0/762499930 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4020070 con 0x55f4b13c57a0 2024-06-13T02:27:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.980+0000 7f820207e740 1 -- 172.21.15.2:0/762499930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81f000f9a0 con 0x55f4b13c57a0 2024-06-13T02:27:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.980+0000 7f81e2000640 1 -- 172.21.15.2:0/762499930 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9583+0+0 (secure 0 0 0) 0x7f81e409a900 con 0x55f4b13c57a0 2024-06-13T02:27:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.980+0000 7f81e2000640 1 -- 172.21.15.2:0/762499930 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f81e409ae10 con 0x55f4b13c57a0 2024-06-13T02:27:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.980+0000 7f820207e740 10 client.26069 fetch_fsmap learned FSMap version 35 2024-06-13T02:27:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.980+0000 7f820207e740 1 -- 172.21.15.2:0/762499930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f4b13de1e0 con 0x55f4b13c57a0 2024-06-13T02:27:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.981+0000 7f81e2000640 1 -- 172.21.15.2:0/762499930 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81f000f9a0 con 0x55f4b13c57a0 2024-06-13T02:27:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.981+0000 7f81e2000640 1 -- 172.21.15.2:0/762499930 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f81e409a370 con 0x55f4b13c57a0 2024-06-13T02:27:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.981+0000 7f820207e740 10 client.26069 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:27:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.981+0000 7f820207e740 10 client.26069 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:27:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.981+0000 7f820207e740 20 client.26069 populate_metadata read hostname 'smithi002' 2024-06-13T02:27:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.981+0000 7f820207e740 1 --2- 172.21.15.2:0/762499930 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f4b13df650 0x55f4b13e1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.981+0000 7f820207e740 4 client.26069 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:27:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.981+0000 7f820207e740 1 -- 172.21.15.2:0/762499930 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4b1335b50 con 0x55f4b13df650 2024-06-13T02:27:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.981+0000 7f81f7e00640 1 --2- 172.21.15.2:0/762499930 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f4b13df650 0x55f4b13e1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.982+0000 7f81f7e00640 1 --2- 172.21.15.2:0/762499930 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f4b13df650 0x55f4b13e1a40 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d75283757735c98 server_cookie=b1d323c27257a151 in_seq=0 out_seq=0 2024-06-13T02:27:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.982+0000 7f81e2000640 10 client.26069 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.983+0000 7f81e2000640 1 -- 172.21.15.2:0/762499930 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f4b1335b50 con 0x55f4b13df650 2024-06-13T02:27:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.983+0000 7f81e2000640 10 client.26069 handle_command_reply: tid=0 2024-06-13T02:27:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.983+0000 7f820207e740 1 client.26069 shutdown 2024-06-13T02:27:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.983+0000 7f820207e740 1 -- 172.21.15.2:0/762499930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c57a0 msgr2=0x55f4b13cc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.983+0000 7f820207e740 1 --2- 172.21.15.2:0/762499930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c57a0 0x55f4b13cc5a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f81e4005fd0 tx=0x7f81e4097810 comp rx=0 tx=0).stop 2024-06-13T02:27:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.983+0000 7f820207e740 1 -- 172.21.15.2:0/762499930 shutdown_connections 2024-06-13T02:27:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.983+0000 7f820207e740 1 --2- 172.21.15.2:0/762499930 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f4b13df650 0x55f4b13e1a40 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.983+0000 7f820207e740 1 --2- 172.21.15.2:0/762499930 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.983+0000 7f81e2000640 0 client.26069 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.983+0000 7f820207e740 1 --2- 172.21.15.2:0/762499930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c57a0 0x55f4b13cc5a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.983+0000 7f820207e740 1 --2- 172.21.15.2:0/762499930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c4230 0x55f4b13cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.983+0000 7f820207e740 1 -- 172.21.15.2:0/762499930 >> 172.21.15.2:0/762499930 conn(0x55f4b138cfb0 msgr2=0x55f4b13c6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.983+0000 7f820207e740 1 -- 172.21.15.2:0/762499930 shutdown_connections 2024-06-13T02:27:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.983+0000 7f820207e740 1 -- 172.21.15.2:0/762499930 wait complete. 2024-06-13T02:27:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:56.984+0000 7f820207e740 20 client.26069 trim_cache size 0 max 16384 2024-06-13T02:27:57.005 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.004+0000 7f820207e740 1 Processor -- start 2024-06-13T02:27:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.004+0000 7f820207e740 1 -- start start 2024-06-13T02:27:57.006 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.005+0000 7f820207e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c4230 0x55f4b13e7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.005+0000 7f820207e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c57a0 0x55f4b13e7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.005+0000 7f820207e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.005+0000 7f820207e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f81f81b3940 con 0x55f4b13cefb0 2024-06-13T02:27:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.005+0000 7f820207e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f81f81b1210 con 0x55f4b13c4230 2024-06-13T02:27:57.007 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.005+0000 7f820207e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81f81af080 con 0x55f4b13c57a0 2024-06-13T02:27:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.006+0000 7f81f7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c4230 0x55f4b13e7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.006+0000 7f81f7e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c4230 0x55f4b13e7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:46472/0 (socket says 172.21.15.2:46472) 2024-06-13T02:27:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.006+0000 7f81f7e00640 1 -- 172.21.15.2:0/1605691455 learned_addr learned my addr 172.21.15.2:0/1605691455 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.006+0000 7f81f7e00640 1 -- 172.21.15.2:0/1605691455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c57a0 msgr2=0x55f4b13e7890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-13T02:27:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.006+0000 7f81f7e00640 1 --2- 172.21.15.2:0/1605691455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c57a0 0x55f4b13e7890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.008 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.006+0000 7f81f7e00640 1 -- 172.21.15.2:0/1605691455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 msgr2=0x55f4b13cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.006+0000 7f81f7e00640 1 --2- 172.21.15.2:0/1605691455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.006+0000 7f81f7e00640 1 -- 172.21.15.2:0/1605691455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b13d1710 con 0x55f4b13c4230 2024-06-13T02:27:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.007+0000 7f81f7e00640 1 --2- 172.21.15.2:0/1605691455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c4230 0x55f4b13e7350 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f81e802aa70 tx=0x7f81e803f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4696bd178a814e5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.007+0000 7f81ecc00640 1 -- 172.21.15.2:0/1605691455 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e8035040 con 0x55f4b13c4230 2024-06-13T02:27:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.007+0000 7f81ecc00640 1 -- 172.21.15.2:0/1605691455 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e8004b90 con 0x55f4b13c4230 2024-06-13T02:27:57.009 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.007+0000 7f81ecc00640 1 -- 172.21.15.2:0/1605691455 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e8003850 con 0x55f4b13c4230 2024-06-13T02:27:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.009+0000 7f820207e740 1 -- 172.21.15.2:0/1605691455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c4230 msgr2=0x55f4b13e7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.009+0000 7f820207e740 1 --2- 172.21.15.2:0/1605691455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c4230 0x55f4b13e7350 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f81e802aa70 tx=0x7f81e803f000 comp rx=0 tx=0).stop 2024-06-13T02:27:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.010+0000 7f820207e740 1 -- 172.21.15.2:0/1605691455 shutdown_connections 2024-06-13T02:27:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.010+0000 7f820207e740 1 --2- 172.21.15.2:0/1605691455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.010+0000 7f820207e740 1 --2- 172.21.15.2:0/1605691455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c57a0 0x55f4b13e7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.010+0000 7f820207e740 1 --2- 172.21.15.2:0/1605691455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c4230 0x55f4b13e7350 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.010+0000 7f820207e740 1 -- 172.21.15.2:0/1605691455 >> 172.21.15.2:0/1605691455 conn(0x55f4b138cfb0 msgr2=0x55f4b13db890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.012+0000 7f820207e740 1 -- 172.21.15.2:0/1605691455 shutdown_connections 2024-06-13T02:27:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.012+0000 7f820207e740 1 -- 172.21.15.2:0/1605691455 wait complete. 2024-06-13T02:27:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.013+0000 7f820207e740 1 -- start start 2024-06-13T02:27:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.013+0000 7f820207e740 1 Processor -- start 2024-06-13T02:27:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.014+0000 7f820207e740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c4230 0x55f4b144e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.014+0000 7f820207e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c57a0 0x55f4b13d7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.014+0000 7f820207e740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13d76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.014+0000 7f820207e740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f81f81af6d0 con 0x55f4b13cefb0 2024-06-13T02:27:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.014+0000 7f820207e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f81f81b0b40 con 0x55f4b13c57a0 2024-06-13T02:27:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.014+0000 7f820207e740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81f81afda0 con 0x55f4b13c4230 2024-06-13T02:27:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.014+0000 7f820207e740 10 client.0 _ll_register_callbacks cb 0x7f81e40d2b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:27:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.015+0000 7f81f7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c4230 0x55f4b144e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.015+0000 7f81f7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c4230 0x55f4b144e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:54366/0 (socket says 172.21.15.2:54366) 2024-06-13T02:27:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.015+0000 7f81f7e00640 1 -- 172.21.15.2:0/4153814769 learned_addr learned my addr 172.21.15.2:0/4153814769 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:27:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.015+0000 7f81f7400640 1 --2- 172.21.15.2:0/4153814769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c57a0 0x55f4b13d7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.015+0000 7f81fd200640 1 --2- 172.21.15.2:0/4153814769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13d76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.015+0000 7f81f7e00640 1 -- 172.21.15.2:0/4153814769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c57a0 msgr2=0x55f4b13d7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.015+0000 7f81f7e00640 1 --2- 172.21.15.2:0/4153814769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c57a0 0x55f4b13d7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.015+0000 7f81f7e00640 1 -- 172.21.15.2:0/4153814769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 msgr2=0x55f4b13d76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:27:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.015+0000 7f81f7e00640 1 --2- 172.21.15.2:0/4153814769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13d76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.015+0000 7f81f7e00640 1 -- 172.21.15.2:0/4153814769 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4b13d7c10 con 0x55f4b13c4230 2024-06-13T02:27:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.015+0000 7f81fd200640 1 --2- 172.21.15.2:0/4153814769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13d76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:27:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.016+0000 7f81f7e00640 1 --2- 172.21.15.2:0/4153814769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c4230 0x55f4b144e100 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f81e8031550 tx=0x7f81e80092b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73fc05367d862478 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:27:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.016+0000 7f81e2000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:27:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.016+0000 7f81e2000640 1 -- 172.21.15.2:0/4153814769 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e80325c0 con 0x55f4b13c4230 2024-06-13T02:27:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.016+0000 7f81e2000640 1 -- 172.21.15.2:0/4153814769 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9583+0+0 (secure 0 0 0) 0x7f81e8032760 con 0x55f4b13c4230 2024-06-13T02:27:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.017+0000 7f820207e740 1 -- 172.21.15.2:0/4153814769 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81e8004b90 con 0x55f4b13c4230 2024-06-13T02:27:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.017+0000 7f81e2000640 1 -- 172.21.15.2:0/4153814769 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f81e8032960 con 0x55f4b13c4230 2024-06-13T02:27:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.017+0000 7f820207e740 10 client.26056 fetch_fsmap learned FSMap version 35 2024-06-13T02:27:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.017+0000 7f820207e740 1 -- 172.21.15.2:0/4153814769 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f4b1463b40 con 0x55f4b13c4230 2024-06-13T02:27:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.017+0000 7f81e2000640 1 -- 172.21.15.2:0/4153814769 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e8004b90 con 0x55f4b13c4230 2024-06-13T02:27:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.017+0000 7f81e2000640 1 -- 172.21.15.2:0/4153814769 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f81e8054330 con 0x55f4b13c4230 2024-06-13T02:27:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.018+0000 7f820207e740 10 client.26056 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:27:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.018+0000 7f820207e740 10 client.26056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:27:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.018+0000 7f820207e740 20 client.26056 populate_metadata read hostname 'smithi002' 2024-06-13T02:27:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.018+0000 7f820207e740 1 --2- 172.21.15.2:0/4153814769 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f4b1464150 0x55f4b1466570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:27:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.018+0000 7f820207e740 4 client.26056 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:27:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.018+0000 7f820207e740 1 -- 172.21.15.2:0/4153814769 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f4b132fea0 con 0x55f4b1464150 2024-06-13T02:27:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.018+0000 7f81f7400640 1 --2- 172.21.15.2:0/4153814769 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f4b1464150 0x55f4b1466570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:27:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.018+0000 7f81e2000640 10 client.26056 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.018+0000 7f81f7400640 1 --2- 172.21.15.2:0/4153814769 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f4b1464150 0x55f4b1466570 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5aa33f21bcba814 server_cookie=a145b811cb5adc2c in_seq=0 out_seq=0 2024-06-13T02:27:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.252+0000 7f81e2000640 1 -- 172.21.15.2:0/4153814769 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55f4b132fea0 con 0x55f4b1464150 2024-06-13T02:27:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.252+0000 7f81e2000640 10 client.26056 handle_command_reply: tid=0 2024-06-13T02:27:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.252+0000 7f820207e740 1 client.26056 shutdown 2024-06-13T02:27:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.253+0000 7f820207e740 1 -- 172.21.15.2:0/4153814769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c4230 msgr2=0x55f4b144e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.253+0000 7f820207e740 1 --2- 172.21.15.2:0/4153814769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c4230 0x55f4b144e100 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f81e8031550 tx=0x7f81e80092b0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.253+0000 7f820207e740 1 -- 172.21.15.2:0/4153814769 shutdown_connections 2024-06-13T02:27:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.253+0000 7f820207e740 1 --2- 172.21.15.2:0/4153814769 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55f4b1464150 0x55f4b1466570 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.253+0000 7f820207e740 1 --2- 172.21.15.2:0/4153814769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55f4b13cefb0 0x55f4b13d76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.253+0000 7f820207e740 1 --2- 172.21.15.2:0/4153814769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4b13c57a0 0x55f4b13d7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.253+0000 7f81e2000640 0 client.26056 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:27:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.253+0000 7f820207e740 1 --2- 172.21.15.2:0/4153814769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f4b13c4230 0x55f4b144e100 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.253+0000 7f820207e740 1 -- 172.21.15.2:0/4153814769 >> 172.21.15.2:0/4153814769 conn(0x55f4b138cfb0 msgr2=0x55f4b13c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.253+0000 7f820207e740 1 -- 172.21.15.2:0/4153814769 shutdown_connections 2024-06-13T02:27:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.253+0000 7f820207e740 1 -- 172.21.15.2:0/4153814769 wait complete. 2024-06-13T02:27:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.254+0000 7f820207e740 20 client.26056 trim_cache size 0 max 16384 2024-06-13T02:27:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:27:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:27:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:27:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.254+0000 7f81fdc00640 1 -- 172.21.15.2:0/3784335664 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f81dc0a2d60 msgr2=0x7f81dc0a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.254+0000 7f81fdc00640 1 --2- 172.21.15.2:0/3784335664 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f81dc0a2d60 0x7f81dc0a5220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f81e8005c40 tx=0x7f81e8005b50 comp rx=0 tx=0).stop 2024-06-13T02:27:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.254+0000 7f81fdc00640 1 -- 172.21.15.2:0/3784335664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81f81032a0 msgr2=0x7f81f819a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:27:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.254+0000 7f81fdc00640 1 --2- 172.21.15.2:0/3784335664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81f81032a0 0x7f81f819a7e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f81e400d740 tx=0x7f81e400dc00 comp rx=0 tx=0).stop 2024-06-13T02:27:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.255+0000 7f81fdc00640 1 -- 172.21.15.2:0/3784335664 shutdown_connections 2024-06-13T02:27:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.255+0000 7f81fdc00640 1 --2- 172.21.15.2:0/3784335664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f810bda0 0x7f81f819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.255+0000 7f81fdc00640 1 --2- 172.21.15.2:0/3784335664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81f81032a0 0x7f81f819a7e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.255+0000 7f81fdc00640 1 --2- 172.21.15.2:0/3784335664 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f81dc0a2d60 0x7f81dc0a5220 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.255+0000 7f81fdc00640 1 --2- 172.21.15.2:0/3784335664 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81f8102980 0x7f81f819a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:27:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.255+0000 7f81fdc00640 1 -- 172.21.15.2:0/3784335664 >> 172.21.15.2:0/3784335664 conn(0x7f81f80fc180 msgr2=0x7f81f8101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:27:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.255+0000 7f81fdc00640 1 -- 172.21.15.2:0/3784335664 shutdown_connections 2024-06-13T02:27:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:27:57.255+0000 7f81fdc00640 1 -- 172.21.15.2:0/3784335664 wait complete. 2024-06-13T02:27:57.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:57 smithi084 ceph-mon[36833]: pgmap v317: 129 pgs: 129 active+clean; 92 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 255 op/s 2024-06-13T02:27:57.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:57 smithi175 ceph-mon[36977]: pgmap v317: 129 pgs: 129 active+clean; 92 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 255 op/s 2024-06-13T02:27:57.548 INFO:tasks.workunit.client.0.smithi002.stdout: 1 729650 7.13 MB/sec execute 421 sec latency 142.269 ms 2024-06-13T02:27:57.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:57 smithi002 ceph-mon[31960]: pgmap v317: 129 pgs: 129 active+clean; 92 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 255 op/s 2024-06-13T02:27:58.548 INFO:tasks.workunit.client.0.smithi002.stdout: 1 731436 7.15 MB/sec execute 422 sec latency 23.359 ms 2024-06-13T02:27:59.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:27:59 smithi084 ceph-mon[36833]: pgmap v318: 129 pgs: 129 active+clean; 92 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 160 op/s 2024-06-13T02:27:59.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:27:59 smithi175 ceph-mon[36977]: pgmap v318: 129 pgs: 129 active+clean; 92 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 160 op/s 2024-06-13T02:27:59.548 INFO:tasks.workunit.client.0.smithi002.stdout: 1 732172 7.13 MB/sec execute 423 sec latency 44.945 ms 2024-06-13T02:27:59.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:27:59 smithi002 ceph-mon[31960]: pgmap v318: 129 pgs: 129 active+clean; 92 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 160 op/s 2024-06-13T02:28:00.548 INFO:tasks.workunit.client.0.smithi002.stdout: 1 733025 7.13 MB/sec execute 424 sec latency 65.106 ms 2024-06-13T02:28:01.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:01 smithi175 ceph-mon[36977]: pgmap v319: 129 pgs: 129 active+clean; 92 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 1.8 MiB/s wr, 125 op/s 2024-06-13T02:28:01.548 INFO:tasks.workunit.client.0.smithi002.stdout: 1 733780 7.11 MB/sec execute 425 sec latency 84.962 ms 2024-06-13T02:28:01.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:01 smithi002 ceph-mon[31960]: pgmap v319: 129 pgs: 129 active+clean; 92 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 1.8 MiB/s wr, 125 op/s 2024-06-13T02:28:01.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:01 smithi084 ceph-mon[36833]: pgmap v319: 129 pgs: 129 active+clean; 92 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 1.8 MiB/s wr, 125 op/s 2024-06-13T02:28:02.548 INFO:tasks.workunit.client.0.smithi002.stdout: 1 734414 7.11 MB/sec execute 426 sec latency 85.145 ms 2024-06-13T02:28:03.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:03 smithi175 ceph-mon[36977]: pgmap v320: 129 pgs: 129 active+clean; 88 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 291 op/s 2024-06-13T02:28:03.549 INFO:tasks.workunit.client.0.smithi002.stdout: 1 735184 7.11 MB/sec execute 427 sec latency 135.041 ms 2024-06-13T02:28:03.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:03 smithi002 ceph-mon[31960]: pgmap v320: 129 pgs: 129 active+clean; 88 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 291 op/s 2024-06-13T02:28:03.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:03 smithi084 ceph-mon[36833]: pgmap v320: 129 pgs: 129 active+clean; 88 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 291 op/s 2024-06-13T02:28:04.549 INFO:tasks.workunit.client.0.smithi002.stdout: 1 735894 7.10 MB/sec execute 428 sec latency 39.830 ms 2024-06-13T02:28:05.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:05 smithi175 ceph-mon[36977]: pgmap v321: 129 pgs: 129 active+clean; 88 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 1.6 MiB/s wr, 228 op/s 2024-06-13T02:28:05.549 INFO:tasks.workunit.client.0.smithi002.stdout: 1 736562 7.09 MB/sec execute 429 sec latency 88.023 ms 2024-06-13T02:28:05.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:05 smithi002 ceph-mon[31960]: pgmap v321: 129 pgs: 129 active+clean; 88 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 1.6 MiB/s wr, 228 op/s 2024-06-13T02:28:05.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:05 smithi084 ceph-mon[36833]: pgmap v321: 129 pgs: 129 active+clean; 88 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 917 KiB/s rd, 1.6 MiB/s wr, 228 op/s 2024-06-13T02:28:06.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:06 smithi175 ceph-mon[36977]: osdmap e113: 12 total, 12 up, 12 in 2024-06-13T02:28:06.549 INFO:tasks.workunit.client.0.smithi002.stdout: 1 736779 7.07 MB/sec execute 430 sec latency 96.413 ms 2024-06-13T02:28:06.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:06 smithi002 ceph-mon[31960]: osdmap e113: 12 total, 12 up, 12 in 2024-06-13T02:28:06.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:06 smithi084 ceph-mon[36833]: osdmap e113: 12 total, 12 up, 12 in 2024-06-13T02:28:07.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:07 smithi175 ceph-mon[36977]: pgmap v323: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 91 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.6 MiB/s wr, 253 op/s 2024-06-13T02:28:07.549 INFO:tasks.workunit.client.0.smithi002.stdout: 1 737446 7.06 MB/sec execute 431 sec latency 75.499 ms 2024-06-13T02:28:07.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:07 smithi002 ceph-mon[31960]: pgmap v323: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 91 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.6 MiB/s wr, 253 op/s 2024-06-13T02:28:07.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:07 smithi084 ceph-mon[36833]: pgmap v323: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 91 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 1.6 MiB/s wr, 253 op/s 2024-06-13T02:28:08.550 INFO:tasks.workunit.client.0.smithi002.stdout: 1 738581 7.07 MB/sec execute 432 sec latency 38.099 ms 2024-06-13T02:28:09.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:09 smithi175 ceph-mon[36977]: pgmap v324: 129 pgs: 20 active+clean+snaptrim, 57 active+clean+snaptrim_wait, 52 active+clean; 94 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 2.0 MiB/s wr, 276 op/s 2024-06-13T02:28:09.550 INFO:tasks.workunit.client.0.smithi002.stdout: 1 739060 7.06 MB/sec execute 433 sec latency 21.387 ms 2024-06-13T02:28:09.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:09 smithi002 ceph-mon[31960]: pgmap v324: 129 pgs: 20 active+clean+snaptrim, 57 active+clean+snaptrim_wait, 52 active+clean; 94 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 2.0 MiB/s wr, 276 op/s 2024-06-13T02:28:09.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:09 smithi084 ceph-mon[36833]: pgmap v324: 129 pgs: 20 active+clean+snaptrim, 57 active+clean+snaptrim_wait, 52 active+clean; 94 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 2.0 MiB/s wr, 276 op/s 2024-06-13T02:28:10.416 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.415+0000 7ff156e00640 1 -- 172.21.15.2:0/3877567406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff150103e30 msgr2=0x7ff150104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.415+0000 7ff156e00640 1 --2- 172.21.15.2:0/3877567406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff150103e30 0x7ff150104210 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff140009900 tx=0x7ff14002a400 comp rx=0 tx=0).stop 2024-06-13T02:28:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.415+0000 7ff156e00640 1 -- 172.21.15.2:0/3877567406 shutdown_connections 2024-06-13T02:28:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.415+0000 7ff156e00640 1 --2- 172.21.15.2:0/3877567406 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff150108f00 0x7ff150110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.415+0000 7ff156e00640 1 --2- 172.21.15.2:0/3877567406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1501047e0 0x7ff150108820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.415+0000 7ff156e00640 1 --2- 172.21.15.2:0/3877567406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff150103e30 0x7ff150104210 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.415+0000 7ff156e00640 1 -- 172.21.15.2:0/3877567406 >> 172.21.15.2:0/3877567406 conn(0x7ff1500ff650 msgr2=0x7ff150101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.416+0000 7ff156e00640 1 -- 172.21.15.2:0/3877567406 shutdown_connections 2024-06-13T02:28:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.416+0000 7ff156e00640 1 -- 172.21.15.2:0/3877567406 wait complete. 2024-06-13T02:28:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.417+0000 7ff156e00640 1 Processor -- start 2024-06-13T02:28:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.417+0000 7ff156e00640 1 -- start start 2024-06-13T02:28:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.417+0000 7ff156e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff150103e30 0x7ff15019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.417+0000 7ff156e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff150108f00 0x7ff15019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.417+0000 7ff156e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff15019ed70 0x7ff15019f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.417+0000 7ff156e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff150114000 con 0x7ff150103e30 2024-06-13T02:28:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.417+0000 7ff156e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff150113e80 con 0x7ff15019ed70 2024-06-13T02:28:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.417+0000 7ff156e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff150114180 con 0x7ff150108f00 2024-06-13T02:28:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.418+0000 7ff147e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff150108f00 0x7ff15019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.418+0000 7ff154e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff15019ed70 0x7ff15019f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.418+0000 7ff147e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff150108f00 0x7ff15019aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58758/0 (socket says 172.21.15.2:58758) 2024-06-13T02:28:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.418+0000 7ff147e00640 1 -- 172.21.15.2:0/2965426478 learned_addr learned my addr 172.21.15.2:0/2965426478 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.418+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2965426478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff150103e30 0x7ff15019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.418+0000 7ff147e00640 1 -- 172.21.15.2:0/2965426478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff15019ed70 msgr2=0x7ff15019f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.418+0000 7ff147e00640 1 --2- 172.21.15.2:0/2965426478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff15019ed70 0x7ff15019f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.418+0000 7ff147e00640 1 -- 172.21.15.2:0/2965426478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff150103e30 msgr2=0x7ff15019a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.418+0000 7ff147e00640 1 --2- 172.21.15.2:0/2965426478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff150103e30 0x7ff15019a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.418+0000 7ff147e00640 1 -- 172.21.15.2:0/2965426478 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15019f860 con 0x7ff150108f00 2024-06-13T02:28:10.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.418+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2965426478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff150103e30 0x7ff15019a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:28:10.421 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.418+0000 7ff147e00640 1 --2- 172.21.15.2:0/2965426478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff150108f00 0x7ff15019aa40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff13800e9f0 tx=0x7ff13800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.419+0000 7ff14d600640 1 -- 172.21.15.2:0/2965426478 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13800cd80 con 0x7ff150108f00 2024-06-13T02:28:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.419+0000 7ff14d600640 1 -- 172.21.15.2:0/2965426478 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff138005030 con 0x7ff150108f00 2024-06-13T02:28:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.419+0000 7ff156e00640 1 -- 172.21.15.2:0/2965426478 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff15019fb50 con 0x7ff150108f00 2024-06-13T02:28:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.419+0000 7ff14d600640 1 -- 172.21.15.2:0/2965426478 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff138004c10 con 0x7ff150108f00 2024-06-13T02:28:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.419+0000 7ff156e00640 1 -- 172.21.15.2:0/2965426478 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1501a7390 con 0x7ff150108f00 2024-06-13T02:28:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.423+0000 7ff159b67740 1 Processor -- start 2024-06-13T02:28:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.423+0000 7ff159b67740 1 -- start start 2024-06-13T02:28:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.423+0000 7ff159b67740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab46b5e0 0x5636ab469b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.423+0000 7ff159b67740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46a070 0x5636ab46a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.423+0000 7ff159b67740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab474df0 0x5636ab4771e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.423+0000 7ff159b67740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5636ab3ce420 con 0x5636ab474df0 2024-06-13T02:28:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.423+0000 7ff159b67740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5636ab375c50 con 0x5636ab46a070 2024-06-13T02:28:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.423+0000 7ff159b67740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5636ab3ca3e0 con 0x5636ab46b5e0 2024-06-13T02:28:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.423+0000 7ff14fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46a070 0x5636ab46a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.423+0000 7ff14fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46a070 0x5636ab46a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:54522/0 (socket says 172.21.15.2:54522) 2024-06-13T02:28:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.423+0000 7ff14fe00640 1 -- 172.21.15.2:0/2913345825 learned_addr learned my addr 172.21.15.2:0/2913345825 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.423+0000 7ff154e00640 1 --2- 172.21.15.2:0/2913345825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab46b5e0 0x5636ab469b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.424+0000 7ff14fe00640 1 -- 172.21.15.2:0/2913345825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab46b5e0 msgr2=0x5636ab469b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.424+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2913345825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab46b5e0 0x5636ab469b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.424+0000 7ff14fe00640 1 -- 172.21.15.2:0/2913345825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab474df0 msgr2=0x5636ab4771e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-13T02:28:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.424+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2913345825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab474df0 0x5636ab4771e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.424+0000 7ff14fe00640 1 -- 172.21.15.2:0/2913345825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636ab0e2210 con 0x5636ab46a070 2024-06-13T02:28:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.424+0000 7ff14d600640 1 -- 172.21.15.2:0/2965426478 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7ff1380051e0 con 0x7ff150108f00 2024-06-13T02:28:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.424+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2913345825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46a070 0x5636ab46a4f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff140000c00 tx=0x7ff1400040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58e01a3bde35ab1b server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.424+0000 7ff145600640 1 -- 172.21.15.2:0/2913345825 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14003f020 con 0x5636ab46a070 2024-06-13T02:28:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.424+0000 7ff145600640 1 -- 172.21.15.2:0/2913345825 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1400044b0 con 0x5636ab46a070 2024-06-13T02:28:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.424+0000 7ff145600640 1 -- 172.21.15.2:0/2913345825 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140035070 con 0x5636ab46a070 2024-06-13T02:28:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.425+0000 7ff159b67740 1 -- 172.21.15.2:0/2913345825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46a070 msgr2=0x5636ab46a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.425+0000 7ff159b67740 1 --2- 172.21.15.2:0/2913345825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46a070 0x5636ab46a4f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff140000c00 tx=0x7ff1400040c0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.426+0000 7ff159b67740 1 -- 172.21.15.2:0/2913345825 shutdown_connections 2024-06-13T02:28:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.426+0000 7ff159b67740 1 --2- 172.21.15.2:0/2913345825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab474df0 0x5636ab4771e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.426+0000 7ff159b67740 1 --2- 172.21.15.2:0/2913345825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46a070 0x5636ab46a4f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.426+0000 7ff159b67740 1 --2- 172.21.15.2:0/2913345825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab46b5e0 0x5636ab469b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.426+0000 7ff159b67740 1 -- 172.21.15.2:0/2913345825 >> 172.21.15.2:0/2913345825 conn(0x5636ab432fb0 msgr2=0x5636ab466660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.426+0000 7ff159b67740 1 -- 172.21.15.2:0/2913345825 shutdown_connections 2024-06-13T02:28:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.426+0000 7ff159b67740 1 -- 172.21.15.2:0/2913345825 wait complete. 2024-06-13T02:28:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.426+0000 7ff14d600640 1 --2- 172.21.15.2:0/2965426478 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff1340a2c80 0x7ff1340a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.426+0000 7ff14d600640 1 -- 172.21.15.2:0/2965426478 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9671+0+0 (secure 0 0 0) 0x7ff1380cfac0 con 0x7ff150108f00 2024-06-13T02:28:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.426+0000 7ff159b67740 1 -- start start 2024-06-13T02:28:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.427+0000 7ff159b67740 1 Processor -- start 2024-06-13T02:28:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.427+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2965426478 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff1340a2c80 0x7ff1340a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.427+0000 7ff159b67740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46a070 0x5636ab471e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.427+0000 7ff159b67740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46b5e0 0x5636ab4723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.427+0000 7ff159b67740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab474df0 0x5636ab4728f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.427+0000 7ff159b67740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5636ab477b60 con 0x5636ab46a070 2024-06-13T02:28:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.427+0000 7ff159b67740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5636ab3890b0 con 0x5636ab46b5e0 2024-06-13T02:28:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.427+0000 7ff159b67740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5636ab477ce0 con 0x5636ab474df0 2024-06-13T02:28:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.428+0000 7ff159b67740 10 client.0 _ll_register_callbacks cb 0x5636ab374f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:28:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.428+0000 7ff154e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab474df0 0x5636ab4728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.428+0000 7ff154e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab474df0 0x5636ab4728f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58776/0 (socket says 172.21.15.2:58776) 2024-06-13T02:28:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.428+0000 7ff154e00640 1 -- 172.21.15.2:0/2905085138 learned_addr learned my addr 172.21.15.2:0/2905085138 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.428+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2905085138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46a070 0x5636ab471e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.428+0000 7ff154e00640 1 -- 172.21.15.2:0/2905085138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46b5e0 msgr2=0x5636ab4723b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-13T02:28:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.428+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2965426478 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff1340a2c80 0x7ff1340a5140 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff1400047e0 tx=0x7ff140004c10 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.428+0000 7ff147e00640 1 --2- 172.21.15.2:0/2905085138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46b5e0 0x5636ab4723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.428+0000 7ff154e00640 1 --2- 172.21.15.2:0/2905085138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46b5e0 0x5636ab4723b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.428+0000 7ff154e00640 1 -- 172.21.15.2:0/2905085138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46a070 msgr2=0x5636ab471e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.428+0000 7ff154e00640 1 --2- 172.21.15.2:0/2905085138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46a070 0x5636ab471e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.429+0000 7ff154e00640 1 -- 172.21.15.2:0/2905085138 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636ab1ae620 con 0x5636ab474df0 2024-06-13T02:28:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.429+0000 7ff147e00640 1 --2- 172.21.15.2:0/2905085138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46b5e0 0x5636ab4723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:28:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.429+0000 7ff154e00640 1 --2- 172.21.15.2:0/2905085138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab474df0 0x5636ab4728f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff148010b40 tx=0x7ff14800f420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0fcecabf63be4fd server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.429+0000 7ff13e000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:28:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.429+0000 7ff13e000640 1 -- 172.21.15.2:0/2905085138 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14800fe60 con 0x5636ab474df0 2024-06-13T02:28:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.429+0000 7ff13e000640 1 -- 172.21.15.2:0/2905085138 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9671+0+0 (secure 0 0 0) 0x7ff1480193c0 con 0x5636ab474df0 2024-06-13T02:28:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.429+0000 7ff159b67740 1 -- 172.21.15.2:0/2905085138 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1400044b0 con 0x5636ab474df0 2024-06-13T02:28:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.430+0000 7ff13e000640 1 -- 172.21.15.2:0/2905085138 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff1480195c0 con 0x5636ab474df0 2024-06-13T02:28:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.430+0000 7ff159b67740 10 client.26068 fetch_fsmap learned FSMap version 35 2024-06-13T02:28:10.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.430+0000 7ff159b67740 1 -- 172.21.15.2:0/2905085138 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5636ab483fe0 con 0x5636ab474df0 2024-06-13T02:28:10.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.430+0000 7ff13e000640 1 -- 172.21.15.2:0/2905085138 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1400044b0 con 0x5636ab474df0 2024-06-13T02:28:10.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.430+0000 7ff13e000640 1 -- 172.21.15.2:0/2905085138 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff14801a9f0 con 0x5636ab474df0 2024-06-13T02:28:10.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.430+0000 7ff159b67740 10 client.26068 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:28:10.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.430+0000 7ff159b67740 10 client.26068 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:28:10.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.430+0000 7ff159b67740 20 client.26068 populate_metadata read hostname 'smithi002' 2024-06-13T02:28:10.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.430+0000 7ff159b67740 1 --2- 172.21.15.2:0/2905085138 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5636ab4854f0 0x5636ab4878e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.431+0000 7ff159b67740 4 client.26068 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:28:10.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.431+0000 7ff159b67740 1 -- 172.21.15.2:0/2905085138 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636ab3dbb50 con 0x5636ab4854f0 2024-06-13T02:28:10.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.431+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2905085138 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5636ab4854f0 0x5636ab4878e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.432+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2905085138 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5636ab4854f0 0x5636ab4878e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d1182a4fceae439 server_cookie=ed01b1b760720aca in_seq=0 out_seq=0 2024-06-13T02:28:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.432+0000 7ff13e000640 10 client.26068 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.432+0000 7ff13e000640 1 -- 172.21.15.2:0/2905085138 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5636ab3dbb50 con 0x5636ab4854f0 2024-06-13T02:28:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.432+0000 7ff13e000640 10 client.26068 handle_command_reply: tid=0 2024-06-13T02:28:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.433+0000 7ff159b67740 1 client.26068 shutdown 2024-06-13T02:28:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.433+0000 7ff159b67740 1 -- 172.21.15.2:0/2905085138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab474df0 msgr2=0x5636ab4728f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.433+0000 7ff159b67740 1 --2- 172.21.15.2:0/2905085138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab474df0 0x5636ab4728f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff148010b40 tx=0x7ff14800f420 comp rx=0 tx=0).stop 2024-06-13T02:28:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.433+0000 7ff159b67740 1 -- 172.21.15.2:0/2905085138 shutdown_connections 2024-06-13T02:28:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.433+0000 7ff159b67740 1 --2- 172.21.15.2:0/2905085138 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5636ab4854f0 0x5636ab4878e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.433+0000 7ff13e000640 0 client.26068 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.433+0000 7ff159b67740 1 --2- 172.21.15.2:0/2905085138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab474df0 0x5636ab4728f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.433+0000 7ff159b67740 1 --2- 172.21.15.2:0/2905085138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46b5e0 0x5636ab4723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.433+0000 7ff159b67740 1 --2- 172.21.15.2:0/2905085138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46a070 0x5636ab471e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.433+0000 7ff159b67740 1 -- 172.21.15.2:0/2905085138 >> 172.21.15.2:0/2905085138 conn(0x5636ab432fb0 msgr2=0x5636ab46c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.433+0000 7ff159b67740 1 -- 172.21.15.2:0/2905085138 shutdown_connections 2024-06-13T02:28:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.433+0000 7ff159b67740 1 -- 172.21.15.2:0/2905085138 wait complete. 2024-06-13T02:28:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.433+0000 7ff159b67740 20 client.26068 trim_cache size 0 max 16384 2024-06-13T02:28:10.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.458+0000 7ff159b67740 1 Processor -- start 2024-06-13T02:28:10.459 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.458+0000 7ff159b67740 1 -- start start 2024-06-13T02:28:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.458+0000 7ff159b67740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46a070 0x5636ab46c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff159b67740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46b5e0 0x5636ab48d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff159b67740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab474df0 0x5636ab48d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff159b67740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501b3af0 con 0x5636ab46b5e0 2024-06-13T02:28:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff159b67740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501b13c0 con 0x5636ab46a070 2024-06-13T02:28:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff159b67740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501af230 con 0x5636ab474df0 2024-06-13T02:28:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff14fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46a070 0x5636ab46c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff14fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46a070 0x5636ab46c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:54546/0 (socket says 172.21.15.2:54546) 2024-06-13T02:28:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff14fe00640 1 -- 172.21.15.2:0/2413810395 learned_addr learned my addr 172.21.15.2:0/2413810395 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:10.461 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff147e00640 1 --2- 172.21.15.2:0/2413810395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46b5e0 0x5636ab48d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff154e00640 1 --2- 172.21.15.2:0/2413810395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab474df0 0x5636ab48d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff14fe00640 1 -- 172.21.15.2:0/2413810395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab474df0 msgr2=0x5636ab48d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2413810395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab474df0 0x5636ab48d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff14fe00640 1 -- 172.21.15.2:0/2413810395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46b5e0 msgr2=0x5636ab48d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2413810395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46b5e0 0x5636ab48d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff14fe00640 1 -- 172.21.15.2:0/2413810395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636ab487c50 con 0x5636ab46a070 2024-06-13T02:28:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.459+0000 7ff147e00640 1 --2- 172.21.15.2:0/2413810395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46b5e0 0x5636ab48d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:28:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.460+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2413810395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46a070 0x5636ab46c350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff140005940 tx=0x7ff1400040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60b1ac1bde6f7de0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.460+0000 7ff144c00640 1 -- 172.21.15.2:0/2413810395 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14003f050 con 0x5636ab46a070 2024-06-13T02:28:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.460+0000 7ff144c00640 1 -- 172.21.15.2:0/2413810395 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff140005620 con 0x5636ab46a070 2024-06-13T02:28:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.460+0000 7ff144c00640 1 -- 172.21.15.2:0/2413810395 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140035040 con 0x5636ab46a070 2024-06-13T02:28:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.461+0000 7ff159b67740 1 -- 172.21.15.2:0/2413810395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46a070 msgr2=0x5636ab46c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.461+0000 7ff159b67740 1 --2- 172.21.15.2:0/2413810395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46a070 0x5636ab46c350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff140005940 tx=0x7ff1400040c0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.461+0000 7ff159b67740 1 -- 172.21.15.2:0/2413810395 shutdown_connections 2024-06-13T02:28:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.461+0000 7ff159b67740 1 --2- 172.21.15.2:0/2413810395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab474df0 0x5636ab48d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.461+0000 7ff159b67740 1 --2- 172.21.15.2:0/2413810395 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46b5e0 0x5636ab48d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.461+0000 7ff159b67740 1 --2- 172.21.15.2:0/2413810395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab46a070 0x5636ab46c350 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.461+0000 7ff159b67740 1 -- 172.21.15.2:0/2413810395 >> 172.21.15.2:0/2413810395 conn(0x5636ab432fb0 msgr2=0x5636ab46bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.461+0000 7ff159b67740 1 -- 172.21.15.2:0/2413810395 shutdown_connections 2024-06-13T02:28:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.461+0000 7ff159b67740 1 -- 172.21.15.2:0/2413810395 wait complete. 2024-06-13T02:28:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.461+0000 7ff159b67740 1 -- start start 2024-06-13T02:28:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.462+0000 7ff159b67740 1 Processor -- start 2024-06-13T02:28:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.462+0000 7ff159b67740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab46a070 0x5636ab46f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.462+0000 7ff159b67740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46b5e0 0x5636ab46f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.462+0000 7ff159b67740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab474df0 0x5636ab46faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.462+0000 7ff159b67740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501af880 con 0x5636ab46b5e0 2024-06-13T02:28:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.462+0000 7ff159b67740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501b0cf0 con 0x5636ab474df0 2024-06-13T02:28:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.462+0000 7ff159b67740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501aff50 con 0x5636ab46a070 2024-06-13T02:28:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.462+0000 7ff159b67740 10 client.0 _ll_register_callbacks cb 0x7ff148007a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:28:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.462+0000 7ff14fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab46a070 0x5636ab46f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.462+0000 7ff154e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab474df0 0x5636ab46faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.462+0000 7ff14fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab46a070 0x5636ab46f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58788/0 (socket says 172.21.15.2:58788) 2024-06-13T02:28:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.462+0000 7ff14fe00640 1 -- 172.21.15.2:0/2072062852 learned_addr learned my addr 172.21.15.2:0/2072062852 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.463+0000 7ff147e00640 1 --2- 172.21.15.2:0/2072062852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46b5e0 0x5636ab46f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.463+0000 7ff14fe00640 1 -- 172.21.15.2:0/2072062852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab474df0 msgr2=0x5636ab46faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.463+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2072062852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab474df0 0x5636ab46faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.463+0000 7ff14fe00640 1 -- 172.21.15.2:0/2072062852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46b5e0 msgr2=0x5636ab46f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.463+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2072062852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46b5e0 0x5636ab46f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.463+0000 7ff14fe00640 1 -- 172.21.15.2:0/2072062852 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636ab4f7b30 con 0x5636ab46a070 2024-06-13T02:28:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.463+0000 7ff154e00640 1 --2- 172.21.15.2:0/2072062852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab474df0 0x5636ab46faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:28:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.463+0000 7ff14fe00640 1 --2- 172.21.15.2:0/2072062852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab46a070 0x5636ab46f020 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff14002a920 tx=0x7ff140004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abba51e97bc8e756 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.463+0000 7ff13e000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:28:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.464+0000 7ff13e000640 1 -- 172.21.15.2:0/2072062852 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14005d020 con 0x5636ab46a070 2024-06-13T02:28:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.464+0000 7ff13e000640 1 -- 172.21.15.2:0/2072062852 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9671+0+0 (secure 0 0 0) 0x7ff1400039f0 con 0x5636ab46a070 2024-06-13T02:28:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.464+0000 7ff159b67740 1 -- 172.21.15.2:0/2072062852 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff140005620 con 0x5636ab46a070 2024-06-13T02:28:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.464+0000 7ff13e000640 1 -- 172.21.15.2:0/2072062852 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff140035040 con 0x5636ab46a070 2024-06-13T02:28:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.464+0000 7ff159b67740 10 client.26074 fetch_fsmap learned FSMap version 35 2024-06-13T02:28:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.464+0000 7ff159b67740 1 -- 172.21.15.2:0/2072062852 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5636ab4f8e40 con 0x5636ab46a070 2024-06-13T02:28:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.464+0000 7ff13e000640 1 -- 172.21.15.2:0/2072062852 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff140005620 con 0x5636ab46a070 2024-06-13T02:28:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.464+0000 7ff13e000640 1 -- 172.21.15.2:0/2072062852 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff14003c470 con 0x5636ab46a070 2024-06-13T02:28:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.465+0000 7ff159b67740 10 client.26074 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:28:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.465+0000 7ff159b67740 10 client.26074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:28:10.468 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.465+0000 7ff159b67740 20 client.26074 populate_metadata read hostname 'smithi002' 2024-06-13T02:28:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.465+0000 7ff159b67740 1 --2- 172.21.15.2:0/2072062852 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5636ab4f9130 0x5636ab4fb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.465+0000 7ff159b67740 4 client.26074 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:28:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.465+0000 7ff159b67740 1 -- 172.21.15.2:0/2072062852 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5636ab3d5ea0 con 0x5636ab4f9130 2024-06-13T02:28:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.465+0000 7ff147e00640 1 --2- 172.21.15.2:0/2072062852 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5636ab4f9130 0x5636ab4fb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.465+0000 7ff147e00640 1 --2- 172.21.15.2:0/2072062852 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5636ab4f9130 0x5636ab4fb520 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d5fe2e60ed4f082 server_cookie=2b0b02fb13b5fd01 in_seq=0 out_seq=0 2024-06-13T02:28:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.465+0000 7ff13e000640 10 client.26074 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:10.551 INFO:tasks.workunit.client.0.smithi002.stdout: 1 739998 7.05 MB/sec execute 434 sec latency 79.621 ms 2024-06-13T02:28:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.616+0000 7ff13e000640 1 -- 172.21.15.2:0/2072062852 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5636ab3d5ea0 con 0x5636ab4f9130 2024-06-13T02:28:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.616+0000 7ff13e000640 10 client.26074 handle_command_reply: tid=0 2024-06-13T02:28:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.616+0000 7ff159b67740 1 client.26074 shutdown 2024-06-13T02:28:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.616+0000 7ff159b67740 1 -- 172.21.15.2:0/2072062852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab46a070 msgr2=0x5636ab46f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.616+0000 7ff159b67740 1 --2- 172.21.15.2:0/2072062852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab46a070 0x5636ab46f020 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff14002a920 tx=0x7ff140004c80 comp rx=0 tx=0).stop 2024-06-13T02:28:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.616+0000 7ff159b67740 1 -- 172.21.15.2:0/2072062852 shutdown_connections 2024-06-13T02:28:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.616+0000 7ff159b67740 1 --2- 172.21.15.2:0/2072062852 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5636ab4f9130 0x5636ab4fb520 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.616+0000 7ff159b67740 1 --2- 172.21.15.2:0/2072062852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5636ab474df0 0x5636ab46faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.617+0000 7ff159b67740 1 --2- 172.21.15.2:0/2072062852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5636ab46b5e0 0x5636ab46f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.617+0000 7ff159b67740 1 --2- 172.21.15.2:0/2072062852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636ab46a070 0x5636ab46f020 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.617+0000 7ff13e000640 0 client.26074 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.617+0000 7ff159b67740 1 -- 172.21.15.2:0/2072062852 >> 172.21.15.2:0/2072062852 conn(0x5636ab432fb0 msgr2=0x5636ab473f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.617+0000 7ff159b67740 1 -- 172.21.15.2:0/2072062852 shutdown_connections 2024-06-13T02:28:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.617+0000 7ff159b67740 1 -- 172.21.15.2:0/2072062852 wait complete. 2024-06-13T02:28:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.618+0000 7ff159b67740 20 client.26074 trim_cache size 0 max 16384 2024-06-13T02:28:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:28:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:28:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:28:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.619+0000 7ff156e00640 1 -- 172.21.15.2:0/2965426478 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff1340a2c80 msgr2=0x7ff1340a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.619+0000 7ff156e00640 1 --2- 172.21.15.2:0/2965426478 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff1340a2c80 0x7ff1340a5140 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff1400047e0 tx=0x7ff140004c10 comp rx=0 tx=0).stop 2024-06-13T02:28:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.619+0000 7ff156e00640 1 -- 172.21.15.2:0/2965426478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff150108f00 msgr2=0x7ff15019aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.619+0000 7ff156e00640 1 --2- 172.21.15.2:0/2965426478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff150108f00 0x7ff15019aa40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff13800e9f0 tx=0x7ff13800eeb0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.619+0000 7ff156e00640 1 -- 172.21.15.2:0/2965426478 shutdown_connections 2024-06-13T02:28:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.619+0000 7ff156e00640 1 --2- 172.21.15.2:0/2965426478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff15019ed70 0x7ff15019f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.619+0000 7ff156e00640 1 --2- 172.21.15.2:0/2965426478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff150108f00 0x7ff15019aa40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.619+0000 7ff156e00640 1 --2- 172.21.15.2:0/2965426478 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7ff1340a2c80 0x7ff1340a5140 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.619+0000 7ff156e00640 1 --2- 172.21.15.2:0/2965426478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff150103e30 0x7ff15019a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.619+0000 7ff156e00640 1 -- 172.21.15.2:0/2965426478 >> 172.21.15.2:0/2965426478 conn(0x7ff1500ff650 msgr2=0x7ff150100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.620+0000 7ff156e00640 1 -- 172.21.15.2:0/2965426478 shutdown_connections 2024-06-13T02:28:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:10.620+0000 7ff156e00640 1 -- 172.21.15.2:0/2965426478 wait complete. 2024-06-13T02:28:11.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:11 smithi175 ceph-mon[36977]: pgmap v325: 129 pgs: 20 active+clean+snaptrim, 57 active+clean+snaptrim_wait, 52 active+clean; 94 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 2.0 MiB/s wr, 276 op/s 2024-06-13T02:28:11.551 INFO:tasks.workunit.client.0.smithi002.stdout: 1 741192 7.04 MB/sec execute 435 sec latency 76.839 ms 2024-06-13T02:28:11.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:11 smithi002 ceph-mon[31960]: pgmap v325: 129 pgs: 20 active+clean+snaptrim, 57 active+clean+snaptrim_wait, 52 active+clean; 94 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 2.0 MiB/s wr, 276 op/s 2024-06-13T02:28:11.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:11 smithi084 ceph-mon[36833]: pgmap v325: 129 pgs: 20 active+clean+snaptrim, 57 active+clean+snaptrim_wait, 52 active+clean; 94 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 969 KiB/s rd, 2.0 MiB/s wr, 276 op/s 2024-06-13T02:28:12.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:12 smithi175 ceph-mon[36977]: pgmap v326: 129 pgs: 129 active+clean; 88 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 200 op/s 2024-06-13T02:28:12.552 INFO:tasks.workunit.client.0.smithi002.stdout: 1 742356 7.05 MB/sec execute 436 sec latency 26.245 ms 2024-06-13T02:28:12.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:12 smithi002 ceph-mon[31960]: pgmap v326: 129 pgs: 129 active+clean; 88 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 200 op/s 2024-06-13T02:28:12.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:12 smithi084 ceph-mon[36833]: pgmap v326: 129 pgs: 129 active+clean; 88 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 200 op/s 2024-06-13T02:28:13.552 INFO:tasks.workunit.client.0.smithi002.stdout: 1 743166 7.04 MB/sec execute 437 sec latency 36.494 ms 2024-06-13T02:28:14.552 INFO:tasks.workunit.client.0.smithi002.stdout: 1 744125 7.03 MB/sec execute 438 sec latency 28.510 ms 2024-06-13T02:28:14.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:14 smithi084 ceph-mon[36833]: osdmap e114: 12 total, 12 up, 12 in 2024-06-13T02:28:14.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:14 smithi084 ceph-mon[36833]: pgmap v328: 129 pgs: 129 active+clean; 88 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 231 op/s 2024-06-13T02:28:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:14 smithi175 ceph-mon[36977]: osdmap e114: 12 total, 12 up, 12 in 2024-06-13T02:28:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:14 smithi175 ceph-mon[36977]: pgmap v328: 129 pgs: 129 active+clean; 88 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 231 op/s 2024-06-13T02:28:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:14 smithi002 ceph-mon[31960]: osdmap e114: 12 total, 12 up, 12 in 2024-06-13T02:28:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:14 smithi002 ceph-mon[31960]: pgmap v328: 129 pgs: 129 active+clean; 88 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 231 op/s 2024-06-13T02:28:15.552 INFO:tasks.workunit.client.0.smithi002.stdout: 1 745686 7.04 MB/sec execute 439 sec latency 56.109 ms 2024-06-13T02:28:15.971 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:15 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:28:16.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:15 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:28:16.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:15 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:28:16.552 INFO:tasks.workunit.client.0.smithi002.stdout: 1 746343 7.03 MB/sec execute 440 sec latency 52.742 ms 2024-06-13T02:28:16.881 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:16 smithi002 ceph-mon[31960]: pgmap v329: 129 pgs: 129 active+clean; 88 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 210 op/s 2024-06-13T02:28:16.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:16 smithi084 ceph-mon[36833]: pgmap v329: 129 pgs: 129 active+clean; 88 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 210 op/s 2024-06-13T02:28:17.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:16 smithi175 ceph-mon[36977]: pgmap v329: 129 pgs: 129 active+clean; 88 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 210 op/s 2024-06-13T02:28:17.552 INFO:tasks.workunit.client.0.smithi002.stdout: 1 747371 7.03 MB/sec execute 441 sec latency 40.578 ms 2024-06-13T02:28:18.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:17 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:18.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:17 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:18.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:17 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:17 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:17 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:17 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:17 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:17 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:17 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.221 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:17 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:17 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:18.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:17 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:18.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:17 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:17 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:17 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:17 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:17 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:17 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:17 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.283 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:17 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:17 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:18.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:17 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:18.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:17 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:17 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:17 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:17 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:17 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:17 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:17 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:17 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:18.552 INFO:tasks.workunit.client.0.smithi002.stdout: 1 749283 7.04 MB/sec execute 442 sec latency 25.960 ms 2024-06-13T02:28:19.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:19 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi084 to 176.2M 2024-06-13T02:28:19.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:19 smithi002 ceph-mon[31960]: Unable to set osd_memory_target on smithi084 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-06-13T02:28:19.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:19 smithi002 ceph-mon[31960]: pgmap v330: 129 pgs: 129 active+clean; 89 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 193 op/s 2024-06-13T02:28:19.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:19 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:19.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:19 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:19.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:19 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:19.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:19 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:19.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:19 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi084 to 176.2M 2024-06-13T02:28:19.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:19 smithi084 ceph-mon[36833]: Unable to set osd_memory_target on smithi084 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-06-13T02:28:19.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:19 smithi084 ceph-mon[36833]: pgmap v330: 129 pgs: 129 active+clean; 89 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 193 op/s 2024-06-13T02:28:19.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:19 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:19.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:19 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:19.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:19 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:19.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:19 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:19.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:19 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi084 to 176.2M 2024-06-13T02:28:19.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:19 smithi175 ceph-mon[36977]: Unable to set osd_memory_target on smithi084 to 184785305: error parsing value: Value '184785305' is below minimum 939524096 2024-06-13T02:28:19.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:19 smithi175 ceph-mon[36977]: pgmap v330: 129 pgs: 129 active+clean; 89 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 193 op/s 2024-06-13T02:28:19.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:19 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:19.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:19 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:19.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:19 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:19.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:19 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:19.552 INFO:tasks.workunit.client.0.smithi002.stdout: 1 750269 7.03 MB/sec execute 443 sec latency 18.751 ms 2024-06-13T02:28:20.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi175 to 176.2M 2024-06-13T02:28:20.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: Unable to set osd_memory_target on smithi175 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-06-13T02:28:20.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:28:20.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:28:20.384 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:20 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:20.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi175 to 176.2M 2024-06-13T02:28:20.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: Unable to set osd_memory_target on smithi175 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-06-13T02:28:20.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:28:20.472 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:28:20.473 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:20 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:20.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi175 to 176.2M 2024-06-13T02:28:20.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: Unable to set osd_memory_target on smithi175 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-06-13T02:28:20.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-13T02:28:20.535 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:28:20.535 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:28:20.535 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:20 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:28:20.553 INFO:tasks.workunit.client.0.smithi002.stdout: 1 751597 7.03 MB/sec execute 444 sec latency 67.208 ms 2024-06-13T02:28:21.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:21 smithi002 ceph-mon[31960]: Adjusting osd_memory_target on smithi002 to 177.5M 2024-06-13T02:28:21.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:21 smithi002 ceph-mon[31960]: Unable to set osd_memory_target on smithi002 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-13T02:28:21.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:21 smithi002 ceph-mon[31960]: pgmap v331: 129 pgs: 129 active+clean; 89 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 193 op/s 2024-06-13T02:28:21.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:21 smithi084 ceph-mon[36833]: Adjusting osd_memory_target on smithi002 to 177.5M 2024-06-13T02:28:21.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:21 smithi084 ceph-mon[36833]: Unable to set osd_memory_target on smithi002 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-13T02:28:21.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:21 smithi084 ceph-mon[36833]: pgmap v331: 129 pgs: 129 active+clean; 89 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 193 op/s 2024-06-13T02:28:21.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:21 smithi175 ceph-mon[36977]: Adjusting osd_memory_target on smithi002 to 177.5M 2024-06-13T02:28:21.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:21 smithi175 ceph-mon[36977]: Unable to set osd_memory_target on smithi002 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-06-13T02:28:21.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:21 smithi175 ceph-mon[36977]: pgmap v331: 129 pgs: 129 active+clean; 89 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 193 op/s 2024-06-13T02:28:21.552 INFO:tasks.workunit.client.0.smithi002.stdout: 1 753146 7.04 MB/sec execute 445 sec latency 19.603 ms 2024-06-13T02:28:22.553 INFO:tasks.workunit.client.0.smithi002.stdout: 1 754193 7.03 MB/sec execute 446 sec latency 24.231 ms 2024-06-13T02:28:23.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:23 smithi002 ceph-mon[31960]: pgmap v332: 129 pgs: 129 active+clean; 96 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 152 op/s 2024-06-13T02:28:23.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:23 smithi084 ceph-mon[36833]: pgmap v332: 129 pgs: 129 active+clean; 96 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 152 op/s 2024-06-13T02:28:23.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:23 smithi175 ceph-mon[36977]: pgmap v332: 129 pgs: 129 active+clean; 96 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 152 op/s 2024-06-13T02:28:23.553 INFO:tasks.workunit.client.0.smithi002.stdout: 1 755372 7.03 MB/sec execute 447 sec latency 26.430 ms 2024-06-13T02:28:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.778+0000 7f7184000640 1 -- 172.21.15.2:0/3141730438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f717c10e1d0 msgr2=0x7f717c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.778+0000 7f7184000640 1 --2- 172.21.15.2:0/3141730438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f717c10e1d0 0x7f717c110620 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7174009be0 tx=0x7f717402a750 comp rx=0 tx=0).stop 2024-06-13T02:28:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.778+0000 7f7184000640 1 -- 172.21.15.2:0/3141730438 shutdown_connections 2024-06-13T02:28:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.778+0000 7f7184000640 1 --2- 172.21.15.2:0/3141730438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f717c10e1d0 0x7f717c110620 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.778+0000 7f7184000640 1 --2- 172.21.15.2:0/3141730438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717c0746f0 0x7f717c10dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.778+0000 7f7184000640 1 --2- 172.21.15.2:0/3141730438 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c073dd0 0x7f717c0741b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.778+0000 7f7184000640 1 -- 172.21.15.2:0/3141730438 >> 172.21.15.2:0/3141730438 conn(0x7f717c0fd460 msgr2=0x7f717c0ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.778+0000 7f7184000640 1 -- 172.21.15.2:0/3141730438 shutdown_connections 2024-06-13T02:28:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.778+0000 7f7184000640 1 -- 172.21.15.2:0/3141730438 wait complete. 2024-06-13T02:28:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.779+0000 7f7184000640 1 Processor -- start 2024-06-13T02:28:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.780+0000 7f7184000640 1 -- start start 2024-06-13T02:28:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.780+0000 7f7184000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c073dd0 0x7f717c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.780+0000 7f7184000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717c0746f0 0x7f717c19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.780+0000 7f7184000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f717c10e1d0 0x7f717c19ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.780+0000 7f7184000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f717c113f20 con 0x7f717c073dd0 2024-06-13T02:28:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.780+0000 7f7184000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f717c113da0 con 0x7f717c10e1d0 2024-06-13T02:28:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.780+0000 7f7184000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f717c1140a0 con 0x7f717c0746f0 2024-06-13T02:28:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.780+0000 7f7182000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f717c10e1d0 0x7f717c19ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.780+0000 7f7181600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c073dd0 0x7f717c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.780+0000 7f7182000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f717c10e1d0 0x7f717c19ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:32866/0 (socket says 172.21.15.2:32866) 2024-06-13T02:28:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.780+0000 7f7182000640 1 -- 172.21.15.2:0/641839150 learned_addr learned my addr 172.21.15.2:0/641839150 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.780+0000 7f7180c00640 1 --2- 172.21.15.2:0/641839150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717c0746f0 0x7f717c19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.781+0000 7f7182000640 1 -- 172.21.15.2:0/641839150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717c0746f0 msgr2=0x7f717c19a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.781+0000 7f7182000640 1 --2- 172.21.15.2:0/641839150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717c0746f0 0x7f717c19a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.781+0000 7f7182000640 1 -- 172.21.15.2:0/641839150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c073dd0 msgr2=0x7f717c19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.781+0000 7f7182000640 1 --2- 172.21.15.2:0/641839150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c073dd0 0x7f717c19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.781+0000 7f7182000640 1 -- 172.21.15.2:0/641839150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c19f400 con 0x7f717c10e1d0 2024-06-13T02:28:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.781+0000 7f7182000640 1 --2- 172.21.15.2:0/641839150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f717c10e1d0 0x7f717c19ecd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7174009d00 tx=0x7f7174030630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.781+0000 7f717a000640 1 -- 172.21.15.2:0/641839150 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7174041020 con 0x7f717c10e1d0 2024-06-13T02:28:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.782+0000 7f717a000640 1 -- 172.21.15.2:0/641839150 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7174037040 con 0x7f717c10e1d0 2024-06-13T02:28:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.782+0000 7f717a000640 1 -- 172.21.15.2:0/641839150 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7174036070 con 0x7f717c10e1d0 2024-06-13T02:28:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.782+0000 7f7184000640 1 -- 172.21.15.2:0/641839150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717c19f690 con 0x7f717c10e1d0 2024-06-13T02:28:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.782+0000 7f7184000640 1 -- 172.21.15.2:0/641839150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f717c1a6f80 con 0x7f717c10e1d0 2024-06-13T02:28:23.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.785+0000 7f717a000640 1 -- 172.21.15.2:0/641839150 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f7174044020 con 0x7f717c10e1d0 2024-06-13T02:28:23.786 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.785+0000 7f7186e49740 1 Processor -- start 2024-06-13T02:28:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.785+0000 7f7186e49740 1 -- start start 2024-06-13T02:28:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.786+0000 7f7186e49740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb07955e0 0x564fb0793b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.786+0000 7f7186e49740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb0794070 0x564fb07944f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.786+0000 7f7186e49740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb079edf0 0x564fb07a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.786+0000 7f7186e49740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564fb06f8420 con 0x564fb07955e0 2024-06-13T02:28:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.786+0000 7f7186e49740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564fb069fc50 con 0x564fb0794070 2024-06-13T02:28:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.786+0000 7f7186e49740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564fb06f43e0 con 0x564fb079edf0 2024-06-13T02:28:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.786+0000 7f7181600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb0794070 0x564fb07944f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.786+0000 7f7181600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb0794070 0x564fb07944f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:32870/0 (socket says 172.21.15.2:32870) 2024-06-13T02:28:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.786+0000 7f7181600640 1 -- 172.21.15.2:0/2726035747 learned_addr learned my addr 172.21.15.2:0/2726035747 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.786+0000 7f7180c00640 1 --2- 172.21.15.2:0/2726035747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb07955e0 0x564fb0793b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.787+0000 7f7181600640 1 -- 172.21.15.2:0/2726035747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb079edf0 msgr2=0x564fb07a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.787+0000 7f7181600640 1 --2- 172.21.15.2:0/2726035747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb079edf0 0x564fb07a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.787+0000 7f7181600640 1 -- 172.21.15.2:0/2726035747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb07955e0 msgr2=0x564fb0793b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.787+0000 7f7181600640 1 --2- 172.21.15.2:0/2726035747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb07955e0 0x564fb0793b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.787+0000 7f7181600640 1 -- 172.21.15.2:0/2726035747 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fb040c210 con 0x564fb0794070 2024-06-13T02:28:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.787+0000 7f7181600640 1 --2- 172.21.15.2:0/2726035747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb0794070 0x564fb07944f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7170009d20 tx=0x7f7170011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d26ce0160a2770b1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.787+0000 7f717a000640 1 --2- 172.21.15.2:0/641839150 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f71640a2d70 0x7f71640a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.787+0000 7f717a000640 1 -- 172.21.15.2:0/641839150 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 9583+0+0 (secure 0 0 0) 0x7f71740f02d0 con 0x7f717c10e1d0 2024-06-13T02:28:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.787+0000 7f716e600640 1 -- 172.21.15.2:0/2726035747 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7170004230 con 0x564fb0794070 2024-06-13T02:28:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.787+0000 7f716e600640 1 -- 172.21.15.2:0/2726035747 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71700043d0 con 0x564fb0794070 2024-06-13T02:28:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.787+0000 7f716e600640 1 -- 172.21.15.2:0/2726035747 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7170019930 con 0x564fb0794070 2024-06-13T02:28:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.787+0000 7f7180c00640 1 --2- 172.21.15.2:0/641839150 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f71640a2d70 0x7f71640a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.788+0000 7f7186e49740 1 -- 172.21.15.2:0/2726035747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb0794070 msgr2=0x564fb07944f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.788+0000 7f7186e49740 1 --2- 172.21.15.2:0/2726035747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb0794070 0x564fb07944f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7170009d20 tx=0x7f7170011810 comp rx=0 tx=0).stop 2024-06-13T02:28:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.788+0000 7f7186e49740 1 -- 172.21.15.2:0/2726035747 shutdown_connections 2024-06-13T02:28:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.788+0000 7f7186e49740 1 --2- 172.21.15.2:0/2726035747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb079edf0 0x564fb07a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.788+0000 7f7186e49740 1 --2- 172.21.15.2:0/2726035747 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb0794070 0x564fb07944f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.788+0000 7f7186e49740 1 --2- 172.21.15.2:0/2726035747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb07955e0 0x564fb0793b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.788+0000 7f7186e49740 1 -- 172.21.15.2:0/2726035747 >> 172.21.15.2:0/2726035747 conn(0x564fb075cfb0 msgr2=0x564fb0790660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.788+0000 7f7180c00640 1 --2- 172.21.15.2:0/641839150 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f71640a2d70 0x7f71640a5230 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7168009670 tx=0x7f7168009600 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.788+0000 7f7186e49740 1 -- 172.21.15.2:0/2726035747 shutdown_connections 2024-06-13T02:28:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.788+0000 7f7186e49740 1 -- 172.21.15.2:0/2726035747 wait complete. 2024-06-13T02:28:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.789+0000 7f7186e49740 1 -- start start 2024-06-13T02:28:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.789+0000 7f7186e49740 1 Processor -- start 2024-06-13T02:28:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.790+0000 7f7186e49740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb0794070 0x564fb079bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.790+0000 7f7186e49740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb07955e0 0x564fb079c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.790+0000 7f7186e49740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb079edf0 0x564fb079c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.790+0000 7f7186e49740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x564fb07a1bc0 con 0x564fb079edf0 2024-06-13T02:28:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.790+0000 7f7186e49740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564fb06b30b0 con 0x564fb0794070 2024-06-13T02:28:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.790+0000 7f7186e49740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x564fb07a1d40 con 0x564fb07955e0 2024-06-13T02:28:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.790+0000 7f7186e49740 10 client.0 _ll_register_callbacks cb 0x564fb069ef40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:28:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.790+0000 7f7181600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb0794070 0x564fb079bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.790+0000 7f7181600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb0794070 0x564fb079bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:32874/0 (socket says 172.21.15.2:32874) 2024-06-13T02:28:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.790+0000 7f7181600640 1 -- 172.21.15.2:0/615551303 learned_addr learned my addr 172.21.15.2:0/615551303 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.790+0000 7f7180c00640 1 --2- 172.21.15.2:0/615551303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb07955e0 0x564fb079c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.791+0000 7f7182000640 1 --2- 172.21.15.2:0/615551303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb079edf0 0x564fb079c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.791+0000 7f7181600640 1 -- 172.21.15.2:0/615551303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb07955e0 msgr2=0x564fb079c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.791+0000 7f7181600640 1 --2- 172.21.15.2:0/615551303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb07955e0 0x564fb079c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.791+0000 7f7181600640 1 -- 172.21.15.2:0/615551303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb079edf0 msgr2=0x564fb079c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.791+0000 7f7181600640 1 --2- 172.21.15.2:0/615551303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb079edf0 0x564fb079c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.791+0000 7f7181600640 1 -- 172.21.15.2:0/615551303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fb04d8620 con 0x564fb0794070 2024-06-13T02:28:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.791+0000 7f7180c00640 1 --2- 172.21.15.2:0/615551303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb07955e0 0x564fb079c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:28:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.791+0000 7f7182000640 1 --2- 172.21.15.2:0/615551303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb079edf0 0x564fb079c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:28:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.792+0000 7f7181600640 1 --2- 172.21.15.2:0/615551303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb0794070 0x564fb079bdc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f717001b040 tx=0x7f7170005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe9b28db7ec5f93f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.792+0000 7f7162a00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:28:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.792+0000 7f7162a00640 1 -- 172.21.15.2:0/615551303 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7170027070 con 0x564fb0794070 2024-06-13T02:28:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.792+0000 7f7162a00640 1 -- 172.21.15.2:0/615551303 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9583+0+0 (secure 0 0 0) 0x7f71700037f0 con 0x564fb0794070 2024-06-13T02:28:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.792+0000 7f7186e49740 1 -- 172.21.15.2:0/615551303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71700043d0 con 0x564fb0794070 2024-06-13T02:28:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.792+0000 7f7162a00640 1 -- 172.21.15.2:0/615551303 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7170033050 con 0x564fb0794070 2024-06-13T02:28:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.792+0000 7f7186e49740 10 client.26102 fetch_fsmap learned FSMap version 35 2024-06-13T02:28:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.792+0000 7f7186e49740 1 -- 172.21.15.2:0/615551303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564fb07bef30 con 0x564fb0794070 2024-06-13T02:28:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.792+0000 7f7162a00640 1 -- 172.21.15.2:0/615551303 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71700043d0 con 0x564fb0794070 2024-06-13T02:28:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.793+0000 7f7162a00640 1 -- 172.21.15.2:0/615551303 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f7170004c30 con 0x564fb0794070 2024-06-13T02:28:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.793+0000 7f7186e49740 10 client.26102 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:28:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.793+0000 7f7186e49740 10 client.26102 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:28:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.793+0000 7f7186e49740 20 client.26102 populate_metadata read hostname 'smithi002' 2024-06-13T02:28:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.793+0000 7f7186e49740 1 --2- 172.21.15.2:0/615551303 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x564fb07c0340 0x564fb07c2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.793+0000 7f7186e49740 4 client.26102 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:28:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.793+0000 7f7186e49740 1 -- 172.21.15.2:0/615551303 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fb0705b50 con 0x564fb07c0340 2024-06-13T02:28:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.793+0000 7f7180c00640 1 --2- 172.21.15.2:0/615551303 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x564fb07c0340 0x564fb07c2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.794+0000 7f7180c00640 1 --2- 172.21.15.2:0/615551303 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x564fb07c0340 0x564fb07c2730 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=661fdfe7d4cbe06a server_cookie=2500ddb623b4e1dd in_seq=0 out_seq=0 2024-06-13T02:28:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.794+0000 7f7162a00640 10 client.26102 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.795+0000 7f7162a00640 1 -- 172.21.15.2:0/615551303 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564fb0705b50 con 0x564fb07c0340 2024-06-13T02:28:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.795+0000 7f7162a00640 10 client.26102 handle_command_reply: tid=0 2024-06-13T02:28:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.795+0000 7f7186e49740 1 client.26102 shutdown 2024-06-13T02:28:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.796+0000 7f7186e49740 1 -- 172.21.15.2:0/615551303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb0794070 msgr2=0x564fb079bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.796+0000 7f7186e49740 1 --2- 172.21.15.2:0/615551303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb0794070 0x564fb079bdc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f717001b040 tx=0x7f7170005270 comp rx=0 tx=0).stop 2024-06-13T02:28:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.796+0000 7f7186e49740 1 -- 172.21.15.2:0/615551303 shutdown_connections 2024-06-13T02:28:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.796+0000 7f7186e49740 1 --2- 172.21.15.2:0/615551303 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x564fb07c0340 0x564fb07c2730 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.796+0000 7f7186e49740 1 --2- 172.21.15.2:0/615551303 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb079edf0 0x564fb079c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.796+0000 7f7186e49740 1 --2- 172.21.15.2:0/615551303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb07955e0 0x564fb079c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.796+0000 7f7186e49740 1 --2- 172.21.15.2:0/615551303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb0794070 0x564fb079bdc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.796+0000 7f7162a00640 0 client.26102 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.796+0000 7f7186e49740 1 -- 172.21.15.2:0/615551303 >> 172.21.15.2:0/615551303 conn(0x564fb075cfb0 msgr2=0x564fb0796460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.796+0000 7f7186e49740 1 -- 172.21.15.2:0/615551303 shutdown_connections 2024-06-13T02:28:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.796+0000 7f7186e49740 1 -- 172.21.15.2:0/615551303 wait complete. 2024-06-13T02:28:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.796+0000 7f7186e49740 20 client.26102 trim_cache size 0 max 16384 2024-06-13T02:28:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.816+0000 7f7186e49740 1 Processor -- start 2024-06-13T02:28:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.816+0000 7f7186e49740 1 -- start start 2024-06-13T02:28:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.816+0000 7f7186e49740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb0794070 0x564fb07c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.816+0000 7f7186e49740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb07955e0 0x564fb07c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.816+0000 7f7186e49740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb079edf0 0x564fb079bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.816+0000 7f7186e49740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f717c1ab320 con 0x564fb0794070 2024-06-13T02:28:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.816+0000 7f7186e49740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f717c1a8bf0 con 0x564fb07955e0 2024-06-13T02:28:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.816+0000 7f7186e49740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f717c0734e0 con 0x564fb079edf0 2024-06-13T02:28:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.817+0000 7f7180c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb07955e0 0x564fb07c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.817+0000 7f7180c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb07955e0 0x564fb07c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:32880/0 (socket says 172.21.15.2:32880) 2024-06-13T02:28:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.817+0000 7f7180c00640 1 -- 172.21.15.2:0/1735206170 learned_addr learned my addr 172.21.15.2:0/1735206170 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.817+0000 7f7182000640 1 --2- 172.21.15.2:0/1735206170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb079edf0 0x564fb079bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.817+0000 7f7181600640 1 --2- 172.21.15.2:0/1735206170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb0794070 0x564fb07c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.817+0000 7f7180c00640 1 -- 172.21.15.2:0/1735206170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb079edf0 msgr2=0x564fb079bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.817+0000 7f7180c00640 1 --2- 172.21.15.2:0/1735206170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb079edf0 0x564fb079bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.817+0000 7f7180c00640 1 -- 172.21.15.2:0/1735206170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb0794070 msgr2=0x564fb07c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.817+0000 7f7180c00640 1 --2- 172.21.15.2:0/1735206170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb0794070 0x564fb07c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.817+0000 7f7180c00640 1 -- 172.21.15.2:0/1735206170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fb0794b40 con 0x564fb07955e0 2024-06-13T02:28:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.817+0000 7f7181600640 1 --2- 172.21.15.2:0/1735206170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb0794070 0x564fb07c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:28:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.817+0000 7f7182000640 1 --2- 172.21.15.2:0/1735206170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb079edf0 0x564fb079bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:28:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.817+0000 7f7180c00640 1 --2- 172.21.15.2:0/1735206170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb07955e0 0x564fb07c8390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f716801d840 tx=0x7f716801a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e727fd344823c76 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.818+0000 7f716dc00640 1 -- 172.21.15.2:0/1735206170 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716801dd40 con 0x564fb07955e0 2024-06-13T02:28:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.818+0000 7f716dc00640 1 -- 172.21.15.2:0/1735206170 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7168005500 con 0x564fb07955e0 2024-06-13T02:28:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.818+0000 7f716dc00640 1 -- 172.21.15.2:0/1735206170 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7168004a00 con 0x564fb07955e0 2024-06-13T02:28:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.819+0000 7f7186e49740 1 -- 172.21.15.2:0/1735206170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb07955e0 msgr2=0x564fb07c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.819+0000 7f7186e49740 1 --2- 172.21.15.2:0/1735206170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb07955e0 0x564fb07c8390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f716801d840 tx=0x7f716801a000 comp rx=0 tx=0).stop 2024-06-13T02:28:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.819+0000 7f7186e49740 1 -- 172.21.15.2:0/1735206170 shutdown_connections 2024-06-13T02:28:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.819+0000 7f7186e49740 1 --2- 172.21.15.2:0/1735206170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb079edf0 0x564fb079bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.819+0000 7f7186e49740 1 --2- 172.21.15.2:0/1735206170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb07955e0 0x564fb07c8390 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.819+0000 7f7186e49740 1 --2- 172.21.15.2:0/1735206170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb0794070 0x564fb07c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.819+0000 7f7186e49740 1 -- 172.21.15.2:0/1735206170 >> 172.21.15.2:0/1735206170 conn(0x564fb075cfb0 msgr2=0x564fb0790190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.819+0000 7f7186e49740 1 -- 172.21.15.2:0/1735206170 shutdown_connections 2024-06-13T02:28:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.819+0000 7f7186e49740 1 -- 172.21.15.2:0/1735206170 wait complete. 2024-06-13T02:28:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.819+0000 7f7186e49740 1 -- start start 2024-06-13T02:28:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.819+0000 7f7186e49740 1 Processor -- start 2024-06-13T02:28:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.820+0000 7f7186e49740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb0794070 0x564fb07a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.820+0000 7f7186e49740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb07955e0 0x564fb07a26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.820+0000 7f7186e49740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb079edf0 0x564fb0828e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.820+0000 7f7186e49740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f717c1a7150 con 0x564fb0794070 2024-06-13T02:28:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.820+0000 7f7186e49740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f717c1a8520 con 0x564fb079edf0 2024-06-13T02:28:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.820+0000 7f7186e49740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f717c1a7780 con 0x564fb07955e0 2024-06-13T02:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.820+0000 7f7186e49740 10 client.0 _ll_register_callbacks cb 0x7f7170009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.820+0000 7f7181600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb0794070 0x564fb07a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.820+0000 7f7180c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb07955e0 0x564fb07a26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.820+0000 7f7180c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb07955e0 0x564fb07a26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:43008/0 (socket says 172.21.15.2:43008) 2024-06-13T02:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.820+0000 7f7180c00640 1 -- 172.21.15.2:0/1291939859 learned_addr learned my addr 172.21.15.2:0/1291939859 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.820+0000 7f7182000640 1 --2- 172.21.15.2:0/1291939859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb079edf0 0x564fb0828e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.821+0000 7f7180c00640 1 -- 172.21.15.2:0/1291939859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb079edf0 msgr2=0x564fb0828e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.821+0000 7f7180c00640 1 --2- 172.21.15.2:0/1291939859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb079edf0 0x564fb0828e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.821+0000 7f7180c00640 1 -- 172.21.15.2:0/1291939859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb0794070 msgr2=0x564fb07a21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.821+0000 7f7180c00640 1 --2- 172.21.15.2:0/1291939859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb0794070 0x564fb07a21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.821+0000 7f7180c00640 1 -- 172.21.15.2:0/1291939859 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fb0829350 con 0x564fb07955e0 2024-06-13T02:28:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.821+0000 7f7181600640 1 --2- 172.21.15.2:0/1291939859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb0794070 0x564fb07a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:28:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.821+0000 7f7180c00640 1 --2- 172.21.15.2:0/1291939859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb07955e0 0x564fb07a26e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7168018040 tx=0x7f7168005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae6cca3c96f22b18 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.821+0000 7f7162a00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:28:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.821+0000 7f7162a00640 1 -- 172.21.15.2:0/1291939859 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716800fa10 con 0x564fb07955e0 2024-06-13T02:28:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.821+0000 7f7162a00640 1 -- 172.21.15.2:0/1291939859 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9583+0+0 (secure 0 0 0) 0x7f716803e470 con 0x564fb07955e0 2024-06-13T02:28:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.821+0000 7f7186e49740 1 -- 172.21.15.2:0/1291939859 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7168005500 con 0x564fb07955e0 2024-06-13T02:28:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.822+0000 7f7162a00640 1 -- 172.21.15.2:0/1291939859 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f716804c050 con 0x564fb07955e0 2024-06-13T02:28:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.822+0000 7f7186e49740 10 client.26089 fetch_fsmap learned FSMap version 35 2024-06-13T02:28:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.822+0000 7f7186e49740 1 -- 172.21.15.2:0/1291939859 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564fb082a570 con 0x564fb07955e0 2024-06-13T02:28:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.822+0000 7f7162a00640 1 -- 172.21.15.2:0/1291939859 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7168005500 con 0x564fb07955e0 2024-06-13T02:28:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.822+0000 7f7162a00640 1 -- 172.21.15.2:0/1291939859 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f716802b730 con 0x564fb07955e0 2024-06-13T02:28:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.822+0000 7f7186e49740 10 client.26089 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:28:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.822+0000 7f7186e49740 10 client.26089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:28:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.822+0000 7f7186e49740 20 client.26089 populate_metadata read hostname 'smithi002' 2024-06-13T02:28:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.822+0000 7f7186e49740 1 --2- 172.21.15.2:0/1291939859 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x564fb082acb0 0x564fb082d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.822+0000 7f7186e49740 4 client.26089 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:28:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.822+0000 7f7186e49740 1 -- 172.21.15.2:0/1291939859 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564fb06ffea0 con 0x564fb082acb0 2024-06-13T02:28:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.823+0000 7f7181600640 1 --2- 172.21.15.2:0/1291939859 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x564fb082acb0 0x564fb082d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.823+0000 7f7181600640 1 --2- 172.21.15.2:0/1291939859 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x564fb082acb0 0x564fb082d0d0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=267f4d2cc54abf26 server_cookie=6c79a39a19e2d007 in_seq=0 out_seq=0 2024-06-13T02:28:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:23.823+0000 7f7162a00640 10 client.26089 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:24.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.112+0000 7f7162a00640 1 -- 172.21.15.2:0/1291939859 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x564fb06ffea0 con 0x564fb082acb0 2024-06-13T02:28:24.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.112+0000 7f7162a00640 10 client.26089 handle_command_reply: tid=0 2024-06-13T02:28:24.113 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.112+0000 7f7186e49740 1 client.26089 shutdown 2024-06-13T02:28:24.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.113+0000 7f7186e49740 1 -- 172.21.15.2:0/1291939859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb07955e0 msgr2=0x564fb07a26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:24.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.113+0000 7f7186e49740 1 --2- 172.21.15.2:0/1291939859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb07955e0 0x564fb07a26e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7168018040 tx=0x7f7168005740 comp rx=0 tx=0).stop 2024-06-13T02:28:24.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.113+0000 7f7186e49740 1 -- 172.21.15.2:0/1291939859 shutdown_connections 2024-06-13T02:28:24.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.113+0000 7f7186e49740 1 --2- 172.21.15.2:0/1291939859 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x564fb082acb0 0x564fb082d0d0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:24.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.113+0000 7f7186e49740 1 --2- 172.21.15.2:0/1291939859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564fb079edf0 0x564fb0828e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:24.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.113+0000 7f7186e49740 1 --2- 172.21.15.2:0/1291939859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564fb07955e0 0x564fb07a26e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.113+0000 7f7186e49740 1 --2- 172.21.15.2:0/1291939859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x564fb0794070 0x564fb07a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.113+0000 7f7186e49740 1 -- 172.21.15.2:0/1291939859 >> 172.21.15.2:0/1291939859 conn(0x564fb075cfb0 msgr2=0x564fb0796460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.113+0000 7f7162a00640 0 client.26089 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.114+0000 7f7186e49740 1 -- 172.21.15.2:0/1291939859 shutdown_connections 2024-06-13T02:28:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.114+0000 7f7186e49740 1 -- 172.21.15.2:0/1291939859 wait complete. 2024-06-13T02:28:24.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.114+0000 7f7186e49740 20 client.26089 trim_cache size 0 max 16384 2024-06-13T02:28:24.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:28:24.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:28:24.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:28:24.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.115+0000 7f7184000640 1 -- 172.21.15.2:0/641839150 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f71640a2d70 msgr2=0x7f71640a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:24.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.115+0000 7f7184000640 1 --2- 172.21.15.2:0/641839150 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f71640a2d70 0x7f71640a5230 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7168009670 tx=0x7f7168009600 comp rx=0 tx=0).stop 2024-06-13T02:28:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.115+0000 7f7184000640 1 -- 172.21.15.2:0/641839150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f717c10e1d0 msgr2=0x7f717c19ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.115+0000 7f7184000640 1 --2- 172.21.15.2:0/641839150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f717c10e1d0 0x7f717c19ecd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7174009d00 tx=0x7f7174030630 comp rx=0 tx=0).stop 2024-06-13T02:28:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.116+0000 7f7184000640 1 -- 172.21.15.2:0/641839150 shutdown_connections 2024-06-13T02:28:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.116+0000 7f7184000640 1 --2- 172.21.15.2:0/641839150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f717c10e1d0 0x7f717c19ecd0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.116+0000 7f7184000640 1 --2- 172.21.15.2:0/641839150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f717c0746f0 0x7f717c19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.116+0000 7f7184000640 1 --2- 172.21.15.2:0/641839150 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f71640a2d70 0x7f71640a5230 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.116+0000 7f7184000640 1 --2- 172.21.15.2:0/641839150 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f717c073dd0 0x7f717c19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.116+0000 7f7184000640 1 -- 172.21.15.2:0/641839150 >> 172.21.15.2:0/641839150 conn(0x7f717c0fd460 msgr2=0x7f717c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.116+0000 7f7184000640 1 -- 172.21.15.2:0/641839150 shutdown_connections 2024-06-13T02:28:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:24.116+0000 7f7184000640 1 -- 172.21.15.2:0/641839150 wait complete. 2024-06-13T02:28:24.553 INFO:tasks.workunit.client.0.smithi002.stdout: 1 756435 7.03 MB/sec execute 448 sec latency 145.597 ms 2024-06-13T02:28:25.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:25 smithi002 ceph-mon[31960]: pgmap v333: 129 pgs: 129 active+clean; 96 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 148 op/s 2024-06-13T02:28:25.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:25 smithi084 ceph-mon[36833]: pgmap v333: 129 pgs: 129 active+clean; 96 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 148 op/s 2024-06-13T02:28:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:25 smithi175 ceph-mon[36977]: pgmap v333: 129 pgs: 129 active+clean; 96 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 148 op/s 2024-06-13T02:28:25.553 INFO:tasks.workunit.client.0.smithi002.stdout: 1 757050 7.02 MB/sec execute 449 sec latency 44.741 ms 2024-06-13T02:28:26.553 INFO:tasks.workunit.client.0.smithi002.stdout: 1 757926 7.01 MB/sec execute 450 sec latency 37.947 ms 2024-06-13T02:28:27.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:27 smithi002 ceph-mon[31960]: pgmap v334: 129 pgs: 129 active+clean; 89 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 222 op/s 2024-06-13T02:28:27.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:27 smithi084 ceph-mon[36833]: pgmap v334: 129 pgs: 129 active+clean; 89 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 222 op/s 2024-06-13T02:28:27.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:27 smithi175 ceph-mon[36977]: pgmap v334: 129 pgs: 129 active+clean; 89 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 222 op/s 2024-06-13T02:28:27.553 INFO:tasks.workunit.client.0.smithi002.stdout: 1 759316 7.02 MB/sec execute 451 sec latency 29.589 ms 2024-06-13T02:28:28.553 INFO:tasks.workunit.client.0.smithi002.stdout: 1 760112 7.01 MB/sec execute 452 sec latency 25.900 ms 2024-06-13T02:28:29.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:29 smithi002 ceph-mon[31960]: pgmap v335: 129 pgs: 129 active+clean; 87 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 255 op/s 2024-06-13T02:28:29.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:29 smithi084 ceph-mon[36833]: pgmap v335: 129 pgs: 129 active+clean; 87 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 255 op/s 2024-06-13T02:28:29.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:29 smithi175 ceph-mon[36977]: pgmap v335: 129 pgs: 129 active+clean; 87 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 255 op/s 2024-06-13T02:28:29.553 INFO:tasks.workunit.client.0.smithi002.stdout: 1 761030 7.00 MB/sec execute 453 sec latency 30.977 ms 2024-06-13T02:28:30.554 INFO:tasks.workunit.client.0.smithi002.stdout: 1 762295 7.00 MB/sec execute 454 sec latency 24.738 ms 2024-06-13T02:28:31.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:31 smithi002 ceph-mon[31960]: pgmap v336: 129 pgs: 129 active+clean; 87 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 236 op/s 2024-06-13T02:28:31.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:31 smithi084 ceph-mon[36833]: pgmap v336: 129 pgs: 129 active+clean; 87 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 236 op/s 2024-06-13T02:28:31.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:31 smithi175 ceph-mon[36977]: pgmap v336: 129 pgs: 129 active+clean; 87 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 236 op/s 2024-06-13T02:28:31.554 INFO:tasks.workunit.client.0.smithi002.stdout: 1 763527 7.01 MB/sec execute 455 sec latency 106.894 ms 2024-06-13T02:28:32.554 INFO:tasks.workunit.client.0.smithi002.stdout: 1 764322 7.00 MB/sec execute 456 sec latency 20.066 ms 2024-06-13T02:28:33.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:33 smithi002 ceph-mon[31960]: pgmap v337: 129 pgs: 129 active+clean; 89 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 291 op/s 2024-06-13T02:28:33.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:33 smithi084 ceph-mon[36833]: pgmap v337: 129 pgs: 129 active+clean; 89 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 291 op/s 2024-06-13T02:28:33.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:33 smithi175 ceph-mon[36977]: pgmap v337: 129 pgs: 129 active+clean; 89 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 291 op/s 2024-06-13T02:28:33.554 INFO:tasks.workunit.client.0.smithi002.stdout: 1 765618 6.99 MB/sec execute 457 sec latency 25.908 ms 2024-06-13T02:28:34.554 INFO:tasks.workunit.client.0.smithi002.stdout: 1 767064 7.00 MB/sec execute 458 sec latency 19.879 ms 2024-06-13T02:28:35.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:35 smithi002 ceph-mon[31960]: pgmap v338: 129 pgs: 129 active+clean; 89 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.6 MiB/s wr, 221 op/s 2024-06-13T02:28:35.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:35 smithi084 ceph-mon[36833]: pgmap v338: 129 pgs: 129 active+clean; 89 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.6 MiB/s wr, 221 op/s 2024-06-13T02:28:35.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:35 smithi175 ceph-mon[36977]: pgmap v338: 129 pgs: 129 active+clean; 89 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.6 MiB/s wr, 221 op/s 2024-06-13T02:28:35.554 INFO:tasks.workunit.client.0.smithi002.stdout: 1 767746 6.99 MB/sec execute 459 sec latency 59.573 ms 2024-06-13T02:28:36.554 INFO:tasks.workunit.client.0.smithi002.stdout: 1 768721 6.99 MB/sec execute 460 sec latency 69.830 ms 2024-06-13T02:28:37.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.270+0000 7f506a000640 1 -- 172.21.15.2:0/2592148274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5064102160 msgr2=0x7f506410e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:37.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.270+0000 7f506a000640 1 --2- 172.21.15.2:0/2592148274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5064102160 0x7f506410e670 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f505c009ca0 tx=0x7f505c02a8c0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.270+0000 7f506a000640 1 -- 172.21.15.2:0/2592148274 shutdown_connections 2024-06-13T02:28:37.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.270+0000 7f506a000640 1 --2- 172.21.15.2:0/2592148274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5064102160 0x7f506410e670 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.270+0000 7f506a000640 1 --2- 172.21.15.2:0/2592148274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50641017a0 0x7f5064101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.271 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.270+0000 7f506a000640 1 --2- 172.21.15.2:0/2592148274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50641077b0 0x7f5064107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.270+0000 7f506a000640 1 -- 172.21.15.2:0/2592148274 >> 172.21.15.2:0/2592148274 conn(0x7f50640fd2d0 msgr2=0x7f50640ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:37.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.270+0000 7f506a000640 1 -- 172.21.15.2:0/2592148274 shutdown_connections 2024-06-13T02:28:37.272 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.270+0000 7f506a000640 1 -- 172.21.15.2:0/2592148274 wait complete. 2024-06-13T02:28:37.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.272+0000 7f506a000640 1 Processor -- start 2024-06-13T02:28:37.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.272+0000 7f506a000640 1 -- start start 2024-06-13T02:28:37.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.272+0000 7f506a000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50641017a0 0x7f506419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.272+0000 7f506a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5064102160 0x7f506419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.274 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.272+0000 7f506a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50641077b0 0x7f506419eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.272+0000 7f506a000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5064111bc0 con 0x7f50641017a0 2024-06-13T02:28:37.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.272+0000 7f506a000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5064111a40 con 0x7f5064102160 2024-06-13T02:28:37.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.272+0000 7f506a000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5064111d40 con 0x7f50641077b0 2024-06-13T02:28:37.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.272+0000 7f5068c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50641017a0 0x7f506419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.272+0000 7f5063e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5064102160 0x7f506419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.272+0000 7f5068c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50641017a0 0x7f506419a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51578/0 (socket says 172.21.15.2:51578) 2024-06-13T02:28:37.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.272+0000 7f5068c00640 1 -- 172.21.15.2:0/2799032257 learned_addr learned my addr 172.21.15.2:0/2799032257 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:37.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.273+0000 7f5069600640 1 --2- 172.21.15.2:0/2799032257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50641077b0 0x7f506419eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.273+0000 7f5068c00640 1 -- 172.21.15.2:0/2799032257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50641077b0 msgr2=0x7f506419eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:37.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.273+0000 7f5068c00640 1 --2- 172.21.15.2:0/2799032257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50641077b0 0x7f506419eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.275 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.273+0000 7f5068c00640 1 -- 172.21.15.2:0/2799032257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5064102160 msgr2=0x7f506419a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.273+0000 7f5068c00640 1 --2- 172.21.15.2:0/2799032257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5064102160 0x7f506419a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.273+0000 7f5068c00640 1 -- 172.21.15.2:0/2799032257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506419f220 con 0x7f50641017a0 2024-06-13T02:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.273+0000 7f5063e00640 1 --2- 172.21.15.2:0/2799032257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5064102160 0x7f506419a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.273+0000 7f5068c00640 1 --2- 172.21.15.2:0/2799032257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50641017a0 0x7f506419a230 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f505800e9f0 tx=0x7f505800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.274+0000 7f5061600640 1 -- 172.21.15.2:0/2799032257 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505800cd80 con 0x7f50641017a0 2024-06-13T02:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.274+0000 7f506a000640 1 -- 172.21.15.2:0/2799032257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f506419f510 con 0x7f50641017a0 2024-06-13T02:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.274+0000 7f5061600640 1 -- 172.21.15.2:0/2799032257 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5058010910 con 0x7f50641017a0 2024-06-13T02:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.274+0000 7f5061600640 1 -- 172.21.15.2:0/2799032257 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580188f0 con 0x7f50641017a0 2024-06-13T02:28:37.276 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.274+0000 7f506a000640 1 -- 172.21.15.2:0/2799032257 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50641a6da0 con 0x7f50641017a0 2024-06-13T02:28:37.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.278+0000 7f506e3fb740 1 Processor -- start 2024-06-13T02:28:37.278 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.278+0000 7f506e3fb740 1 -- start start 2024-06-13T02:28:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.279+0000 7f506e3fb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532deb37a0 0x56532deb1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.279+0000 7f506e3fb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb2230 0x56532deb26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.279+0000 7f506e3fb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532debcfb0 0x56532debf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.279+0000 7f506e3fb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56532de16420 con 0x56532debcfb0 2024-06-13T02:28:37.279 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.279+0000 7f506e3fb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56532ddbdc50 con 0x56532deb2230 2024-06-13T02:28:37.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.279+0000 7f506e3fb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56532de123e0 con 0x56532deb37a0 2024-06-13T02:28:37.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.279+0000 7f5061600640 1 -- 172.21.15.2:0/2799032257 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f5058010ac0 con 0x7f50641017a0 2024-06-13T02:28:37.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.279+0000 7f5068c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb2230 0x56532deb26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.279+0000 7f5068c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb2230 0x56532deb26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:33832/0 (socket says 172.21.15.2:33832) 2024-06-13T02:28:37.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.279+0000 7f5063e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532debcfb0 0x56532debf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.279+0000 7f5068c00640 1 -- 172.21.15.2:0/1993537843 learned_addr learned my addr 172.21.15.2:0/1993537843 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:37.280 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.279+0000 7f5069600640 1 --2- 172.21.15.2:0/1993537843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532deb37a0 0x56532deb1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.280+0000 7f5068c00640 1 -- 172.21.15.2:0/1993537843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532deb37a0 msgr2=0x56532deb1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:37.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.280+0000 7f5068c00640 1 --2- 172.21.15.2:0/1993537843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532deb37a0 0x56532deb1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.280+0000 7f5068c00640 1 -- 172.21.15.2:0/1993537843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532debcfb0 msgr2=0x56532debf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:37.282 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.280+0000 7f5068c00640 1 --2- 172.21.15.2:0/1993537843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532debcfb0 0x56532debf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.280+0000 7f5068c00640 1 -- 172.21.15.2:0/1993537843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56532db2a210 con 0x56532deb2230 2024-06-13T02:28:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.280+0000 7f5068c00640 1 --2- 172.21.15.2:0/1993537843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb2230 0x56532deb26b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f50580d3d80 tx=0x7f50580d86d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3ad1db8e644818 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.280+0000 7f5055c00640 1 -- 172.21.15.2:0/1993537843 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580df020 con 0x56532deb2230 2024-06-13T02:28:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.280+0000 7f5055c00640 1 -- 172.21.15.2:0/1993537843 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50580dbb60 con 0x56532deb2230 2024-06-13T02:28:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.280+0000 7f5055c00640 1 -- 172.21.15.2:0/1993537843 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580dabd0 con 0x56532deb2230 2024-06-13T02:28:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.281+0000 7f506e3fb740 1 -- 172.21.15.2:0/1993537843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb2230 msgr2=0x56532deb26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.281+0000 7f506e3fb740 1 --2- 172.21.15.2:0/1993537843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb2230 0x56532deb26b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f50580d3d80 tx=0x7f50580d86d0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.281+0000 7f506e3fb740 1 -- 172.21.15.2:0/1993537843 shutdown_connections 2024-06-13T02:28:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.281+0000 7f506e3fb740 1 --2- 172.21.15.2:0/1993537843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532debcfb0 0x56532debf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.281+0000 7f506e3fb740 1 --2- 172.21.15.2:0/1993537843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb2230 0x56532deb26b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.281+0000 7f506e3fb740 1 --2- 172.21.15.2:0/1993537843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532deb37a0 0x56532deb1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.283 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.281+0000 7f506e3fb740 1 -- 172.21.15.2:0/1993537843 >> 172.21.15.2:0/1993537843 conn(0x56532de7afb0 msgr2=0x56532deae820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:37.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.281+0000 7f506e3fb740 1 -- 172.21.15.2:0/1993537843 shutdown_connections 2024-06-13T02:28:37.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.282+0000 7f506e3fb740 1 -- 172.21.15.2:0/1993537843 wait complete. 2024-06-13T02:28:37.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.282+0000 7f5061600640 1 --2- 172.21.15.2:0/2799032257 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f504c0a2bf0 0x7f504c0a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.282+0000 7f5061600640 1 -- 172.21.15.2:0/2799032257 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 9583+0+0 (secure 0 0 0) 0x7f50580cfc10 con 0x7f50641017a0 2024-06-13T02:28:37.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.282+0000 7f5063e00640 1 --2- 172.21.15.2:0/2799032257 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f504c0a2bf0 0x7f504c0a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.282+0000 7f506e3fb740 1 -- start start 2024-06-13T02:28:37.284 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.282+0000 7f506e3fb740 1 Processor -- start 2024-06-13T02:28:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.283+0000 7f5063e00640 1 --2- 172.21.15.2:0/2799032257 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f504c0a2bf0 0x7f504c0a50b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x56532deaf9b0 tx=0x7f5050005f90 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.283+0000 7f506e3fb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532deb2230 0x56532deba000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.283+0000 7f506e3fb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb37a0 0x56532deba540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.283+0000 7f506e3fb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532debcfb0 0x56532debaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.283+0000 7f506e3fb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x56532debfd80 con 0x56532debcfb0 2024-06-13T02:28:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.283+0000 7f506e3fb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56532ddd10b0 con 0x56532deb37a0 2024-06-13T02:28:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.283+0000 7f506e3fb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56532debff00 con 0x56532deb2230 2024-06-13T02:28:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.283+0000 7f506e3fb740 10 client.0 _ll_register_callbacks cb 0x56532ddbcf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:28:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.283+0000 7f5068c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532deb2230 0x56532deba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.283+0000 7f5068c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532deb2230 0x56532deba000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:42594/0 (socket says 172.21.15.2:42594) 2024-06-13T02:28:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.283+0000 7f5068c00640 1 -- 172.21.15.2:0/1266010452 learned_addr learned my addr 172.21.15.2:0/1266010452 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.283+0000 7f5063e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb37a0 0x56532deba540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.283+0000 7f5069600640 1 --2- 172.21.15.2:0/1266010452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532debcfb0 0x56532debaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.284+0000 7f5068c00640 1 -- 172.21.15.2:0/1266010452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb37a0 msgr2=0x56532deba540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.284+0000 7f5068c00640 1 --2- 172.21.15.2:0/1266010452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb37a0 0x56532deba540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.284+0000 7f5068c00640 1 -- 172.21.15.2:0/1266010452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532debcfb0 msgr2=0x56532debaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.284+0000 7f5068c00640 1 --2- 172.21.15.2:0/1266010452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532debcfb0 0x56532debaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.284+0000 7f5068c00640 1 -- 172.21.15.2:0/1266010452 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56532dbf6620 con 0x56532deb2230 2024-06-13T02:28:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.284+0000 7f5068c00640 1 --2- 172.21.15.2:0/1266010452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532deb2230 0x56532deba000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5058098730 tx=0x7f505809a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=920eb6013f65c24c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.284+0000 7f504a000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:28:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.284+0000 7f504a000640 1 -- 172.21.15.2:0/1266010452 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580df070 con 0x56532deb2230 2024-06-13T02:28:37.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.284+0000 7f506e3fb740 1 -- 172.21.15.2:0/1266010452 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50580dbb60 con 0x56532deb2230 2024-06-13T02:28:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.284+0000 7f504a000640 1 -- 172.21.15.2:0/1266010452 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9583+0+0 (secure 0 0 0) 0x7f505809bfc0 con 0x56532deb2230 2024-06-13T02:28:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.284+0000 7f504a000640 1 -- 172.21.15.2:0/1266010452 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5058098000 con 0x56532deb2230 2024-06-13T02:28:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.284+0000 7f506e3fb740 10 client.26101 fetch_fsmap learned FSMap version 35 2024-06-13T02:28:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.284+0000 7f506e3fb740 1 -- 172.21.15.2:0/1266010452 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56532debfd80 con 0x56532deb2230 2024-06-13T02:28:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.285+0000 7f504a000640 1 -- 172.21.15.2:0/1266010452 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50580dbb60 con 0x56532deb2230 2024-06-13T02:28:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.285+0000 7f504a000640 1 -- 172.21.15.2:0/1266010452 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f50580a4490 con 0x56532deb2230 2024-06-13T02:28:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.285+0000 7f506e3fb740 10 client.26101 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:28:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.285+0000 7f506e3fb740 10 client.26101 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:28:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.285+0000 7f506e3fb740 20 client.26101 populate_metadata read hostname 'smithi002' 2024-06-13T02:28:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.285+0000 7f506e3fb740 1 --2- 172.21.15.2:0/1266010452 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56532ded5ae0 0x56532ded7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.285+0000 7f506e3fb740 4 client.26101 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:28:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.285+0000 7f506e3fb740 1 -- 172.21.15.2:0/1266010452 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56532de23b50 con 0x56532ded5ae0 2024-06-13T02:28:37.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.285+0000 7f5063e00640 1 --2- 172.21.15.2:0/1266010452 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56532ded5ae0 0x56532ded7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.286+0000 7f5063e00640 1 --2- 172.21.15.2:0/1266010452 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56532ded5ae0 0x56532ded7ed0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7ef33c8f2a78c8d server_cookie=23df38c09891913d in_seq=0 out_seq=0 2024-06-13T02:28:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.286+0000 7f504a000640 10 client.26101 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.287+0000 7f504a000640 1 -- 172.21.15.2:0/1266010452 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56532de23b50 con 0x56532ded5ae0 2024-06-13T02:28:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.287+0000 7f504a000640 10 client.26101 handle_command_reply: tid=0 2024-06-13T02:28:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.287+0000 7f506e3fb740 1 client.26101 shutdown 2024-06-13T02:28:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.288+0000 7f506e3fb740 1 -- 172.21.15.2:0/1266010452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532deb2230 msgr2=0x56532deba000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.288+0000 7f506e3fb740 1 --2- 172.21.15.2:0/1266010452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532deb2230 0x56532deba000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5058098730 tx=0x7f505809a270 comp rx=0 tx=0).stop 2024-06-13T02:28:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.288+0000 7f506e3fb740 1 -- 172.21.15.2:0/1266010452 shutdown_connections 2024-06-13T02:28:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.288+0000 7f506e3fb740 1 --2- 172.21.15.2:0/1266010452 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56532ded5ae0 0x56532ded7ed0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.288+0000 7f506e3fb740 1 --2- 172.21.15.2:0/1266010452 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532debcfb0 0x56532debaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.288+0000 7f506e3fb740 1 --2- 172.21.15.2:0/1266010452 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb37a0 0x56532deba540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.288+0000 7f506e3fb740 1 --2- 172.21.15.2:0/1266010452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532deb2230 0x56532deba000 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.288+0000 7f506e3fb740 1 -- 172.21.15.2:0/1266010452 >> 172.21.15.2:0/1266010452 conn(0x56532de7afb0 msgr2=0x56532deb4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.288+0000 7f504a000640 0 client.26101 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.288+0000 7f506e3fb740 1 -- 172.21.15.2:0/1266010452 shutdown_connections 2024-06-13T02:28:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.288+0000 7f506e3fb740 1 -- 172.21.15.2:0/1266010452 wait complete. 2024-06-13T02:28:37.292 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.288+0000 7f506e3fb740 20 client.26101 trim_cache size 0 max 16384 2024-06-13T02:28:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.305+0000 7f506e3fb740 1 Processor -- start 2024-06-13T02:28:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.305+0000 7f506e3fb740 1 -- start start 2024-06-13T02:28:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.305+0000 7f506e3fb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb2230 0x56532deba6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.305+0000 7f506e3fb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532deb37a0 0x56532dedd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.305+0000 7f506e3fb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532debcfb0 0x56532dedda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.305+0000 7f506e3fb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f50641af650 con 0x56532deb37a0 2024-06-13T02:28:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.305+0000 7f506e3fb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f50641acf20 con 0x56532deb2230 2024-06-13T02:28:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.305+0000 7f506e3fb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f50641aad90 con 0x56532debcfb0 2024-06-13T02:28:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.306+0000 7f5068c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb2230 0x56532deba6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.306+0000 7f5069600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532debcfb0 0x56532dedda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.306+0000 7f5068c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb2230 0x56532deba6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:33850/0 (socket says 172.21.15.2:33850) 2024-06-13T02:28:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.306+0000 7f5068c00640 1 -- 172.21.15.2:0/4192119410 learned_addr learned my addr 172.21.15.2:0/4192119410 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.306+0000 7f5063e00640 1 --2- 172.21.15.2:0/4192119410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532deb37a0 0x56532dedd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.306+0000 7f5068c00640 1 -- 172.21.15.2:0/4192119410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532debcfb0 msgr2=0x56532dedda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.306+0000 7f5068c00640 1 --2- 172.21.15.2:0/4192119410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532debcfb0 0x56532dedda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.306+0000 7f5068c00640 1 -- 172.21.15.2:0/4192119410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532deb37a0 msgr2=0x56532dedd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.306+0000 7f5068c00640 1 --2- 172.21.15.2:0/4192119410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532deb37a0 0x56532dedd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.306+0000 7f5068c00640 1 -- 172.21.15.2:0/4192119410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56532deaa000 con 0x56532deb2230 2024-06-13T02:28:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.306+0000 7f5063e00640 1 --2- 172.21.15.2:0/4192119410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532deb37a0 0x56532dedd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:28:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.306+0000 7f5068c00640 1 --2- 172.21.15.2:0/4192119410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb2230 0x56532deba6d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f50580981c0 tx=0x7f50580d86d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d29780086652c476 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.306+0000 7f5055200640 1 -- 172.21.15.2:0/4192119410 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580df030 con 0x56532deb2230 2024-06-13T02:28:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.306+0000 7f5055200640 1 -- 172.21.15.2:0/4192119410 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50580d3490 con 0x56532deb2230 2024-06-13T02:28:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.306+0000 7f5055200640 1 -- 172.21.15.2:0/4192119410 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505809b6c0 con 0x56532deb2230 2024-06-13T02:28:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.307+0000 7f506e3fb740 1 -- 172.21.15.2:0/4192119410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb2230 msgr2=0x56532deba6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.307+0000 7f506e3fb740 1 --2- 172.21.15.2:0/4192119410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb2230 0x56532deba6d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f50580981c0 tx=0x7f50580d86d0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.307+0000 7f506e3fb740 1 -- 172.21.15.2:0/4192119410 shutdown_connections 2024-06-13T02:28:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.307+0000 7f506e3fb740 1 --2- 172.21.15.2:0/4192119410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532debcfb0 0x56532dedda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.307+0000 7f506e3fb740 1 --2- 172.21.15.2:0/4192119410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532deb37a0 0x56532dedd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.307+0000 7f506e3fb740 1 --2- 172.21.15.2:0/4192119410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb2230 0x56532deba6d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.307+0000 7f506e3fb740 1 -- 172.21.15.2:0/4192119410 >> 172.21.15.2:0/4192119410 conn(0x56532de7afb0 msgr2=0x56532deb9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.307+0000 7f506e3fb740 1 -- 172.21.15.2:0/4192119410 shutdown_connections 2024-06-13T02:28:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.307+0000 7f506e3fb740 1 -- 172.21.15.2:0/4192119410 wait complete. 2024-06-13T02:28:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.308+0000 7f506e3fb740 1 -- start start 2024-06-13T02:28:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.308+0000 7f506e3fb740 1 Processor -- start 2024-06-13T02:28:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.308+0000 7f506e3fb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532deb2230 0x56532dece290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.308+0000 7f506e3fb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb37a0 0x56532deb6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.308+0000 7f506e3fb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532debcfb0 0x56532deb7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.308+0000 7f506e3fb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f50641ab3e0 con 0x56532deb2230 2024-06-13T02:28:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.308+0000 7f506e3fb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f50641ac850 con 0x56532deb37a0 2024-06-13T02:28:37.312 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.308+0000 7f506e3fb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f50641abab0 con 0x56532debcfb0 2024-06-13T02:28:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.309+0000 7f506e3fb740 10 client.0 _ll_register_callbacks cb 0x7f5050009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:28:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.309+0000 7f5068c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532deb2230 0x56532dece290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.309+0000 7f5063e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb37a0 0x56532deb6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.309+0000 7f5068c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532deb2230 0x56532dece290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51604/0 (socket says 172.21.15.2:51604) 2024-06-13T02:28:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.309+0000 7f5068c00640 1 -- 172.21.15.2:0/2446032766 learned_addr learned my addr 172.21.15.2:0/2446032766 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.309+0000 7f5069600640 1 --2- 172.21.15.2:0/2446032766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532debcfb0 0x56532deb7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.309+0000 7f5068c00640 1 -- 172.21.15.2:0/2446032766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532debcfb0 msgr2=0x56532deb7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.309+0000 7f5068c00640 1 --2- 172.21.15.2:0/2446032766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532debcfb0 0x56532deb7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.309+0000 7f5068c00640 1 -- 172.21.15.2:0/2446032766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb37a0 msgr2=0x56532deb6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.309+0000 7f5068c00640 1 --2- 172.21.15.2:0/2446032766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb37a0 0x56532deb6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.309+0000 7f5068c00640 1 -- 172.21.15.2:0/2446032766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56532deb7c30 con 0x56532deb2230 2024-06-13T02:28:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.309+0000 7f5063e00640 1 --2- 172.21.15.2:0/2446032766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb37a0 0x56532deb6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:28:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.309+0000 7f5068c00640 1 --2- 172.21.15.2:0/2446032766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532deb2230 0x56532dece290 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f50580a43f0 tx=0x7f50580cd390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d4f49ae0babc38 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.309+0000 7f504a000640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:28:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.310+0000 7f504a000640 1 -- 172.21.15.2:0/2446032766 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50580df070 con 0x56532deb2230 2024-06-13T02:28:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.310+0000 7f504a000640 1 -- 172.21.15.2:0/2446032766 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9583+0+0 (secure 0 0 0) 0x7f50580d3190 con 0x56532deb2230 2024-06-13T02:28:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.310+0000 7f506e3fb740 1 -- 172.21.15.2:0/2446032766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50580d3490 con 0x56532deb2230 2024-06-13T02:28:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.310+0000 7f504a000640 1 -- 172.21.15.2:0/2446032766 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f505809b8a0 con 0x56532deb2230 2024-06-13T02:28:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.310+0000 7f506e3fb740 10 client.15921 fetch_fsmap learned FSMap version 35 2024-06-13T02:28:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.310+0000 7f506e3fb740 1 -- 172.21.15.2:0/2446032766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56532deb7c30 con 0x56532deb2230 2024-06-13T02:28:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.310+0000 7f504a000640 1 -- 172.21.15.2:0/2446032766 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50580d3490 con 0x56532deb2230 2024-06-13T02:28:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.310+0000 7f504a000640 1 -- 172.21.15.2:0/2446032766 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f505809b1b0 con 0x56532deb2230 2024-06-13T02:28:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.310+0000 7f506e3fb740 10 client.15921 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:28:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.310+0000 7f506e3fb740 10 client.15921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:28:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.310+0000 7f506e3fb740 20 client.15921 populate_metadata read hostname 'smithi002' 2024-06-13T02:28:37.315 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.310+0000 7f506e3fb740 1 --2- 172.21.15.2:0/2446032766 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56532df407d0 0x56532df42bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:37.315 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.310+0000 7f506e3fb740 4 client.15921 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:28:37.315 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.310+0000 7f506e3fb740 1 -- 172.21.15.2:0/2446032766 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56532de1dea0 con 0x56532df407d0 2024-06-13T02:28:37.315 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.311+0000 7f5063e00640 1 --2- 172.21.15.2:0/2446032766 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56532df407d0 0x56532df42bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:37.315 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.311+0000 7f5063e00640 1 --2- 172.21.15.2:0/2446032766 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56532df407d0 0x56532df42bc0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=970d5aecff65f5fe server_cookie=dfc68223c3fd806f in_seq=0 out_seq=0 2024-06-13T02:28:37.315 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.311+0000 7f504a000640 10 client.15921 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:37.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:37 smithi002 ceph-mon[31960]: pgmap v339: 129 pgs: 129 active+clean; 93 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 267 op/s 2024-06-13T02:28:37.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:37 smithi084 ceph-mon[36833]: pgmap v339: 129 pgs: 129 active+clean; 93 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 267 op/s 2024-06-13T02:28:37.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:37 smithi175 ceph-mon[36977]: pgmap v339: 129 pgs: 129 active+clean; 93 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 267 op/s 2024-06-13T02:28:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.532+0000 7f504a000640 1 -- 172.21.15.2:0/2446032766 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56532de1dea0 con 0x56532df407d0 2024-06-13T02:28:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.532+0000 7f504a000640 10 client.15921 handle_command_reply: tid=0 2024-06-13T02:28:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.532+0000 7f506e3fb740 1 client.15921 shutdown 2024-06-13T02:28:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.533+0000 7f506e3fb740 1 -- 172.21.15.2:0/2446032766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532deb2230 msgr2=0x56532dece290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.533+0000 7f506e3fb740 1 --2- 172.21.15.2:0/2446032766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532deb2230 0x56532dece290 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f50580a43f0 tx=0x7f50580cd390 comp rx=0 tx=0).stop 2024-06-13T02:28:37.533 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.533+0000 7f506e3fb740 1 -- 172.21.15.2:0/2446032766 shutdown_connections 2024-06-13T02:28:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.533+0000 7f506e3fb740 1 --2- 172.21.15.2:0/2446032766 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x56532df407d0 0x56532df42bc0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.533+0000 7f506e3fb740 1 --2- 172.21.15.2:0/2446032766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56532debcfb0 0x56532deb7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.533+0000 7f506e3fb740 1 --2- 172.21.15.2:0/2446032766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56532deb37a0 0x56532deb6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.533+0000 7f506e3fb740 1 --2- 172.21.15.2:0/2446032766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x56532deb2230 0x56532dece290 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.533+0000 7f506e3fb740 1 -- 172.21.15.2:0/2446032766 >> 172.21.15.2:0/2446032766 conn(0x56532de7afb0 msgr2=0x56532deb4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.533+0000 7f504a000640 0 client.15921 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.533+0000 7f506e3fb740 1 -- 172.21.15.2:0/2446032766 shutdown_connections 2024-06-13T02:28:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.533+0000 7f506e3fb740 1 -- 172.21.15.2:0/2446032766 wait complete. 2024-06-13T02:28:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.533+0000 7f506e3fb740 20 client.15921 trim_cache size 0 max 16384 2024-06-13T02:28:37.534 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:28:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:28:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:28:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.534+0000 7f506a000640 1 -- 172.21.15.2:0/2799032257 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f504c0a2bf0 msgr2=0x7f504c0a50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.534+0000 7f506a000640 1 --2- 172.21.15.2:0/2799032257 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f504c0a2bf0 0x7f504c0a50b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x56532deaf9b0 tx=0x7f5050005f90 comp rx=0 tx=0).stop 2024-06-13T02:28:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.534+0000 7f506a000640 1 -- 172.21.15.2:0/2799032257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50641017a0 msgr2=0x7f506419a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.534+0000 7f506a000640 1 --2- 172.21.15.2:0/2799032257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50641017a0 0x7f506419a230 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f505800e9f0 tx=0x7f505800eeb0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.535 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.534+0000 7f506a000640 1 -- 172.21.15.2:0/2799032257 shutdown_connections 2024-06-13T02:28:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.534+0000 7f506a000640 1 --2- 172.21.15.2:0/2799032257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50641077b0 0x7f506419eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.534+0000 7f506a000640 1 --2- 172.21.15.2:0/2799032257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5064102160 0x7f506419a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.534+0000 7f506a000640 1 --2- 172.21.15.2:0/2799032257 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f504c0a2bf0 0x7f504c0a50b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.534+0000 7f506a000640 1 --2- 172.21.15.2:0/2799032257 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50641017a0 0x7f506419a230 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.534+0000 7f506a000640 1 -- 172.21.15.2:0/2799032257 >> 172.21.15.2:0/2799032257 conn(0x7f50640fd2d0 msgr2=0x7f506410ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.534+0000 7f506a000640 1 -- 172.21.15.2:0/2799032257 shutdown_connections 2024-06-13T02:28:37.536 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:37.535+0000 7f506a000640 1 -- 172.21.15.2:0/2799032257 wait complete. 2024-06-13T02:28:37.554 INFO:tasks.workunit.client.0.smithi002.stdout: 1 770336 6.99 MB/sec execute 461 sec latency 86.283 ms 2024-06-13T02:28:38.555 INFO:tasks.workunit.client.0.smithi002.stdout: 1 771052 6.99 MB/sec execute 462 sec latency 21.826 ms 2024-06-13T02:28:39.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:39 smithi002 ceph-mon[31960]: pgmap v340: 129 pgs: 129 active+clean; 94 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 185 op/s 2024-06-13T02:28:39.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:39 smithi084 ceph-mon[36833]: pgmap v340: 129 pgs: 129 active+clean; 94 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 185 op/s 2024-06-13T02:28:39.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:39 smithi175 ceph-mon[36977]: pgmap v340: 129 pgs: 129 active+clean; 94 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 185 op/s 2024-06-13T02:28:39.555 INFO:tasks.workunit.client.0.smithi002.stdout: 1 772058 6.98 MB/sec execute 463 sec latency 22.490 ms 2024-06-13T02:28:40.555 INFO:tasks.workunit.client.0.smithi002.stdout: 1 773869 6.99 MB/sec execute 464 sec latency 25.199 ms 2024-06-13T02:28:41.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:41 smithi002 ceph-mon[31960]: pgmap v341: 129 pgs: 129 active+clean; 94 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 113 op/s 2024-06-13T02:28:41.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:41 smithi084 ceph-mon[36833]: pgmap v341: 129 pgs: 129 active+clean; 94 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 113 op/s 2024-06-13T02:28:41.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:41 smithi175 ceph-mon[36977]: pgmap v341: 129 pgs: 129 active+clean; 94 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 113 op/s 2024-06-13T02:28:41.555 INFO:tasks.workunit.client.0.smithi002.stdout: 1 774479 6.98 MB/sec execute 465 sec latency 84.600 ms 2024-06-13T02:28:42.555 INFO:tasks.workunit.client.0.smithi002.stdout: 1 775536 6.98 MB/sec execute 466 sec latency 43.833 ms 2024-06-13T02:28:43.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:43 smithi002 ceph-mon[31960]: pgmap v342: 129 pgs: 129 active+clean; 88 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 231 op/s 2024-06-13T02:28:43.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:43 smithi084 ceph-mon[36833]: pgmap v342: 129 pgs: 129 active+clean; 88 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 231 op/s 2024-06-13T02:28:43.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:43 smithi175 ceph-mon[36977]: pgmap v342: 129 pgs: 129 active+clean; 88 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 231 op/s 2024-06-13T02:28:43.555 INFO:tasks.workunit.client.0.smithi002.stdout: 1 777308 6.98 MB/sec execute 467 sec latency 32.284 ms 2024-06-13T02:28:44.555 INFO:tasks.workunit.client.0.smithi002.stdout: 1 778267 6.98 MB/sec execute 468 sec latency 25.120 ms 2024-06-13T02:28:45.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:45 smithi084 ceph-mon[36833]: pgmap v343: 129 pgs: 129 active+clean; 88 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 176 op/s 2024-06-13T02:28:45.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:45 smithi175 ceph-mon[36977]: pgmap v343: 129 pgs: 129 active+clean; 88 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 176 op/s 2024-06-13T02:28:45.555 INFO:tasks.workunit.client.0.smithi002.stdout: 1 779258 6.98 MB/sec execute 469 sec latency 22.669 ms 2024-06-13T02:28:45.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:45 smithi002 ceph-mon[31960]: pgmap v343: 129 pgs: 129 active+clean; 88 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 176 op/s 2024-06-13T02:28:46.556 INFO:tasks.workunit.client.0.smithi002.stdout: 1 780885 6.98 MB/sec execute 470 sec latency 134.778 ms 2024-06-13T02:28:47.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:47 smithi084 ceph-mon[36833]: pgmap v344: 129 pgs: 129 active+clean; 91 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 221 op/s 2024-06-13T02:28:47.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:47 smithi175 ceph-mon[36977]: pgmap v344: 129 pgs: 129 active+clean; 91 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 221 op/s 2024-06-13T02:28:47.556 INFO:tasks.workunit.client.0.smithi002.stdout: 1 781572 6.97 MB/sec execute 471 sec latency 27.228 ms 2024-06-13T02:28:47.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:47 smithi002 ceph-mon[31960]: pgmap v344: 129 pgs: 129 active+clean; 91 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 221 op/s 2024-06-13T02:28:48.556 INFO:tasks.workunit.client.0.smithi002.stdout: 1 782592 6.97 MB/sec execute 472 sec latency 24.927 ms 2024-06-13T02:28:49.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:49 smithi084 ceph-mon[36833]: pgmap v345: 129 pgs: 129 active+clean; 95 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 189 op/s 2024-06-13T02:28:49.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:49 smithi175 ceph-mon[36977]: pgmap v345: 129 pgs: 129 active+clean; 95 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 189 op/s 2024-06-13T02:28:49.556 INFO:tasks.workunit.client.0.smithi002.stdout: 1 784151 6.97 MB/sec execute 473 sec latency 36.262 ms 2024-06-13T02:28:49.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:49 smithi002 ceph-mon[31960]: pgmap v345: 129 pgs: 129 active+clean; 95 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 189 op/s 2024-06-13T02:28:50.556 INFO:tasks.workunit.client.0.smithi002.stdout: 1 785107 6.97 MB/sec execute 474 sec latency 51.490 ms 2024-06-13T02:28:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.683+0000 7f35b5a00640 1 -- 172.21.15.2:0/2076432096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0074660 msgr2=0x7f35b0112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.683+0000 7f35b5a00640 1 --2- 172.21.15.2:0/2076432096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0074660 0x7f35b0112290 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f359c009900 tx=0x7f359c02a480 comp rx=0 tx=0).stop 2024-06-13T02:28:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.683+0000 7f35b5a00640 1 -- 172.21.15.2:0/2076432096 shutdown_connections 2024-06-13T02:28:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.683+0000 7f35b5a00640 1 --2- 172.21.15.2:0/2076432096 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b01127d0 0x7f35b0114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.683+0000 7f35b5a00640 1 --2- 172.21.15.2:0/2076432096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0074660 0x7f35b0112290 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.683+0000 7f35b5a00640 1 --2- 172.21.15.2:0/2076432096 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b0073d40 0x7f35b0074120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.683+0000 7f35b5a00640 1 -- 172.21.15.2:0/2076432096 >> 172.21.15.2:0/2076432096 conn(0x7f35b00fd2b0 msgr2=0x7f35b00ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.684+0000 7f35b5a00640 1 -- 172.21.15.2:0/2076432096 shutdown_connections 2024-06-13T02:28:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.684+0000 7f35b5a00640 1 -- 172.21.15.2:0/2076432096 wait complete. 2024-06-13T02:28:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.685+0000 7f35b5a00640 1 Processor -- start 2024-06-13T02:28:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.685+0000 7f35b5a00640 1 -- start start 2024-06-13T02:28:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.685+0000 7f35b5a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0073d40 0x7f35b019e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.685+0000 7f35b5a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b0074660 0x7f35b019ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.685+0000 7f35b5a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b01127d0 0x7f35b01a2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.685+0000 7f35b5a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35b01181f0 con 0x7f35b0074660 2024-06-13T02:28:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.685+0000 7f35b5a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f35b0118070 con 0x7f35b01127d0 2024-06-13T02:28:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.685+0000 7f35b5a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35b0118370 con 0x7f35b0073d40 2024-06-13T02:28:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.685+0000 7f35afe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0073d40 0x7f35b019e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.686+0000 7f35afe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0073d40 0x7f35b019e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:60470/0 (socket says 172.21.15.2:60470) 2024-06-13T02:28:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.686+0000 7f35afe00640 1 -- 172.21.15.2:0/769088946 learned_addr learned my addr 172.21.15.2:0/769088946 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.686+0000 7f35b5000640 1 --2- 172.21.15.2:0/769088946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b01127d0 0x7f35b01a2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.686+0000 7f35af400640 1 --2- 172.21.15.2:0/769088946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b0074660 0x7f35b019ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.686+0000 7f35afe00640 1 -- 172.21.15.2:0/769088946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b01127d0 msgr2=0x7f35b01a2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.686+0000 7f35afe00640 1 --2- 172.21.15.2:0/769088946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b01127d0 0x7f35b01a2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.686+0000 7f35afe00640 1 -- 172.21.15.2:0/769088946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b0074660 msgr2=0x7f35b019ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.686+0000 7f35afe00640 1 --2- 172.21.15.2:0/769088946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b0074660 0x7f35b019ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.686+0000 7f35afe00640 1 -- 172.21.15.2:0/769088946 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b01a3700 con 0x7f35b0073d40 2024-06-13T02:28:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.686+0000 7f35b5000640 1 --2- 172.21.15.2:0/769088946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b01127d0 0x7f35b01a2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:28:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.686+0000 7f35afe00640 1 --2- 172.21.15.2:0/769088946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0073d40 0x7f35b019e710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f35a000e9f0 tx=0x7f35a000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.687+0000 7f35acc00640 1 -- 172.21.15.2:0/769088946 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a000ccc0 con 0x7f35b0073d40 2024-06-13T02:28:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.687+0000 7f35acc00640 1 -- 172.21.15.2:0/769088946 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35a0010910 con 0x7f35b0073d40 2024-06-13T02:28:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.687+0000 7f35acc00640 1 -- 172.21.15.2:0/769088946 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a00188a0 con 0x7f35b0073d40 2024-06-13T02:28:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.687+0000 7f35b5a00640 1 -- 172.21.15.2:0/769088946 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b01a39f0 con 0x7f35b0073d40 2024-06-13T02:28:50.690 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.687+0000 7f35b5a00640 1 -- 172.21.15.2:0/769088946 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b01ab280 con 0x7f35b0073d40 2024-06-13T02:28:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.690+0000 7f35acc00640 1 -- 172.21.15.2:0/769088946 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f35a0010ac0 con 0x7f35b0073d40 2024-06-13T02:28:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.691+0000 7f35b9e0d740 1 Processor -- start 2024-06-13T02:28:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.691+0000 7f35b9e0d740 1 -- start start 2024-06-13T02:28:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.691+0000 7f35b9e0d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea4a7a0 0x55c2aea48cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.691+0000 7f35b9e0d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea49230 0x55c2aea496b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.691+0000 7f35b9e0d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea53fb0 0x55c2aea563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.691+0000 7f35b9e0d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c2ae9ad420 con 0x55c2aea53fb0 2024-06-13T02:28:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.691+0000 7f35b9e0d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c2ae954c50 con 0x55c2aea4a7a0 2024-06-13T02:28:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.691+0000 7f35b9e0d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c2ae9a93e0 con 0x55c2aea49230 2024-06-13T02:28:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.692+0000 7f35b5000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea4a7a0 0x55c2aea48cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.692+0000 7f35afe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea49230 0x55c2aea496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.692+0000 7f35b5000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea4a7a0 0x55c2aea48cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:52212/0 (socket says 172.21.15.2:52212) 2024-06-13T02:28:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.692+0000 7f35b5000640 1 -- 172.21.15.2:0/517264082 learned_addr learned my addr 172.21.15.2:0/517264082 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.692+0000 7f35af400640 1 --2- 172.21.15.2:0/517264082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea53fb0 0x55c2aea563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.692+0000 7f35b5000640 1 -- 172.21.15.2:0/517264082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea49230 msgr2=0x55c2aea496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.692+0000 7f35b5000640 1 --2- 172.21.15.2:0/517264082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea49230 0x55c2aea496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.692+0000 7f35b5000640 1 -- 172.21.15.2:0/517264082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea53fb0 msgr2=0x55c2aea563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.692+0000 7f35b5000640 1 --2- 172.21.15.2:0/517264082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea53fb0 0x55c2aea563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.692+0000 7f35b5000640 1 -- 172.21.15.2:0/517264082 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ae6c1210 con 0x55c2aea4a7a0 2024-06-13T02:28:50.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.692+0000 7f35acc00640 1 --2- 172.21.15.2:0/769088946 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f35940a2de0 0x7f35940a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.695 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.692+0000 7f35b5000640 1 --2- 172.21.15.2:0/517264082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea4a7a0 0x55c2aea48cf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f35a80117c0 tx=0x7f35a8011c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d04c323933c964c server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.693+0000 7f35acc00640 1 -- 172.21.15.2:0/769088946 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 9583+0+0 (secure 0 0 0) 0x7f35a00cfc60 con 0x7f35b0073d40 2024-06-13T02:28:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.693+0000 7f35a5600640 1 -- 172.21.15.2:0/517264082 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a800fc60 con 0x55c2aea4a7a0 2024-06-13T02:28:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.693+0000 7f35afe00640 1 --2- 172.21.15.2:0/769088946 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f35940a2de0 0x7f35940a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.693+0000 7f35a5600640 1 -- 172.21.15.2:0/517264082 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35a8003e50 con 0x55c2aea4a7a0 2024-06-13T02:28:50.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.693+0000 7f35a5600640 1 -- 172.21.15.2:0/517264082 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a8019430 con 0x55c2aea4a7a0 2024-06-13T02:28:50.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.694+0000 7f35b9e0d740 1 -- 172.21.15.2:0/517264082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea4a7a0 msgr2=0x55c2aea48cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:50.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.694+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/517264082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea4a7a0 0x55c2aea48cf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f35a80117c0 tx=0x7f35a8011c80 comp rx=0 tx=0).stop 2024-06-13T02:28:50.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.694+0000 7f35afe00640 1 --2- 172.21.15.2:0/769088946 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f35940a2de0 0x7f35940a52a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55c2aea4bf00 tx=0x7f35a00d3690 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:50.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.694+0000 7f35b9e0d740 1 -- 172.21.15.2:0/517264082 shutdown_connections 2024-06-13T02:28:50.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.694+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/517264082 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea53fb0 0x55c2aea563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.694+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/517264082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea49230 0x55c2aea496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.694+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/517264082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea4a7a0 0x55c2aea48cf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.698 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.694+0000 7f35b9e0d740 1 -- 172.21.15.2:0/517264082 >> 172.21.15.2:0/517264082 conn(0x55c2aea11fb0 msgr2=0x55c2aea45820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.694+0000 7f35b9e0d740 1 -- 172.21.15.2:0/517264082 shutdown_connections 2024-06-13T02:28:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.694+0000 7f35b9e0d740 1 -- 172.21.15.2:0/517264082 wait complete. 2024-06-13T02:28:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.695+0000 7f35b9e0d740 1 -- start start 2024-06-13T02:28:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.695+0000 7f35b9e0d740 1 Processor -- start 2024-06-13T02:28:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.695+0000 7f35b9e0d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea49230 0x55c2aea51050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.695+0000 7f35b9e0d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea4a7a0 0x55c2aea51590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.695+0000 7f35b9e0d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea53fb0 0x55c2aea51ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.695+0000 7f35b9e0d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55c2aea56d80 con 0x55c2aea4a7a0 2024-06-13T02:28:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.695+0000 7f35b9e0d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c2ae9680b0 con 0x55c2aea49230 2024-06-13T02:28:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.695+0000 7f35b9e0d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55c2aea56f00 con 0x55c2aea53fb0 2024-06-13T02:28:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.695+0000 7f35b9e0d740 10 client.0 _ll_register_callbacks cb 0x55c2ae953f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:28:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.696+0000 7f35b5000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea49230 0x55c2aea51050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.696+0000 7f35af400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea4a7a0 0x55c2aea51590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.696+0000 7f35af400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea4a7a0 0x55c2aea51590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54816/0 (socket says 172.21.15.2:54816) 2024-06-13T02:28:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.696+0000 7f35b5000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea49230 0x55c2aea51050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:52218/0 (socket says 172.21.15.2:52218) 2024-06-13T02:28:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.696+0000 7f35af400640 1 -- 172.21.15.2:0/1205815241 learned_addr learned my addr 172.21.15.2:0/1205815241 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.696+0000 7f35b5000640 1 --2- 172.21.15.2:0/1205815241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea53fb0 0x55c2aea51ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.696+0000 7f35af400640 1 -- 172.21.15.2:0/1205815241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea53fb0 msgr2=0x55c2aea51ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.696+0000 7f35af400640 1 --2- 172.21.15.2:0/1205815241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea53fb0 0x55c2aea51ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.696+0000 7f35af400640 1 -- 172.21.15.2:0/1205815241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea49230 msgr2=0x55c2aea51050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.696+0000 7f35af400640 1 --2- 172.21.15.2:0/1205815241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea49230 0x55c2aea51050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.696+0000 7f35af400640 1 -- 172.21.15.2:0/1205815241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2ae78d620 con 0x55c2aea4a7a0 2024-06-13T02:28:50.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.697+0000 7f35af400640 1 --2- 172.21.15.2:0/1205815241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea4a7a0 0x55c2aea51590 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f359c031550 tx=0x7f359c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6e0ccbfc5f7b34 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:50.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.697+0000 7f359a000640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:28:50.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.697+0000 7f359a000640 1 -- 172.21.15.2:0/1205815241 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c035040 con 0x55c2aea4a7a0 2024-06-13T02:28:50.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.697+0000 7f359a000640 1 -- 172.21.15.2:0/1205815241 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9583+0+0 (secure 0 0 0) 0x7f359c005230 con 0x55c2aea4a7a0 2024-06-13T02:28:50.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.697+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1205815241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35a8003e50 con 0x55c2aea4a7a0 2024-06-13T02:28:50.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.698+0000 7f359a000640 1 -- 172.21.15.2:0/1205815241 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f359c04d050 con 0x55c2aea4a7a0 2024-06-13T02:28:50.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.698+0000 7f35b9e0d740 10 client.15933 fetch_fsmap learned FSMap version 35 2024-06-13T02:28:50.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.698+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1205815241 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c2aea63170 con 0x55c2aea4a7a0 2024-06-13T02:28:50.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.698+0000 7f359a000640 1 -- 172.21.15.2:0/1205815241 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35a8003e50 con 0x55c2aea4a7a0 2024-06-13T02:28:50.703 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.698+0000 7f359a000640 1 -- 172.21.15.2:0/1205815241 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f359c003770 con 0x55c2aea4a7a0 2024-06-13T02:28:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.698+0000 7f35b9e0d740 10 client.15933 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:28:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.698+0000 7f35b9e0d740 10 client.15933 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:28:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.698+0000 7f35b9e0d740 20 client.15933 populate_metadata read hostname 'smithi002' 2024-06-13T02:28:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.699+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/1205815241 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c2aea64630 0x55c2aea66a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.699+0000 7f35b9e0d740 4 client.15933 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:28:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.699+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1205815241 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2ae9bab50 con 0x55c2aea64630 2024-06-13T02:28:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.699+0000 7f35b5000640 1 --2- 172.21.15.2:0/1205815241 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c2aea64630 0x55c2aea66a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.699+0000 7f35b5000640 1 --2- 172.21.15.2:0/1205815241 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c2aea64630 0x55c2aea66a20 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80466e379ec491aa server_cookie=a31cde586c2201f0 in_seq=0 out_seq=0 2024-06-13T02:28:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.699+0000 7f359a000640 10 client.15933 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.700+0000 7f359a000640 1 -- 172.21.15.2:0/1205815241 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c2ae9bab50 con 0x55c2aea64630 2024-06-13T02:28:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.700+0000 7f359a000640 10 client.15933 handle_command_reply: tid=0 2024-06-13T02:28:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.701+0000 7f35b9e0d740 1 client.15933 shutdown 2024-06-13T02:28:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.701+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1205815241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea4a7a0 msgr2=0x55c2aea51590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.701+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/1205815241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea4a7a0 0x55c2aea51590 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f359c031550 tx=0x7f359c0042e0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.701+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1205815241 shutdown_connections 2024-06-13T02:28:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.701+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/1205815241 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c2aea64630 0x55c2aea66a20 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.701+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/1205815241 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea53fb0 0x55c2aea51ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.701+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/1205815241 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea4a7a0 0x55c2aea51590 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.701+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/1205815241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea49230 0x55c2aea51050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.701+0000 7f359a000640 0 client.15933 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.701+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1205815241 >> 172.21.15.2:0/1205815241 conn(0x55c2aea11fb0 msgr2=0x55c2aea4b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.701+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1205815241 shutdown_connections 2024-06-13T02:28:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.701+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1205815241 wait complete. 2024-06-13T02:28:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.701+0000 7f35b9e0d740 20 client.15933 trim_cache size 0 max 16384 2024-06-13T02:28:50.720 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.719+0000 7f35b9e0d740 1 Processor -- start 2024-06-13T02:28:50.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.720+0000 7f35b9e0d740 1 -- start start 2024-06-13T02:28:50.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.720+0000 7f35b9e0d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea49230 0x55c2aea51720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.720+0000 7f35b9e0d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea4a7a0 0x55c2aea6c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.720+0000 7f35b9e0d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea53fb0 0x55c2aea6c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.720+0000 7f35b9e0d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35b01b7e40 con 0x55c2aea49230 2024-06-13T02:28:50.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.720+0000 7f35b9e0d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f35b01b5710 con 0x55c2aea4a7a0 2024-06-13T02:28:50.721 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.720+0000 7f35b9e0d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35b01b3580 con 0x55c2aea53fb0 2024-06-13T02:28:50.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.720+0000 7f35af400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea4a7a0 0x55c2aea6c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.720+0000 7f35af400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea4a7a0 0x55c2aea6c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:52224/0 (socket says 172.21.15.2:52224) 2024-06-13T02:28:50.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.720+0000 7f35af400640 1 -- 172.21.15.2:0/3042277111 learned_addr learned my addr 172.21.15.2:0/3042277111 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:50.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.720+0000 7f35b5000640 1 --2- 172.21.15.2:0/3042277111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea49230 0x55c2aea51720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.721+0000 7f35b5000640 1 --2- 172.21.15.2:0/3042277111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea53fb0 0x55c2aea6c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.723 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.721+0000 7f35af400640 1 -- 172.21.15.2:0/3042277111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea53fb0 msgr2=0x55c2aea6c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.721+0000 7f35af400640 1 --2- 172.21.15.2:0/3042277111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea53fb0 0x55c2aea6c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.721+0000 7f35af400640 1 -- 172.21.15.2:0/3042277111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea49230 msgr2=0x55c2aea51720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.721+0000 7f35af400640 1 --2- 172.21.15.2:0/3042277111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea49230 0x55c2aea51720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.721+0000 7f35af400640 1 -- 172.21.15.2:0/3042277111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2aea67050 con 0x55c2aea4a7a0 2024-06-13T02:28:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.721+0000 7f35b5000640 1 --2- 172.21.15.2:0/3042277111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea49230 0x55c2aea51720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:28:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.721+0000 7f35af400640 1 --2- 172.21.15.2:0/3042277111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea4a7a0 0x55c2aea6c280 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f359c02a9a0 tx=0x7f359c003ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92fd1e10038f42f1 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.721+0000 7f35a4c00640 1 -- 172.21.15.2:0/3042277111 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c056070 con 0x55c2aea4a7a0 2024-06-13T02:28:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.721+0000 7f35a4c00640 1 -- 172.21.15.2:0/3042277111 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f359c040070 con 0x55c2aea4a7a0 2024-06-13T02:28:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.721+0000 7f35a4c00640 1 -- 172.21.15.2:0/3042277111 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c035030 con 0x55c2aea4a7a0 2024-06-13T02:28:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.722+0000 7f35b9e0d740 1 -- 172.21.15.2:0/3042277111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea4a7a0 msgr2=0x55c2aea6c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.722+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/3042277111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea4a7a0 0x55c2aea6c280 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f359c02a9a0 tx=0x7f359c003ef0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.724 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.722+0000 7f35b9e0d740 1 -- 172.21.15.2:0/3042277111 shutdown_connections 2024-06-13T02:28:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.722+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/3042277111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea53fb0 0x55c2aea6c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.722+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/3042277111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea4a7a0 0x55c2aea6c280 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.722+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/3042277111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea49230 0x55c2aea51720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.722+0000 7f35b9e0d740 1 -- 172.21.15.2:0/3042277111 >> 172.21.15.2:0/3042277111 conn(0x55c2aea11fb0 msgr2=0x55c2aea51010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.722+0000 7f35b9e0d740 1 -- 172.21.15.2:0/3042277111 shutdown_connections 2024-06-13T02:28:50.725 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.722+0000 7f35b9e0d740 1 -- 172.21.15.2:0/3042277111 wait complete. 2024-06-13T02:28:50.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.723+0000 7f35b9e0d740 1 -- start start 2024-06-13T02:28:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.723+0000 7f35b9e0d740 1 Processor -- start 2024-06-13T02:28:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.723+0000 7f35b9e0d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea49230 0x55c2aea5c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.723+0000 7f35b9e0d740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea4a7a0 0x55c2aea57a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.723+0000 7f35b9e0d740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea53fb0 0x55c2aea57f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.723+0000 7f35b9e0d740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35b01b3bd0 con 0x55c2aea53fb0 2024-06-13T02:28:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.723+0000 7f35b9e0d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f35b01b5040 con 0x55c2aea49230 2024-06-13T02:28:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.723+0000 7f35b9e0d740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35b01b42a0 con 0x55c2aea4a7a0 2024-06-13T02:28:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.723+0000 7f35b9e0d740 10 client.0 _ll_register_callbacks cb 0x7f35a80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:28:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.724+0000 7f35b5000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea49230 0x55c2aea5c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.724+0000 7f35b5000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea53fb0 0x55c2aea57f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.728 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.724+0000 7f35b5000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea53fb0 0x55c2aea57f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54830/0 (socket says 172.21.15.2:54830) 2024-06-13T02:28:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.724+0000 7f35b5000640 1 -- 172.21.15.2:0/1666014153 learned_addr learned my addr 172.21.15.2:0/1666014153 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:28:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.724+0000 7f35af400640 1 --2- 172.21.15.2:0/1666014153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea4a7a0 0x55c2aea57a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.724+0000 7f35b5000640 1 -- 172.21.15.2:0/1666014153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea4a7a0 msgr2=0x55c2aea57a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.724+0000 7f35b5000640 1 --2- 172.21.15.2:0/1666014153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea4a7a0 0x55c2aea57a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.724+0000 7f35b5000640 1 -- 172.21.15.2:0/1666014153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea49230 msgr2=0x55c2aea5c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:28:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.724+0000 7f35b5000640 1 --2- 172.21.15.2:0/1666014153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea49230 0x55c2aea5c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.724+0000 7f35b5000640 1 -- 172.21.15.2:0/1666014153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2aea41000 con 0x55c2aea53fb0 2024-06-13T02:28:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.725+0000 7f35b5000640 1 --2- 172.21.15.2:0/1666014153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea53fb0 0x55c2aea57f50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009600 tx=0x7f35a8004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfb59333f50342 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:28:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.725+0000 7f359a000640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:28:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.725+0000 7f359a000640 1 -- 172.21.15.2:0/1666014153 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a8031070 con 0x55c2aea53fb0 2024-06-13T02:28:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.725+0000 7f359a000640 1 -- 172.21.15.2:0/1666014153 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9583+0+0 (secure 0 0 0) 0x7f35a800fb20 con 0x55c2aea53fb0 2024-06-13T02:28:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.725+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1666014153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f359c040070 con 0x55c2aea53fb0 2024-06-13T02:28:50.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.725+0000 7f359a000640 1 -- 172.21.15.2:0/1666014153 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f35a8034040 con 0x55c2aea53fb0 2024-06-13T02:28:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.725+0000 7f35b9e0d740 10 client.15939 fetch_fsmap learned FSMap version 35 2024-06-13T02:28:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.725+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1666014153 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c2aeacee40 con 0x55c2aea53fb0 2024-06-13T02:28:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.726+0000 7f359a000640 1 -- 172.21.15.2:0/1666014153 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f359c040070 con 0x55c2aea53fb0 2024-06-13T02:28:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.726+0000 7f359a000640 1 -- 172.21.15.2:0/1666014153 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f35a8025040 con 0x55c2aea53fb0 2024-06-13T02:28:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.726+0000 7f35b9e0d740 10 client.15939 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:28:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.726+0000 7f35b9e0d740 10 client.15939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:28:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.726+0000 7f35b9e0d740 20 client.15939 populate_metadata read hostname 'smithi002' 2024-06-13T02:28:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.726+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/1666014153 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c2aeacf3c0 0x55c2aead17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:28:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.726+0000 7f35b9e0d740 4 client.15939 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:28:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.726+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1666014153 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c2ae9b4ea0 con 0x55c2aeacf3c0 2024-06-13T02:28:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.726+0000 7f35af400640 1 --2- 172.21.15.2:0/1666014153 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c2aeacf3c0 0x55c2aead17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:28:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.727+0000 7f35af400640 1 --2- 172.21.15.2:0/1666014153 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c2aeacf3c0 0x55c2aead17b0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7c4db6e3b3477ab server_cookie=57e202488e812333 in_seq=0 out_seq=0 2024-06-13T02:28:50.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:50.727+0000 7f359a000640 10 client.15939 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:51.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.130+0000 7f359a000640 1 -- 172.21.15.2:0/1666014153 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55c2ae9b4ea0 con 0x55c2aeacf3c0 2024-06-13T02:28:51.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.130+0000 7f359a000640 10 client.15939 handle_command_reply: tid=0 2024-06-13T02:28:51.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.130+0000 7f35b9e0d740 1 client.15939 shutdown 2024-06-13T02:28:51.132 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.131+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1666014153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea53fb0 msgr2=0x55c2aea57f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:51.132 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.131+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/1666014153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea53fb0 0x55c2aea57f50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009600 tx=0x7f35a8004550 comp rx=0 tx=0).stop 2024-06-13T02:28:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.131+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1666014153 shutdown_connections 2024-06-13T02:28:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.131+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/1666014153 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55c2aeacf3c0 0x55c2aead17b0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.131+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/1666014153 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55c2aea53fb0 0x55c2aea57f50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.131+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/1666014153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c2aea4a7a0 0x55c2aea57a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.131+0000 7f35b9e0d740 1 --2- 172.21.15.2:0/1666014153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2aea49230 0x55c2aea5c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.131+0000 7f359a000640 0 client.15939 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:28:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.131+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1666014153 >> 172.21.15.2:0/1666014153 conn(0x55c2aea11fb0 msgr2=0x55c2aea4b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.131+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1666014153 shutdown_connections 2024-06-13T02:28:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.131+0000 7f35b9e0d740 1 -- 172.21.15.2:0/1666014153 wait complete. 2024-06-13T02:28:51.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.132+0000 7f35b9e0d740 20 client.15939 trim_cache size 0 max 16384 2024-06-13T02:28:51.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:28:51.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:28:51.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:28:51.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.133+0000 7f35b5a00640 1 -- 172.21.15.2:0/769088946 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f35940a2de0 msgr2=0x7f35940a52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:51.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.133+0000 7f35b5a00640 1 --2- 172.21.15.2:0/769088946 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f35940a2de0 0x7f35940a52a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55c2aea4bf00 tx=0x7f35a00d3690 comp rx=0 tx=0).stop 2024-06-13T02:28:51.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.133+0000 7f35b5a00640 1 -- 172.21.15.2:0/769088946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0073d40 msgr2=0x7f35b019e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:28:51.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.133+0000 7f35b5a00640 1 --2- 172.21.15.2:0/769088946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0073d40 0x7f35b019e710 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f35a000e9f0 tx=0x7f35a000edf0 comp rx=0 tx=0).stop 2024-06-13T02:28:51.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.133+0000 7f35b5a00640 1 -- 172.21.15.2:0/769088946 shutdown_connections 2024-06-13T02:28:51.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.133+0000 7f35b5a00640 1 --2- 172.21.15.2:0/769088946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b01127d0 0x7f35b01a2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:51.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.133+0000 7f35b5a00640 1 --2- 172.21.15.2:0/769088946 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f35940a2de0 0x7f35940a52a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:51.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.133+0000 7f35b5a00640 1 --2- 172.21.15.2:0/769088946 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b0074660 0x7f35b019ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:51.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.133+0000 7f35b5a00640 1 --2- 172.21.15.2:0/769088946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0073d40 0x7f35b019e710 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:28:51.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.133+0000 7f35b5a00640 1 -- 172.21.15.2:0/769088946 >> 172.21.15.2:0/769088946 conn(0x7f35b00fd2b0 msgr2=0x7f35b00feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:28:51.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.134+0000 7f35b5a00640 1 -- 172.21.15.2:0/769088946 shutdown_connections 2024-06-13T02:28:51.136 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:28:51.134+0000 7f35b5a00640 1 -- 172.21.15.2:0/769088946 wait complete. 2024-06-13T02:28:51.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:51 smithi084 ceph-mon[36833]: pgmap v346: 129 pgs: 129 active+clean; 95 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 175 op/s 2024-06-13T02:28:51.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:51 smithi175 ceph-mon[36977]: pgmap v346: 129 pgs: 129 active+clean; 95 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 175 op/s 2024-06-13T02:28:51.556 INFO:tasks.workunit.client.0.smithi002.stdout: 1 785889 6.96 MB/sec execute 475 sec latency 138.199 ms 2024-06-13T02:28:51.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:51 smithi002 ceph-mon[31960]: pgmap v346: 129 pgs: 129 active+clean; 95 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 175 op/s 2024-06-13T02:28:52.557 INFO:tasks.workunit.client.0.smithi002.stdout: 1 787151 6.96 MB/sec execute 476 sec latency 24.865 ms 2024-06-13T02:28:53.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:53 smithi084 ceph-mon[36833]: pgmap v347: 129 pgs: 129 active+clean; 98 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 262 op/s 2024-06-13T02:28:53.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:53 smithi175 ceph-mon[36977]: pgmap v347: 129 pgs: 129 active+clean; 98 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 262 op/s 2024-06-13T02:28:53.557 INFO:tasks.workunit.client.0.smithi002.stdout: 1 788367 6.96 MB/sec execute 477 sec latency 20.962 ms 2024-06-13T02:28:53.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:53 smithi002 ceph-mon[31960]: pgmap v347: 129 pgs: 129 active+clean; 98 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 262 op/s 2024-06-13T02:28:54.557 INFO:tasks.workunit.client.0.smithi002.stdout: 1 789322 6.96 MB/sec execute 478 sec latency 19.808 ms 2024-06-13T02:28:55.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:55 smithi084 ceph-mon[36833]: pgmap v348: 129 pgs: 129 active+clean; 98 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.7 MiB/s wr, 144 op/s 2024-06-13T02:28:55.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:55 smithi175 ceph-mon[36977]: pgmap v348: 129 pgs: 129 active+clean; 98 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.7 MiB/s wr, 144 op/s 2024-06-13T02:28:55.557 INFO:tasks.workunit.client.0.smithi002.stdout: 1 790684 6.95 MB/sec execute 479 sec latency 28.540 ms 2024-06-13T02:28:55.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:55 smithi002 ceph-mon[31960]: pgmap v348: 129 pgs: 129 active+clean; 98 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.7 MiB/s wr, 144 op/s 2024-06-13T02:28:56.557 INFO:tasks.workunit.client.0.smithi002.stdout: 1 791906 6.96 MB/sec execute 480 sec latency 48.892 ms 2024-06-13T02:28:57.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:57 smithi084 ceph-mon[36833]: pgmap v349: 129 pgs: 129 active+clean; 90 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 255 op/s 2024-06-13T02:28:57.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:57 smithi175 ceph-mon[36977]: pgmap v349: 129 pgs: 129 active+clean; 90 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 255 op/s 2024-06-13T02:28:57.557 INFO:tasks.workunit.client.0.smithi002.stdout: 1 792529 6.95 MB/sec execute 481 sec latency 29.133 ms 2024-06-13T02:28:57.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:57 smithi002 ceph-mon[31960]: pgmap v349: 129 pgs: 129 active+clean; 90 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 255 op/s 2024-06-13T02:28:58.557 INFO:tasks.workunit.client.0.smithi002.stdout: 1 793467 6.95 MB/sec execute 482 sec latency 28.089 ms 2024-06-13T02:28:59.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:28:59 smithi084 ceph-mon[36833]: pgmap v350: 129 pgs: 129 active+clean; 88 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 229 op/s 2024-06-13T02:28:59.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:28:59 smithi175 ceph-mon[36977]: pgmap v350: 129 pgs: 129 active+clean; 88 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 229 op/s 2024-06-13T02:28:59.557 INFO:tasks.workunit.client.0.smithi002.stdout: 1 794966 6.95 MB/sec execute 483 sec latency 25.209 ms 2024-06-13T02:28:59.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:28:59 smithi002 ceph-mon[31960]: pgmap v350: 129 pgs: 129 active+clean; 88 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 229 op/s 2024-06-13T02:29:00.558 INFO:tasks.workunit.client.0.smithi002.stdout: 1 795494 6.94 MB/sec execute 484 sec latency 102.704 ms 2024-06-13T02:29:01.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:01 smithi084 ceph-mon[36833]: pgmap v351: 129 pgs: 129 active+clean; 88 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-06-13T02:29:01.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:01 smithi175 ceph-mon[36977]: pgmap v351: 129 pgs: 129 active+clean; 88 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-06-13T02:29:01.558 INFO:tasks.workunit.client.0.smithi002.stdout: 1 795514 6.93 MB/sec execute 485 sec latency 162.531 ms 2024-06-13T02:29:01.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:01 smithi002 ceph-mon[31960]: pgmap v351: 129 pgs: 129 active+clean; 88 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-06-13T02:29:02.558 INFO:tasks.workunit.client.0.smithi002.stdout: 1 796126 6.92 MB/sec execute 486 sec latency 70.824 ms 2024-06-13T02:29:03.433 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:03 smithi002 ceph-mon[31960]: pgmap v352: 129 pgs: 129 active+clean; 90 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 292 op/s 2024-06-13T02:29:03.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:03 smithi084 ceph-mon[36833]: pgmap v352: 129 pgs: 129 active+clean; 90 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 292 op/s 2024-06-13T02:29:03.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:03 smithi175 ceph-mon[36977]: pgmap v352: 129 pgs: 129 active+clean; 90 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 292 op/s 2024-06-13T02:29:03.558 INFO:tasks.workunit.client.0.smithi002.stdout: 1 797014 6.91 MB/sec execute 487 sec latency 143.211 ms 2024-06-13T02:29:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.285+0000 7fc813e00640 1 -- 172.21.15.2:0/1398704337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc814102a20 msgr2=0x7fc814102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.285+0000 7fc813e00640 1 --2- 172.21.15.2:0/1398704337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc814102a20 0x7fc814102e00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc804009ca0 tx=0x7fc80402a950 comp rx=0 tx=0).stop 2024-06-13T02:29:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.285+0000 7fc813e00640 1 -- 172.21.15.2:0/1398704337 shutdown_connections 2024-06-13T02:29:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.285+0000 7fc813e00640 1 --2- 172.21.15.2:0/1398704337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81410bdf0 0x7fc81410e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.285+0000 7fc813e00640 1 --2- 172.21.15.2:0/1398704337 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc814103340 0x7fc81410b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.285+0000 7fc813e00640 1 --2- 172.21.15.2:0/1398704337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc814102a20 0x7fc814102e00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.285+0000 7fc813e00640 1 -- 172.21.15.2:0/1398704337 >> 172.21.15.2:0/1398704337 conn(0x7fc8140fc180 msgr2=0x7fc8140fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:04.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.285+0000 7fc813e00640 1 -- 172.21.15.2:0/1398704337 shutdown_connections 2024-06-13T02:29:04.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.285+0000 7fc813e00640 1 -- 172.21.15.2:0/1398704337 wait complete. 2024-06-13T02:29:04.287 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.286+0000 7fc813e00640 1 Processor -- start 2024-06-13T02:29:04.288 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.287+0000 7fc813e00640 1 -- start start 2024-06-13T02:29:04.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.287+0000 7fc813e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc814102a20 0x7fc81419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.287+0000 7fc813e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc814103340 0x7fc81419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.287+0000 7fc813e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81410bdf0 0x7fc81419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.287+0000 7fc813e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc814111ba0 con 0x7fc814102a20 2024-06-13T02:29:04.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.287+0000 7fc813e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc814111a20 con 0x7fc81410bdf0 2024-06-13T02:29:04.289 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.287+0000 7fc813e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc814111d20 con 0x7fc814103340 2024-06-13T02:29:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.288+0000 7fc80a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc814103340 0x7fc81419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.288+0000 7fc813400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81410bdf0 0x7fc81419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.288+0000 7fc80a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc814103340 0x7fc81419a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:43152/0 (socket says 172.21.15.2:43152) 2024-06-13T02:29:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.288+0000 7fc80a000640 1 -- 172.21.15.2:0/3561434381 learned_addr learned my addr 172.21.15.2:0/3561434381 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.288+0000 7fc812a00640 1 --2- 172.21.15.2:0/3561434381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc814102a20 0x7fc81419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.288+0000 7fc813400640 1 -- 172.21.15.2:0/3561434381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc814103340 msgr2=0x7fc81419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.288+0000 7fc813400640 1 --2- 172.21.15.2:0/3561434381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc814103340 0x7fc81419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.288+0000 7fc813400640 1 -- 172.21.15.2:0/3561434381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc814102a20 msgr2=0x7fc81419a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.288+0000 7fc813400640 1 --2- 172.21.15.2:0/3561434381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc814102a20 0x7fc81419a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.288+0000 7fc813400640 1 -- 172.21.15.2:0/3561434381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81419f270 con 0x7fc81410bdf0 2024-06-13T02:29:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.288+0000 7fc80a000640 1 --2- 172.21.15.2:0/3561434381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc814103340 0x7fc81419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:29:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.289+0000 7fc813400640 1 --2- 172.21.15.2:0/3561434381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81410bdf0 0x7fc81419eb40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00e970 tx=0x7fc80c00ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.289+0000 7fc80be00640 1 -- 172.21.15.2:0/3561434381 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c00ccc0 con 0x7fc81410bdf0 2024-06-13T02:29:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.289+0000 7fc80be00640 1 -- 172.21.15.2:0/3561434381 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc80c005020 con 0x7fc81410bdf0 2024-06-13T02:29:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.289+0000 7fc813e00640 1 -- 172.21.15.2:0/3561434381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81419f560 con 0x7fc81410bdf0 2024-06-13T02:29:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.289+0000 7fc80be00640 1 -- 172.21.15.2:0/3561434381 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c004a00 con 0x7fc81410bdf0 2024-06-13T02:29:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.289+0000 7fc813e00640 1 -- 172.21.15.2:0/3561434381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8141a6df0 con 0x7fc81410bdf0 2024-06-13T02:29:04.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.292+0000 7fc80be00640 1 -- 172.21.15.2:0/3561434381 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fc80c0051d0 con 0x7fc81410bdf0 2024-06-13T02:29:04.293 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.293+0000 7fc81c76a740 1 Processor -- start 2024-06-13T02:29:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.293+0000 7fc81c76a740 1 -- start start 2024-06-13T02:29:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.293+0000 7fc81c76a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e05087a0 0x5588e0506cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.293+0000 7fc81c76a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0507230 0x5588e05076b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.293+0000 7fc81c76a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e0511fb0 0x5588e05143a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.293+0000 7fc81c76a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5588e046b420 con 0x5588e0507230 2024-06-13T02:29:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.293+0000 7fc81c76a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5588e0412c50 con 0x5588e05087a0 2024-06-13T02:29:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.293+0000 7fc81c76a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5588e04673e0 con 0x5588e0511fb0 2024-06-13T02:29:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.293+0000 7fc80a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e05087a0 0x5588e0506cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.293+0000 7fc812a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0507230 0x5588e05076b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.293+0000 7fc80a000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e05087a0 0x5588e0506cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:42330/0 (socket says 172.21.15.2:42330) 2024-06-13T02:29:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.293+0000 7fc80a000640 1 -- 172.21.15.2:0/446022933 learned_addr learned my addr 172.21.15.2:0/446022933 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.294+0000 7fc80a000640 1 --2- 172.21.15.2:0/446022933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e0511fb0 0x5588e05143a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.294+0000 7fc80be00640 1 --2- 172.21.15.2:0/3561434381 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc7f80a2ce0 0x7fc7f80a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.294+0000 7fc80be00640 1 -- 172.21.15.2:0/3561434381 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 9583+0+0 (secure 0 0 0) 0x7fc80c0cf800 con 0x7fc81410bdf0 2024-06-13T02:29:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.294+0000 7fc813400640 1 --2- 172.21.15.2:0/3561434381 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc7f80a2ce0 0x7fc7f80a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.294+0000 7fc80a000640 1 -- 172.21.15.2:0/446022933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e0511fb0 msgr2=0x5588e05143a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.294+0000 7fc80a000640 1 --2- 172.21.15.2:0/446022933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e0511fb0 0x5588e05143a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.297 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.294+0000 7fc80a000640 1 -- 172.21.15.2:0/446022933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0507230 msgr2=0x5588e05076b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:04.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.294+0000 7fc80a000640 1 --2- 172.21.15.2:0/446022933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0507230 0x5588e05076b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.294+0000 7fc80a000640 1 -- 172.21.15.2:0/446022933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588e017f210 con 0x5588e05087a0 2024-06-13T02:29:04.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.294+0000 7fc812a00640 1 --2- 172.21.15.2:0/446022933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0507230 0x5588e05076b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:29:04.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.294+0000 7fc80a000640 1 --2- 172.21.15.2:0/446022933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e05087a0 0x5588e0506cf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc013ce0 tx=0x7fc7fc0095b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25f77b5e9dabaf0f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:04.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.295+0000 7fc803e00640 1 -- 172.21.15.2:0/446022933 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc013dd0 con 0x5588e05087a0 2024-06-13T02:29:04.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.295+0000 7fc803e00640 1 -- 172.21.15.2:0/446022933 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7fc013170 con 0x5588e05087a0 2024-06-13T02:29:04.298 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.295+0000 7fc803e00640 1 -- 172.21.15.2:0/446022933 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc00e3b0 con 0x5588e05087a0 2024-06-13T02:29:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.296+0000 7fc81c76a740 1 -- 172.21.15.2:0/446022933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e05087a0 msgr2=0x5588e0506cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.296+0000 7fc81c76a740 1 --2- 172.21.15.2:0/446022933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e05087a0 0x5588e0506cf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc013ce0 tx=0x7fc7fc0095b0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.296+0000 7fc813400640 1 --2- 172.21.15.2:0/3561434381 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc7f80a2ce0 0x7fc7f80a51a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc80c004770 tx=0x7fc80c0046c0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:04.301 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.296+0000 7fc81c76a740 1 -- 172.21.15.2:0/446022933 shutdown_connections 2024-06-13T02:29:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.296+0000 7fc81c76a740 1 --2- 172.21.15.2:0/446022933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e0511fb0 0x5588e05143a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.296+0000 7fc81c76a740 1 --2- 172.21.15.2:0/446022933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0507230 0x5588e05076b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.296+0000 7fc81c76a740 1 --2- 172.21.15.2:0/446022933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e05087a0 0x5588e0506cf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.296+0000 7fc81c76a740 1 -- 172.21.15.2:0/446022933 >> 172.21.15.2:0/446022933 conn(0x5588e04cffb0 msgr2=0x5588e0503820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.296+0000 7fc81c76a740 1 -- 172.21.15.2:0/446022933 shutdown_connections 2024-06-13T02:29:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.296+0000 7fc81c76a740 1 -- 172.21.15.2:0/446022933 wait complete. 2024-06-13T02:29:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.296+0000 7fc81c76a740 1 -- start start 2024-06-13T02:29:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.297+0000 7fc81c76a740 1 Processor -- start 2024-06-13T02:29:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.297+0000 7fc81c76a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0507230 0x5588e050f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.297+0000 7fc81c76a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e05087a0 0x5588e050f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.302 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.297+0000 7fc81c76a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e0511fb0 0x5588e050fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.297+0000 7fc81c76a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5588e0514d80 con 0x5588e0507230 2024-06-13T02:29:04.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.297+0000 7fc81c76a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5588e04260b0 con 0x5588e0511fb0 2024-06-13T02:29:04.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.297+0000 7fc81c76a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5588e0514f00 con 0x5588e05087a0 2024-06-13T02:29:04.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.297+0000 7fc81c76a740 10 client.0 _ll_register_callbacks cb 0x5588e0411f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:29:04.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.297+0000 7fc80a000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0507230 0x5588e050f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.297+0000 7fc812a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e05087a0 0x5588e050f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.297+0000 7fc812a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e05087a0 0x5588e050f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:43178/0 (socket says 172.21.15.2:43178) 2024-06-13T02:29:04.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.297+0000 7fc812a00640 1 -- 172.21.15.2:0/419598588 learned_addr learned my addr 172.21.15.2:0/419598588 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:04.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.298+0000 7fc80a000640 1 --2- 172.21.15.2:0/419598588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e0511fb0 0x5588e050fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.298+0000 7fc812a00640 1 -- 172.21.15.2:0/419598588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e0511fb0 msgr2=0x5588e050fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:04.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.298+0000 7fc812a00640 1 --2- 172.21.15.2:0/419598588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e0511fb0 0x5588e050fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.298+0000 7fc812a00640 1 -- 172.21.15.2:0/419598588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0507230 msgr2=0x5588e050f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:04.303 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.298+0000 7fc812a00640 1 --2- 172.21.15.2:0/419598588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0507230 0x5588e050f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.298+0000 7fc812a00640 1 -- 172.21.15.2:0/419598588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588e024b620 con 0x5588e05087a0 2024-06-13T02:29:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.298+0000 7fc812a00640 1 --2- 172.21.15.2:0/419598588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e05087a0 0x5588e050f540 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc804009ca0 tx=0x7fc804003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d64af47e4cedf64 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.298+0000 7fc800c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:29:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.298+0000 7fc800c00640 1 -- 172.21.15.2:0/419598588 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804049060 con 0x5588e05087a0 2024-06-13T02:29:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.299+0000 7fc800c00640 1 -- 172.21.15.2:0/419598588 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9583+0+0 (secure 0 0 0) 0x7fc80402fb40 con 0x5588e05087a0 2024-06-13T02:29:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.299+0000 7fc81c76a740 1 -- 172.21.15.2:0/419598588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7fc013170 con 0x5588e05087a0 2024-06-13T02:29:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.299+0000 7fc800c00640 1 -- 172.21.15.2:0/419598588 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc804050050 con 0x5588e05087a0 2024-06-13T02:29:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.299+0000 7fc81c76a740 10 client.26137 fetch_fsmap learned FSMap version 35 2024-06-13T02:29:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.299+0000 7fc81c76a740 1 -- 172.21.15.2:0/419598588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5588e0521120 con 0x5588e05087a0 2024-06-13T02:29:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.299+0000 7fc800c00640 1 -- 172.21.15.2:0/419598588 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7fc013170 con 0x5588e05087a0 2024-06-13T02:29:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.299+0000 7fc800c00640 1 -- 172.21.15.2:0/419598588 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fc804030440 con 0x5588e05087a0 2024-06-13T02:29:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.299+0000 7fc81c76a740 10 client.26137 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:29:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.299+0000 7fc81c76a740 10 client.26137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:29:04.304 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.299+0000 7fc81c76a740 20 client.26137 populate_metadata read hostname 'smithi002' 2024-06-13T02:29:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.299+0000 7fc81c76a740 1 --2- 172.21.15.2:0/419598588 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5588e05225e0 0x5588e05249d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.300+0000 7fc81c76a740 4 client.26137 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:29:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.300+0000 7fc81c76a740 1 -- 172.21.15.2:0/419598588 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588e0478b50 con 0x5588e05225e0 2024-06-13T02:29:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.300+0000 7fc80a000640 1 --2- 172.21.15.2:0/419598588 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5588e05225e0 0x5588e05249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.300+0000 7fc80a000640 1 --2- 172.21.15.2:0/419598588 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5588e05225e0 0x5588e05249d0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f4e11751f81e6f server_cookie=6dc71ca79f39b7c4 in_seq=0 out_seq=0 2024-06-13T02:29:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.300+0000 7fc800c00640 10 client.26137 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.301+0000 7fc800c00640 1 -- 172.21.15.2:0/419598588 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5588e0478b50 con 0x5588e05225e0 2024-06-13T02:29:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.301+0000 7fc800c00640 10 client.26137 handle_command_reply: tid=0 2024-06-13T02:29:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.301+0000 7fc81c76a740 1 client.26137 shutdown 2024-06-13T02:29:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.301+0000 7fc81c76a740 1 -- 172.21.15.2:0/419598588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e05087a0 msgr2=0x5588e050f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.301+0000 7fc81c76a740 1 --2- 172.21.15.2:0/419598588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e05087a0 0x5588e050f540 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc804009ca0 tx=0x7fc804003ba0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.302+0000 7fc81c76a740 1 -- 172.21.15.2:0/419598588 shutdown_connections 2024-06-13T02:29:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.302+0000 7fc81c76a740 1 --2- 172.21.15.2:0/419598588 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5588e05225e0 0x5588e05249d0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.302+0000 7fc81c76a740 1 --2- 172.21.15.2:0/419598588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e0511fb0 0x5588e050fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.302+0000 7fc81c76a740 1 --2- 172.21.15.2:0/419598588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e05087a0 0x5588e050f540 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.302+0000 7fc800c00640 0 client.26137 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.302+0000 7fc81c76a740 1 --2- 172.21.15.2:0/419598588 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0507230 0x5588e050f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.302+0000 7fc81c76a740 1 -- 172.21.15.2:0/419598588 >> 172.21.15.2:0/419598588 conn(0x5588e04cffb0 msgr2=0x5588e0509650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.302+0000 7fc81c76a740 1 -- 172.21.15.2:0/419598588 shutdown_connections 2024-06-13T02:29:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.302+0000 7fc81c76a740 1 -- 172.21.15.2:0/419598588 wait complete. 2024-06-13T02:29:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.302+0000 7fc81c76a740 20 client.26137 trim_cache size 0 max 16384 2024-06-13T02:29:04.320 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.319+0000 7fc81c76a740 1 Processor -- start 2024-06-13T02:29:04.320 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.319+0000 7fc81c76a740 1 -- start start 2024-06-13T02:29:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.320+0000 7fc81c76a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e0507230 0x5588e05094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.320+0000 7fc81c76a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e05087a0 0x5588e052a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.320+0000 7fc81c76a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e0511fb0 0x5588e052a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.320+0000 7fc81c76a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141b3960 con 0x5588e05087a0 2024-06-13T02:29:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.320+0000 7fc81c76a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141b1230 con 0x5588e0511fb0 2024-06-13T02:29:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.320+0000 7fc81c76a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141af0a0 con 0x5588e0507230 2024-06-13T02:29:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.320+0000 7fc812a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e05087a0 0x5588e052a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.320+0000 7fc812a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e05087a0 0x5588e052a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44626/0 (socket says 172.21.15.2:44626) 2024-06-13T02:29:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.320+0000 7fc812a00640 1 -- 172.21.15.2:0/1122523383 learned_addr learned my addr 172.21.15.2:0/1122523383 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:04.321 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.320+0000 7fc80a000640 1 --2- 172.21.15.2:0/1122523383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e0507230 0x5588e05094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.320+0000 7fc812a00640 1 -- 172.21.15.2:0/1122523383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e0507230 msgr2=0x5588e05094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.321+0000 7fc812a00640 1 --2- 172.21.15.2:0/1122523383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e0507230 0x5588e05094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.321+0000 7fc812a00640 1 -- 172.21.15.2:0/1122523383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e0511fb0 msgr2=0x5588e052a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.321+0000 7fc812a00640 1 --2- 172.21.15.2:0/1122523383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e0511fb0 0x5588e052a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.322 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.321+0000 7fc812a00640 1 -- 172.21.15.2:0/1122523383 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588e0524d40 con 0x5588e05087a0 2024-06-13T02:29:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.321+0000 7fc812a00640 1 --2- 172.21.15.2:0/1122523383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e05087a0 0x5588e052a290 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc80402ae70 tx=0x7fc80402a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830cb06b5ff411e5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.321+0000 7fc803400640 1 -- 172.21.15.2:0/1122523383 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804059070 con 0x5588e05087a0 2024-06-13T02:29:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.321+0000 7fc803400640 1 -- 172.21.15.2:0/1122523383 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc804030c30 con 0x5588e05087a0 2024-06-13T02:29:04.323 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.321+0000 7fc803400640 1 -- 172.21.15.2:0/1122523383 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804049070 con 0x5588e05087a0 2024-06-13T02:29:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.322+0000 7fc81c76a740 1 -- 172.21.15.2:0/1122523383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e05087a0 msgr2=0x5588e052a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.322+0000 7fc81c76a740 1 --2- 172.21.15.2:0/1122523383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e05087a0 0x5588e052a290 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc80402ae70 tx=0x7fc80402a950 comp rx=0 tx=0).stop 2024-06-13T02:29:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.322+0000 7fc81c76a740 1 -- 172.21.15.2:0/1122523383 shutdown_connections 2024-06-13T02:29:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.322+0000 7fc81c76a740 1 --2- 172.21.15.2:0/1122523383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e0511fb0 0x5588e052a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.322+0000 7fc81c76a740 1 --2- 172.21.15.2:0/1122523383 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e05087a0 0x5588e052a290 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.322+0000 7fc81c76a740 1 --2- 172.21.15.2:0/1122523383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e0507230 0x5588e05094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.322+0000 7fc81c76a740 1 -- 172.21.15.2:0/1122523383 >> 172.21.15.2:0/1122523383 conn(0x5588e04cffb0 msgr2=0x5588e0508d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.322+0000 7fc81c76a740 1 -- 172.21.15.2:0/1122523383 shutdown_connections 2024-06-13T02:29:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.322+0000 7fc81c76a740 1 -- 172.21.15.2:0/1122523383 wait complete. 2024-06-13T02:29:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.322+0000 7fc81c76a740 1 -- start start 2024-06-13T02:29:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.323+0000 7fc81c76a740 1 Processor -- start 2024-06-13T02:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.323+0000 7fc81c76a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e0507230 0x5588e051a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.323+0000 7fc81c76a740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e05087a0 0x5588e0515ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.323+0000 7fc81c76a740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0511fb0 0x5588e0515ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.323+0000 7fc81c76a740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141af6f0 con 0x5588e0511fb0 2024-06-13T02:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.323+0000 7fc81c76a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141b0b60 con 0x5588e0507230 2024-06-13T02:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.323+0000 7fc81c76a740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141afdc0 con 0x5588e05087a0 2024-06-13T02:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.323+0000 7fc81c76a740 10 client.0 _ll_register_callbacks cb 0x7fc804009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.323+0000 7fc812a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e05087a0 0x5588e0515ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.323+0000 7fc812a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e05087a0 0x5588e0515ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:43198/0 (socket says 172.21.15.2:43198) 2024-06-13T02:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.323+0000 7fc812a00640 1 -- 172.21.15.2:0/416475315 learned_addr learned my addr 172.21.15.2:0/416475315 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.324+0000 7fc80a000640 1 --2- 172.21.15.2:0/416475315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e0507230 0x5588e051a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.324+0000 7fc80a000640 1 --2- 172.21.15.2:0/416475315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0511fb0 0x5588e0515ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.324+0000 7fc812a00640 1 -- 172.21.15.2:0/416475315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e0507230 msgr2=0x5588e051a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.324+0000 7fc812a00640 1 --2- 172.21.15.2:0/416475315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e0507230 0x5588e051a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.324+0000 7fc812a00640 1 -- 172.21.15.2:0/416475315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0511fb0 msgr2=0x5588e0515ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.324+0000 7fc812a00640 1 --2- 172.21.15.2:0/416475315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0511fb0 0x5588e0515ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.324+0000 7fc812a00640 1 -- 172.21.15.2:0/416475315 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588e0516630 con 0x5588e05087a0 2024-06-13T02:29:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.324+0000 7fc80a000640 1 --2- 172.21.15.2:0/416475315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e0507230 0x5588e051a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:29:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.324+0000 7fc812a00640 1 --2- 172.21.15.2:0/416475315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e05087a0 0x5588e0515ab0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc804009ca0 tx=0x7fc80402f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c39a759614d5187d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.324+0000 7fc800c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.324+0000 7fc800c00640 1 -- 172.21.15.2:0/416475315 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804062060 con 0x5588e05087a0 2024-06-13T02:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.325+0000 7fc800c00640 1 -- 172.21.15.2:0/416475315 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9583+0+0 (secure 0 0 0) 0x7fc804003f40 con 0x5588e05087a0 2024-06-13T02:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.325+0000 7fc81c76a740 1 -- 172.21.15.2:0/416475315 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc804030c30 con 0x5588e05087a0 2024-06-13T02:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.325+0000 7fc800c00640 1 -- 172.21.15.2:0/416475315 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc804059050 con 0x5588e05087a0 2024-06-13T02:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.325+0000 7fc81c76a740 10 client.26143 fetch_fsmap learned FSMap version 35 2024-06-13T02:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.325+0000 7fc81c76a740 1 -- 172.21.15.2:0/416475315 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5588e058d0c0 con 0x5588e05087a0 2024-06-13T02:29:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.325+0000 7fc800c00640 1 -- 172.21.15.2:0/416475315 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc804030c30 con 0x5588e05087a0 2024-06-13T02:29:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.325+0000 7fc800c00640 1 -- 172.21.15.2:0/416475315 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fc80405d470 con 0x5588e05087a0 2024-06-13T02:29:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.325+0000 7fc81c76a740 10 client.26143 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:29:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.325+0000 7fc81c76a740 10 client.26143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:29:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.325+0000 7fc81c76a740 20 client.26143 populate_metadata read hostname 'smithi002' 2024-06-13T02:29:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.325+0000 7fc81c76a740 1 --2- 172.21.15.2:0/416475315 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5588e058d780 0x5588e058fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.325+0000 7fc81c76a740 4 client.26143 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:29:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.325+0000 7fc81c76a740 1 -- 172.21.15.2:0/416475315 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5588e0472ea0 con 0x5588e058d780 2024-06-13T02:29:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.326+0000 7fc80a000640 1 --2- 172.21.15.2:0/416475315 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5588e058d780 0x5588e058fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.326+0000 7fc80a000640 1 --2- 172.21.15.2:0/416475315 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5588e058d780 0x5588e058fba0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d110cdf10841419a server_cookie=6582607f8f12d3b9 in_seq=0 out_seq=0 2024-06-13T02:29:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.326+0000 7fc800c00640 10 client.26143 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:04.558 INFO:tasks.workunit.client.0.smithi002.stdout: 1 798592 6.92 MB/sec execute 488 sec latency 106.567 ms 2024-06-13T02:29:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.563+0000 7fc800c00640 1 -- 172.21.15.2:0/416475315 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5588e0472ea0 con 0x5588e058d780 2024-06-13T02:29:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.563+0000 7fc800c00640 10 client.26143 handle_command_reply: tid=0 2024-06-13T02:29:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.563+0000 7fc81c76a740 1 client.26143 shutdown 2024-06-13T02:29:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.564+0000 7fc81c76a740 1 -- 172.21.15.2:0/416475315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e05087a0 msgr2=0x5588e0515ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.564+0000 7fc81c76a740 1 --2- 172.21.15.2:0/416475315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e05087a0 0x5588e0515ab0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc804009ca0 tx=0x7fc80402f740 comp rx=0 tx=0).stop 2024-06-13T02:29:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.564+0000 7fc81c76a740 1 -- 172.21.15.2:0/416475315 shutdown_connections 2024-06-13T02:29:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.564+0000 7fc81c76a740 1 --2- 172.21.15.2:0/416475315 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5588e058d780 0x5588e058fba0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.564+0000 7fc81c76a740 1 --2- 172.21.15.2:0/416475315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5588e0511fb0 0x5588e0515ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.564+0000 7fc81c76a740 1 --2- 172.21.15.2:0/416475315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5588e05087a0 0x5588e0515ab0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.564+0000 7fc81c76a740 1 --2- 172.21.15.2:0/416475315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5588e0507230 0x5588e051a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.564+0000 7fc81c76a740 1 -- 172.21.15.2:0/416475315 >> 172.21.15.2:0/416475315 conn(0x5588e04cffb0 msgr2=0x5588e0509620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.564+0000 7fc800c00640 0 client.26143 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.564+0000 7fc81c76a740 1 -- 172.21.15.2:0/416475315 shutdown_connections 2024-06-13T02:29:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.565+0000 7fc81c76a740 1 -- 172.21.15.2:0/416475315 wait complete. 2024-06-13T02:29:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.565+0000 7fc81c76a740 20 client.26143 trim_cache size 0 max 16384 2024-06-13T02:29:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:29:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:29:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:29:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.566+0000 7fc813e00640 1 -- 172.21.15.2:0/3561434381 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc7f80a2ce0 msgr2=0x7fc7f80a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.566+0000 7fc813e00640 1 --2- 172.21.15.2:0/3561434381 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc7f80a2ce0 0x7fc7f80a51a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc80c004770 tx=0x7fc80c0046c0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.566+0000 7fc813e00640 1 -- 172.21.15.2:0/3561434381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81410bdf0 msgr2=0x7fc81419eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.566+0000 7fc813e00640 1 --2- 172.21.15.2:0/3561434381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81410bdf0 0x7fc81419eb40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00e970 tx=0x7fc80c00ee30 comp rx=0 tx=0).stop 2024-06-13T02:29:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.566+0000 7fc813e00640 1 -- 172.21.15.2:0/3561434381 shutdown_connections 2024-06-13T02:29:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.566+0000 7fc813e00640 1 --2- 172.21.15.2:0/3561434381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81410bdf0 0x7fc81419eb40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.566+0000 7fc813e00640 1 --2- 172.21.15.2:0/3561434381 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc814103340 0x7fc81419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.566+0000 7fc813e00640 1 --2- 172.21.15.2:0/3561434381 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc7f80a2ce0 0x7fc7f80a51a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.566+0000 7fc813e00640 1 --2- 172.21.15.2:0/3561434381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc814102a20 0x7fc81419a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.566+0000 7fc813e00640 1 -- 172.21.15.2:0/3561434381 >> 172.21.15.2:0/3561434381 conn(0x7fc8140fc180 msgr2=0x7fc8140fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:04.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.567+0000 7fc813e00640 1 -- 172.21.15.2:0/3561434381 shutdown_connections 2024-06-13T02:29:04.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:04.567+0000 7fc813e00640 1 -- 172.21.15.2:0/3561434381 wait complete. 2024-06-13T02:29:05.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:05 smithi084 ceph-mon[36833]: pgmap v353: 129 pgs: 129 active+clean; 90 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 205 op/s 2024-06-13T02:29:05.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:05 smithi175 ceph-mon[36977]: pgmap v353: 129 pgs: 129 active+clean; 90 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 205 op/s 2024-06-13T02:29:05.558 INFO:tasks.workunit.client.0.smithi002.stdout: 1 799157 6.91 MB/sec execute 489 sec latency 80.935 ms 2024-06-13T02:29:05.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:05 smithi002 ceph-mon[31960]: pgmap v353: 129 pgs: 129 active+clean; 90 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 205 op/s 2024-06-13T02:29:06.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:06 smithi084 ceph-mon[36833]: osdmap e115: 12 total, 12 up, 12 in 2024-06-13T02:29:06.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:06 smithi175 ceph-mon[36977]: osdmap e115: 12 total, 12 up, 12 in 2024-06-13T02:29:06.558 INFO:tasks.workunit.client.0.smithi002.stdout: 1 799584 6.90 MB/sec execute 490 sec latency 48.518 ms 2024-06-13T02:29:06.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:06 smithi002 ceph-mon[31960]: osdmap e115: 12 total, 12 up, 12 in 2024-06-13T02:29:07.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:07 smithi084 ceph-mon[36833]: pgmap v355: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 88 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 240 op/s 2024-06-13T02:29:07.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:07 smithi175 ceph-mon[36977]: pgmap v355: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 88 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 240 op/s 2024-06-13T02:29:07.558 INFO:tasks.workunit.client.0.smithi002.stdout: 1 799852 6.89 MB/sec execute 491 sec latency 148.001 ms 2024-06-13T02:29:07.632 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:07 smithi002 ceph-mon[31960]: pgmap v355: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 88 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.6 MiB/s wr, 240 op/s 2024-06-13T02:29:08.558 INFO:tasks.workunit.client.0.smithi002.stdout: 1 800638 6.88 MB/sec execute 492 sec latency 112.696 ms 2024-06-13T02:29:09.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:09 smithi084 ceph-mon[36833]: pgmap v356: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 84 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 266 op/s 2024-06-13T02:29:09.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:09 smithi175 ceph-mon[36977]: pgmap v356: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 84 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 266 op/s 2024-06-13T02:29:09.558 INFO:tasks.workunit.client.0.smithi002.stdout: 1 802391 6.89 MB/sec execute 493 sec latency 27.008 ms 2024-06-13T02:29:09.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:09 smithi002 ceph-mon[31960]: pgmap v356: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 84 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 266 op/s 2024-06-13T02:29:10.558 INFO:tasks.workunit.client.0.smithi002.stdout: 1 803188 6.88 MB/sec execute 494 sec latency 21.503 ms 2024-06-13T02:29:11.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:11 smithi084 ceph-mon[36833]: pgmap v357: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 84 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 266 op/s 2024-06-13T02:29:11.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:11 smithi175 ceph-mon[36977]: pgmap v357: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 84 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 266 op/s 2024-06-13T02:29:11.558 INFO:tasks.workunit.client.0.smithi002.stdout: 1 804079 6.88 MB/sec execute 495 sec latency 66.221 ms 2024-06-13T02:29:11.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:11 smithi002 ceph-mon[31960]: pgmap v357: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 84 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 266 op/s 2024-06-13T02:29:12.559 INFO:tasks.workunit.client.0.smithi002.stdout: 1 805704 6.88 MB/sec execute 496 sec latency 50.896 ms 2024-06-13T02:29:13.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:13 smithi175 ceph-mon[36977]: pgmap v358: 129 pgs: 129 active+clean; 86 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1.8 MiB/s wr, 238 op/s 2024-06-13T02:29:13.559 INFO:tasks.workunit.client.0.smithi002.stdout: 1 806503 6.88 MB/sec execute 497 sec latency 33.905 ms 2024-06-13T02:29:13.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:13 smithi002 ceph-mon[31960]: pgmap v358: 129 pgs: 129 active+clean; 86 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1.8 MiB/s wr, 238 op/s 2024-06-13T02:29:13.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:13 smithi084 ceph-mon[36833]: pgmap v358: 129 pgs: 129 active+clean; 86 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1.8 MiB/s wr, 238 op/s 2024-06-13T02:29:14.559 INFO:tasks.workunit.client.0.smithi002.stdout: 1 807563 6.88 MB/sec execute 498 sec latency 24.741 ms 2024-06-13T02:29:14.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:14 smithi084 ceph-mon[36833]: osdmap e116: 12 total, 12 up, 12 in 2024-06-13T02:29:14.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:14 smithi084 ceph-mon[36833]: pgmap v360: 129 pgs: 129 active+clean; 86 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 271 op/s 2024-06-13T02:29:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:14 smithi175 ceph-mon[36977]: osdmap e116: 12 total, 12 up, 12 in 2024-06-13T02:29:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:14 smithi175 ceph-mon[36977]: pgmap v360: 129 pgs: 129 active+clean; 86 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 271 op/s 2024-06-13T02:29:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:14 smithi002 ceph-mon[31960]: osdmap e116: 12 total, 12 up, 12 in 2024-06-13T02:29:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:14 smithi002 ceph-mon[31960]: pgmap v360: 129 pgs: 129 active+clean; 86 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 271 op/s 2024-06-13T02:29:15.559 INFO:tasks.workunit.client.0.smithi002.stdout: 1 809160 6.88 MB/sec execute 499 sec latency 58.579 ms 2024-06-13T02:29:16.560 INFO:tasks.workunit.client.0.smithi002.stdout: 1 810059 6.88 MB/sec execute 500 sec latency 63.099 ms 2024-06-13T02:29:17.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:17 smithi175 ceph-mon[36977]: pgmap v361: 129 pgs: 129 active+clean; 92 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 177 op/s 2024-06-13T02:29:17.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:17 smithi002 ceph-mon[31960]: pgmap v361: 129 pgs: 129 active+clean; 92 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 177 op/s 2024-06-13T02:29:17.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:17 smithi084 ceph-mon[36833]: pgmap v361: 129 pgs: 129 active+clean; 92 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 177 op/s 2024-06-13T02:29:17.560 INFO:tasks.workunit.client.0.smithi002.stdout: 1 811008 6.87 MB/sec execute 501 sec latency 156.622 ms 2024-06-13T02:29:17.726 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.726+0000 7f86bc600640 1 -- 172.21.15.2:0/971911352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86b4108bf0 msgr2=0x7f86b410cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.726+0000 7f86bc600640 1 --2- 172.21.15.2:0/971911352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86b4108bf0 0x7f86b410cc30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009900 tx=0x7f86a002a3f0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.726+0000 7f86bc600640 1 -- 172.21.15.2:0/971911352 shutdown_connections 2024-06-13T02:29:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.726+0000 7f86bc600640 1 --2- 172.21.15.2:0/971911352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86b410d310 0x7f86b4114ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.726+0000 7f86bc600640 1 --2- 172.21.15.2:0/971911352 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86b4108bf0 0x7f86b410cc30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.726+0000 7f86bc600640 1 --2- 172.21.15.2:0/971911352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86b4108240 0x7f86b4108620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.726+0000 7f86bc600640 1 -- 172.21.15.2:0/971911352 >> 172.21.15.2:0/971911352 conn(0x7f86b4075eb0 msgr2=0x7f86b40782d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.726+0000 7f86bc600640 1 -- 172.21.15.2:0/971911352 shutdown_connections 2024-06-13T02:29:17.727 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.726+0000 7f86bc600640 1 -- 172.21.15.2:0/971911352 wait complete. 2024-06-13T02:29:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.727+0000 7f86bc600640 1 Processor -- start 2024-06-13T02:29:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.728+0000 7f86bc600640 1 -- start start 2024-06-13T02:29:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.728+0000 7f86bc600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86b4108240 0x7f86b41a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.728+0000 7f86bc600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86b410d310 0x7f86b41a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.728+0000 7f86bc600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86b419e720 0x7f86b419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.728+0000 7f86bc600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4118380 con 0x7f86b410d310 2024-06-13T02:29:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.728+0000 7f86bc600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4118200 con 0x7f86b419e720 2024-06-13T02:29:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.728+0000 7f86bc600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f86b4118500 con 0x7f86b4108240 2024-06-13T02:29:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.728+0000 7f86b9c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86b4108240 0x7f86b41a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.728+0000 7f86b9c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86b4108240 0x7f86b41a4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:60316/0 (socket says 172.21.15.2:60316) 2024-06-13T02:29:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.728+0000 7f86b9c00640 1 -- 172.21.15.2:0/3114068541 learned_addr learned my addr 172.21.15.2:0/3114068541 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.728+0000 7f86b9200640 1 --2- 172.21.15.2:0/3114068541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86b410d310 0x7f86b41a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.728+0000 7f86ba600640 1 --2- 172.21.15.2:0/3114068541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86b419e720 0x7f86b419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.729+0000 7f86b9c00640 1 -- 172.21.15.2:0/3114068541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86b419e720 msgr2=0x7f86b419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.729+0000 7f86b9c00640 1 --2- 172.21.15.2:0/3114068541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86b419e720 0x7f86b419eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.729+0000 7f86b9c00640 1 -- 172.21.15.2:0/3114068541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86b410d310 msgr2=0x7f86b41a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.729+0000 7f86b9c00640 1 --2- 172.21.15.2:0/3114068541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86b410d310 0x7f86b41a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.729+0000 7f86b9c00640 1 -- 172.21.15.2:0/3114068541 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b419f320 con 0x7f86b4108240 2024-06-13T02:29:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.729+0000 7f86b9c00640 1 --2- 172.21.15.2:0/3114068541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86b4108240 0x7f86b41a4660 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f86a800e9f0 tx=0x7f86a800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.729+0000 7f86b2000640 1 -- 172.21.15.2:0/3114068541 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a800ccc0 con 0x7f86b4108240 2024-06-13T02:29:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.730+0000 7f86bc600640 1 -- 172.21.15.2:0/3114068541 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b41ab400 con 0x7f86b4108240 2024-06-13T02:29:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.730+0000 7f86b2000640 1 -- 172.21.15.2:0/3114068541 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a8010910 con 0x7f86b4108240 2024-06-13T02:29:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.730+0000 7f86b2000640 1 -- 172.21.15.2:0/3114068541 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a80188a0 con 0x7f86b4108240 2024-06-13T02:29:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.730+0000 7f86bc600640 1 -- 172.21.15.2:0/3114068541 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b41ab800 con 0x7f86b4108240 2024-06-13T02:29:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.734+0000 7f86bf3d9740 1 Processor -- start 2024-06-13T02:29:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.735+0000 7f86bf3d9740 1 -- start start 2024-06-13T02:29:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.735+0000 7f86b2000640 1 -- 172.21.15.2:0/3114068541 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f86a8010ac0 con 0x7f86b4108240 2024-06-13T02:29:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.735+0000 7f86bf3d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c95e0 0x5573567c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.735+0000 7f86bf3d9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567c8070 0x5573567c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.735+0000 7f86bf3d9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567d2df0 0x5573567d51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.735+0000 7f86bf3d9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55735672c420 con 0x5573567c8070 2024-06-13T02:29:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.735+0000 7f86bf3d9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5573566d3c50 con 0x5573567d2df0 2024-06-13T02:29:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.735+0000 7f86bf3d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5573567283e0 con 0x5573567c95e0 2024-06-13T02:29:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.735+0000 7f86ba600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c95e0 0x5573567c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.735+0000 7f86b9c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567c8070 0x5573567c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.735+0000 7f86ba600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c95e0 0x5573567c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:60320/0 (socket says 172.21.15.2:60320) 2024-06-13T02:29:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.735+0000 7f86ba600640 1 -- 172.21.15.2:0/2180701967 learned_addr learned my addr 172.21.15.2:0/2180701967 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.735+0000 7f86b9200640 1 --2- 172.21.15.2:0/2180701967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567d2df0 0x5573567d51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.736+0000 7f86ba600640 1 -- 172.21.15.2:0/2180701967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567d2df0 msgr2=0x5573567d51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.736+0000 7f86ba600640 1 --2- 172.21.15.2:0/2180701967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567d2df0 0x5573567d51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.736+0000 7f86ba600640 1 -- 172.21.15.2:0/2180701967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567c8070 msgr2=0x5573567c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.736+0000 7f86ba600640 1 --2- 172.21.15.2:0/2180701967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567c8070 0x5573567c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.736+0000 7f86ba600640 1 -- 172.21.15.2:0/2180701967 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557356440210 con 0x5573567c95e0 2024-06-13T02:29:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.736+0000 7f86b9c00640 1 --2- 172.21.15.2:0/2180701967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567c8070 0x5573567c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:29:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.737+0000 7f86ba600640 1 --2- 172.21.15.2:0/2180701967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c95e0 0x5573567c7b30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009f90 tx=0x7f86ac0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9081adb92164423f server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.737+0000 7f86a6a00640 1 -- 172.21.15.2:0/2180701967 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac01e070 con 0x5573567c95e0 2024-06-13T02:29:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.737+0000 7f86a6a00640 1 -- 172.21.15.2:0/2180701967 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ac003c30 con 0x5573567c95e0 2024-06-13T02:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.737+0000 7f86a6a00640 1 -- 172.21.15.2:0/2180701967 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00f9e0 con 0x5573567c95e0 2024-06-13T02:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.737+0000 7f86b2000640 1 --2- 172.21.15.2:0/3114068541 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f869c0a2d70 0x7f869c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.737+0000 7f86b2000640 1 -- 172.21.15.2:0/3114068541 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9583+0+0 (secure 0 0 0) 0x7f86a80cfc20 con 0x7f86b4108240 2024-06-13T02:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.737+0000 7f86b9c00640 1 --2- 172.21.15.2:0/3114068541 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f869c0a2d70 0x7f869c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.738+0000 7f86bf3d9740 1 -- 172.21.15.2:0/2180701967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c95e0 msgr2=0x5573567c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.738+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/2180701967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c95e0 0x5573567c7b30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009f90 tx=0x7f86ac0118d0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.738+0000 7f86bf3d9740 1 -- 172.21.15.2:0/2180701967 shutdown_connections 2024-06-13T02:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.738+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/2180701967 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567d2df0 0x5573567d51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.738+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/2180701967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567c8070 0x5573567c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.738+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/2180701967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c95e0 0x5573567c7b30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.738+0000 7f86bf3d9740 1 -- 172.21.15.2:0/2180701967 >> 172.21.15.2:0/2180701967 conn(0x557356790fb0 msgr2=0x5573567c4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.738+0000 7f86bf3d9740 1 -- 172.21.15.2:0/2180701967 shutdown_connections 2024-06-13T02:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.738+0000 7f86bf3d9740 1 -- 172.21.15.2:0/2180701967 wait complete. 2024-06-13T02:29:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.738+0000 7f86b9c00640 1 --2- 172.21.15.2:0/3114068541 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f869c0a2d70 0x7f869c0a5230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x5573567cad40 tx=0x7f86a80d3710 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.739+0000 7f86bf3d9740 1 -- start start 2024-06-13T02:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.739+0000 7f86bf3d9740 1 Processor -- start 2024-06-13T02:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.739+0000 7f86bf3d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c8070 0x5573567cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.739+0000 7f86bf3d9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c95e0 0x5573567d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.739+0000 7f86bf3d9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567d2df0 0x5573567d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.739+0000 7f86bf3d9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5573567d5bc0 con 0x5573567d2df0 2024-06-13T02:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.740+0000 7f86bf3d9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5573566e70b0 con 0x5573567c95e0 2024-06-13T02:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.740+0000 7f86bf3d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5573567d5d40 con 0x5573567c8070 2024-06-13T02:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.740+0000 7f86bf3d9740 10 client.0 _ll_register_callbacks cb 0x5573566d2f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.740+0000 7f86b9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c95e0 0x5573567d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.740+0000 7f86b9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c95e0 0x5573567d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:55122/0 (socket says 172.21.15.2:55122) 2024-06-13T02:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.740+0000 7f86b9200640 1 -- 172.21.15.2:0/208607566 learned_addr learned my addr 172.21.15.2:0/208607566 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.740+0000 7f86ba600640 1 --2- 172.21.15.2:0/208607566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c8070 0x5573567cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.740+0000 7f86ba600640 1 --2- 172.21.15.2:0/208607566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567d2df0 0x5573567d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.740+0000 7f86b9200640 1 -- 172.21.15.2:0/208607566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c8070 msgr2=0x5573567cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.740+0000 7f86b9200640 1 --2- 172.21.15.2:0/208607566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c8070 0x5573567cfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.740+0000 7f86b9200640 1 -- 172.21.15.2:0/208607566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567d2df0 msgr2=0x5573567d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.740+0000 7f86b9200640 1 --2- 172.21.15.2:0/208607566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567d2df0 0x5573567d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.740+0000 7f86b9200640 1 -- 172.21.15.2:0/208607566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55735650c620 con 0x5573567c95e0 2024-06-13T02:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.740+0000 7f86ba600640 1 --2- 172.21.15.2:0/208607566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c8070 0x5573567cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.741+0000 7f86b9200640 1 --2- 172.21.15.2:0/208607566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c95e0 0x5573567d03a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009230 tx=0x7f86a00317e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62adc4fcf209d3f3 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.741+0000 7f869b400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.741+0000 7f869b400640 1 -- 172.21.15.2:0/208607566 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0035040 con 0x5573567c95e0 2024-06-13T02:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.741+0000 7f869b400640 1 -- 172.21.15.2:0/208607566 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9583+0+0 (secure 0 0 0) 0x7f86a0004240 con 0x5573567c95e0 2024-06-13T02:29:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.741+0000 7f86bf3d9740 1 -- 172.21.15.2:0/208607566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86ac003c30 con 0x5573567c95e0 2024-06-13T02:29:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.741+0000 7f869b400640 1 -- 172.21.15.2:0/208607566 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f86a0004440 con 0x5573567c95e0 2024-06-13T02:29:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.741+0000 7f86bf3d9740 10 client.26171 fetch_fsmap learned FSMap version 35 2024-06-13T02:29:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.741+0000 7f86bf3d9740 1 -- 172.21.15.2:0/208607566 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5573567e1f80 con 0x5573567c95e0 2024-06-13T02:29:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.741+0000 7f869b400640 1 -- 172.21.15.2:0/208607566 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ac003c30 con 0x5573567c95e0 2024-06-13T02:29:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.742+0000 7f869b400640 1 -- 172.21.15.2:0/208607566 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f86a0004bf0 con 0x5573567c95e0 2024-06-13T02:29:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.742+0000 7f86bf3d9740 10 client.26171 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:29:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.742+0000 7f86bf3d9740 10 client.26171 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:29:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.742+0000 7f86bf3d9740 20 client.26171 populate_metadata read hostname 'smithi002' 2024-06-13T02:29:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.742+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/208607566 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573567e3440 0x5573567e5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.742+0000 7f86bf3d9740 4 client.26171 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:29:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.742+0000 7f86bf3d9740 1 -- 172.21.15.2:0/208607566 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557356739b50 con 0x5573567e3440 2024-06-13T02:29:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.742+0000 7f86ba600640 1 --2- 172.21.15.2:0/208607566 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573567e3440 0x5573567e5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.743+0000 7f86ba600640 1 --2- 172.21.15.2:0/208607566 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573567e3440 0x5573567e5850 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d97099ef795d706 server_cookie=b628a0b471fd99b7 in_seq=0 out_seq=0 2024-06-13T02:29:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.743+0000 7f869b400640 10 client.26171 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.744+0000 7f869b400640 1 -- 172.21.15.2:0/208607566 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557356739b50 con 0x5573567e3440 2024-06-13T02:29:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.744+0000 7f869b400640 10 client.26171 handle_command_reply: tid=0 2024-06-13T02:29:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.744+0000 7f86bf3d9740 1 client.26171 shutdown 2024-06-13T02:29:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.744+0000 7f86bf3d9740 1 -- 172.21.15.2:0/208607566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c95e0 msgr2=0x5573567d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.744+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/208607566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c95e0 0x5573567d03a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009230 tx=0x7f86a00317e0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.745+0000 7f86bf3d9740 1 -- 172.21.15.2:0/208607566 shutdown_connections 2024-06-13T02:29:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.745+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/208607566 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573567e3440 0x5573567e5850 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.745+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/208607566 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567d2df0 0x5573567d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.745+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/208607566 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c95e0 0x5573567d03a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.745+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/208607566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c8070 0x5573567cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.745+0000 7f869b400640 0 client.26171 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.745+0000 7f86bf3d9740 1 -- 172.21.15.2:0/208607566 >> 172.21.15.2:0/208607566 conn(0x557356790fb0 msgr2=0x5573567ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.745+0000 7f86bf3d9740 1 -- 172.21.15.2:0/208607566 shutdown_connections 2024-06-13T02:29:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.745+0000 7f86bf3d9740 1 -- 172.21.15.2:0/208607566 wait complete. 2024-06-13T02:29:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.745+0000 7f86bf3d9740 20 client.26171 trim_cache size 0 max 16384 2024-06-13T02:29:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.764+0000 7f86bf3d9740 1 Processor -- start 2024-06-13T02:29:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.764+0000 7f86bf3d9740 1 -- start start 2024-06-13T02:29:17.764 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86bf3d9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557356790fb0 0x5573567c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86bf3d9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c8070 0x5573567c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86bf3d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c95e0 0x5573567eb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86bf3d9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41b8050 con 0x557356790fb0 2024-06-13T02:29:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86bf3d9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41b5920 con 0x5573567c8070 2024-06-13T02:29:17.765 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86bf3d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41b3790 con 0x5573567c95e0 2024-06-13T02:29:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86ba600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557356790fb0 0x5573567c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86b9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c8070 0x5573567c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86ba600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557356790fb0 0x5573567c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:47336/0 (socket says 172.21.15.2:47336) 2024-06-13T02:29:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86b9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c8070 0x5573567c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:55130/0 (socket says 172.21.15.2:55130) 2024-06-13T02:29:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86ba600640 1 -- 172.21.15.2:0/1687217412 learned_addr learned my addr 172.21.15.2:0/1687217412 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86ba600640 1 --2- 172.21.15.2:0/1687217412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c95e0 0x5573567eb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86ba600640 1 -- 172.21.15.2:0/1687217412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c95e0 msgr2=0x5573567eb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:17.766 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86ba600640 1 --2- 172.21.15.2:0/1687217412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c95e0 0x5573567eb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86ba600640 1 -- 172.21.15.2:0/1687217412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c8070 msgr2=0x5573567c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.765+0000 7f86ba600640 1 --2- 172.21.15.2:0/1687217412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c8070 0x5573567c36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.766+0000 7f86ba600640 1 -- 172.21.15.2:0/1687217412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573567ce3b0 con 0x557356790fb0 2024-06-13T02:29:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.766+0000 7f86ba600640 1 --2- 172.21.15.2:0/1687217412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557356790fb0 0x5573567c43c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00f5f0 tx=0x7f86ac00f620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a094fe02a951d2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.766+0000 7f86a6000640 1 -- 172.21.15.2:0/1687217412 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac01e070 con 0x557356790fb0 2024-06-13T02:29:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.766+0000 7f86a6000640 1 -- 172.21.15.2:0/1687217412 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ac01f040 con 0x557356790fb0 2024-06-13T02:29:17.767 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.766+0000 7f86a6000640 1 -- 172.21.15.2:0/1687217412 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac004560 con 0x557356790fb0 2024-06-13T02:29:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.767+0000 7f86bf3d9740 1 -- 172.21.15.2:0/1687217412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557356790fb0 msgr2=0x5573567c43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.767+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/1687217412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557356790fb0 0x5573567c43c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00f5f0 tx=0x7f86ac00f620 comp rx=0 tx=0).stop 2024-06-13T02:29:17.768 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.767+0000 7f86bf3d9740 1 -- 172.21.15.2:0/1687217412 shutdown_connections 2024-06-13T02:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.767+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/1687217412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5573567c95e0 0x5573567eb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.767+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/1687217412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c8070 0x5573567c36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.767+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/1687217412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557356790fb0 0x5573567c43c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.767+0000 7f86bf3d9740 1 -- 172.21.15.2:0/1687217412 >> 172.21.15.2:0/1687217412 conn(0x5573567cb830 msgr2=0x5573567c2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.767+0000 7f86bf3d9740 1 -- 172.21.15.2:0/1687217412 shutdown_connections 2024-06-13T02:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.767+0000 7f86bf3d9740 1 -- 172.21.15.2:0/1687217412 wait complete. 2024-06-13T02:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.768+0000 7f86bf3d9740 1 -- start start 2024-06-13T02:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.768+0000 7f86bf3d9740 1 Processor -- start 2024-06-13T02:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.768+0000 7f86bf3d9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557356790fb0 0x5573567d6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.768+0000 7f86bf3d9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c8070 0x5573567d7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.768+0000 7f86bf3d9740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567c95e0 0x5573567d7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.768+0000 7f86bf3d9740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41b3de0 con 0x5573567c95e0 2024-06-13T02:29:17.769 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.768+0000 7f86bf3d9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41b5250 con 0x5573567c8070 2024-06-13T02:29:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.768+0000 7f86bf3d9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f86b41b44b0 con 0x557356790fb0 2024-06-13T02:29:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.768+0000 7f86bf3d9740 10 client.0 _ll_register_callbacks cb 0x7f86a0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:29:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.769+0000 7f86b9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c8070 0x5573567d7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.769+0000 7f86b9200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c8070 0x5573567d7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:55146/0 (socket says 172.21.15.2:55146) 2024-06-13T02:29:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.769+0000 7f86b9200640 1 -- 172.21.15.2:0/3497940790 learned_addr learned my addr 172.21.15.2:0/3497940790 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.769+0000 7f86ba600640 1 --2- 172.21.15.2:0/3497940790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557356790fb0 0x5573567d6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.770 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.769+0000 7f86ba600640 1 --2- 172.21.15.2:0/3497940790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567c95e0 0x5573567d7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.771 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.769+0000 7f86b9200640 1 -- 172.21.15.2:0/3497940790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557356790fb0 msgr2=0x5573567d6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.769+0000 7f86b9200640 1 --2- 172.21.15.2:0/3497940790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557356790fb0 0x5573567d6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.769+0000 7f86b9200640 1 -- 172.21.15.2:0/3497940790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567c95e0 msgr2=0x5573567d7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.769+0000 7f86b9200640 1 --2- 172.21.15.2:0/3497940790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567c95e0 0x5573567d7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.769+0000 7f86b9200640 1 -- 172.21.15.2:0/3497940790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55735684d340 con 0x5573567c8070 2024-06-13T02:29:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.769+0000 7f86b9200640 1 --2- 172.21.15.2:0/3497940790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c8070 0x5573567d7500 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f86a0005940 tx=0x7f86a002aaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a784512021c58c45 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.769+0000 7f869b400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:29:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.770+0000 7f869b400640 1 -- 172.21.15.2:0/3497940790 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0035040 con 0x5573567c8070 2024-06-13T02:29:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.770+0000 7f86bf3d9740 1 -- 172.21.15.2:0/3497940790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86ac01f040 con 0x5573567c8070 2024-06-13T02:29:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.770+0000 7f869b400640 1 -- 172.21.15.2:0/3497940790 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9583+0+0 (secure 0 0 0) 0x7f86a00053d0 con 0x5573567c8070 2024-06-13T02:29:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.770+0000 7f869b400640 1 -- 172.21.15.2:0/3497940790 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f86a0005d50 con 0x5573567c8070 2024-06-13T02:29:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.770+0000 7f86bf3d9740 10 client.26177 fetch_fsmap learned FSMap version 35 2024-06-13T02:29:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.770+0000 7f86bf3d9740 1 -- 172.21.15.2:0/3497940790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55735684e630 con 0x5573567c8070 2024-06-13T02:29:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.770+0000 7f869b400640 1 -- 172.21.15.2:0/3497940790 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ac01f040 con 0x5573567c8070 2024-06-13T02:29:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.771+0000 7f869b400640 1 -- 172.21.15.2:0/3497940790 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f86a00047e0 con 0x5573567c8070 2024-06-13T02:29:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.771+0000 7f86bf3d9740 10 client.26177 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:29:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.771+0000 7f86bf3d9740 10 client.26177 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:29:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.771+0000 7f86bf3d9740 20 client.26177 populate_metadata read hostname 'smithi002' 2024-06-13T02:29:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.771+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/3497940790 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573567d2df0 0x557356850de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.771+0000 7f86bf3d9740 4 client.26177 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:29:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.771+0000 7f86bf3d9740 1 -- 172.21.15.2:0/3497940790 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557356733ea0 con 0x5573567d2df0 2024-06-13T02:29:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.771+0000 7f86ba600640 1 --2- 172.21.15.2:0/3497940790 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573567d2df0 0x557356850de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.771+0000 7f86ba600640 1 --2- 172.21.15.2:0/3497940790 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573567d2df0 0x557356850de0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=314f7fd9ef6838e5 server_cookie=d1f38efa5294ebc2 in_seq=0 out_seq=0 2024-06-13T02:29:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.771+0000 7f869b400640 10 client.26177 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.962+0000 7f869b400640 1 -- 172.21.15.2:0/3497940790 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x557356733ea0 con 0x5573567d2df0 2024-06-13T02:29:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.962+0000 7f869b400640 10 client.26177 handle_command_reply: tid=0 2024-06-13T02:29:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.962+0000 7f86bf3d9740 1 client.26177 shutdown 2024-06-13T02:29:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.963+0000 7f86bf3d9740 1 -- 172.21.15.2:0/3497940790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c8070 msgr2=0x5573567d7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.963+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/3497940790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c8070 0x5573567d7500 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f86a0005940 tx=0x7f86a002aaf0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.963+0000 7f86bf3d9740 1 -- 172.21.15.2:0/3497940790 shutdown_connections 2024-06-13T02:29:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.963+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/3497940790 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5573567d2df0 0x557356850de0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.963+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/3497940790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5573567c95e0 0x5573567d7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.963+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/3497940790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5573567c8070 0x5573567d7500 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.963+0000 7f86bf3d9740 1 --2- 172.21.15.2:0/3497940790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557356790fb0 0x5573567d6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.963 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.963+0000 7f869b400640 0 client.26177 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.963+0000 7f86bf3d9740 1 -- 172.21.15.2:0/3497940790 >> 172.21.15.2:0/3497940790 conn(0x5573567cb830 msgr2=0x5573567ca460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.963+0000 7f86bf3d9740 1 -- 172.21.15.2:0/3497940790 shutdown_connections 2024-06-13T02:29:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.963+0000 7f86bf3d9740 1 -- 172.21.15.2:0/3497940790 wait complete. 2024-06-13T02:29:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.963+0000 7f86bf3d9740 20 client.26177 trim_cache size 0 max 16384 2024-06-13T02:29:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:29:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:29:17.964 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:29:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.964+0000 7f86bc600640 1 -- 172.21.15.2:0/3114068541 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f869c0a2d70 msgr2=0x7f869c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.964+0000 7f86bc600640 1 --2- 172.21.15.2:0/3114068541 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f869c0a2d70 0x7f869c0a5230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x5573567cad40 tx=0x7f86a80d3710 comp rx=0 tx=0).stop 2024-06-13T02:29:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.964+0000 7f86bc600640 1 -- 172.21.15.2:0/3114068541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86b4108240 msgr2=0x7f86b41a4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.964+0000 7f86bc600640 1 --2- 172.21.15.2:0/3114068541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86b4108240 0x7f86b41a4660 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f86a800e9f0 tx=0x7f86a800edf0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.964+0000 7f86bc600640 1 -- 172.21.15.2:0/3114068541 shutdown_connections 2024-06-13T02:29:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.964+0000 7f86bc600640 1 --2- 172.21.15.2:0/3114068541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86b419e720 0x7f86b419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.964+0000 7f86bc600640 1 --2- 172.21.15.2:0/3114068541 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f869c0a2d70 0x7f869c0a5230 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.964+0000 7f86bc600640 1 --2- 172.21.15.2:0/3114068541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f86b410d310 0x7f86b41a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.965 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.964+0000 7f86bc600640 1 --2- 172.21.15.2:0/3114068541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86b4108240 0x7f86b41a4660 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:17.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.964+0000 7f86bc600640 1 -- 172.21.15.2:0/3114068541 >> 172.21.15.2:0/3114068541 conn(0x7f86b4075eb0 msgr2=0x7f86b4077210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:17.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.964+0000 7f86bc600640 1 -- 172.21.15.2:0/3114068541 shutdown_connections 2024-06-13T02:29:17.966 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:17.965+0000 7f86bc600640 1 -- 172.21.15.2:0/3114068541 wait complete. 2024-06-13T02:29:18.560 INFO:tasks.workunit.client.0.smithi002.stdout: 1 812671 6.88 MB/sec execute 502 sec latency 133.397 ms 2024-06-13T02:29:19.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:19 smithi175 ceph-mon[36977]: pgmap v362: 129 pgs: 129 active+clean; 91 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 143 op/s 2024-06-13T02:29:19.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:19 smithi002 ceph-mon[31960]: pgmap v362: 129 pgs: 129 active+clean; 91 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 143 op/s 2024-06-13T02:29:19.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:19 smithi084 ceph-mon[36833]: pgmap v362: 129 pgs: 129 active+clean; 91 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 143 op/s 2024-06-13T02:29:19.560 INFO:tasks.workunit.client.0.smithi002.stdout: 1 813711 6.87 MB/sec execute 503 sec latency 22.943 ms 2024-06-13T02:29:20.282 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:20 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:29:20.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:20 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:29:20.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:20 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:29:20.560 INFO:tasks.workunit.client.0.smithi002.stdout: 1 814823 6.87 MB/sec execute 504 sec latency 20.296 ms 2024-06-13T02:29:21.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:21 smithi002 ceph-mon[31960]: pgmap v363: 129 pgs: 129 active+clean; 91 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 143 op/s 2024-06-13T02:29:21.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:21 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:29:21.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:21 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:29:21.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:21 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:29:21.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:21 smithi084 ceph-mon[36833]: pgmap v363: 129 pgs: 129 active+clean; 91 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 143 op/s 2024-06-13T02:29:21.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:21 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:29:21.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:21 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:29:21.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:21 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:29:21.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:21 smithi175 ceph-mon[36977]: pgmap v363: 129 pgs: 129 active+clean; 91 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 143 op/s 2024-06-13T02:29:21.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:21 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:29:21.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:21 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:29:21.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:21 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:29:21.560 INFO:tasks.workunit.client.0.smithi002.stdout: 1 816697 6.88 MB/sec execute 505 sec latency 20.398 ms 2024-06-13T02:29:22.561 INFO:tasks.workunit.client.0.smithi002.stdout: 1 817477 6.87 MB/sec execute 506 sec latency 65.864 ms 2024-06-13T02:29:23.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:23 smithi002 ceph-mon[31960]: pgmap v364: 129 pgs: 129 active+clean; 88 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 231 op/s 2024-06-13T02:29:23.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:23 smithi084 ceph-mon[36833]: pgmap v364: 129 pgs: 129 active+clean; 88 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 231 op/s 2024-06-13T02:29:23.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:23 smithi175 ceph-mon[36977]: pgmap v364: 129 pgs: 129 active+clean; 88 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 231 op/s 2024-06-13T02:29:23.561 INFO:tasks.workunit.client.0.smithi002.stdout: 1 818576 6.87 MB/sec execute 507 sec latency 24.864 ms 2024-06-13T02:29:24.561 INFO:tasks.workunit.client.0.smithi002.stdout: 1 820226 6.88 MB/sec execute 508 sec latency 21.261 ms 2024-06-13T02:29:25.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:25 smithi002 ceph-mon[31960]: pgmap v365: 129 pgs: 129 active+clean; 88 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 225 op/s 2024-06-13T02:29:25.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:25 smithi084 ceph-mon[36833]: pgmap v365: 129 pgs: 129 active+clean; 88 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 225 op/s 2024-06-13T02:29:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:25 smithi175 ceph-mon[36977]: pgmap v365: 129 pgs: 129 active+clean; 88 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 225 op/s 2024-06-13T02:29:25.561 INFO:tasks.workunit.client.0.smithi002.stdout: 1 820916 6.87 MB/sec execute 509 sec latency 20.881 ms 2024-06-13T02:29:26.561 INFO:tasks.workunit.client.0.smithi002.stdout: 1 821961 6.86 MB/sec execute 510 sec latency 30.280 ms 2024-06-13T02:29:27.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:27 smithi002 ceph-mon[31960]: pgmap v366: 129 pgs: 129 active+clean; 93 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 248 op/s 2024-06-13T02:29:27.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:27 smithi084 ceph-mon[36833]: pgmap v366: 129 pgs: 129 active+clean; 93 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 248 op/s 2024-06-13T02:29:27.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:27 smithi175 ceph-mon[36977]: pgmap v366: 129 pgs: 129 active+clean; 93 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 248 op/s 2024-06-13T02:29:27.561 INFO:tasks.workunit.client.0.smithi002.stdout: 1 823657 6.87 MB/sec execute 511 sec latency 66.134 ms 2024-06-13T02:29:28.562 INFO:tasks.workunit.client.0.smithi002.stdout: 1 824369 6.86 MB/sec execute 512 sec latency 24.373 ms 2024-06-13T02:29:29.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:29 smithi002 ceph-mon[31960]: pgmap v367: 129 pgs: 129 active+clean; 93 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 205 op/s 2024-06-13T02:29:29.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:29 smithi084 ceph-mon[36833]: pgmap v367: 129 pgs: 129 active+clean; 93 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 205 op/s 2024-06-13T02:29:29.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:29 smithi175 ceph-mon[36977]: pgmap v367: 129 pgs: 129 active+clean; 93 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 205 op/s 2024-06-13T02:29:29.561 INFO:tasks.workunit.client.0.smithi002.stdout: 1 825352 6.86 MB/sec execute 513 sec latency 22.711 ms 2024-06-13T02:29:30.562 INFO:tasks.workunit.client.0.smithi002.stdout: 1 826879 6.86 MB/sec execute 514 sec latency 25.939 ms 2024-06-13T02:29:31.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.124+0000 7f382ec00640 1 -- 172.21.15.2:0/3332558831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38281077c0 msgr2=0x7f3828107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:31.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.124+0000 7f382ec00640 1 --2- 172.21.15.2:0/3332558831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38281077c0 0x7f3828107ba0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f381c009900 tx=0x7f381c02a400 comp rx=0 tx=0).stop 2024-06-13T02:29:31.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.124+0000 7f382ec00640 1 -- 172.21.15.2:0/3332558831 shutdown_connections 2024-06-13T02:29:31.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.124+0000 7f382ec00640 1 --2- 172.21.15.2:0/3332558831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3828102170 0x7f382810e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.124+0000 7f382ec00640 1 --2- 172.21.15.2:0/3332558831 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f38281017b0 0x7f3828101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.124+0000 7f382ec00640 1 --2- 172.21.15.2:0/3332558831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38281077c0 0x7f3828107ba0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.124+0000 7f382ec00640 1 -- 172.21.15.2:0/3332558831 >> 172.21.15.2:0/3332558831 conn(0x7f38280fd2e0 msgr2=0x7f38280ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:31.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.124+0000 7f382ec00640 1 -- 172.21.15.2:0/3332558831 shutdown_connections 2024-06-13T02:29:31.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.124+0000 7f382ec00640 1 -- 172.21.15.2:0/3332558831 wait complete. 2024-06-13T02:29:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.125+0000 7f382ec00640 1 Processor -- start 2024-06-13T02:29:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.126+0000 7f382ec00640 1 -- start start 2024-06-13T02:29:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.126+0000 7f382ec00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38281017b0 0x7f382819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.126+0000 7f382ec00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3828102170 0x7f382819a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.126+0000 7f382ec00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38281077c0 0x7f382819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.126+0000 7f382ec00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3828111bd0 con 0x7f3828102170 2024-06-13T02:29:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.126+0000 7f382ec00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3828111a50 con 0x7f38281077c0 2024-06-13T02:29:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.126+0000 7f382ec00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3828111d50 con 0x7f38281017b0 2024-06-13T02:29:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.126+0000 7f382d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38281017b0 0x7f382819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.126+0000 7f382d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38281017b0 0x7f382819a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:39944/0 (socket says 172.21.15.2:39944) 2024-06-13T02:29:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.126+0000 7f382d800640 1 -- 172.21.15.2:0/4075018712 learned_addr learned my addr 172.21.15.2:0/4075018712 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.126+0000 7f382e200640 1 --2- 172.21.15.2:0/4075018712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38281077c0 0x7f382819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.127+0000 7f382ce00640 1 --2- 172.21.15.2:0/4075018712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3828102170 0x7f382819a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.127+0000 7f382d800640 1 -- 172.21.15.2:0/4075018712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38281077c0 msgr2=0x7f382819eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.127+0000 7f382d800640 1 --2- 172.21.15.2:0/4075018712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38281077c0 0x7f382819eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.127+0000 7f382d800640 1 -- 172.21.15.2:0/4075018712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3828102170 msgr2=0x7f382819a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.127+0000 7f382d800640 1 --2- 172.21.15.2:0/4075018712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3828102170 0x7f382819a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.127+0000 7f382d800640 1 -- 172.21.15.2:0/4075018712 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382819f2a0 con 0x7f38281017b0 2024-06-13T02:29:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.127+0000 7f382d800640 1 --2- 172.21.15.2:0/4075018712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38281017b0 0x7f382819a350 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f381c006010 tx=0x7f381c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.127+0000 7f3826000640 1 -- 172.21.15.2:0/4075018712 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c03f070 con 0x7f38281017b0 2024-06-13T02:29:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.128+0000 7f3826000640 1 -- 172.21.15.2:0/4075018712 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f381c031c30 con 0x7f38281017b0 2024-06-13T02:29:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.128+0000 7f382ec00640 1 -- 172.21.15.2:0/4075018712 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382819f530 con 0x7f38281017b0 2024-06-13T02:29:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.128+0000 7f3826000640 1 -- 172.21.15.2:0/4075018712 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381c035030 con 0x7f38281017b0 2024-06-13T02:29:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.128+0000 7f382ec00640 1 -- 172.21.15.2:0/4075018712 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38281a6e20 con 0x7f38281017b0 2024-06-13T02:29:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.131+0000 7f38331e0740 1 Processor -- start 2024-06-13T02:29:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.131+0000 7f38331e0740 1 -- start start 2024-06-13T02:29:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.132+0000 7f3826000640 1 -- 172.21.15.2:0/4075018712 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f381c042070 con 0x7f38281017b0 2024-06-13T02:29:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.132+0000 7f38331e0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.132+0000 7f38331e0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 0x55b8491b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.132+0000 7f38331e0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491bffb0 0x55b8491c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.132+0000 7f38331e0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b849119420 con 0x55b8491bffb0 2024-06-13T02:29:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.132+0000 7f38331e0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b8490c0c50 con 0x55b8491b5230 2024-06-13T02:29:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.132+0000 7f38331e0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b8491153e0 con 0x55b8491b67a0 2024-06-13T02:29:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.132+0000 7f382d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 0x55b8491b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.132+0000 7f382e200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.132+0000 7f382e200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:39956/0 (socket says 172.21.15.2:39956) 2024-06-13T02:29:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.132+0000 7f382d800640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 0x55b8491b56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:55200/0 (socket says 172.21.15.2:55200) 2024-06-13T02:29:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.132+0000 7f382e200640 1 -- 172.21.15.2:0/3450028319 learned_addr learned my addr 172.21.15.2:0/3450028319 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.132+0000 7f382ce00640 1 --2- 172.21.15.2:0/3450028319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491bffb0 0x55b8491c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.133+0000 7f382e200640 1 -- 172.21.15.2:0/3450028319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 msgr2=0x55b8491b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:31.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.133+0000 7f382e200640 1 --2- 172.21.15.2:0/3450028319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 0x55b8491b56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.133+0000 7f382e200640 1 -- 172.21.15.2:0/3450028319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491bffb0 msgr2=0x55b8491c23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:31.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.133+0000 7f382e200640 1 --2- 172.21.15.2:0/3450028319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491bffb0 0x55b8491c23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.133+0000 7f382e200640 1 -- 172.21.15.2:0/3450028319 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b848e2d210 con 0x55b8491b67a0 2024-06-13T02:29:31.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.133+0000 7f382e200640 1 --2- 172.21.15.2:0/3450028319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491b4cf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3820009f80 tx=0x7f38200118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1210110ff16072ce server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:31.141 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.133+0000 7f381aa00640 1 -- 172.21.15.2:0/3450028319 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820004d20 con 0x55b8491b67a0 2024-06-13T02:29:31.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.133+0000 7f381aa00640 1 -- 172.21.15.2:0/3450028319 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3820004050 con 0x55b8491b67a0 2024-06-13T02:29:31.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.134+0000 7f381aa00640 1 -- 172.21.15.2:0/3450028319 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820005260 con 0x55b8491b67a0 2024-06-13T02:29:31.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.134+0000 7f3826000640 1 --2- 172.21.15.2:0/4075018712 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f38100a2d60 0x7f38100a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.134+0000 7f3826000640 1 -- 172.21.15.2:0/4075018712 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9583+0+0 (secure 0 0 0) 0x7f381c0eff20 con 0x7f38281017b0 2024-06-13T02:29:31.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.134+0000 7f382d800640 1 --2- 172.21.15.2:0/4075018712 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f38100a2d60 0x7f38100a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.134+0000 7f38331e0740 1 -- 172.21.15.2:0/3450028319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 msgr2=0x55b8491b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:31.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.134+0000 7f38331e0740 1 --2- 172.21.15.2:0/3450028319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491b4cf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3820009f80 tx=0x7f38200118d0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.134+0000 7f38331e0740 1 -- 172.21.15.2:0/3450028319 shutdown_connections 2024-06-13T02:29:31.142 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.134+0000 7f38331e0740 1 --2- 172.21.15.2:0/3450028319 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491bffb0 0x55b8491c23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.134+0000 7f38331e0740 1 --2- 172.21.15.2:0/3450028319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 0x55b8491b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.135+0000 7f38331e0740 1 --2- 172.21.15.2:0/3450028319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491b4cf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.135+0000 7f38331e0740 1 -- 172.21.15.2:0/3450028319 >> 172.21.15.2:0/3450028319 conn(0x55b84917dfb0 msgr2=0x55b8491b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.135+0000 7f38331e0740 1 -- 172.21.15.2:0/3450028319 shutdown_connections 2024-06-13T02:29:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.135+0000 7f38331e0740 1 -- 172.21.15.2:0/3450028319 wait complete. 2024-06-13T02:29:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.135+0000 7f382d800640 1 --2- 172.21.15.2:0/4075018712 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f38100a2d60 0x7f38100a5220 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f381c0ed300 tx=0x7f381c0f3a70 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.135+0000 7f38331e0740 1 -- start start 2024-06-13T02:29:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.135+0000 7f38331e0740 1 Processor -- start 2024-06-13T02:29:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.136+0000 7f38331e0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491b5230 0x55b8491bd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.143 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.136+0000 7f38331e0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491bd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.136+0000 7f38331e0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491bffb0 0x55b8491bda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.136+0000 7f38331e0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55b8491c2d80 con 0x55b8491b5230 2024-06-13T02:29:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.136+0000 7f38331e0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b8490d40b0 con 0x55b8491bffb0 2024-06-13T02:29:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.136+0000 7f38331e0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55b8491c2f00 con 0x55b8491b67a0 2024-06-13T02:29:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.136+0000 7f38331e0740 10 client.0 _ll_register_callbacks cb 0x55b8490bff40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:29:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.136+0000 7f382ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491bd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.136+0000 7f382ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491bd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:39962/0 (socket says 172.21.15.2:39962) 2024-06-13T02:29:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.136+0000 7f382ce00640 1 -- 172.21.15.2:0/2632608885 learned_addr learned my addr 172.21.15.2:0/2632608885 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.136+0000 7f382e200640 1 --2- 172.21.15.2:0/2632608885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491b5230 0x55b8491bd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.144 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.137+0000 7f382e200640 1 --2- 172.21.15.2:0/2632608885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491bffb0 0x55b8491bda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.137+0000 7f382ce00640 1 -- 172.21.15.2:0/2632608885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491bffb0 msgr2=0x55b8491bda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:31.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.137+0000 7f382ce00640 1 --2- 172.21.15.2:0/2632608885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491bffb0 0x55b8491bda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.137+0000 7f382ce00640 1 -- 172.21.15.2:0/2632608885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491b5230 msgr2=0x55b8491bd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:31.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.137+0000 7f382ce00640 1 --2- 172.21.15.2:0/2632608885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491b5230 0x55b8491bd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.137+0000 7f382ce00640 1 -- 172.21.15.2:0/2632608885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b848ef9620 con 0x55b8491b67a0 2024-06-13T02:29:31.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.137+0000 7f382e200640 1 --2- 172.21.15.2:0/2632608885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491bffb0 0x55b8491bda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:29:31.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.137+0000 7f382ce00640 1 --2- 172.21.15.2:0/2632608885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491bd540 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f381400da10 tx=0x7f381400ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7ac388138b56387 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:31.145 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.137+0000 7f380f400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:29:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.137+0000 7f380f400640 1 -- 172.21.15.2:0/2632608885 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814005020 con 0x55b8491b67a0 2024-06-13T02:29:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.137+0000 7f380f400640 1 -- 172.21.15.2:0/2632608885 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9583+0+0 (secure 0 0 0) 0x7f38140051c0 con 0x55b8491b67a0 2024-06-13T02:29:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.137+0000 7f38331e0740 1 -- 172.21.15.2:0/2632608885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3820004050 con 0x55b8491b67a0 2024-06-13T02:29:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.138+0000 7f380f400640 1 -- 172.21.15.2:0/2632608885 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3814023050 con 0x55b8491b67a0 2024-06-13T02:29:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.138+0000 7f38331e0740 10 client.26173 fetch_fsmap learned FSMap version 35 2024-06-13T02:29:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.138+0000 7f38331e0740 1 -- 172.21.15.2:0/2632608885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b8491cf180 con 0x55b8491b67a0 2024-06-13T02:29:31.146 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.138+0000 7f380f400640 1 -- 172.21.15.2:0/2632608885 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3820004050 con 0x55b8491b67a0 2024-06-13T02:29:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.138+0000 7f380f400640 1 -- 172.21.15.2:0/2632608885 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f3814019030 con 0x55b8491b67a0 2024-06-13T02:29:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.138+0000 7f38331e0740 10 client.26173 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:29:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.138+0000 7f38331e0740 10 client.26173 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:29:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.138+0000 7f38331e0740 20 client.26173 populate_metadata read hostname 'smithi002' 2024-06-13T02:29:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.138+0000 7f38331e0740 1 --2- 172.21.15.2:0/2632608885 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b8491d0640 0x55b8491d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.139+0000 7f38331e0740 4 client.26173 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:29:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.139+0000 7f38331e0740 1 -- 172.21.15.2:0/2632608885 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b849126b50 con 0x55b8491d0640 2024-06-13T02:29:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.139+0000 7f382e200640 1 --2- 172.21.15.2:0/2632608885 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b8491d0640 0x55b8491d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.139+0000 7f382e200640 1 --2- 172.21.15.2:0/2632608885 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b8491d0640 0x55b8491d2a30 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb87051eeca9b938 server_cookie=c2d05187e9f33ffc in_seq=0 out_seq=0 2024-06-13T02:29:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.139+0000 7f380f400640 10 client.26173 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.141+0000 7f380f400640 1 -- 172.21.15.2:0/2632608885 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b849126b50 con 0x55b8491d0640 2024-06-13T02:29:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.141+0000 7f380f400640 10 client.26173 handle_command_reply: tid=0 2024-06-13T02:29:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.141+0000 7f38331e0740 1 client.26173 shutdown 2024-06-13T02:29:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.141+0000 7f38331e0740 1 -- 172.21.15.2:0/2632608885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 msgr2=0x55b8491bd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.141+0000 7f38331e0740 1 --2- 172.21.15.2:0/2632608885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491bd540 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f381400da10 tx=0x7f381400ded0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.141+0000 7f38331e0740 1 -- 172.21.15.2:0/2632608885 shutdown_connections 2024-06-13T02:29:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.141+0000 7f38331e0740 1 --2- 172.21.15.2:0/2632608885 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b8491d0640 0x55b8491d2a30 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.141+0000 7f38331e0740 1 --2- 172.21.15.2:0/2632608885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491bffb0 0x55b8491bda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.141+0000 7f38331e0740 1 --2- 172.21.15.2:0/2632608885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491bd540 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.141+0000 7f38331e0740 1 --2- 172.21.15.2:0/2632608885 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491b5230 0x55b8491bd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.141+0000 7f380f400640 0 client.26173 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.141+0000 7f38331e0740 1 -- 172.21.15.2:0/2632608885 >> 172.21.15.2:0/2632608885 conn(0x55b84917dfb0 msgr2=0x55b8491b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.141+0000 7f38331e0740 1 -- 172.21.15.2:0/2632608885 shutdown_connections 2024-06-13T02:29:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.141+0000 7f38331e0740 1 -- 172.21.15.2:0/2632608885 wait complete. 2024-06-13T02:29:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.141+0000 7f38331e0740 20 client.26173 trim_cache size 0 max 16384 2024-06-13T02:29:31.161 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.160+0000 7f38331e0740 1 Processor -- start 2024-06-13T02:29:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.161+0000 7f38331e0740 1 -- start start 2024-06-13T02:29:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.161+0000 7f38331e0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 0x55b8491d8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.161+0000 7f38331e0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491b67a0 0x55b8491d8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.161+0000 7f38331e0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491bffb0 0x55b8491b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.161+0000 7f38331e0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f38281b3940 con 0x55b8491b67a0 2024-06-13T02:29:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.161+0000 7f38331e0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f38281b1210 con 0x55b8491b5230 2024-06-13T02:29:31.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.161+0000 7f38331e0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f38281af080 con 0x55b8491bffb0 2024-06-13T02:29:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.161+0000 7f382ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491b67a0 0x55b8491d8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.161+0000 7f382e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 0x55b8491d8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.161+0000 7f382ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491b67a0 0x55b8491d8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56242/0 (socket says 172.21.15.2:56242) 2024-06-13T02:29:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.161+0000 7f382ce00640 1 -- 172.21.15.2:0/2690199016 learned_addr learned my addr 172.21.15.2:0/2690199016 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.162+0000 7f382e200640 1 --2- 172.21.15.2:0/2690199016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491bffb0 0x55b8491b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.162+0000 7f382ce00640 1 -- 172.21.15.2:0/2690199016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491bffb0 msgr2=0x55b8491b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.162+0000 7f382ce00640 1 --2- 172.21.15.2:0/2690199016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491bffb0 0x55b8491b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.162+0000 7f382ce00640 1 -- 172.21.15.2:0/2690199016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 msgr2=0x55b8491d8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.162+0000 7f382ce00640 1 --2- 172.21.15.2:0/2690199016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 0x55b8491d8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.162+0000 7f382ce00640 1 -- 172.21.15.2:0/2690199016 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8491ad000 con 0x55b8491b67a0 2024-06-13T02:29:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.162+0000 7f382ce00640 1 --2- 172.21.15.2:0/2690199016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491b67a0 0x55b8491d8840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3814000c00 tx=0x7f3814004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0659aa99b92d4d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.163+0000 7f381a000640 1 -- 172.21.15.2:0/2690199016 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f381402b020 con 0x55b8491b67a0 2024-06-13T02:29:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.163+0000 7f381a000640 1 -- 172.21.15.2:0/2690199016 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3814011440 con 0x55b8491b67a0 2024-06-13T02:29:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.163+0000 7f381a000640 1 -- 172.21.15.2:0/2690199016 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3814004680 con 0x55b8491b67a0 2024-06-13T02:29:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.163+0000 7f38331e0740 1 -- 172.21.15.2:0/2690199016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491b67a0 msgr2=0x55b8491d8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.163+0000 7f38331e0740 1 --2- 172.21.15.2:0/2690199016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491b67a0 0x55b8491d8840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3814000c00 tx=0x7f3814004320 comp rx=0 tx=0).stop 2024-06-13T02:29:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.163+0000 7f38331e0740 1 -- 172.21.15.2:0/2690199016 shutdown_connections 2024-06-13T02:29:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.163+0000 7f38331e0740 1 --2- 172.21.15.2:0/2690199016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491bffb0 0x55b8491b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.163+0000 7f38331e0740 1 --2- 172.21.15.2:0/2690199016 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491b67a0 0x55b8491d8840 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.163+0000 7f38331e0740 1 --2- 172.21.15.2:0/2690199016 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 0x55b8491d8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.163+0000 7f38331e0740 1 -- 172.21.15.2:0/2690199016 >> 172.21.15.2:0/2690199016 conn(0x55b84917dfb0 msgr2=0x55b8491b8310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.164+0000 7f38331e0740 1 -- 172.21.15.2:0/2690199016 shutdown_connections 2024-06-13T02:29:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.164+0000 7f38331e0740 1 -- 172.21.15.2:0/2690199016 wait complete. 2024-06-13T02:29:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.164+0000 7f38331e0740 1 -- start start 2024-06-13T02:29:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.164+0000 7f38331e0740 1 Processor -- start 2024-06-13T02:29:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f38331e0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 0x55b8491c8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f38331e0740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f38331e0740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491bffb0 0x55b8491c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f38331e0740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f38281af6d0 con 0x55b8491bffb0 2024-06-13T02:29:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f38331e0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f38281b0b40 con 0x55b8491b5230 2024-06-13T02:29:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f38331e0740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f38281afda0 con 0x55b8491b67a0 2024-06-13T02:29:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f38331e0740 10 client.0 _ll_register_callbacks cb 0x7f3814004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:29:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f382e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 0x55b8491c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f382e200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 0x55b8491c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:55230/0 (socket says 172.21.15.2:55230) 2024-06-13T02:29:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f382e200640 1 -- 172.21.15.2:0/4169946832 learned_addr learned my addr 172.21.15.2:0/4169946832 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f382ce00640 1 --2- 172.21.15.2:0/4169946832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f382e200640 1 --2- 172.21.15.2:0/4169946832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491bffb0 0x55b8491c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f382e200640 1 -- 172.21.15.2:0/4169946832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 msgr2=0x55b8491c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f382e200640 1 --2- 172.21.15.2:0/4169946832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f382e200640 1 -- 172.21.15.2:0/4169946832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491bffb0 msgr2=0x55b8491c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f382e200640 1 --2- 172.21.15.2:0/4169946832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491bffb0 0x55b8491c38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.165+0000 7f382e200640 1 -- 172.21.15.2:0/4169946832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8491c40c0 con 0x55b8491b5230 2024-06-13T02:29:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.166+0000 7f382e200640 1 --2- 172.21.15.2:0/4169946832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 0x55b8491c8480 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3820006010 tx=0x7f3820009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8304e51d60d11c4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.166+0000 7f380f400640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:29:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.166+0000 7f380f400640 1 -- 172.21.15.2:0/4169946832 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820003c30 con 0x55b8491b5230 2024-06-13T02:29:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.166+0000 7f38331e0740 1 -- 172.21.15.2:0/4169946832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3814011440 con 0x55b8491b5230 2024-06-13T02:29:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.166+0000 7f380f400640 1 -- 172.21.15.2:0/4169946832 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 9583+0+0 (secure 0 0 0) 0x7f38200048f0 con 0x55b8491b5230 2024-06-13T02:29:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.166+0000 7f380f400640 1 -- 172.21.15.2:0/4169946832 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f382003d050 con 0x55b8491b5230 2024-06-13T02:29:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.166+0000 7f38331e0740 10 client.26192 fetch_fsmap learned FSMap version 35 2024-06-13T02:29:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.166+0000 7f38331e0740 1 -- 172.21.15.2:0/4169946832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b84923aeb0 con 0x55b8491b5230 2024-06-13T02:29:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.167+0000 7f380f400640 1 -- 172.21.15.2:0/4169946832 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3814011440 con 0x55b8491b5230 2024-06-13T02:29:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.167+0000 7f380f400640 1 -- 172.21.15.2:0/4169946832 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f38200055f0 con 0x55b8491b5230 2024-06-13T02:29:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.167+0000 7f38331e0740 10 client.26192 fetch_fsmap finished waiting for FSMap version 35 2024-06-13T02:29:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.167+0000 7f38331e0740 10 client.26192 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:29:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.167+0000 7f38331e0740 20 client.26192 populate_metadata read hostname 'smithi002' 2024-06-13T02:29:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.167+0000 7f38331e0740 1 --2- 172.21.15.2:0/4169946832 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b84923b3d0 0x55b84923d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.167+0000 7f38331e0740 4 client.26192 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:29:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.167+0000 7f38331e0740 1 -- 172.21.15.2:0/4169946832 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b849120ea0 con 0x55b84923b3d0 2024-06-13T02:29:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.167+0000 7f382ce00640 1 --2- 172.21.15.2:0/4169946832 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b84923b3d0 0x55b84923d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.168+0000 7f382ce00640 1 --2- 172.21.15.2:0/4169946832 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b84923b3d0 0x55b84923d7f0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c59a7a3b2b36e13c server_cookie=a802d02481559194 in_seq=0 out_seq=0 2024-06-13T02:29:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.168+0000 7f380f400640 10 client.26192 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:31.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:31 smithi002 ceph-mon[31960]: pgmap v368: 129 pgs: 129 active+clean; 93 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 193 op/s 2024-06-13T02:29:31.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:31 smithi084 ceph-mon[36833]: pgmap v368: 129 pgs: 129 active+clean; 93 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 193 op/s 2024-06-13T02:29:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.472+0000 7f380f400640 1 -- 172.21.15.2:0/4169946832 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55b849120ea0 con 0x55b84923b3d0 2024-06-13T02:29:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.472+0000 7f380f400640 10 client.26192 handle_command_reply: tid=0 2024-06-13T02:29:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.472+0000 7f38331e0740 1 client.26192 shutdown 2024-06-13T02:29:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.472+0000 7f38331e0740 1 -- 172.21.15.2:0/4169946832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 msgr2=0x55b8491c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.472+0000 7f38331e0740 1 --2- 172.21.15.2:0/4169946832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 0x55b8491c8480 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3820006010 tx=0x7f3820009500 comp rx=0 tx=0).stop 2024-06-13T02:29:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.472+0000 7f38331e0740 1 -- 172.21.15.2:0/4169946832 shutdown_connections 2024-06-13T02:29:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.472+0000 7f38331e0740 1 --2- 172.21.15.2:0/4169946832 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55b84923b3d0 0x55b84923d7f0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.472+0000 7f38331e0740 1 --2- 172.21.15.2:0/4169946832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55b8491bffb0 0x55b8491c38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.472+0000 7f38331e0740 1 --2- 172.21.15.2:0/4169946832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b8491b67a0 0x55b8491c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.472+0000 7f38331e0740 1 --2- 172.21.15.2:0/4169946832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b8491b5230 0x55b8491c8480 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.472+0000 7f38331e0740 1 -- 172.21.15.2:0/4169946832 >> 172.21.15.2:0/4169946832 conn(0x55b84917dfb0 msgr2=0x55b8491b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.472+0000 7f380f400640 0 client.26192 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.472+0000 7f38331e0740 1 -- 172.21.15.2:0/4169946832 shutdown_connections 2024-06-13T02:29:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.472+0000 7f38331e0740 1 -- 172.21.15.2:0/4169946832 wait complete. 2024-06-13T02:29:31.475 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.473+0000 7f38331e0740 20 client.26192 trim_cache size 0 max 16384 2024-06-13T02:29:31.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:29:31.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:29:31.476 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:29:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.474+0000 7f382ec00640 1 -- 172.21.15.2:0/4075018712 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f38100a2d60 msgr2=0x7f38100a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.474+0000 7f382ec00640 1 --2- 172.21.15.2:0/4075018712 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f38100a2d60 0x7f38100a5220 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f381c0ed300 tx=0x7f381c0f3a70 comp rx=0 tx=0).stop 2024-06-13T02:29:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.474+0000 7f382ec00640 1 -- 172.21.15.2:0/4075018712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38281017b0 msgr2=0x7f382819a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.474+0000 7f382ec00640 1 --2- 172.21.15.2:0/4075018712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38281017b0 0x7f382819a350 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f381c006010 tx=0x7f381c003c10 comp rx=0 tx=0).stop 2024-06-13T02:29:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.474+0000 7f382ec00640 1 -- 172.21.15.2:0/4075018712 shutdown_connections 2024-06-13T02:29:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.474+0000 7f382ec00640 1 --2- 172.21.15.2:0/4075018712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f38281077c0 0x7f382819eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.474+0000 7f382ec00640 1 --2- 172.21.15.2:0/4075018712 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f38100a2d60 0x7f38100a5220 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.477 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.474+0000 7f382ec00640 1 --2- 172.21.15.2:0/4075018712 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3828102170 0x7f382819a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.474+0000 7f382ec00640 1 --2- 172.21.15.2:0/4075018712 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38281017b0 0x7f382819a350 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.474+0000 7f382ec00640 1 -- 172.21.15.2:0/4075018712 >> 172.21.15.2:0/4075018712 conn(0x7f38280fd2e0 msgr2=0x7f382810cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.474+0000 7f382ec00640 1 -- 172.21.15.2:0/4075018712 shutdown_connections 2024-06-13T02:29:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:31.474+0000 7f382ec00640 1 -- 172.21.15.2:0/4075018712 wait complete. 2024-06-13T02:29:31.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:31 smithi175 ceph-mon[36977]: pgmap v368: 129 pgs: 129 active+clean; 93 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 193 op/s 2024-06-13T02:29:31.562 INFO:tasks.workunit.client.0.smithi002.stdout: 1 827602 6.86 MB/sec execute 515 sec latency 174.505 ms 2024-06-13T02:29:31.970 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:29:31 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: ignoring --setuser ceph since I am not root 2024-06-13T02:29:31.971 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:29:31 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: ignoring --setgroup ceph since I am not root 2024-06-13T02:29:31.971 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:29:31 smithi084 ceph-mds[66763]: -- 172.21.15.84:0/3801197435 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558a38319a40 con 0x558a382ecc00 2024-06-13T02:29:31.971 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:29:31 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: starting mds.h at 2024-06-13T02:29:32.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:32 smithi002 ceph-mon[31960]: daemon mds.h restarted 2024-06-13T02:29:32.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:32 smithi084 ceph-mon[36833]: daemon mds.h restarted 2024-06-13T02:29:32.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:32 smithi175 ceph-mon[36977]: daemon mds.h restarted 2024-06-13T02:29:32.562 INFO:tasks.workunit.client.0.smithi002.stdout: 1 828479 6.85 MB/sec execute 516 sec latency 30.616 ms 2024-06-13T02:29:33.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:33 smithi002 ceph-mon[31960]: pgmap v369: 129 pgs: 129 active+clean; 96 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 270 op/s 2024-06-13T02:29:33.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:33 smithi002 ceph-mon[31960]: osdmap e117: 12 total, 12 up, 12 in 2024-06-13T02:29:33.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:33 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.84:6836/1192425303,v1:172.21.15.84:6837/1192425303] up:boot 2024-06-13T02:29:33.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:33 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-06-13T02:29:33.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:33 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:29:33.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:33 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:29:33.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:33 smithi084 ceph-mon[36833]: pgmap v369: 129 pgs: 129 active+clean; 96 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 270 op/s 2024-06-13T02:29:33.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:33 smithi084 ceph-mon[36833]: osdmap e117: 12 total, 12 up, 12 in 2024-06-13T02:29:33.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:33 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.84:6836/1192425303,v1:172.21.15.84:6837/1192425303] up:boot 2024-06-13T02:29:33.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:33 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-06-13T02:29:33.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:33 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:29:33.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:33 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:29:33.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:33 smithi175 ceph-mon[36977]: pgmap v369: 129 pgs: 129 active+clean; 96 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 270 op/s 2024-06-13T02:29:33.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:33 smithi175 ceph-mon[36977]: osdmap e117: 12 total, 12 up, 12 in 2024-06-13T02:29:33.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:33 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.84:6836/1192425303,v1:172.21.15.84:6837/1192425303] up:boot 2024-06-13T02:29:33.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:33 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-06-13T02:29:33.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:33 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:29:33.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:33 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:29:33.562 INFO:tasks.workunit.client.0.smithi002.stdout: 1 830010 6.86 MB/sec execute 517 sec latency 27.930 ms 2024-06-13T02:29:34.562 INFO:tasks.workunit.client.0.smithi002.stdout: 1 831244 6.86 MB/sec execute 518 sec latency 22.838 ms 2024-06-13T02:29:35.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:35 smithi002 ceph-mon[31960]: pgmap v371: 129 pgs: 129 active+clean; 96 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 172 op/s 2024-06-13T02:29:35.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:35 smithi084 ceph-mon[36833]: pgmap v371: 129 pgs: 129 active+clean; 96 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 172 op/s 2024-06-13T02:29:35.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:35 smithi175 ceph-mon[36977]: pgmap v371: 129 pgs: 129 active+clean; 96 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 172 op/s 2024-06-13T02:29:35.562 INFO:tasks.workunit.client.0.smithi002.stdout: 1 832281 6.86 MB/sec execute 519 sec latency 20.190 ms 2024-06-13T02:29:36.563 INFO:tasks.workunit.client.0.smithi002.stdout: 1 834078 6.86 MB/sec execute 520 sec latency 22.901 ms 2024-06-13T02:29:37.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:37 smithi002 ceph-mon[31960]: pgmap v372: 129 pgs: 129 active+clean; 89 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 251 op/s 2024-06-13T02:29:37.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:37 smithi084 ceph-mon[36833]: pgmap v372: 129 pgs: 129 active+clean; 89 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 251 op/s 2024-06-13T02:29:37.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:37 smithi175 ceph-mon[36977]: pgmap v372: 129 pgs: 129 active+clean; 89 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 251 op/s 2024-06-13T02:29:37.562 INFO:tasks.workunit.client.0.smithi002.stdout: 1 834741 6.86 MB/sec execute 521 sec latency 51.619 ms 2024-06-13T02:29:38.563 INFO:tasks.workunit.client.0.smithi002.stdout: 1 835806 6.85 MB/sec execute 522 sec latency 29.268 ms 2024-06-13T02:29:39.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:39 smithi002 ceph-mon[31960]: pgmap v373: 129 pgs: 129 active+clean; 89 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 265 op/s 2024-06-13T02:29:39.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:39 smithi084 ceph-mon[36833]: pgmap v373: 129 pgs: 129 active+clean; 89 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 265 op/s 2024-06-13T02:29:39.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:39 smithi175 ceph-mon[36977]: pgmap v373: 129 pgs: 129 active+clean; 89 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 265 op/s 2024-06-13T02:29:39.563 INFO:tasks.workunit.client.0.smithi002.stdout: 1 837625 6.86 MB/sec execute 523 sec latency 22.078 ms 2024-06-13T02:29:40.563 INFO:tasks.workunit.client.0.smithi002.stdout: 1 838321 6.85 MB/sec execute 524 sec latency 31.408 ms 2024-06-13T02:29:41.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:41 smithi002 ceph-mon[31960]: pgmap v374: 129 pgs: 129 active+clean; 89 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 265 op/s 2024-06-13T02:29:41.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:41 smithi084 ceph-mon[36833]: pgmap v374: 129 pgs: 129 active+clean; 89 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 265 op/s 2024-06-13T02:29:41.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:41 smithi175 ceph-mon[36977]: pgmap v374: 129 pgs: 129 active+clean; 89 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 265 op/s 2024-06-13T02:29:41.563 INFO:tasks.workunit.client.0.smithi002.stdout: 1 839426 6.85 MB/sec execute 525 sec latency 30.506 ms 2024-06-13T02:29:42.563 INFO:tasks.workunit.client.0.smithi002.stdout: 1 840795 6.85 MB/sec execute 526 sec latency 95.596 ms 2024-06-13T02:29:43.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:43 smithi002 ceph-mon[31960]: pgmap v375: 129 pgs: 129 active+clean; 93 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 240 op/s 2024-06-13T02:29:43.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:43 smithi084 ceph-mon[36833]: pgmap v375: 129 pgs: 129 active+clean; 93 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 240 op/s 2024-06-13T02:29:43.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:43 smithi175 ceph-mon[36977]: pgmap v375: 129 pgs: 129 active+clean; 93 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 240 op/s 2024-06-13T02:29:43.563 INFO:tasks.workunit.client.0.smithi002.stdout: 1 841743 6.85 MB/sec execute 527 sec latency 49.196 ms 2024-06-13T02:29:44.563 INFO:tasks.workunit.client.0.smithi002.stdout: 1 842627 6.84 MB/sec execute 528 sec latency 21.161 ms 2024-06-13T02:29:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.624+0000 7f09a3600640 1 -- 172.21.15.2:0/3107172786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c108f00 msgr2=0x7f099c110ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.624+0000 7f09a3600640 1 --2- 172.21.15.2:0/3107172786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c108f00 0x7f099c110ad0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0994009ca0 tx=0x7f099402a8b0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.624+0000 7f09a3600640 1 -- 172.21.15.2:0/3107172786 shutdown_connections 2024-06-13T02:29:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.624+0000 7f09a3600640 1 --2- 172.21.15.2:0/3107172786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c108f00 0x7f099c110ad0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.624+0000 7f09a3600640 1 --2- 172.21.15.2:0/3107172786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f099c1047e0 0x7f099c108820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.624+0000 7f09a3600640 1 --2- 172.21.15.2:0/3107172786 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c103e30 0x7f099c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.624+0000 7f09a3600640 1 -- 172.21.15.2:0/3107172786 >> 172.21.15.2:0/3107172786 conn(0x7f099c0ff650 msgr2=0x7f099c101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.624+0000 7f09a3600640 1 -- 172.21.15.2:0/3107172786 shutdown_connections 2024-06-13T02:29:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.624+0000 7f09a3600640 1 -- 172.21.15.2:0/3107172786 wait complete. 2024-06-13T02:29:44.627 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.625+0000 7f09a3600640 1 Processor -- start 2024-06-13T02:29:44.627 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.625+0000 7f09a3600640 1 -- start start 2024-06-13T02:29:44.627 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.625+0000 7f09a3600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c103e30 0x7f099c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.627 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.625+0000 7f09a3600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f099c108f00 0x7f099c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.627 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.625+0000 7f09a3600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c19ed40 0x7f099c19f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.626+0000 7f09a3600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f099c114000 con 0x7f099c19ed40 2024-06-13T02:29:44.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.626+0000 7f09a3600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f099c113e80 con 0x7f099c103e30 2024-06-13T02:29:44.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.626+0000 7f09a3600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f099c114180 con 0x7f099c108f00 2024-06-13T02:29:44.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.626+0000 7f09a0c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c103e30 0x7f099c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.626+0000 7f099be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f099c108f00 0x7f099c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.626+0000 7f09a0c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c103e30 0x7f099c19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:35304/0 (socket says 172.21.15.2:35304) 2024-06-13T02:29:44.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.626+0000 7f09a0c00640 1 -- 172.21.15.2:0/2236147173 learned_addr learned my addr 172.21.15.2:0/2236147173 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:44.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.626+0000 7f09a1600640 1 --2- 172.21.15.2:0/2236147173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c19ed40 0x7f099c19f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.626+0000 7f09a0c00640 1 -- 172.21.15.2:0/2236147173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f099c108f00 msgr2=0x7f099c19a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:44.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.626+0000 7f09a0c00640 1 --2- 172.21.15.2:0/2236147173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f099c108f00 0x7f099c19a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.626+0000 7f09a0c00640 1 -- 172.21.15.2:0/2236147173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c19ed40 msgr2=0x7f099c19f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:44.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.626+0000 7f09a0c00640 1 --2- 172.21.15.2:0/2236147173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c19ed40 0x7f099c19f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.626+0000 7f09a0c00640 1 -- 172.21.15.2:0/2236147173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c19f830 con 0x7f099c103e30 2024-06-13T02:29:44.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.626+0000 7f099be00640 1 --2- 172.21.15.2:0/2236147173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f099c108f00 0x7f099c19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:29:44.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.627+0000 7f09a0c00640 1 --2- 172.21.15.2:0/2236147173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c103e30 0x7f099c19a480 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f099000d950 tx=0x7f099000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:44.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.627+0000 7f0999600640 1 -- 172.21.15.2:0/2236147173 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0990017030 con 0x7f099c103e30 2024-06-13T02:29:44.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.627+0000 7f0999600640 1 -- 172.21.15.2:0/2236147173 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0990004020 con 0x7f099c103e30 2024-06-13T02:29:44.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.627+0000 7f09a3600640 1 -- 172.21.15.2:0/2236147173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099c19fb20 con 0x7f099c103e30 2024-06-13T02:29:44.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.627+0000 7f0999600640 1 -- 172.21.15.2:0/2236147173 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09900047a0 con 0x7f099c103e30 2024-06-13T02:29:44.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.627+0000 7f09a3600640 1 -- 172.21.15.2:0/2236147173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f099c1a7280 con 0x7f099c103e30 2024-06-13T02:29:44.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.631+0000 7f0999600640 1 -- 172.21.15.2:0/2236147173 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f09900041d0 con 0x7f099c103e30 2024-06-13T02:29:44.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.631+0000 7f09a6412740 1 Processor -- start 2024-06-13T02:29:44.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.632+0000 7f09a6412740 1 -- start start 2024-06-13T02:29:44.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.632+0000 7f09a6412740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac53db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.632+0000 7f09a6412740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac53e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.632+0000 7f09a6412740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 0x5649ac54b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.632+0000 7f09a6412740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5649ac4a2420 con 0x5649ac53e070 2024-06-13T02:29:44.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.632+0000 7f09a6412740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5649ac449c50 con 0x5649ac548df0 2024-06-13T02:29:44.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.632+0000 7f09a6412740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5649ac49e3e0 con 0x5649ac53f5e0 2024-06-13T02:29:44.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.632+0000 7f09a1600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac53db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.632+0000 7f09a0c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac53e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.634 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.632+0000 7f09a1600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac53db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:59574/0 (socket says 172.21.15.2:59574) 2024-06-13T02:29:44.635 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.632+0000 7f09a1600640 1 -- 172.21.15.2:0/3237432669 learned_addr learned my addr 172.21.15.2:0/3237432669 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:44.635 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.632+0000 7f099be00640 1 --2- 172.21.15.2:0/3237432669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 0x5649ac54b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.635 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.633+0000 7f09a1600640 1 -- 172.21.15.2:0/3237432669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 msgr2=0x5649ac54b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:44.635 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.633+0000 7f09a1600640 1 --2- 172.21.15.2:0/3237432669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 0x5649ac54b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.635 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.633+0000 7f09a1600640 1 -- 172.21.15.2:0/3237432669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 msgr2=0x5649ac53e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:44.635 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.633+0000 7f09a1600640 1 --2- 172.21.15.2:0/3237432669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac53e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.635 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.633+0000 7f09a1600640 1 -- 172.21.15.2:0/3237432669 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649ac1b6210 con 0x5649ac53f5e0 2024-06-13T02:29:44.635 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.633+0000 7f09a1600640 1 --2- 172.21.15.2:0/3237432669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac53db30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0994035000 tx=0x7f0994030450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8afd31513d6f0e86 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:44.635 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.633+0000 7f0999600640 1 --2- 172.21.15.2:0/2236147173 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f09840a2cf0 0x7f09840a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.633+0000 7f0999600640 1 -- 172.21.15.2:0/2236147173 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9495+0+0 (secure 0 0 0) 0x7f09900cf150 con 0x7f099c103e30 2024-06-13T02:29:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.633+0000 7f098dc00640 1 -- 172.21.15.2:0/3237432669 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994003970 con 0x5649ac53f5e0 2024-06-13T02:29:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.634+0000 7f09a0c00640 1 --2- 172.21.15.2:0/2236147173 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f09840a2cf0 0x7f09840a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.634+0000 7f098dc00640 1 -- 172.21.15.2:0/3237432669 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0994036070 con 0x5649ac53f5e0 2024-06-13T02:29:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.634+0000 7f098dc00640 1 -- 172.21.15.2:0/3237432669 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994004420 con 0x5649ac53f5e0 2024-06-13T02:29:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.634+0000 7f09a6412740 1 -- 172.21.15.2:0/3237432669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 msgr2=0x5649ac53db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.634+0000 7f09a6412740 1 --2- 172.21.15.2:0/3237432669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac53db30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0994035000 tx=0x7f0994030450 comp rx=0 tx=0).stop 2024-06-13T02:29:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.634+0000 7f09a0c00640 1 --2- 172.21.15.2:0/2236147173 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f09840a2cf0 0x7f09840a51b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f09900cc580 tx=0x7f09900d2ca0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.634+0000 7f09a6412740 1 -- 172.21.15.2:0/3237432669 shutdown_connections 2024-06-13T02:29:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.634+0000 7f09a6412740 1 --2- 172.21.15.2:0/3237432669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 0x5649ac54b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.634+0000 7f09a6412740 1 --2- 172.21.15.2:0/3237432669 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac53e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.634+0000 7f09a6412740 1 --2- 172.21.15.2:0/3237432669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac53db30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.634+0000 7f09a6412740 1 -- 172.21.15.2:0/3237432669 >> 172.21.15.2:0/3237432669 conn(0x5649ac506fb0 msgr2=0x5649ac53a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.635+0000 7f09a6412740 1 -- 172.21.15.2:0/3237432669 shutdown_connections 2024-06-13T02:29:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.635+0000 7f09a6412740 1 -- 172.21.15.2:0/3237432669 wait complete. 2024-06-13T02:29:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.635+0000 7f09a6412740 1 -- start start 2024-06-13T02:29:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.635+0000 7f09a6412740 1 Processor -- start 2024-06-13T02:29:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.636+0000 7f09a6412740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac545e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.636+0000 7f09a6412740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac5463a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.636+0000 7f09a6412740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 0x5649ac5468e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.636+0000 7f09a6412740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5649ac54bb60 con 0x5649ac53e070 2024-06-13T02:29:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.636+0000 7f09a6412740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5649ac45d0b0 con 0x5649ac548df0 2024-06-13T02:29:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.636+0000 7f09a6412740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5649ac54bce0 con 0x5649ac53f5e0 2024-06-13T02:29:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.636+0000 7f09a6412740 10 client.0 _ll_register_callbacks cb 0x5649ac448f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:29:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.636+0000 7f099be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac5463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.636+0000 7f099be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac5463a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:59590/0 (socket says 172.21.15.2:59590) 2024-06-13T02:29:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.636+0000 7f099be00640 1 -- 172.21.15.2:0/1310805826 learned_addr learned my addr 172.21.15.2:0/1310805826 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.636+0000 7f09a1600640 1 --2- 172.21.15.2:0/1310805826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac545e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.636+0000 7f09a1600640 1 --2- 172.21.15.2:0/1310805826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 0x5649ac5468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.637+0000 7f099be00640 1 -- 172.21.15.2:0/1310805826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 msgr2=0x5649ac5468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.637+0000 7f099be00640 1 --2- 172.21.15.2:0/1310805826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 0x5649ac5468e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.637+0000 7f099be00640 1 -- 172.21.15.2:0/1310805826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 msgr2=0x5649ac545e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.637+0000 7f099be00640 1 --2- 172.21.15.2:0/1310805826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac545e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.637+0000 7f099be00640 1 -- 172.21.15.2:0/1310805826 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649ac282620 con 0x5649ac53f5e0 2024-06-13T02:29:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.637+0000 7f09a1600640 1 --2- 172.21.15.2:0/1310805826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 0x5649ac5468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:29:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.637+0000 7f099be00640 1 --2- 172.21.15.2:0/1310805826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac5463a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0988012d20 tx=0x7f098800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ddbbd68d37344b2 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:44.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.637+0000 7f0982000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:29:44.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.637+0000 7f0982000640 1 -- 172.21.15.2:0/1310805826 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0988012110 con 0x5649ac53f5e0 2024-06-13T02:29:44.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.637+0000 7f0982000640 1 -- 172.21.15.2:0/1310805826 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9495+0+0 (secure 0 0 0) 0x7f0988004050 con 0x5649ac53f5e0 2024-06-13T02:29:44.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.637+0000 7f09a6412740 1 -- 172.21.15.2:0/1310805826 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0994036070 con 0x5649ac53f5e0 2024-06-13T02:29:44.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.637+0000 7f0982000640 1 -- 172.21.15.2:0/1310805826 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f09880122b0 con 0x5649ac53f5e0 2024-06-13T02:29:44.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.638+0000 7f09a6412740 10 client.26197 fetch_fsmap learned FSMap version 37 2024-06-13T02:29:44.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.638+0000 7f09a6412740 1 -- 172.21.15.2:0/1310805826 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5649ac557f80 con 0x5649ac53f5e0 2024-06-13T02:29:44.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.638+0000 7f0982000640 1 -- 172.21.15.2:0/1310805826 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0994036070 con 0x5649ac53f5e0 2024-06-13T02:29:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.638+0000 7f0982000640 1 -- 172.21.15.2:0/1310805826 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 37) ==== 8346+0+0 (secure 0 0 0) 0x7f0988010430 con 0x5649ac53f5e0 2024-06-13T02:29:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.638+0000 7f09a6412740 10 client.26197 fetch_fsmap finished waiting for FSMap version 37 2024-06-13T02:29:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.638+0000 7f09a6412740 10 client.26197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:29:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.638+0000 7f09a6412740 20 client.26197 populate_metadata read hostname 'smithi002' 2024-06-13T02:29:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.638+0000 7f09a6412740 1 --2- 172.21.15.2:0/1310805826 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ac5593f0 0x5649ac55b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.638+0000 7f09a6412740 4 client.26197 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:29:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.638+0000 7f09a6412740 1 -- 172.21.15.2:0/1310805826 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649ac4afb50 con 0x5649ac5593f0 2024-06-13T02:29:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.639+0000 7f09a1600640 1 --2- 172.21.15.2:0/1310805826 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ac5593f0 0x5649ac55b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.639+0000 7f09a1600640 1 --2- 172.21.15.2:0/1310805826 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ac5593f0 0x5649ac55b7e0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a306d4cb9ee09b7 server_cookie=ca245b5389418079 in_seq=0 out_seq=0 2024-06-13T02:29:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.639+0000 7f0982000640 10 client.26197 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.640+0000 7f0982000640 1 -- 172.21.15.2:0/1310805826 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5649ac4afb50 con 0x5649ac5593f0 2024-06-13T02:29:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.640+0000 7f0982000640 10 client.26197 handle_command_reply: tid=0 2024-06-13T02:29:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.640+0000 7f09a6412740 1 client.26197 shutdown 2024-06-13T02:29:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.640+0000 7f09a6412740 1 -- 172.21.15.2:0/1310805826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 msgr2=0x5649ac5463a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.640+0000 7f09a6412740 1 --2- 172.21.15.2:0/1310805826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac5463a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0988012d20 tx=0x7f098800f790 comp rx=0 tx=0).stop 2024-06-13T02:29:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.640+0000 7f09a6412740 1 -- 172.21.15.2:0/1310805826 shutdown_connections 2024-06-13T02:29:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.640+0000 7f09a6412740 1 --2- 172.21.15.2:0/1310805826 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ac5593f0 0x5649ac55b7e0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.640+0000 7f09a6412740 1 --2- 172.21.15.2:0/1310805826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 0x5649ac5468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.640+0000 7f09a6412740 1 --2- 172.21.15.2:0/1310805826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac5463a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.640+0000 7f09a6412740 1 --2- 172.21.15.2:0/1310805826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac545e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.640+0000 7f09a6412740 1 -- 172.21.15.2:0/1310805826 >> 172.21.15.2:0/1310805826 conn(0x5649ac506fb0 msgr2=0x5649ac5404d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.640+0000 7f0982000640 0 client.26197 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.640+0000 7f09a6412740 1 -- 172.21.15.2:0/1310805826 shutdown_connections 2024-06-13T02:29:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.640+0000 7f09a6412740 1 -- 172.21.15.2:0/1310805826 wait complete. 2024-06-13T02:29:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.641+0000 7f09a6412740 20 client.26197 trim_cache size 0 max 16384 2024-06-13T02:29:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.659+0000 7f09a6412740 1 Processor -- start 2024-06-13T02:29:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.659+0000 7f09a6412740 1 -- start start 2024-06-13T02:29:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f09a6412740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac5396c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f09a6412740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac53f5e0 0x5649ac5610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f09a6412740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac548df0 0x5649ac561630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f09a6412740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1b3a80 con 0x5649ac53e070 2024-06-13T02:29:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f09a6412740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1b1350 con 0x5649ac53f5e0 2024-06-13T02:29:44.661 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f09a6412740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1af1a0 con 0x5649ac548df0 2024-06-13T02:29:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f099be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac53f5e0 0x5649ac5610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f099be00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac53f5e0 0x5649ac5610f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:35334/0 (socket says 172.21.15.2:35334) 2024-06-13T02:29:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f099be00640 1 -- 172.21.15.2:0/3676127045 learned_addr learned my addr 172.21.15.2:0/3676127045 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f09a1600640 1 --2- 172.21.15.2:0/3676127045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac5396c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f099be00640 1 -- 172.21.15.2:0/3676127045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac548df0 msgr2=0x5649ac561630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f09a1600640 1 --2- 172.21.15.2:0/3676127045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac548df0 0x5649ac561630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f099be00640 1 --2- 172.21.15.2:0/3676127045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac548df0 0x5649ac561630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f099be00640 1 -- 172.21.15.2:0/3676127045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 msgr2=0x5649ac5396c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f099be00640 1 --2- 172.21.15.2:0/3676127045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac5396c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f099be00640 1 -- 172.21.15.2:0/3676127045 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649ac555aa0 con 0x5649ac53f5e0 2024-06-13T02:29:44.662 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.660+0000 7f09a1600640 1 --2- 172.21.15.2:0/3676127045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac548df0 0x5649ac561630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:29:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.661+0000 7f099be00640 1 --2- 172.21.15.2:0/3676127045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac53f5e0 0x5649ac5610f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0988010a40 tx=0x7f098800fd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=410d55d520c817e5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.661+0000 7f098d200640 1 -- 172.21.15.2:0/3676127045 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0988000e60 con 0x5649ac53f5e0 2024-06-13T02:29:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.661+0000 7f098d200640 1 -- 172.21.15.2:0/3676127045 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0988005590 con 0x5649ac53f5e0 2024-06-13T02:29:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.661+0000 7f098d200640 1 -- 172.21.15.2:0/3676127045 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09880035f0 con 0x5649ac53f5e0 2024-06-13T02:29:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.662+0000 7f09a6412740 1 -- 172.21.15.2:0/3676127045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac53f5e0 msgr2=0x5649ac5610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.662+0000 7f09a6412740 1 --2- 172.21.15.2:0/3676127045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac53f5e0 0x5649ac5610f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0988010a40 tx=0x7f098800fd10 comp rx=0 tx=0).stop 2024-06-13T02:29:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.662+0000 7f09a6412740 1 -- 172.21.15.2:0/3676127045 shutdown_connections 2024-06-13T02:29:44.665 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.662+0000 7f09a6412740 1 --2- 172.21.15.2:0/3676127045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac548df0 0x5649ac561630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.662+0000 7f09a6412740 1 --2- 172.21.15.2:0/3676127045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac53f5e0 0x5649ac5610f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.662+0000 7f09a6412740 1 --2- 172.21.15.2:0/3676127045 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac5396c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.662+0000 7f09a6412740 1 -- 172.21.15.2:0/3676127045 >> 172.21.15.2:0/3676127045 conn(0x5649ac506fb0 msgr2=0x5649ac538fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.662+0000 7f09a6412740 1 -- 172.21.15.2:0/3676127045 shutdown_connections 2024-06-13T02:29:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.662+0000 7f09a6412740 1 -- 172.21.15.2:0/3676127045 wait complete. 2024-06-13T02:29:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.662+0000 7f09a6412740 1 -- start start 2024-06-13T02:29:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.663+0000 7f09a6412740 1 Processor -- start 2024-06-13T02:29:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.663+0000 7f09a6412740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac54c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.663+0000 7f09a6412740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac54ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.663+0000 7f09a6412740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 0x5649ac5c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.663+0000 7f09a6412740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1af810 con 0x5649ac53e070 2024-06-13T02:29:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.663+0000 7f09a6412740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1b0c80 con 0x5649ac548df0 2024-06-13T02:29:44.666 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.663+0000 7f09a6412740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f099c1afee0 con 0x5649ac53f5e0 2024-06-13T02:29:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.663+0000 7f09a6412740 10 client.0 _ll_register_callbacks cb 0x7f0988009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:29:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.663+0000 7f099be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac54ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.663+0000 7f09a1600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac54c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.663+0000 7f099be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac54ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:59604/0 (socket says 172.21.15.2:59604) 2024-06-13T02:29:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.663+0000 7f099be00640 1 -- 172.21.15.2:0/610853 learned_addr learned my addr 172.21.15.2:0/610853 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.664+0000 7f09a1600640 1 --2- 172.21.15.2:0/610853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 0x5649ac5c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.664+0000 7f099be00640 1 -- 172.21.15.2:0/610853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 msgr2=0x5649ac5c20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.664+0000 7f099be00640 1 --2- 172.21.15.2:0/610853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 0x5649ac5c20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.664+0000 7f099be00640 1 -- 172.21.15.2:0/610853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 msgr2=0x5649ac54c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.664+0000 7f099be00640 1 --2- 172.21.15.2:0/610853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac54c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.664+0000 7f099be00640 1 -- 172.21.15.2:0/610853 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649ac5c25f0 con 0x5649ac53f5e0 2024-06-13T02:29:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.664+0000 7f099be00640 1 --2- 172.21.15.2:0/610853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac54ca90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f098800ffe0 tx=0x7f09880296b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32bc16ecea1a9ed9 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.664+0000 7f0982000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:29:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.665+0000 7f0982000640 1 -- 172.21.15.2:0/610853 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09880052f0 con 0x5649ac53f5e0 2024-06-13T02:29:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.665+0000 7f0982000640 1 -- 172.21.15.2:0/610853 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9495+0+0 (secure 0 0 0) 0x7f0988029820 con 0x5649ac53f5e0 2024-06-13T02:29:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.665+0000 7f09a6412740 1 -- 172.21.15.2:0/610853 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0988005590 con 0x5649ac53f5e0 2024-06-13T02:29:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.665+0000 7f0982000640 1 -- 172.21.15.2:0/610853 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0988029a20 con 0x5649ac53f5e0 2024-06-13T02:29:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.665+0000 7f09a6412740 10 client.26200 fetch_fsmap learned FSMap version 37 2024-06-13T02:29:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.665+0000 7f09a6412740 1 -- 172.21.15.2:0/610853 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5649ac5c3840 con 0x5649ac53f5e0 2024-06-13T02:29:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.665+0000 7f0982000640 1 -- 172.21.15.2:0/610853 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0988005590 con 0x5649ac53f5e0 2024-06-13T02:29:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.665+0000 7f0982000640 1 -- 172.21.15.2:0/610853 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 37) ==== 8346+0+0 (secure 0 0 0) 0x7f098801c420 con 0x5649ac53f5e0 2024-06-13T02:29:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.665+0000 7f09a6412740 10 client.26200 fetch_fsmap finished waiting for FSMap version 37 2024-06-13T02:29:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.665+0000 7f09a6412740 10 client.26200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:29:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.665+0000 7f09a6412740 20 client.26200 populate_metadata read hostname 'smithi002' 2024-06-13T02:29:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.665+0000 7f09a6412740 1 --2- 172.21.15.2:0/610853 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ac5c3f70 0x5649ac5c6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.666+0000 7f09a6412740 4 client.26200 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:29:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.666+0000 7f09a6412740 1 -- 172.21.15.2:0/610853 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5649ac4a9ea0 con 0x5649ac5c3f70 2024-06-13T02:29:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.666+0000 7f09a1600640 1 --2- 172.21.15.2:0/610853 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ac5c3f70 0x5649ac5c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.666+0000 7f09a1600640 1 --2- 172.21.15.2:0/610853 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ac5c3f70 0x5649ac5c6390 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0f219b90928e3c3 server_cookie=1b31b9794e49272b in_seq=0 out_seq=0 2024-06-13T02:29:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.666+0000 7f0982000640 10 client.26200 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.926+0000 7f0982000640 1 -- 172.21.15.2:0/610853 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5649ac4a9ea0 con 0x5649ac5c3f70 2024-06-13T02:29:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.926+0000 7f0982000640 10 client.26200 handle_command_reply: tid=0 2024-06-13T02:29:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.927+0000 7f09a6412740 1 client.26200 shutdown 2024-06-13T02:29:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.927+0000 7f09a6412740 1 -- 172.21.15.2:0/610853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 msgr2=0x5649ac54ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:44.928 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.927+0000 7f09a6412740 1 --2- 172.21.15.2:0/610853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac54ca90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f098800ffe0 tx=0x7f09880296b0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.927+0000 7f09a6412740 1 -- 172.21.15.2:0/610853 shutdown_connections 2024-06-13T02:29:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.927+0000 7f09a6412740 1 --2- 172.21.15.2:0/610853 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x5649ac5c3f70 0x5649ac5c6390 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.927+0000 7f09a6412740 1 --2- 172.21.15.2:0/610853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5649ac548df0 0x5649ac5c20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.927+0000 7f09a6412740 1 --2- 172.21.15.2:0/610853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5649ac53f5e0 0x5649ac54ca90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.927+0000 7f09a6412740 1 --2- 172.21.15.2:0/610853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5649ac53e070 0x5649ac54c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.927+0000 7f0982000640 0 client.26200 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.927+0000 7f09a6412740 1 -- 172.21.15.2:0/610853 >> 172.21.15.2:0/610853 conn(0x5649ac506fb0 msgr2=0x5649ac5466b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.927+0000 7f09a6412740 1 -- 172.21.15.2:0/610853 shutdown_connections 2024-06-13T02:29:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.927+0000 7f09a6412740 1 -- 172.21.15.2:0/610853 wait complete. 2024-06-13T02:29:44.929 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.927+0000 7f09a6412740 20 client.26200 trim_cache size 0 max 16384 2024-06-13T02:29:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:29:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:29:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:29:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.928+0000 7f09a3600640 1 -- 172.21.15.2:0/2236147173 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f09840a2cf0 msgr2=0x7f09840a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.928+0000 7f09a3600640 1 --2- 172.21.15.2:0/2236147173 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f09840a2cf0 0x7f09840a51b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f09900cc580 tx=0x7f09900d2ca0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.930 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.928+0000 7f09a3600640 1 -- 172.21.15.2:0/2236147173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c103e30 msgr2=0x7f099c19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.928+0000 7f09a3600640 1 --2- 172.21.15.2:0/2236147173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c103e30 0x7f099c19a480 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f099000d950 tx=0x7f099000de10 comp rx=0 tx=0).stop 2024-06-13T02:29:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.928+0000 7f09a3600640 1 -- 172.21.15.2:0/2236147173 shutdown_connections 2024-06-13T02:29:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.928+0000 7f09a3600640 1 --2- 172.21.15.2:0/2236147173 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f09840a2cf0 0x7f09840a51b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.928+0000 7f09a3600640 1 --2- 172.21.15.2:0/2236147173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f099c19ed40 0x7f099c19f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.928+0000 7f09a3600640 1 --2- 172.21.15.2:0/2236147173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f099c108f00 0x7f099c19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.928+0000 7f09a3600640 1 --2- 172.21.15.2:0/2236147173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f099c103e30 0x7f099c19a480 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.928+0000 7f09a3600640 1 -- 172.21.15.2:0/2236147173 >> 172.21.15.2:0/2236147173 conn(0x7f099c0ff650 msgr2=0x7f099c101910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.928+0000 7f09a3600640 1 -- 172.21.15.2:0/2236147173 shutdown_connections 2024-06-13T02:29:44.931 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:44.928+0000 7f09a3600640 1 -- 172.21.15.2:0/2236147173 wait complete. 2024-06-13T02:29:45.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:45 smithi002 ceph-mon[31960]: pgmap v376: 129 pgs: 129 active+clean; 93 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 1.3 MiB/s wr, 202 op/s 2024-06-13T02:29:45.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:45 smithi084 ceph-mon[36833]: pgmap v376: 129 pgs: 129 active+clean; 93 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 1.3 MiB/s wr, 202 op/s 2024-06-13T02:29:45.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:45 smithi175 ceph-mon[36977]: pgmap v376: 129 pgs: 129 active+clean; 93 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 1.3 MiB/s wr, 202 op/s 2024-06-13T02:29:45.564 INFO:tasks.workunit.client.0.smithi002.stdout: 1 843656 6.84 MB/sec execute 529 sec latency 70.334 ms 2024-06-13T02:29:46.564 INFO:tasks.workunit.client.0.smithi002.stdout: 1 845027 6.84 MB/sec execute 530 sec latency 23.484 ms 2024-06-13T02:29:47.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:47 smithi002 ceph-mon[31960]: pgmap v377: 129 pgs: 129 active+clean; 89 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 303 op/s 2024-06-13T02:29:47.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:47 smithi084 ceph-mon[36833]: pgmap v377: 129 pgs: 129 active+clean; 89 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 303 op/s 2024-06-13T02:29:47.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:47 smithi175 ceph-mon[36977]: pgmap v377: 129 pgs: 129 active+clean; 89 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 303 op/s 2024-06-13T02:29:47.564 INFO:tasks.workunit.client.0.smithi002.stdout: 1 845557 6.84 MB/sec execute 531 sec latency 32.871 ms 2024-06-13T02:29:48.564 INFO:tasks.workunit.client.0.smithi002.stdout: 1 846455 6.83 MB/sec execute 532 sec latency 123.169 ms 2024-06-13T02:29:49.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:49 smithi084 ceph-mon[36833]: pgmap v378: 129 pgs: 129 active+clean; 89 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 216 op/s 2024-06-13T02:29:49.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:49 smithi175 ceph-mon[36977]: pgmap v378: 129 pgs: 129 active+clean; 89 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 216 op/s 2024-06-13T02:29:49.564 INFO:tasks.workunit.client.0.smithi002.stdout: 1 847778 6.83 MB/sec execute 533 sec latency 187.873 ms 2024-06-13T02:29:49.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:49 smithi002 ceph-mon[31960]: pgmap v378: 129 pgs: 129 active+clean; 89 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 216 op/s 2024-06-13T02:29:50.565 INFO:tasks.workunit.client.0.smithi002.stdout: 1 848722 6.83 MB/sec execute 534 sec latency 35.757 ms 2024-06-13T02:29:51.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:51 smithi084 ceph-mon[36833]: pgmap v379: 129 pgs: 129 active+clean; 89 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 192 op/s 2024-06-13T02:29:51.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:51 smithi175 ceph-mon[36977]: pgmap v379: 129 pgs: 129 active+clean; 89 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 192 op/s 2024-06-13T02:29:51.565 INFO:tasks.workunit.client.0.smithi002.stdout: 1 849543 6.82 MB/sec execute 535 sec latency 38.108 ms 2024-06-13T02:29:51.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:51 smithi002 ceph-mon[31960]: pgmap v379: 129 pgs: 129 active+clean; 89 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 192 op/s 2024-06-13T02:29:52.565 INFO:tasks.workunit.client.0.smithi002.stdout: 1 850705 6.82 MB/sec execute 536 sec latency 71.958 ms 2024-06-13T02:29:53.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:53 smithi084 ceph-mon[36833]: pgmap v380: 129 pgs: 129 active+clean; 92 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 256 op/s 2024-06-13T02:29:53.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:53 smithi175 ceph-mon[36977]: pgmap v380: 129 pgs: 129 active+clean; 92 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 256 op/s 2024-06-13T02:29:53.565 INFO:tasks.workunit.client.0.smithi002.stdout: 1 852225 6.83 MB/sec execute 537 sec latency 28.450 ms 2024-06-13T02:29:53.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:53 smithi002 ceph-mon[31960]: pgmap v380: 129 pgs: 129 active+clean; 92 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 256 op/s 2024-06-13T02:29:54.565 INFO:tasks.workunit.client.0.smithi002.stdout: 1 852913 6.82 MB/sec execute 538 sec latency 30.815 ms 2024-06-13T02:29:55.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:55 smithi084 ceph-mon[36833]: pgmap v381: 129 pgs: 129 active+clean; 92 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 200 op/s 2024-06-13T02:29:55.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:55 smithi175 ceph-mon[36977]: pgmap v381: 129 pgs: 129 active+clean; 92 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 200 op/s 2024-06-13T02:29:55.565 INFO:tasks.workunit.client.0.smithi002.stdout: 1 853937 6.81 MB/sec execute 539 sec latency 35.866 ms 2024-06-13T02:29:55.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:55 smithi002 ceph-mon[31960]: pgmap v381: 129 pgs: 129 active+clean; 92 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 200 op/s 2024-06-13T02:29:56.566 INFO:tasks.workunit.client.0.smithi002.stdout: 1 855637 6.82 MB/sec execute 540 sec latency 25.548 ms 2024-06-13T02:29:57.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:57 smithi084 ceph-mon[36833]: pgmap v382: 129 pgs: 129 active+clean; 94 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 245 op/s 2024-06-13T02:29:57.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:57 smithi175 ceph-mon[36977]: pgmap v382: 129 pgs: 129 active+clean; 94 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 245 op/s 2024-06-13T02:29:57.565 INFO:tasks.workunit.client.0.smithi002.stdout: 1 856315 6.81 MB/sec execute 541 sec latency 65.074 ms 2024-06-13T02:29:57.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:57 smithi002 ceph-mon[31960]: pgmap v382: 129 pgs: 129 active+clean; 94 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 245 op/s 2024-06-13T02:29:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.100+0000 7fc95ac00640 1 -- 172.21.15.2:0/3369489723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc954100750 msgr2=0x7fc95410de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.100+0000 7fc95ac00640 1 --2- 172.21.15.2:0/3369489723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc954100750 0x7fc95410de30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc944009900 tx=0x7fc94402a4a0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.100+0000 7fc95ac00640 1 -- 172.21.15.2:0/3369489723 shutdown_connections 2024-06-13T02:29:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.100+0000 7fc95ac00640 1 --2- 172.21.15.2:0/3369489723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc95410e370 0x7fc954110760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.100+0000 7fc95ac00640 1 --2- 172.21.15.2:0/3369489723 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc954100750 0x7fc95410de30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.100+0000 7fc95ac00640 1 --2- 172.21.15.2:0/3369489723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9540ffe30 0x7fc954100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.100+0000 7fc95ac00640 1 -- 172.21.15.2:0/3369489723 >> 172.21.15.2:0/3369489723 conn(0x7fc9540757b0 msgr2=0x7fc954075bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.102+0000 7fc95ac00640 1 -- 172.21.15.2:0/3369489723 shutdown_connections 2024-06-13T02:29:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.102+0000 7fc95ac00640 1 -- 172.21.15.2:0/3369489723 wait complete. 2024-06-13T02:29:58.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.103+0000 7fc95ac00640 1 Processor -- start 2024-06-13T02:29:58.103 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.104+0000 7fc95ac00640 1 -- start start 2024-06-13T02:29:58.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.104+0000 7fc95ac00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ffe30 0x7fc95410bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.104+0000 7fc95ac00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc954100750 0x7fc95410c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.104+0000 7fc95ac00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc95410e370 0x7fc95410d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.104+0000 7fc95ac00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc954103d70 con 0x7fc95410e370 2024-06-13T02:29:58.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.104+0000 7fc95ac00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc954103bf0 con 0x7fc9540ffe30 2024-06-13T02:29:58.104 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.104+0000 7fc95ac00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc954103ef0 con 0x7fc954100750 2024-06-13T02:29:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.104+0000 7fc953e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ffe30 0x7fc95410bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.104+0000 7fc953400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc954100750 0x7fc95410c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.105+0000 7fc953e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ffe30 0x7fc95410bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:48466/0 (socket says 172.21.15.2:48466) 2024-06-13T02:29:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.105+0000 7fc953e00640 1 -- 172.21.15.2:0/3584175336 learned_addr learned my addr 172.21.15.2:0/3584175336 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.105+0000 7fc953400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc954100750 0x7fc95410c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58746/0 (socket says 172.21.15.2:58746) 2024-06-13T02:29:58.105 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.105+0000 7fc958c00640 1 --2- 172.21.15.2:0/3584175336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc95410e370 0x7fc95410d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.105+0000 7fc953400640 1 -- 172.21.15.2:0/3584175336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ffe30 msgr2=0x7fc95410bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.105+0000 7fc953400640 1 --2- 172.21.15.2:0/3584175336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ffe30 0x7fc95410bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.105+0000 7fc953400640 1 -- 172.21.15.2:0/3584175336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc95410e370 msgr2=0x7fc95410d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.105+0000 7fc953400640 1 --2- 172.21.15.2:0/3584175336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc95410e370 0x7fc95410d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.105+0000 7fc953400640 1 -- 172.21.15.2:0/3584175336 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95410dae0 con 0x7fc954100750 2024-06-13T02:29:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.106+0000 7fc953400640 1 --2- 172.21.15.2:0/3584175336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc954100750 0x7fc95410c0e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc94402a9c0 tx=0x7fc944003c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.106+0000 7fc950c00640 1 -- 172.21.15.2:0/3584175336 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94403f070 con 0x7fc954100750 2024-06-13T02:29:58.106 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.106+0000 7fc950c00640 1 -- 172.21.15.2:0/3584175336 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc94403b460 con 0x7fc954100750 2024-06-13T02:29:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.106+0000 7fc950c00640 1 -- 172.21.15.2:0/3584175336 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944035030 con 0x7fc954100750 2024-06-13T02:29:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.106+0000 7fc95ac00640 1 -- 172.21.15.2:0/3584175336 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95410dd70 con 0x7fc954100750 2024-06-13T02:29:58.107 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.106+0000 7fc95ac00640 1 -- 172.21.15.2:0/3584175336 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9541ab3d0 con 0x7fc954100750 2024-06-13T02:29:58.112 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.112+0000 7fc95da70740 1 Processor -- start 2024-06-13T02:29:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.112+0000 7fc950c00640 1 -- 172.21.15.2:0/3584175336 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fc944042070 con 0x7fc954100750 2024-06-13T02:29:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.113+0000 7fc95da70740 1 -- start start 2024-06-13T02:29:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.113+0000 7fc95da70740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04b5e0 0x55cd1b049b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.113+0000 7fc95da70740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b04a070 0x55cd1b04a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.113+0000 7fc95da70740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b054df0 0x55cd1b0571e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.113+0000 7fc95da70740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cd1afae420 con 0x55cd1b04a070 2024-06-13T02:29:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.113+0000 7fc95da70740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cd1af55c50 con 0x55cd1b054df0 2024-06-13T02:29:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.113+0000 7fc95da70740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cd1afaa3e0 con 0x55cd1b04b5e0 2024-06-13T02:29:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.114+0000 7fc953e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b04a070 0x55cd1b04a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.114+0000 7fc958c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04b5e0 0x55cd1b049b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.114+0000 7fc958c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04b5e0 0x55cd1b049b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58754/0 (socket says 172.21.15.2:58754) 2024-06-13T02:29:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.114+0000 7fc958c00640 1 -- 172.21.15.2:0/1303080742 learned_addr learned my addr 172.21.15.2:0/1303080742 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.114+0000 7fc953400640 1 --2- 172.21.15.2:0/1303080742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b054df0 0x55cd1b0571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.114+0000 7fc953e00640 1 -- 172.21.15.2:0/1303080742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04b5e0 msgr2=0x55cd1b049b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.114+0000 7fc953e00640 1 --2- 172.21.15.2:0/1303080742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04b5e0 0x55cd1b049b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.114+0000 7fc953e00640 1 -- 172.21.15.2:0/1303080742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b054df0 msgr2=0x55cd1b0571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.114+0000 7fc953e00640 1 --2- 172.21.15.2:0/1303080742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b054df0 0x55cd1b0571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.115+0000 7fc953e00640 1 -- 172.21.15.2:0/1303080742 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1acc2210 con 0x55cd1b04a070 2024-06-13T02:29:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.115+0000 7fc950c00640 1 --2- 172.21.15.2:0/3584175336 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc9380a2e40 0x7fc9380a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.115+0000 7fc953e00640 1 --2- 172.21.15.2:0/1303080742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b04a070 0x55cd1b04a4f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc94c007ed0 tx=0x7fc94c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fd5993be4ad4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:58.116 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.115+0000 7fc949200640 1 -- 172.21.15.2:0/1303080742 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c014070 con 0x55cd1b04a070 2024-06-13T02:29:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.115+0000 7fc949200640 1 -- 172.21.15.2:0/1303080742 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc94c003e50 con 0x55cd1b04a070 2024-06-13T02:29:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.115+0000 7fc949200640 1 -- 172.21.15.2:0/1303080742 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c004030 con 0x55cd1b04a070 2024-06-13T02:29:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.116+0000 7fc950c00640 1 -- 172.21.15.2:0/3584175336 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9495+0+0 (secure 0 0 0) 0x7fc9440eff50 con 0x7fc954100750 2024-06-13T02:29:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.117+0000 7fc958c00640 1 --2- 172.21.15.2:0/3584175336 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc9380a2e40 0x7fc9380a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.117+0000 7fc95da70740 1 -- 172.21.15.2:0/1303080742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b04a070 msgr2=0x55cd1b04a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.117+0000 7fc95da70740 1 --2- 172.21.15.2:0/1303080742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b04a070 0x55cd1b04a4f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc94c007ed0 tx=0x7fc94c00e720 comp rx=0 tx=0).stop 2024-06-13T02:29:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.118+0000 7fc958c00640 1 --2- 172.21.15.2:0/3584175336 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc9380a2e40 0x7fc9380a5300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc94000bb30 tx=0x7fc940008040 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.118+0000 7fc95da70740 1 -- 172.21.15.2:0/1303080742 shutdown_connections 2024-06-13T02:29:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.118+0000 7fc95da70740 1 --2- 172.21.15.2:0/1303080742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b054df0 0x55cd1b0571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.118+0000 7fc95da70740 1 --2- 172.21.15.2:0/1303080742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b04a070 0x55cd1b04a4f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.118+0000 7fc95da70740 1 --2- 172.21.15.2:0/1303080742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04b5e0 0x55cd1b049b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.118+0000 7fc95da70740 1 -- 172.21.15.2:0/1303080742 >> 172.21.15.2:0/1303080742 conn(0x55cd1b012fb0 msgr2=0x55cd1b046660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.119+0000 7fc95da70740 1 -- 172.21.15.2:0/1303080742 shutdown_connections 2024-06-13T02:29:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.119+0000 7fc95da70740 1 -- 172.21.15.2:0/1303080742 wait complete. 2024-06-13T02:29:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.119+0000 7fc95da70740 1 -- start start 2024-06-13T02:29:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.120+0000 7fc95da70740 1 Processor -- start 2024-06-13T02:29:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.120+0000 7fc95da70740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b04a070 0x55cd1b051d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.120+0000 7fc95da70740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04b5e0 0x55cd1b0522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.120+0000 7fc95da70740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b054df0 0x55cd1b052810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.121+0000 7fc95da70740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cd1b068bd0 con 0x55cd1b04a070 2024-06-13T02:29:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.121+0000 7fc95da70740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cd1af690b0 con 0x55cd1b054df0 2024-06-13T02:29:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.121+0000 7fc95da70740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cd1b068d50 con 0x55cd1b04b5e0 2024-06-13T02:29:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.121+0000 7fc95da70740 10 client.0 _ll_register_callbacks cb 0x55cd1af54f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:29:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.121+0000 7fc953400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04b5e0 0x55cd1b0522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.121+0000 7fc953400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04b5e0 0x55cd1b0522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58756/0 (socket says 172.21.15.2:58756) 2024-06-13T02:29:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.121+0000 7fc953400640 1 -- 172.21.15.2:0/3469937820 learned_addr learned my addr 172.21.15.2:0/3469937820 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.121+0000 7fc958c00640 1 --2- 172.21.15.2:0/3469937820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b054df0 0x55cd1b052810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.121+0000 7fc953e00640 1 --2- 172.21.15.2:0/3469937820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b04a070 0x55cd1b051d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.122+0000 7fc953400640 1 -- 172.21.15.2:0/3469937820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b054df0 msgr2=0x55cd1b052810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.122+0000 7fc953400640 1 --2- 172.21.15.2:0/3469937820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b054df0 0x55cd1b052810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.122+0000 7fc953400640 1 -- 172.21.15.2:0/3469937820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b04a070 msgr2=0x55cd1b051d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.122+0000 7fc953400640 1 --2- 172.21.15.2:0/3469937820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b04a070 0x55cd1b051d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.122+0000 7fc953400640 1 -- 172.21.15.2:0/3469937820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd1ad8e620 con 0x55cd1b04b5e0 2024-06-13T02:29:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.122+0000 7fc953400640 1 --2- 172.21.15.2:0/3469937820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04b5e0 0x55cd1b0522d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc944000c00 tx=0x7fc944003f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d72d2ea351f092f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.122+0000 7fc93d600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:29:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.122+0000 7fc93d600640 1 -- 172.21.15.2:0/3469937820 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9440bbe70 con 0x55cd1b04b5e0 2024-06-13T02:29:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.122+0000 7fc93d600640 1 -- 172.21.15.2:0/3469937820 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9495+0+0 (secure 0 0 0) 0x7fc9440ed550 con 0x55cd1b04b5e0 2024-06-13T02:29:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.123+0000 7fc95da70740 1 -- 172.21.15.2:0/3469937820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc94c003e50 con 0x55cd1b04b5e0 2024-06-13T02:29:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.123+0000 7fc93d600640 1 -- 172.21.15.2:0/3469937820 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc9440bba00 con 0x55cd1b04b5e0 2024-06-13T02:29:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.123+0000 7fc95da70740 10 client.26209 fetch_fsmap learned FSMap version 37 2024-06-13T02:29:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.123+0000 7fc95da70740 1 -- 172.21.15.2:0/3469937820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55cd1b068bd0 con 0x55cd1b04b5e0 2024-06-13T02:29:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.123+0000 7fc93d600640 1 -- 172.21.15.2:0/3469937820 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc94c003e50 con 0x55cd1b04b5e0 2024-06-13T02:29:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.124+0000 7fc93d600640 1 -- 172.21.15.2:0/3469937820 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 37) ==== 8346+0+0 (secure 0 0 0) 0x7fc9440dace0 con 0x55cd1b04b5e0 2024-06-13T02:29:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.124+0000 7fc95da70740 10 client.26209 fetch_fsmap finished waiting for FSMap version 37 2024-06-13T02:29:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.124+0000 7fc95da70740 10 client.26209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:29:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.124+0000 7fc95da70740 20 client.26209 populate_metadata read hostname 'smithi002' 2024-06-13T02:29:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.124+0000 7fc95da70740 1 --2- 172.21.15.2:0/3469937820 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd1b076320 0x55cd1b078780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.124+0000 7fc95da70740 4 client.26209 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:29:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.124+0000 7fc95da70740 1 -- 172.21.15.2:0/3469937820 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd1afbbb50 con 0x55cd1b076320 2024-06-13T02:29:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.125+0000 7fc953e00640 1 --2- 172.21.15.2:0/3469937820 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd1b076320 0x55cd1b078780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.126+0000 7fc953e00640 1 --2- 172.21.15.2:0/3469937820 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd1b076320 0x55cd1b078780 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d08517b0619b90e6 server_cookie=60868152bb10449a in_seq=0 out_seq=0 2024-06-13T02:29:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.126+0000 7fc93d600640 10 client.26209 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.127+0000 7fc93d600640 1 -- 172.21.15.2:0/3469937820 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55cd1afbbb50 con 0x55cd1b076320 2024-06-13T02:29:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.127+0000 7fc93d600640 10 client.26209 handle_command_reply: tid=0 2024-06-13T02:29:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.127+0000 7fc95da70740 1 client.26209 shutdown 2024-06-13T02:29:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.127+0000 7fc95da70740 1 -- 172.21.15.2:0/3469937820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04b5e0 msgr2=0x55cd1b0522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.127+0000 7fc95da70740 1 --2- 172.21.15.2:0/3469937820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04b5e0 0x55cd1b0522d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc944000c00 tx=0x7fc944003f70 comp rx=0 tx=0).stop 2024-06-13T02:29:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.128+0000 7fc95da70740 1 -- 172.21.15.2:0/3469937820 shutdown_connections 2024-06-13T02:29:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.128+0000 7fc95da70740 1 --2- 172.21.15.2:0/3469937820 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd1b076320 0x55cd1b078780 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.128+0000 7fc95da70740 1 --2- 172.21.15.2:0/3469937820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b054df0 0x55cd1b052810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.128+0000 7fc95da70740 1 --2- 172.21.15.2:0/3469937820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04b5e0 0x55cd1b0522d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.128+0000 7fc95da70740 1 --2- 172.21.15.2:0/3469937820 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b04a070 0x55cd1b051d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.128+0000 7fc95da70740 1 -- 172.21.15.2:0/3469937820 >> 172.21.15.2:0/3469937820 conn(0x55cd1b012fb0 msgr2=0x55cd1b04c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.128+0000 7fc93d600640 0 client.26209 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.128+0000 7fc95da70740 1 -- 172.21.15.2:0/3469937820 shutdown_connections 2024-06-13T02:29:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.128+0000 7fc95da70740 1 -- 172.21.15.2:0/3469937820 wait complete. 2024-06-13T02:29:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.128+0000 7fc95da70740 20 client.26209 trim_cache size 0 max 16384 2024-06-13T02:29:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.162+0000 7fc95da70740 1 Processor -- start 2024-06-13T02:29:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.162+0000 7fc95da70740 1 -- start start 2024-06-13T02:29:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.163+0000 7fc95da70740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04a070 0x55cd1b04d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.163+0000 7fc95da70740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b04b5e0 0x55cd1b045fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.163+0000 7fc95da70740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b054df0 0x55cd1b046500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.163+0000 7fc95da70740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc9541af5b0 con 0x55cd1b054df0 2024-06-13T02:29:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.163+0000 7fc95da70740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc9541ace80 con 0x55cd1b04b5e0 2024-06-13T02:29:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.163+0000 7fc95da70740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc95410cdd0 con 0x55cd1b04a070 2024-06-13T02:29:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.163+0000 7fc953400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b04b5e0 0x55cd1b045fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.163+0000 7fc953400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b04b5e0 0x55cd1b045fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:48504/0 (socket says 172.21.15.2:48504) 2024-06-13T02:29:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.163+0000 7fc953400640 1 -- 172.21.15.2:0/3125469024 learned_addr learned my addr 172.21.15.2:0/3125469024 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.163+0000 7fc953e00640 1 --2- 172.21.15.2:0/3125469024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04a070 0x55cd1b04d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.164+0000 7fc958c00640 1 --2- 172.21.15.2:0/3125469024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b054df0 0x55cd1b046500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.164+0000 7fc953400640 1 -- 172.21.15.2:0/3125469024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04a070 msgr2=0x55cd1b04d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.164+0000 7fc953400640 1 --2- 172.21.15.2:0/3125469024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04a070 0x55cd1b04d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.164+0000 7fc953400640 1 -- 172.21.15.2:0/3125469024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b054df0 msgr2=0x55cd1b046500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.164+0000 7fc953400640 1 --2- 172.21.15.2:0/3125469024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b054df0 0x55cd1b046500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.164+0000 7fc953400640 1 -- 172.21.15.2:0/3125469024 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1b0502e0 con 0x55cd1b04b5e0 2024-06-13T02:29:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.166+0000 7fc953400640 1 --2- 172.21.15.2:0/3125469024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b04b5e0 0x55cd1b045fc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc944006010 tx=0x7fc9440f02e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6de3652c20827bae server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.166+0000 7fc93fe00640 1 -- 172.21.15.2:0/3125469024 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9440bbbe0 con 0x55cd1b04b5e0 2024-06-13T02:29:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.166+0000 7fc93fe00640 1 -- 172.21.15.2:0/3125469024 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9440d5020 con 0x55cd1b04b5e0 2024-06-13T02:29:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.166+0000 7fc93fe00640 1 -- 172.21.15.2:0/3125469024 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94403b9c0 con 0x55cd1b04b5e0 2024-06-13T02:29:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.167+0000 7fc95da70740 1 -- 172.21.15.2:0/3125469024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b04b5e0 msgr2=0x55cd1b045fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.167+0000 7fc95da70740 1 --2- 172.21.15.2:0/3125469024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b04b5e0 0x55cd1b045fc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc944006010 tx=0x7fc9440f02e0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.168+0000 7fc95da70740 1 -- 172.21.15.2:0/3125469024 shutdown_connections 2024-06-13T02:29:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.168+0000 7fc95da70740 1 --2- 172.21.15.2:0/3125469024 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b054df0 0x55cd1b046500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.168+0000 7fc95da70740 1 --2- 172.21.15.2:0/3125469024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b04b5e0 0x55cd1b045fc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.168+0000 7fc95da70740 1 --2- 172.21.15.2:0/3125469024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04a070 0x55cd1b04d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.168+0000 7fc95da70740 1 -- 172.21.15.2:0/3125469024 >> 172.21.15.2:0/3125469024 conn(0x55cd1b012fb0 msgr2=0x55cd1b053e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.169+0000 7fc95da70740 1 -- 172.21.15.2:0/3125469024 shutdown_connections 2024-06-13T02:29:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.169+0000 7fc95da70740 1 -- 172.21.15.2:0/3125469024 wait complete. 2024-06-13T02:29:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.169+0000 7fc95da70740 1 -- start start 2024-06-13T02:29:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.170+0000 7fc95da70740 1 Processor -- start 2024-06-13T02:29:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.170+0000 7fc95da70740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04a070 0x55cd1b069f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.170+0000 7fc95da70740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b04b5e0 0x55cd1b06a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.171+0000 7fc95da70740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b054df0 0x55cd1b06a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.171+0000 7fc95da70740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc95411c1f0 con 0x55cd1b054df0 2024-06-13T02:29:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.171+0000 7fc95da70740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc9541ac7b0 con 0x55cd1b04b5e0 2024-06-13T02:29:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.171+0000 7fc95da70740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc9541aba10 con 0x55cd1b04a070 2024-06-13T02:29:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.171+0000 7fc95da70740 10 client.0 _ll_register_callbacks cb 0x7fc944009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:29:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.171+0000 7fc953e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04a070 0x55cd1b069f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.171+0000 7fc953e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04a070 0x55cd1b069f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58764/0 (socket says 172.21.15.2:58764) 2024-06-13T02:29:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.171+0000 7fc953e00640 1 -- 172.21.15.2:0/3866395890 learned_addr learned my addr 172.21.15.2:0/3866395890 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:29:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.171+0000 7fc958c00640 1 --2- 172.21.15.2:0/3866395890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b054df0 0x55cd1b06a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.172+0000 7fc953e00640 1 -- 172.21.15.2:0/3866395890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b04b5e0 msgr2=0x55cd1b06a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.172+0000 7fc953e00640 1 --2- 172.21.15.2:0/3866395890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b04b5e0 0x55cd1b06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.172+0000 7fc953e00640 1 -- 172.21.15.2:0/3866395890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b054df0 msgr2=0x55cd1b06a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:29:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.172+0000 7fc953e00640 1 --2- 172.21.15.2:0/3866395890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b054df0 0x55cd1b06a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.172+0000 7fc953e00640 1 -- 172.21.15.2:0/3866395890 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd1b0e0230 con 0x55cd1b04a070 2024-06-13T02:29:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.172+0000 7fc958c00640 1 --2- 172.21.15.2:0/3866395890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b054df0 0x55cd1b06a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:29:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.173+0000 7fc953e00640 1 --2- 172.21.15.2:0/3866395890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04a070 0x55cd1b069f40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc94c007ed0 tx=0x7fc94c010b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95a910cac67920bd server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:29:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.173+0000 7fc93d600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:29:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.173+0000 7fc93d600640 1 -- 172.21.15.2:0/3866395890 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c014040 con 0x55cd1b04a070 2024-06-13T02:29:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.173+0000 7fc93d600640 1 -- 172.21.15.2:0/3866395890 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9495+0+0 (secure 0 0 0) 0x7fc94c003970 con 0x55cd1b04a070 2024-06-13T02:29:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.173+0000 7fc95da70740 1 -- 172.21.15.2:0/3866395890 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9440d5020 con 0x55cd1b04a070 2024-06-13T02:29:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.174+0000 7fc93d600640 1 -- 172.21.15.2:0/3866395890 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc94c032050 con 0x55cd1b04a070 2024-06-13T02:29:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.174+0000 7fc95da70740 10 client.26215 fetch_fsmap learned FSMap version 37 2024-06-13T02:29:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.174+0000 7fc95da70740 1 -- 172.21.15.2:0/3866395890 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55cd1b0e1500 con 0x55cd1b04a070 2024-06-13T02:29:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.174+0000 7fc93d600640 1 -- 172.21.15.2:0/3866395890 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9440d5020 con 0x55cd1b04a070 2024-06-13T02:29:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.175+0000 7fc93d600640 1 -- 172.21.15.2:0/3866395890 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 37) ==== 8346+0+0 (secure 0 0 0) 0x7fc94c0056a0 con 0x55cd1b04a070 2024-06-13T02:29:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.175+0000 7fc95da70740 10 client.26215 fetch_fsmap finished waiting for FSMap version 37 2024-06-13T02:29:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.175+0000 7fc95da70740 10 client.26215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:29:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.175+0000 7fc95da70740 20 client.26215 populate_metadata read hostname 'smithi002' 2024-06-13T02:29:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.175+0000 7fc95da70740 1 --2- 172.21.15.2:0/3866395890 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd1b0e19d0 0x55cd1b0e3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:29:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.175+0000 7fc95da70740 4 client.26215 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:29:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.175+0000 7fc95da70740 1 -- 172.21.15.2:0/3866395890 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cd1afb5ea0 con 0x55cd1b0e19d0 2024-06-13T02:29:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.175+0000 7fc953400640 1 --2- 172.21.15.2:0/3866395890 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd1b0e19d0 0x55cd1b0e3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:29:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.176+0000 7fc953400640 1 --2- 172.21.15.2:0/3866395890 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd1b0e19d0 0x55cd1b0e3df0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=501bdcc56a087c1 server_cookie=4d9b20afd092d914 in_seq=0 out_seq=0 2024-06-13T02:29:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.176+0000 7fc93d600640 10 client.26215 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.429+0000 7fc93d600640 1 -- 172.21.15.2:0/3866395890 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55cd1afb5ea0 con 0x55cd1b0e19d0 2024-06-13T02:29:58.429 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.429+0000 7fc93d600640 10 client.26215 handle_command_reply: tid=0 2024-06-13T02:29:58.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.429+0000 7fc95da70740 1 client.26215 shutdown 2024-06-13T02:29:58.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.430+0000 7fc95da70740 1 -- 172.21.15.2:0/3866395890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04a070 msgr2=0x55cd1b069f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:58.430 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.430+0000 7fc95da70740 1 --2- 172.21.15.2:0/3866395890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04a070 0x55cd1b069f40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc94c007ed0 tx=0x7fc94c010b40 comp rx=0 tx=0).stop 2024-06-13T02:29:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.430+0000 7fc95da70740 1 -- 172.21.15.2:0/3866395890 shutdown_connections 2024-06-13T02:29:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.430+0000 7fc95da70740 1 --2- 172.21.15.2:0/3866395890 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd1b0e19d0 0x55cd1b0e3df0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.430+0000 7fc95da70740 1 --2- 172.21.15.2:0/3866395890 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd1b054df0 0x55cd1b06a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.430+0000 7fc95da70740 1 --2- 172.21.15.2:0/3866395890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd1b04b5e0 0x55cd1b06a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.430+0000 7fc95da70740 1 --2- 172.21.15.2:0/3866395890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd1b04a070 0x55cd1b069f40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.430+0000 7fc95da70740 1 -- 172.21.15.2:0/3866395890 >> 172.21.15.2:0/3866395890 conn(0x55cd1b012fb0 msgr2=0x55cd1b051d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.430+0000 7fc93d600640 0 client.26215 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:29:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.431+0000 7fc95da70740 1 -- 172.21.15.2:0/3866395890 shutdown_connections 2024-06-13T02:29:58.431 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.431+0000 7fc95da70740 1 -- 172.21.15.2:0/3866395890 wait complete. 2024-06-13T02:29:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.431+0000 7fc95da70740 20 client.26215 trim_cache size 0 max 16384 2024-06-13T02:29:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:29:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:29:58.432 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:29:58.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.433+0000 7fc95ac00640 1 -- 172.21.15.2:0/3584175336 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc9380a2e40 msgr2=0x7fc9380a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:58.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.433+0000 7fc95ac00640 1 --2- 172.21.15.2:0/3584175336 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc9380a2e40 0x7fc9380a5300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc94000bb30 tx=0x7fc940008040 comp rx=0 tx=0).stop 2024-06-13T02:29:58.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.433+0000 7fc95ac00640 1 -- 172.21.15.2:0/3584175336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc954100750 msgr2=0x7fc95410c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:29:58.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.433+0000 7fc95ac00640 1 --2- 172.21.15.2:0/3584175336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc954100750 0x7fc95410c0e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc94402a9c0 tx=0x7fc944003c00 comp rx=0 tx=0).stop 2024-06-13T02:29:58.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.433+0000 7fc95ac00640 1 -- 172.21.15.2:0/3584175336 shutdown_connections 2024-06-13T02:29:58.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.433+0000 7fc95ac00640 1 --2- 172.21.15.2:0/3584175336 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc9380a2e40 0x7fc9380a5300 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.433+0000 7fc95ac00640 1 --2- 172.21.15.2:0/3584175336 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc95410e370 0x7fc95410d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.433+0000 7fc95ac00640 1 --2- 172.21.15.2:0/3584175336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc954100750 0x7fc95410c0e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.433+0000 7fc95ac00640 1 --2- 172.21.15.2:0/3584175336 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ffe30 0x7fc95410bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:29:58.433 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.433+0000 7fc95ac00640 1 -- 172.21.15.2:0/3584175336 >> 172.21.15.2:0/3584175336 conn(0x7fc9540757b0 msgr2=0x7fc95410e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:29:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.433+0000 7fc95ac00640 1 -- 172.21.15.2:0/3584175336 shutdown_connections 2024-06-13T02:29:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:29:58.434+0000 7fc95ac00640 1 -- 172.21.15.2:0/3584175336 wait complete. 2024-06-13T02:29:58.565 INFO:tasks.workunit.client.0.smithi002.stdout: 1 857106 6.81 MB/sec execute 542 sec latency 153.811 ms 2024-06-13T02:29:59.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:29:59 smithi084 ceph-mon[36833]: pgmap v383: 129 pgs: 129 active+clean; 96 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 167 op/s 2024-06-13T02:29:59.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:29:59 smithi175 ceph-mon[36977]: pgmap v383: 129 pgs: 129 active+clean; 96 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 167 op/s 2024-06-13T02:29:59.565 INFO:tasks.workunit.client.0.smithi002.stdout: 1 858573 6.81 MB/sec execute 543 sec latency 24.953 ms 2024-06-13T02:29:59.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:29:59 smithi002 ceph-mon[31960]: pgmap v383: 129 pgs: 129 active+clean; 96 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 167 op/s 2024-06-13T02:30:00.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:00 smithi084 ceph-mon[36833]: overall HEALTH_OK 2024-06-13T02:30:00.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:00 smithi175 ceph-mon[36977]: overall HEALTH_OK 2024-06-13T02:30:00.565 INFO:tasks.workunit.client.0.smithi002.stdout: 1 859590 6.81 MB/sec execute 544 sec latency 25.521 ms 2024-06-13T02:30:00.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:00 smithi002 ceph-mon[31960]: overall HEALTH_OK 2024-06-13T02:30:01.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:01 smithi084 ceph-mon[36833]: pgmap v384: 129 pgs: 129 active+clean; 96 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 135 op/s 2024-06-13T02:30:01.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:01 smithi175 ceph-mon[36977]: pgmap v384: 129 pgs: 129 active+clean; 96 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 135 op/s 2024-06-13T02:30:01.669 INFO:tasks.workunit.client.0.smithi002.stdout: 1 860211 6.80 MB/sec execute 545 sec latency 144.858 ms 2024-06-13T02:30:01.670 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:01 smithi002 ceph-mon[31960]: pgmap v384: 129 pgs: 129 active+clean; 96 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.9 MiB/s wr, 135 op/s 2024-06-13T02:30:02.568 INFO:tasks.workunit.client.0.smithi002.stdout: 1 860234 6.79 MB/sec execute 546 sec latency 176.953 ms 2024-06-13T02:30:03.433 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:03 smithi002 ceph-mon[31960]: pgmap v385: 129 pgs: 129 active+clean; 91 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 269 op/s 2024-06-13T02:30:03.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:03 smithi084 ceph-mon[36833]: pgmap v385: 129 pgs: 129 active+clean; 91 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 269 op/s 2024-06-13T02:30:03.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:03 smithi175 ceph-mon[36977]: pgmap v385: 129 pgs: 129 active+clean; 91 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 269 op/s 2024-06-13T02:30:03.566 INFO:tasks.workunit.client.0.smithi002.stdout: 1 860812 6.78 MB/sec execute 547 sec latency 135.022 ms 2024-06-13T02:30:04.566 INFO:tasks.workunit.client.0.smithi002.stdout: 1 862374 6.79 MB/sec execute 548 sec latency 26.017 ms 2024-06-13T02:30:05.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:05 smithi084 ceph-mon[36833]: pgmap v386: 129 pgs: 129 active+clean; 91 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 1.9 MiB/s wr, 204 op/s 2024-06-13T02:30:05.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:05 smithi175 ceph-mon[36977]: pgmap v386: 129 pgs: 129 active+clean; 91 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 1.9 MiB/s wr, 204 op/s 2024-06-13T02:30:05.567 INFO:tasks.workunit.client.0.smithi002.stdout: 1 862980 6.78 MB/sec execute 549 sec latency 72.006 ms 2024-06-13T02:30:05.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:05 smithi002 ceph-mon[31960]: pgmap v386: 129 pgs: 129 active+clean; 91 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 1.9 MiB/s wr, 204 op/s 2024-06-13T02:30:06.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:06 smithi084 ceph-mon[36833]: osdmap e118: 12 total, 12 up, 12 in 2024-06-13T02:30:06.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:06 smithi175 ceph-mon[36977]: osdmap e118: 12 total, 12 up, 12 in 2024-06-13T02:30:06.566 INFO:tasks.workunit.client.0.smithi002.stdout: 1 863179 6.77 MB/sec execute 550 sec latency 68.462 ms 2024-06-13T02:30:06.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:06 smithi002 ceph-mon[31960]: osdmap e118: 12 total, 12 up, 12 in 2024-06-13T02:30:07.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:07 smithi084 ceph-mon[36833]: pgmap v388: 129 pgs: 12 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 87 active+clean; 91 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 249 op/s 2024-06-13T02:30:07.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:07 smithi175 ceph-mon[36977]: pgmap v388: 129 pgs: 12 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 87 active+clean; 91 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 249 op/s 2024-06-13T02:30:07.567 INFO:tasks.workunit.client.0.smithi002.stdout: 1 863534 6.76 MB/sec execute 551 sec latency 72.442 ms 2024-06-13T02:30:07.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:07 smithi002 ceph-mon[31960]: pgmap v388: 129 pgs: 12 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 87 active+clean; 91 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 249 op/s 2024-06-13T02:30:08.567 INFO:tasks.workunit.client.0.smithi002.stdout: 1 863852 6.75 MB/sec execute 552 sec latency 159.779 ms 2024-06-13T02:30:09.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:09 smithi175 ceph-mon[36977]: pgmap v389: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 88 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 1.8 MiB/s wr, 236 op/s 2024-06-13T02:30:09.567 INFO:tasks.workunit.client.0.smithi002.stdout: 1 865073 6.75 MB/sec execute 553 sec latency 249.672 ms 2024-06-13T02:30:09.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:09 smithi002 ceph-mon[31960]: pgmap v389: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 88 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 1.8 MiB/s wr, 236 op/s 2024-06-13T02:30:09.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:09 smithi084 ceph-mon[36833]: pgmap v389: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 88 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 1.8 MiB/s wr, 236 op/s 2024-06-13T02:30:10.567 INFO:tasks.workunit.client.0.smithi002.stdout: 1 866429 6.76 MB/sec execute 554 sec latency 23.151 ms 2024-06-13T02:30:11.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:11 smithi175 ceph-mon[36977]: pgmap v390: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 88 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 1.8 MiB/s wr, 236 op/s 2024-06-13T02:30:11.567 INFO:tasks.workunit.client.0.smithi002.stdout: 1 867236 6.75 MB/sec execute 555 sec latency 19.450 ms 2024-06-13T02:30:11.606 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.606+0000 7fb731000640 1 -- 172.21.15.2:0/1960914654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb72c102a00 msgr2=0x7fb72c102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:11.606 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.606+0000 7fb731000640 1 --2- 172.21.15.2:0/1960914654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb72c102a00 0x7fb72c102de0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009900 tx=0x7fb71c02a480 comp rx=0 tx=0).stop 2024-06-13T02:30:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.606+0000 7fb731000640 1 -- 172.21.15.2:0/1960914654 shutdown_connections 2024-06-13T02:30:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.606+0000 7fb731000640 1 --2- 172.21.15.2:0/1960914654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb72c10bdd0 0x7fb72c10e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.606+0000 7fb731000640 1 --2- 172.21.15.2:0/1960914654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb72c103320 0x7fb72c10b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.606+0000 7fb731000640 1 --2- 172.21.15.2:0/1960914654 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb72c102a00 0x7fb72c102de0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.606+0000 7fb731000640 1 -- 172.21.15.2:0/1960914654 >> 172.21.15.2:0/1960914654 conn(0x7fb72c0fc180 msgr2=0x7fb72c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.606+0000 7fb731000640 1 -- 172.21.15.2:0/1960914654 shutdown_connections 2024-06-13T02:30:11.607 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.606+0000 7fb731000640 1 -- 172.21.15.2:0/1960914654 wait complete. 2024-06-13T02:30:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.607+0000 7fb731000640 1 Processor -- start 2024-06-13T02:30:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.607+0000 7fb731000640 1 -- start start 2024-06-13T02:30:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.608+0000 7fb731000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb72c102a00 0x7fb72c100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.608+0000 7fb731000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb72c103320 0x7fb72c100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.608+0000 7fb731000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb72c10bdd0 0x7fb72c1010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.608+0000 7fb731000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c111bf0 con 0x7fb72c103320 2024-06-13T02:30:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.608+0000 7fb731000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c111a70 con 0x7fb72c10bdd0 2024-06-13T02:30:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.608+0000 7fb731000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c111d70 con 0x7fb72c102a00 2024-06-13T02:30:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.608+0000 7fb72b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb72c102a00 0x7fb72c100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.608+0000 7fb72aa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb72c103320 0x7fb72c100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.608+0000 7fb72b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb72c102a00 0x7fb72c100650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58926/0 (socket says 172.21.15.2:58926) 2024-06-13T02:30:11.611 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.608+0000 7fb72b400640 1 -- 172.21.15.2:0/856846349 learned_addr learned my addr 172.21.15.2:0/856846349 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.608+0000 7fb72be00640 1 --2- 172.21.15.2:0/856846349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb72c10bdd0 0x7fb72c1010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.609+0000 7fb72b400640 1 -- 172.21.15.2:0/856846349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb72c10bdd0 msgr2=0x7fb72c1010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.609+0000 7fb72b400640 1 --2- 172.21.15.2:0/856846349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb72c10bdd0 0x7fb72c1010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.609+0000 7fb72b400640 1 -- 172.21.15.2:0/856846349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb72c103320 msgr2=0x7fb72c100b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.609+0000 7fb72b400640 1 --2- 172.21.15.2:0/856846349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb72c103320 0x7fb72c100b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.609+0000 7fb72b400640 1 -- 172.21.15.2:0/856846349 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c1a65b0 con 0x7fb72c102a00 2024-06-13T02:30:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.609+0000 7fb72b400640 1 --2- 172.21.15.2:0/856846349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb72c102a00 0x7fb72c100650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb71c004770 tx=0x7fb71c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.609+0000 7fb723e00640 1 -- 172.21.15.2:0/856846349 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c03f070 con 0x7fb72c102a00 2024-06-13T02:30:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.609+0000 7fb723e00640 1 -- 172.21.15.2:0/856846349 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb71c031ca0 con 0x7fb72c102a00 2024-06-13T02:30:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.610+0000 7fb731000640 1 -- 172.21.15.2:0/856846349 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72c1a6840 con 0x7fb72c102a00 2024-06-13T02:30:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.610+0000 7fb723e00640 1 -- 172.21.15.2:0/856846349 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c035030 con 0x7fb72c102a00 2024-06-13T02:30:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.610+0000 7fb731000640 1 -- 172.21.15.2:0/856846349 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72c1a6d30 con 0x7fb72c102a00 2024-06-13T02:30:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.613+0000 7fb7355c6740 1 Processor -- start 2024-06-13T02:30:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.614+0000 7fb723e00640 1 -- 172.21.15.2:0/856846349 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fb71c042070 con 0x7fb72c102a00 2024-06-13T02:30:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.614+0000 7fb7355c6740 1 -- start start 2024-06-13T02:30:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.614+0000 7fb7355c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc67a0 0x55cd0adc4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.614+0000 7fb7355c6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adc5230 0x55cd0adc56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.614+0000 7fb7355c6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adcffb0 0x55cd0add23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.614+0000 7fb7355c6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cd0ad29420 con 0x55cd0adc5230 2024-06-13T02:30:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.614+0000 7fb7355c6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cd0acd0c50 con 0x55cd0adcffb0 2024-06-13T02:30:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.614+0000 7fb7355c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cd0ad253e0 con 0x55cd0adc67a0 2024-06-13T02:30:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.615+0000 7fb72be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc67a0 0x55cd0adc4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.615+0000 7fb72aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adcffb0 0x55cd0add23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.615+0000 7fb72be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc67a0 0x55cd0adc4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58938/0 (socket says 172.21.15.2:58938) 2024-06-13T02:30:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.615+0000 7fb72b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adc5230 0x55cd0adc56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.617 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.615+0000 7fb72be00640 1 -- 172.21.15.2:0/3737084882 learned_addr learned my addr 172.21.15.2:0/3737084882 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.615+0000 7fb72aa00640 1 -- 172.21.15.2:0/3737084882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc67a0 msgr2=0x55cd0adc4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.615+0000 7fb72aa00640 1 --2- 172.21.15.2:0/3737084882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc67a0 0x55cd0adc4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.615+0000 7fb72aa00640 1 -- 172.21.15.2:0/3737084882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adc5230 msgr2=0x55cd0adc56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.615+0000 7fb72aa00640 1 --2- 172.21.15.2:0/3737084882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adc5230 0x55cd0adc56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.615+0000 7fb72aa00640 1 -- 172.21.15.2:0/3737084882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0aa3d210 con 0x55cd0adcffb0 2024-06-13T02:30:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.615+0000 7fb72aa00640 1 --2- 172.21.15.2:0/3737084882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adcffb0 0x55cd0add23a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb718009c20 tx=0x7fb718011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da47877a3304494d server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.615+0000 7fb723e00640 1 --2- 172.21.15.2:0/856846349 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fb7100a2e30 0x7fb7100a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.616+0000 7fb720c00640 1 -- 172.21.15.2:0/3737084882 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718004050 con 0x55cd0adcffb0 2024-06-13T02:30:11.618 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.616+0000 7fb720c00640 1 -- 172.21.15.2:0/3737084882 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb718005500 con 0x55cd0adcffb0 2024-06-13T02:30:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.616+0000 7fb720c00640 1 -- 172.21.15.2:0/3737084882 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718004dd0 con 0x55cd0adcffb0 2024-06-13T02:30:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.616+0000 7fb723e00640 1 -- 172.21.15.2:0/856846349 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9671+0+0 (secure 0 0 0) 0x7fb71c0efdf0 con 0x7fb72c102a00 2024-06-13T02:30:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.616+0000 7fb72be00640 1 --2- 172.21.15.2:0/856846349 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fb7100a2e30 0x7fb7100a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.616+0000 7fb7355c6740 1 -- 172.21.15.2:0/3737084882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adcffb0 msgr2=0x55cd0add23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.616+0000 7fb7355c6740 1 --2- 172.21.15.2:0/3737084882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adcffb0 0x55cd0add23a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb718009c20 tx=0x7fb718011810 comp rx=0 tx=0).stop 2024-06-13T02:30:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.616+0000 7fb72be00640 1 --2- 172.21.15.2:0/856846349 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fb7100a2e30 0x7fb7100a52f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb7240125f0 tx=0x7fb724009500 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.617+0000 7fb7355c6740 1 -- 172.21.15.2:0/3737084882 shutdown_connections 2024-06-13T02:30:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.617+0000 7fb7355c6740 1 --2- 172.21.15.2:0/3737084882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adcffb0 0x55cd0add23a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.617+0000 7fb7355c6740 1 --2- 172.21.15.2:0/3737084882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adc5230 0x55cd0adc56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.619 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.617+0000 7fb7355c6740 1 --2- 172.21.15.2:0/3737084882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc67a0 0x55cd0adc4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.620 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.617+0000 7fb7355c6740 1 -- 172.21.15.2:0/3737084882 >> 172.21.15.2:0/3737084882 conn(0x55cd0ad8dfb0 msgr2=0x55cd0adc1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:11.620 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.617+0000 7fb7355c6740 1 -- 172.21.15.2:0/3737084882 shutdown_connections 2024-06-13T02:30:11.620 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.617+0000 7fb7355c6740 1 -- 172.21.15.2:0/3737084882 wait complete. 2024-06-13T02:30:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.617+0000 7fb7355c6740 1 -- start start 2024-06-13T02:30:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.618+0000 7fb7355c6740 1 Processor -- start 2024-06-13T02:30:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.618+0000 7fb7355c6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adc5230 0x55cd0adccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.618+0000 7fb7355c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc67a0 0x55cd0adcd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.618+0000 7fb7355c6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adcffb0 0x55cd0adcda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.618+0000 7fb7355c6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55cd0add2d80 con 0x55cd0adcffb0 2024-06-13T02:30:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.618+0000 7fb7355c6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cd0ace40b0 con 0x55cd0adc5230 2024-06-13T02:30:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.618+0000 7fb7355c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55cd0add2f00 con 0x55cd0adc67a0 2024-06-13T02:30:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.618+0000 7fb7355c6740 10 client.0 _ll_register_callbacks cb 0x55cd0accff40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:30:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.619+0000 7fb72aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc67a0 0x55cd0adcd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.619+0000 7fb72aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc67a0 0x55cd0adcd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58944/0 (socket says 172.21.15.2:58944) 2024-06-13T02:30:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.619+0000 7fb72aa00640 1 -- 172.21.15.2:0/95692901 learned_addr learned my addr 172.21.15.2:0/95692901 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.619+0000 7fb72b400640 1 --2- 172.21.15.2:0/95692901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adc5230 0x55cd0adccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.619+0000 7fb72be00640 1 --2- 172.21.15.2:0/95692901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adcffb0 0x55cd0adcda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.619+0000 7fb72aa00640 1 -- 172.21.15.2:0/95692901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adc5230 msgr2=0x55cd0adccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.619+0000 7fb72aa00640 1 --2- 172.21.15.2:0/95692901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adc5230 0x55cd0adccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.619+0000 7fb72aa00640 1 -- 172.21.15.2:0/95692901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adcffb0 msgr2=0x55cd0adcda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.619+0000 7fb72aa00640 1 --2- 172.21.15.2:0/95692901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adcffb0 0x55cd0adcda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.619+0000 7fb72aa00640 1 -- 172.21.15.2:0/95692901 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0ab09620 con 0x55cd0adc67a0 2024-06-13T02:30:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.619+0000 7fb72be00640 1 --2- 172.21.15.2:0/95692901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adcffb0 0x55cd0adcda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:30:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.620+0000 7fb72aa00640 1 --2- 172.21.15.2:0/95692901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc67a0 0x55cd0adcd500 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb718011d10 tx=0x7fb718005710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34f8100cbfec0464 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.620+0000 7fb715600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:30:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.620+0000 7fb715600640 1 -- 172.21.15.2:0/95692901 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718027070 con 0x55cd0adc67a0 2024-06-13T02:30:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.620+0000 7fb7355c6740 1 -- 172.21.15.2:0/95692901 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb718005500 con 0x55cd0adc67a0 2024-06-13T02:30:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.620+0000 7fb715600640 1 -- 172.21.15.2:0/95692901 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9671+0+0 (secure 0 0 0) 0x7fb718004d50 con 0x55cd0adc67a0 2024-06-13T02:30:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.620+0000 7fb715600640 1 -- 172.21.15.2:0/95692901 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb718033050 con 0x55cd0adc67a0 2024-06-13T02:30:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.620+0000 7fb7355c6740 10 client.26227 fetch_fsmap learned FSMap version 37 2024-06-13T02:30:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.620+0000 7fb7355c6740 1 -- 172.21.15.2:0/95692901 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55cd0addf0f0 con 0x55cd0adc67a0 2024-06-13T02:30:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.620+0000 7fb715600640 1 -- 172.21.15.2:0/95692901 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb718005500 con 0x55cd0adc67a0 2024-06-13T02:30:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.621+0000 7fb715600640 1 -- 172.21.15.2:0/95692901 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 37) ==== 8346+0+0 (secure 0 0 0) 0x7fb718023460 con 0x55cd0adc67a0 2024-06-13T02:30:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.621+0000 7fb7355c6740 10 client.26227 fetch_fsmap finished waiting for FSMap version 37 2024-06-13T02:30:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.621+0000 7fb7355c6740 10 client.26227 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:30:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.621+0000 7fb7355c6740 20 client.26227 populate_metadata read hostname 'smithi002' 2024-06-13T02:30:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.621+0000 7fb7355c6740 1 --2- 172.21.15.2:0/95692901 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd0ade0500 0x55cd0ade28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.621+0000 7fb7355c6740 4 client.26227 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:30:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.621+0000 7fb7355c6740 1 -- 172.21.15.2:0/95692901 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd0ad36b50 con 0x55cd0ade0500 2024-06-13T02:30:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.621+0000 7fb72b400640 1 --2- 172.21.15.2:0/95692901 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd0ade0500 0x55cd0ade28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.622+0000 7fb72b400640 1 --2- 172.21.15.2:0/95692901 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd0ade0500 0x55cd0ade28f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28ddcfd6d17984b8 server_cookie=409066658e24d2aa in_seq=0 out_seq=0 2024-06-13T02:30:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.622+0000 7fb715600640 10 client.26227 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.622+0000 7fb715600640 1 -- 172.21.15.2:0/95692901 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55cd0ad36b50 con 0x55cd0ade0500 2024-06-13T02:30:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.622+0000 7fb715600640 10 client.26227 handle_command_reply: tid=0 2024-06-13T02:30:11.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.622+0000 7fb7355c6740 1 client.26227 shutdown 2024-06-13T02:30:11.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.623+0000 7fb7355c6740 1 -- 172.21.15.2:0/95692901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc67a0 msgr2=0x55cd0adcd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:11.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.623+0000 7fb7355c6740 1 --2- 172.21.15.2:0/95692901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc67a0 0x55cd0adcd500 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb718011d10 tx=0x7fb718005710 comp rx=0 tx=0).stop 2024-06-13T02:30:11.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.623+0000 7fb7355c6740 1 -- 172.21.15.2:0/95692901 shutdown_connections 2024-06-13T02:30:11.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.623+0000 7fb7355c6740 1 --2- 172.21.15.2:0/95692901 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd0ade0500 0x55cd0ade28f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.623+0000 7fb7355c6740 1 --2- 172.21.15.2:0/95692901 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adcffb0 0x55cd0adcda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.632 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.623+0000 7fb7355c6740 1 --2- 172.21.15.2:0/95692901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc67a0 0x55cd0adcd500 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.623+0000 7fb7355c6740 1 --2- 172.21.15.2:0/95692901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adc5230 0x55cd0adccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.623+0000 7fb715600640 0 client.26227 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.623+0000 7fb7355c6740 1 -- 172.21.15.2:0/95692901 >> 172.21.15.2:0/95692901 conn(0x55cd0ad8dfb0 msgr2=0x55cd0adc7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.623+0000 7fb7355c6740 1 -- 172.21.15.2:0/95692901 shutdown_connections 2024-06-13T02:30:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.623+0000 7fb7355c6740 1 -- 172.21.15.2:0/95692901 wait complete. 2024-06-13T02:30:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.623+0000 7fb7355c6740 20 client.26227 trim_cache size 0 max 16384 2024-06-13T02:30:11.634 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:11 smithi002 ceph-mon[31960]: pgmap v390: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 88 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 1.8 MiB/s wr, 236 op/s 2024-06-13T02:30:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.640+0000 7fb7355c6740 1 Processor -- start 2024-06-13T02:30:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.641+0000 7fb7355c6740 1 -- start start 2024-06-13T02:30:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.641+0000 7fb7355c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc5230 0x55cd0ade80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.641+0000 7fb7355c6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adc67a0 0x55cd0ade8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.641+0000 7fb7355c6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adcffb0 0x55cd0adccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.641+0000 7fb7355c6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1b3a10 con 0x55cd0adcffb0 2024-06-13T02:30:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.641+0000 7fb7355c6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1b12e0 con 0x55cd0adc67a0 2024-06-13T02:30:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.641+0000 7fb7355c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1af150 con 0x55cd0adc5230 2024-06-13T02:30:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.641+0000 7fb72aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adc67a0 0x55cd0ade8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.641+0000 7fb72be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adcffb0 0x55cd0adccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.641+0000 7fb72b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc5230 0x55cd0ade80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.641+0000 7fb72be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adcffb0 0x55cd0adccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:39600/0 (socket says 172.21.15.2:39600) 2024-06-13T02:30:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.641+0000 7fb72aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adc67a0 0x55cd0ade8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:42890/0 (socket says 172.21.15.2:42890) 2024-06-13T02:30:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.641+0000 7fb72be00640 1 -- 172.21.15.2:0/3154681897 learned_addr learned my addr 172.21.15.2:0/3154681897 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.642+0000 7fb72aa00640 1 -- 172.21.15.2:0/3154681897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc5230 msgr2=0x55cd0ade80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.642+0000 7fb72aa00640 1 --2- 172.21.15.2:0/3154681897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc5230 0x55cd0ade80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.642+0000 7fb72aa00640 1 -- 172.21.15.2:0/3154681897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adcffb0 msgr2=0x55cd0adccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.642+0000 7fb72aa00640 1 --2- 172.21.15.2:0/3154681897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adcffb0 0x55cd0adccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.642+0000 7fb72aa00640 1 -- 172.21.15.2:0/3154681897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0adc6190 con 0x55cd0adc67a0 2024-06-13T02:30:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.642+0000 7fb72aa00640 1 --2- 172.21.15.2:0/3154681897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adc67a0 0x55cd0ade8600 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55cd0adce590 tx=0x7fb718005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93659098945c3851 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.642+0000 7fb717e00640 1 -- 172.21.15.2:0/3154681897 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71803c070 con 0x55cd0adc67a0 2024-06-13T02:30:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.642+0000 7fb717e00640 1 -- 172.21.15.2:0/3154681897 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7180097a0 con 0x55cd0adc67a0 2024-06-13T02:30:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.642+0000 7fb717e00640 1 -- 172.21.15.2:0/3154681897 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb718027050 con 0x55cd0adc67a0 2024-06-13T02:30:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.643+0000 7fb7355c6740 1 -- 172.21.15.2:0/3154681897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adc67a0 msgr2=0x55cd0ade8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.643+0000 7fb7355c6740 1 --2- 172.21.15.2:0/3154681897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adc67a0 0x55cd0ade8600 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x55cd0adce590 tx=0x7fb718005780 comp rx=0 tx=0).stop 2024-06-13T02:30:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.643+0000 7fb7355c6740 1 -- 172.21.15.2:0/3154681897 shutdown_connections 2024-06-13T02:30:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.643+0000 7fb7355c6740 1 --2- 172.21.15.2:0/3154681897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adcffb0 0x55cd0adccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.643+0000 7fb7355c6740 1 --2- 172.21.15.2:0/3154681897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adc67a0 0x55cd0ade8600 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.643+0000 7fb7355c6740 1 --2- 172.21.15.2:0/3154681897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc5230 0x55cd0ade80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.643+0000 7fb7355c6740 1 -- 172.21.15.2:0/3154681897 >> 172.21.15.2:0/3154681897 conn(0x55cd0ad8dfb0 msgr2=0x55cd0adc8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.643+0000 7fb7355c6740 1 -- 172.21.15.2:0/3154681897 shutdown_connections 2024-06-13T02:30:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.643+0000 7fb7355c6740 1 -- 172.21.15.2:0/3154681897 wait complete. 2024-06-13T02:30:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.644+0000 7fb7355c6740 1 -- start start 2024-06-13T02:30:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.644+0000 7fb7355c6740 1 Processor -- start 2024-06-13T02:30:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.644+0000 7fb7355c6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc5230 0x55cd0add8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.644+0000 7fb7355c6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adc67a0 0x55cd0add88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.644+0000 7fb7355c6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adcffb0 0x55cd0adc9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.651 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb7355c6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1af7a0 con 0x55cd0adc67a0 2024-06-13T02:30:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb7355c6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1b0c10 con 0x55cd0adcffb0 2024-06-13T02:30:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb7355c6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1afe70 con 0x55cd0adc5230 2024-06-13T02:30:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb7355c6740 10 client.0 _ll_register_callbacks cb 0x7fb71c0f3770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:30:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb72b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc5230 0x55cd0add8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb72b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc5230 0x55cd0add8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:58964/0 (socket says 172.21.15.2:58964) 2024-06-13T02:30:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb72b400640 1 -- 172.21.15.2:0/4067044307 learned_addr learned my addr 172.21.15.2:0/4067044307 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb72be00640 1 --2- 172.21.15.2:0/4067044307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adcffb0 0x55cd0adc9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb72aa00640 1 --2- 172.21.15.2:0/4067044307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adc67a0 0x55cd0add88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb72b400640 1 -- 172.21.15.2:0/4067044307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adcffb0 msgr2=0x55cd0adc9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb72b400640 1 --2- 172.21.15.2:0/4067044307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adcffb0 0x55cd0adc9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb72b400640 1 -- 172.21.15.2:0/4067044307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adc67a0 msgr2=0x55cd0add88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb72b400640 1 --2- 172.21.15.2:0/4067044307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adc67a0 0x55cd0add88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb72b400640 1 -- 172.21.15.2:0/4067044307 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0adc9e90 con 0x55cd0adc5230 2024-06-13T02:30:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb72b400640 1 --2- 172.21.15.2:0/4067044307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc5230 0x55cd0add8380 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0ed0c0 tx=0x7fb71c0dc040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a06297e3503bc252 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.645+0000 7fb715600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:30:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.646+0000 7fb715600640 1 -- 172.21.15.2:0/4067044307 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c049040 con 0x55cd0adc5230 2024-06-13T02:30:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.646+0000 7fb715600640 1 -- 172.21.15.2:0/4067044307 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9671+0+0 (secure 0 0 0) 0x7fb71c03b460 con 0x55cd0adc5230 2024-06-13T02:30:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.646+0000 7fb7355c6740 1 -- 172.21.15.2:0/4067044307 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7180097a0 con 0x55cd0adc5230 2024-06-13T02:30:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.646+0000 7fb715600640 1 -- 172.21.15.2:0/4067044307 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb71c0bb970 con 0x55cd0adc5230 2024-06-13T02:30:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.646+0000 7fb7355c6740 10 client.26233 fetch_fsmap learned FSMap version 37 2024-06-13T02:30:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.646+0000 7fb7355c6740 1 -- 172.21.15.2:0/4067044307 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55cd0ae4a9e0 con 0x55cd0adc5230 2024-06-13T02:30:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.646+0000 7fb715600640 1 -- 172.21.15.2:0/4067044307 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7180097a0 con 0x55cd0adc5230 2024-06-13T02:30:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.646+0000 7fb715600640 1 -- 172.21.15.2:0/4067044307 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 37) ==== 8346+0+0 (secure 0 0 0) 0x7fb71c0b84a0 con 0x55cd0adc5230 2024-06-13T02:30:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.646+0000 7fb7355c6740 10 client.26233 fetch_fsmap finished waiting for FSMap version 37 2024-06-13T02:30:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.646+0000 7fb7355c6740 10 client.26233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:30:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.646+0000 7fb7355c6740 20 client.26233 populate_metadata read hostname 'smithi002' 2024-06-13T02:30:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.646+0000 7fb7355c6740 1 --2- 172.21.15.2:0/4067044307 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd0ae4b100 0x55cd0ae4d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.646+0000 7fb7355c6740 4 client.26233 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:30:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.646+0000 7fb7355c6740 1 -- 172.21.15.2:0/4067044307 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cd0ad30ea0 con 0x55cd0ae4b100 2024-06-13T02:30:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.647+0000 7fb72aa00640 1 --2- 172.21.15.2:0/4067044307 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd0ae4b100 0x55cd0ae4d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.647+0000 7fb72aa00640 1 --2- 172.21.15.2:0/4067044307 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd0ae4b100 0x55cd0ae4d4f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2056283cef7f3b74 server_cookie=b3f9ca25d8a8a6c9 in_seq=0 out_seq=0 2024-06-13T02:30:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.647+0000 7fb715600640 10 client.26233 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:11.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:11 smithi084 ceph-mon[36833]: pgmap v390: 129 pgs: 20 active+clean+snaptrim, 56 active+clean+snaptrim_wait, 53 active+clean; 88 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 1.8 MiB/s wr, 236 op/s 2024-06-13T02:30:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.882+0000 7fb715600640 1 -- 172.21.15.2:0/4067044307 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55cd0ad30ea0 con 0x55cd0ae4b100 2024-06-13T02:30:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.882+0000 7fb715600640 10 client.26233 handle_command_reply: tid=0 2024-06-13T02:30:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.882+0000 7fb7355c6740 1 client.26233 shutdown 2024-06-13T02:30:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.882+0000 7fb7355c6740 1 -- 172.21.15.2:0/4067044307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc5230 msgr2=0x55cd0add8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.882+0000 7fb7355c6740 1 --2- 172.21.15.2:0/4067044307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc5230 0x55cd0add8380 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb71c0ed0c0 tx=0x7fb71c0dc040 comp rx=0 tx=0).stop 2024-06-13T02:30:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.882+0000 7fb7355c6740 1 -- 172.21.15.2:0/4067044307 shutdown_connections 2024-06-13T02:30:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.882+0000 7fb7355c6740 1 --2- 172.21.15.2:0/4067044307 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55cd0ae4b100 0x55cd0ae4d4f0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.882+0000 7fb7355c6740 1 --2- 172.21.15.2:0/4067044307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd0adcffb0 0x55cd0adc9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.882+0000 7fb7355c6740 1 --2- 172.21.15.2:0/4067044307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55cd0adc67a0 0x55cd0add88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.882+0000 7fb7355c6740 1 --2- 172.21.15.2:0/4067044307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cd0adc5230 0x55cd0add8380 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.882+0000 7fb7355c6740 1 -- 172.21.15.2:0/4067044307 >> 172.21.15.2:0/4067044307 conn(0x55cd0ad8dfb0 msgr2=0x55cd0adc0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.882+0000 7fb715600640 0 client.26233 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.883+0000 7fb7355c6740 1 -- 172.21.15.2:0/4067044307 shutdown_connections 2024-06-13T02:30:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.883+0000 7fb7355c6740 1 -- 172.21.15.2:0/4067044307 wait complete. 2024-06-13T02:30:11.884 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.883+0000 7fb7355c6740 20 client.26233 trim_cache size 0 max 16384 2024-06-13T02:30:11.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:30:11.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:30:11.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:30:11.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.884+0000 7fb731000640 1 -- 172.21.15.2:0/856846349 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fb7100a2e30 msgr2=0x7fb7100a52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:11.885 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.884+0000 7fb731000640 1 --2- 172.21.15.2:0/856846349 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fb7100a2e30 0x7fb7100a52f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb7240125f0 tx=0x7fb724009500 comp rx=0 tx=0).stop 2024-06-13T02:30:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.884+0000 7fb731000640 1 -- 172.21.15.2:0/856846349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb72c102a00 msgr2=0x7fb72c100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.884+0000 7fb731000640 1 --2- 172.21.15.2:0/856846349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb72c102a00 0x7fb72c100650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb71c004770 tx=0x7fb71c003c10 comp rx=0 tx=0).stop 2024-06-13T02:30:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.884+0000 7fb731000640 1 -- 172.21.15.2:0/856846349 shutdown_connections 2024-06-13T02:30:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.884+0000 7fb731000640 1 --2- 172.21.15.2:0/856846349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb72c10bdd0 0x7fb72c1010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.884+0000 7fb731000640 1 --2- 172.21.15.2:0/856846349 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fb7100a2e30 0x7fb7100a52f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.884+0000 7fb731000640 1 --2- 172.21.15.2:0/856846349 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb72c103320 0x7fb72c100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.884+0000 7fb731000640 1 --2- 172.21.15.2:0/856846349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb72c102a00 0x7fb72c100650 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.884+0000 7fb731000640 1 -- 172.21.15.2:0/856846349 >> 172.21.15.2:0/856846349 conn(0x7fb72c0fc180 msgr2=0x7fb72c0fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.884+0000 7fb731000640 1 -- 172.21.15.2:0/856846349 shutdown_connections 2024-06-13T02:30:11.886 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:11.884+0000 7fb731000640 1 -- 172.21.15.2:0/856846349 wait complete. 2024-06-13T02:30:12.567 INFO:tasks.workunit.client.0.smithi002.stdout: 1 867883 6.74 MB/sec execute 556 sec latency 135.263 ms 2024-06-13T02:30:13.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:13 smithi175 ceph-mon[36977]: pgmap v391: 129 pgs: 129 active+clean; 77 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.8 MiB/s wr, 142 op/s 2024-06-13T02:30:13.568 INFO:tasks.workunit.client.0.smithi002.stdout: 1 869284 6.74 MB/sec execute 557 sec latency 56.107 ms 2024-06-13T02:30:13.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:13 smithi002 ceph-mon[31960]: pgmap v391: 129 pgs: 129 active+clean; 77 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.8 MiB/s wr, 142 op/s 2024-06-13T02:30:13.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:13 smithi084 ceph-mon[36833]: pgmap v391: 129 pgs: 129 active+clean; 77 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.8 MiB/s wr, 142 op/s 2024-06-13T02:30:14.568 INFO:tasks.workunit.client.0.smithi002.stdout: 1 870317 6.74 MB/sec execute 558 sec latency 25.839 ms 2024-06-13T02:30:14.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:14 smithi084 ceph-mon[36833]: osdmap e119: 12 total, 12 up, 12 in 2024-06-13T02:30:14.970 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:14 smithi084 ceph-mon[36833]: pgmap v393: 129 pgs: 129 active+clean; 77 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 161 op/s 2024-06-13T02:30:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:14 smithi175 ceph-mon[36977]: osdmap e119: 12 total, 12 up, 12 in 2024-06-13T02:30:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:14 smithi175 ceph-mon[36977]: pgmap v393: 129 pgs: 129 active+clean; 77 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 161 op/s 2024-06-13T02:30:15.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:14 smithi002 ceph-mon[31960]: osdmap e119: 12 total, 12 up, 12 in 2024-06-13T02:30:15.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:14 smithi002 ceph-mon[31960]: pgmap v393: 129 pgs: 129 active+clean; 77 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 161 op/s 2024-06-13T02:30:15.568 INFO:tasks.workunit.client.0.smithi002.stdout: 1 871288 6.74 MB/sec execute 559 sec latency 22.911 ms 2024-06-13T02:30:16.568 INFO:tasks.workunit.client.0.smithi002.stdout: 1 872603 6.74 MB/sec execute 560 sec latency 42.619 ms 2024-06-13T02:30:17.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:17 smithi002 ceph-mon[31960]: pgmap v394: 129 pgs: 129 active+clean; 77 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 2.2 MiB/s wr, 206 op/s 2024-06-13T02:30:17.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:17 smithi084 ceph-mon[36833]: pgmap v394: 129 pgs: 129 active+clean; 77 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 2.2 MiB/s wr, 206 op/s 2024-06-13T02:30:17.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:17 smithi175 ceph-mon[36977]: pgmap v394: 129 pgs: 129 active+clean; 77 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 2.2 MiB/s wr, 206 op/s 2024-06-13T02:30:17.568 INFO:tasks.workunit.client.0.smithi002.stdout: 1 873791 6.74 MB/sec execute 561 sec latency 30.395 ms 2024-06-13T02:30:18.568 INFO:tasks.workunit.client.0.smithi002.stdout: 1 874803 6.74 MB/sec execute 562 sec latency 36.503 ms 2024-06-13T02:30:19.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:19 smithi002 ceph-mon[31960]: pgmap v395: 129 pgs: 129 active+clean; 74 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 238 op/s 2024-06-13T02:30:19.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:19 smithi084 ceph-mon[36833]: pgmap v395: 129 pgs: 129 active+clean; 74 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 238 op/s 2024-06-13T02:30:19.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:19 smithi175 ceph-mon[36977]: pgmap v395: 129 pgs: 129 active+clean; 74 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 238 op/s 2024-06-13T02:30:19.568 INFO:tasks.workunit.client.0.smithi002.stdout: 1 876158 6.74 MB/sec execute 563 sec latency 23.914 ms 2024-06-13T02:30:20.568 INFO:tasks.workunit.client.0.smithi002.stdout: 1 877139 6.74 MB/sec execute 564 sec latency 25.975 ms 2024-06-13T02:30:21.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:21 smithi002 ceph-mon[31960]: pgmap v396: 129 pgs: 129 active+clean; 74 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 238 op/s 2024-06-13T02:30:21.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:21 smithi084 ceph-mon[36833]: pgmap v396: 129 pgs: 129 active+clean; 74 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 238 op/s 2024-06-13T02:30:21.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:21 smithi175 ceph-mon[36977]: pgmap v396: 129 pgs: 129 active+clean; 74 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 238 op/s 2024-06-13T02:30:21.568 INFO:tasks.workunit.client.0.smithi002.stdout: 1 878083 6.73 MB/sec execute 565 sec latency 20.936 ms 2024-06-13T02:30:22.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:22 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:30:22.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:22 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:30:22.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:22 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:30:22.569 INFO:tasks.workunit.client.0.smithi002.stdout: 1 879528 6.73 MB/sec execute 566 sec latency 33.625 ms 2024-06-13T02:30:23.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:23 smithi002 ceph-mon[31960]: pgmap v397: 129 pgs: 129 active+clean; 78 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 238 op/s 2024-06-13T02:30:23.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:23 smithi084 ceph-mon[36833]: pgmap v397: 129 pgs: 129 active+clean; 78 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 238 op/s 2024-06-13T02:30:23.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:23 smithi175 ceph-mon[36977]: pgmap v397: 129 pgs: 129 active+clean; 78 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 238 op/s 2024-06-13T02:30:23.569 INFO:tasks.workunit.client.0.smithi002.stdout: 1 880593 6.74 MB/sec execute 567 sec latency 99.756 ms 2024-06-13T02:30:24.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:24 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:30:24.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:24 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:30:24.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:24 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:30:24.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:24 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:30:24.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:24 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:30:24.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:24 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:30:24.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:24 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:30:24.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:24 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:30:24.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:24 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:30:24.569 INFO:tasks.workunit.client.0.smithi002.stdout: 1 881281 6.73 MB/sec execute 568 sec latency 19.901 ms 2024-06-13T02:30:25.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.037+0000 7f3aea200640 1 -- 172.21.15.2:0/1218102829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ae4101990 msgr2=0x7f3ae4101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:25.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.037+0000 7f3aea200640 1 --2- 172.21.15.2:0/1218102829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ae4101990 0x7f3ae4101e10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009900 tx=0x7f3ad002a3f0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.037+0000 7f3aea200640 1 -- 172.21.15.2:0/1218102829 shutdown_connections 2024-06-13T02:30:25.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.037+0000 7f3aea200640 1 --2- 172.21.15.2:0/1218102829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4102350 0x7f3ae410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.037+0000 7f3aea200640 1 --2- 172.21.15.2:0/1218102829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ae4101990 0x7f3ae4101e10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.037+0000 7f3aea200640 1 --2- 172.21.15.2:0/1218102829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ae41079a0 0x7f3ae4107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.037+0000 7f3aea200640 1 -- 172.21.15.2:0/1218102829 >> 172.21.15.2:0/1218102829 conn(0x7f3ae40fd460 msgr2=0x7f3ae40ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:25.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.037+0000 7f3aea200640 1 -- 172.21.15.2:0/1218102829 shutdown_connections 2024-06-13T02:30:25.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.037+0000 7f3aea200640 1 -- 172.21.15.2:0/1218102829 wait complete. 2024-06-13T02:30:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.038+0000 7f3aea200640 1 Processor -- start 2024-06-13T02:30:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.038+0000 7f3aea200640 1 -- start start 2024-06-13T02:30:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.039+0000 7f3aea200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ae4101990 0x7f3ae41981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.039+0000 7f3aea200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4102350 0x7f3ae4198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.039+0000 7f3aea200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ae41079a0 0x7f3ae419caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.039+0000 7f3aea200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae4111e00 con 0x7f3ae4102350 2024-06-13T02:30:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.039+0000 7f3aea200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae4111c80 con 0x7f3ae4101990 2024-06-13T02:30:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.039+0000 7f3aea200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae4111f80 con 0x7f3ae41079a0 2024-06-13T02:30:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.039+0000 7f3ae2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4102350 0x7f3ae4198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.039+0000 7f3ae3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ae41079a0 0x7f3ae419caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.039+0000 7f3ae3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ae4101990 0x7f3ae41981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.039+0000 7f3ae2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4102350 0x7f3ae4198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:33970/0 (socket says 172.21.15.2:33970) 2024-06-13T02:30:25.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.039+0000 7f3ae3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ae4101990 0x7f3ae41981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:44060/0 (socket says 172.21.15.2:44060) 2024-06-13T02:30:25.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.039+0000 7f3ae2a00640 1 -- 172.21.15.2:0/36879270 learned_addr learned my addr 172.21.15.2:0/36879270 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.040+0000 7f3ae3e00640 1 -- 172.21.15.2:0/36879270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ae4101990 msgr2=0x7f3ae41981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.040+0000 7f3ae3e00640 1 --2- 172.21.15.2:0/36879270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ae4101990 0x7f3ae41981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.040+0000 7f3ae3e00640 1 -- 172.21.15.2:0/36879270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4102350 msgr2=0x7f3ae4198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.040+0000 7f3ae3e00640 1 --2- 172.21.15.2:0/36879270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4102350 0x7f3ae4198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.040+0000 7f3ae3e00640 1 -- 172.21.15.2:0/36879270 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae419d1d0 con 0x7f3ae41079a0 2024-06-13T02:30:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.040+0000 7f3ae3400640 1 --2- 172.21.15.2:0/36879270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ae4101990 0x7f3ae41981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:30:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.040+0000 7f3ae2a00640 1 --2- 172.21.15.2:0/36879270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4102350 0x7f3ae4198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:30:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.040+0000 7f3ae3e00640 1 --2- 172.21.15.2:0/36879270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ae41079a0 0x7f3ae419caa0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00cab0 tx=0x7f3adc00cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.040+0000 7f3adbe00640 1 -- 172.21.15.2:0/36879270 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc00ae20 con 0x7f3ae41079a0 2024-06-13T02:30:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.040+0000 7f3adbe00640 1 -- 172.21.15.2:0/36879270 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3adc00f930 con 0x7f3ae41079a0 2024-06-13T02:30:25.042 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.040+0000 7f3aea200640 1 -- 172.21.15.2:0/36879270 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae419d4c0 con 0x7f3ae41079a0 2024-06-13T02:30:25.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.040+0000 7f3adbe00640 1 -- 172.21.15.2:0/36879270 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc018b30 con 0x7f3ae41079a0 2024-06-13T02:30:25.043 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.040+0000 7f3aea200640 1 -- 172.21.15.2:0/36879270 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae41a4d50 con 0x7f3ae41079a0 2024-06-13T02:30:25.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.044+0000 7f3adbe00640 1 -- 172.21.15.2:0/36879270 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f3adc00fae0 con 0x7f3ae41079a0 2024-06-13T02:30:25.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.044+0000 7f3aed1d2740 1 Processor -- start 2024-06-13T02:30:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.044+0000 7f3aed1d2740 1 -- start start 2024-06-13T02:30:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.045+0000 7f3aed1d2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe576d5e0 0x55dbe576bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.045+0000 7f3aed1d2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe576c070 0x55dbe576c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.045+0000 7f3aed1d2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe5776df0 0x55dbe57791e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.045+0000 7f3aed1d2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dbe56d0420 con 0x55dbe576c070 2024-06-13T02:30:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.045+0000 7f3aed1d2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55dbe5677c50 con 0x55dbe5776df0 2024-06-13T02:30:25.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.045+0000 7f3aed1d2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dbe56cc3e0 con 0x55dbe576d5e0 2024-06-13T02:30:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.045+0000 7f3ae2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe5776df0 0x55dbe57791e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.045+0000 7f3ae2a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe5776df0 0x55dbe57791e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:44070/0 (socket says 172.21.15.2:44070) 2024-06-13T02:30:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.045+0000 7f3ae2a00640 1 -- 172.21.15.2:0/2576388849 learned_addr learned my addr 172.21.15.2:0/2576388849 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.045+0000 7f3ae3400640 1 --2- 172.21.15.2:0/2576388849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe576c070 0x55dbe576c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.045+0000 7f3ae2a00640 1 --2- 172.21.15.2:0/2576388849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe576d5e0 0x55dbe576bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.046+0000 7f3ae2a00640 1 -- 172.21.15.2:0/2576388849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe576d5e0 msgr2=0x55dbe576bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.046+0000 7f3ae2a00640 1 --2- 172.21.15.2:0/2576388849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe576d5e0 0x55dbe576bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.046+0000 7f3ae2a00640 1 -- 172.21.15.2:0/2576388849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe576c070 msgr2=0x55dbe576c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.046+0000 7f3ae2a00640 1 --2- 172.21.15.2:0/2576388849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe576c070 0x55dbe576c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.046+0000 7f3ae2a00640 1 -- 172.21.15.2:0/2576388849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbe53e4210 con 0x55dbe5776df0 2024-06-13T02:30:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.046+0000 7f3ae2a00640 1 --2- 172.21.15.2:0/2576388849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe5776df0 0x55dbe57791e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0003b50 tx=0x7f3ad002a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63305b266aa078f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.046+0000 7f3adbe00640 1 --2- 172.21.15.2:0/36879270 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f3ac80a2cf0 0x7f3ac80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.046+0000 7f3acfe00640 1 -- 172.21.15.2:0/2576388849 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0035030 con 0x55dbe5776df0 2024-06-13T02:30:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.046+0000 7f3acfe00640 1 -- 172.21.15.2:0/2576388849 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ad0003db0 con 0x55dbe5776df0 2024-06-13T02:30:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.046+0000 7f3acfe00640 1 -- 172.21.15.2:0/2576388849 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad003d7d0 con 0x55dbe5776df0 2024-06-13T02:30:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.047+0000 7f3adbe00640 1 -- 172.21.15.2:0/36879270 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 9583+0+0 (secure 0 0 0) 0x7f3adc0cffb0 con 0x7f3ae41079a0 2024-06-13T02:30:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.047+0000 7f3ae3400640 1 --2- 172.21.15.2:0/36879270 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f3ac80a2cf0 0x7f3ac80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.047+0000 7f3aed1d2740 1 -- 172.21.15.2:0/2576388849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe5776df0 msgr2=0x55dbe57791e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:25.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.047+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/2576388849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe5776df0 0x55dbe57791e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0003b50 tx=0x7f3ad002a3f0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.047+0000 7f3aed1d2740 1 -- 172.21.15.2:0/2576388849 shutdown_connections 2024-06-13T02:30:25.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.047+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/2576388849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe5776df0 0x55dbe57791e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.047+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/2576388849 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe576c070 0x55dbe576c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.047+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/2576388849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe576d5e0 0x55dbe576bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.047+0000 7f3aed1d2740 1 -- 172.21.15.2:0/2576388849 >> 172.21.15.2:0/2576388849 conn(0x55dbe5734fb0 msgr2=0x55dbe5768660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:25.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.047+0000 7f3aed1d2740 1 -- 172.21.15.2:0/2576388849 shutdown_connections 2024-06-13T02:30:25.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.048+0000 7f3aed1d2740 1 -- 172.21.15.2:0/2576388849 wait complete. 2024-06-13T02:30:25.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.048+0000 7f3ae3400640 1 --2- 172.21.15.2:0/36879270 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f3ac80a2cf0 0x7f3ac80a51b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55dbe576ed40 tx=0x7f3ad4005f90 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:25.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.048+0000 7f3aed1d2740 1 -- start start 2024-06-13T02:30:25.050 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.048+0000 7f3aed1d2740 1 Processor -- start 2024-06-13T02:30:25.052 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3aed1d2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576c070 0x55dbe5773e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3aed1d2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe576d5e0 0x55dbe57743b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3aed1d2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe5776df0 0x55dbe57748f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3aed1d2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55dbe577df70 con 0x55dbe576d5e0 2024-06-13T02:30:25.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3aed1d2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55dbe568b0b0 con 0x55dbe576c070 2024-06-13T02:30:25.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3aed1d2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55dbe577e0f0 con 0x55dbe5776df0 2024-06-13T02:30:25.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3aed1d2740 10 client.0 _ll_register_callbacks cb 0x55dbe5676f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:30:25.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3ae3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576c070 0x55dbe5773e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3ae3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe5776df0 0x55dbe57748f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3ae3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576c070 0x55dbe5773e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:44074/0 (socket says 172.21.15.2:44074) 2024-06-13T02:30:25.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3ae3400640 1 -- 172.21.15.2:0/1797712613 learned_addr learned my addr 172.21.15.2:0/1797712613 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:25.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3ae2a00640 1 --2- 172.21.15.2:0/1797712613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe576d5e0 0x55dbe57743b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.053 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3ae3e00640 1 -- 172.21.15.2:0/1797712613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576c070 msgr2=0x55dbe5773e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:25.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3ae3e00640 1 --2- 172.21.15.2:0/1797712613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576c070 0x55dbe5773e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3ae3e00640 1 -- 172.21.15.2:0/1797712613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe576d5e0 msgr2=0x55dbe57743b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:25.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3ae3e00640 1 --2- 172.21.15.2:0/1797712613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe576d5e0 0x55dbe57743b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.049+0000 7f3ae3e00640 1 -- 172.21.15.2:0/1797712613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbe54b0620 con 0x55dbe5776df0 2024-06-13T02:30:25.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.050+0000 7f3ae3e00640 1 --2- 172.21.15.2:0/1797712613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe5776df0 0x55dbe57748f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0cd280 tx=0x7f3adc018400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e696a4c0bddddfce server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:25.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.050+0000 7f3accc00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:30:25.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.050+0000 7f3accc00640 1 -- 172.21.15.2:0/1797712613 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc0a0400 con 0x55dbe5776df0 2024-06-13T02:30:25.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.050+0000 7f3accc00640 1 -- 172.21.15.2:0/1797712613 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 9583+0+0 (secure 0 0 0) 0x7f3adc0cd500 con 0x55dbe5776df0 2024-06-13T02:30:25.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.050+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1797712613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ad0003db0 con 0x55dbe5776df0 2024-06-13T02:30:25.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.050+0000 7f3accc00640 1 -- 172.21.15.2:0/1797712613 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3adc0b5020 con 0x55dbe5776df0 2024-06-13T02:30:25.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.050+0000 7f3aed1d2740 10 client.26245 fetch_fsmap learned FSMap version 37 2024-06-13T02:30:25.054 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.050+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1797712613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55dbe578a3b0 con 0x55dbe5776df0 2024-06-13T02:30:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.050+0000 7f3accc00640 1 -- 172.21.15.2:0/1797712613 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ad0003db0 con 0x55dbe5776df0 2024-06-13T02:30:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.051+0000 7f3accc00640 1 -- 172.21.15.2:0/1797712613 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 37) ==== 8346+0+0 (secure 0 0 0) 0x7f3adc004b40 con 0x55dbe5776df0 2024-06-13T02:30:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.051+0000 7f3aed1d2740 10 client.26245 fetch_fsmap finished waiting for FSMap version 37 2024-06-13T02:30:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.051+0000 7f3aed1d2740 10 client.26245 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:30:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.051+0000 7f3aed1d2740 20 client.26245 populate_metadata read hostname 'smithi002' 2024-06-13T02:30:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.051+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/1797712613 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55dbe578b870 0x55dbe578dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.051+0000 7f3aed1d2740 4 client.26245 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:30:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.051+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1797712613 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbe56ddb50 con 0x55dbe578b870 2024-06-13T02:30:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.051+0000 7f3ae3400640 1 --2- 172.21.15.2:0/1797712613 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55dbe578b870 0x55dbe578dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.052+0000 7f3ae3400640 1 --2- 172.21.15.2:0/1797712613 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55dbe578b870 0x55dbe578dc60 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=678cbfbd74cf17bd server_cookie=2e494a5ee23ecf3d in_seq=0 out_seq=0 2024-06-13T02:30:25.055 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.052+0000 7f3accc00640 10 client.26245 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:25.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.052+0000 7f3accc00640 1 -- 172.21.15.2:0/1797712613 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55dbe56ddb50 con 0x55dbe578b870 2024-06-13T02:30:25.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.052+0000 7f3accc00640 10 client.26245 handle_command_reply: tid=0 2024-06-13T02:30:25.056 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.052+0000 7f3aed1d2740 1 client.26245 shutdown 2024-06-13T02:30:25.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.053+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1797712613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe5776df0 msgr2=0x55dbe57748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:25.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.053+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/1797712613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe5776df0 0x55dbe57748f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0cd280 tx=0x7f3adc018400 comp rx=0 tx=0).stop 2024-06-13T02:30:25.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.053+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1797712613 shutdown_connections 2024-06-13T02:30:25.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.053+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/1797712613 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55dbe578b870 0x55dbe578dc60 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.053+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/1797712613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe5776df0 0x55dbe57748f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.053+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/1797712613 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe576d5e0 0x55dbe57743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.053+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/1797712613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576c070 0x55dbe5773e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.053+0000 7f3accc00640 0 client.26245 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:25.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.053+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1797712613 >> 172.21.15.2:0/1797712613 conn(0x55dbe5734fb0 msgr2=0x55dbe576e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:25.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.053+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1797712613 shutdown_connections 2024-06-13T02:30:25.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.053+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1797712613 wait complete. 2024-06-13T02:30:25.057 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.053+0000 7f3aed1d2740 20 client.26245 trim_cache size 0 max 16384 2024-06-13T02:30:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.075+0000 7f3aed1d2740 1 Processor -- start 2024-06-13T02:30:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.075+0000 7f3aed1d2740 1 -- start start 2024-06-13T02:30:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.076+0000 7f3aed1d2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe576c070 0x55dbe57687b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.076 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.076+0000 7f3aed1d2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576d5e0 0x55dbe5793550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.077 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.076+0000 7f3aed1d2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe5776df0 0x55dbe5793a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.077 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.076+0000 7f3aed1d2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae41af690 con 0x55dbe5776df0 2024-06-13T02:30:25.077 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.076+0000 7f3aed1d2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae41acf60 con 0x55dbe576d5e0 2024-06-13T02:30:25.077 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.076+0000 7f3aed1d2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae41aadd0 con 0x55dbe576c070 2024-06-13T02:30:25.077 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.076+0000 7f3ae3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe576c070 0x55dbe57687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.076+0000 7f3ae3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe576c070 0x55dbe57687b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:59818/0 (socket says 172.21.15.2:59818) 2024-06-13T02:30:25.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.076+0000 7f3ae3400640 1 -- 172.21.15.2:0/3444320800 learned_addr learned my addr 172.21.15.2:0/3444320800 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:25.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.076+0000 7f3ae3e00640 1 --2- 172.21.15.2:0/3444320800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe5776df0 0x55dbe5793a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.076+0000 7f3ae2a00640 1 --2- 172.21.15.2:0/3444320800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576d5e0 0x55dbe5793550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.077+0000 7f3ae3400640 1 -- 172.21.15.2:0/3444320800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576d5e0 msgr2=0x55dbe5793550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:25.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.077+0000 7f3ae3400640 1 --2- 172.21.15.2:0/3444320800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576d5e0 0x55dbe5793550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.078 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.077+0000 7f3ae3400640 1 -- 172.21.15.2:0/3444320800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe5776df0 msgr2=0x55dbe5793a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.077+0000 7f3ae3400640 1 --2- 172.21.15.2:0/3444320800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe5776df0 0x55dbe5793a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.077+0000 7f3ae3400640 1 -- 172.21.15.2:0/3444320800 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbe578e2c0 con 0x55dbe576c070 2024-06-13T02:30:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.077+0000 7f3ae2a00640 1 --2- 172.21.15.2:0/3444320800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576d5e0 0x55dbe5793550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:30:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.077+0000 7f3ae3400640 1 --2- 172.21.15.2:0/3444320800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe576c070 0x55dbe57687b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4012dc0 tx=0x7f3ad4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f575bec034a97310 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.077+0000 7f3acf400640 1 -- 172.21.15.2:0/3444320800 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad400fde0 con 0x55dbe576c070 2024-06-13T02:30:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.077+0000 7f3acf400640 1 -- 172.21.15.2:0/3444320800 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ad401d860 con 0x55dbe576c070 2024-06-13T02:30:25.079 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.077+0000 7f3acf400640 1 -- 172.21.15.2:0/3444320800 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad40053e0 con 0x55dbe576c070 2024-06-13T02:30:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.078+0000 7f3aed1d2740 1 -- 172.21.15.2:0/3444320800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe576c070 msgr2=0x55dbe57687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.078+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/3444320800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe576c070 0x55dbe57687b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4012dc0 tx=0x7f3ad4017000 comp rx=0 tx=0).stop 2024-06-13T02:30:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.078+0000 7f3aed1d2740 1 -- 172.21.15.2:0/3444320800 shutdown_connections 2024-06-13T02:30:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.078+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/3444320800 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe5776df0 0x55dbe5793a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.078+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/3444320800 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576d5e0 0x55dbe5793550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.078+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/3444320800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe576c070 0x55dbe57687b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.080 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.078+0000 7f3aed1d2740 1 -- 172.21.15.2:0/3444320800 >> 172.21.15.2:0/3444320800 conn(0x55dbe5734fb0 msgr2=0x55dbe57680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.078+0000 7f3aed1d2740 1 -- 172.21.15.2:0/3444320800 shutdown_connections 2024-06-13T02:30:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.079+0000 7f3aed1d2740 1 -- 172.21.15.2:0/3444320800 wait complete. 2024-06-13T02:30:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.079+0000 7f3aed1d2740 1 -- start start 2024-06-13T02:30:25.081 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.079+0000 7f3aed1d2740 1 Processor -- start 2024-06-13T02:30:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.080+0000 7f3aed1d2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576c070 0x55dbe5783890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.080+0000 7f3aed1d2740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe576d5e0 0x55dbe577ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.080+0000 7f3aed1d2740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe5776df0 0x55dbe577f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.080+0000 7f3aed1d2740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae41ab420 con 0x55dbe576d5e0 2024-06-13T02:30:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.080+0000 7f3aed1d2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae41ac890 con 0x55dbe576c070 2024-06-13T02:30:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.080+0000 7f3aed1d2740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae41abaf0 con 0x55dbe5776df0 2024-06-13T02:30:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.080+0000 7f3aed1d2740 10 client.0 _ll_register_callbacks cb 0x7f3adc00fe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:30:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.083+0000 7f3ae3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576c070 0x55dbe5783890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.083+0000 7f3ae3400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576c070 0x55dbe5783890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:44092/0 (socket says 172.21.15.2:44092) 2024-06-13T02:30:25.084 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.083+0000 7f3ae3400640 1 -- 172.21.15.2:0/1727936887 learned_addr learned my addr 172.21.15.2:0/1727936887 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.083+0000 7f3ae3400640 1 -- 172.21.15.2:0/1727936887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe5776df0 msgr2=0x55dbe577f140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-13T02:30:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.083+0000 7f3ae3400640 1 --2- 172.21.15.2:0/1727936887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe5776df0 0x55dbe577f140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.083+0000 7f3ae3400640 1 -- 172.21.15.2:0/1727936887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe576d5e0 msgr2=0x55dbe577ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.083+0000 7f3ae3400640 1 --2- 172.21.15.2:0/1727936887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe576d5e0 0x55dbe577ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.083+0000 7f3ae3400640 1 -- 172.21.15.2:0/1727936887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbe577f700 con 0x55dbe576c070 2024-06-13T02:30:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.084+0000 7f3ae3400640 1 --2- 172.21.15.2:0/1727936887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576c070 0x55dbe5783890 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3ad400f5c0 tx=0x7f3ad400f5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91ab7802d9fc9ad5 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:25.085 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.084+0000 7f3accc00640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:30:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.085+0000 7f3accc00640 1 -- 172.21.15.2:0/1727936887 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad401dcd0 con 0x55dbe576c070 2024-06-13T02:30:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.085+0000 7f3accc00640 1 -- 172.21.15.2:0/1727936887 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 9583+0+0 (secure 0 0 0) 0x7f3ad4005120 con 0x55dbe576c070 2024-06-13T02:30:25.086 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.085+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1727936887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ad401d860 con 0x55dbe576c070 2024-06-13T02:30:25.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.086+0000 7f3accc00640 1 -- 172.21.15.2:0/1727936887 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3ad4005320 con 0x55dbe576c070 2024-06-13T02:30:25.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.086+0000 7f3aed1d2740 10 client.26264 fetch_fsmap learned FSMap version 37 2024-06-13T02:30:25.087 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.086+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1727936887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55dbe57f62e0 con 0x55dbe576c070 2024-06-13T02:30:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.087+0000 7f3accc00640 1 -- 172.21.15.2:0/1727936887 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ad401d860 con 0x55dbe576c070 2024-06-13T02:30:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.087+0000 7f3accc00640 1 -- 172.21.15.2:0/1727936887 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 37) ==== 8346+0+0 (secure 0 0 0) 0x7f3ad403a020 con 0x55dbe576c070 2024-06-13T02:30:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.087+0000 7f3aed1d2740 10 client.26264 fetch_fsmap finished waiting for FSMap version 37 2024-06-13T02:30:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.087+0000 7f3aed1d2740 10 client.26264 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:30:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.087+0000 7f3aed1d2740 20 client.26264 populate_metadata read hostname 'smithi002' 2024-06-13T02:30:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.087+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/1727936887 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55dbe57f6920 0x55dbe57f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.087+0000 7f3aed1d2740 4 client.26264 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:30:25.088 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.087+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1727936887 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dbe56d7ea0 con 0x55dbe57f6920 2024-06-13T02:30:25.089 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.089+0000 7f3ae2a00640 1 --2- 172.21.15.2:0/1727936887 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55dbe57f6920 0x55dbe57f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.093+0000 7f3accc00640 10 client.26264 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:25.094 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.093+0000 7f3ae2a00640 1 --2- 172.21.15.2:0/1727936887 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55dbe57f6920 0x55dbe57f8d60 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5212985fbd5a8689 server_cookie=87b1ee6d4673093d in_seq=0 out_seq=0 2024-06-13T02:30:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.366+0000 7f3accc00640 1 -- 172.21.15.2:0/1727936887 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55dbe56d7ea0 con 0x55dbe57f6920 2024-06-13T02:30:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.366+0000 7f3accc00640 10 client.26264 handle_command_reply: tid=0 2024-06-13T02:30:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.366+0000 7f3aed1d2740 1 client.26264 shutdown 2024-06-13T02:30:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.367+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1727936887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576c070 msgr2=0x55dbe5783890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.367+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/1727936887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576c070 0x55dbe5783890 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3ad400f5c0 tx=0x7f3ad400f5f0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.367+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1727936887 shutdown_connections 2024-06-13T02:30:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.367+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/1727936887 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55dbe57f6920 0x55dbe57f8d60 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.367+0000 7f3accc00640 0 client.26264 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.367+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/1727936887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dbe5776df0 0x55dbe577f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.367+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/1727936887 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55dbe576d5e0 0x55dbe577ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.367+0000 7f3aed1d2740 1 --2- 172.21.15.2:0/1727936887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dbe576c070 0x55dbe5783890 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.368 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.367+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1727936887 >> 172.21.15.2:0/1727936887 conn(0x55dbe5734fb0 msgr2=0x55dbe57756a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.368+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1727936887 shutdown_connections 2024-06-13T02:30:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.368+0000 7f3aed1d2740 1 -- 172.21.15.2:0/1727936887 wait complete. 2024-06-13T02:30:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.368+0000 7f3aed1d2740 20 client.26264 trim_cache size 0 max 16384 2024-06-13T02:30:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:30:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:30:25.369 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:30:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.369+0000 7f3aea200640 1 -- 172.21.15.2:0/36879270 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f3ac80a2cf0 msgr2=0x7f3ac80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.369+0000 7f3aea200640 1 --2- 172.21.15.2:0/36879270 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f3ac80a2cf0 0x7f3ac80a51b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55dbe576ed40 tx=0x7f3ad4005f90 comp rx=0 tx=0).stop 2024-06-13T02:30:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.369+0000 7f3aea200640 1 -- 172.21.15.2:0/36879270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ae41079a0 msgr2=0x7f3ae419caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.369+0000 7f3aea200640 1 --2- 172.21.15.2:0/36879270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ae41079a0 0x7f3ae419caa0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00cab0 tx=0x7f3adc00cf70 comp rx=0 tx=0).stop 2024-06-13T02:30:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.369+0000 7f3aea200640 1 -- 172.21.15.2:0/36879270 shutdown_connections 2024-06-13T02:30:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.369+0000 7f3aea200640 1 --2- 172.21.15.2:0/36879270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ae41079a0 0x7f3ae419caa0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.370 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.369+0000 7f3aea200640 1 --2- 172.21.15.2:0/36879270 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f3ac80a2cf0 0x7f3ac80a51b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.369+0000 7f3aea200640 1 --2- 172.21.15.2:0/36879270 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ae4102350 0x7f3ae4198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.369+0000 7f3aea200640 1 --2- 172.21.15.2:0/36879270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ae4101990 0x7f3ae41981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:25.371 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.369+0000 7f3aea200640 1 -- 172.21.15.2:0/36879270 >> 172.21.15.2:0/36879270 conn(0x7f3ae40fd460 msgr2=0x7f3ae40fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:25.371 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:25 smithi084 ceph-mon[36833]: pgmap v398: 129 pgs: 129 active+clean; 78 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 232 op/s 2024-06-13T02:30:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.370+0000 7f3aea200640 1 -- 172.21.15.2:0/36879270 shutdown_connections 2024-06-13T02:30:25.372 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:25.370+0000 7f3aea200640 1 -- 172.21.15.2:0/36879270 wait complete. 2024-06-13T02:30:25.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:25 smithi002 ceph-mon[31960]: pgmap v398: 129 pgs: 129 active+clean; 78 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 232 op/s 2024-06-13T02:30:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:25 smithi175 ceph-mon[36977]: pgmap v398: 129 pgs: 129 active+clean; 78 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 232 op/s 2024-06-13T02:30:25.569 INFO:tasks.workunit.client.0.smithi002.stdout: 1 882144 6.72 MB/sec execute 569 sec latency 174.640 ms 2024-06-13T02:30:26.569 INFO:tasks.workunit.client.0.smithi002.stdout: 1 883760 6.73 MB/sec execute 570 sec latency 25.763 ms 2024-06-13T02:30:27.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:27 smithi002 ceph-mon[31960]: pgmap v399: 129 pgs: 129 active+clean; 73 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 289 op/s 2024-06-13T02:30:27.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:27 smithi084 ceph-mon[36833]: pgmap v399: 129 pgs: 129 active+clean; 73 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 289 op/s 2024-06-13T02:30:27.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:27 smithi175 ceph-mon[36977]: pgmap v399: 129 pgs: 129 active+clean; 73 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 289 op/s 2024-06-13T02:30:27.569 INFO:tasks.workunit.client.0.smithi002.stdout: 1 884460 6.72 MB/sec execute 571 sec latency 42.143 ms 2024-06-13T02:30:28.569 INFO:tasks.workunit.client.0.smithi002.stdout: 1 885350 6.72 MB/sec execute 572 sec latency 106.668 ms 2024-06-13T02:30:29.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:29 smithi002 ceph-mon[31960]: pgmap v400: 129 pgs: 129 active+clean; 71 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 237 op/s 2024-06-13T02:30:29.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:29 smithi084 ceph-mon[36833]: pgmap v400: 129 pgs: 129 active+clean; 71 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 237 op/s 2024-06-13T02:30:29.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:29 smithi175 ceph-mon[36977]: pgmap v400: 129 pgs: 129 active+clean; 71 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 237 op/s 2024-06-13T02:30:29.570 INFO:tasks.workunit.client.0.smithi002.stdout: 1 886481 6.71 MB/sec execute 573 sec latency 61.730 ms 2024-06-13T02:30:30.570 INFO:tasks.workunit.client.0.smithi002.stdout: 1 887775 6.72 MB/sec execute 574 sec latency 25.817 ms 2024-06-13T02:30:31.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:31 smithi002 ceph-mon[31960]: pgmap v401: 129 pgs: 129 active+clean; 71 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-06-13T02:30:31.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:31 smithi084 ceph-mon[36833]: pgmap v401: 129 pgs: 129 active+clean; 71 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-06-13T02:30:31.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:31 smithi175 ceph-mon[36977]: pgmap v401: 129 pgs: 129 active+clean; 71 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-06-13T02:30:31.570 INFO:tasks.workunit.client.0.smithi002.stdout: 1 888559 6.71 MB/sec execute 575 sec latency 29.040 ms 2024-06-13T02:30:32.570 INFO:tasks.workunit.client.0.smithi002.stdout: 1 889545 6.71 MB/sec execute 576 sec latency 29.506 ms 2024-06-13T02:30:33.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:33 smithi002 ceph-mon[31960]: pgmap v402: 129 pgs: 129 active+clean; 75 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 260 op/s 2024-06-13T02:30:33.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:33 smithi084 ceph-mon[36833]: pgmap v402: 129 pgs: 129 active+clean; 75 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 260 op/s 2024-06-13T02:30:33.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:33 smithi175 ceph-mon[36977]: pgmap v402: 129 pgs: 129 active+clean; 75 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 260 op/s 2024-06-13T02:30:33.570 INFO:tasks.workunit.client.0.smithi002.stdout: 1 891172 6.72 MB/sec execute 577 sec latency 26.530 ms 2024-06-13T02:30:34.570 INFO:tasks.workunit.client.0.smithi002.stdout: 1 891776 6.71 MB/sec execute 578 sec latency 28.444 ms 2024-06-13T02:30:35.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:35 smithi002 ceph-mon[31960]: pgmap v403: 129 pgs: 129 active+clean; 75 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 204 op/s 2024-06-13T02:30:35.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:35 smithi084 ceph-mon[36833]: pgmap v403: 129 pgs: 129 active+clean; 75 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 204 op/s 2024-06-13T02:30:35.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:35 smithi175 ceph-mon[36977]: pgmap v403: 129 pgs: 129 active+clean; 75 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 204 op/s 2024-06-13T02:30:35.570 INFO:tasks.workunit.client.0.smithi002.stdout: 1 892719 6.71 MB/sec execute 579 sec latency 40.357 ms 2024-06-13T02:30:36.570 INFO:tasks.workunit.client.0.smithi002.stdout: 1 894599 6.72 MB/sec execute 580 sec latency 22.707 ms 2024-06-13T02:30:37.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:37 smithi002 ceph-mon[31960]: pgmap v404: 129 pgs: 129 active+clean; 76 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 224 op/s 2024-06-13T02:30:37.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:37 smithi084 ceph-mon[36833]: pgmap v404: 129 pgs: 129 active+clean; 76 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 224 op/s 2024-06-13T02:30:37.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:37 smithi175 ceph-mon[36977]: pgmap v404: 129 pgs: 129 active+clean; 76 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 224 op/s 2024-06-13T02:30:37.570 INFO:tasks.workunit.client.0.smithi002.stdout: 1 895249 6.71 MB/sec execute 581 sec latency 25.089 ms 2024-06-13T02:30:38.550 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.549+0000 7f5999e00640 1 -- 172.21.15.2:0/951546393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59941077b0 msgr2=0x7f5994107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.549+0000 7f5999e00640 1 --2- 172.21.15.2:0/951546393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59941077b0 0x7f5994107b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5988009900 tx=0x7f598802a410 comp rx=0 tx=0).stop 2024-06-13T02:30:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.549+0000 7f5999e00640 1 -- 172.21.15.2:0/951546393 shutdown_connections 2024-06-13T02:30:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.549+0000 7f5999e00640 1 --2- 172.21.15.2:0/951546393 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5994102160 0x7f599410e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.549+0000 7f5999e00640 1 --2- 172.21.15.2:0/951546393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59941017a0 0x7f5994101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.549+0000 7f5999e00640 1 --2- 172.21.15.2:0/951546393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59941077b0 0x7f5994107b90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.549+0000 7f5999e00640 1 -- 172.21.15.2:0/951546393 >> 172.21.15.2:0/951546393 conn(0x7f59940fd2d0 msgr2=0x7f59940ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.549+0000 7f5999e00640 1 -- 172.21.15.2:0/951546393 shutdown_connections 2024-06-13T02:30:38.551 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.549+0000 7f5999e00640 1 -- 172.21.15.2:0/951546393 wait complete. 2024-06-13T02:30:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.550+0000 7f5999e00640 1 Processor -- start 2024-06-13T02:30:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.551+0000 7f5999e00640 1 -- start start 2024-06-13T02:30:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.551+0000 7f5999e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59941017a0 0x7f599419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.551+0000 7f5999e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5994102160 0x7f599419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.551+0000 7f5999e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59941077b0 0x7f599419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.551+0000 7f5999e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5994111bd0 con 0x7f59941077b0 2024-06-13T02:30:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.551+0000 7f5999e00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5994111a50 con 0x7f59941017a0 2024-06-13T02:30:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.551+0000 7f5999e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5994111d50 con 0x7f5994102160 2024-06-13T02:30:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.551+0000 7f5998a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59941017a0 0x7f599419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.554 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.551+0000 7f5998a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59941017a0 0x7f599419a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:33368/0 (socket says 172.21.15.2:33368) 2024-06-13T02:30:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.551+0000 7f5998a00640 1 -- 172.21.15.2:0/762520049 learned_addr learned my addr 172.21.15.2:0/762520049 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.551+0000 7f5993e00640 1 --2- 172.21.15.2:0/762520049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5994102160 0x7f599419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.551+0000 7f5999400640 1 --2- 172.21.15.2:0/762520049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59941077b0 0x7f599419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.552+0000 7f5998a00640 1 -- 172.21.15.2:0/762520049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5994102160 msgr2=0x7f599419a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.552+0000 7f5998a00640 1 --2- 172.21.15.2:0/762520049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5994102160 0x7f599419a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.552+0000 7f5998a00640 1 -- 172.21.15.2:0/762520049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59941077b0 msgr2=0x7f599419eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.552+0000 7f5998a00640 1 --2- 172.21.15.2:0/762520049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59941077b0 0x7f599419eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.552+0000 7f5998a00640 1 -- 172.21.15.2:0/762520049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599419f250 con 0x7f59941017a0 2024-06-13T02:30:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.552+0000 7f5993e00640 1 --2- 172.21.15.2:0/762520049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5994102160 0x7f599419a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:30:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.552+0000 7f5998a00640 1 --2- 172.21.15.2:0/762520049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59941017a0 0x7f599419a260 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f598802aa00 tx=0x7f5988003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:38.555 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.552+0000 7f5991600640 1 -- 172.21.15.2:0/762520049 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598803f070 con 0x7f59941017a0 2024-06-13T02:30:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.552+0000 7f5991600640 1 -- 172.21.15.2:0/762520049 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5988031c30 con 0x7f59941017a0 2024-06-13T02:30:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.553+0000 7f5991600640 1 -- 172.21.15.2:0/762520049 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5988035030 con 0x7f59941017a0 2024-06-13T02:30:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.553+0000 7f5999e00640 1 -- 172.21.15.2:0/762520049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f599419f4e0 con 0x7f59941017a0 2024-06-13T02:30:38.556 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.553+0000 7f5999e00640 1 -- 172.21.15.2:0/762520049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59941a6dd0 con 0x7f59941017a0 2024-06-13T02:30:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.556+0000 7f599e1e6740 1 Processor -- start 2024-06-13T02:30:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.556+0000 7f5991600640 1 -- 172.21.15.2:0/762520049 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f5988042070 con 0x7f59941017a0 2024-06-13T02:30:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.557+0000 7f599e1e6740 1 -- start start 2024-06-13T02:30:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.557+0000 7f599e1e6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa3967c0 0x556baa394d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.557+0000 7f599e1e6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa395250 0x556baa3956d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.558 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.557+0000 7f599e1e6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa39ffd0 0x556baa3a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.557+0000 7f599e1e6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556baa2f9420 con 0x556baa39ffd0 2024-06-13T02:30:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.557+0000 7f599e1e6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556baa2a0c50 con 0x556baa395250 2024-06-13T02:30:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.557+0000 7f599e1e6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556baa2f53e0 con 0x556baa3967c0 2024-06-13T02:30:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.557+0000 7f5999400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa3967c0 0x556baa394d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.557+0000 7f5998a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa395250 0x556baa3956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.557+0000 7f5993e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa39ffd0 0x556baa3a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.557+0000 7f5998a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa395250 0x556baa3956d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:33376/0 (socket says 172.21.15.2:33376) 2024-06-13T02:30:38.559 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.557+0000 7f5998a00640 1 -- 172.21.15.2:0/1154006316 learned_addr learned my addr 172.21.15.2:0/1154006316 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.558+0000 7f5998a00640 1 -- 172.21.15.2:0/1154006316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa3967c0 msgr2=0x556baa394d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.558+0000 7f5998a00640 1 --2- 172.21.15.2:0/1154006316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa3967c0 0x556baa394d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.558+0000 7f5998a00640 1 -- 172.21.15.2:0/1154006316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa39ffd0 msgr2=0x556baa3a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.558+0000 7f5998a00640 1 --2- 172.21.15.2:0/1154006316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa39ffd0 0x556baa3a23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.558+0000 7f5998a00640 1 -- 172.21.15.2:0/1154006316 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556baa00d210 con 0x556baa395250 2024-06-13T02:30:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.558+0000 7f5993e00640 1 --2- 172.21.15.2:0/1154006316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa39ffd0 0x556baa3a23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:30:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.558+0000 7f5998a00640 1 --2- 172.21.15.2:0/1154006316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa395250 0x556baa3956d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f59880ed090 tx=0x7f59880f81a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c2d65427ff0fd56 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.558+0000 7f5991600640 1 --2- 172.21.15.2:0/762520049 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f597c0a2ce0 0x7f597c0a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.559+0000 7f5985c00640 1 -- 172.21.15.2:0/1154006316 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59880f89b0 con 0x556baa395250 2024-06-13T02:30:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.559+0000 7f5985c00640 1 -- 172.21.15.2:0/1154006316 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59880fd070 con 0x556baa395250 2024-06-13T02:30:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.559+0000 7f5985c00640 1 -- 172.21.15.2:0/1154006316 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59880bb930 con 0x556baa395250 2024-06-13T02:30:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.559+0000 7f5991600640 1 -- 172.21.15.2:0/762520049 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 9583+0+0 (secure 0 0 0) 0x7f59880efe20 con 0x7f59941017a0 2024-06-13T02:30:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.559+0000 7f5999400640 1 --2- 172.21.15.2:0/762520049 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f597c0a2ce0 0x7f597c0a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.562 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.560+0000 7f599e1e6740 1 -- 172.21.15.2:0/1154006316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa395250 msgr2=0x556baa3956d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.560+0000 7f599e1e6740 1 --2- 172.21.15.2:0/1154006316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa395250 0x556baa3956d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f59880ed090 tx=0x7f59880f81a0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.560+0000 7f599e1e6740 1 -- 172.21.15.2:0/1154006316 shutdown_connections 2024-06-13T02:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.560+0000 7f599e1e6740 1 --2- 172.21.15.2:0/1154006316 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa39ffd0 0x556baa3a23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.560+0000 7f599e1e6740 1 --2- 172.21.15.2:0/1154006316 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa395250 0x556baa3956d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.560+0000 7f599e1e6740 1 --2- 172.21.15.2:0/1154006316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa3967c0 0x556baa394d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.560+0000 7f599e1e6740 1 -- 172.21.15.2:0/1154006316 >> 172.21.15.2:0/1154006316 conn(0x556baa35dfb0 msgr2=0x556baa391840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.560+0000 7f5999400640 1 --2- 172.21.15.2:0/762520049 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f597c0a2ce0 0x7f597c0a51a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f598c005fd0 tx=0x7f598c009500 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.560+0000 7f599e1e6740 1 -- 172.21.15.2:0/1154006316 shutdown_connections 2024-06-13T02:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.560+0000 7f599e1e6740 1 -- 172.21.15.2:0/1154006316 wait complete. 2024-06-13T02:30:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.561+0000 7f599e1e6740 1 -- start start 2024-06-13T02:30:38.567 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.561+0000 7f599e1e6740 1 Processor -- start 2024-06-13T02:30:38.567 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.562+0000 7f599e1e6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa395250 0x556baa39cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.567 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.562+0000 7f599e1e6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3967c0 0x556baa39d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.567 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.562+0000 7f599e1e6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa39ffd0 0x556baa39da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.567 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.562+0000 7f599e1e6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x556baa3a2ac0 con 0x556baa395250 2024-06-13T02:30:38.567 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.562+0000 7f599e1e6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556baa2b40b0 con 0x556baa3967c0 2024-06-13T02:30:38.567 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.562+0000 7f599e1e6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556baa3a2c40 con 0x556baa39ffd0 2024-06-13T02:30:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.562+0000 7f599e1e6740 10 client.0 _ll_register_callbacks cb 0x556baa29ff40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:30:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.562+0000 7f5998a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa395250 0x556baa39cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.562+0000 7f5993e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3967c0 0x556baa39d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.562+0000 7f5998a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa395250 0x556baa39cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51954/0 (socket says 172.21.15.2:51954) 2024-06-13T02:30:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.562+0000 7f5998a00640 1 -- 172.21.15.2:0/4007162197 learned_addr learned my addr 172.21.15.2:0/4007162197 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.562+0000 7f5999400640 1 --2- 172.21.15.2:0/4007162197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa39ffd0 0x556baa39da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.562+0000 7f5998a00640 1 -- 172.21.15.2:0/4007162197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa39ffd0 msgr2=0x556baa39da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.563+0000 7f5998a00640 1 --2- 172.21.15.2:0/4007162197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa39ffd0 0x556baa39da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.563+0000 7f5998a00640 1 -- 172.21.15.2:0/4007162197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3967c0 msgr2=0x556baa39d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.563+0000 7f5998a00640 1 --2- 172.21.15.2:0/4007162197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3967c0 0x556baa39d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.568 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.563+0000 7f5998a00640 1 -- 172.21.15.2:0/4007162197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556baa0d9620 con 0x556baa395250 2024-06-13T02:30:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.563+0000 7f5993e00640 1 --2- 172.21.15.2:0/4007162197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3967c0 0x556baa39d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:30:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.563+0000 7f5998a00640 1 --2- 172.21.15.2:0/4007162197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa395250 0x556baa39cfb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5988000c00 tx=0x7f59880045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f3e3842fed4d78 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.563+0000 7f597a000640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-06-13T02:30:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.563+0000 7f597a000640 1 -- 172.21.15.2:0/4007162197 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59880ba370 con 0x556baa395250 2024-06-13T02:30:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.563+0000 7f597a000640 1 -- 172.21.15.2:0/4007162197 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 9583+0+0 (secure 0 0 0) 0x7f59880b8640 con 0x556baa395250 2024-06-13T02:30:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.563+0000 7f599e1e6740 1 -- 172.21.15.2:0/4007162197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59880fd070 con 0x556baa395250 2024-06-13T02:30:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.563+0000 7f597a000640 1 -- 172.21.15.2:0/4007162197 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f59880ba590 con 0x556baa395250 2024-06-13T02:30:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.563+0000 7f599e1e6740 10 client.16068 fetch_fsmap learned FSMap version 37 2024-06-13T02:30:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.563+0000 7f599e1e6740 1 -- 172.21.15.2:0/4007162197 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x556baa3a2ac0 con 0x556baa395250 2024-06-13T02:30:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.564+0000 7f597a000640 1 -- 172.21.15.2:0/4007162197 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59880fd070 con 0x556baa395250 2024-06-13T02:30:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.564+0000 7f597a000640 1 -- 172.21.15.2:0/4007162197 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 37) ==== 8346+0+0 (secure 0 0 0) 0x7f59880b9c70 con 0x556baa395250 2024-06-13T02:30:38.569 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.564+0000 7f599e1e6740 10 client.16068 fetch_fsmap finished waiting for FSMap version 37 2024-06-13T02:30:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.564+0000 7f599e1e6740 10 client.16068 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:30:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.564+0000 7f599e1e6740 20 client.16068 populate_metadata read hostname 'smithi002' 2024-06-13T02:30:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.564+0000 7f599e1e6740 1 --2- 172.21.15.2:0/4007162197 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556baa3b0030 0x556baa3b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.564+0000 7f599e1e6740 4 client.16068 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:30:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.564+0000 7f599e1e6740 1 -- 172.21.15.2:0/4007162197 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556baa306b50 con 0x556baa3b0030 2024-06-13T02:30:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.564+0000 7f5993e00640 1 --2- 172.21.15.2:0/4007162197 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556baa3b0030 0x556baa3b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.565+0000 7f5993e00640 1 --2- 172.21.15.2:0/4007162197 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556baa3b0030 0x556baa3b2420 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e082b9914ac28f57 server_cookie=e7a13bed76499ae2 in_seq=0 out_seq=0 2024-06-13T02:30:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.565+0000 7f597a000640 10 client.16068 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.565+0000 7f597a000640 1 -- 172.21.15.2:0/4007162197 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556baa306b50 con 0x556baa3b0030 2024-06-13T02:30:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.565+0000 7f597a000640 10 client.16068 handle_command_reply: tid=0 2024-06-13T02:30:38.570 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.566+0000 7f599e1e6740 1 client.16068 shutdown 2024-06-13T02:30:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.566+0000 7f599e1e6740 1 -- 172.21.15.2:0/4007162197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa395250 msgr2=0x556baa39cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.566+0000 7f599e1e6740 1 --2- 172.21.15.2:0/4007162197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa395250 0x556baa39cfb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5988000c00 tx=0x7f59880045a0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.566+0000 7f599e1e6740 1 -- 172.21.15.2:0/4007162197 shutdown_connections 2024-06-13T02:30:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.566+0000 7f599e1e6740 1 --2- 172.21.15.2:0/4007162197 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556baa3b0030 0x556baa3b2420 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.566+0000 7f599e1e6740 1 --2- 172.21.15.2:0/4007162197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa39ffd0 0x556baa39da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.566+0000 7f599e1e6740 1 --2- 172.21.15.2:0/4007162197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3967c0 0x556baa39d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.566+0000 7f599e1e6740 1 --2- 172.21.15.2:0/4007162197 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa395250 0x556baa39cfb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.566+0000 7f599e1e6740 1 -- 172.21.15.2:0/4007162197 >> 172.21.15.2:0/4007162197 conn(0x556baa35dfb0 msgr2=0x556baa397670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.566+0000 7f597a000640 0 client.16068 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.566+0000 7f599e1e6740 1 -- 172.21.15.2:0/4007162197 shutdown_connections 2024-06-13T02:30:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.566+0000 7f599e1e6740 1 -- 172.21.15.2:0/4007162197 wait complete. 2024-06-13T02:30:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.566+0000 7f599e1e6740 20 client.16068 trim_cache size 0 max 16384 2024-06-13T02:30:38.572 INFO:tasks.workunit.client.0.smithi002.stdout: 1 896266 6.70 MB/sec execute 582 sec latency 34.915 ms 2024-06-13T02:30:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.583+0000 7f599e1e6740 1 Processor -- start 2024-06-13T02:30:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.583+0000 7f599e1e6740 1 -- start start 2024-06-13T02:30:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.583+0000 7f599e1e6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa395250 0x556baa390820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.583+0000 7f599e1e6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3967c0 0x556baa3b7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.583+0000 7f599e1e6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa39ffd0 0x556baa3b8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.583+0000 7f599e1e6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f59941b39b0 con 0x556baa39ffd0 2024-06-13T02:30:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.583+0000 7f599e1e6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f59941b1280 con 0x556baa3967c0 2024-06-13T02:30:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.583+0000 7f599e1e6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59941af0f0 con 0x556baa395250 2024-06-13T02:30:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.584+0000 7f5998a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa395250 0x556baa390820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.584+0000 7f5993e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3967c0 0x556baa3b7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.584+0000 7f5998a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa395250 0x556baa390820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:57184/0 (socket says 172.21.15.2:57184) 2024-06-13T02:30:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.584+0000 7f5993e00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3967c0 0x556baa3b7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:33390/0 (socket says 172.21.15.2:33390) 2024-06-13T02:30:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.584+0000 7f5998a00640 1 -- 172.21.15.2:0/1326849355 learned_addr learned my addr 172.21.15.2:0/1326849355 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.584+0000 7f5999400640 1 --2- 172.21.15.2:0/1326849355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa39ffd0 0x556baa3b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.584+0000 7f5993e00640 1 -- 172.21.15.2:0/1326849355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa395250 msgr2=0x556baa390820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.584+0000 7f5993e00640 1 --2- 172.21.15.2:0/1326849355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa395250 0x556baa390820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.584+0000 7f5993e00640 1 -- 172.21.15.2:0/1326849355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa39ffd0 msgr2=0x556baa3b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.584+0000 7f5993e00640 1 --2- 172.21.15.2:0/1326849355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa39ffd0 0x556baa3b8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.584+0000 7f5993e00640 1 -- 172.21.15.2:0/1326849355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556baa3b2790 con 0x556baa3967c0 2024-06-13T02:30:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.584+0000 7f5998a00640 1 --2- 172.21.15.2:0/1326849355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa395250 0x556baa390820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:30:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.585+0000 7f5993e00640 1 --2- 172.21.15.2:0/1326849355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3967c0 0x556baa3b7d10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x556baa3b2cb0 tx=0x7f5980005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8dac503e211d08e server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.585+0000 7f5985200640 1 -- 172.21.15.2:0/1326849355 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59800042f0 con 0x556baa3967c0 2024-06-13T02:30:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.585+0000 7f5985200640 1 -- 172.21.15.2:0/1326849355 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5980004490 con 0x556baa3967c0 2024-06-13T02:30:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.585+0000 7f5985200640 1 -- 172.21.15.2:0/1326849355 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5980010a30 con 0x556baa3967c0 2024-06-13T02:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.586+0000 7f599e1e6740 1 -- 172.21.15.2:0/1326849355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3967c0 msgr2=0x556baa3b7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.586+0000 7f599e1e6740 1 --2- 172.21.15.2:0/1326849355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3967c0 0x556baa3b7d10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x556baa3b2cb0 tx=0x7f5980005f90 comp rx=0 tx=0).stop 2024-06-13T02:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.586+0000 7f599e1e6740 1 -- 172.21.15.2:0/1326849355 shutdown_connections 2024-06-13T02:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.586+0000 7f599e1e6740 1 --2- 172.21.15.2:0/1326849355 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa39ffd0 0x556baa3b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.586+0000 7f599e1e6740 1 --2- 172.21.15.2:0/1326849355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa3967c0 0x556baa3b7d10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.586+0000 7f599e1e6740 1 --2- 172.21.15.2:0/1326849355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa395250 0x556baa390820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.586+0000 7f599e1e6740 1 -- 172.21.15.2:0/1326849355 >> 172.21.15.2:0/1326849355 conn(0x556baa35dfb0 msgr2=0x556baa390110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.586+0000 7f599e1e6740 1 -- 172.21.15.2:0/1326849355 shutdown_connections 2024-06-13T02:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.586+0000 7f599e1e6740 1 -- 172.21.15.2:0/1326849355 wait complete. 2024-06-13T02:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.587+0000 7f599e1e6740 1 -- start start 2024-06-13T02:30:38.589 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.587+0000 7f599e1e6740 1 Processor -- start 2024-06-13T02:30:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.588+0000 7f599e1e6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa395250 0x556baa3a7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.588+0000 7f599e1e6740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa3967c0 0x556baa3a8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.588+0000 7f599e1e6740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa39ffd0 0x556baa3a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.588+0000 7f599e1e6740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f59941af740 con 0x556baa3967c0 2024-06-13T02:30:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.588+0000 7f599e1e6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f59941b0bb0 con 0x556baa395250 2024-06-13T02:30:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.588+0000 7f599e1e6740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59941afe10 con 0x556baa39ffd0 2024-06-13T02:30:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.588+0000 7f599e1e6740 10 client.0 _ll_register_callbacks cb 0x7f598c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:30:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.588+0000 7f5998a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa395250 0x556baa3a7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.590 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.588+0000 7f5999400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa39ffd0 0x556baa3a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.588+0000 7f5998a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa395250 0x556baa3a7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:33398/0 (socket says 172.21.15.2:33398) 2024-06-13T02:30:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.588+0000 7f5998a00640 1 -- 172.21.15.2:0/1836989917 learned_addr learned my addr 172.21.15.2:0/1836989917 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.588+0000 7f5993e00640 1 --2- 172.21.15.2:0/1836989917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa3967c0 0x556baa3a8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.589+0000 7f5998a00640 1 -- 172.21.15.2:0/1836989917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa39ffd0 msgr2=0x556baa3a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:38.592 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.589+0000 7f5998a00640 1 --2- 172.21.15.2:0/1836989917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa39ffd0 0x556baa3a4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.589+0000 7f5998a00640 1 -- 172.21.15.2:0/1836989917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa3967c0 msgr2=0x556baa3a8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.589+0000 7f5998a00640 1 --2- 172.21.15.2:0/1836989917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa3967c0 0x556baa3a8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.589+0000 7f5998a00640 1 -- 172.21.15.2:0/1836989917 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556baa3a8aa0 con 0x556baa395250 2024-06-13T02:30:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.589+0000 7f5999400640 1 --2- 172.21.15.2:0/1836989917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa39ffd0 0x556baa3a4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:30:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.589+0000 7f5998a00640 1 --2- 172.21.15.2:0/1836989917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa395250 0x556baa3a7ed0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f59880bbcd0 tx=0x7f598802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ea6d295b9fe0fa4 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.589+0000 7f597a000640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-06-13T02:30:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.589+0000 7f597a000640 1 -- 172.21.15.2:0/1836989917 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5988049070 con 0x556baa395250 2024-06-13T02:30:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.590+0000 7f597a000640 1 -- 172.21.15.2:0/1836989917 <== mon.2 v2:172.21.15.84:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 9583+0+0 (secure 0 0 0) 0x7f59880f3740 con 0x556baa395250 2024-06-13T02:30:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.590+0000 7f599e1e6740 1 -- 172.21.15.2:0/1836989917 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5980004490 con 0x556baa395250 2024-06-13T02:30:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.590+0000 7f597a000640 1 -- 172.21.15.2:0/1836989917 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f59880ba780 con 0x556baa395250 2024-06-13T02:30:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.590+0000 7f599e1e6740 10 client.26282 fetch_fsmap learned FSMap version 37 2024-06-13T02:30:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.590+0000 7f599e1e6740 1 -- 172.21.15.2:0/1836989917 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x556baa3a8aa0 con 0x556baa395250 2024-06-13T02:30:38.593 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.590+0000 7f597a000640 1 -- 172.21.15.2:0/1836989917 <== mon.2 v2:172.21.15.84:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5980004490 con 0x556baa395250 2024-06-13T02:30:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.590+0000 7f597a000640 1 -- 172.21.15.2:0/1836989917 <== mon.2 v2:172.21.15.84:3300/0 5 ==== fsmap(e 37) ==== 8346+0+0 (secure 0 0 0) 0x7f59880c4700 con 0x556baa395250 2024-06-13T02:30:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.590+0000 7f599e1e6740 10 client.26282 fetch_fsmap finished waiting for FSMap version 37 2024-06-13T02:30:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.590+0000 7f599e1e6740 10 client.26282 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:30:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.590+0000 7f599e1e6740 20 client.26282 populate_metadata read hostname 'smithi002' 2024-06-13T02:30:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.590+0000 7f599e1e6740 1 --2- 172.21.15.2:0/1836989917 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556baa423e50 0x556baa426240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.591+0000 7f599e1e6740 4 client.26282 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:30:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.591+0000 7f599e1e6740 1 -- 172.21.15.2:0/1836989917 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556baa300ea0 con 0x556baa423e50 2024-06-13T02:30:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.591+0000 7f5993e00640 1 --2- 172.21.15.2:0/1836989917 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556baa423e50 0x556baa426240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.591+0000 7f5993e00640 1 --2- 172.21.15.2:0/1836989917 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556baa423e50 0x556baa426240 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=156a352089e35483 server_cookie=15ad633efde84519 in_seq=0 out_seq=0 2024-06-13T02:30:38.594 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.591+0000 7f597a000640 10 client.26282 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.866+0000 7f597a000640 1 -- 172.21.15.2:0/1836989917 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x556baa300ea0 con 0x556baa423e50 2024-06-13T02:30:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.866+0000 7f597a000640 10 client.26282 handle_command_reply: tid=0 2024-06-13T02:30:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.866+0000 7f599e1e6740 1 client.26282 shutdown 2024-06-13T02:30:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.866+0000 7f599e1e6740 1 -- 172.21.15.2:0/1836989917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa395250 msgr2=0x556baa3a7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.866+0000 7f599e1e6740 1 --2- 172.21.15.2:0/1836989917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa395250 0x556baa3a7ed0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f59880bbcd0 tx=0x7f598802a410 comp rx=0 tx=0).stop 2024-06-13T02:30:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.866+0000 7f599e1e6740 1 -- 172.21.15.2:0/1836989917 shutdown_connections 2024-06-13T02:30:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.866+0000 7f599e1e6740 1 --2- 172.21.15.2:0/1836989917 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x556baa423e50 0x556baa426240 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.866+0000 7f599e1e6740 1 --2- 172.21.15.2:0/1836989917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556baa39ffd0 0x556baa3a4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.866+0000 7f599e1e6740 1 --2- 172.21.15.2:0/1836989917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x556baa3967c0 0x556baa3a8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.866+0000 7f599e1e6740 1 --2- 172.21.15.2:0/1836989917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556baa395250 0x556baa3a7ed0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.866+0000 7f599e1e6740 1 -- 172.21.15.2:0/1836989917 >> 172.21.15.2:0/1836989917 conn(0x556baa35dfb0 msgr2=0x556baa3909a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.866+0000 7f597a000640 0 client.26282 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.867+0000 7f599e1e6740 1 -- 172.21.15.2:0/1836989917 shutdown_connections 2024-06-13T02:30:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.867+0000 7f599e1e6740 1 -- 172.21.15.2:0/1836989917 wait complete. 2024-06-13T02:30:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.868+0000 7f599e1e6740 20 client.26282 trim_cache size 0 max 16384 2024-06-13T02:30:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:30:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:30:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:30:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.869+0000 7f5999e00640 1 -- 172.21.15.2:0/762520049 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f597c0a2ce0 msgr2=0x7f597c0a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.869+0000 7f5999e00640 1 --2- 172.21.15.2:0/762520049 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f597c0a2ce0 0x7f597c0a51a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f598c005fd0 tx=0x7f598c009500 comp rx=0 tx=0).stop 2024-06-13T02:30:38.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.869+0000 7f5999e00640 1 -- 172.21.15.2:0/762520049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59941017a0 msgr2=0x7f599419a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:38.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.869+0000 7f5999e00640 1 --2- 172.21.15.2:0/762520049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59941017a0 0x7f599419a260 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f598802aa00 tx=0x7f5988003c10 comp rx=0 tx=0).stop 2024-06-13T02:30:38.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.869+0000 7f5999e00640 1 -- 172.21.15.2:0/762520049 shutdown_connections 2024-06-13T02:30:38.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.869+0000 7f5999e00640 1 --2- 172.21.15.2:0/762520049 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f597c0a2ce0 0x7f597c0a51a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.869+0000 7f5999e00640 1 --2- 172.21.15.2:0/762520049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59941077b0 0x7f599419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.870 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.869+0000 7f5999e00640 1 --2- 172.21.15.2:0/762520049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5994102160 0x7f599419a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.869+0000 7f5999e00640 1 --2- 172.21.15.2:0/762520049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59941017a0 0x7f599419a260 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:38.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.869+0000 7f5999e00640 1 -- 172.21.15.2:0/762520049 >> 172.21.15.2:0/762520049 conn(0x7f59940fd2d0 msgr2=0x7f599410caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:38.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.870+0000 7f5999e00640 1 -- 172.21.15.2:0/762520049 shutdown_connections 2024-06-13T02:30:38.871 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:38.870+0000 7f5999e00640 1 -- 172.21.15.2:0/762520049 wait complete. 2024-06-13T02:30:39.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:39 smithi002 ceph-mon[31960]: pgmap v405: 129 pgs: 129 active+clean; 78 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 159 op/s 2024-06-13T02:30:39.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:39 smithi084 ceph-mon[36833]: pgmap v405: 129 pgs: 129 active+clean; 78 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 159 op/s 2024-06-13T02:30:39.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:39 smithi175 ceph-mon[36977]: pgmap v405: 129 pgs: 129 active+clean; 78 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 159 op/s 2024-06-13T02:30:39.570 INFO:tasks.workunit.client.0.smithi002.stdout: 1 897680 6.71 MB/sec execute 583 sec latency 112.611 ms 2024-06-13T02:30:40.571 INFO:tasks.workunit.client.0.smithi002.stdout: 1 898528 6.71 MB/sec execute 584 sec latency 26.301 ms 2024-06-13T02:30:41.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:41 smithi002 ceph-mon[31960]: pgmap v406: 129 pgs: 129 active+clean; 78 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 1.2 MiB/s wr, 110 op/s 2024-06-13T02:30:41.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:41 smithi084 ceph-mon[36833]: pgmap v406: 129 pgs: 129 active+clean; 78 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 1.2 MiB/s wr, 110 op/s 2024-06-13T02:30:41.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:41 smithi175 ceph-mon[36977]: pgmap v406: 129 pgs: 129 active+clean; 78 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 1.2 MiB/s wr, 110 op/s 2024-06-13T02:30:41.571 INFO:tasks.workunit.client.0.smithi002.stdout: 1 899431 6.70 MB/sec execute 585 sec latency 32.334 ms 2024-06-13T02:30:42.571 INFO:tasks.workunit.client.0.smithi002.stdout: 1 900647 6.70 MB/sec execute 586 sec latency 26.540 ms 2024-06-13T02:30:43.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:43 smithi002 ceph-mon[31960]: pgmap v407: 129 pgs: 129 active+clean; 74 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 244 op/s 2024-06-13T02:30:43.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:43 smithi084 ceph-mon[36833]: pgmap v407: 129 pgs: 129 active+clean; 74 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 244 op/s 2024-06-13T02:30:43.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:43 smithi175 ceph-mon[36977]: pgmap v407: 129 pgs: 129 active+clean; 74 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 244 op/s 2024-06-13T02:30:43.571 INFO:tasks.workunit.client.0.smithi002.stdout: 1 901823 6.70 MB/sec execute 587 sec latency 67.419 ms 2024-06-13T02:30:44.571 INFO:tasks.workunit.client.0.smithi002.stdout: 1 902434 6.69 MB/sec execute 588 sec latency 68.176 ms 2024-06-13T02:30:45.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:45 smithi002 ceph-mon[31960]: pgmap v408: 129 pgs: 129 active+clean; 74 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 1.2 MiB/s wr, 179 op/s 2024-06-13T02:30:45.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:45 smithi084 ceph-mon[36833]: pgmap v408: 129 pgs: 129 active+clean; 74 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 1.2 MiB/s wr, 179 op/s 2024-06-13T02:30:45.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:45 smithi175 ceph-mon[36977]: pgmap v408: 129 pgs: 129 active+clean; 74 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 1.2 MiB/s wr, 179 op/s 2024-06-13T02:30:45.572 INFO:tasks.workunit.client.0.smithi002.stdout: 1 903388 6.69 MB/sec execute 589 sec latency 27.622 ms 2024-06-13T02:30:46.571 INFO:tasks.workunit.client.0.smithi002.stdout: 1 904943 6.69 MB/sec execute 590 sec latency 24.565 ms 2024-06-13T02:30:47.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:47 smithi084 ceph-mon[36833]: pgmap v409: 129 pgs: 129 active+clean; 75 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 206 op/s 2024-06-13T02:30:47.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:47 smithi175 ceph-mon[36977]: pgmap v409: 129 pgs: 129 active+clean; 75 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 206 op/s 2024-06-13T02:30:47.571 INFO:tasks.workunit.client.0.smithi002.stdout: 1 905554 6.69 MB/sec execute 591 sec latency 25.474 ms 2024-06-13T02:30:47.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:47 smithi002 ceph-mon[31960]: pgmap v409: 129 pgs: 129 active+clean; 75 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.6 MiB/s wr, 206 op/s 2024-06-13T02:30:48.572 INFO:tasks.workunit.client.0.smithi002.stdout: 1 906469 6.68 MB/sec execute 592 sec latency 22.518 ms 2024-06-13T02:30:49.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:49 smithi084 ceph-mon[36833]: pgmap v410: 129 pgs: 129 active+clean; 78 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 221 op/s 2024-06-13T02:30:49.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:49 smithi175 ceph-mon[36977]: pgmap v410: 129 pgs: 129 active+clean; 78 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 221 op/s 2024-06-13T02:30:49.572 INFO:tasks.workunit.client.0.smithi002.stdout: 1 907850 6.68 MB/sec execute 593 sec latency 39.551 ms 2024-06-13T02:30:49.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:49 smithi002 ceph-mon[31960]: pgmap v410: 129 pgs: 129 active+clean; 78 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 221 op/s 2024-06-13T02:30:50.572 INFO:tasks.workunit.client.0.smithi002.stdout: 1 909199 6.69 MB/sec execute 594 sec latency 22.613 ms 2024-06-13T02:30:51.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:51 smithi084 ceph-mon[36833]: pgmap v411: 129 pgs: 129 active+clean; 78 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 195 op/s 2024-06-13T02:30:51.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:51 smithi175 ceph-mon[36977]: pgmap v411: 129 pgs: 129 active+clean; 78 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 195 op/s 2024-06-13T02:30:51.572 INFO:tasks.workunit.client.0.smithi002.stdout: 1 910090 6.68 MB/sec execute 595 sec latency 16.004 ms 2024-06-13T02:30:51.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:51 smithi002 ceph-mon[31960]: pgmap v411: 129 pgs: 129 active+clean; 78 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 195 op/s 2024-06-13T02:30:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.028+0000 7fa754c00640 1 -- 172.21.15.2:0/2464497280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7501066c0 msgr2=0x7fa750106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.028+0000 7fa754c00640 1 --2- 172.21.15.2:0/2464497280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7501066c0 0x7fa750106aa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa740009860 tx=0x7fa74002a340 comp rx=0 tx=0).stop 2024-06-13T02:30:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.028+0000 7fa754c00640 1 -- 172.21.15.2:0/2464497280 shutdown_connections 2024-06-13T02:30:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.028+0000 7fa754c00640 1 --2- 172.21.15.2:0/2464497280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa750101070 0x7fa75010d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.028+0000 7fa754c00640 1 --2- 172.21.15.2:0/2464497280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7501006b0 0x7fa750100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.028+0000 7fa754c00640 1 --2- 172.21.15.2:0/2464497280 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7501066c0 0x7fa750106aa0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.028+0000 7fa754c00640 1 -- 172.21.15.2:0/2464497280 >> 172.21.15.2:0/2464497280 conn(0x7fa7500fc180 msgr2=0x7fa7500fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.028+0000 7fa754c00640 1 -- 172.21.15.2:0/2464497280 shutdown_connections 2024-06-13T02:30:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.028+0000 7fa754c00640 1 -- 172.21.15.2:0/2464497280 wait complete. 2024-06-13T02:30:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.029+0000 7fa754c00640 1 Processor -- start 2024-06-13T02:30:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.029+0000 7fa754c00640 1 -- start start 2024-06-13T02:30:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.030+0000 7fa754c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7501006b0 0x7fa75019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.030+0000 7fa754c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa750101070 0x7fa75019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.030+0000 7fa754c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7501066c0 0x7fa75019eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.030+0000 7fa754c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa750111bd0 con 0x7fa7501066c0 2024-06-13T02:30:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.030+0000 7fa754c00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa750111a50 con 0x7fa7501006b0 2024-06-13T02:30:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.030+0000 7fa754c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa750111d50 con 0x7fa750101070 2024-06-13T02:30:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.030+0000 7fa74f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7501006b0 0x7fa75019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.030+0000 7fa74f400640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7501006b0 0x7fa75019a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:35942/0 (socket says 172.21.15.2:35942) 2024-06-13T02:30:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.030+0000 7fa74f400640 1 -- 172.21.15.2:0/78097662 learned_addr learned my addr 172.21.15.2:0/78097662 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.030+0000 7fa74fe00640 1 --2- 172.21.15.2:0/78097662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7501066c0 0x7fa75019eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.030+0000 7fa74ea00640 1 --2- 172.21.15.2:0/78097662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa750101070 0x7fa75019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.031+0000 7fa74f400640 1 -- 172.21.15.2:0/78097662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa750101070 msgr2=0x7fa75019a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.031+0000 7fa74f400640 1 --2- 172.21.15.2:0/78097662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa750101070 0x7fa75019a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.031+0000 7fa74f400640 1 -- 172.21.15.2:0/78097662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7501066c0 msgr2=0x7fa75019eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.031+0000 7fa74f400640 1 --2- 172.21.15.2:0/78097662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7501066c0 0x7fa75019eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.031+0000 7fa74f400640 1 -- 172.21.15.2:0/78097662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75019f240 con 0x7fa7501006b0 2024-06-13T02:30:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.031+0000 7fa74f400640 1 --2- 172.21.15.2:0/78097662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7501006b0 0x7fa75019a250 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa740035040 tx=0x7fa740033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.031+0000 7fa747e00640 1 -- 172.21.15.2:0/78097662 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74003f020 con 0x7fa7501006b0 2024-06-13T02:30:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.031+0000 7fa747e00640 1 -- 172.21.15.2:0/78097662 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa740004040 con 0x7fa7501006b0 2024-06-13T02:30:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.031+0000 7fa754c00640 1 -- 172.21.15.2:0/78097662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75019f4d0 con 0x7fa7501006b0 2024-06-13T02:30:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.031+0000 7fa747e00640 1 -- 172.21.15.2:0/78097662 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740037040 con 0x7fa7501006b0 2024-06-13T02:30:52.032 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.032+0000 7fa754c00640 1 -- 172.21.15.2:0/78097662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7501a6dc0 con 0x7fa7501006b0 2024-06-13T02:30:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.036+0000 7fa7591cb740 1 Processor -- start 2024-06-13T02:30:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.036+0000 7fa7591cb740 1 -- start start 2024-06-13T02:30:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.036+0000 7fa747e00640 1 -- 172.21.15.2:0/78097662 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fa740042020 con 0x7fa7501006b0 2024-06-13T02:30:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.037+0000 7fa7591cb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a9537a0 0x55bc1a951cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.037+0000 7fa7591cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a952230 0x55bc1a9526b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.037+0000 7fa7591cb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 0x55bc1a95f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.037+0000 7fa7591cb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a8b6420 con 0x55bc1a95cfb0 2024-06-13T02:30:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.037+0000 7fa7591cb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a85dc50 con 0x55bc1a9537a0 2024-06-13T02:30:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.037+0000 7fa7591cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a8b23e0 con 0x55bc1a952230 2024-06-13T02:30:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.037+0000 7fa74f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a952230 0x55bc1a9526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.037+0000 7fa74fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a9537a0 0x55bc1a951cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.037+0000 7fa74fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a9537a0 0x55bc1a951cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:35958/0 (socket says 172.21.15.2:35958) 2024-06-13T02:30:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.037+0000 7fa74fe00640 1 -- 172.21.15.2:0/3278504666 learned_addr learned my addr 172.21.15.2:0/3278504666 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.037+0000 7fa74ea00640 1 --2- 172.21.15.2:0/3278504666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 0x55bc1a95f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.037+0000 7fa74fe00640 1 -- 172.21.15.2:0/3278504666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a952230 msgr2=0x55bc1a9526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.037+0000 7fa74fe00640 1 --2- 172.21.15.2:0/3278504666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a952230 0x55bc1a9526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.038+0000 7fa74fe00640 1 -- 172.21.15.2:0/3278504666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 msgr2=0x55bc1a95f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.038+0000 7fa74fe00640 1 --2- 172.21.15.2:0/3278504666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 0x55bc1a95f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.038+0000 7fa74fe00640 1 -- 172.21.15.2:0/3278504666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc1a5ca210 con 0x55bc1a9537a0 2024-06-13T02:30:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.038+0000 7fa74f400640 1 --2- 172.21.15.2:0/3278504666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a952230 0x55bc1a9526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:30:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.038+0000 7fa74ea00640 1 --2- 172.21.15.2:0/3278504666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 0x55bc1a95f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:30:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.038+0000 7fa74fe00640 1 --2- 172.21.15.2:0/3278504666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a9537a0 0x55bc1a951cf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa748009f80 tx=0x7fa7480118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13fafd2f361cd47 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.038+0000 7fa73be00640 1 -- 172.21.15.2:0/3278504666 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748004d20 con 0x55bc1a9537a0 2024-06-13T02:30:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.038+0000 7fa73be00640 1 -- 172.21.15.2:0/3278504666 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa748004050 con 0x55bc1a9537a0 2024-06-13T02:30:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.038+0000 7fa73be00640 1 -- 172.21.15.2:0/3278504666 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748005240 con 0x55bc1a9537a0 2024-06-13T02:30:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.039+0000 7fa747e00640 1 --2- 172.21.15.2:0/78097662 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa7340a2ce0 0x7fa7340a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.039+0000 7fa747e00640 1 -- 172.21.15.2:0/78097662 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 9583+0+0 (secure 0 0 0) 0x7fa7400ef7d0 con 0x7fa7501006b0 2024-06-13T02:30:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.039+0000 7fa74f400640 1 --2- 172.21.15.2:0/78097662 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa7340a2ce0 0x7fa7340a51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.039+0000 7fa7591cb740 1 -- 172.21.15.2:0/3278504666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a9537a0 msgr2=0x55bc1a951cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.039+0000 7fa7591cb740 1 --2- 172.21.15.2:0/3278504666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a9537a0 0x55bc1a951cf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa748009f80 tx=0x7fa7480118d0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.039+0000 7fa7591cb740 1 -- 172.21.15.2:0/3278504666 shutdown_connections 2024-06-13T02:30:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.039+0000 7fa7591cb740 1 --2- 172.21.15.2:0/3278504666 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 0x55bc1a95f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.039+0000 7fa7591cb740 1 --2- 172.21.15.2:0/3278504666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a952230 0x55bc1a9526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.039+0000 7fa7591cb740 1 --2- 172.21.15.2:0/3278504666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a9537a0 0x55bc1a951cf0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.039+0000 7fa7591cb740 1 -- 172.21.15.2:0/3278504666 >> 172.21.15.2:0/3278504666 conn(0x55bc1a91afb0 msgr2=0x55bc1a94e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.040+0000 7fa7591cb740 1 -- 172.21.15.2:0/3278504666 shutdown_connections 2024-06-13T02:30:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.040+0000 7fa74f400640 1 --2- 172.21.15.2:0/78097662 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa7340a2ce0 0x7fa7340a51a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa7400eccc0 tx=0x7fa7400f5550 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.040+0000 7fa7591cb740 1 -- 172.21.15.2:0/3278504666 wait complete. 2024-06-13T02:30:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.040+0000 7fa7591cb740 1 -- start start 2024-06-13T02:30:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.040+0000 7fa7591cb740 1 Processor -- start 2024-06-13T02:30:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.041+0000 7fa7591cb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a952230 0x55bc1a95a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.041+0000 7fa7591cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a9537a0 0x55bc1a95a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.041+0000 7fa7591cb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 0x55bc1a95aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.041+0000 7fa7591cb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a95fd80 con 0x55bc1a95cfb0 2024-06-13T02:30:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.041+0000 7fa7591cb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a8710b0 con 0x55bc1a952230 2024-06-13T02:30:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.041+0000 7fa7591cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55bc1a95ff00 con 0x55bc1a9537a0 2024-06-13T02:30:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.041+0000 7fa7591cb740 10 client.0 _ll_register_callbacks cb 0x55bc1a85cf40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:30:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.041+0000 7fa74ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a9537a0 0x55bc1a95a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.041+0000 7fa74ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a9537a0 0x55bc1a95a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:51454/0 (socket says 172.21.15.2:51454) 2024-06-13T02:30:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.041+0000 7fa74ea00640 1 -- 172.21.15.2:0/3014177838 learned_addr learned my addr 172.21.15.2:0/3014177838 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.041+0000 7fa74fe00640 1 --2- 172.21.15.2:0/3014177838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a952230 0x55bc1a95a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.041+0000 7fa74fe00640 1 --2- 172.21.15.2:0/3014177838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 0x55bc1a95aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.042+0000 7fa74ea00640 1 -- 172.21.15.2:0/3014177838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a952230 msgr2=0x55bc1a95a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.042+0000 7fa74ea00640 1 --2- 172.21.15.2:0/3014177838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a952230 0x55bc1a95a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.042+0000 7fa74ea00640 1 -- 172.21.15.2:0/3014177838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 msgr2=0x55bc1a95aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.042+0000 7fa74ea00640 1 --2- 172.21.15.2:0/3014177838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 0x55bc1a95aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.042+0000 7fa74ea00640 1 -- 172.21.15.2:0/3014177838 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc1a696620 con 0x55bc1a9537a0 2024-06-13T02:30:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.042+0000 7fa74fe00640 1 --2- 172.21.15.2:0/3014177838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 0x55bc1a95aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:30:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.042+0000 7fa74ea00640 1 --2- 172.21.15.2:0/3014177838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a9537a0 0x55bc1a95a570 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0116f0 tx=0x7fa73c011bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec39c18fd6c26812 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.042+0000 7fa738c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:30:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.042+0000 7fa738c00640 1 -- 172.21.15.2:0/3014177838 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c004260 con 0x55bc1a9537a0 2024-06-13T02:30:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.043+0000 7fa738c00640 1 -- 172.21.15.2:0/3014177838 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 9583+0+0 (secure 0 0 0) 0x7fa73c004400 con 0x55bc1a9537a0 2024-06-13T02:30:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.043+0000 7fa7591cb740 1 -- 172.21.15.2:0/3014177838 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa748004050 con 0x55bc1a9537a0 2024-06-13T02:30:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.043+0000 7fa738c00640 1 -- 172.21.15.2:0/3014177838 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa73c025050 con 0x55bc1a9537a0 2024-06-13T02:30:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.043+0000 7fa7591cb740 10 client.26278 fetch_fsmap learned FSMap version 37 2024-06-13T02:30:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.043+0000 7fa7591cb740 1 -- 172.21.15.2:0/3014177838 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55bc1a96c150 con 0x55bc1a9537a0 2024-06-13T02:30:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.043+0000 7fa738c00640 1 -- 172.21.15.2:0/3014177838 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa748004050 con 0x55bc1a9537a0 2024-06-13T02:30:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.044+0000 7fa738c00640 1 -- 172.21.15.2:0/3014177838 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 37) ==== 8346+0+0 (secure 0 0 0) 0x7fa73c011ce0 con 0x55bc1a9537a0 2024-06-13T02:30:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.044+0000 7fa7591cb740 10 client.26278 fetch_fsmap finished waiting for FSMap version 37 2024-06-13T02:30:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.044+0000 7fa7591cb740 10 client.26278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:30:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.044+0000 7fa7591cb740 20 client.26278 populate_metadata read hostname 'smithi002' 2024-06-13T02:30:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.044+0000 7fa7591cb740 1 --2- 172.21.15.2:0/3014177838 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bc1a96d6b0 0x55bc1a96faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.044+0000 7fa7591cb740 4 client.26278 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-13T02:30:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.044+0000 7fa7591cb740 1 -- 172.21.15.2:0/3014177838 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc1a8c3b50 con 0x55bc1a96d6b0 2024-06-13T02:30:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.044+0000 7fa74fe00640 1 --2- 172.21.15.2:0/3014177838 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bc1a96d6b0 0x55bc1a96faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.045+0000 7fa74fe00640 1 --2- 172.21.15.2:0/3014177838 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bc1a96d6b0 0x55bc1a96faa0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8b30a676216b2a7 server_cookie=b16d70674a2a379b in_seq=0 out_seq=0 2024-06-13T02:30:52.047 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.045+0000 7fa738c00640 10 client.26278 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.046+0000 7fa738c00640 1 -- 172.21.15.2:0/3014177838 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55bc1a8c3b50 con 0x55bc1a96d6b0 2024-06-13T02:30:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.046+0000 7fa738c00640 10 client.26278 handle_command_reply: tid=0 2024-06-13T02:30:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.046+0000 7fa7591cb740 1 client.26278 shutdown 2024-06-13T02:30:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.046+0000 7fa7591cb740 1 -- 172.21.15.2:0/3014177838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a9537a0 msgr2=0x55bc1a95a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.046+0000 7fa7591cb740 1 --2- 172.21.15.2:0/3014177838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a9537a0 0x55bc1a95a570 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0116f0 tx=0x7fa73c011bb0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.047+0000 7fa7591cb740 1 -- 172.21.15.2:0/3014177838 shutdown_connections 2024-06-13T02:30:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.047+0000 7fa7591cb740 1 --2- 172.21.15.2:0/3014177838 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bc1a96d6b0 0x55bc1a96faa0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.047+0000 7fa7591cb740 1 --2- 172.21.15.2:0/3014177838 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 0x55bc1a95aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.048 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.047+0000 7fa7591cb740 1 --2- 172.21.15.2:0/3014177838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a9537a0 0x55bc1a95a570 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.047+0000 7fa7591cb740 1 --2- 172.21.15.2:0/3014177838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a952230 0x55bc1a95a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.047+0000 7fa7591cb740 1 -- 172.21.15.2:0/3014177838 >> 172.21.15.2:0/3014177838 conn(0x55bc1a91afb0 msgr2=0x55bc1a954690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.047+0000 7fa738c00640 0 client.26278 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.047+0000 7fa7591cb740 1 -- 172.21.15.2:0/3014177838 shutdown_connections 2024-06-13T02:30:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.047+0000 7fa7591cb740 1 -- 172.21.15.2:0/3014177838 wait complete. 2024-06-13T02:30:52.049 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.047+0000 7fa7591cb740 20 client.26278 trim_cache size 0 max 16384 2024-06-13T02:30:52.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.067+0000 7fa7591cb740 1 Processor -- start 2024-06-13T02:30:52.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.067+0000 7fa7591cb740 1 -- start start 2024-06-13T02:30:52.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.067+0000 7fa7591cb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a952230 0x55bc1a94e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.067+0000 7fa7591cb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a9537a0 0x55bc1a975350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.067+0000 7fa7591cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a95cfb0 0x55bc1a975890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.067+0000 7fa7591cb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501b3910 con 0x55bc1a952230 2024-06-13T02:30:52.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.067+0000 7fa7591cb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501b11e0 con 0x55bc1a9537a0 2024-06-13T02:30:52.067 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.067+0000 7fa7591cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501af050 con 0x55bc1a95cfb0 2024-06-13T02:30:52.068 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.067+0000 7fa74fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a952230 0x55bc1a94e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.068 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.067+0000 7fa74ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a9537a0 0x55bc1a975350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.068 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.068+0000 7fa74ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a9537a0 0x55bc1a975350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:35980/0 (socket says 172.21.15.2:35980) 2024-06-13T02:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.068+0000 7fa74ea00640 1 -- 172.21.15.2:0/3033744528 learned_addr learned my addr 172.21.15.2:0/3033744528 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.068+0000 7fa74fe00640 1 --2- 172.21.15.2:0/3033744528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a95cfb0 0x55bc1a975890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.068+0000 7fa74ea00640 1 -- 172.21.15.2:0/3033744528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a95cfb0 msgr2=0x55bc1a975890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.068+0000 7fa74ea00640 1 --2- 172.21.15.2:0/3033744528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a95cfb0 0x55bc1a975890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.068+0000 7fa74ea00640 1 -- 172.21.15.2:0/3033744528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a952230 msgr2=0x55bc1a94e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.068+0000 7fa74ea00640 1 --2- 172.21.15.2:0/3033744528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a952230 0x55bc1a94e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.068+0000 7fa74ea00640 1 -- 172.21.15.2:0/3033744528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc1a9533a0 con 0x55bc1a9537a0 2024-06-13T02:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.068+0000 7fa74ea00640 1 --2- 172.21.15.2:0/3033744528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a9537a0 0x55bc1a975350 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa73c000c00 tx=0x7fa73c005e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1332d49d0f7e21ba server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.068+0000 7fa73b400640 1 -- 172.21.15.2:0/3033744528 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c02d020 con 0x55bc1a9537a0 2024-06-13T02:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.069+0000 7fa73b400640 1 -- 172.21.15.2:0/3033744528 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa73c00fe80 con 0x55bc1a9537a0 2024-06-13T02:30:52.069 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.069+0000 7fa73b400640 1 -- 172.21.15.2:0/3033744528 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c005210 con 0x55bc1a9537a0 2024-06-13T02:30:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.069+0000 7fa7591cb740 1 -- 172.21.15.2:0/3033744528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a9537a0 msgr2=0x55bc1a975350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.069+0000 7fa7591cb740 1 --2- 172.21.15.2:0/3033744528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a9537a0 0x55bc1a975350 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa73c000c00 tx=0x7fa73c005e70 comp rx=0 tx=0).stop 2024-06-13T02:30:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.069+0000 7fa7591cb740 1 -- 172.21.15.2:0/3033744528 shutdown_connections 2024-06-13T02:30:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.069+0000 7fa7591cb740 1 --2- 172.21.15.2:0/3033744528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a95cfb0 0x55bc1a975890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.069+0000 7fa7591cb740 1 --2- 172.21.15.2:0/3033744528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a9537a0 0x55bc1a975350 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.069+0000 7fa7591cb740 1 --2- 172.21.15.2:0/3033744528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a952230 0x55bc1a94e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.072 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.069+0000 7fa7591cb740 1 -- 172.21.15.2:0/3033744528 >> 172.21.15.2:0/3033744528 conn(0x55bc1a91afb0 msgr2=0x55bc1a94e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.070+0000 7fa7591cb740 1 -- 172.21.15.2:0/3033744528 shutdown_connections 2024-06-13T02:30:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.070+0000 7fa7591cb740 1 -- 172.21.15.2:0/3033744528 wait complete. 2024-06-13T02:30:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.070+0000 7fa7591cb740 1 -- start start 2024-06-13T02:30:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.070+0000 7fa7591cb740 1 Processor -- start 2024-06-13T02:30:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa7591cb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a952230 0x55bc1a9654f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa7591cb740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a9537a0 0x55bc1a965a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa7591cb740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 0x55bc1a960a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa7591cb740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501af6a0 con 0x55bc1a95cfb0 2024-06-13T02:30:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa7591cb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501b0b10 con 0x55bc1a952230 2024-06-13T02:30:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa7591cb740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501afd70 con 0x55bc1a9537a0 2024-06-13T02:30:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa7591cb740 10 client.0 _ll_register_callbacks cb 0x7fa73c009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-13T02:30:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa74fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a952230 0x55bc1a9654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.073 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa74ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a9537a0 0x55bc1a965a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa74fe00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a952230 0x55bc1a9654f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:35996/0 (socket says 172.21.15.2:35996) 2024-06-13T02:30:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa74fe00640 1 -- 172.21.15.2:0/4253748035 learned_addr learned my addr 172.21.15.2:0/4253748035 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:30:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa74ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a9537a0 0x55bc1a965a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:51476/0 (socket says 172.21.15.2:51476) 2024-06-13T02:30:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa74fe00640 1 --2- 172.21.15.2:0/4253748035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 0x55bc1a960a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa74ea00640 1 -- 172.21.15.2:0/4253748035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a952230 msgr2=0x55bc1a9654f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa74ea00640 1 --2- 172.21.15.2:0/4253748035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a952230 0x55bc1a9654f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.071+0000 7fa74ea00640 1 -- 172.21.15.2:0/4253748035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 msgr2=0x55bc1a960a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-13T02:30:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.072+0000 7fa74ea00640 1 --2- 172.21.15.2:0/4253748035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 0x55bc1a960a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.072+0000 7fa74ea00640 1 -- 172.21.15.2:0/4253748035 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc1a961260 con 0x55bc1a9537a0 2024-06-13T02:30:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.072+0000 7fa74ea00640 1 --2- 172.21.15.2:0/4253748035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a9537a0 0x55bc1a965a30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0048d0 tx=0x7fa73c004490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2a95fbaf0f57392 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:30:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.072+0000 7fa738c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-06-13T02:30:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.072+0000 7fa738c00640 1 -- 172.21.15.2:0/4253748035 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c02d030 con 0x55bc1a9537a0 2024-06-13T02:30:52.074 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.072+0000 7fa7591cb740 1 -- 172.21.15.2:0/4253748035 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bc1a8bdea0 con 0x55bc1a9537a0 2024-06-13T02:30:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.072+0000 7fa738c00640 1 -- 172.21.15.2:0/4253748035 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 9583+0+0 (secure 0 0 0) 0x7fa73c017040 con 0x55bc1a9537a0 2024-06-13T02:30:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.072+0000 7fa738c00640 1 -- 172.21.15.2:0/4253748035 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa73c042050 con 0x55bc1a9537a0 2024-06-13T02:30:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.073+0000 7fa7591cb740 10 client.26284 fetch_fsmap learned FSMap version 37 2024-06-13T02:30:52.075 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.073+0000 7fa7591cb740 1 -- 172.21.15.2:0/4253748035 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55bc1a9d7f40 con 0x55bc1a9537a0 2024-06-13T02:30:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.073+0000 7fa738c00640 1 -- 172.21.15.2:0/4253748035 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55bc1a8bdea0 con 0x55bc1a9537a0 2024-06-13T02:30:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.073+0000 7fa738c00640 1 -- 172.21.15.2:0/4253748035 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 37) ==== 8346+0+0 (secure 0 0 0) 0x7fa73c011ce0 con 0x55bc1a9537a0 2024-06-13T02:30:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.073+0000 7fa7591cb740 10 client.26284 fetch_fsmap finished waiting for FSMap version 37 2024-06-13T02:30:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.073+0000 7fa7591cb740 10 client.26284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-06-13T02:30:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.073+0000 7fa7591cb740 20 client.26284 populate_metadata read hostname 'smithi002' 2024-06-13T02:30:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.073+0000 7fa7591cb740 1 --2- 172.21.15.2:0/4253748035 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bc1a9d85f0 0x55bc1a9da9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:30:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.073+0000 7fa7591cb740 4 client.26284 mds_command: new command op to 24527 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-13T02:30:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.073+0000 7fa7591cb740 1 -- 172.21.15.2:0/4253748035 --> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bc1a83b7a0 con 0x55bc1a9d85f0 2024-06-13T02:30:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.073+0000 7fa74fe00640 1 --2- 172.21.15.2:0/4253748035 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bc1a9d85f0 0x55bc1a9da9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:30:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.074+0000 7fa74fe00640 1 --2- 172.21.15.2:0/4253748035 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bc1a9d85f0 0x55bc1a9da9e0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d495b6010f6c89d6 server_cookie=a035b37aca60426f in_seq=0 out_seq=0 2024-06-13T02:30:52.076 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.074+0000 7fa738c00640 10 client.26284 ms_handle_connect on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.354+0000 7fa738c00640 1 -- 172.21.15.2:0/4253748035 <== mds.0 v2:172.21.15.84:6838/541041266 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55bc1a83b7a0 con 0x55bc1a9d85f0 2024-06-13T02:30:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.354+0000 7fa738c00640 10 client.26284 handle_command_reply: tid=0 2024-06-13T02:30:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.354+0000 7fa7591cb740 1 client.26284 shutdown 2024-06-13T02:30:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.354+0000 7fa7591cb740 1 -- 172.21.15.2:0/4253748035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a9537a0 msgr2=0x55bc1a965a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.354+0000 7fa7591cb740 1 --2- 172.21.15.2:0/4253748035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a9537a0 0x55bc1a965a30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0048d0 tx=0x7fa73c004490 comp rx=0 tx=0).stop 2024-06-13T02:30:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.354+0000 7fa7591cb740 1 -- 172.21.15.2:0/4253748035 shutdown_connections 2024-06-13T02:30:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.354+0000 7fa7591cb740 1 --2- 172.21.15.2:0/4253748035 >> [v2:172.21.15.84:6838/541041266,v1:172.21.15.84:6839/541041266] conn(0x55bc1a9d85f0 0x55bc1a9da9e0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.354+0000 7fa7591cb740 1 --2- 172.21.15.2:0/4253748035 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55bc1a95cfb0 0x55bc1a960a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.354+0000 7fa7591cb740 1 --2- 172.21.15.2:0/4253748035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bc1a9537a0 0x55bc1a965a30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.354+0000 7fa7591cb740 1 --2- 172.21.15.2:0/4253748035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bc1a952230 0x55bc1a9654f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.354+0000 7fa7591cb740 1 -- 172.21.15.2:0/4253748035 >> 172.21.15.2:0/4253748035 conn(0x55bc1a91afb0 msgr2=0x55bc1a94d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.354+0000 7fa738c00640 0 client.26284 ms_handle_reset on v2:172.21.15.84:6838/541041266 2024-06-13T02:30:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.354+0000 7fa7591cb740 1 -- 172.21.15.2:0/4253748035 shutdown_connections 2024-06-13T02:30:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.354+0000 7fa7591cb740 1 -- 172.21.15.2:0/4253748035 wait complete. 2024-06-13T02:30:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.355+0000 7fa7591cb740 20 client.26284 trim_cache size 0 max 16384 2024-06-13T02:30:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:{ 2024-06-13T02:30:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout: "return_code": 0 2024-06-13T02:30:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stdout:} 2024-06-13T02:30:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.356+0000 7fa754c00640 1 -- 172.21.15.2:0/78097662 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa7340a2ce0 msgr2=0x7fa7340a51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.356+0000 7fa754c00640 1 --2- 172.21.15.2:0/78097662 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa7340a2ce0 0x7fa7340a51a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa7400eccc0 tx=0x7fa7400f5550 comp rx=0 tx=0).stop 2024-06-13T02:30:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.356+0000 7fa754c00640 1 -- 172.21.15.2:0/78097662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7501006b0 msgr2=0x7fa75019a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:30:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.356+0000 7fa754c00640 1 --2- 172.21.15.2:0/78097662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7501006b0 0x7fa75019a250 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa740035040 tx=0x7fa740033b60 comp rx=0 tx=0).stop 2024-06-13T02:30:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.356+0000 7fa754c00640 1 -- 172.21.15.2:0/78097662 shutdown_connections 2024-06-13T02:30:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.356+0000 7fa754c00640 1 --2- 172.21.15.2:0/78097662 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa7340a2ce0 0x7fa7340a51a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.356+0000 7fa754c00640 1 --2- 172.21.15.2:0/78097662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa7501066c0 0x7fa75019eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.356+0000 7fa754c00640 1 --2- 172.21.15.2:0/78097662 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa750101070 0x7fa75019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.356+0000 7fa754c00640 1 --2- 172.21.15.2:0/78097662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7501006b0 0x7fa75019a250 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:30:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.356+0000 7fa754c00640 1 -- 172.21.15.2:0/78097662 >> 172.21.15.2:0/78097662 conn(0x7fa7500fc180 msgr2=0x7fa75010be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:30:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.356+0000 7fa754c00640 1 -- 172.21.15.2:0/78097662 shutdown_connections 2024-06-13T02:30:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi002.front.sepia.ceph.com.smithi002.stderr:2024-06-13T02:30:52.356+0000 7fa754c00640 1 -- 172.21.15.2:0/78097662 wait complete. 2024-06-13T02:30:52.572 INFO:tasks.workunit.client.0.smithi002.stdout: 1 911293 6.68 MB/sec execute 596 sec latency 94.325 ms 2024-06-13T02:30:53.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:53 smithi084 ceph-mon[36833]: pgmap v412: 129 pgs: 129 active+clean; 81 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 250 op/s 2024-06-13T02:30:53.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:53 smithi175 ceph-mon[36977]: pgmap v412: 129 pgs: 129 active+clean; 81 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 250 op/s 2024-06-13T02:30:53.572 INFO:tasks.workunit.client.0.smithi002.stdout: 1 912522 6.69 MB/sec execute 597 sec latency 20.297 ms 2024-06-13T02:30:53.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:53 smithi002 ceph-mon[31960]: pgmap v412: 129 pgs: 129 active+clean; 81 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 250 op/s 2024-06-13T02:30:54.572 INFO:tasks.workunit.client.0.smithi002.stdout: 1 913194 6.68 MB/sec execute 598 sec latency 41.825 ms 2024-06-13T02:30:55.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:55 smithi084 ceph-mon[36833]: pgmap v413: 129 pgs: 129 active+clean; 81 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 116 op/s 2024-06-13T02:30:55.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:55 smithi175 ceph-mon[36977]: pgmap v413: 129 pgs: 129 active+clean; 81 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 116 op/s 2024-06-13T02:30:55.572 INFO:tasks.workunit.client.0.smithi002.stdout: 1 914193 6.67 MB/sec execute 599 sec latency 180.918 ms 2024-06-13T02:30:55.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:55 smithi002 ceph-mon[31960]: pgmap v413: 129 pgs: 129 active+clean; 81 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 116 op/s 2024-06-13T02:30:56.573 INFO:tasks.workunit.client.0.smithi002.stdout: 1 cleanup 600 sec 2024-06-13T02:30:56.835 INFO:tasks.workunit.client.0.smithi002.stdout: 0 cleanup 600 sec 2024-06-13T02:30:56.835 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-06-13T02:30:56.835 INFO:tasks.workunit.client.0.smithi002.stdout: Operation Count AvgLat MaxLat 2024-06-13T02:30:56.835 INFO:tasks.workunit.client.0.smithi002.stdout: ---------------------------------------- 2024-06-13T02:30:56.835 INFO:tasks.workunit.client.0.smithi002.stdout: NTCreateX 127896 1.418 206.171 2024-06-13T02:30:56.835 INFO:tasks.workunit.client.0.smithi002.stdout: Close 93968 0.010 3.052 2024-06-13T02:30:56.835 INFO:tasks.workunit.client.0.smithi002.stdout: Rename 5420 6.413 92.037 2024-06-13T02:30:56.835 INFO:tasks.workunit.client.0.smithi002.stdout: Unlink 25829 2.053 48.605 2024-06-13T02:30:56.835 INFO:tasks.workunit.client.0.smithi002.stdout: Deltree 2 133.264 176.555 2024-06-13T02:30:56.835 INFO:tasks.workunit.client.0.smithi002.stdout: Mkdir 1 0.045 0.045 2024-06-13T02:30:56.835 INFO:tasks.workunit.client.0.smithi002.stdout: Qpathinfo 115999 1.547 276.940 2024-06-13T02:30:56.835 INFO:tasks.workunit.client.0.smithi002.stdout: Qfileinfo 20301 0.005 1.132 2024-06-13T02:30:56.836 INFO:tasks.workunit.client.0.smithi002.stdout: Qfsinfo 21280 0.568 42.520 2024-06-13T02:30:56.836 INFO:tasks.workunit.client.0.smithi002.stdout: Sfileinfo 10420 0.076 3.073 2024-06-13T02:30:56.836 INFO:tasks.workunit.client.0.smithi002.stdout: Find 44865 0.498 4939.933 2024-06-13T02:30:56.836 INFO:tasks.workunit.client.0.smithi002.stdout: WriteX 63588 0.296 179.752 2024-06-13T02:30:56.836 INFO:tasks.workunit.client.0.smithi002.stdout: ReadX 200851 0.039 99.742 2024-06-13T02:30:56.836 INFO:tasks.workunit.client.0.smithi002.stdout: LockX 418 0.875 3.284 2024-06-13T02:30:56.836 INFO:tasks.workunit.client.0.smithi002.stdout: UnlockX 418 0.782 2.531 2024-06-13T02:30:56.836 INFO:tasks.workunit.client.0.smithi002.stdout: Flush 8963 9.061 260.134 2024-06-13T02:30:56.836 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-06-13T02:30:56.836 INFO:tasks.workunit.client.0.smithi002.stdout:Throughput 6.67453 MB/sec 1 clients 1 procs max_latency=4939.953 ms 2024-06-13T02:30:56.836 INFO:tasks.workunit.client.0.smithi002.stderr:+ dbench 10 2024-06-13T02:30:56.838 INFO:tasks.workunit.client.0.smithi002.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-06-13T02:30:56.838 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-06-13T02:30:56.838 INFO:tasks.workunit.client.0.smithi002.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-06-13T02:30:56.843 INFO:tasks.workunit.client.0.smithi002.stdout:8 of 10 processes prepared for launch 0 sec 2024-06-13T02:30:56.943 INFO:tasks.workunit.client.0.smithi002.stdout:10 of 10 processes prepared for launch 0 sec 2024-06-13T02:30:56.943 INFO:tasks.workunit.client.0.smithi002.stdout:releasing clients 2024-06-13T02:30:57.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:57 smithi084 ceph-mon[36833]: pgmap v414: 129 pgs: 129 active+clean; 81 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 230 op/s 2024-06-13T02:30:57.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:57 smithi175 ceph-mon[36977]: pgmap v414: 129 pgs: 129 active+clean; 81 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 230 op/s 2024-06-13T02:30:57.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:57 smithi002 ceph-mon[31960]: pgmap v414: 129 pgs: 129 active+clean; 81 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 230 op/s 2024-06-13T02:30:57.943 INFO:tasks.workunit.client.0.smithi002.stdout: 10 404 143.38 MB/sec warmup 1 sec latency 147.704 ms 2024-06-13T02:30:58.943 INFO:tasks.workunit.client.0.smithi002.stdout: 10 821 102.49 MB/sec warmup 2 sec latency 241.819 ms 2024-06-13T02:30:59.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:59 smithi084 ceph-mon[36833]: pgmap v415: 129 pgs: 129 active+clean; 77 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 239 op/s 2024-06-13T02:30:59.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:30:59 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:30:59.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:59 smithi175 ceph-mon[36977]: pgmap v415: 129 pgs: 129 active+clean; 77 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 239 op/s 2024-06-13T02:30:59.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:30:59 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:30:59.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:59 smithi002 ceph-mon[31960]: pgmap v415: 129 pgs: 129 active+clean; 77 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 239 op/s 2024-06-13T02:30:59.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:30:59 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:30:59.944 INFO:tasks.workunit.client.0.smithi002.stdout: 10 1030 73.02 MB/sec warmup 3 sec latency 401.429 ms 2024-06-13T02:31:00.944 INFO:tasks.workunit.client.0.smithi002.stdout: 10 1329 61.09 MB/sec warmup 4 sec latency 631.505 ms 2024-06-13T02:31:01.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:01 smithi084 ceph-mon[36833]: pgmap v416: 129 pgs: 129 active+clean; 77 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 1.6 MiB/s wr, 205 op/s 2024-06-13T02:31:01.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:01 smithi084 ceph-mon[36833]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:31:01.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:01 smithi175 ceph-mon[36977]: pgmap v416: 129 pgs: 129 active+clean; 77 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 1.6 MiB/s wr, 205 op/s 2024-06-13T02:31:01.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:01 smithi175 ceph-mon[36977]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:31:01.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:01 smithi002 ceph-mon[31960]: pgmap v416: 129 pgs: 129 active+clean; 77 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 1.6 MiB/s wr, 205 op/s 2024-06-13T02:31:01.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:01 smithi002 ceph-mon[31960]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-06-13T02:31:01.944 INFO:tasks.workunit.client.0.smithi002.stdout: 10 1329 48.87 MB/sec warmup 5 sec latency 1631.667 ms 2024-06-13T02:31:02.944 INFO:tasks.workunit.client.0.smithi002.stdout: 10 1329 40.73 MB/sec warmup 6 sec latency 2631.868 ms 2024-06-13T02:31:03.334 INFO:tasks.workunit.client.0.smithi002.stdout:[1991] write failed on handle 10293 (Resource temporarily unavailable) 2024-06-13T02:31:03.334 INFO:tasks.workunit.client.0.smithi002.stdout:Child failed with status 1 2024-06-13T02:31:03.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T02:31:03.346 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-06-13T02:31:03.347 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-06-13T02:31:03.450 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:03 smithi002 ceph-mon[31960]: pgmap v417: 129 pgs: 129 active+clean; 85 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 386 op/s 2024-06-13T02:31:03.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:03 smithi084 ceph-mon[36833]: pgmap v417: 129 pgs: 129 active+clean; 85 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 386 op/s 2024-06-13T02:31:03.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:03 smithi175 ceph-mon[36977]: pgmap v417: 129 pgs: 129 active+clean; 85 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 386 op/s 2024-06-13T02:31:04.893 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi002 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1373963c202323287783ccb099bbae1ec8f14a5d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2024-06-13T02:31:05.092 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a97059e161d64988a4e2ce0985c72c15 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_1373963c202323287783ccb099bbae1ec8f14a5d/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c1b06c2b5d3a02a3583265a115f09e052855bcf2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi002 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1373963c202323287783ccb099bbae1ec8f14a5d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2024-06-13T02:31:05.095 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-06-13T02:31:05.104 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T02:31:05.129 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-06-13T02:31:05.145 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-06-13T02:31:05.145 INFO:teuthology.task.exec:Executing custom commands... 2024-06-13T02:31:05.146 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T02:31:05.146 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-06-13T02:31:05.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-06-13T02:31:05.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-06-13T02:31:05.523 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:05 smithi002 ceph-mon[31960]: pgmap v418: 129 pgs: 129 active+clean; 85 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 331 op/s 2024-06-13T02:31:05.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:05 smithi175 ceph-mon[36977]: pgmap v418: 129 pgs: 129 active+clean; 85 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 331 op/s 2024-06-13T02:31:05.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:05 smithi084 ceph-mon[36833]: pgmap v418: 129 pgs: 129 active+clean; 85 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 331 op/s 2024-06-13T02:31:05.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.720+0000 7f8ffc000640 1 -- 172.21.15.2:0/622179018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4100750 msgr2=0x7f8ff410de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:05.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.720+0000 7f8ffc000640 1 --2- 172.21.15.2:0/622179018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4100750 0x7f8ff410de30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8009900 tx=0x7f8fe802a4a0 comp rx=0 tx=0).stop 2024-06-13T02:31:05.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.720+0000 7f8ffc000640 1 -- 172.21.15.2:0/622179018 shutdown_connections 2024-06-13T02:31:05.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.720+0000 7f8ffc000640 1 --2- 172.21.15.2:0/622179018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ff410e370 0x7f8ff4110760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:05.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.720+0000 7f8ffc000640 1 --2- 172.21.15.2:0/622179018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4100750 0x7f8ff410de30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:05.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.720+0000 7f8ffc000640 1 --2- 172.21.15.2:0/622179018 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ff40ffe30 0x7f8ff4100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:05.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.720+0000 7f8ffc000640 1 -- 172.21.15.2:0/622179018 >> 172.21.15.2:0/622179018 conn(0x7f8ff40757b0 msgr2=0x7f8ff4075bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:05.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.722+0000 7f8ffc000640 1 -- 172.21.15.2:0/622179018 shutdown_connections 2024-06-13T02:31:05.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.722+0000 7f8ffc000640 1 -- 172.21.15.2:0/622179018 wait complete. 2024-06-13T02:31:05.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.724+0000 7f8ffc000640 1 Processor -- start 2024-06-13T02:31:05.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.725+0000 7f8ffc000640 1 -- start start 2024-06-13T02:31:05.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.725+0000 7f8ffc000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ff40ffe30 0x7f8ff419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:05.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.725+0000 7f8ffc000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4100750 0x7f8ff419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:05.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.726+0000 7f8ffc000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ff410e370 0x7f8ff419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:05.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.726+0000 7f8ff9600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ff40ffe30 0x7f8ff419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:05.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.726+0000 7f8ffc000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4114080 con 0x7f8ff40ffe30 2024-06-13T02:31:05.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.726+0000 7f8ffc000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4113f00 con 0x7f8ff4100750 2024-06-13T02:31:05.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.726+0000 7f8ffc000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4114200 con 0x7f8ff410e370 2024-06-13T02:31:05.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.726+0000 7f8ffa000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ff410e370 0x7f8ff419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:05.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.726+0000 7f8ff8c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4100750 0x7f8ff419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:05.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.726+0000 7f8ffa000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ff410e370 0x7f8ff419eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:59122/0 (socket says 172.21.15.2:59122) 2024-06-13T02:31:05.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.726+0000 7f8ffa000640 1 -- 172.21.15.2:0/1820354746 learned_addr learned my addr 172.21.15.2:0/1820354746 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:31:05.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.727+0000 7f8ffa000640 1 -- 172.21.15.2:0/1820354746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4100750 msgr2=0x7f8ff419abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:05.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.727+0000 7f8ffa000640 1 --2- 172.21.15.2:0/1820354746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4100750 0x7f8ff419abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:05.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.727+0000 7f8ffa000640 1 -- 172.21.15.2:0/1820354746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ff40ffe30 msgr2=0x7f8ff419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:05.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.726+0000 7f8ff9600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ff40ffe30 0x7f8ff419a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60122/0 (socket says 172.21.15.2:60122) 2024-06-13T02:31:05.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.728+0000 7f8ffa000640 1 --2- 172.21.15.2:0/1820354746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ff40ffe30 0x7f8ff419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:05.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.728+0000 7f8ffa000640 1 -- 172.21.15.2:0/1820354746 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff419f620 con 0x7f8ff410e370 2024-06-13T02:31:05.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.728+0000 7f8ff9600640 1 --2- 172.21.15.2:0/1820354746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ff40ffe30 0x7f8ff419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-13T02:31:05.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.729+0000 7f8ffa000640 1 --2- 172.21.15.2:0/1820354746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ff410e370 0x7f8ff419eef0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00b970 tx=0x7f8fec00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:05.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.729+0000 7f8ff2000640 1 -- 172.21.15.2:0/1820354746 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec019070 con 0x7f8ff410e370 2024-06-13T02:31:05.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.729+0000 7f8ff2000640 1 -- 172.21.15.2:0/1820354746 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fec00cb40 con 0x7f8ff410e370 2024-06-13T02:31:05.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.729+0000 7f8ff2000640 1 -- 172.21.15.2:0/1820354746 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0076e0 con 0x7f8ff410e370 2024-06-13T02:31:05.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.729+0000 7f8ffc000640 1 -- 172.21.15.2:0/1820354746 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff419f910 con 0x7f8ff410e370 2024-06-13T02:31:05.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.729+0000 7f8ffc000640 1 -- 172.21.15.2:0/1820354746 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff41039e0 con 0x7f8ff410e370 2024-06-13T02:31:05.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.731+0000 7f8ffc000640 1 -- 172.21.15.2:0/1820354746 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff4101050 con 0x7f8ff410e370 2024-06-13T02:31:05.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.738+0000 7f8ff2000640 1 -- 172.21.15.2:0/1820354746 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f8fec01c070 con 0x7f8ff410e370 2024-06-13T02:31:05.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.740+0000 7f8ff2000640 1 --2- 172.21.15.2:0/1820354746 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8fdc0a2d70 0x7f8fdc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:05.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.740+0000 7f8ff2000640 1 -- 172.21.15.2:0/1820354746 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9671+0+0 (secure 0 0 0) 0x7f8fec0cf2c0 con 0x7f8ff410e370 2024-06-13T02:31:05.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.741+0000 7f8ff9600640 1 --2- 172.21.15.2:0/1820354746 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8fdc0a2d70 0x7f8fdc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:05.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.742+0000 7f8ff9600640 1 --2- 172.21.15.2:0/1820354746 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8fdc0a2d70 0x7f8fdc0a5230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400a8b0 tx=0x7f8fe4008040 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:05.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:05.743+0000 7f8ff2000640 1 -- 172.21.15.2:0/1820354746 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8fec09bb70 con 0x7f8ff410e370 2024-06-13T02:31:06.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.177+0000 7f8ffc000640 1 -- 172.21.15.2:0/1820354746 --> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f8ff402d350 con 0x7f8fdc0a2d70 2024-06-13T02:31:06.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.262+0000 7f8ff2000640 1 -- 172.21.15.2:0/1820354746 <== mgr.25123 v2:172.21.15.2:6800/2181612853 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f8ff402d350 con 0x7f8fdc0a2d70 2024-06-13T02:31:06.264 INFO:teuthology.orchestra.run.smithi002.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-06-13T00:00:00", "created": "2024-06-13T02:17:52", "first": "2024-06-13T02:18:00", "last": "2024-06-13T02:31:00", "last_pruned": "2024-06-13T02:31:03", "created_count": 14, "pruned_count": 8, "active": true} 2024-06-13T02:31:06.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.267+0000 7f8ffc000640 1 -- 172.21.15.2:0/1820354746 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8fdc0a2d70 msgr2=0x7f8fdc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:06.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.267+0000 7f8ffc000640 1 --2- 172.21.15.2:0/1820354746 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8fdc0a2d70 0x7f8fdc0a5230 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400a8b0 tx=0x7f8fe4008040 comp rx=0 tx=0).stop 2024-06-13T02:31:06.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.267+0000 7f8ffc000640 1 -- 172.21.15.2:0/1820354746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ff410e370 msgr2=0x7f8ff419eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:06.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.267+0000 7f8ffc000640 1 --2- 172.21.15.2:0/1820354746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ff410e370 0x7f8ff419eef0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00b970 tx=0x7f8fec00be30 comp rx=0 tx=0).stop 2024-06-13T02:31:06.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.268+0000 7f8ffc000640 1 -- 172.21.15.2:0/1820354746 shutdown_connections 2024-06-13T02:31:06.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.268+0000 7f8ffc000640 1 --2- 172.21.15.2:0/1820354746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ff410e370 0x7f8ff419eef0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.268+0000 7f8ffc000640 1 --2- 172.21.15.2:0/1820354746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ff4100750 0x7f8ff419abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.268+0000 7f8ffc000640 1 --2- 172.21.15.2:0/1820354746 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f8fdc0a2d70 0x7f8fdc0a5230 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.268+0000 7f8ffc000640 1 --2- 172.21.15.2:0/1820354746 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8ff40ffe30 0x7f8ff419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.268+0000 7f8ffc000640 1 -- 172.21.15.2:0/1820354746 >> 172.21.15.2:0/1820354746 conn(0x7f8ff40757b0 msgr2=0x7f8ff410e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.268+0000 7f8ffc000640 1 -- 172.21.15.2:0/1820354746 shutdown_connections 2024-06-13T02:31:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.268+0000 7f8ffc000640 1 -- 172.21.15.2:0/1820354746 wait complete. 2024-06-13T02:31:06.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-06-13T02:31:06.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:06 smithi175 ceph-mon[36977]: osdmap e120: 12 total, 12 up, 12 in 2024-06-13T02:31:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.585+0000 7fc0e8000640 1 -- 172.21.15.2:0/3499585845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0e0110140 msgr2=0x7fc0e010dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.585+0000 7fc0e8000640 1 --2- 172.21.15.2:0/3499585845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0e0110140 0x7fc0e010dce0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009900 tx=0x7fc0d402a3f0 comp rx=0 tx=0).stop 2024-06-13T02:31:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.586+0000 7fc0e8000640 1 -- 172.21.15.2:0/3499585845 shutdown_connections 2024-06-13T02:31:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.586+0000 7fc0e8000640 1 --2- 172.21.15.2:0/3499585845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e011b180 0x7fc0e011d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.586+0000 7fc0e8000640 1 --2- 172.21.15.2:0/3499585845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0e010e220 0x7fc0e010e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.586+0000 7fc0e8000640 1 --2- 172.21.15.2:0/3499585845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0e0110140 0x7fc0e010dce0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:06.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.586+0000 7fc0e8000640 1 -- 172.21.15.2:0/3499585845 >> 172.21.15.2:0/3499585845 conn(0x7fc0e006ca80 msgr2=0x7fc0e006ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.586+0000 7fc0e8000640 1 -- 172.21.15.2:0/3499585845 shutdown_connections 2024-06-13T02:31:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.586+0000 7fc0e8000640 1 -- 172.21.15.2:0/3499585845 wait complete. 2024-06-13T02:31:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.587+0000 7fc0e8000640 1 Processor -- start 2024-06-13T02:31:06.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.588+0000 7fc0e8000640 1 -- start start 2024-06-13T02:31:06.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.588+0000 7fc0e8000640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e010e220 0x7fc0e01a7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:06.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.588+0000 7fc0e8000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0e0110140 0x7fc0e01a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:06.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.588+0000 7fc0e8000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0e011b180 0x7fc0e01ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:06.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.588+0000 7fc0e8000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e0120c10 con 0x7fc0e011b180 2024-06-13T02:31:06.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.588+0000 7fc0e8000640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e0120a90 con 0x7fc0e010e220 2024-06-13T02:31:06.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.588+0000 7fc0e8000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e0120d90 con 0x7fc0e0110140 2024-06-13T02:31:06.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.589+0000 7fc0e4c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0e0110140 0x7fc0e01a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:06.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.589+0000 7fc0e4c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0e0110140 0x7fc0e01a75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:59148/0 (socket says 172.21.15.2:59148) 2024-06-13T02:31:06.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.589+0000 7fc0e4c00640 1 -- 172.21.15.2:0/4017335156 learned_addr learned my addr 172.21.15.2:0/4017335156 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:31:06.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.589+0000 7fc0e5600640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e010e220 0x7fc0e01a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:06.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.589+0000 7fc0e6000640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0e011b180 0x7fc0e01ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:06.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.589+0000 7fc0e5600640 1 -- 172.21.15.2:0/4017335156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0e0110140 msgr2=0x7fc0e01a75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:06.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.589+0000 7fc0e5600640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0e0110140 0x7fc0e01a75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:06.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.589+0000 7fc0e5600640 1 -- 172.21.15.2:0/4017335156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0e011b180 msgr2=0x7fc0e01ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:06.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.590+0000 7fc0e5600640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0e011b180 0x7fc0e01ab950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:06.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.590+0000 7fc0e5600640 1 -- 172.21.15.2:0/4017335156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e01ac080 con 0x7fc0e010e220 2024-06-13T02:31:06.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.590+0000 7fc0e4c00640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0e0110140 0x7fc0e01a75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:31:06.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.590+0000 7fc0e5600640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e010e220 0x7fc0e01a7090 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc0d402a910 tx=0x7fc0d4003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:06.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.591+0000 7fc0e6000640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0e011b180 0x7fc0e01ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:31:06.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.591+0000 7fc0de000640 1 -- 172.21.15.2:0/4017335156 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d403f070 con 0x7fc0e010e220 2024-06-13T02:31:06.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.591+0000 7fc0de000640 1 -- 172.21.15.2:0/4017335156 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0d4031c90 con 0x7fc0e010e220 2024-06-13T02:31:06.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.591+0000 7fc0de000640 1 -- 172.21.15.2:0/4017335156 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4035030 con 0x7fc0e010e220 2024-06-13T02:31:06.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.592+0000 7fc0e8000640 1 -- 172.21.15.2:0/4017335156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e01ac310 con 0x7fc0e010e220 2024-06-13T02:31:06.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.593+0000 7fc0e8000640 1 -- 172.21.15.2:0/4017335156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e01b3c00 con 0x7fc0e010e220 2024-06-13T02:31:06.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.595+0000 7fc0e8000640 1 -- 172.21.15.2:0/4017335156 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e006dd20 con 0x7fc0e010e220 2024-06-13T02:31:06.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.598+0000 7fc0de000640 1 -- 172.21.15.2:0/4017335156 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fc0d4042070 con 0x7fc0e010e220 2024-06-13T02:31:06.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.600+0000 7fc0de000640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc0c80a2d70 0x7fc0c80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:06.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.600+0000 7fc0de000640 1 -- 172.21.15.2:0/4017335156 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9671+0+0 (secure 0 0 0) 0x7fc0d40eff20 con 0x7fc0e010e220 2024-06-13T02:31:06.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.601+0000 7fc0e4c00640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc0c80a2d70 0x7fc0c80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:06.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.603+0000 7fc0e4c00640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc0c80a2d70 0x7fc0c80a5230 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00734c0 tx=0x7fc0cc00b4a0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:06.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:06.605+0000 7fc0de000640 1 -- 172.21.15.2:0/4017335156 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fc0d40bc070 con 0x7fc0e010e220 2024-06-13T02:31:06.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:06 smithi002 ceph-mon[31960]: osdmap e120: 12 total, 12 up, 12 in 2024-06-13T02:31:06.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:06 smithi084 ceph-mon[36833]: osdmap e120: 12 total, 12 up, 12 in 2024-06-13T02:31:07.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.020+0000 7fc0e8000640 1 -- 172.21.15.2:0/4017335156 --> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fc0e011a290 con 0x7fc0c80a2d70 2024-06-13T02:31:07.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.078+0000 7fc0de000640 1 -- 172.21.15.2:0/4017335156 <== mgr.25123 v2:172.21.15.2:6800/2181612853 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fc0e011a290 con 0x7fc0c80a2d70 2024-06-13T02:31:07.079 INFO:teuthology.orchestra.run.smithi002.stdout:/ 1m 6m3h 2024-06-13T02:31:07.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.083+0000 7fc0e8000640 1 -- 172.21.15.2:0/4017335156 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc0c80a2d70 msgr2=0x7fc0c80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:07.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.083+0000 7fc0e8000640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc0c80a2d70 0x7fc0c80a5230 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00734c0 tx=0x7fc0cc00b4a0 comp rx=0 tx=0).stop 2024-06-13T02:31:07.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.083+0000 7fc0e8000640 1 -- 172.21.15.2:0/4017335156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e010e220 msgr2=0x7fc0e01a7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:07.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.083+0000 7fc0e8000640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e010e220 0x7fc0e01a7090 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc0d402a910 tx=0x7fc0d4003b90 comp rx=0 tx=0).stop 2024-06-13T02:31:07.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.083+0000 7fc0e8000640 1 -- 172.21.15.2:0/4017335156 shutdown_connections 2024-06-13T02:31:07.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.083+0000 7fc0e8000640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fc0c80a2d70 0x7fc0c80a5230 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:07.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.083+0000 7fc0e8000640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc0e011b180 0x7fc0e01ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:07.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.083+0000 7fc0e8000640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0e0110140 0x7fc0e01a75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:07.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.083+0000 7fc0e8000640 1 --2- 172.21.15.2:0/4017335156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0e010e220 0x7fc0e01a7090 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:07.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.083+0000 7fc0e8000640 1 -- 172.21.15.2:0/4017335156 >> 172.21.15.2:0/4017335156 conn(0x7fc0e006ca80 msgr2=0x7fc0e0119b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:07.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.083+0000 7fc0e8000640 1 -- 172.21.15.2:0/4017335156 shutdown_connections 2024-06-13T02:31:07.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.083+0000 7fc0e8000640 1 -- 172.21.15.2:0/4017335156 wait complete. 2024-06-13T02:31:07.116 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-06-13T02:31:07.126 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-13T02:31:07.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:07 smithi002 ceph-mon[31960]: pgmap v420: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 222 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 18 MiB/s wr, 342 op/s 2024-06-13T02:31:07.383 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:07 smithi002 ceph-mon[31960]: from='client.26287 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:31:07.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.420+0000 7f4d6a600640 1 -- 172.21.15.2:0/1006209660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64109a90 msgr2=0x7f4d64109e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:07.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.420+0000 7f4d6a600640 1 --2- 172.21.15.2:0/1006209660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64109a90 0x7f4d64109e70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009ca0 tx=0x7f4d5c02a8b0 comp rx=0 tx=0).stop 2024-06-13T02:31:07.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.420+0000 7f4d6a600640 1 -- 172.21.15.2:0/1006209660 shutdown_connections 2024-06-13T02:31:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.420+0000 7f4d6a600640 1 --2- 172.21.15.2:0/1006209660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d64104440 0x7f4d64110950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.420+0000 7f4d6a600640 1 --2- 172.21.15.2:0/1006209660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d64103a80 0x7f4d64103f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.420+0000 7f4d6a600640 1 --2- 172.21.15.2:0/1006209660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64109a90 0x7f4d64109e70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.420+0000 7f4d6a600640 1 -- 172.21.15.2:0/1006209660 >> 172.21.15.2:0/1006209660 conn(0x7f4d640ff510 msgr2=0x7f4d64101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.421+0000 7f4d6a600640 1 -- 172.21.15.2:0/1006209660 shutdown_connections 2024-06-13T02:31:07.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.421+0000 7f4d6a600640 1 -- 172.21.15.2:0/1006209660 wait complete. 2024-06-13T02:31:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.422+0000 7f4d6a600640 1 Processor -- start 2024-06-13T02:31:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.423+0000 7f4d6a600640 1 -- start start 2024-06-13T02:31:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.423+0000 7f4d6a600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64103a80 0x7f4d64075eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:07.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.423+0000 7f4d6a600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d64104440 0x7f4d640763f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:07.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.423+0000 7f4d6a600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d64109a90 0x7f4d64076930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:07.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.423+0000 7f4d6a600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4d64113ec0 con 0x7f4d64109a90 2024-06-13T02:31:07.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.424+0000 7f4d6a600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d64113d40 con 0x7f4d64103a80 2024-06-13T02:31:07.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.424+0000 7f4d6a600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4d64114040 con 0x7f4d64104440 2024-06-13T02:31:07.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.424+0000 7f4d69200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64103a80 0x7f4d64075eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.424+0000 7f4d69200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64103a80 0x7f4d64075eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:47910/0 (socket says 172.21.15.2:47910) 2024-06-13T02:31:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.424+0000 7f4d69200640 1 -- 172.21.15.2:0/1635481307 learned_addr learned my addr 172.21.15.2:0/1635481307 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:31:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.424+0000 7f4d69200640 1 -- 172.21.15.2:0/1635481307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d64104440 msgr2=0x7f4d640763f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-13T02:31:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.424+0000 7f4d69200640 1 --2- 172.21.15.2:0/1635481307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d64104440 0x7f4d640763f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.424+0000 7f4d69200640 1 -- 172.21.15.2:0/1635481307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d64109a90 msgr2=0x7f4d64076930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.425+0000 7f4d69200640 1 --2- 172.21.15.2:0/1635481307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d64109a90 0x7f4d64076930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:07.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.425+0000 7f4d69200640 1 -- 172.21.15.2:0/1635481307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6419c190 con 0x7f4d64103a80 2024-06-13T02:31:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.425+0000 7f4d69200640 1 --2- 172.21.15.2:0/1635481307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64103a80 0x7f4d64075eb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c02aea0 tx=0x7f4d5c003f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.426+0000 7f4d61600640 1 -- 172.21.15.2:0/1635481307 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c004040 con 0x7f4d64103a80 2024-06-13T02:31:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.426+0000 7f4d61600640 1 -- 172.21.15.2:0/1635481307 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d5c040070 con 0x7f4d64103a80 2024-06-13T02:31:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.426+0000 7f4d61600640 1 -- 172.21.15.2:0/1635481307 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c045af0 con 0x7f4d64103a80 2024-06-13T02:31:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.428+0000 7f4d6a600640 1 -- 172.21.15.2:0/1635481307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6419c420 con 0x7f4d64103a80 2024-06-13T02:31:07.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.428+0000 7f4d6a600640 1 -- 172.21.15.2:0/1635481307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d6419c920 con 0x7f4d64103a80 2024-06-13T02:31:07.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.431+0000 7f4d6a600640 1 -- 172.21.15.2:0/1635481307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d641051c0 con 0x7f4d64103a80 2024-06-13T02:31:07.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.433+0000 7f4d61600640 1 -- 172.21.15.2:0/1635481307 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f4d5c045c90 con 0x7f4d64103a80 2024-06-13T02:31:07.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.435+0000 7f4d61600640 1 --2- 172.21.15.2:0/1635481307 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f4d480a2dc0 0x7f4d480a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:07.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.436+0000 7f4d61600640 1 -- 172.21.15.2:0/1635481307 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9671+0+0 (secure 0 0 0) 0x7f4d5c0f0bd0 con 0x7f4d64103a80 2024-06-13T02:31:07.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.437+0000 7f4d63e00640 1 --2- 172.21.15.2:0/1635481307 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f4d480a2dc0 0x7f4d480a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:07.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.438+0000 7f4d63e00640 1 --2- 172.21.15.2:0/1635481307 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f4d480a2dc0 0x7f4d480a5280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4d64077670 tx=0x7f4d5000b370 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:07.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.441+0000 7f4d61600640 1 -- 172.21.15.2:0/1635481307 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4d5c04a060 con 0x7f4d64103a80 2024-06-13T02:31:07.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:07 smithi175 ceph-mon[36977]: pgmap v420: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 222 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 18 MiB/s wr, 342 op/s 2024-06-13T02:31:07.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:07 smithi175 ceph-mon[36977]: from='client.26287 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:31:07.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:07 smithi084 ceph-mon[36833]: pgmap v420: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 222 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 18 MiB/s wr, 342 op/s 2024-06-13T02:31:07.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:07 smithi084 ceph-mon[36833]: from='client.26287 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:31:07.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.825+0000 7f4d6a600640 1 -- 172.21.15.2:0/1635481307 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d6410bff0 con 0x7f4d64103a80 2024-06-13T02:31:07.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.828+0000 7f4d61600640 1 -- 172.21.15.2:0/1635481307 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) ==== 74+0+25548 (secure 0 0 0) 0x7f4d5c0bd480 con 0x7f4d64103a80 2024-06-13T02:31:07.832 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:31:07.832 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":120,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","created":"2024-06-13T02:03:16.412002+0000","modified":"2024-06-13T02:31:05.199683+0000","last_up_change":"2024-06-13T02:11:26.464184+0000","last_in_change":"2024-06-13T02:11:06.957351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T02:07:10.994857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T02:12:34.674172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T02:12:39.213985+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":23,"snap_epoch":120,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T02:12:53.098590+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":23,"snap_epoch":120,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96b4d494-453c-48aa-b1e2-ee30dfa83e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6803","nonce":3254812126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6805","nonce":3254812126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6809","nonce":3254812126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6807","nonce":3254812126}]},"public_addr":"172.21.15.2:6803/3254812126","cluster_addr":"172.21.15.2:6805/3254812126","heartbeat_back_addr":"172.21.15.2:6809/3254812126","heartbeat_front_addr":"172.21.15.2:6807/3254812126","state":["exists","up"]},{"osd":1,"uuid":"856e86b6-9281-485b-a36b-2fe04de31329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6801","nonce":1593775403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6803","nonce":1593775403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6807","nonce":1593775403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6805","nonce":1593775403}]},"public_addr":"172.21.15.84:6801/1593775403","cluster_addr":"172.21.15.84:6803/1593775403","heartbeat_back_addr":"172.21.15.84:6807/1593775403","heartbeat_front_addr":"172.21.15.84:6805/1593775403","state":["exists","up"]},{"osd":2,"uuid":"8c9daa52-0dfb-471a-afb4-6eb0b908195a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6801","nonce":2174304558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6803","nonce":2174304558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6807","nonce":2174304558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6805","nonce":2174304558}]},"public_addr":"172.21.15.175:6801/2174304558","cluster_addr":"172.21.15.175:6803/2174304558","heartbeat_back_addr":"172.21.15.175:6807/2174304558","heartbeat_front_addr":"172.21.15.175:6805/2174304558","state":["exists","up"]},{"osd":3,"uuid":"2e747d36-4aa5-4c4c-918d-b8100980cc8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6811","nonce":3010864289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6813","nonce":3010864289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6817","nonce":3010864289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6815","nonce":3010864289}]},"public_addr":"172.21.15.2:6811/3010864289","cluster_addr":"172.21.15.2:6813/3010864289","heartbeat_back_addr":"172.21.15.2:6817/3010864289","heartbeat_front_addr":"172.21.15.2:6815/3010864289","state":["exists","up"]},{"osd":4,"uuid":"bd063fb2-1a65-4b18-898c-f80ddc2a1229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6809","nonce":2541323390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6811","nonce":2541323390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6815","nonce":2541323390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6813","nonce":2541323390}]},"public_addr":"172.21.15.84:6809/2541323390","cluster_addr":"172.21.15.84:6811/2541323390","heartbeat_back_addr":"172.21.15.84:6815/2541323390","heartbeat_front_addr":"172.21.15.84:6813/2541323390","state":["exists","up"]},{"osd":5,"uuid":"e0ea80fd-1bfe-4d2e-9733-ff442ec015b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6809","nonce":764262885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6811","nonce":764262885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6815","nonce":764262885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6813","nonce":764262885}]},"public_addr":"172.21.15.175:6809/764262885","cluster_addr":"172.21.15.175:6811/764262885","heartbeat_back_addr":"172.21.15.175:6815/764262885","heartbeat_front_addr":"172.21.15.175:6813/764262885","state":["exists","up"]},{"osd":6,"uuid":"1c204d74-5e48-4e2e-bb98-6a8d4974187c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6819","nonce":297321106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6821","nonce":297321106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6825","nonce":297321106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6823","nonce":297321106}]},"public_addr":"172.21.15.2:6819/297321106","cluster_addr":"172.21.15.2:6821/297321106","heartbeat_back_addr":"172.21.15.2:6825/297321106","heartbeat_front_addr":"172.21.15.2:6823/297321106","state":["exists","up"]},{"osd":7,"uuid":"1299bbb1-fbfb-4aba-be6b-6704691735f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6817","nonce":3873726653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6819","nonce":3873726653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6823","nonce":3873726653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6821","nonce":3873726653}]},"public_addr":"172.21.15.84:6817/3873726653","cluster_addr":"172.21.15.84:6819/3873726653","heartbeat_back_addr":"172.21.15.84:6823/3873726653","heartbeat_front_addr":"172.21.15.84:6821/3873726653","state":["exists","up"]},{"osd":8,"uuid":"9c3f2a92-d956-4246-bce9-620824d0da22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6817","nonce":2622818232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6819","nonce":2622818232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6823","nonce":2622818232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6821","nonce":2622818232}]},"public_addr":"172.21.15.175:6817/2622818232","cluster_addr":"172.21.15.175:6819/2622818232","heartbeat_back_addr":"172.21.15.175:6823/2622818232","heartbeat_front_addr":"172.21.15.175:6821/2622818232","state":["exists","up"]},{"osd":9,"uuid":"e9839f78-05c6-4b3f-bc14-cb771a03ff5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6827","nonce":1171735390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6829","nonce":1171735390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6833","nonce":1171735390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6831","nonce":1171735390}]},"public_addr":"172.21.15.2:6827/1171735390","cluster_addr":"172.21.15.2:6829/1171735390","heartbeat_back_addr":"172.21.15.2:6833/1171735390","heartbeat_front_addr":"172.21.15.2:6831/1171735390","state":["exists","up"]},{"osd":10,"uuid":"66719431-5ba9-4865-957b-f6582e607a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6825","nonce":4269523460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6827","nonce":4269523460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6831","nonce":4269523460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6829","nonce":4269523460}]},"public_addr":"172.21.15.84:6825/4269523460","cluster_addr":"172.21.15.84:6827/4269523460","heartbeat_back_addr":"172.21.15.84:6831/4269523460","heartbeat_front_addr":"172.21.15.84:6829/4269523460","state":["exists","up"]},{"osd":11,"uuid":"1ce6e6ee-6ff3-416f-b985-e3afe503093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6825","nonce":2762894732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6827","nonce":2762894732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6831","nonce":2762894732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6829","nonce":2762894732}]},"public_addr":"172.21.15.175:6825/2762894732","cluster_addr":"172.21.15.175:6827/2762894732","heartbeat_back_addr":"172.21.15.175:6831/2762894732","heartbeat_front_addr":"172.21.15.175:6829/2762894732","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:16.956638+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:42.268685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:06.272084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:39.696927+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:06.182991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:31.626603+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:05.247728+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:31.985114+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:57.474180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:31.988863+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:59.683056+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:11:24.493248+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/1200045905":"2024-06-14T02:17:49.559195+0000","172.21.15.2:0/968145683":"2024-06-14T02:17:49.559195+0000","172.21.15.2:6800/2988831869":"2024-06-14T02:17:49.559195+0000","172.21.15.2:0/3011421954":"2024-06-14T02:17:49.559195+0000","172.21.15.2:6801/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6800/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/544481430":"2024-06-14T02:17:49.559195+0000","172.21.15.2:0/3397168014":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/1789744365":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3831398703":"2024-06-14T02:03:50.073572+0000","172.21.15.2:6801/2988831869":"2024-06-14T02:17:49.559195+0000","172.21.15.2:0/3119270562":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/2163302458":"2024-06-14T02:03:50.073572+0000","172.21.15.2:6800/2830681579":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/1678672435":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6801/2830681579":"2024-06-14T02:03:50.073572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]},{"pool":4,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]},{"pool":4,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T02:31:07.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.835+0000 7f4d6a600640 1 -- 172.21.15.2:0/1635481307 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f4d480a2dc0 msgr2=0x7f4d480a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:07.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.835+0000 7f4d6a600640 1 --2- 172.21.15.2:0/1635481307 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f4d480a2dc0 0x7f4d480a5280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4d64077670 tx=0x7f4d5000b370 comp rx=0 tx=0).stop 2024-06-13T02:31:07.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.835+0000 7f4d6a600640 1 -- 172.21.15.2:0/1635481307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64103a80 msgr2=0x7f4d64075eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:07.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.835+0000 7f4d6a600640 1 --2- 172.21.15.2:0/1635481307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64103a80 0x7f4d64075eb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c02aea0 tx=0x7f4d5c003f80 comp rx=0 tx=0).stop 2024-06-13T02:31:07.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.836+0000 7f4d6a600640 1 -- 172.21.15.2:0/1635481307 shutdown_connections 2024-06-13T02:31:07.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.836+0000 7f4d6a600640 1 --2- 172.21.15.2:0/1635481307 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f4d480a2dc0 0x7f4d480a5280 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:07.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.836+0000 7f4d6a600640 1 --2- 172.21.15.2:0/1635481307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4d64109a90 0x7f4d64076930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:07.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.836+0000 7f4d6a600640 1 --2- 172.21.15.2:0/1635481307 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d64104440 0x7f4d640763f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:07.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.836+0000 7f4d6a600640 1 --2- 172.21.15.2:0/1635481307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d64103a80 0x7f4d64075eb0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:07.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.836+0000 7f4d6a600640 1 -- 172.21.15.2:0/1635481307 >> 172.21.15.2:0/1635481307 conn(0x7f4d640ff510 msgr2=0x7f4d640ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:07.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.836+0000 7f4d6a600640 1 -- 172.21.15.2:0/1635481307 shutdown_connections 2024-06-13T02:31:07.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:07.836+0000 7f4d6a600640 1 -- 172.21.15.2:0/1635481307 wait complete. 2024-06-13T02:31:07.869 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-13T02:07:10.994857+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-13T02:12:34.674172+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-13T02:12:39.213985+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 23, 'snap_epoch': 120, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-06-13T02:12:53.098590+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 23, 'snap_epoch': 120, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-06-13T02:31:07.870 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-13T02:31:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.175+0000 7f4aa0a00640 1 -- 172.21.15.2:0/1933287648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a94009690 msgr2=0x7f4a94007ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.175+0000 7f4aa0a00640 1 --2- 172.21.15.2:0/1933287648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a94009690 0x7f4a94007ad0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009860 tx=0x7f4a9002a340 comp rx=0 tx=0).stop 2024-06-13T02:31:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.175+0000 7f4aa0a00640 1 -- 172.21.15.2:0/1933287648 shutdown_connections 2024-06-13T02:31:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.175+0000 7f4aa0a00640 1 --2- 172.21.15.2:0/1933287648 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a940a6ba0 0x7f4a940a8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.175+0000 7f4aa0a00640 1 --2- 172.21.15.2:0/1933287648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a94008010 0x7f4a94008490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.175+0000 7f4aa0a00640 1 --2- 172.21.15.2:0/1933287648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a94009690 0x7f4a94007ad0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.175+0000 7f4aa0a00640 1 -- 172.21.15.2:0/1933287648 >> 172.21.15.2:0/1933287648 conn(0x7f4a9400b850 msgr2=0x7f4a9400bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.175+0000 7f4aa0a00640 1 -- 172.21.15.2:0/1933287648 shutdown_connections 2024-06-13T02:31:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.175+0000 7f4aa0a00640 1 -- 172.21.15.2:0/1933287648 wait complete. 2024-06-13T02:31:08.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.177+0000 7f4aa0a00640 1 Processor -- start 2024-06-13T02:31:08.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.177+0000 7f4aa0a00640 1 -- start start 2024-06-13T02:31:08.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.177+0000 7f4aa0a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a94008010 0x7f4a941387a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:08.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.177+0000 7f4aa0a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a94009690 0x7f4a94138ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:08.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.177+0000 7f4aa0a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a940a6ba0 0x7f4a94132950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:08.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.177+0000 7f4aa0a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4a940ac670 con 0x7f4a940a6ba0 2024-06-13T02:31:08.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.177+0000 7f4aa0a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4a940ac4f0 con 0x7f4a94009690 2024-06-13T02:31:08.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.177+0000 7f4aa0a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4a940ac7f0 con 0x7f4a94008010 2024-06-13T02:31:08.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.178+0000 7f4a9aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a94009690 0x7f4a94138ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:08.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.178+0000 7f4a9aa00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a94009690 0x7f4a94138ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:47928/0 (socket says 172.21.15.2:47928) 2024-06-13T02:31:08.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.178+0000 7f4a9aa00640 1 -- 172.21.15.2:0/1827636237 learned_addr learned my addr 172.21.15.2:0/1827636237 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:31:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.178+0000 7f4a9b400640 1 --2- 172.21.15.2:0/1827636237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a94008010 0x7f4a941387a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.178+0000 7f4a9aa00640 1 -- 172.21.15.2:0/1827636237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a94008010 msgr2=0x7f4a941387a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.178+0000 7f4a9aa00640 1 --2- 172.21.15.2:0/1827636237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a94008010 0x7f4a941387a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.178+0000 7f4a9aa00640 1 -- 172.21.15.2:0/1827636237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a940a6ba0 msgr2=0x7f4a94132950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.178+0000 7f4a9aa00640 1 --2- 172.21.15.2:0/1827636237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a940a6ba0 0x7f4a94132950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.178+0000 7f4a9aa00640 1 -- 172.21.15.2:0/1827636237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a941330a0 con 0x7f4a94009690 2024-06-13T02:31:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.179+0000 7f4a9aa00640 1 --2- 172.21.15.2:0/1827636237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a94009690 0x7f4a94138ce0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800e9f0 tx=0x7f4a8800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.179+0000 7f4a8fe00640 1 -- 172.21.15.2:0/1827636237 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8800ccc0 con 0x7f4a94009690 2024-06-13T02:31:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.180+0000 7f4a8fe00640 1 -- 172.21.15.2:0/1827636237 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a8800ce60 con 0x7f4a94009690 2024-06-13T02:31:08.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.180+0000 7f4a8fe00640 1 -- 172.21.15.2:0/1827636237 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88010690 con 0x7f4a94009690 2024-06-13T02:31:08.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.181+0000 7f4aa0a00640 1 -- 172.21.15.2:0/1827636237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a94133390 con 0x7f4a94009690 2024-06-13T02:31:08.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.181+0000 7f4aa0a00640 1 -- 172.21.15.2:0/1827636237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a94150670 con 0x7f4a94009690 2024-06-13T02:31:08.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.182+0000 7f4aa0a00640 1 -- 172.21.15.2:0/1827636237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a94005590 con 0x7f4a94009690 2024-06-13T02:31:08.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.187+0000 7f4a8fe00640 1 -- 172.21.15.2:0/1827636237 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f4a880046c0 con 0x7f4a94009690 2024-06-13T02:31:08.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.189+0000 7f4a8fe00640 1 --2- 172.21.15.2:0/1827636237 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f4a840a2e50 0x7f4a840a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:08.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.189+0000 7f4a8fe00640 1 -- 172.21.15.2:0/1827636237 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9671+0+0 (secure 0 0 0) 0x7f4a880cfb20 con 0x7f4a94009690 2024-06-13T02:31:08.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.192+0000 7f4a9b400640 1 --2- 172.21.15.2:0/1827636237 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f4a840a2e50 0x7f4a840a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:08.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.193+0000 7f4a9b400640 1 --2- 172.21.15.2:0/1827636237 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f4a840a2e50 0x7f4a840a5310 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009830 tx=0x7f4a900056d0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:08.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.193+0000 7f4a8fe00640 1 -- 172.21.15.2:0/1827636237 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f4a8809c2c0 con 0x7f4a94009690 2024-06-13T02:31:08.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:08 smithi175 ceph-mon[36977]: from='client.26309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:31:08.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:08 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1635481307' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:31:08.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.593+0000 7f4aa0a00640 1 -- 172.21.15.2:0/1827636237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4a94150b20 con 0x7f4a94009690 2024-06-13T02:31:08.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.594+0000 7f4a8fe00640 1 -- 172.21.15.2:0/1827636237 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v120) ==== 93+0+10 (secure 0 0 0) 0x7f4a8809bbc0 con 0x7f4a94009690 2024-06-13T02:31:08.595 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-06-13T02:31:08.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.598+0000 7f4aa0a00640 1 -- 172.21.15.2:0/1827636237 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f4a840a2e50 msgr2=0x7f4a840a5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.598+0000 7f4aa0a00640 1 --2- 172.21.15.2:0/1827636237 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f4a840a2e50 0x7f4a840a5310 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009830 tx=0x7f4a900056d0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.598+0000 7f4aa0a00640 1 -- 172.21.15.2:0/1827636237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a94009690 msgr2=0x7f4a94138ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:08.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.598+0000 7f4aa0a00640 1 --2- 172.21.15.2:0/1827636237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a94009690 0x7f4a94138ce0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800e9f0 tx=0x7f4a8800eeb0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.602+0000 7f4aa0a00640 1 -- 172.21.15.2:0/1827636237 shutdown_connections 2024-06-13T02:31:08.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.602+0000 7f4aa0a00640 1 --2- 172.21.15.2:0/1827636237 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f4a840a2e50 0x7f4a840a5310 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.602+0000 7f4aa0a00640 1 --2- 172.21.15.2:0/1827636237 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4a940a6ba0 0x7f4a94132950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.602+0000 7f4aa0a00640 1 --2- 172.21.15.2:0/1827636237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a94009690 0x7f4a94138ce0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.602+0000 7f4aa0a00640 1 --2- 172.21.15.2:0/1827636237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a94008010 0x7f4a941387a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.602+0000 7f4aa0a00640 1 -- 172.21.15.2:0/1827636237 >> 172.21.15.2:0/1827636237 conn(0x7f4a9400b850 msgr2=0x7f4a940a2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:08.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.602+0000 7f4aa0a00640 1 -- 172.21.15.2:0/1827636237 shutdown_connections 2024-06-13T02:31:08.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.602+0000 7f4aa0a00640 1 -- 172.21.15.2:0/1827636237 wait complete. 2024-06-13T02:31:08.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:08 smithi002 ceph-mon[31960]: from='client.26309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:31:08.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:08 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1635481307' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:31:08.633 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-13T02:31:08.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:08 smithi084 ceph-mon[36833]: from='client.26309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-13T02:31:08.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:08 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1635481307' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:31:08.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.919+0000 7f7538600640 1 -- 172.21.15.2:0/3237796211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7530112810 msgr2=0x7f7530114c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:08.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.919+0000 7f7538600640 1 --2- 172.21.15.2:0/3237796211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7530112810 0x7f7530114c00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f752801ace0 tx=0x7f752803b960 comp rx=0 tx=0).stop 2024-06-13T02:31:08.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.920+0000 7f7538600640 1 -- 172.21.15.2:0/3237796211 shutdown_connections 2024-06-13T02:31:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.920+0000 7f7538600640 1 --2- 172.21.15.2:0/3237796211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7530112810 0x7f7530114c00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.920+0000 7f7538600640 1 --2- 172.21.15.2:0/3237796211 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75300767f0 0x7f75301122d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.920+0000 7f7538600640 1 --2- 172.21.15.2:0/3237796211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7530075ed0 0x7f75300762b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.920+0000 7f7538600640 1 -- 172.21.15.2:0/3237796211 >> 172.21.15.2:0/3237796211 conn(0x7f75300ff620 msgr2=0x7f7530101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:08.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.920+0000 7f7538600640 1 -- 172.21.15.2:0/3237796211 shutdown_connections 2024-06-13T02:31:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.920+0000 7f7538600640 1 -- 172.21.15.2:0/3237796211 wait complete. 2024-06-13T02:31:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.921+0000 7f7538600640 1 Processor -- start 2024-06-13T02:31:08.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.921+0000 7f7538600640 1 -- start start 2024-06-13T02:31:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.922+0000 7f7538600640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7530075ed0 0x7f7530111e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.922+0000 7f7538600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75300767f0 0x7f753010df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.922+0000 7f7538600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7530112810 0x7f753010e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.922+0000 7f7538600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7530106410 con 0x7f75300767f0 2024-06-13T02:31:08.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.922+0000 7f7538600640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7530106290 con 0x7f7530075ed0 2024-06-13T02:31:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.922+0000 7f7538600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7530106590 con 0x7f7530112810 2024-06-13T02:31:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.922+0000 7f7535c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7530075ed0 0x7f7530111e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.922+0000 7f7535c00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7530075ed0 0x7f7530111e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:47954/0 (socket says 172.21.15.2:47954) 2024-06-13T02:31:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.922+0000 7f7535c00640 1 -- 172.21.15.2:0/905256913 learned_addr learned my addr 172.21.15.2:0/905256913 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:31:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.922+0000 7f7535200640 1 --2- 172.21.15.2:0/905256913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75300767f0 0x7f753010df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:08.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.922+0000 7f7536600640 1 --2- 172.21.15.2:0/905256913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7530112810 0x7f753010e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.923+0000 7f7535c00640 1 -- 172.21.15.2:0/905256913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7530112810 msgr2=0x7f753010e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.923+0000 7f7535c00640 1 --2- 172.21.15.2:0/905256913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7530112810 0x7f753010e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.923+0000 7f7535c00640 1 -- 172.21.15.2:0/905256913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75300767f0 msgr2=0x7f753010df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.923+0000 7f7535c00640 1 --2- 172.21.15.2:0/905256913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75300767f0 0x7f753010df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.923+0000 7f7535c00640 1 -- 172.21.15.2:0/905256913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753010ea90 con 0x7f7530075ed0 2024-06-13T02:31:08.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.923+0000 7f7535200640 1 --2- 172.21.15.2:0/905256913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75300767f0 0x7f753010df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:31:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.924+0000 7f7535c00640 1 --2- 172.21.15.2:0/905256913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7530075ed0 0x7f7530111e80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f752400ea20 tx=0x7f752400eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.924+0000 7f752e000640 1 -- 172.21.15.2:0/905256913 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752400cd00 con 0x7f7530075ed0 2024-06-13T02:31:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.924+0000 7f752e000640 1 -- 172.21.15.2:0/905256913 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7524010910 con 0x7f7530075ed0 2024-06-13T02:31:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.924+0000 7f752e000640 1 -- 172.21.15.2:0/905256913 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524018840 con 0x7f7530075ed0 2024-06-13T02:31:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.924+0000 7f7538600640 1 -- 172.21.15.2:0/905256913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753010ed80 con 0x7f7530075ed0 2024-06-13T02:31:08.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.924+0000 7f7538600640 1 -- 172.21.15.2:0/905256913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75301a2a70 con 0x7f7530075ed0 2024-06-13T02:31:08.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.926+0000 7f7538600640 1 -- 172.21.15.2:0/905256913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7530077610 con 0x7f7530075ed0 2024-06-13T02:31:08.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.930+0000 7f752e000640 1 -- 172.21.15.2:0/905256913 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f7524010ac0 con 0x7f7530075ed0 2024-06-13T02:31:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.932+0000 7f752e000640 1 --2- 172.21.15.2:0/905256913 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f75180a2e40 0x7f75180a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.932+0000 7f752e000640 1 -- 172.21.15.2:0/905256913 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9671+0+0 (secure 0 0 0) 0x7f75240cfbf0 con 0x7f7530075ed0 2024-06-13T02:31:08.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.932+0000 7f7535200640 1 --2- 172.21.15.2:0/905256913 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f75180a2e40 0x7f75180a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:08.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.934+0000 7f7535200640 1 --2- 172.21.15.2:0/905256913 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f75180a2e40 0x7f75180a5300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f751c005e10 tx=0x7f751c005da0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:08.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:08.938+0000 7f752e000640 1 -- 172.21.15.2:0/905256913 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f752409c330 con 0x7f7530075ed0 2024-06-13T02:31:09.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.280+0000 7f7538600640 1 -- 172.21.15.2:0/905256913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f753010f440 con 0x7f7530075ed0 2024-06-13T02:31:09.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.281+0000 7f752e000640 1 -- 172.21.15.2:0/905256913 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v120) ==== 104+0+11 (secure 0 0 0) 0x7f752409bc30 con 0x7f7530075ed0 2024-06-13T02:31:09.282 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-06-13T02:31:09.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.284+0000 7f7538600640 1 -- 172.21.15.2:0/905256913 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f75180a2e40 msgr2=0x7f75180a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:09.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.284+0000 7f7538600640 1 --2- 172.21.15.2:0/905256913 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f75180a2e40 0x7f75180a5300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f751c005e10 tx=0x7f751c005da0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.284+0000 7f7538600640 1 -- 172.21.15.2:0/905256913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7530075ed0 msgr2=0x7f7530111e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:09.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.284+0000 7f7538600640 1 --2- 172.21.15.2:0/905256913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7530075ed0 0x7f7530111e80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f752400ea20 tx=0x7f752400eee0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.284+0000 7f7538600640 1 -- 172.21.15.2:0/905256913 shutdown_connections 2024-06-13T02:31:09.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.284+0000 7f7538600640 1 --2- 172.21.15.2:0/905256913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7530112810 0x7f753010e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.284+0000 7f7538600640 1 --2- 172.21.15.2:0/905256913 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f75180a2e40 0x7f75180a5300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.284+0000 7f7538600640 1 --2- 172.21.15.2:0/905256913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75300767f0 0x7f753010df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.284+0000 7f7538600640 1 --2- 172.21.15.2:0/905256913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7530075ed0 0x7f7530111e80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.284+0000 7f7538600640 1 -- 172.21.15.2:0/905256913 >> 172.21.15.2:0/905256913 conn(0x7f75300ff620 msgr2=0x7f7530113e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:09.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.285+0000 7f7538600640 1 -- 172.21.15.2:0/905256913 shutdown_connections 2024-06-13T02:31:09.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.285+0000 7f7538600640 1 -- 172.21.15.2:0/905256913 wait complete. 2024-06-13T02:31:09.310 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-13T02:31:09.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:09 smithi175 ceph-mon[36977]: pgmap v421: 129 pgs: 20 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 55 active+clean; 280 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 24 MiB/s wr, 349 op/s 2024-06-13T02:31:09.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:09 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1827636237' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-13T02:31:09.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.548+0000 7f93eb200640 1 -- 172.21.15.2:0/953409436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93ec1077b0 msgr2=0x7f93ec107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:09.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.548+0000 7f93eb200640 1 --2- 172.21.15.2:0/953409436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93ec1077b0 0x7f93ec107b90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009900 tx=0x7f93dc02a410 comp rx=0 tx=0).stop 2024-06-13T02:31:09.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.548+0000 7f93eb200640 1 -- 172.21.15.2:0/953409436 shutdown_connections 2024-06-13T02:31:09.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.548+0000 7f93eb200640 1 --2- 172.21.15.2:0/953409436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ec102160 0x7f93ec10e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.548+0000 7f93eb200640 1 --2- 172.21.15.2:0/953409436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec1017a0 0x7f93ec101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.548+0000 7f93eb200640 1 --2- 172.21.15.2:0/953409436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93ec1077b0 0x7f93ec107b90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.548+0000 7f93eb200640 1 -- 172.21.15.2:0/953409436 >> 172.21.15.2:0/953409436 conn(0x7f93ec0fd2f0 msgr2=0x7f93ec0ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:09.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.548+0000 7f93eb200640 1 -- 172.21.15.2:0/953409436 shutdown_connections 2024-06-13T02:31:09.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.548+0000 7f93eb200640 1 -- 172.21.15.2:0/953409436 wait complete. 2024-06-13T02:31:09.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.549+0000 7f93eb200640 1 Processor -- start 2024-06-13T02:31:09.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.550+0000 7f93eb200640 1 -- start start 2024-06-13T02:31:09.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.550+0000 7f93eb200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec1017a0 0x7f93ec0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:09.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.550+0000 7f93eb200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ec102160 0x7f93ec073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:09.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.550+0000 7f93eb200640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93ec1077b0 0x7f93ec0742d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:09.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.550+0000 7f93eb200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec111c10 con 0x7f93ec1017a0 2024-06-13T02:31:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.550+0000 7f93eb200640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec111a90 con 0x7f93ec1077b0 2024-06-13T02:31:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.550+0000 7f93eb200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec111d90 con 0x7f93ec102160 2024-06-13T02:31:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.550+0000 7f93e9400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ec102160 0x7f93ec073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.551+0000 7f93e9400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ec102160 0x7f93ec073ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:59220/0 (socket says 172.21.15.2:59220) 2024-06-13T02:31:09.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.551+0000 7f93e9400640 1 -- 172.21.15.2:0/3304833407 learned_addr learned my addr 172.21.15.2:0/3304833407 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:31:09.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.551+0000 7f93e9e00640 1 --2- 172.21.15.2:0/3304833407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec1017a0 0x7f93ec0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:09.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.551+0000 7f93ea800640 1 --2- 172.21.15.2:0/3304833407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93ec1077b0 0x7f93ec0742d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:09.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.551+0000 7f93e9400640 1 -- 172.21.15.2:0/3304833407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93ec1077b0 msgr2=0x7f93ec0742d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:09.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.551+0000 7f93e9400640 1 --2- 172.21.15.2:0/3304833407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93ec1077b0 0x7f93ec0742d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.551+0000 7f93e9400640 1 -- 172.21.15.2:0/3304833407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec1017a0 msgr2=0x7f93ec0758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:09.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.551+0000 7f93e9400640 1 --2- 172.21.15.2:0/3304833407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec1017a0 0x7f93ec0758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.551+0000 7f93e9400640 1 -- 172.21.15.2:0/3304833407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec19c2b0 con 0x7f93ec102160 2024-06-13T02:31:09.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.551+0000 7f93e9e00640 1 --2- 172.21.15.2:0/3304833407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec1017a0 0x7f93ec0758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:31:09.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.552+0000 7f93e9400640 1 --2- 172.21.15.2:0/3304833407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ec102160 0x7f93ec073ca0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f93d800e9f0 tx=0x7f93d800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:09.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.553+0000 7f93e2a00640 1 -- 172.21.15.2:0/3304833407 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d800cd80 con 0x7f93ec102160 2024-06-13T02:31:09.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.553+0000 7f93e2a00640 1 -- 172.21.15.2:0/3304833407 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d8010910 con 0x7f93ec102160 2024-06-13T02:31:09.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.553+0000 7f93e2a00640 1 -- 172.21.15.2:0/3304833407 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8018980 con 0x7f93ec102160 2024-06-13T02:31:09.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.553+0000 7f93eb200640 1 -- 172.21.15.2:0/3304833407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93ec19c5a0 con 0x7f93ec102160 2024-06-13T02:31:09.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.553+0000 7f93eb200640 1 -- 172.21.15.2:0/3304833407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93ec19caa0 con 0x7f93ec102160 2024-06-13T02:31:09.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.554+0000 7f93eb200640 1 -- 172.21.15.2:0/3304833407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93ec102ee0 con 0x7f93ec102160 2024-06-13T02:31:09.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.557+0000 7f93e2a00640 1 -- 172.21.15.2:0/3304833407 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f93d8010ac0 con 0x7f93ec102160 2024-06-13T02:31:09.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.559+0000 7f93e2a00640 1 --2- 172.21.15.2:0/3304833407 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f93d00a2e80 0x7f93d00a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:09.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.560+0000 7f93e2a00640 1 -- 172.21.15.2:0/3304833407 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9671+0+0 (secure 0 0 0) 0x7f93d80d0190 con 0x7f93ec102160 2024-06-13T02:31:09.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.560+0000 7f93e9e00640 1 --2- 172.21.15.2:0/3304833407 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f93d00a2e80 0x7f93d00a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:09.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.560+0000 7f93e2a00640 1 -- 172.21.15.2:0/3304833407 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f93d809c9b0 con 0x7f93ec102160 2024-06-13T02:31:09.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.561+0000 7f93e9e00640 1 --2- 172.21.15.2:0/3304833407 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f93d00a2e80 0x7f93d00a5340 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93dc000c00 tx=0x7f93dc02a910 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:09.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:09 smithi002 ceph-mon[31960]: pgmap v421: 129 pgs: 20 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 55 active+clean; 280 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 24 MiB/s wr, 349 op/s 2024-06-13T02:31:09.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:09 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1827636237' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-13T02:31:09.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:09 smithi084 ceph-mon[36833]: pgmap v421: 129 pgs: 20 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 55 active+clean; 280 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 24 MiB/s wr, 349 op/s 2024-06-13T02:31:09.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:09 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1827636237' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-13T02:31:09.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.792+0000 7f93eb200640 1 -- 172.21.15.2:0/3304833407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f93ec109d10 con 0x7f93ec102160 2024-06-13T02:31:09.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.793+0000 7f93e2a00640 1 -- 172.21.15.2:0/3304833407 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v120) ==== 100+0+11 (secure 0 0 0) 0x7f93d8096e20 con 0x7f93ec102160 2024-06-13T02:31:09.794 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-06-13T02:31:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.796+0000 7f93eb200640 1 -- 172.21.15.2:0/3304833407 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f93d00a2e80 msgr2=0x7f93d00a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.796+0000 7f93eb200640 1 --2- 172.21.15.2:0/3304833407 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f93d00a2e80 0x7f93d00a5340 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93dc000c00 tx=0x7f93dc02a910 comp rx=0 tx=0).stop 2024-06-13T02:31:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.796+0000 7f93eb200640 1 -- 172.21.15.2:0/3304833407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ec102160 msgr2=0x7f93ec073ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.796+0000 7f93eb200640 1 --2- 172.21.15.2:0/3304833407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ec102160 0x7f93ec073ca0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f93d800e9f0 tx=0x7f93d800eeb0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.796+0000 7f93eb200640 1 -- 172.21.15.2:0/3304833407 shutdown_connections 2024-06-13T02:31:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.796+0000 7f93eb200640 1 --2- 172.21.15.2:0/3304833407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93ec1077b0 0x7f93ec0742d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.796+0000 7f93eb200640 1 --2- 172.21.15.2:0/3304833407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ec102160 0x7f93ec073ca0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.796+0000 7f93eb200640 1 --2- 172.21.15.2:0/3304833407 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f93d00a2e80 0x7f93d00a5340 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.796+0000 7f93eb200640 1 --2- 172.21.15.2:0/3304833407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f93ec1017a0 0x7f93ec0758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.796+0000 7f93eb200640 1 -- 172.21.15.2:0/3304833407 >> 172.21.15.2:0/3304833407 conn(0x7f93ec0fd2f0 msgr2=0x7f93ec0fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.796+0000 7f93eb200640 1 -- 172.21.15.2:0/3304833407 shutdown_connections 2024-06-13T02:31:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:09.796+0000 7f93eb200640 1 -- 172.21.15.2:0/3304833407 wait complete. 2024-06-13T02:31:09.818 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-06-13T02:31:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.015+0000 7f1625a00640 1 -- 172.21.15.2:0/2246597277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1620103df0 msgr2=0x7f16201041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.015+0000 7f1625a00640 1 --2- 172.21.15.2:0/2246597277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1620103df0 0x7f16201041d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1610009900 tx=0x7f161002a400 comp rx=0 tx=0).stop 2024-06-13T02:31:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.015+0000 7f1625a00640 1 -- 172.21.15.2:0/2246597277 shutdown_connections 2024-06-13T02:31:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.015+0000 7f1625a00640 1 --2- 172.21.15.2:0/2246597277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1620108ec0 0x7f1620110a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.015+0000 7f1625a00640 1 --2- 172.21.15.2:0/2246597277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16201047a0 0x7f16201087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.015+0000 7f1625a00640 1 --2- 172.21.15.2:0/2246597277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1620103df0 0x7f16201041d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.015+0000 7f1625a00640 1 -- 172.21.15.2:0/2246597277 >> 172.21.15.2:0/2246597277 conn(0x7f16200ff610 msgr2=0x7f1620101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:10.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.015+0000 7f1625a00640 1 -- 172.21.15.2:0/2246597277 shutdown_connections 2024-06-13T02:31:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.015+0000 7f1625a00640 1 -- 172.21.15.2:0/2246597277 wait complete. 2024-06-13T02:31:10.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.016+0000 7f1625a00640 1 Processor -- start 2024-06-13T02:31:10.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.016+0000 7f1625a00640 1 -- start start 2024-06-13T02:31:10.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.016+0000 7f1625a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1620103df0 0x7f162019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.016+0000 7f1625a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1620108ec0 0x7f162019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.016+0000 7f1625a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162019ede0 0x7f162019f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.016+0000 7f1625a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1620113fc0 con 0x7f1620108ec0 2024-06-13T02:31:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.016+0000 7f1625a00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1620113e40 con 0x7f1620103df0 2024-06-13T02:31:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.016+0000 7f1625a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1620114140 con 0x7f162019ede0 2024-06-13T02:31:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.017+0000 7f161ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1620103df0 0x7f162019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:10.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.017+0000 7f161f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162019ede0 0x7f162019f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:10.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.017+0000 7f1616000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1620108ec0 0x7f162019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:10.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.017+0000 7f161ea00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1620103df0 0x7f162019a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:47974/0 (socket says 172.21.15.2:47974) 2024-06-13T02:31:10.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.017+0000 7f161ea00640 1 -- 172.21.15.2:0/1614037549 learned_addr learned my addr 172.21.15.2:0/1614037549 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:31:10.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.017+0000 7f161f400640 1 -- 172.21.15.2:0/1614037549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1620103df0 msgr2=0x7f162019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:10.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.017+0000 7f161f400640 1 --2- 172.21.15.2:0/1614037549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1620103df0 0x7f162019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.017+0000 7f161f400640 1 -- 172.21.15.2:0/1614037549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1620108ec0 msgr2=0x7f162019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.017+0000 7f161f400640 1 --2- 172.21.15.2:0/1614037549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1620108ec0 0x7f162019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.017+0000 7f161f400640 1 -- 172.21.15.2:0/1614037549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f162019f8d0 con 0x7f162019ede0 2024-06-13T02:31:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.017+0000 7f161f400640 1 --2- 172.21.15.2:0/1614037549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162019ede0 0x7f162019f290 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f161800e940 tx=0x7f161800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.018+0000 7f1617e00640 1 -- 172.21.15.2:0/1614037549 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1618004d20 con 0x7f162019ede0 2024-06-13T02:31:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.018+0000 7f1617e00640 1 -- 172.21.15.2:0/1614037549 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1618005020 con 0x7f162019ede0 2024-06-13T02:31:10.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.018+0000 7f1625a00640 1 -- 172.21.15.2:0/1614037549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f162019fbc0 con 0x7f162019ede0 2024-06-13T02:31:10.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.018+0000 7f1617e00640 1 -- 172.21.15.2:0/1614037549 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16180116b0 con 0x7f162019ede0 2024-06-13T02:31:10.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.018+0000 7f1625a00640 1 -- 172.21.15.2:0/1614037549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16201a73b0 con 0x7f162019ede0 2024-06-13T02:31:10.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.019+0000 7f1625a00640 1 -- 172.21.15.2:0/1614037549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1620068850 con 0x7f162019ede0 2024-06-13T02:31:10.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.021+0000 7f1617e00640 1 -- 172.21.15.2:0/1614037549 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f16180054d0 con 0x7f162019ede0 2024-06-13T02:31:10.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.022+0000 7f1617e00640 1 --2- 172.21.15.2:0/1614037549 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f16040a2d80 0x7f16040a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:10.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.022+0000 7f1617e00640 1 -- 172.21.15.2:0/1614037549 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9671+0+0 (secure 0 0 0) 0x7f16180cf890 con 0x7f162019ede0 2024-06-13T02:31:10.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.023+0000 7f161ea00640 1 --2- 172.21.15.2:0/1614037549 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f16040a2d80 0x7f16040a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:10.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.023+0000 7f161ea00640 1 --2- 172.21.15.2:0/1614037549 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f16040a2d80 0x7f16040a5240 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f16100096c0 tx=0x7f16100046c0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:10.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.024+0000 7f1617e00640 1 -- 172.21.15.2:0/1614037549 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f1618016030 con 0x7f162019ede0 2024-06-13T02:31:10.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.219+0000 7f1625a00640 1 -- 172.21.15.2:0/1614037549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f16201047a0 con 0x7f162019ede0 2024-06-13T02:31:10.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.220+0000 7f1617e00640 1 -- 172.21.15.2:0/1614037549 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v120) ==== 103+0+11 (secure 0 0 0) 0x7f161809ba00 con 0x7f162019ede0 2024-06-13T02:31:10.221 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-06-13T02:31:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.222+0000 7f1625a00640 1 -- 172.21.15.2:0/1614037549 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f16040a2d80 msgr2=0x7f16040a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.222+0000 7f1625a00640 1 --2- 172.21.15.2:0/1614037549 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f16040a2d80 0x7f16040a5240 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f16100096c0 tx=0x7f16100046c0 comp rx=0 tx=0).stop 2024-06-13T02:31:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.222+0000 7f1625a00640 1 -- 172.21.15.2:0/1614037549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162019ede0 msgr2=0x7f162019f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:10.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.222+0000 7f1625a00640 1 --2- 172.21.15.2:0/1614037549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162019ede0 0x7f162019f290 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f161800e940 tx=0x7f161800ee00 comp rx=0 tx=0).stop 2024-06-13T02:31:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.222+0000 7f1625a00640 1 -- 172.21.15.2:0/1614037549 shutdown_connections 2024-06-13T02:31:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.222+0000 7f1625a00640 1 --2- 172.21.15.2:0/1614037549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f162019ede0 0x7f162019f290 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.222+0000 7f1625a00640 1 --2- 172.21.15.2:0/1614037549 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f16040a2d80 0x7f16040a5240 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.222+0000 7f1625a00640 1 --2- 172.21.15.2:0/1614037549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1620108ec0 0x7f162019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:10.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.222+0000 7f1625a00640 1 --2- 172.21.15.2:0/1614037549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1620103df0 0x7f162019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.222+0000 7f1625a00640 1 -- 172.21.15.2:0/1614037549 >> 172.21.15.2:0/1614037549 conn(0x7f16200ff610 msgr2=0x7f1620100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.222+0000 7f1625a00640 1 -- 172.21.15.2:0/1614037549 shutdown_connections 2024-06-13T02:31:10.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.222+0000 7f1625a00640 1 -- 172.21.15.2:0/1614037549 wait complete. 2024-06-13T02:31:10.241 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-06-13T02:31:10.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.444+0000 7f31eee00640 1 -- 172.21.15.2:0/1480173619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e8073dd0 msgr2=0x7f31e80741b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:10.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.444+0000 7f31eee00640 1 --2- 172.21.15.2:0/1480173619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e8073dd0 0x7f31e80741b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f31d8009900 tx=0x7f31d802a480 comp rx=0 tx=0).stop 2024-06-13T02:31:10.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.445+0000 7f31eee00640 1 -- 172.21.15.2:0/1480173619 shutdown_connections 2024-06-13T02:31:10.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.445+0000 7f31eee00640 1 --2- 172.21.15.2:0/1480173619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e810e1b0 0x7f31e8110600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:10.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.445+0000 7f31eee00640 1 --2- 172.21.15.2:0/1480173619 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31e80746f0 0x7f31e810dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:10.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.445+0000 7f31eee00640 1 --2- 172.21.15.2:0/1480173619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e8073dd0 0x7f31e80741b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:10.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.445+0000 7f31eee00640 1 -- 172.21.15.2:0/1480173619 >> 172.21.15.2:0/1480173619 conn(0x7f31e80fd480 msgr2=0x7f31e80ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:10.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.445+0000 7f31eee00640 1 -- 172.21.15.2:0/1480173619 shutdown_connections 2024-06-13T02:31:10.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.445+0000 7f31eee00640 1 -- 172.21.15.2:0/1480173619 wait complete. 2024-06-13T02:31:10.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.446+0000 7f31eee00640 1 Processor -- start 2024-06-13T02:31:10.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.446+0000 7f31eee00640 1 -- start start 2024-06-13T02:31:10.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.446+0000 7f31eee00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e8073dd0 0x7f31e819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:10.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.446+0000 7f31eee00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31e80746f0 0x7f31e819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:10.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.446+0000 7f31eee00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e810e1b0 0x7f31e819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:10.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.446+0000 7f31eee00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f31e8113fa0 con 0x7f31e80746f0 2024-06-13T02:31:10.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.446+0000 7f31eee00640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f31e8113e20 con 0x7f31e8073dd0 2024-06-13T02:31:10.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.446+0000 7f31eee00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31e8114120 con 0x7f31e810e1b0 2024-06-13T02:31:10.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.446+0000 7f31e7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31e80746f0 0x7f31e819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:10.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.446+0000 7f31e7400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31e80746f0 0x7f31e819aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60244/0 (socket says 172.21.15.2:60244) 2024-06-13T02:31:10.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.446+0000 7f31e7400640 1 -- 172.21.15.2:0/1574170231 learned_addr learned my addr 172.21.15.2:0/1574170231 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:31:10.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.447+0000 7f31ece00640 1 --2- 172.21.15.2:0/1574170231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e810e1b0 0x7f31e819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:10.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.447+0000 7f31e7e00640 1 --2- 172.21.15.2:0/1574170231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e8073dd0 0x7f31e819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:10.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.447+0000 7f31e7e00640 1 -- 172.21.15.2:0/1574170231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e810e1b0 msgr2=0x7f31e819ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:10.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.447+0000 7f31e7e00640 1 --2- 172.21.15.2:0/1574170231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e810e1b0 0x7f31e819ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:10.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.447+0000 7f31e7e00640 1 -- 172.21.15.2:0/1574170231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31e80746f0 msgr2=0x7f31e819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:10.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.447+0000 7f31e7e00640 1 --2- 172.21.15.2:0/1574170231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31e80746f0 0x7f31e819aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:10.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.447+0000 7f31e7e00640 1 -- 172.21.15.2:0/1574170231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e819f4a0 con 0x7f31e8073dd0 2024-06-13T02:31:10.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.447+0000 7f31e7400640 1 --2- 172.21.15.2:0/1574170231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31e80746f0 0x7f31e819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:31:10.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.447+0000 7f31e7e00640 1 --2- 172.21.15.2:0/1574170231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e8073dd0 0x7f31e819a500 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f31d802a9a0 tx=0x7f31d8003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:10.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.448+0000 7f31e4c00640 1 -- 172.21.15.2:0/1574170231 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d803f070 con 0x7f31e8073dd0 2024-06-13T02:31:10.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.448+0000 7f31e4c00640 1 -- 172.21.15.2:0/1574170231 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31d8031c90 con 0x7f31e8073dd0 2024-06-13T02:31:10.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.448+0000 7f31eee00640 1 -- 172.21.15.2:0/1574170231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e819f730 con 0x7f31e8073dd0 2024-06-13T02:31:10.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.448+0000 7f31e4c00640 1 -- 172.21.15.2:0/1574170231 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d8035030 con 0x7f31e8073dd0 2024-06-13T02:31:10.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.448+0000 7f31eee00640 1 -- 172.21.15.2:0/1574170231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e81a7020 con 0x7f31e8073dd0 2024-06-13T02:31:10.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.449+0000 7f31eee00640 1 -- 172.21.15.2:0/1574170231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e8068ca0 con 0x7f31e8073dd0 2024-06-13T02:31:10.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.451+0000 7f31e4c00640 1 -- 172.21.15.2:0/1574170231 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f31d8042070 con 0x7f31e8073dd0 2024-06-13T02:31:10.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.452+0000 7f31e4c00640 1 --2- 172.21.15.2:0/1574170231 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f31cc0a2d00 0x7f31cc0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:10.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.452+0000 7f31e4c00640 1 -- 172.21.15.2:0/1574170231 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9671+0+0 (secure 0 0 0) 0x7f31d80effe0 con 0x7f31e8073dd0 2024-06-13T02:31:10.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.453+0000 7f31e7400640 1 --2- 172.21.15.2:0/1574170231 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f31cc0a2d00 0x7f31cc0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:10.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.453+0000 7f31e7400640 1 --2- 172.21.15.2:0/1574170231 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f31cc0a2d00 0x7f31cc0a51c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f31e80ffb10 tx=0x7f31d400b4a0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:10.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.457+0000 7f31e4c00640 1 -- 172.21.15.2:0/1574170231 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f31d80bc0f0 con 0x7f31e8073dd0 2024-06-13T02:31:10.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:10 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/905256913' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-13T02:31:10.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:10 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/3304833407' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-13T02:31:10.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:10 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1614037549' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-13T02:31:10.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:10 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/905256913' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-13T02:31:10.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:10 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/3304833407' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-13T02:31:10.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:10 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1614037549' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-13T02:31:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.712+0000 7f31eee00640 1 -- 172.21.15.2:0/1574170231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f31e8109330 con 0x7f31e8073dd0 2024-06-13T02:31:10.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:10 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/905256913' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-13T02:31:10.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:10 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/3304833407' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-13T02:31:10.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:10 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1614037549' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-06-13T02:31:10.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.722+0000 7f31e4c00640 1 -- 172.21.15.2:0/1574170231 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+740893 (secure 0 0 0) 0x7f31d80c03f0 con 0x7f31e8073dd0 2024-06-13T02:31:10.728 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:31:10.728 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T02:31:10.728 INFO:teuthology.orchestra.run.smithi002.stdout: "epoch": 26, 2024-06-13T02:31:10.728 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.728 INFO:teuthology.orchestra.run.smithi002.stdout: "active_gid": 25123, 2024-06-13T02:31:10.728 INFO:teuthology.orchestra.run.smithi002.stdout: "active_name": "x", 2024-06-13T02:31:10.729 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addrs": { 2024-06-13T02:31:10.729 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-06-13T02:31:10.729 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:10.729 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-06-13T02:31:10.729 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6800", 2024-06-13T02:31:10.729 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2181612853 2024-06-13T02:31:10.729 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.730 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:10.730 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-06-13T02:31:10.730 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:6801", 2024-06-13T02:31:10.730 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2181612853 2024-06-13T02:31:10.730 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:10.730 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T02:31:10.730 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.731 INFO:teuthology.orchestra.run.smithi002.stdout: "active_addr": "172.21.15.2:6801/2181612853", 2024-06-13T02:31:10.731 INFO:teuthology.orchestra.run.smithi002.stdout: "active_change": "2024-06-13T02:17:49.559744+0000", 2024-06-13T02:31:10.731 INFO:teuthology.orchestra.run.smithi002.stdout: "active_mgr_features": 4540701547738038271, 2024-06-13T02:31:10.731 INFO:teuthology.orchestra.run.smithi002.stdout: "available": true, 2024-06-13T02:31:10.731 INFO:teuthology.orchestra.run.smithi002.stdout: "standbys": [ 2024-06-13T02:31:10.731 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:10.731 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 25117, 2024-06-13T02:31:10.732 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "z", 2024-06-13T02:31:10.732 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540701547738038271, 2024-06-13T02:31:10.732 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-06-13T02:31:10.732 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:10.732 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-06-13T02:31:10.732 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:10.732 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:10.732 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:10.733 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T02:31:10.733 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T02:31:10.733 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:10.733 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.733 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.733 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T02:31:10.733 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.734 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.734 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.734 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-06-13T02:31:10.734 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.734 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.734 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.734 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.735 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:10.735 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:10.735 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.735 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.735 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.735 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.735 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.735 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.736 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:10.736 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:10.736 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:10.736 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:10.736 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:10.736 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:10.736 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:10.736 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:10.737 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.737 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.737 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.737 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.737 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.737 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:10.737 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:10.738 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.738 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.738 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.738 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.738 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.738 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.738 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.738 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.739 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.739 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.739 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.739 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.739 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:10.739 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:10.739 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.739 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.740 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.740 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:10.740 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.740 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.740 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:10.740 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:10.740 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:10.741 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:10.741 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:10.741 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:10.741 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:10.741 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:10.741 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.741 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.742 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.742 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.742 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.742 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:10.742 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:10.742 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.742 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.742 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.743 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.743 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.743 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.743 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.743 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.743 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.743 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.743 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.744 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-06-13T02:31:10.744 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-06-13T02:31:10.744 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.744 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.744 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.744 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.744 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.745 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.745 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.745 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-06-13T02:31:10.745 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.745 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.745 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.745 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.745 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-06-13T02:31:10.746 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-06-13T02:31:10.746 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.746 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.746 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.746 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-06-13T02:31:10.746 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.746 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.746 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.747 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-06-13T02:31:10.747 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.747 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.747 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.747 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.747 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-06-13T02:31:10.747 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-06-13T02:31:10.747 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.748 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.748 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.748 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.748 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.748 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.748 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.748 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-06-13T02:31:10.748 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.749 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.749 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.749 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.749 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-06-13T02:31:10.749 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-06-13T02:31:10.749 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.749 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.750 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.750 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.750 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.750 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.750 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.750 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-06-13T02:31:10.750 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.750 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.751 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.751 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.751 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-06-13T02:31:10.751 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-06-13T02:31:10.751 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.751 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.751 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.751 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-06-13T02:31:10.752 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.752 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.752 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.752 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-06-13T02:31:10.752 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.752 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.752 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.752 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.753 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-06-13T02:31:10.753 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-06-13T02:31:10.753 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.753 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.753 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.753 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.753 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.753 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.754 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.754 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-06-13T02:31:10.754 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.754 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.754 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.754 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-06-13T02:31:10.755 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-06-13T02:31:10.755 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.755 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.755 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.755 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.755 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.755 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.755 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.756 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-13T02:31:10.756 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.756 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.756 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.756 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.756 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-06-13T02:31:10.756 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-06-13T02:31:10.757 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.757 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.757 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.757 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.757 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.757 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.757 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.757 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-06-13T02:31:10.758 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.758 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.758 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.758 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:10.758 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:10.758 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.758 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:10.758 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-06-13T02:31:10.759 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:10.759 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:10.759 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:10.759 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-06-13T02:31:10.759 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-06-13T02:31:10.759 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.759 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.759 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.760 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.760 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.760 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.760 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.760 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-06-13T02:31:10.760 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.760 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.760 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.761 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.761 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-06-13T02:31:10.761 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-06-13T02:31:10.761 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.761 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.761 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.761 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-06-13T02:31:10.761 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.762 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.762 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-06-13T02:31:10.762 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-13T02:31:10.762 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.762 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.762 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.763 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-06-13T02:31:10.763 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-06-13T02:31:10.763 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T02:31:10.763 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.763 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.763 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T02:31:10.763 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-06-13T02:31:10.763 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-06-13T02:31:10.764 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.764 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-13T02:31:10.764 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-13T02:31:10.764 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.764 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.764 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.764 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-06-13T02:31:10.764 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-06-13T02:31:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T02:31:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-06-13T02:31:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T02:31:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-06-13T02:31:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-13T02:31:10.765 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.766 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.766 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.766 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.766 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-06-13T02:31:10.766 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-06-13T02:31:10.766 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.766 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.767 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-06-13T02:31:10.767 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.767 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.767 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.767 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-13T02:31:10.767 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-13T02:31:10.767 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.768 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.768 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.768 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-06-13T02:31:10.768 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-06-13T02:31:10.768 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:10.768 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.768 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.768 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-06-13T02:31:10.769 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-06-13T02:31:10.769 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-06-13T02:31:10.769 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.769 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-06-13T02:31:10.769 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-13T02:31:10.769 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.769 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.769 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.769 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-06-13T02:31:10.770 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-06-13T02:31:10.770 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.770 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.770 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.770 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-06-13T02:31:10.770 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.770 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.771 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.771 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-06-13T02:31:10.771 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-13T02:31:10.771 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.771 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.771 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.771 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-06-13T02:31:10.772 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-06-13T02:31:10.772 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T02:31:10.772 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.772 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.772 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T02:31:10.772 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-06-13T02:31:10.772 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-06-13T02:31:10.772 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.772 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-13T02:31:10.773 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-13T02:31:10.773 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.773 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.773 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.773 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:10.773 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:10.773 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.773 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.774 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.774 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.774 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.774 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.774 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:10.774 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:10.774 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:10.774 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:10.775 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:10.775 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:10.775 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:10.775 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:10.775 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.775 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.775 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.775 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.776 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.776 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:10.776 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:10.776 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.776 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.776 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.776 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.776 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.777 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.777 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.777 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.777 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.777 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.777 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.777 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.778 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:10.778 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:10.778 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.778 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.778 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.778 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:10.778 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.778 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.778 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:10.779 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:10.779 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:10.779 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:10.779 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:10.779 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:10.779 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:10.779 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:10.779 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.780 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.780 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.780 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.780 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.780 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:10.780 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:10.780 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.780 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.781 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.781 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.781 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.781 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.781 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.781 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.781 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.781 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.782 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.782 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.782 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-06-13T02:31:10.782 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-06-13T02:31:10.782 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:10.782 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.782 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.782 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T02:31:10.783 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.783 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.783 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.783 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-13T02:31:10.783 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.783 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.783 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.783 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.783 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-06-13T02:31:10.784 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-06-13T02:31:10.784 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.784 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.784 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.784 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-06-13T02:31:10.784 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.784 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.784 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:10.785 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-06-13T02:31:10.785 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-06-13T02:31:10.785 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-06-13T02:31:10.785 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-06-13T02:31:10.785 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-06-13T02:31:10.785 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:10.785 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-06-13T02:31:10.785 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.785 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.786 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.786 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.786 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-06-13T02:31:10.786 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-06-13T02:31:10.786 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.786 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.786 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.787 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.787 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.787 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.787 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.787 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-13T02:31:10.787 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.787 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.787 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.788 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.788 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T02:31:10.788 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T02:31:10.788 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:10.788 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.788 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.788 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T02:31:10.788 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.789 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.789 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.789 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-13T02:31:10.789 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.789 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.789 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.789 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.789 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-06-13T02:31:10.789 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-06-13T02:31:10.790 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.790 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.790 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.790 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T02:31:10.790 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T02:31:10.790 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.790 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.790 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-13T02:31:10.791 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-13T02:31:10.791 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.791 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.791 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.791 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-06-13T02:31:10.791 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-06-13T02:31:10.791 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T02:31:10.791 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.791 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.792 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:10.792 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.792 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.792 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.792 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-13T02:31:10.792 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.792 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.792 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.792 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:10.793 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:10.793 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.793 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:10.793 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-06-13T02:31:10.793 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:10.793 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:10.793 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:10.793 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-06-13T02:31:10.794 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-06-13T02:31:10.794 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:10.794 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.794 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.794 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-06-13T02:31:10.794 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.794 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.794 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.795 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-13T02:31:10.795 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.795 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.795 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.795 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.795 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-06-13T02:31:10.795 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-06-13T02:31:10.795 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:10.795 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.796 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.796 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-06-13T02:31:10.796 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.796 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.796 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.796 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-13T02:31:10.796 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.796 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.797 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.797 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.797 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-06-13T02:31:10.797 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-06-13T02:31:10.797 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.797 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.797 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.797 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-06-13T02:31:10.797 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.798 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.798 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.798 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-13T02:31:10.798 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.798 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.798 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.798 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.798 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-06-13T02:31:10.798 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-06-13T02:31:10.799 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.799 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.799 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.799 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.799 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.799 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.799 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.799 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-13T02:31:10.799 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-13T02:31:10.800 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.800 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.800 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.800 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-06-13T02:31:10.800 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-06-13T02:31:10.800 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:10.800 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.800 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.800 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T02:31:10.801 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.801 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.801 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.801 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-13T02:31:10.801 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.801 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.801 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.801 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.802 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-06-13T02:31:10.802 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-06-13T02:31:10.802 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:10.802 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.802 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.802 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-06-13T02:31:10.802 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.802 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.802 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.803 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-13T02:31:10.803 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.803 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.803 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.803 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-06-13T02:31:10.803 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-06-13T02:31:10.803 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.803 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.804 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.804 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.804 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.804 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.804 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:10.804 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-06-13T02:31:10.804 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-06-13T02:31:10.804 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-06-13T02:31:10.804 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:10.805 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-13T02:31:10.805 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.805 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.805 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.805 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-06-13T02:31:10.805 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-06-13T02:31:10.805 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.806 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.806 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.806 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.806 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.806 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.806 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.806 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-13T02:31:10.806 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.806 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.807 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.807 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-06-13T02:31:10.807 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-06-13T02:31:10.807 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.807 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.807 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.807 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.808 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.808 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.808 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.808 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-13T02:31:10.808 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.808 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.808 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.808 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.809 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-06-13T02:31:10.809 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-06-13T02:31:10.809 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.809 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.809 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.809 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.809 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.809 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.810 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.810 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-13T02:31:10.810 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.810 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.810 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.810 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.810 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-06-13T02:31:10.811 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-06-13T02:31:10.811 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.811 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.811 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.811 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-13T02:31:10.811 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.811 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.811 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.811 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T02:31:10.812 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.812 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.812 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.812 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.812 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-06-13T02:31:10.812 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-06-13T02:31:10.812 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.812 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.813 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.813 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-13T02:31:10.813 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.813 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.813 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.813 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-06-13T02:31:10.813 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.813 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.813 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.814 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.814 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-06-13T02:31:10.814 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-06-13T02:31:10.814 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.814 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.814 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.814 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-13T02:31:10.815 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.815 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.815 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.815 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-06-13T02:31:10.815 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.815 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.815 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.815 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.815 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-06-13T02:31:10.816 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-06-13T02:31:10.816 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.816 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.816 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.816 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-13T02:31:10.816 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.816 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.816 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.817 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T02:31:10.817 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.817 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.817 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.817 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.817 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-06-13T02:31:10.817 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-06-13T02:31:10.817 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.818 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.818 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.818 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-13T02:31:10.818 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.818 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.818 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.818 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-06-13T02:31:10.818 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.818 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.819 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.819 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.819 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-06-13T02:31:10.819 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-06-13T02:31:10.819 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.819 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.819 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.819 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-13T02:31:10.819 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.820 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.820 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.820 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-06-13T02:31:10.820 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.820 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.820 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.820 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-06-13T02:31:10.820 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-06-13T02:31:10.821 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.821 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.821 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.821 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-13T02:31:10.821 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.821 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.821 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.821 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-06-13T02:31:10.822 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.822 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.822 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.822 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.822 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-06-13T02:31:10.822 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-06-13T02:31:10.822 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.822 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.823 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.823 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-13T02:31:10.823 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.823 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.823 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.823 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-06-13T02:31:10.823 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.823 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.824 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.824 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.824 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-06-13T02:31:10.824 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-06-13T02:31:10.824 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.824 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.824 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.824 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-13T02:31:10.824 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.825 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.825 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.825 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-06-13T02:31:10.825 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.825 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.825 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.825 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-06-13T02:31:10.825 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-06-13T02:31:10.826 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.826 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.826 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.826 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-13T02:31:10.826 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.826 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.826 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.826 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-06-13T02:31:10.826 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.826 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.827 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.827 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.827 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-06-13T02:31:10.827 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-06-13T02:31:10.827 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.827 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.827 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.827 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-13T02:31:10.827 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.828 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.828 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.828 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T02:31:10.828 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.828 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.828 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.828 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-06-13T02:31:10.828 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-06-13T02:31:10.829 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.829 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.829 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.829 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-13T02:31:10.829 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.829 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.829 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.829 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-06-13T02:31:10.829 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.830 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.830 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.830 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.830 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-06-13T02:31:10.830 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-06-13T02:31:10.830 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.830 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.830 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.831 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-13T02:31:10.831 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.831 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.831 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.831 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T02:31:10.831 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.831 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.831 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.832 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.832 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-06-13T02:31:10.832 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-06-13T02:31:10.832 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.832 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.832 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.832 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-13T02:31:10.832 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.832 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.832 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.833 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-06-13T02:31:10.833 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.833 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.833 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.833 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.833 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-06-13T02:31:10.833 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-06-13T02:31:10.833 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.834 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.834 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.834 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-13T02:31:10.834 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.834 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.834 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.834 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-06-13T02:31:10.834 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.834 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.835 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.835 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.835 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-06-13T02:31:10.835 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-06-13T02:31:10.835 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.835 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.835 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.835 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-13T02:31:10.835 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.836 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.836 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.836 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-06-13T02:31:10.836 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.836 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.836 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.836 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.836 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-06-13T02:31:10.836 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-06-13T02:31:10.836 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.837 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.837 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.837 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.837 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.837 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.837 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.837 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-06-13T02:31:10.837 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.837 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.838 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.838 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.838 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-06-13T02:31:10.838 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-06-13T02:31:10.838 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:10.838 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.838 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.838 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T02:31:10.838 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.839 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.839 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.839 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-13T02:31:10.839 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.839 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.839 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.839 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.839 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-06-13T02:31:10.839 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-06-13T02:31:10.840 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.840 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.840 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.840 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-06-13T02:31:10.840 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.840 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.840 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.840 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-13T02:31:10.840 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.841 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.841 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.841 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.841 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-06-13T02:31:10.841 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-06-13T02:31:10.841 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.841 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.841 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.842 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-06-13T02:31:10.842 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.842 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.842 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.842 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-13T02:31:10.842 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.842 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.842 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.843 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-06-13T02:31:10.843 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-06-13T02:31:10.843 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:10.843 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.843 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.843 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-06-13T02:31:10.843 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.843 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.843 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.843 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-06-13T02:31:10.844 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.844 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.844 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.844 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-06-13T02:31:10.844 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-06-13T02:31:10.844 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.844 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.844 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.845 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.845 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.845 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.845 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.845 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-13T02:31:10.845 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.845 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.845 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.846 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-06-13T02:31:10.846 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-06-13T02:31:10.846 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:10.846 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.846 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.846 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T02:31:10.846 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.846 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.849 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.849 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-06-13T02:31:10.849 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.850 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.850 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.850 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.850 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-06-13T02:31:10.850 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-06-13T02:31:10.850 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.850 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.850 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.850 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-13T02:31:10.851 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.851 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.851 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.851 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-13T02:31:10.851 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.851 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.851 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.851 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.851 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-06-13T02:31:10.852 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-06-13T02:31:10.852 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:10.852 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.852 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.852 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T02:31:10.852 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.852 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.852 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.852 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-06-13T02:31:10.853 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.853 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.853 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.853 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.853 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-06-13T02:31:10.853 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-06-13T02:31:10.853 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.853 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.853 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.854 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.854 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.854 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.854 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.854 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-13T02:31:10.854 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.854 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.854 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.855 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.855 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-06-13T02:31:10.855 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-06-13T02:31:10.855 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.855 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.855 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.855 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.855 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.855 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.856 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.856 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-13T02:31:10.856 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.856 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.856 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.856 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:10.856 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:10.857 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.857 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.857 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.857 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.857 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.857 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.857 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:10.857 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:10.858 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:10.858 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:10.858 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:10.858 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:10.858 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:10.858 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:10.858 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.858 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.859 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.859 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.859 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.859 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-06-13T02:31:10.859 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-06-13T02:31:10.859 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.859 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.859 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.859 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.860 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.860 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.860 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.860 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-13T02:31:10.860 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.860 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.860 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.860 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.861 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:10.861 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:10.861 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.861 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.861 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.861 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.861 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.861 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.861 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.862 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-13T02:31:10.862 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.862 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.862 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.862 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.862 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:10.862 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:10.862 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.863 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.863 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.863 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:10.863 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.863 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.863 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:10.863 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:10.863 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:10.864 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:10.864 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:10.864 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:10.864 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:10.864 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:10.864 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.864 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.864 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.864 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.865 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.865 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:10.865 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:10.865 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.865 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.865 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.865 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.865 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.866 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.866 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.866 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.866 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.866 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.866 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.866 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-13T02:31:10.867 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-13T02:31:10.867 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.867 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.867 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.867 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.867 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.867 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.867 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.867 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-13T02:31:10.868 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.868 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.868 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.868 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.868 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-13T02:31:10.868 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-13T02:31:10.868 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.868 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.868 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.869 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-06-13T02:31:10.869 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.869 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.869 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.869 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-13T02:31:10.869 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.869 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.869 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.869 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.870 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-06-13T02:31:10.870 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-06-13T02:31:10.870 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.870 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.870 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.870 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:10.870 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.871 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.871 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.871 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-06-13T02:31:10.871 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.871 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.871 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.871 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.871 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-06-13T02:31:10.872 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-06-13T02:31:10.872 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.872 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.872 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.872 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:10.872 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.872 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.872 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.872 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-13T02:31:10.873 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.873 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.873 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.873 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.873 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-06-13T02:31:10.873 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-06-13T02:31:10.873 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.873 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.873 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.873 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.874 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.874 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.874 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.874 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-06-13T02:31:10.874 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.874 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.874 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.874 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.875 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-06-13T02:31:10.875 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-06-13T02:31:10.875 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.875 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.875 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.875 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-06-13T02:31:10.875 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.875 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.875 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:10.876 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-06-13T02:31:10.876 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-06-13T02:31:10.876 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:10.876 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-06-13T02:31:10.876 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.876 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.876 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.876 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.876 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-06-13T02:31:10.877 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-06-13T02:31:10.877 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.877 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.877 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.877 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-06-13T02:31:10.877 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.877 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.877 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.877 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-13T02:31:10.878 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.878 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.878 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.878 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.878 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-06-13T02:31:10.878 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-06-13T02:31:10.878 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.878 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.878 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.879 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-13T02:31:10.879 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.879 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.879 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.879 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-13T02:31:10.879 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.879 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.879 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.879 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.880 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-06-13T02:31:10.880 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-06-13T02:31:10.880 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.880 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.880 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.880 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.880 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.880 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.881 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.881 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-13T02:31:10.881 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.881 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.881 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.881 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.881 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-06-13T02:31:10.881 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-06-13T02:31:10.881 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.882 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.882 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.882 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.882 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.882 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.882 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.882 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-13T02:31:10.882 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.883 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.883 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.883 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.883 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-06-13T02:31:10.883 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-06-13T02:31:10.883 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.883 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.883 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.883 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.884 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.884 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.884 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.884 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-13T02:31:10.884 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.884 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.884 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.884 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.884 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-06-13T02:31:10.885 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-06-13T02:31:10.885 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.885 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.885 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.885 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.885 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.885 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.885 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.885 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-13T02:31:10.886 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.886 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.886 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.886 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.886 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-06-13T02:31:10.886 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-06-13T02:31:10.886 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.886 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.886 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.887 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.887 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.887 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.887 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-13T02:31:10.887 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.887 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.887 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.887 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.888 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-06-13T02:31:10.888 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-06-13T02:31:10.888 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.888 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.888 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.888 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-06-13T02:31:10.888 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.888 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.888 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.889 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-06-13T02:31:10.889 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.889 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.889 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.889 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.889 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-06-13T02:31:10.889 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-06-13T02:31:10.889 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.890 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.890 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.890 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.890 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.890 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.890 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.890 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-13T02:31:10.890 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.890 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.891 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.891 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.891 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-06-13T02:31:10.891 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-06-13T02:31:10.891 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.891 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.891 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.891 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.892 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.892 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.892 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.892 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-13T02:31:10.892 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.892 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.892 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.892 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.892 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-06-13T02:31:10.893 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-06-13T02:31:10.893 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.893 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.893 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.893 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.893 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.893 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.893 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.893 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-13T02:31:10.894 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.894 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.894 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.894 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.894 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-06-13T02:31:10.894 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-06-13T02:31:10.894 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.894 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.895 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.895 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.895 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.895 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.895 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.895 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-06-13T02:31:10.895 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.895 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.895 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.896 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.896 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-06-13T02:31:10.896 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-06-13T02:31:10.896 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.896 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.896 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.896 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.896 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.896 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.897 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.897 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-13T02:31:10.897 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.897 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.897 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.897 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.897 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-06-13T02:31:10.897 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-06-13T02:31:10.897 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.898 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.898 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.898 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.898 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.898 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.898 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.898 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-13T02:31:10.898 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.899 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.899 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.899 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:10.899 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:10.899 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.899 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:10.899 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-06-13T02:31:10.899 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:10.899 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:10.899 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:10.900 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:10.900 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:10.900 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.900 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.900 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.900 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.900 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.900 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.900 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:10.901 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:10.901 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:10.901 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:10.901 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:10.901 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:10.901 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:10.901 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:10.901 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.901 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.902 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.902 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.902 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.902 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:10.902 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:10.902 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.902 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.902 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.902 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.903 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.903 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.903 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.903 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.903 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.903 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.903 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.903 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.904 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:10.904 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:10.904 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.904 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.904 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.904 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:10.904 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.904 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.904 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:10.905 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:10.905 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:10.905 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:10.905 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:10.905 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:10.905 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:10.905 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:10.905 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.905 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.905 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.906 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.906 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.906 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:10.906 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:10.906 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.906 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.906 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.906 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.907 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.907 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.907 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.907 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.907 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.907 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.907 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.907 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.907 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-06-13T02:31:10.908 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-06-13T02:31:10.908 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:10.908 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.908 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.908 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-06-13T02:31:10.908 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.908 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.908 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.909 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-13T02:31:10.909 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.909 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.909 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.909 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.909 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-06-13T02:31:10.909 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-06-13T02:31:10.909 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:10.909 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.909 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.910 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-06-13T02:31:10.910 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.910 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.910 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.910 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-13T02:31:10.910 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.910 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.910 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.911 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:10.911 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:10.911 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.911 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:10.911 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-06-13T02:31:10.911 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:10.911 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:10.911 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:10.911 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-13T02:31:10.912 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-13T02:31:10.912 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.912 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.912 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.912 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:10.912 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.912 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.912 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.912 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.913 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.913 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.913 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.913 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.913 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-06-13T02:31:10.913 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-13T02:31:10.913 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.913 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.913 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.913 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.914 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.914 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.914 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.914 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.914 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.914 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.914 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.914 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.915 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-13T02:31:10.915 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-13T02:31:10.915 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.915 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.915 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.915 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.915 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.915 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.915 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.916 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.916 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.916 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.916 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.916 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.916 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-06-13T02:31:10.916 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-06-13T02:31:10.916 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.916 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.917 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.917 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.917 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.917 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.917 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.917 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.917 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.917 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.917 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.918 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.918 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-13T02:31:10.918 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-13T02:31:10.918 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.918 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.918 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.918 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.918 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.919 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.919 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.919 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.919 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.919 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.919 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.919 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.919 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-06-13T02:31:10.919 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-13T02:31:10.920 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.920 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.920 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.920 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.920 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.920 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.920 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.920 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.920 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.921 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.921 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.921 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.921 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-13T02:31:10.921 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-13T02:31:10.921 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.921 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.921 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.921 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.922 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.922 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.922 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.922 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.922 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.922 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.922 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.922 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-13T02:31:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-13T02:31:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.923 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.924 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.924 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.924 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.924 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.924 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.924 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.924 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-13T02:31:10.924 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-13T02:31:10.925 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.925 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.925 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.925 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.925 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.925 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.925 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.925 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.925 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.925 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.926 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.926 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.926 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-13T02:31:10.926 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-13T02:31:10.926 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.926 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.926 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.926 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.927 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.927 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.927 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.927 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.927 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.927 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.927 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.927 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.927 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-13T02:31:10.928 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-13T02:31:10.928 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.928 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.928 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.928 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.928 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.928 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.928 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.929 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.929 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.929 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.929 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.929 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.929 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-13T02:31:10.929 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-13T02:31:10.929 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.929 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.930 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.930 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.930 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.930 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.930 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.930 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.930 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.930 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.931 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.931 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.931 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-13T02:31:10.931 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-13T02:31:10.931 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.931 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.931 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.931 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.931 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.932 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.932 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.932 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.932 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.932 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.932 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.932 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.932 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-13T02:31:10.932 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-13T02:31:10.933 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.933 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.933 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.933 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.933 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.933 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.933 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.933 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.934 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.934 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.934 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.934 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.934 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-06-13T02:31:10.934 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-13T02:31:10.934 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.934 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.934 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.935 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T02:31:10.935 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.935 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.935 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.935 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.935 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.935 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.935 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.936 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-13T02:31:10.936 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-13T02:31:10.936 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.936 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.936 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.936 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.936 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.936 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.936 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.937 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.937 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.937 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.937 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.937 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.937 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-06-13T02:31:10.937 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-06-13T02:31:10.937 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.937 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.938 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.938 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.938 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.938 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.938 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.938 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.938 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.938 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.938 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.939 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-06-13T02:31:10.939 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-13T02:31:10.939 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.939 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.939 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.939 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T02:31:10.939 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.939 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.940 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.940 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.940 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.940 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.940 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.940 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-13T02:31:10.940 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-13T02:31:10.940 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.941 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.941 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.941 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.941 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.941 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.941 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.941 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.941 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.941 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.942 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.942 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.942 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-13T02:31:10.946 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-13T02:31:10.947 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.947 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.947 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.947 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.947 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.947 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.947 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.947 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.948 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.948 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.948 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.948 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.948 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-13T02:31:10.948 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-13T02:31:10.948 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.948 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.948 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.949 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.949 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.949 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.949 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.949 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.949 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.949 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.949 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.949 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-13T02:31:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-13T02:31:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.950 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.951 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.951 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.951 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.951 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.951 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.951 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-06-13T02:31:10.951 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-13T02:31:10.951 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.951 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.952 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.952 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.952 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.952 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.952 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.952 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.952 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.952 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.952 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.953 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.953 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-13T02:31:10.953 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-13T02:31:10.953 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.953 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.953 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.953 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.953 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.954 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.954 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.954 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.954 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.954 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.954 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.954 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.954 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-13T02:31:10.954 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-13T02:31:10.955 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.955 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.955 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.955 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.955 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.955 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.955 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.955 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.955 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.956 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.956 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.956 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.956 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-13T02:31:10.956 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-13T02:31:10.956 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.956 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.956 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.957 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.957 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.957 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.957 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.957 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.957 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.957 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.957 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.957 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.958 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-13T02:31:10.958 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-13T02:31:10.958 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.958 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.958 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.958 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.958 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.958 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.958 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.959 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.959 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.959 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.959 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.959 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-13T02:31:10.959 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-13T02:31:10.959 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.960 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.960 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.960 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.960 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.960 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.960 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.960 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.960 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.960 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.961 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.961 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.961 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-13T02:31:10.961 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-13T02:31:10.961 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.961 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.961 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.961 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.961 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.962 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.962 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.962 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.962 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.962 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.962 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.962 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-13T02:31:10.963 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-13T02:31:10.963 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.963 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.963 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.963 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.963 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.963 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.963 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.963 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-13T02:31:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-13T02:31:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.964 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.965 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.965 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.965 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.965 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.965 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.965 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.965 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.965 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.966 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-06-13T02:31:10.966 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-13T02:31:10.966 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.966 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.966 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.966 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.966 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.966 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.967 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.967 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.967 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.967 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.967 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.967 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-13T02:31:10.967 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-13T02:31:10.967 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.968 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.968 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.968 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-13T02:31:10.968 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.968 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.968 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.968 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.968 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.968 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.969 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.969 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.969 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-13T02:31:10.969 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-13T02:31:10.969 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.969 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.969 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.969 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:10.969 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.970 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.970 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.970 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.970 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.970 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.970 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.970 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.970 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-13T02:31:10.971 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-13T02:31:10.971 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.971 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.971 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.971 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-06-13T02:31:10.971 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.971 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.971 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.971 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.972 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.972 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.972 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.972 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.972 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-13T02:31:10.972 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-13T02:31:10.972 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.972 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.972 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.973 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-06-13T02:31:10.973 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.973 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.973 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.973 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.973 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.973 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.973 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.973 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.973 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-06-13T02:31:10.974 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-13T02:31:10.974 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.974 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.974 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.974 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.974 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.974 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.974 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.975 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.975 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.975 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.975 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.975 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.975 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-13T02:31:10.975 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-13T02:31:10.975 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.975 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.976 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.976 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T02:31:10.976 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.976 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.976 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.976 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.976 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.976 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.976 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.977 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.977 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-06-13T02:31:10.977 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-13T02:31:10.977 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.977 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.977 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.977 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.977 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.977 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.978 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.978 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.978 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.978 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.978 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.978 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.978 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-06-13T02:31:10.978 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-13T02:31:10.979 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.979 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.979 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.979 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:10.979 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.979 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.979 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.979 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.979 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.980 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.980 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.980 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.980 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-13T02:31:10.980 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-13T02:31:10.980 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.980 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.980 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.980 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T02:31:10.981 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.981 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.981 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.981 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.981 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.981 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.981 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.981 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.982 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-13T02:31:10.982 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-13T02:31:10.982 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.982 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.982 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.982 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:10.982 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.982 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.982 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.983 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.983 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.983 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.983 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.983 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.983 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-13T02:31:10.983 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-13T02:31:10.983 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.983 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.984 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.984 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T02:31:10.984 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.984 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.984 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.984 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.984 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.984 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.984 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.985 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.985 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-06-13T02:31:10.985 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-06-13T02:31:10.985 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.985 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.985 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.985 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.985 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.985 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.986 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.986 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.986 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.986 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.986 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.986 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.986 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-06-13T02:31:10.986 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-06-13T02:31:10.986 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.987 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.987 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.987 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.987 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.987 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.987 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.987 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.987 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.988 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.988 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.988 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-06-13T02:31:10.988 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-06-13T02:31:10.988 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.988 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.988 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.988 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.989 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.989 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.989 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.989 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-06-13T02:31:10.989 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.989 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.989 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.989 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.989 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-06-13T02:31:10.990 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-06-13T02:31:10.990 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:10.990 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.990 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.990 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-06-13T02:31:10.990 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.990 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.990 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.990 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.991 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.991 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.991 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.991 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.991 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-06-13T02:31:10.991 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-06-13T02:31:10.991 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.991 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.991 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:10.992 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.992 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.992 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.992 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.992 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.992 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.992 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.992 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.992 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.993 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:10.993 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:10.993 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.993 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.993 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.993 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:10.993 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.993 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.993 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:10.994 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:10.994 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:10.994 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:10.994 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:10.994 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:10.994 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:10.994 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:10.994 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.994 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.995 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.995 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.995 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.995 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:10.995 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:10.995 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.995 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.995 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.995 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.996 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.996 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.996 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:10.996 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.996 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.996 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.996 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.996 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.997 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:10.997 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:10.997 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:10.997 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.997 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.997 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:10.997 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:10.997 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:10.997 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:10.998 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:10.998 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:10.998 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:10.998 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:10.998 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:10.998 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:10.998 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:10.998 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:10.998 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:10.999 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:10.999 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:10.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:10.999 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:10.999 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:10.999 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:10.999 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:10.999 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:10.999 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:10.999 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.000 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.000 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.000 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.000 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.000 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.000 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.000 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.000 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-06-13T02:31:11.000 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-06-13T02:31:11.001 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.001 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.001 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.001 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.001 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.001 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.001 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.001 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-06-13T02:31:11.001 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.002 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.002 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.002 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.002 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-06-13T02:31:11.002 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-06-13T02:31:11.002 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.002 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.002 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.003 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.003 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.003 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.003 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.003 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.003 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.003 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.003 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.003 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.004 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T02:31:11.004 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T02:31:11.004 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.004 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.004 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.004 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-06-13T02:31:11.004 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.004 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.004 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.005 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.005 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.005 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.005 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.005 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T02:31:11.005 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T02:31:11.005 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.005 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.006 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.006 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-06-13T02:31:11.006 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.006 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.006 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.006 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.006 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.006 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.006 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.007 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-06-13T02:31:11.007 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-06-13T02:31:11.007 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.007 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.007 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.007 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.007 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.008 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.008 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.008 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.008 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.008 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.008 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.008 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.008 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-06-13T02:31:11.008 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-06-13T02:31:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-06-13T02:31:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.009 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.010 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.010 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.010 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.010 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-06-13T02:31:11.010 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-06-13T02:31:11.010 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.010 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.010 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.010 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-06-13T02:31:11.011 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.011 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.011 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.011 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.011 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-06-13T02:31:11.011 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.011 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.011 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.012 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.012 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.012 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-06-13T02:31:11.012 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-06-13T02:31:11.012 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.012 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.012 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.012 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-06-13T02:31:11.013 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-06-13T02:31:11.013 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-06-13T02:31:11.013 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.013 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.013 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.013 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.013 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.013 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.013 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-06-13T02:31:11.014 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-06-13T02:31:11.014 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.014 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.014 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.014 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.014 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.014 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.014 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.014 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.015 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.015 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.015 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.015 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.015 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.015 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.015 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.015 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-06-13T02:31:11.015 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.016 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.016 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.016 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-06-13T02:31:11.016 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-06-13T02:31:11.016 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.016 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.016 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.016 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.016 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.017 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.017 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.017 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-06-13T02:31:11.017 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.017 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.017 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.017 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.017 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.017 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.018 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.018 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.018 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.018 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.018 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.018 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.018 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.018 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.018 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.019 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.019 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.019 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.019 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.019 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.019 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.019 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.019 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.019 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.020 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.020 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.020 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.020 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.020 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.020 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.020 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.020 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.020 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.021 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.021 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.021 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.021 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.021 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.021 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.021 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.021 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.021 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.022 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.022 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.022 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.022 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.022 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.022 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.022 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.022 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.023 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.023 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.023 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.023 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.023 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.023 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.023 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.023 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.023 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.024 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.024 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.024 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.024 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.024 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.024 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.024 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.024 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.025 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.025 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.025 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.025 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.025 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.025 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.025 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.025 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-06-13T02:31:11.025 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-06-13T02:31:11.026 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.026 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.026 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.026 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-06-13T02:31:11.026 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.026 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.026 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.026 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-13T02:31:11.026 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.027 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.027 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.027 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.027 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-06-13T02:31:11.027 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-06-13T02:31:11.027 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.027 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.027 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.027 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-06-13T02:31:11.028 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.028 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.028 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.028 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-13T02:31:11.028 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.028 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.028 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.028 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-06-13T02:31:11.029 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-06-13T02:31:11.029 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.029 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.029 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.029 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-06-13T02:31:11.029 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.029 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.029 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.029 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-06-13T02:31:11.030 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.030 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.030 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.030 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.030 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-06-13T02:31:11.030 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-06-13T02:31:11.030 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.030 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.031 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.031 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-06-13T02:31:11.031 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.031 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.031 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.031 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-13T02:31:11.031 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.031 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.031 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.032 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.032 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-06-13T02:31:11.032 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-06-13T02:31:11.032 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.032 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.032 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.032 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.032 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.032 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.033 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.033 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-13T02:31:11.033 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.033 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.033 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.033 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.033 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T02:31:11.033 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T02:31:11.034 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.034 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.034 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.034 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T02:31:11.034 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.034 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.034 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.034 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-06-13T02:31:11.034 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.035 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.035 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.035 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-06-13T02:31:11.035 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-06-13T02:31:11.035 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.035 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.035 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.035 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-06-13T02:31:11.036 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.036 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.036 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.036 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-13T02:31:11.036 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.036 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.036 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.036 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.036 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.037 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.037 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-06-13T02:31:11.037 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.037 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.037 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.037 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.037 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.037 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.038 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.038 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.038 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.038 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.038 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.038 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.038 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.038 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.039 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.039 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.039 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.039 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.039 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.039 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.039 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.039 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.039 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.039 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.040 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.040 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.040 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.040 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.040 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.040 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.040 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.040 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.040 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.041 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.041 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.041 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.041 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.041 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.041 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.041 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.041 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.042 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.042 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.042 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.042 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.042 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.042 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.042 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.042 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.043 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.043 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.043 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.043 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.043 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.043 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.043 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.043 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.043 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.044 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.044 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.044 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.044 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.044 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.044 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.044 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.044 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.044 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.045 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.045 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.045 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.045 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.045 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.045 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.045 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-06-13T02:31:11.045 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-06-13T02:31:11.045 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.046 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.046 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.046 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-06-13T02:31:11.046 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.046 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.046 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.046 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.046 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.046 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.047 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.047 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.047 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-06-13T02:31:11.047 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-06-13T02:31:11.047 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.047 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.047 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.047 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-06-13T02:31:11.047 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.048 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.048 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.048 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.048 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.048 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.048 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.048 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T02:31:11.048 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T02:31:11.048 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.049 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.049 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.049 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T02:31:11.049 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.049 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.049 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.049 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.049 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.050 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.050 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.050 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.050 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.050 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.050 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.050 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-06-13T02:31:11.050 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-06-13T02:31:11.051 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-06-13T02:31:11.051 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.051 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-06-13T02:31:11.051 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-06-13T02:31:11.051 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.051 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.051 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.051 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-06-13T02:31:11.051 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.052 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.052 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.052 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-13T02:31:11.052 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.052 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.052 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.052 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.052 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-06-13T02:31:11.053 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-06-13T02:31:11.053 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.053 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.053 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.053 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-06-13T02:31:11.053 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.053 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.053 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.053 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-13T02:31:11.054 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.054 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.054 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.054 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.054 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-06-13T02:31:11.054 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-06-13T02:31:11.054 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.054 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.055 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.055 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.055 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.055 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.055 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.055 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-06-13T02:31:11.055 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.055 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.055 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.056 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.056 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T02:31:11.056 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T02:31:11.056 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.056 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.056 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.056 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-06-13T02:31:11.056 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-06-13T02:31:11.056 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.057 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.057 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-13T02:31:11.057 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.057 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.057 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.057 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.057 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.057 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.058 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.058 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.058 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.058 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.058 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.058 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.058 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.058 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.059 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.059 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.059 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.059 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.059 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.059 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.059 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.059 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.059 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.060 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.060 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.060 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.060 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.060 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.060 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.060 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.060 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.061 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.061 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.061 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.061 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.061 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.061 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.061 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.061 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.062 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.062 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.062 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.062 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.062 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.062 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.062 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.062 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.063 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.063 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.063 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.063 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.063 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.063 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.063 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.063 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.063 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.064 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.064 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.064 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.064 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.064 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.064 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.064 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.064 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.064 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.065 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.065 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.065 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.065 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.065 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.065 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.065 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.065 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-06-13T02:31:11.065 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-06-13T02:31:11.066 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.066 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.066 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.066 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.066 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.066 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.066 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.066 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-06-13T02:31:11.066 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.067 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.067 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.067 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.067 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-06-13T02:31:11.067 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-06-13T02:31:11.067 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.067 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.067 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.068 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-06-13T02:31:11.068 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.068 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.068 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.068 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-06-13T02:31:11.068 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.068 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.068 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.069 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-06-13T02:31:11.069 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-06-13T02:31:11.069 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.069 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.069 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.069 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-06-13T02:31:11.069 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.069 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.069 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.070 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-13T02:31:11.070 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.070 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.070 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.070 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.070 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-06-13T02:31:11.070 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-06-13T02:31:11.070 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.070 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.071 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.071 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T02:31:11.071 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T02:31:11.071 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-06-13T02:31:11.071 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.071 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-13T02:31:11.071 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.071 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.072 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.072 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.072 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-06-13T02:31:11.072 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-06-13T02:31:11.072 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.072 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.072 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.072 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.072 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.073 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.073 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.073 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-06-13T02:31:11.073 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.073 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.073 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.073 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.073 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-06-13T02:31:11.073 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-06-13T02:31:11.074 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.074 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.074 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.074 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-06-13T02:31:11.074 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.074 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.074 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.074 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-13T02:31:11.075 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.075 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.075 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.075 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.075 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.075 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.075 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.075 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-06-13T02:31:11.075 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.076 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.076 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.076 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.076 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.076 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.076 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.076 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.076 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.076 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.077 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.077 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.077 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.077 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.077 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.077 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.077 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.077 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.077 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.078 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.078 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.078 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.078 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.078 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.078 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.078 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.078 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.079 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.079 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.079 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.079 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.079 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.079 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.079 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.079 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.079 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.080 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.080 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.080 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.080 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.080 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.080 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.080 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.080 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.080 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.081 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.081 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.081 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.081 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.081 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.081 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.081 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.081 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.081 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.082 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.082 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.082 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.082 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.082 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.082 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.082 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.082 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.083 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.083 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.083 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.083 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.083 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.083 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.083 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.083 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.083 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.084 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.084 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.084 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.084 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.084 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.084 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-06-13T02:31:11.084 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.084 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.084 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.085 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.085 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.085 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.085 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.085 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.085 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.085 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.085 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.085 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.086 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.086 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.086 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.086 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.086 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.086 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.086 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.086 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.087 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.087 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.087 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.087 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.087 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.087 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.087 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.087 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.088 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.088 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.088 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.088 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.088 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.088 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.088 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.088 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.088 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.089 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.089 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.089 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.089 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.089 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.089 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.089 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.089 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.089 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.090 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.090 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.090 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.090 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.090 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.090 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.090 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.090 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.091 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.091 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.091 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.091 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.091 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.091 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.091 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.091 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.092 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.092 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.092 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.092 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.092 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.092 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.092 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.092 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.093 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.093 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.093 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.093 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.093 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.093 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.093 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-06-13T02:31:11.093 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.093 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.093 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.094 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-06-13T02:31:11.094 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-06-13T02:31:11.094 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.094 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.094 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.094 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-06-13T02:31:11.094 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.094 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.094 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.095 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-13T02:31:11.095 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.095 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.095 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.095 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.095 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-06-13T02:31:11.095 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-06-13T02:31:11.095 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.095 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.096 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.096 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:11.096 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-06-13T02:31:11.096 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.096 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.096 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-13T02:31:11.096 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.096 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.096 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.097 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.097 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.097 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.097 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.097 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.097 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.097 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.097 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.098 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.098 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.098 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.098 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.098 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.098 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.098 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.098 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.098 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.099 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.099 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.099 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.099 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.099 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.099 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.099 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.099 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.099 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.100 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.100 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.100 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.100 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.100 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.100 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.100 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.100 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.100 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.101 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.101 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.101 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.101 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.101 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.101 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.101 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.101 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.102 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.102 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.102 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.102 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.102 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.102 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.102 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.102 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.102 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.103 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.103 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.103 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.103 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.103 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.103 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.103 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.103 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.104 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.104 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.104 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.104 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.104 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.104 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.104 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.104 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.105 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.105 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.105 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.105 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.105 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.105 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-06-13T02:31:11.105 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.105 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.106 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.106 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-06-13T02:31:11.106 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-06-13T02:31:11.106 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.106 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.106 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.106 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-06-13T02:31:11.106 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.107 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.107 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.107 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-06-13T02:31:11.107 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-13T02:31:11.107 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.107 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.107 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.107 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.107 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.108 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.108 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.108 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.108 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.108 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.108 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.108 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.108 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.109 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.109 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.109 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.109 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.109 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.109 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.109 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.109 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.109 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.110 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.110 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.110 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.110 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.110 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.110 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.110 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.110 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.110 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.111 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.111 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.111 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.111 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.111 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.111 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.111 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.111 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.111 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.112 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.112 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.112 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.112 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.112 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.112 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.112 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.112 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.112 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.113 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.113 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.113 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.113 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.113 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.113 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.113 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.113 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.113 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.114 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.114 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.114 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.114 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.114 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.114 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.114 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.114 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.115 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.115 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.115 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.115 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.115 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.115 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-06-13T02:31:11.115 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-06-13T02:31:11.115 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.115 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.116 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.116 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.116 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.116 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.116 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.116 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-06-13T02:31:11.116 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-13T02:31:11.116 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.117 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.117 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-06-13T02:31:11.117 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-06-13T02:31:11.117 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.117 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.117 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.117 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-06-13T02:31:11.117 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.118 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.118 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.118 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-06-13T02:31:11.118 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.118 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.118 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.118 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-06-13T02:31:11.118 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-06-13T02:31:11.119 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.119 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.119 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.119 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-06-13T02:31:11.119 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.119 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.119 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.119 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-06-13T02:31:11.120 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.120 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.120 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.120 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-06-13T02:31:11.120 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-06-13T02:31:11.120 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.120 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.120 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.121 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.121 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.121 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.121 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.121 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-06-13T02:31:11.121 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.121 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.121 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.121 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.121 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-06-13T02:31:11.122 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-06-13T02:31:11.122 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.122 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.122 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.122 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-06-13T02:31:11.122 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.122 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.122 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.123 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-13T02:31:11.123 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-13T02:31:11.123 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.123 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.123 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.123 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.123 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.123 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.123 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-06-13T02:31:11.124 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.124 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.124 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.124 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.124 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.124 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.124 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.124 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.125 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.125 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.125 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.125 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.125 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.125 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.125 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.125 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.125 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.126 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.126 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.126 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.126 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.126 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.126 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.126 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.126 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.126 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.127 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.127 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.127 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.127 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.127 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.127 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.127 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.127 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.127 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.127 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.128 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.128 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.128 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.128 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.128 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.128 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.128 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.128 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.128 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.129 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.129 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.129 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.129 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.129 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.129 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.129 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.129 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.130 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.130 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.130 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.130 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.130 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.130 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.130 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.130 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.130 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.131 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.131 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.131 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.131 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.131 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.131 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.131 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.131 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.131 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.132 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.132 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.132 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.132 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.132 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.132 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-06-13T02:31:11.132 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.132 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.132 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.132 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.133 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.133 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.133 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.133 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.133 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.133 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.133 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.133 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.134 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.134 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.134 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.134 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.134 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.134 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.134 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.134 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.135 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.135 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.135 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.135 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.135 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.135 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.135 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.135 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.135 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.135 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.136 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.136 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.136 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.136 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.136 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.136 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.136 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.136 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.136 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.137 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.137 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.137 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.137 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.137 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.137 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.137 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.137 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.137 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.138 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.138 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.138 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.138 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.138 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.138 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.138 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.138 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.138 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.139 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.139 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.139 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.139 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.139 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.139 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.139 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.139 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.140 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.140 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.140 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.140 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.140 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.140 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.140 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.140 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.140 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.141 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.141 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.141 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-06-13T02:31:11.141 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.141 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.141 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.141 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.141 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.141 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.142 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.142 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.142 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.142 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.142 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.142 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.142 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.142 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.142 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.143 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.143 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.143 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.143 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.143 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.143 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.143 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.143 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.143 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.144 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.144 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.144 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.144 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.144 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.144 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.144 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.144 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.144 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.145 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.145 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.145 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.145 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.145 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.145 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.145 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.145 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.146 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.146 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.146 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.146 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.146 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.146 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.146 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.146 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.146 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.147 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.147 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.147 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.147 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.147 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.147 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.147 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.147 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.147 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.148 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.148 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.148 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.148 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.148 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.148 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.148 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.148 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.148 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.149 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.149 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.149 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.149 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.149 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.149 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.149 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.149 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-06-13T02:31:11.149 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.150 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.150 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.150 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-06-13T02:31:11.150 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-06-13T02:31:11.150 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.150 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.150 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.150 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.150 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.151 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.151 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.151 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-13T02:31:11.151 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.151 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.151 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.151 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.151 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.151 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.152 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.152 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.152 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.152 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.152 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.152 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.152 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.152 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.152 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.152 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.153 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.153 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.153 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.153 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.153 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.153 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.153 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.153 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.153 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.154 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.154 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.154 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.154 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.154 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.154 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.154 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.154 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.154 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.155 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.155 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.155 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.155 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.155 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.155 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.155 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.155 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.156 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.156 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.156 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.156 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.156 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.156 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.156 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.156 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.156 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.157 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.157 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.157 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.157 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.157 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.157 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.157 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.157 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.157 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.158 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.158 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.158 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.158 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.158 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.158 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.158 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.158 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.158 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.159 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.159 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.159 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.159 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.159 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.159 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-06-13T02:31:11.159 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-06-13T02:31:11.159 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.159 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.160 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.160 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.160 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.160 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.160 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.160 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-06-13T02:31:11.160 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-06-13T02:31:11.160 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-06-13T02:31:11.160 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.161 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-06-13T02:31:11.161 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.161 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.161 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.161 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.161 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.161 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.161 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.162 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-06-13T02:31:11.162 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.162 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.162 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.162 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.162 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.162 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.162 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.163 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.163 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.163 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.163 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.163 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.163 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.163 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.163 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.163 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.164 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.164 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.164 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.164 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.164 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.164 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.164 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.164 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.164 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.164 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.165 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.165 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.165 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.165 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.165 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.165 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.165 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.165 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.165 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.166 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.166 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.166 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.166 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.166 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.166 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.166 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.166 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.167 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.167 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.167 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.167 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.167 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.167 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.167 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.167 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.167 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.168 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.168 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.168 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.168 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.168 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.168 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.168 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.168 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.169 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.169 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.169 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.169 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.169 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.169 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.169 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.169 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.169 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.170 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.170 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.170 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.170 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.170 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.170 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.170 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.170 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-06-13T02:31:11.170 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.171 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.171 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.171 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.171 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.171 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.171 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.171 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.171 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.171 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.172 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.172 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.172 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.172 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.172 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.172 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.172 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.172 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.172 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.173 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.173 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.173 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.173 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.173 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.173 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.173 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.173 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.173 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.174 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.174 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.174 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.174 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.174 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.174 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.174 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.174 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.175 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.175 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.175 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.175 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.175 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.175 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.175 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.175 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.175 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.175 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.176 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.176 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.176 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.176 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.176 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.176 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.176 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.176 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.176 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.177 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.177 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.177 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.177 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.177 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.177 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.177 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.177 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.177 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.178 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.178 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.178 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.178 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.178 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.178 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.178 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.178 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.179 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.179 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.179 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.179 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.179 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-06-13T02:31:11.179 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.179 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.179 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.179 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.179 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.180 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.180 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.180 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.180 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.180 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.180 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.180 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.180 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.180 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.181 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.181 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.181 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.181 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.181 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.181 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.181 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.181 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.181 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.182 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.182 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.182 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.182 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.182 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.182 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.182 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.182 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.183 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.183 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.183 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.183 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.183 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.183 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.183 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.183 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.183 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.184 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.184 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.184 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.184 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.184 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.184 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.184 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.184 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.184 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.185 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.185 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.185 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.185 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.185 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.185 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.185 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.185 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.185 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.186 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.186 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.186 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.186 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.186 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.186 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.186 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.186 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.187 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.187 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.187 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.187 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.187 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.187 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.187 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T02:31:11.187 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T02:31:11.187 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.188 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.188 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.188 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T02:31:11.188 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.188 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.188 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.188 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.188 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.188 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.189 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.189 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.189 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-06-13T02:31:11.189 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-06-13T02:31:11.189 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:11.189 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.189 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.189 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-06-13T02:31:11.189 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-06-13T02:31:11.190 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.190 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.190 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-06-13T02:31:11.190 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-13T02:31:11.190 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.190 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.190 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.190 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.191 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.191 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.191 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-06-13T02:31:11.191 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.191 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.191 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.191 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-06-13T02:31:11.191 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-06-13T02:31:11.191 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.192 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.192 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.192 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.192 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.192 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.192 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.192 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-13T02:31:11.192 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.192 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.193 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.193 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.193 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-06-13T02:31:11.193 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-06-13T02:31:11.193 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.193 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.193 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.193 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.193 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.194 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.194 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.194 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.194 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.194 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.194 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.194 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.194 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.195 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.196 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.197 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.198 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.199 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.200 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.201 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-06-13T02:31:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-06-13T02:31:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.202 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-06-13T02:31:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-06-13T02:31:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.203 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T02:31:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T02:31:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T02:31:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-06-13T02:31:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.205 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-06-13T02:31:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-06-13T02:31:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-06-13T02:31:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.206 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.207 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.208 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.208 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.208 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-06-13T02:31:11.208 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-06-13T02:31:11.208 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.208 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.208 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.208 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.209 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.209 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.209 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.209 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-13T02:31:11.209 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-13T02:31:11.209 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.209 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.209 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.209 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.210 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.210 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.210 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.210 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.210 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.210 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.210 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.211 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.211 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.211 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.211 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.211 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.211 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.211 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.211 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.211 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.212 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.212 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.212 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.212 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.212 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.212 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.212 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.212 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.213 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.213 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.213 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.213 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.213 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.213 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.213 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.213 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.214 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.214 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.214 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.214 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.214 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.214 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.214 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.214 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.214 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.215 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.215 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.215 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.215 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.215 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.215 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.215 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.215 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.216 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.216 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.216 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.216 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.216 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.216 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.216 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.216 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.216 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.217 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.217 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.217 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.217 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.217 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.217 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.217 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.217 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.218 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.218 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.218 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-06-13T02:31:11.218 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-06-13T02:31:11.218 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.218 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.218 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.218 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.218 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.219 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.219 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.219 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.219 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.219 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.219 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.219 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.219 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-13T02:31:11.220 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-13T02:31:11.220 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.220 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.220 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.220 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-06-13T02:31:11.220 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.220 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.220 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.220 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.221 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.221 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.221 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.221 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.221 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-06-13T02:31:11.221 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-06-13T02:31:11.221 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:11.221 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.221 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.222 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-06-13T02:31:11.222 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.222 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.222 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.222 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.222 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.222 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.222 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.222 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.223 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T02:31:11.223 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T02:31:11.223 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.223 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.223 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.223 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-06-13T02:31:11.223 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.223 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.223 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.224 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-13T02:31:11.224 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.224 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.224 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.224 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.224 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T02:31:11.224 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T02:31:11.224 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.225 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.225 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.225 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-06-13T02:31:11.225 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.225 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.225 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.225 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-13T02:31:11.225 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.225 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.226 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.226 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.226 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-06-13T02:31:11.226 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-06-13T02:31:11.226 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.226 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.226 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.226 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-06-13T02:31:11.226 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.227 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.227 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.227 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.227 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.227 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.227 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.227 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.227 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-06-13T02:31:11.227 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-06-13T02:31:11.228 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.228 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.228 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.228 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-06-13T02:31:11.228 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.228 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.228 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.228 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-06-13T02:31:11.228 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-06-13T02:31:11.229 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.229 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.229 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.229 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.229 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.229 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-06-13T02:31:11.229 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-06-13T02:31:11.230 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.230 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.230 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.230 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-06-13T02:31:11.230 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-06-13T02:31:11.230 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-06-13T02:31:11.230 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.230 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.231 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.231 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.231 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.231 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.231 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.231 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.231 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.231 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-06-13T02:31:11.232 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.232 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.232 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.232 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.232 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.232 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.232 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.232 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.232 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.233 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.233 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.233 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.233 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.233 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.233 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.233 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.233 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.233 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.234 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.234 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.234 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.234 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.234 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.234 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.234 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.234 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.235 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.235 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.235 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.235 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.235 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.235 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.235 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.235 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.235 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.236 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.236 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.236 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.236 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.236 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.236 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.236 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.236 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.237 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.237 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.237 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.237 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.237 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.237 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.237 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.237 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.237 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.238 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.238 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.238 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.238 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.238 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.238 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.238 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.238 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.238 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.239 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.239 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.239 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.239 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.239 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.239 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.239 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.239 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.239 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.240 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.240 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.240 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.240 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-06-13T02:31:11.240 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-06-13T02:31:11.240 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.240 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.240 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.240 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:11.241 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.241 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.241 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.241 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.241 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.241 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.241 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.241 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.241 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-06-13T02:31:11.242 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-06-13T02:31:11.242 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.242 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.242 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.242 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.242 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.242 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.242 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.242 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.243 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.243 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.243 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.243 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.243 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-06-13T02:31:11.243 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-06-13T02:31:11.243 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.243 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.243 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.244 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.244 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.244 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.244 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.244 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.244 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.244 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.244 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.244 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.245 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.245 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.245 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.245 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-06-13T02:31:11.245 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.245 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.245 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.245 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-06-13T02:31:11.245 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-06-13T02:31:11.246 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.246 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.246 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.246 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.246 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.246 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.246 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.246 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.246 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.247 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.247 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.247 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.247 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-06-13T02:31:11.247 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-06-13T02:31:11.247 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.247 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.247 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.247 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.248 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.248 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.248 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.248 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.248 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.248 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.248 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.248 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.249 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.249 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.249 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.249 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.249 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.249 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.249 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.249 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.249 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.250 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.250 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.250 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.250 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.250 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.250 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.250 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.250 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.250 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.251 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.251 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.251 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.251 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.251 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.251 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.251 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.251 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.252 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.252 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.252 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.252 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.252 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.252 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.252 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.252 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.253 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.253 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.253 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.253 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.253 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.253 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.253 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.253 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.253 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.254 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.255 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.256 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T02:31:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T02:31:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.257 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T02:31:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T02:31:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.258 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.259 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-06-13T02:31:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.260 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.261 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.261 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.261 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.261 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.261 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.261 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.261 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.261 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.261 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.262 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.263 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.264 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.265 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.266 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.266 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.266 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.266 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.266 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.266 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.266 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.266 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.266 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.268 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.268 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.268 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.268 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.268 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.268 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.268 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.268 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.268 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.269 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.269 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-06-13T02:31:11.269 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.269 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.269 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.269 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.269 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.269 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.269 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.269 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.270 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.270 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.270 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.270 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.270 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.270 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.270 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.270 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.271 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.271 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.271 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.271 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.271 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.271 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.271 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.271 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.271 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.272 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.272 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.272 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.272 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.272 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.272 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.272 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.272 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.272 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.273 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.273 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.273 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.273 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.273 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.273 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.273 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.273 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.273 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.273 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.274 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.274 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.274 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.274 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.274 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.274 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.274 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.274 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.275 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.275 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.275 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.275 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.275 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.275 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.275 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.275 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.275 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.276 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.276 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.276 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.276 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.276 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.276 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.276 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.276 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.276 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.277 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.277 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.277 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.277 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-06-13T02:31:11.277 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-06-13T02:31:11.277 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.277 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.277 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.278 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-06-13T02:31:11.278 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.278 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.278 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.278 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-13T02:31:11.278 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.278 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.278 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.278 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.279 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.279 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.279 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.279 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-06-13T02:31:11.279 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.279 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.279 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.279 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.279 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.280 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.280 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.280 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.280 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.280 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.280 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.280 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.280 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.280 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.281 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.281 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.281 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.281 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.281 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.281 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.281 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.281 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.281 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.281 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.282 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.282 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.282 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.282 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.282 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.282 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.282 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.282 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.283 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.283 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.283 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.283 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.283 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.283 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.283 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.283 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.283 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.284 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.284 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.284 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.284 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.284 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.284 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.284 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.284 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.284 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.285 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.285 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.285 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.285 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.285 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.285 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.285 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.285 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.285 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.286 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.286 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.286 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.286 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.286 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.286 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.286 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.286 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.286 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.287 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.287 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.287 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.287 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.287 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.287 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-06-13T02:31:11.287 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-06-13T02:31:11.287 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.287 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.287 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.288 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.288 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.288 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.288 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.288 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.288 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.288 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.288 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.288 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.289 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-06-13T02:31:11.289 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-06-13T02:31:11.289 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.289 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.289 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.289 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-06-13T02:31:11.289 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.289 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.289 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.290 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.290 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.290 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.290 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.290 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.290 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-06-13T02:31:11.290 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-06-13T02:31:11.290 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.290 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.291 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.291 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.291 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.291 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.291 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.291 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.291 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.291 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.291 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.292 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.292 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-06-13T02:31:11.292 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-06-13T02:31:11.292 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.292 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.292 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.292 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.292 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.292 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.293 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.293 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.293 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.293 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.293 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.293 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.293 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-06-13T02:31:11.293 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-06-13T02:31:11.293 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:11.294 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.294 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.294 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.294 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.294 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.294 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.294 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.294 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.294 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.295 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.295 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.295 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-06-13T02:31:11.295 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-06-13T02:31:11.295 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.295 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.295 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.295 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.295 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.296 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.296 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.296 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.296 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.296 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.296 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.296 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.296 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-06-13T02:31:11.296 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-06-13T02:31:11.296 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.297 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.297 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.297 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.297 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.297 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.297 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.297 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.297 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.297 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.298 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.298 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.298 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-06-13T02:31:11.298 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-06-13T02:31:11.298 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.298 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.298 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.298 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.299 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.299 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.299 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.299 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.299 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.299 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.299 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.299 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.299 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-06-13T02:31:11.299 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-06-13T02:31:11.300 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.300 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.300 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.300 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.300 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T02:31:11.300 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-06-13T02:31:11.300 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.300 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.300 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.301 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.301 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.301 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.301 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-06-13T02:31:11.301 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-06-13T02:31:11.301 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.301 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.301 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.301 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.302 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.302 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.302 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.302 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.302 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.302 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.302 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.302 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.302 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-06-13T02:31:11.303 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-06-13T02:31:11.303 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.303 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.303 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.303 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.303 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.303 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.303 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.303 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.304 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.304 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.304 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.304 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.304 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-06-13T02:31:11.304 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-06-13T02:31:11.304 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.304 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.304 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.304 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.305 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.305 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.305 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.305 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.305 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.305 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.305 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.305 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.305 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.306 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.306 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.306 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-06-13T02:31:11.306 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.306 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.306 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.306 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-06-13T02:31:11.306 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-06-13T02:31:11.307 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.307 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.307 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.307 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.307 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.307 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.307 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.307 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-06-13T02:31:11.307 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.308 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.308 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.308 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.308 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-06-13T02:31:11.308 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-06-13T02:31:11.308 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.308 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.308 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.308 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.309 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.309 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.309 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.309 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-06-13T02:31:11.309 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.309 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.309 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.309 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.309 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.310 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.310 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.310 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.310 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.310 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.310 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.310 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.310 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.310 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.311 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.311 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.311 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.311 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.311 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.311 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.311 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.311 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.311 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.312 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.312 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.312 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.312 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.312 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.312 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.312 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.312 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.312 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.313 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.313 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.313 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.313 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.313 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.313 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.313 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.313 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.313 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.314 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.314 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.314 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.314 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.314 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.314 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.314 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.314 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.314 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.315 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.315 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.315 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.315 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.315 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.315 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.315 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.315 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.315 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.316 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.316 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.316 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.316 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.316 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.316 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.316 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.316 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.316 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.317 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.317 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.317 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.317 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.317 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.317 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.317 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.317 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.317 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.318 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-06-13T02:31:11.318 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.318 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.318 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.318 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.318 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.318 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.318 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.318 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.319 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.319 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.319 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.319 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.319 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.319 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.319 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.319 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.319 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.320 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.320 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.320 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.320 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.320 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.320 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.320 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.320 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.320 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.321 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.321 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.321 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.321 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.321 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.321 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.321 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.321 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.321 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.322 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.322 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.322 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.322 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.322 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.322 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.322 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.322 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.322 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.323 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.323 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.323 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.323 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.323 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.323 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.323 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.323 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.323 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.324 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.324 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.324 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.324 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.324 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.324 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.324 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.324 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.325 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.325 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.325 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.325 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.325 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.325 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.325 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.325 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.325 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.326 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.326 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.326 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.326 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.326 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.326 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.326 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-06-13T02:31:11.326 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.326 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.327 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.327 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.327 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.327 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.327 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.327 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.327 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.327 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.327 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.327 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.328 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.328 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.328 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.328 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.328 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.328 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.328 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.328 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.328 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.329 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.329 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.329 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.329 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.329 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.329 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.329 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.329 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.329 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.330 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.330 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.330 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.330 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.330 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.330 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.330 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.330 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.331 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.331 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.331 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.331 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.331 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.331 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.331 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.331 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.332 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.332 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.332 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.332 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.332 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.332 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.332 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.332 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.332 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.333 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.334 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-06-13T02:31:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-06-13T02:31:11.335 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-06-13T02:31:11.336 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.336 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.336 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.336 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-13T02:31:11.336 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.336 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.336 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.336 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.336 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.337 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.337 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.337 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.337 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T02:31:11.337 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T02:31:11.337 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.337 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.337 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.337 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-06-13T02:31:11.338 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.338 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.338 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.338 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.338 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.338 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.338 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.338 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.338 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.339 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.339 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.339 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.339 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.339 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.339 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.339 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.339 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.339 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.340 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.340 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.340 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.340 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.340 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.340 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.340 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.340 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.340 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.341 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.341 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.341 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.341 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.341 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.341 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.341 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.341 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.341 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.342 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.342 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.342 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.342 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.342 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.342 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.342 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.342 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.343 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.343 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.343 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.343 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.343 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.343 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.343 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.343 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.343 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.344 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.344 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.344 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.344 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.344 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.344 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.344 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.344 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.344 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.345 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.345 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.345 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.345 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.345 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.345 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.345 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.345 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.345 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.345 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.346 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.346 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.346 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.346 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.346 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.346 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.346 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.346 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.347 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.347 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-06-13T02:31:11.347 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.347 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.347 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.347 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-06-13T02:31:11.347 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-06-13T02:31:11.347 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.347 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.347 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.348 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.348 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.348 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.348 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.348 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-13T02:31:11.348 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.348 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.348 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.349 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.349 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-06-13T02:31:11.349 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-06-13T02:31:11.349 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.349 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.349 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.349 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.349 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.349 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.349 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.350 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-13T02:31:11.350 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.350 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.350 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.350 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.350 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-06-13T02:31:11.350 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-06-13T02:31:11.350 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.350 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.351 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.351 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.351 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.351 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.351 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.351 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-13T02:31:11.351 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.351 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.351 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.352 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.352 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-06-13T02:31:11.352 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-06-13T02:31:11.352 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.352 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.352 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.352 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.352 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.352 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.353 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.353 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-13T02:31:11.353 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.353 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.353 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.353 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.353 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-06-13T02:31:11.353 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-06-13T02:31:11.353 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.354 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.354 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.354 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.354 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.354 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.354 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.354 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-13T02:31:11.354 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.354 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.355 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.355 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.355 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-06-13T02:31:11.355 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-06-13T02:31:11.355 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.355 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.355 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.355 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.355 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.356 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.356 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.356 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.356 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.356 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.356 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.356 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.356 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-06-13T02:31:11.356 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-06-13T02:31:11.357 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.357 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.357 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.357 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.357 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.357 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.357 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.357 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.358 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.358 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.358 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.358 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.358 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-06-13T02:31:11.358 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-06-13T02:31:11.358 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.358 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.358 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.359 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-13T02:31:11.359 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.359 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.359 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.359 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.359 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.359 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.359 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.359 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.360 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-06-13T02:31:11.360 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-06-13T02:31:11.360 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.360 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.360 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.360 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.360 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.360 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.361 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.361 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.361 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.361 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.361 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.361 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.361 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T02:31:11.361 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T02:31:11.361 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.362 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.362 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.362 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-06-13T02:31:11.362 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-06-13T02:31:11.362 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.362 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.362 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.362 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.363 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.363 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.363 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.363 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-06-13T02:31:11.363 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-06-13T02:31:11.363 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.363 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.363 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.363 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-06-13T02:31:11.363 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.364 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.364 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.364 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.364 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.364 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.364 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.364 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.364 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-06-13T02:31:11.364 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-06-13T02:31:11.365 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.365 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.365 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.365 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.365 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.365 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.365 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.365 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.365 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.366 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.366 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.366 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.366 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-06-13T02:31:11.366 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-06-13T02:31:11.366 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.366 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.366 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.366 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.367 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.367 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.367 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.367 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.367 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.367 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.367 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.367 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.367 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.368 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.368 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.368 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.368 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.368 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.368 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.368 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.368 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.368 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.369 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.369 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.369 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.369 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.369 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.369 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.369 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.369 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.369 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.370 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.370 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.370 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.370 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.370 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.370 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.370 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.370 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.370 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.371 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.371 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.371 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.371 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.371 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.371 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.371 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.371 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.371 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.372 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.372 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.372 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.372 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.372 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.372 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.372 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.372 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.372 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.373 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.373 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.373 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.373 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.373 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.373 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.373 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.373 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.373 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.374 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.374 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.374 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.374 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.374 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.374 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.374 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.374 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.374 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.375 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.375 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.375 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.375 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.375 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.375 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.375 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-06-13T02:31:11.375 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-06-13T02:31:11.375 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.376 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.376 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.376 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.376 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.376 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.376 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.376 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.376 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.376 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.377 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.377 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.377 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-06-13T02:31:11.377 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-06-13T02:31:11.377 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.377 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.377 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.377 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.377 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.378 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.378 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.378 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.378 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.378 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.378 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.378 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.378 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-06-13T02:31:11.379 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-06-13T02:31:11.379 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.379 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.379 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.379 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-13T02:31:11.379 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.379 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.379 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.379 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.380 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.380 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.380 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.380 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.380 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.380 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.380 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.380 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-06-13T02:31:11.380 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.381 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.381 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.381 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.381 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.381 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.381 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.381 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.381 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.381 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.381 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.382 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.382 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.382 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.382 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.382 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.382 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.382 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.382 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.382 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.383 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.383 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.383 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.383 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.383 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.383 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.383 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.383 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.383 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.384 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.384 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.384 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.384 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.384 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.384 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.384 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.384 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.385 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.385 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.385 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.385 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.385 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.385 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.385 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.385 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.385 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.385 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.386 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.386 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.386 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.386 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.386 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.386 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.386 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.386 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.386 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.387 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.387 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.387 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.387 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.387 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.387 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.387 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.387 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.387 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.388 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.388 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.388 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.388 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.388 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.388 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.388 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.388 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.388 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.389 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.389 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.389 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-06-13T02:31:11.389 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.389 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.389 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.389 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.389 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.389 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.390 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.390 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.390 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.390 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.390 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.390 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.390 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.390 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.391 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.391 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.391 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.391 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.391 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.391 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.391 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.391 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.391 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.392 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.392 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.392 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.392 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.392 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.392 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.392 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.392 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.393 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.393 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.393 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.393 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.393 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.393 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.393 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.393 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.393 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.394 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.394 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.394 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.394 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.394 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.394 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.394 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.394 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.394 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.395 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.395 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.395 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.395 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.395 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.395 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.395 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.395 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.395 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.395 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.396 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.396 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.396 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.396 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.396 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.396 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.396 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.396 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.396 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.397 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.397 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.397 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.397 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.397 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-06-13T02:31:11.397 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-06-13T02:31:11.397 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.397 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.397 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.398 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-06-13T02:31:11.398 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.398 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.398 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.398 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-13T02:31:11.398 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.398 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.398 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.399 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.399 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-06-13T02:31:11.399 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-06-13T02:31:11.399 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.399 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.399 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.399 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.399 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.399 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.400 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.400 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-06-13T02:31:11.400 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.400 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.400 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.400 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.400 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-06-13T02:31:11.400 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-06-13T02:31:11.400 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.401 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.401 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.401 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T02:31:11.401 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.401 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.401 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.401 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-13T02:31:11.401 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.401 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.402 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.402 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.402 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-06-13T02:31:11.402 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-06-13T02:31:11.402 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.402 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.402 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.402 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.402 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.403 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.403 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.403 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-13T02:31:11.403 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.403 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.403 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.403 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.403 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.403 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.403 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.404 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-06-13T02:31:11.404 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.404 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.404 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.404 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-06-13T02:31:11.404 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-06-13T02:31:11.404 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T02:31:11.404 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.404 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.405 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-06-13T02:31:11.405 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.405 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.405 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.405 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.405 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.405 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.405 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.405 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.406 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-06-13T02:31:11.406 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-06-13T02:31:11.406 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.406 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.406 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.406 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.406 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.406 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.406 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.407 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.407 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.407 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.407 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.407 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.407 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T02:31:11.407 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T02:31:11.407 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.408 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.408 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.408 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T02:31:11.408 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.408 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.408 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.408 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.408 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.408 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.409 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.409 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.409 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.409 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.409 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.409 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.409 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.409 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.409 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.410 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.411 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.412 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.413 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.414 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.415 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.416 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-06-13T02:31:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-06-13T02:31:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.417 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-06-13T02:31:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-06-13T02:31:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.418 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-06-13T02:31:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.419 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-06-13T02:31:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-06-13T02:31:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-13T02:31:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.421 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.421 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.421 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.421 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.421 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.421 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.421 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.421 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.421 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T02:31:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: "gid": 25136, 2024-06-13T02:31:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "y", 2024-06-13T02:31:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr_features": 4540701547738038271, 2024-06-13T02:31:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-06-13T02:31:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.422 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-06-13T02:31:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T02:31:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T02:31:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.423 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T02:31:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-06-13T02:31:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.424 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.425 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.426 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.427 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.429 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.431 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-06-13T02:31:11.432 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-06-13T02:31:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-06-13T02:31:11.433 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.434 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.434 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.434 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.434 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-06-13T02:31:11.434 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-06-13T02:31:11.434 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.434 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.434 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-06-13T02:31:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-06-13T02:31:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.435 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-06-13T02:31:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-06-13T02:31:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.436 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-06-13T02:31:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-06-13T02:31:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-06-13T02:31:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.437 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.438 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.438 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.438 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.438 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.438 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.438 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-06-13T02:31:11.438 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.438 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-06-13T02:31:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-06-13T02:31:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-06-13T02:31:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-06-13T02:31:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-06-13T02:31:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-06-13T02:31:11.440 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-06-13T02:31:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.441 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-06-13T02:31:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-06-13T02:31:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.442 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-13T02:31:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.443 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-06-13T02:31:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-06-13T02:31:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.444 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-06-13T02:31:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.445 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-06-13T02:31:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-06-13T02:31:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-06-13T02:31:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.446 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.447 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.447 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.447 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.447 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.447 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.447 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-06-13T02:31:11.447 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.447 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.447 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-06-13T02:31:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-06-13T02:31:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-06-13T02:31:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.448 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-06-13T02:31:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-13T02:31:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-06-13T02:31:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-06-13T02:31:11.449 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T02:31:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T02:31:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-06-13T02:31:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-06-13T02:31:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-13T02:31:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-13T02:31:11.450 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-06-13T02:31:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-06-13T02:31:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T02:31:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-06-13T02:31:11.451 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T02:31:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-06-13T02:31:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-13T02:31:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-06-13T02:31:11.452 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-06-13T02:31:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-06-13T02:31:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-13T02:31:11.453 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-13T02:31:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-06-13T02:31:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-06-13T02:31:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.454 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-06-13T02:31:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-06-13T02:31:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-06-13T02:31:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-06-13T02:31:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-13T02:31:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.455 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-06-13T02:31:11.456 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-06-13T02:31:11.456 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.456 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.456 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.456 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-06-13T02:31:11.456 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.456 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.456 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-06-13T02:31:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-13T02:31:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-06-13T02:31:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-06-13T02:31:11.457 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T02:31:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T02:31:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-06-13T02:31:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-06-13T02:31:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-13T02:31:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-13T02:31:11.458 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.459 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.460 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.461 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.462 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.463 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.464 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.465 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.466 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-06-13T02:31:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-06-13T02:31:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T02:31:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.467 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-13T02:31:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-06-13T02:31:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-06-13T02:31:11.468 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-06-13T02:31:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-06-13T02:31:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-06-13T02:31:11.469 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-06-13T02:31:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-06-13T02:31:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-06-13T02:31:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-06-13T02:31:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.470 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-06-13T02:31:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-06-13T02:31:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.471 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-13T02:31:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T02:31:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T02:31:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.472 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T02:31:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-13T02:31:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.473 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-06-13T02:31:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-06-13T02:31:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T02:31:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T02:31:11.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-13T02:31:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-13T02:31:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-06-13T02:31:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-06-13T02:31:11.475 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T02:31:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-13T02:31:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.476 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-06-13T02:31:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.477 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-06-13T02:31:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-06-13T02:31:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-06-13T02:31:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.478 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.479 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-13T02:31:11.479 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.479 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.479 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.479 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.479 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-06-13T02:31:11.479 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-06-13T02:31:11.479 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.479 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-06-13T02:31:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-13T02:31:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.480 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-06-13T02:31:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-06-13T02:31:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-06-13T02:31:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.481 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-13T02:31:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-06-13T02:31:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-06-13T02:31:11.482 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-13T02:31:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-13T02:31:11.483 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-06-13T02:31:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-06-13T02:31:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T02:31:11.484 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-13T02:31:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-06-13T02:31:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-06-13T02:31:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-06-13T02:31:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-13T02:31:11.486 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-06-13T02:31:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-06-13T02:31:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.487 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-06-13T02:31:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-06-13T02:31:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-06-13T02:31:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-13T02:31:11.488 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-06-13T02:31:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-06-13T02:31:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.489 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-13T02:31:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.490 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-06-13T02:31:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-06-13T02:31:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.491 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-13T02:31:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-06-13T02:31:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-06-13T02:31:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.492 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-13T02:31:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.493 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-06-13T02:31:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-06-13T02:31:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-13T02:31:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.494 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T02:31:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-06-13T02:31:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-06-13T02:31:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.495 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-13T02:31:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-06-13T02:31:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.496 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-06-13T02:31:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-06-13T02:31:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-13T02:31:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.497 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-06-13T02:31:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-06-13T02:31:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-06-13T02:31:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.498 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-13T02:31:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T02:31:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.499 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-06-13T02:31:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-06-13T02:31:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-13T02:31:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.500 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-06-13T02:31:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-06-13T02:31:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-06-13T02:31:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-13T02:31:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-06-13T02:31:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.502 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-06-13T02:31:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-06-13T02:31:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-13T02:31:11.503 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-06-13T02:31:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-06-13T02:31:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-06-13T02:31:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-13T02:31:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-06-13T02:31:11.505 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-06-13T02:31:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-06-13T02:31:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.506 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-13T02:31:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-06-13T02:31:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.507 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-06-13T02:31:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-06-13T02:31:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-13T02:31:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.508 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-06-13T02:31:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-06-13T02:31:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-06-13T02:31:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.509 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-13T02:31:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T02:31:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.510 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-06-13T02:31:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-06-13T02:31:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-13T02:31:11.511 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-06-13T02:31:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-06-13T02:31:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-06-13T02:31:11.512 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-13T02:31:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T02:31:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.513 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-06-13T02:31:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-06-13T02:31:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-13T02:31:11.514 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-06-13T02:31:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-06-13T02:31:11.515 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-06-13T02:31:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-13T02:31:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-06-13T02:31:11.516 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-06-13T02:31:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-06-13T02:31:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.517 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-13T02:31:11.518 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.518 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.518 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.518 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-06-13T02:31:11.518 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.518 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.518 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-06-13T02:31:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-06-13T02:31:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.520 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.520 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-06-13T02:31:11.520 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.520 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.520 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.520 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.520 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-06-13T02:31:11.520 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-06-13T02:31:11.520 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.521 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.521 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.521 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T02:31:11.521 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.521 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.521 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.521 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-13T02:31:11.521 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.521 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-06-13T02:31:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-06-13T02:31:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.522 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-06-13T02:31:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-13T02:31:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.523 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-06-13T02:31:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-06-13T02:31:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-06-13T02:31:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.524 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-13T02:31:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-06-13T02:31:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-06-13T02:31:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-06-13T02:31:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-06-13T02:31:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.526 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-06-13T02:31:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-06-13T02:31:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.527 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-13T02:31:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.528 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-06-13T02:31:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-06-13T02:31:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T02:31:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.529 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-06-13T02:31:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-06-13T02:31:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-06-13T02:31:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.530 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-13T02:31:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-13T02:31:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.531 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-06-13T02:31:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-06-13T02:31:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T02:31:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.532 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-06-13T02:31:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-06-13T02:31:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-06-13T02:31:11.533 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-13T02:31:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.534 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-06-13T02:31:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-06-13T02:31:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.535 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-13T02:31:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.536 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.537 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.538 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-06-13T02:31:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-06-13T02:31:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.539 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-13T02:31:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.540 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-13T02:31:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.542 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.543 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.544 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.545 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-13T02:31:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-13T02:31:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.546 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-13T02:31:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-13T02:31:11.547 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-13T02:31:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-06-13T02:31:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-13T02:31:11.548 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-06-13T02:31:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-06-13T02:31:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.549 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-06-13T02:31:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-06-13T02:31:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-06-13T02:31:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.551 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-13T02:31:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-06-13T02:31:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-06-13T02:31:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.552 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-06-13T02:31:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.553 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-06-13T02:31:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-06-13T02:31:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-06-13T02:31:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.554 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-06-13T02:31:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-06-13T02:31:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-06-13T02:31:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.555 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-06-13T02:31:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-06-13T02:31:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-06-13T02:31:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.556 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-13T02:31:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-06-13T02:31:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-06-13T02:31:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.557 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-13T02:31:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-13T02:31:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.558 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-06-13T02:31:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-06-13T02:31:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.559 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-13T02:31:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-06-13T02:31:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-06-13T02:31:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.561 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-13T02:31:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-06-13T02:31:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-06-13T02:31:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.562 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-13T02:31:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.563 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.564 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-06-13T02:31:11.564 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-06-13T02:31:11.564 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.564 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.564 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.564 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.564 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.564 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.564 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-13T02:31:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-06-13T02:31:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-06-13T02:31:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.565 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-13T02:31:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.566 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-06-13T02:31:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-06-13T02:31:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-06-13T02:31:11.567 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-06-13T02:31:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-06-13T02:31:11.568 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-06-13T02:31:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-13T02:31:11.569 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-06-13T02:31:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-06-13T02:31:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.570 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-13T02:31:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.571 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-06-13T02:31:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-06-13T02:31:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-13T02:31:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-06-13T02:31:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-06-13T02:31:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.573 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-06-13T02:31:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.574 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-06-13T02:31:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-06-13T02:31:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.575 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-13T02:31:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-06-13T02:31:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-06-13T02:31:11.576 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-13T02:31:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.577 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-06-13T02:31:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.579 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.580 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.581 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.582 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.583 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.584 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.585 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-06-13T02:31:11.586 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-06-13T02:31:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-06-13T02:31:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-13T02:31:11.587 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-06-13T02:31:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-06-13T02:31:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.588 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-06-13T02:31:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-13T02:31:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.589 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-06-13T02:31:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-13T02:31:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-13T02:31:11.590 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.591 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-06-13T02:31:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-13T02:31:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.592 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-13T02:31:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-13T02:31:11.593 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.594 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-06-13T02:31:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-06-13T02:31:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.595 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-13T02:31:11.596 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-13T02:31:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.597 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-06-13T02:31:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-13T02:31:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.598 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.599 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.599 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.599 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.599 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.599 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.599 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.599 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.599 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.599 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-13T02:31:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-13T02:31:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.600 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-13T02:31:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-13T02:31:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.601 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.602 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-13T02:31:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-13T02:31:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.603 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-13T02:31:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-13T02:31:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.604 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.605 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-13T02:31:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-13T02:31:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.606 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.607 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-13T02:31:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-13T02:31:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.608 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-13T02:31:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-13T02:31:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.609 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.610 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-13T02:31:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-13T02:31:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.611 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-06-13T02:31:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-13T02:31:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.612 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T02:31:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-13T02:31:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-13T02:31:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.614 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-06-13T02:31:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-06-13T02:31:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.615 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.616 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-06-13T02:31:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-13T02:31:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T02:31:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.617 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-13T02:31:11.618 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-13T02:31:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.619 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-13T02:31:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-13T02:31:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.620 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.621 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-13T02:31:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-13T02:31:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.622 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-13T02:31:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-13T02:31:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.623 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.624 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-06-13T02:31:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-13T02:31:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.625 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-13T02:31:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-13T02:31:11.626 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.627 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-13T02:31:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-13T02:31:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.628 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-13T02:31:11.629 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-13T02:31:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.630 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-13T02:31:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-13T02:31:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.631 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.632 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.632 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.632 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.632 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.632 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.632 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.632 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.632 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-13T02:31:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-13T02:31:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.633 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-13T02:31:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-13T02:31:11.634 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.635 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-13T02:31:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-13T02:31:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.636 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-13T02:31:11.637 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-13T02:31:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.638 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-06-13T02:31:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-13T02:31:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.639 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.640 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-13T02:31:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-13T02:31:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-13T02:31:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-13T02:31:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-13T02:31:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.642 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.643 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-13T02:31:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-13T02:31:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-06-13T02:31:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.644 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-13T02:31:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-13T02:31:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.645 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-06-13T02:31:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.646 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-06-13T02:31:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-13T02:31:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.647 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-13T02:31:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-13T02:31:11.648 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T02:31:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.649 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-06-13T02:31:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-13T02:31:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.650 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-06-13T02:31:11.651 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-13T02:31:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.652 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-13T02:31:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-13T02:31:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.653 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T02:31:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.654 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-13T02:31:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-13T02:31:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.655 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-13T02:31:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-13T02:31:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.656 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T02:31:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.657 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-06-13T02:31:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-06-13T02:31:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.658 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-06-13T02:31:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-06-13T02:31:11.659 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.660 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-06-13T02:31:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-06-13T02:31:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.661 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-06-13T02:31:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.662 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-06-13T02:31:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-06-13T02:31:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-06-13T02:31:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.663 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-06-13T02:31:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-06-13T02:31:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.664 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.665 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.666 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.666 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.666 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.666 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.666 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.666 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.666 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.666 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.667 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.668 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.669 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.670 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.671 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.672 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.673 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-06-13T02:31:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-06-13T02:31:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.674 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-06-13T02:31:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-06-13T02:31:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-06-13T02:31:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.675 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.676 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T02:31:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T02:31:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-06-13T02:31:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.677 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T02:31:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T02:31:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.678 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-06-13T02:31:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.679 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-06-13T02:31:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-06-13T02:31:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.680 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-06-13T02:31:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-06-13T02:31:11.681 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-06-13T02:31:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.682 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-06-13T02:31:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-06-13T02:31:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-06-13T02:31:11.683 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-06-13T02:31:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.684 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-06-13T02:31:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-06-13T02:31:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-06-13T02:31:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-06-13T02:31:11.685 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-06-13T02:31:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-06-13T02:31:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-06-13T02:31:11.686 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.687 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-06-13T02:31:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.688 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-06-13T02:31:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-06-13T02:31:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.689 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-06-13T02:31:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.690 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.692 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.693 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.694 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.695 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.696 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.697 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-06-13T02:31:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-06-13T02:31:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.698 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-06-13T02:31:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-13T02:31:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.699 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-06-13T02:31:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-06-13T02:31:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-06-13T02:31:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-13T02:31:11.700 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-06-13T02:31:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-06-13T02:31:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.701 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-06-13T02:31:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-06-13T02:31:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.702 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-06-13T02:31:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-06-13T02:31:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-06-13T02:31:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.703 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-13T02:31:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-06-13T02:31:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-06-13T02:31:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.704 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-13T02:31:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.705 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T02:31:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T02:31:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T02:31:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.706 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-06-13T02:31:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-06-13T02:31:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-06-13T02:31:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.707 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-06-13T02:31:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-13T02:31:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.708 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-06-13T02:31:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.709 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.710 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.711 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.712 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.713 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.714 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.715 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.716 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-06-13T02:31:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-06-13T02:31:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.717 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-06-13T02:31:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.718 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-06-13T02:31:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-06-13T02:31:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-06-13T02:31:11.719 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T02:31:11.720 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T02:31:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T02:31:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.721 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.722 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.722 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.722 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.722 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.722 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.722 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.722 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-06-13T02:31:11.722 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-06-13T02:31:11.722 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-06-13T02:31:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-06-13T02:31:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-06-13T02:31:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-06-13T02:31:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.723 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-13T02:31:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-06-13T02:31:11.724 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-06-13T02:31:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-06-13T02:31:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-13T02:31:11.725 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-06-13T02:31:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-06-13T02:31:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.726 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-06-13T02:31:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.727 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T02:31:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T02:31:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-06-13T02:31:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-06-13T02:31:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.728 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-13T02:31:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.729 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.730 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.731 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.732 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.733 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.734 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.734 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.734 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.734 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.734 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.734 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.734 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.735 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.736 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-06-13T02:31:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-06-13T02:31:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.737 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-06-13T02:31:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.738 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-06-13T02:31:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-06-13T02:31:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-06-13T02:31:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.739 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-06-13T02:31:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-06-13T02:31:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-06-13T02:31:11.740 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-06-13T02:31:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-13T02:31:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.741 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-06-13T02:31:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-06-13T02:31:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.742 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T02:31:11.743 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T02:31:11.743 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-06-13T02:31:11.743 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.743 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-13T02:31:11.743 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.743 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.743 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.743 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-06-13T02:31:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-06-13T02:31:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.744 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-06-13T02:31:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-06-13T02:31:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-06-13T02:31:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.745 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-06-13T02:31:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-13T02:31:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.746 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-06-13T02:31:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.747 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.748 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.749 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.750 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.751 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.752 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.753 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.754 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.755 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-06-13T02:31:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.756 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.757 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.758 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.759 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.759 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.759 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.759 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.759 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.759 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.759 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.759 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.761 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.762 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.762 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.762 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.762 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.762 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.762 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.762 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.762 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.763 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.764 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-06-13T02:31:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-06-13T02:31:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-06-13T02:31:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.765 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-06-13T02:31:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-13T02:31:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.766 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-06-13T02:31:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-06-13T02:31:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-06-13T02:31:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.767 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-13T02:31:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.768 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.769 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.770 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.771 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.772 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.773 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.774 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.775 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-06-13T02:31:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.776 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-06-13T02:31:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-06-13T02:31:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-06-13T02:31:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.777 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-06-13T02:31:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-13T02:31:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.778 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.779 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.779 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.779 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.779 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.779 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.779 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.779 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.779 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.780 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.781 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.782 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.783 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.784 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.785 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-06-13T02:31:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-06-13T02:31:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.786 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-06-13T02:31:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-13T02:31:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.787 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-06-13T02:31:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-06-13T02:31:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-06-13T02:31:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.788 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-06-13T02:31:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-06-13T02:31:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-06-13T02:31:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.789 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-06-13T02:31:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-06-13T02:31:11.790 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-06-13T02:31:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-06-13T02:31:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.791 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-06-13T02:31:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.792 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-06-13T02:31:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-06-13T02:31:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-06-13T02:31:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.793 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-13T02:31:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-13T02:31:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.794 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-06-13T02:31:11.795 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.795 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.795 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.795 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.795 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.795 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.795 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.795 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.795 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.796 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.797 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.798 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.799 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.800 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.801 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.802 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-06-13T02:31:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.803 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.804 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.805 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.806 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.808 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.809 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.810 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.810 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.810 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.810 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.810 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.810 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.810 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.810 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.810 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.811 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.811 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.811 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.811 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.811 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.811 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.811 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.811 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.811 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-06-13T02:31:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.812 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.813 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.814 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.815 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.816 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.817 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.818 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.819 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-06-13T02:31:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.820 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-06-13T02:31:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-06-13T02:31:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.821 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-13T02:31:11.822 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.822 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.822 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.822 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.822 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.822 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.822 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.822 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.822 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.823 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.824 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.825 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.827 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.828 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.829 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-06-13T02:31:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-06-13T02:31:11.830 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-06-13T02:31:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-06-13T02:31:11.831 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-06-13T02:31:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-06-13T02:31:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.832 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-06-13T02:31:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.833 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.834 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.835 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.836 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.837 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.837 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.837 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.837 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.837 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.837 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.837 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.837 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.838 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.839 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.840 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.841 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-06-13T02:31:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.842 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.843 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.844 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.845 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.846 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.846 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.846 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.846 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.846 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.846 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.846 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.846 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.847 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.848 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.849 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.850 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-06-13T02:31:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.851 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.852 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.853 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.853 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.853 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.853 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.853 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.853 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.853 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.853 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.854 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.855 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.856 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.857 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.858 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.859 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T02:31:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T02:31:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.860 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T02:31:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.861 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-06-13T02:31:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-06-13T02:31:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-06-13T02:31:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-06-13T02:31:11.862 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-06-13T02:31:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-13T02:31:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.863 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-06-13T02:31:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-06-13T02:31:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-06-13T02:31:11.864 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-13T02:31:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.865 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-06-13T02:31:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-06-13T02:31:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.866 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.867 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.868 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.868 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.868 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.868 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.868 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.868 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.868 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.868 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.869 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.870 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.871 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.872 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.873 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.874 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.875 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-06-13T02:31:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-06-13T02:31:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.876 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-06-13T02:31:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-06-13T02:31:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.877 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T02:31:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T02:31:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T02:31:11.878 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-06-13T02:31:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.879 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-06-13T02:31:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-06-13T02:31:11.880 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-06-13T02:31:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.881 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-06-13T02:31:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-06-13T02:31:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.882 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-13T02:31:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-13T02:31:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.883 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.884 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.885 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.886 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.887 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.888 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.889 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.890 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.891 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-06-13T02:31:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-06-13T02:31:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.892 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.893 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-13T02:31:11.894 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-13T02:31:11.894 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.894 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.894 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.894 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-06-13T02:31:11.894 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.894 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.894 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-06-13T02:31:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-06-13T02:31:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:11.895 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-06-13T02:31:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T02:31:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T02:31:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-06-13T02:31:11.897 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-13T02:31:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T02:31:11.898 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T02:31:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-06-13T02:31:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.899 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-13T02:31:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-06-13T02:31:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-06-13T02:31:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.900 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-06-13T02:31:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.901 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.902 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-06-13T02:31:11.902 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-06-13T02:31:11.902 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.902 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.902 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.902 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-06-13T02:31:11.902 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.902 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-06-13T02:31:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-06-13T02:31:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.903 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-06-13T02:31:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-06-13T02:31:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-06-13T02:31:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-06-13T02:31:11.904 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-06-13T02:31:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.905 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-06-13T02:31:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.906 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.907 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.908 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.909 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.910 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.911 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.912 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.913 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-06-13T02:31:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-06-13T02:31:11.914 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.915 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-06-13T02:31:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-06-13T02:31:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-06-13T02:31:11.917 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-06-13T02:31:11.918 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.918 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.918 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.918 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.918 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.918 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.918 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.918 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.919 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-06-13T02:31:11.920 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.920 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.920 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.920 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-06-13T02:31:11.920 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-06-13T02:31:11.920 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.920 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.920 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.921 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.922 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-06-13T02:31:11.922 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-06-13T02:31:11.922 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.922 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.922 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.922 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.922 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.922 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.923 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.924 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.925 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.926 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.927 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.928 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.929 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.930 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.931 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T02:31:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T02:31:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.932 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T02:31:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T02:31:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.933 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.934 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-06-13T02:31:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.935 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.936 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.937 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.937 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.937 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.937 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.937 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.937 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.937 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.937 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.938 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.939 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.940 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.941 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.942 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.943 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-06-13T02:31:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.944 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.945 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.946 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.947 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.948 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.949 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.950 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.951 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.952 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-06-13T02:31:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-06-13T02:31:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-06-13T02:31:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.953 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-13T02:31:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.954 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-06-13T02:31:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.955 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.956 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.957 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.958 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.959 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.960 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.961 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.962 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.963 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-06-13T02:31:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-06-13T02:31:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.964 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-06-13T02:31:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-06-13T02:31:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.965 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-06-13T02:31:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.966 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.967 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.967 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-06-13T02:31:11.967 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-06-13T02:31:11.967 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.967 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.967 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.967 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.967 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-06-13T02:31:11.968 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-06-13T02:31:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.969 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.970 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.970 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.970 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.970 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-06-13T02:31:11.970 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-06-13T02:31:11.970 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.741+0000 7f31eee00640 1 -- 172.21.15.2:0/1574170231 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f31cc0a2d00 msgr2=0x7f31cc0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.741+0000 7f31eee00640 1 --2- 172.21.15.2:0/1574170231 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f31cc0a2d00 0x7f31cc0a51c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f31e80ffb10 tx=0x7f31d400b4a0 comp rx=0 tx=0).stop 2024-06-13T02:31:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.741+0000 7f31eee00640 1 -- 172.21.15.2:0/1574170231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e8073dd0 msgr2=0x7f31e819a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.741+0000 7f31eee00640 1 --2- 172.21.15.2:0/1574170231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e8073dd0 0x7f31e819a500 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f31d802a9a0 tx=0x7f31d8003b90 comp rx=0 tx=0).stop 2024-06-13T02:31:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.741+0000 7f31eee00640 1 -- 172.21.15.2:0/1574170231 shutdown_connections 2024-06-13T02:31:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.741+0000 7f31eee00640 1 --2- 172.21.15.2:0/1574170231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e810e1b0 0x7f31e819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:11.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.741+0000 7f31eee00640 1 --2- 172.21.15.2:0/1574170231 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f31cc0a2d00 0x7f31cc0a51c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:11.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.741+0000 7f31eee00640 1 --2- 172.21.15.2:0/1574170231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f31e80746f0 0x7f31e819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:11.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.741+0000 7f31eee00640 1 --2- 172.21.15.2:0/1574170231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31e8073dd0 0x7f31e819a500 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:11.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.741+0000 7f31eee00640 1 -- 172.21.15.2:0/1574170231 >> 172.21.15.2:0/1574170231 conn(0x7f31e80fd480 msgr2=0x7f31e80fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:11.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.741+0000 7f31eee00640 1 -- 172.21.15.2:0/1574170231 shutdown_connections 2024-06-13T02:31:11.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:10.741+0000 7f31eee00640 1 -- 172.21.15.2:0/1574170231 wait complete. 2024-06-13T02:31:11.973 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:11 smithi084 ceph-mon[36833]: pgmap v422: 129 pgs: 20 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 55 active+clean; 280 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 24 MiB/s wr, 349 op/s 2024-06-13T02:31:11.973 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:11 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1574170231' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-13T02:31:11.973 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:11 smithi175 ceph-mon[36977]: pgmap v422: 129 pgs: 20 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 55 active+clean; 280 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 24 MiB/s wr, 349 op/s 2024-06-13T02:31:11.973 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:11 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1574170231' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-13T02:31:11.975 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.976 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.976 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.976 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.976 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.976 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.976 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.976 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-06-13T02:31:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-06-13T02:31:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.977 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.978 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-06-13T02:31:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-06-13T02:31:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.979 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-06-13T02:31:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-06-13T02:31:11.980 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.981 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-06-13T02:31:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-06-13T02:31:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.982 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T02:31:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-06-13T02:31:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.983 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-06-13T02:31:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-06-13T02:31:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.984 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-06-13T02:31:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-06-13T02:31:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.985 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.986 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-06-13T02:31:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-06-13T02:31:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.987 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.988 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-06-13T02:31:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-06-13T02:31:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-06-13T02:31:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.989 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-06-13T02:31:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.991 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-06-13T02:31:11.991 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-06-13T02:31:11.991 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.991 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.991 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.991 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.991 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.991 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-06-13T02:31:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:11.992 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.993 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.995 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.996 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:11.996 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.996 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.996 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.996 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.996 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.996 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:11.996 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:11.997 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:11.998 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:11.999 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.000 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-06-13T02:31:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.002 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.003 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.004 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.005 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.006 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.007 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.008 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.009 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-06-13T02:31:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.010 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.011 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.012 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.013 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.014 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.015 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.016 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.017 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-06-13T02:31:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.018 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-06-13T02:31:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-06-13T02:31:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-13T02:31:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.019 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T02:31:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T02:31:12.020 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-06-13T02:31:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.021 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.022 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.023 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.023 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.023 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.023 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.023 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.023 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.023 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.023 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.023 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.024 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.025 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.026 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.027 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.028 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.029 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-06-13T02:31:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.030 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-06-13T02:31:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-06-13T02:31:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.031 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-13T02:31:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-06-13T02:31:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-06-13T02:31:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.032 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.033 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.033 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.033 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.033 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.033 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-13T02:31:12.033 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.033 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.033 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-06-13T02:31:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-06-13T02:31:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.034 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-13T02:31:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-06-13T02:31:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-06-13T02:31:12.035 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-13T02:31:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.036 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-06-13T02:31:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-06-13T02:31:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.037 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-13T02:31:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-06-13T02:31:12.038 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-06-13T02:31:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.039 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-06-13T02:31:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-06-13T02:31:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.040 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-06-13T02:31:12.041 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-06-13T02:31:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-13T02:31:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.042 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-06-13T02:31:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-06-13T02:31:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.043 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.044 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T02:31:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T02:31:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-06-13T02:31:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-06-13T02:31:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.045 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-06-13T02:31:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-06-13T02:31:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.046 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-06-13T02:31:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.047 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-06-13T02:31:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-06-13T02:31:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.048 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-06-13T02:31:12.049 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-06-13T02:31:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.050 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.051 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.052 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.053 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.054 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.055 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.056 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.057 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.058 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-06-13T02:31:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-06-13T02:31:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.059 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.060 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-06-13T02:31:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-06-13T02:31:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.061 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-06-13T02:31:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-06-13T02:31:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.062 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-13T02:31:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.063 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-06-13T02:31:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.064 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.065 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.066 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.066 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.066 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.066 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.066 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.066 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.066 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.066 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.066 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.067 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.069 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.070 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.071 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.072 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-06-13T02:31:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.073 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.075 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.076 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.077 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.078 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.079 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.080 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-06-13T02:31:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-06-13T02:31:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-06-13T02:31:12.081 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-13T02:31:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-06-13T02:31:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-06-13T02:31:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-06-13T02:31:12.083 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-06-13T02:31:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-06-13T02:31:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.084 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T02:31:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-13T02:31:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.085 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-06-13T02:31:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-06-13T02:31:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.086 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-13T02:31:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.087 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-06-13T02:31:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-06-13T02:31:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-06-13T02:31:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T02:31:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.088 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-06-13T02:31:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-06-13T02:31:12.089 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-06-13T02:31:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.090 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T02:31:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T02:31:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.091 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T02:31:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.092 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.093 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.094 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.095 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.096 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.097 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.098 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.098 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.098 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.098 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.098 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.098 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.098 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.098 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.099 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-06-13T02:31:12.100 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-06-13T02:31:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.101 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-06-13T02:31:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-06-13T02:31:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.102 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-06-13T02:31:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.103 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-06-13T02:31:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-06-13T02:31:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-13T02:31:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.104 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T02:31:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.105 INFO:teuthology.orchestra.run.smithi002.stdout: "modules": [ 2024-06-13T02:31:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-06-13T02:31:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard", 2024-06-13T02:31:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: "iostat", 2024-06-13T02:31:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: "nfs", 2024-06-13T02:31:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: "restful", 2024-06-13T02:31:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: "snap_schedule" 2024-06-13T02:31:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: "available_modules": [ 2024-06-13T02:31:12.106 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "alerts", 2024-06-13T02:31:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T02:31:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T02:31:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.107 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T02:31:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How frequently to reexamine health status", 2024-06-13T02:31:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.108 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.109 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.110 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.111 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.112 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.113 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.114 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.115 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.116 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_destination": { 2024-06-13T02:31:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_destination", 2024-06-13T02:31:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email address to send alerts to", 2024-06-13T02:31:12.117 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_from_name": { 2024-06-13T02:31:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_from_name", 2024-06-13T02:31:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.118 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "Ceph", 2024-06-13T02:31:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Email From: name", 2024-06-13T02:31:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.119 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_host": { 2024-06-13T02:31:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_host", 2024-06-13T02:31:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.120 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP server", 2024-06-13T02:31:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_password": { 2024-06-13T02:31:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_password", 2024-06-13T02:31:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.121 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Password to authenticate with", 2024-06-13T02:31:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.122 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.123 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.123 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_port": { 2024-06-13T02:31:12.123 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_port", 2024-06-13T02:31:12.123 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.123 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.123 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.123 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "465", 2024-06-13T02:31:12.123 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.123 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP port", 2024-06-13T02:31:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_sender": { 2024-06-13T02:31:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_sender", 2024-06-13T02:31:12.124 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SMTP envelope sender", 2024-06-13T02:31:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.125 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_ssl": { 2024-06-13T02:31:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_ssl", 2024-06-13T02:31:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.126 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-13T02:31:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.127 INFO:teuthology.orchestra.run.smithi002.stdout: "smtp_user": { 2024-06-13T02:31:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "smtp_user", 2024-06-13T02:31:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.128 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "User to authenticate as", 2024-06-13T02:31:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "balancer", 2024-06-13T02:31:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.129 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "active": { 2024-06-13T02:31:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "active", 2024-06-13T02:31:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.130 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically balance PGs across cluster", 2024-06-13T02:31:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_time": { 2024-06-13T02:31:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_time", 2024-06-13T02:31:12.131 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0000", 2024-06-13T02:31:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "beginning time of day to automatically balance", 2024-06-13T02:31:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-13T02:31:12.132 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: "begin_weekday": { 2024-06-13T02:31:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "begin_weekday", 2024-06-13T02:31:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T02:31:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.133 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T02:31:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-06-13T02:31:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-06-13T02:31:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-13T02:31:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-13T02:31:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.134 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_max_iterations": { 2024-06-13T02:31:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_max_iterations", 2024-06-13T02:31:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T02:31:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "25", 2024-06-13T02:31:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T02:31:12.135 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "250", 2024-06-13T02:31:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-13T02:31:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_metrics": { 2024-06-13T02:31:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_metrics", 2024-06-13T02:31:12.136 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "pgs,objects,bytes", 2024-06-13T02:31:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-13T02:31:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-13T02:31:12.137 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: "crush_compat_step": { 2024-06-13T02:31:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crush_compat_step", 2024-06-13T02:31:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.138 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.5", 2024-06-13T02:31:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0.001", 2024-06-13T02:31:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "0.999", 2024-06-13T02:31:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "aggressiveness of optimization", 2024-06-13T02:31:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-13T02:31:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.139 INFO:teuthology.orchestra.run.smithi002.stdout: "end_time": { 2024-06-13T02:31:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_time", 2024-06-13T02:31:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2359", 2024-06-13T02:31:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.140 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ending time of day to automatically balance", 2024-06-13T02:31:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-13T02:31:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "end_weekday": { 2024-06-13T02:31:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "end_weekday", 2024-06-13T02:31:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T02:31:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.141 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T02:31:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "0", 2024-06-13T02:31:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "6", 2024-06-13T02:31:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-13T02:31:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-13T02:31:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.143 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.144 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.145 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.146 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.147 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.148 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.149 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "min_score": { 2024-06-13T02:31:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_score", 2024-06-13T02:31:12.150 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T02:31:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-13T02:31:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.151 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-06-13T02:31:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-06-13T02:31:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "upmap", 2024-06-13T02:31:12.152 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: "crush-compat", 2024-06-13T02:31:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: "none", 2024-06-13T02:31:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: "read", 2024-06-13T02:31:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap", 2024-06-13T02:31:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap-read" 2024-06-13T02:31:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Balancer mode", 2024-06-13T02:31:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_ids": { 2024-06-13T02:31:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_ids", 2024-06-13T02:31:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-13T02:31:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.155 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T02:31:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T02:31:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T02:31:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.156 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-13T02:31:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_deviation": { 2024-06-13T02:31:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_deviation", 2024-06-13T02:31:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.157 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T02:31:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T02:31:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-13T02:31:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-13T02:31:12.158 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: "upmap_max_optimizations": { 2024-06-13T02:31:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "upmap_max_optimizations", 2024-06-13T02:31:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T02:31:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:12.159 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-13T02:31:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.160 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm", 2024-06-13T02:31:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_down_multiplier": { 2024-06-13T02:31:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_down_multiplier", 2024-06-13T02:31:12.161 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-06-13T02:31:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-13T02:31:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.162 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.163 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.163 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.163 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_refresh_rate": { 2024-06-13T02:31:12.163 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_refresh_rate", 2024-06-13T02:31:12.163 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.163 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.163 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.163 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "20", 2024-06-13T02:31:12.163 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-13T02:31:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: "agent_starting_port": { 2024-06-13T02:31:12.164 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "agent_starting_port", 2024-06-13T02:31:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4721", 2024-06-13T02:31:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-13T02:31:12.165 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_ptrace": { 2024-06-13T02:31:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_ptrace", 2024-06-13T02:31:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.166 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-13T02:31:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-13T02:31:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.167 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_interval": { 2024-06-13T02:31:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_interval", 2024-06-13T02:31:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T02:31:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.168 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-13T02:31:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: "autotune_memory_target_ratio": { 2024-06-13T02:31:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "autotune_memory_target_ratio", 2024-06-13T02:31:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.169 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0.7", 2024-06-13T02:31:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-13T02:31:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.170 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm_log_destination": { 2024-06-13T02:31:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephadm_log_destination", 2024-06-13T02:31:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.171 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "file", 2024-06-13T02:31:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "file,syslog", 2024-06-13T02:31:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "syslog" 2024-06-13T02:31:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-13T02:31:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.172 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: "cgroups_split": { 2024-06-13T02:31:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cgroups_split", 2024-06-13T02:31:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.173 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-13T02:31:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "config_checks_enabled": { 2024-06-13T02:31:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_checks_enabled", 2024-06-13T02:31:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.174 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-13T02:31:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.175 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: "config_dashboard": { 2024-06-13T02:31:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_dashboard", 2024-06-13T02:31:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.176 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-13T02:31:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_alertmanager": { 2024-06-13T02:31:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_alertmanager", 2024-06-13T02:31:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.177 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-13T02:31:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T02:31:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.178 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_base": { 2024-06-13T02:31:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_base", 2024-06-13T02:31:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-13T02:31:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.179 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Container image name, without the tag", 2024-06-13T02:31:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_elasticsearch": { 2024-06-13T02:31:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_elasticsearch", 2024-06-13T02:31:12.180 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.181 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.181 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.181 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-13T02:31:12.181 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.181 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.181 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.181 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "elasticsearch container image", 2024-06-13T02:31:12.181 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_grafana": { 2024-06-13T02:31:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_grafana", 2024-06-13T02:31:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.182 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-13T02:31:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T02:31:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_haproxy": { 2024-06-13T02:31:12.183 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_haproxy", 2024-06-13T02:31:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-13T02:31:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "HAproxy container image", 2024-06-13T02:31:12.184 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_agent": { 2024-06-13T02:31:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_agent", 2024-06-13T02:31:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.185 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-13T02:31:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger agent container image", 2024-06-13T02:31:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.186 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_collector": { 2024-06-13T02:31:12.187 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_collector", 2024-06-13T02:31:12.187 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.187 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.187 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.187 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-13T02:31:12.187 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.187 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.187 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger collector container image", 2024-06-13T02:31:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_jaeger_query": { 2024-06-13T02:31:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_jaeger_query", 2024-06-13T02:31:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.188 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-13T02:31:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Jaeger query container image", 2024-06-13T02:31:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_keepalived": { 2024-06-13T02:31:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_keepalived", 2024-06-13T02:31:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-13T02:31:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.190 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Keepalived container image", 2024-06-13T02:31:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_loki": { 2024-06-13T02:31:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_loki", 2024-06-13T02:31:12.191 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-13T02:31:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Loki container image", 2024-06-13T02:31:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.192 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_node_exporter": { 2024-06-13T02:31:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_node_exporter", 2024-06-13T02:31:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-13T02:31:12.193 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T02:31:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.194 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_nvmeof": { 2024-06-13T02:31:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_nvmeof", 2024-06-13T02:31:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-06-13T02:31:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.195 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Nvme-of container image", 2024-06-13T02:31:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_prometheus": { 2024-06-13T02:31:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_prometheus", 2024-06-13T02:31:12.196 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-13T02:31:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Prometheus container image", 2024-06-13T02:31:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.197 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_promtail": { 2024-06-13T02:31:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_promtail", 2024-06-13T02:31:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-13T02:31:12.198 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Promtail container image", 2024-06-13T02:31:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_samba": { 2024-06-13T02:31:12.199 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_samba", 2024-06-13T02:31:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-13T02:31:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Samba/SMB container image", 2024-06-13T02:31:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.200 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "container_image_snmp_gateway": { 2024-06-13T02:31:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_image_snmp_gateway", 2024-06-13T02:31:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-13T02:31:12.201 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.202 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.202 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.202 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "SNMP Gateway container image", 2024-06-13T02:31:12.202 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.202 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.202 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.202 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "container_init": { 2024-06-13T02:31:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "container_init", 2024-06-13T02:31:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.203 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Run podman/docker with `--init`", 2024-06-13T02:31:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "daemon_cache_timeout": { 2024-06-13T02:31:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "daemon_cache_timeout", 2024-06-13T02:31:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.204 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T02:31:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-13T02:31:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.205 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "default_cephadm_command_timeout": { 2024-06-13T02:31:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_cephadm_command_timeout", 2024-06-13T02:31:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "900", 2024-06-13T02:31:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.206 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-13T02:31:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: "default_registry": { 2024-06-13T02:31:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "default_registry", 2024-06-13T02:31:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.207 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "docker.io", 2024-06-13T02:31:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-13T02:31:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.208 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "device_cache_timeout": { 2024-06-13T02:31:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_cache_timeout", 2024-06-13T02:31:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1800", 2024-06-13T02:31:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.209 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache device inventory", 2024-06-13T02:31:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: "device_enhanced_scan": { 2024-06-13T02:31:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_enhanced_scan", 2024-06-13T02:31:12.210 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-13T02:31:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.211 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: "facts_cache_timeout": { 2024-06-13T02:31:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "facts_cache_timeout", 2024-06-13T02:31:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T02:31:12.212 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "seconds to cache host facts data", 2024-06-13T02:31:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "grafana_dashboards_path": { 2024-06-13T02:31:12.213 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "grafana_dashboards_path", 2024-06-13T02:31:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-13T02:31:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-13T02:31:12.214 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "host_check_interval": { 2024-06-13T02:31:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "host_check_interval", 2024-06-13T02:31:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.215 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T02:31:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to perform a host check", 2024-06-13T02:31:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.216 INFO:teuthology.orchestra.run.smithi002.stdout: "hw_monitoring": { 2024-06-13T02:31:12.217 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hw_monitoring", 2024-06-13T02:31:12.217 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.217 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.217 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.217 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.217 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.217 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.217 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.217 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-13T02:31:12.217 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.218 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.218 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.218 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.218 INFO:teuthology.orchestra.run.smithi002.stdout: "inventory_list_all": { 2024-06-13T02:31:12.218 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "inventory_list_all", 2024-06-13T02:31:12.218 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.218 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.218 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.218 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.219 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.219 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.219 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.219 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-13T02:31:12.219 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.219 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.219 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.219 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.220 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.221 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.222 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.222 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.222 INFO:teuthology.orchestra.run.smithi002.stdout: "log_refresh_metadata": { 2024-06-13T02:31:12.222 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_refresh_metadata", 2024-06-13T02:31:12.222 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.222 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.222 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.222 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-13T02:31:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.223 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-13T02:31:12.224 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.225 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.226 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.227 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.228 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-13T02:31:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-13T02:31:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.229 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-13T02:31:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.230 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-13T02:31:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-13T02:31:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "*", 2024-06-13T02:31:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-13T02:31:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: "max_count_per_host": { 2024-06-13T02:31:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_count_per_host", 2024-06-13T02:31:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.232 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of daemons per service per host", 2024-06-13T02:31:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.233 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: "max_osd_draining_count": { 2024-06-13T02:31:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_osd_draining_count", 2024-06-13T02:31:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.234 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-13T02:31:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.235 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: "migration_current": { 2024-06-13T02:31:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "migration_current", 2024-06-13T02:31:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.236 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "internal - do not modify", 2024-06-13T02:31:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: "mode": { 2024-06-13T02:31:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mode", 2024-06-13T02:31:12.237 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "root", 2024-06-13T02:31:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm-package", 2024-06-13T02:31:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: "root" 2024-06-13T02:31:12.238 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "mode for remote execution of cephadm", 2024-06-13T02:31:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "oob_default_addr": { 2024-06-13T02:31:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "oob_default_addr", 2024-06-13T02:31:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.239 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "169.254.1.1", 2024-06-13T02:31:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-13T02:31:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.240 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: "prometheus_alerts_path": { 2024-06-13T02:31:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus_alerts_path", 2024-06-13T02:31:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.241 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-13T02:31:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-13T02:31:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.242 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_insecure": { 2024-06-13T02:31:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_insecure", 2024-06-13T02:31:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.243 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-13T02:31:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_password": { 2024-06-13T02:31:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_password", 2024-06-13T02:31:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.244 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-13T02:31:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.245 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.246 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.246 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_url": { 2024-06-13T02:31:12.246 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_url", 2024-06-13T02:31:12.246 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.246 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.246 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.246 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.246 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-13T02:31:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: "registry_username": { 2024-06-13T02:31:12.247 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "registry_username", 2024-06-13T02:31:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.248 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-13T02:31:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: "secure_monitoring_stack": { 2024-06-13T02:31:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "secure_monitoring_stack", 2024-06-13T02:31:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.249 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-13T02:31:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.250 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "service_discovery_port": { 2024-06-13T02:31:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "service_discovery_port", 2024-06-13T02:31:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8765", 2024-06-13T02:31:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.251 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "cephadm service discovery port", 2024-06-13T02:31:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: "ssh_config_file": { 2024-06-13T02:31:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssh_config_file", 2024-06-13T02:31:12.252 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-13T02:31:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.253 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: "use_agent": { 2024-06-13T02:31:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_agent", 2024-06-13T02:31:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.254 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-13T02:31:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.255 INFO:teuthology.orchestra.run.smithi002.stdout: "use_repo_digest": { 2024-06-13T02:31:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "use_repo_digest", 2024-06-13T02:31:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.256 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-13T02:31:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_failed_host_check": { 2024-06-13T02:31:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_failed_host_check", 2024-06-13T02:31:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.257 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if the host check fails", 2024-06-13T02:31:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.258 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_daemons": { 2024-06-13T02:31:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_daemons", 2024-06-13T02:31:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.259 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-13T02:31:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_on_stray_hosts": { 2024-06-13T02:31:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_on_stray_hosts", 2024-06-13T02:31:12.260 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-13T02:31:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.261 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crash", 2024-06-13T02:31:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.262 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.263 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.264 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.265 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.266 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.267 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.268 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.269 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "retain_interval": { 2024-06-13T02:31:12.270 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retain_interval", 2024-06-13T02:31:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "31536000", 2024-06-13T02:31:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-13T02:31:12.271 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_recent_interval": { 2024-06-13T02:31:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_recent_interval", 2024-06-13T02:31:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.272 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1209600", 2024-06-13T02:31:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-13T02:31:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.273 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dashboard", 2024-06-13T02:31:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-13T02:31:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-13T02:31:12.274 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.275 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_HOST": { 2024-06-13T02:31:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-13T02:31:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.276 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-13T02:31:12.277 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-13T02:31:12.278 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.278 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.278 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.278 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.278 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.278 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.278 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.278 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_ENABLED": { 2024-06-13T02:31:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_ENABLED", 2024-06-13T02:31:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.279 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.280 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-13T02:31:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-13T02:31:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.281 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: "ENABLE_BROWSABLE_API": { 2024-06-13T02:31:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-13T02:31:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.282 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.283 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-13T02:31:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-13T02:31:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.284 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.285 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-13T02:31:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-13T02:31:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.286 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-13T02:31:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-13T02:31:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.287 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.288 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-13T02:31:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-13T02:31:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.289 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.290 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-13T02:31:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-13T02:31:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.291 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.292 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.292 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.292 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.292 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.292 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-13T02:31:12.292 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-13T02:31:12.292 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.292 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.293 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-13T02:31:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-13T02:31:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.294 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-13T02:31:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-13T02:31:12.295 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.296 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_PASSWORD": { 2024-06-13T02:31:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-13T02:31:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T02:31:12.297 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-13T02:31:12.298 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-13T02:31:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.299 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_URL": { 2024-06-13T02:31:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_URL", 2024-06-13T02:31:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.300 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_API_USERNAME": { 2024-06-13T02:31:12.301 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-13T02:31:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T02:31:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.302 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-13T02:31:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-13T02:31:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.303 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.304 INFO:teuthology.orchestra.run.smithi002.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-13T02:31:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-13T02:31:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.305 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-13T02:31:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-13T02:31:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.306 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.307 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-13T02:31:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-13T02:31:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.308 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_HOST": { 2024-06-13T02:31:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-13T02:31:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.309 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.310 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-13T02:31:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-13T02:31:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.311 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-13T02:31:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-13T02:31:12.312 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.313 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-13T02:31:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-13T02:31:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.314 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-13T02:31:12.315 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-13T02:31:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.316 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-13T02:31:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-13T02:31:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.317 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.318 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.318 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.318 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.318 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.318 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.318 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.318 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.318 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.318 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-13T02:31:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-13T02:31:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.319 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-13T02:31:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-13T02:31:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.320 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.321 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-13T02:31:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-13T02:31:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.322 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_ENABLED": { 2024-06-13T02:31:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-13T02:31:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.324 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-13T02:31:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-13T02:31:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-13T02:31:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.325 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-13T02:31:12.326 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-13T02:31:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.327 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-13T02:31:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-13T02:31:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.328 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8", 2024-06-13T02:31:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-13T02:31:12.329 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-13T02:31:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "45", 2024-06-13T02:31:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.330 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ACCESS_KEY": { 2024-06-13T02:31:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-13T02:31:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.331 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.332 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-13T02:31:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-13T02:31:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "admin", 2024-06-13T02:31:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.333 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SECRET_KEY": { 2024-06-13T02:31:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-13T02:31:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.334 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.335 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "RGW_API_SSL_VERIFY": { 2024-06-13T02:31:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-13T02:31:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.336 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-13T02:31:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-13T02:31:12.337 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T02:31:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.338 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-13T02:31:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-13T02:31:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.340 INFO:teuthology.orchestra.run.smithi002.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-13T02:31:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-13T02:31:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T02:31:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.341 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: "cross_origin_url": { 2024-06-13T02:31:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cross_origin_url", 2024-06-13T02:31:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.342 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.343 INFO:teuthology.orchestra.run.smithi002.stdout: "crt_file": { 2024-06-13T02:31:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "crt_file", 2024-06-13T02:31:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.344 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: "debug": { 2024-06-13T02:31:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "debug", 2024-06-13T02:31:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.345 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Enable/disable debug options", 2024-06-13T02:31:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.346 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "jwt_token_ttl": { 2024-06-13T02:31:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "jwt_token_ttl", 2024-06-13T02:31:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "28800", 2024-06-13T02:31:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-06-13T02:31:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-06-13T02:31:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.348 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.350 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.351 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.352 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.353 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.354 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.355 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.356 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.357 INFO:teuthology.orchestra.run.smithi002.stdout: "motd": { 2024-06-13T02:31:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "motd", 2024-06-13T02:31:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.358 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "The message of the day", 2024-06-13T02:31:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect_resolve_ip_addr": { 2024-06-13T02:31:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "redirect_resolve_ip_addr", 2024-06-13T02:31:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.359 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.360 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.360 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.360 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.360 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.360 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.360 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.360 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.360 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T02:31:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T02:31:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-06-13T02:31:12.361 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.362 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T02:31:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T02:31:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8080", 2024-06-13T02:31:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.363 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-06-13T02:31:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-06-13T02:31:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.364 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.365 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl_server_port": { 2024-06-13T02:31:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl_server_port", 2024-06-13T02:31:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8443", 2024-06-13T02:31:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.366 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-06-13T02:31:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-06-13T02:31:12.367 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "redirect", 2024-06-13T02:31:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: "redirect" 2024-06-13T02:31:12.368 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-06-13T02:31:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-06-13T02:31:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.369 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-06-13T02:31:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-06-13T02:31:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-06-13T02:31:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.370 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: "url_prefix": { 2024-06-13T02:31:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url_prefix", 2024-06-13T02:31:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.371 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.372 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-06-13T02:31:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_monitoring": { 2024-06-13T02:31:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_monitoring", 2024-06-13T02:31:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.373 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "monitor device health metrics", 2024-06-13T02:31:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.374 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.375 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.376 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.377 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.378 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.379 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.380 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.381 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.382 INFO:teuthology.orchestra.run.smithi002.stdout: "mark_out_threshold": { 2024-06-13T02:31:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mark_out_threshold", 2024-06-13T02:31:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "2419200", 2024-06-13T02:31:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.383 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-13T02:31:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: "pool_name": { 2024-06-13T02:31:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pool_name", 2024-06-13T02:31:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.384 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "device_health_metrics", 2024-06-13T02:31:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-13T02:31:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.385 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "retention_period": { 2024-06-13T02:31:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "retention_period", 2024-06-13T02:31:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15552000", 2024-06-13T02:31:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.386 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long to retain device health metrics", 2024-06-13T02:31:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_frequency": { 2024-06-13T02:31:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_frequency", 2024-06-13T02:31:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.387 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-06-13T02:31:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-13T02:31:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.388 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "self_heal": { 2024-06-13T02:31:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "self_heal", 2024-06-13T02:31:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.389 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-13T02:31:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T02:31:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T02:31:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.390 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T02:31:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how frequently to wake up and check device health", 2024-06-13T02:31:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.391 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: "warn_threshold": { 2024-06-13T02:31:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "warn_threshold", 2024-06-13T02:31:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7257600", 2024-06-13T02:31:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.392 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-13T02:31:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.393 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "diskprediction_local", 2024-06-13T02:31:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.394 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.395 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.396 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.397 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.398 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.399 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.400 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.401 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: "predict_interval": { 2024-06-13T02:31:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predict_interval", 2024-06-13T02:31:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "86400", 2024-06-13T02:31:12.402 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "predictor_model": { 2024-06-13T02:31:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "predictor_model", 2024-06-13T02:31:12.403 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "prophetstor", 2024-06-13T02:31:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.404 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T02:31:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T02:31:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "600", 2024-06-13T02:31:12.405 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.406 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "influx", 2024-06-13T02:31:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": false, 2024-06-13T02:31:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "influxdb python module not found", 2024-06-13T02:31:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: "batch_size": { 2024-06-13T02:31:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "batch_size", 2024-06-13T02:31:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.407 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5000", 2024-06-13T02:31:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-13T02:31:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.408 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "database": { 2024-06-13T02:31:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "database", 2024-06-13T02:31:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "ceph", 2024-06-13T02:31:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.409 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-13T02:31:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": { 2024-06-13T02:31:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "hostname", 2024-06-13T02:31:12.410 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server hostname", 2024-06-13T02:31:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.411 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T02:31:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T02:31:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "30", 2024-06-13T02:31:12.412 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "5", 2024-06-13T02:31:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-13T02:31:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.413 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.414 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.415 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.415 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.415 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.415 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.415 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.415 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.415 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.415 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.416 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.417 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.419 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.419 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.419 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.421 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.421 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.421 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.422 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.423 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "password": { 2024-06-13T02:31:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "password", 2024-06-13T02:31:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.424 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "password of InfluxDB server user", 2024-06-13T02:31:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "port": { 2024-06-13T02:31:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "port", 2024-06-13T02:31:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.425 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "8086", 2024-06-13T02:31:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "InfluxDB server port", 2024-06-13T02:31:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.426 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: "ssl": { 2024-06-13T02:31:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ssl", 2024-06-13T02:31:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "false", 2024-06-13T02:31:12.427 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-13T02:31:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "threads": { 2024-06-13T02:31:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threads", 2024-06-13T02:31:12.428 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T02:31:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T02:31:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "32", 2024-06-13T02:31:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-13T02:31:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.429 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "username": { 2024-06-13T02:31:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "username", 2024-06-13T02:31:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.430 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "username of InfluxDB server user", 2024-06-13T02:31:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "verify_ssl": { 2024-06-13T02:31:12.431 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "verify_ssl", 2024-06-13T02:31:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "true", 2024-06-13T02:31:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.432 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-13T02:31:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "insights", 2024-06-13T02:31:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.433 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.434 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.435 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.436 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.437 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.438 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.439 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.440 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.441 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "iostat", 2024-06-13T02:31:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.442 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.443 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.444 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.445 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.446 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.447 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.448 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.449 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.450 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "k8sevents", 2024-06-13T02:31:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_event_retention_days": { 2024-06-13T02:31:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "ceph_event_retention_days", 2024-06-13T02:31:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.451 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "7", 2024-06-13T02:31:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-13T02:31:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.452 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: "config_check_secs": { 2024-06-13T02:31:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "config_check_secs", 2024-06-13T02:31:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "10", 2024-06-13T02:31:12.453 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-13T02:31:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.454 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.455 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.456 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.457 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.458 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.459 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.460 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.461 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.462 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "localpool", 2024-06-13T02:31:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "failure_domain": { 2024-06-13T02:31:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "failure_domain", 2024-06-13T02:31:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.463 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "host", 2024-06-13T02:31:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "failure domain for any created local pool", 2024-06-13T02:31:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-13T02:31:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.464 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.465 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.466 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.467 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.468 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.469 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.470 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.471 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "min_size": { 2024-06-13T02:31:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "min_size", 2024-06-13T02:31:12.472 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default min_size for any created local pool", 2024-06-13T02:31:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-13T02:31:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.473 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: "num_rep": { 2024-06-13T02:31:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "num_rep", 2024-06-13T02:31:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3", 2024-06-13T02:31:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default replica count for any created local pool", 2024-06-13T02:31:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_num": { 2024-06-13T02:31:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_num", 2024-06-13T02:31:12.475 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "128", 2024-06-13T02:31:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "default pg_num for any created local pool", 2024-06-13T02:31:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.476 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "prefix": { 2024-06-13T02:31:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prefix", 2024-06-13T02:31:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.477 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "name prefix for any created local pool", 2024-06-13T02:31:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.478 INFO:teuthology.orchestra.run.smithi002.stdout: "subtree": { 2024-06-13T02:31:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "subtree", 2024-06-13T02:31:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "rack", 2024-06-13T02:31:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-13T02:31:12.479 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-13T02:31:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mds_autoscaler", 2024-06-13T02:31:12.480 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.481 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.482 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.483 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.484 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.485 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.486 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.487 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.488 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirroring", 2024-06-13T02:31:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.489 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.491 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.492 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.493 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.494 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.495 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.496 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "nfs", 2024-06-13T02:31:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.497 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.498 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.499 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.500 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.501 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.502 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.503 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.504 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.505 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-06-13T02:31:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "fail_fs": { 2024-06-13T02:31:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "fail_fs", 2024-06-13T02:31:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.506 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-13T02:31:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.507 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.508 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.509 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.511 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.512 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.513 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.514 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.515 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator": { 2024-06-13T02:31:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "orchestrator", 2024-06-13T02:31:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.516 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "cephadm", 2024-06-13T02:31:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "rook", 2024-06-13T02:31:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "test_orchestrator" 2024-06-13T02:31:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Orchestrator backend", 2024-06-13T02:31:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.517 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_perf_query", 2024-06-13T02:31:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.518 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.519 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.520 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.521 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.522 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.523 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.524 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.525 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.526 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "osd_support", 2024-06-13T02:31:12.527 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.527 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.527 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.527 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.527 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.527 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.527 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.527 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.528 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.529 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.530 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.531 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.532 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.534 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "pg_autoscaler", 2024-06-13T02:31:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.535 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.536 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.537 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.538 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.539 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.540 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.541 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.542 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.543 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T02:31:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T02:31:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T02:31:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.544 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: "threshold": { 2024-06-13T02:31:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "threshold", 2024-06-13T02:31:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:12.545 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "3.0", 2024-06-13T02:31:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1.0", 2024-06-13T02:31:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "scaling threshold", 2024-06-13T02:31:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-13T02:31:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.546 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "progress", 2024-06-13T02:31:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.547 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_pg_recovery_event": { 2024-06-13T02:31:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_pg_recovery_event", 2024-06-13T02:31:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.548 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-13T02:31:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-06-13T02:31:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-06-13T02:31:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.549 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.550 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.551 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.553 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.554 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.555 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.556 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.557 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "max_completed_events": { 2024-06-13T02:31:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_completed_events", 2024-06-13T02:31:12.558 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "50", 2024-06-13T02:31:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "number of past completed events to remember", 2024-06-13T02:31:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.559 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: "sleep_interval": { 2024-06-13T02:31:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "sleep_interval", 2024-06-13T02:31:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "5", 2024-06-13T02:31:12.560 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "how long the module is going to sleep", 2024-06-13T02:31:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.561 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "prometheus", 2024-06-13T02:31:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "cache": { 2024-06-13T02:31:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cache", 2024-06-13T02:31:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.562 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.563 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.563 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.563 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.563 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.563 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.563 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.563 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "exclude_perf_counters": { 2024-06-13T02:31:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "exclude_perf_counters", 2024-06-13T02:31:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.564 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-13T02:31:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-13T02:31:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.565 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.566 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.567 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.568 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.569 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.569 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.569 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.569 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.569 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.569 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.569 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.569 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.569 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.570 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.571 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.572 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools": { 2024-06-13T02:31:12.573 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools", 2024-06-13T02:31:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.574 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-13T02:31:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-13T02:31:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.575 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "300", 2024-06-13T02:31:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.576 INFO:teuthology.orchestra.run.smithi002.stdout: "scrape_interval": { 2024-06-13T02:31:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "scrape_interval", 2024-06-13T02:31:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15.0", 2024-06-13T02:31:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.577 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T02:31:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T02:31:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.578 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "::", 2024-06-13T02:31:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-13T02:31:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.579 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T02:31:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T02:31:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "9283", 2024-06-13T02:31:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.580 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-13T02:31:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: "stale_cache_strategy": { 2024-06-13T02:31:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stale_cache_strategy", 2024-06-13T02:31:12.581 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "log", 2024-06-13T02:31:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.582 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_behaviour": { 2024-06-13T02:31:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_behaviour", 2024-06-13T02:31:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "default", 2024-06-13T02:31:12.583 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: "default", 2024-06-13T02:31:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: "error" 2024-06-13T02:31:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.584 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "standby_error_status_code": { 2024-06-13T02:31:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "standby_error_status_code", 2024-06-13T02:31:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "500", 2024-06-13T02:31:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "400", 2024-06-13T02:31:12.585 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "599", 2024-06-13T02:31:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.586 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-06-13T02:31:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.587 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.588 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.589 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.590 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.591 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.592 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.593 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.594 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_snap_create": { 2024-06-13T02:31:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_snap_create", 2024-06-13T02:31:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10", 2024-06-13T02:31:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.596 INFO:teuthology.orchestra.run.smithi002.stdout: "mirror_snapshot_schedule": { 2024-06-13T02:31:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "mirror_snapshot_schedule", 2024-06-13T02:31:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.597 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: "trash_purge_schedule": { 2024-06-13T02:31:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "trash_purge_schedule", 2024-06-13T02:31:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.598 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.599 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "restful", 2024-06-13T02:31:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: "enable_auth": { 2024-06-13T02:31:12.600 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enable_auth", 2024-06-13T02:31:12.601 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.601 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.601 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.601 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.601 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.601 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.601 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.601 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.601 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: "key_file": { 2024-06-13T02:31:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "key_file", 2024-06-13T02:31:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.602 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.603 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.604 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.605 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.606 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.607 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.608 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.609 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.610 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "server_addr": { 2024-06-13T02:31:12.611 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_addr", 2024-06-13T02:31:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.612 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "server_port": { 2024-06-13T02:31:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "server_port", 2024-06-13T02:31:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.613 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.614 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rgw", 2024-06-13T02:31:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.615 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.616 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.617 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.618 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.619 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.620 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.621 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.622 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rook", 2024-06-13T02:31:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.624 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.625 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.626 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.627 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.628 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.630 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.631 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: "storage_class": { 2024-06-13T02:31:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "storage_class", 2024-06-13T02:31:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "local", 2024-06-13T02:31:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.632 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-13T02:31:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.633 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "selftest", 2024-06-13T02:31:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.634 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.635 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.637 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.638 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.638 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.638 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.638 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.638 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.638 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.638 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.638 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.639 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.640 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.641 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: "roption1": { 2024-06-13T02:31:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption1", 2024-06-13T02:31:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.642 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.643 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "roption2": { 2024-06-13T02:31:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "roption2", 2024-06-13T02:31:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "xyz", 2024-06-13T02:31:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.644 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption1": { 2024-06-13T02:31:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption1", 2024-06-13T02:31:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.645 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.646 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption2": { 2024-06-13T02:31:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption2", 2024-06-13T02:31:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.647 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption3": { 2024-06-13T02:31:12.648 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption3", 2024-06-13T02:31:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "float", 2024-06-13T02:31:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.649 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption4": { 2024-06-13T02:31:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption4", 2024-06-13T02:31:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.650 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.651 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption5": { 2024-06-13T02:31:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption5", 2024-06-13T02:31:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.652 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption6": { 2024-06-13T02:31:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption6", 2024-06-13T02:31:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.653 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.654 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "rwoption7": { 2024-06-13T02:31:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rwoption7", 2024-06-13T02:31:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "1", 2024-06-13T02:31:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "42", 2024-06-13T02:31:12.655 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: "testkey": { 2024-06-13T02:31:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testkey", 2024-06-13T02:31:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.656 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.657 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "testlkey": { 2024-06-13T02:31:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testlkey", 2024-06-13T02:31:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.658 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "testnewline": { 2024-06-13T02:31:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "testnewline", 2024-06-13T02:31:12.659 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.660 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.661 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.661 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.661 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.661 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.661 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.661 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-06-13T02:31:12.661 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.661 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.662 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.662 INFO:teuthology.orchestra.run.smithi002.stdout: "allow_m_granularity": { 2024-06-13T02:31:12.662 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "allow_m_granularity", 2024-06-13T02:31:12.662 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.662 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.662 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.662 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.662 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "allow minute scheduled snapshots", 2024-06-13T02:31:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "dump_on_update": { 2024-06-13T02:31:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "dump_on_update", 2024-06-13T02:31:12.663 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "dump database to debug log on update", 2024-06-13T02:31:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.664 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.665 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.666 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.667 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.668 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.669 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.670 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.671 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.672 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "stats", 2024-06-13T02:31:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.673 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.674 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.675 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.677 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.678 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.679 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.680 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.681 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "status", 2024-06-13T02:31:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.682 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.683 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.684 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.685 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.686 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.687 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.688 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.689 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telegraf", 2024-06-13T02:31:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.690 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: "address": { 2024-06-13T02:31:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "address", 2024-06-13T02:31:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-13T02:31:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.691 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T02:31:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T02:31:12.692 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "15", 2024-06-13T02:31:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "telemetry", 2024-06-13T02:31:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_basic": { 2024-06-13T02:31:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_basic", 2024-06-13T02:31:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-13T02:31:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_crash": { 2024-06-13T02:31:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_crash", 2024-06-13T02:31:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-13T02:31:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_device": { 2024-06-13T02:31:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_device", 2024-06-13T02:31:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.706 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-13T02:31:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_ident": { 2024-06-13T02:31:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_ident", 2024-06-13T02:31:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.707 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-13T02:31:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.708 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "channel_perf": { 2024-06-13T02:31:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "channel_perf", 2024-06-13T02:31:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.709 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-13T02:31:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: "contact": { 2024-06-13T02:31:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "contact", 2024-06-13T02:31:12.710 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.711 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "description": { 2024-06-13T02:31:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "description", 2024-06-13T02:31:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.712 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "device_url": { 2024-06-13T02:31:12.713 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "device_url", 2024-06-13T02:31:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-13T02:31:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.714 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": { 2024-06-13T02:31:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "enabled", 2024-06-13T02:31:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.715 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.716 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T02:31:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T02:31:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "24", 2024-06-13T02:31:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "8", 2024-06-13T02:31:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.717 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: "last_opt_revision": { 2024-06-13T02:31:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "last_opt_revision", 2024-06-13T02:31:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.718 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "1", 2024-06-13T02:31:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.719 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard": { 2024-06-13T02:31:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard", 2024-06-13T02:31:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.720 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: "leaderboard_description": { 2024-06-13T02:31:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "leaderboard_description", 2024-06-13T02:31:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.721 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.722 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.723 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.724 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.725 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.726 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.727 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.728 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.729 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.730 INFO:teuthology.orchestra.run.smithi002.stdout: "organization": { 2024-06-13T02:31:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "organization", 2024-06-13T02:31:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.731 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: "proxy": { 2024-06-13T02:31:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "proxy", 2024-06-13T02:31:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.732 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.733 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "url": { 2024-06-13T02:31:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "url", 2024-06-13T02:31:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-13T02:31:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.734 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.735 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "test_orchestrator", 2024-06-13T02:31:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.736 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.737 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.738 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.739 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.740 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.741 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.743 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.744 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-06-13T02:31:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.745 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.746 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.747 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.748 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.749 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.750 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.751 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.752 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "max_concurrent_clones": { 2024-06-13T02:31:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "max_concurrent_clones", 2024-06-13T02:31:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "4", 2024-06-13T02:31:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.753 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-13T02:31:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "periodic_async_work": { 2024-06-13T02:31:12.754 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "periodic_async_work", 2024-06-13T02:31:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Periodically check for async work", 2024-06-13T02:31:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.755 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_delay": { 2024-06-13T02:31:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_delay", 2024-06-13T02:31:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "0", 2024-06-13T02:31:12.756 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-13T02:31:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "snapshot_clone_no_wait": { 2024-06-13T02:31:12.757 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snapshot_clone_no_wait", 2024-06-13T02:31:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "True", 2024-06-13T02:31:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-13T02:31:12.758 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix", 2024-06-13T02:31:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: "can_run": true, 2024-06-13T02:31:12.759 INFO:teuthology.orchestra.run.smithi002.stdout: "error_string": "", 2024-06-13T02:31:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: "module_options": { 2024-06-13T02:31:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: "discovery_interval": { 2024-06-13T02:31:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "discovery_interval", 2024-06-13T02:31:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "uint", 2024-06-13T02:31:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "100", 2024-06-13T02:31:12.760 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: "identifier": { 2024-06-13T02:31:12.761 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "identifier", 2024-06-13T02:31:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.762 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: "interval": { 2024-06-13T02:31:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "interval", 2024-06-13T02:31:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "secs", 2024-06-13T02:31:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.763 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "60", 2024-06-13T02:31:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.764 INFO:teuthology.orchestra.run.smithi002.stdout: "log_level": { 2024-06-13T02:31:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_level", 2024-06-13T02:31:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.765 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.766 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster": { 2024-06-13T02:31:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster", 2024-06-13T02:31:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.767 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.768 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_cluster_level": { 2024-06-13T02:31:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_cluster_level", 2024-06-13T02:31:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "info", 2024-06-13T02:31:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [ 2024-06-13T02:31:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "", 2024-06-13T02:31:12.769 INFO:teuthology.orchestra.run.smithi002.stdout: "critical", 2024-06-13T02:31:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: "debug", 2024-06-13T02:31:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: "error", 2024-06-13T02:31:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: "info", 2024-06-13T02:31:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: "warning" 2024-06-13T02:31:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.770 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "log_to_file": { 2024-06-13T02:31:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "log_to_file", 2024-06-13T02:31:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "bool", 2024-06-13T02:31:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 1, 2024-06-13T02:31:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "False", 2024-06-13T02:31:12.771 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_host": { 2024-06-13T02:31:12.772 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_host", 2024-06-13T02:31:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "", 2024-06-13T02:31:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.773 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_port": { 2024-06-13T02:31:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_port", 2024-06-13T02:31:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "int", 2024-06-13T02:31:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.774 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "10051", 2024-06-13T02:31:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.775 INFO:teuthology.orchestra.run.smithi002.stdout: "zabbix_sender": { 2024-06-13T02:31:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "zabbix_sender", 2024-06-13T02:31:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "str", 2024-06-13T02:31:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "level": "advanced", 2024-06-13T02:31:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "flags": 0, 2024-06-13T02:31:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-13T02:31:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "min": "", 2024-06-13T02:31:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "max": "", 2024-06-13T02:31:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "enum_allowed": [], 2024-06-13T02:31:12.776 INFO:teuthology.orchestra.run.smithi002.stdout: "desc": "", 2024-06-13T02:31:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: "long_desc": "", 2024-06-13T02:31:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-06-13T02:31:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: "see_also": [] 2024-06-13T02:31:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: "services": { 2024-06-13T02:31:12.777 INFO:teuthology.orchestra.run.smithi002.stdout: "dashboard": "https://172.21.15.2:8443/" 2024-06-13T02:31:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: "always_on_modules": { 2024-06-13T02:31:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: "octopus": [ 2024-06-13T02:31:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-06-13T02:31:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-06-13T02:31:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-06-13T02:31:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-06-13T02:31:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-06-13T02:31:12.778 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-06-13T02:31:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-06-13T02:31:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-06-13T02:31:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-06-13T02:31:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-06-13T02:31:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: "pacific": [ 2024-06-13T02:31:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-06-13T02:31:12.779 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-06-13T02:31:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-06-13T02:31:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-06-13T02:31:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-06-13T02:31:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-06-13T02:31:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-06-13T02:31:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-06-13T02:31:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-06-13T02:31:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-06-13T02:31:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.780 INFO:teuthology.orchestra.run.smithi002.stdout: "quincy": [ 2024-06-13T02:31:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-06-13T02:31:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-06-13T02:31:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-06-13T02:31:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-06-13T02:31:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-06-13T02:31:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-06-13T02:31:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-06-13T02:31:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-06-13T02:31:12.781 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-06-13T02:31:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-06-13T02:31:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: "reef": [ 2024-06-13T02:31:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-06-13T02:31:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-06-13T02:31:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-06-13T02:31:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-06-13T02:31:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-06-13T02:31:12.782 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-06-13T02:31:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-06-13T02:31:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-06-13T02:31:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-06-13T02:31:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-06-13T02:31:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-06-13T02:31:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "squid": [ 2024-06-13T02:31:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "balancer", 2024-06-13T02:31:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "crash", 2024-06-13T02:31:12.783 INFO:teuthology.orchestra.run.smithi002.stdout: "devicehealth", 2024-06-13T02:31:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: "orchestrator", 2024-06-13T02:31:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: "pg_autoscaler", 2024-06-13T02:31:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: "progress", 2024-06-13T02:31:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: "rbd_support", 2024-06-13T02:31:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: "status", 2024-06-13T02:31:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: "telemetry", 2024-06-13T02:31:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: "volumes" 2024-06-13T02:31:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T02:31:12.784 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: "last_failure_osd_epoch": 101, 2024-06-13T02:31:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: "active_clients": [ 2024-06-13T02:31:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "devicehealth", 2024-06-13T02:31:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-06-13T02:31:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-06-13T02:31:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-06-13T02:31:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2207516639 2024-06-13T02:31:12.785 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T02:31:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "libcephsqlite", 2024-06-13T02:31:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-06-13T02:31:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-06-13T02:31:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-06-13T02:31:12.786 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2103424516 2024-06-13T02:31:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T02:31:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "rbd_support", 2024-06-13T02:31:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-06-13T02:31:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-06-13T02:31:12.787 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-06-13T02:31:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2869736936 2024-06-13T02:31:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T02:31:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-06-13T02:31:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-06-13T02:31:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-06-13T02:31:12.788 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-06-13T02:31:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3237552775 2024-06-13T02:31:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T02:31:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "snap_schedule", 2024-06-13T02:31:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-06-13T02:31:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.789 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-06-13T02:31:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-06-13T02:31:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 1862689507 2024-06-13T02:31:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T02:31:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "volumes", 2024-06-13T02:31:12.790 INFO:teuthology.orchestra.run.smithi002.stdout: "addrvec": [ 2024-06-13T02:31:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-06-13T02:31:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v2", 2024-06-13T02:31:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-06-13T02:31:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 928602475 2024-06-13T02:31:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T02:31:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:12.791 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-06-13T02:31:12.791 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T02:31:12.798 DEBUG:tasks.check_counter:Getting stats from a 2024-06-13T02:31:12.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph daemon mds.a perf dump 2024-06-13T02:31:12.798 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:11 smithi002 ceph-mon[31960]: pgmap v422: 129 pgs: 20 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 55 active+clean; 280 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 24 MiB/s wr, 349 op/s 2024-06-13T02:31:12.798 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:11 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1574170231' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-13T02:31:13.274 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:31:13.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:13 smithi175 ceph-mon[36977]: pgmap v423: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 20 MiB/s wr, 151 op/s 2024-06-13T02:31:13.598 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:13 smithi002 ceph-mon[31960]: pgmap v423: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 20 MiB/s wr, 151 op/s 2024-06-13T02:31:13.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:13 smithi084 ceph-mon[36833]: pgmap v423: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 20 MiB/s wr, 151 op/s 2024-06-13T02:31:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:14 smithi175 ceph-mon[36977]: osdmap e121: 12 total, 12 up, 12 in 2024-06-13T02:31:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:14 smithi175 ceph-mon[36977]: pgmap v425: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 23 MiB/s wr, 171 op/s 2024-06-13T02:31:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:14 smithi002 ceph-mon[31960]: osdmap e121: 12 total, 12 up, 12 in 2024-06-13T02:31:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:14 smithi002 ceph-mon[31960]: pgmap v425: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 23 MiB/s wr, 171 op/s 2024-06-13T02:31:15.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:14 smithi084 ceph-mon[36833]: osdmap e121: 12 total, 12 up, 12 in 2024-06-13T02:31:15.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:14 smithi084 ceph-mon[36833]: pgmap v425: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 23 MiB/s wr, 171 op/s 2024-06-13T02:31:15.820 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T02:31:15.821 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T02:31:15.821 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-06-13T02:31:15.821 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-06-13T02:31:15.821 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-06-13T02:31:15.821 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-06-13T02:31:15.821 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-06-13T02:31:15.821 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-06-13T02:31:15.821 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.004248742, 2024-06-13T02:31:15.822 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-06-13T02:31:15.822 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000714708, 2024-06-13T02:31:15.822 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T02:31:15.822 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:15.822 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:15.822 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:15.822 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:15.822 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:15.822 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:15.823 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:15.823 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:15.823 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:15.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:15.823 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-13T02:31:15.823 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-06-13T02:31:15.823 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:15.823 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T02:31:15.823 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 314, 2024-06-13T02:31:15.824 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 303, 2024-06-13T02:31:15.824 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1607360, 2024-06-13T02:31:15.824 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 187264, 2024-06-13T02:31:15.824 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-06-13T02:31:15.824 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-06-13T02:31:15.824 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.136522202, 2024-06-13T02:31:15.824 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.049612004, 2024-06-13T02:31:15.824 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.095353559, 2024-06-13T02:31:15.824 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.014690580, 2024-06-13T02:31:15.825 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:15.825 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 302, 2024-06-13T02:31:15.825 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.032051694, 2024-06-13T02:31:15.825 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000106131 2024-06-13T02:31:15.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:15.825 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:15.825 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:15.825 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:15.825 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:15.825 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:15.826 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1607360, 2024-06-13T02:31:15.826 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 187264 2024-06-13T02:31:15.826 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:15.826 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T02:31:15.826 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 6, 2024-06-13T02:31:15.826 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 234, 2024-06-13T02:31:15.826 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 3344, 2024-06-13T02:31:15.826 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 197104, 2024-06-13T02:31:15.826 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-06-13T02:31:15.827 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-06-13T02:31:15.827 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.047634897, 2024-06-13T02:31:15.827 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.036625444, 2024-06-13T02:31:15.827 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.004075943, 2024-06-13T02:31:15.827 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T02:31:15.827 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:15.827 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 232, 2024-06-13T02:31:15.827 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.048045347, 2024-06-13T02:31:15.827 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000207092 2024-06-13T02:31:15.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:15.828 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:15.828 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:15.828 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:15.828 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:15.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:15.828 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-06-13T02:31:15.828 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 197104 2024-06-13T02:31:15.828 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:15.829 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-06-13T02:31:15.829 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-06-13T02:31:15.829 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-06-13T02:31:15.829 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:15.829 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-06-13T02:31:15.829 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-06-13T02:31:15.829 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-06-13T02:31:15.829 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T02:31:15.829 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-06-13T02:31:15.829 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T02:31:15.830 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-06-13T02:31:15.830 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T02:31:15.830 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T02:31:15.830 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T02:31:15.830 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T02:31:15.830 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T02:31:15.830 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-06-13T02:31:15.830 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T02:31:15.830 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T02:31:15.831 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-06-13T02:31:15.831 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-06-13T02:31:15.831 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-06-13T02:31:15.831 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-06-13T02:31:15.831 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T02:31:15.831 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T02:31:15.831 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T02:31:15.831 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T02:31:15.831 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T02:31:15.832 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-06-13T02:31:15.832 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-06-13T02:31:15.832 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-06-13T02:31:15.832 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T02:31:15.832 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T02:31:15.832 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-06-13T02:31:15.832 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-06-13T02:31:15.832 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-06-13T02:31:15.832 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-06-13T02:31:15.833 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T02:31:15.833 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-06-13T02:31:15.833 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T02:31:15.833 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-06-13T02:31:15.833 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 150776, 2024-06-13T02:31:15.833 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 32, 2024-06-13T02:31:15.833 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-06-13T02:31:15.833 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-06-13T02:31:15.833 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-06-13T02:31:15.834 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-06-13T02:31:15.834 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-06-13T02:31:15.834 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-06-13T02:31:15.834 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-06-13T02:31:15.834 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-06-13T02:31:15.834 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-06-13T02:31:15.834 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-06-13T02:31:15.834 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T02:31:15.835 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-06-13T02:31:15.835 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-06-13T02:31:15.835 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-06-13T02:31:15.835 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-06-13T02:31:15.835 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-06-13T02:31:15.835 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-06-13T02:31:15.835 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-06-13T02:31:15.835 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-06-13T02:31:15.835 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-06-13T02:31:15.836 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:15.836 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T02:31:15.836 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-06-13T02:31:15.836 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-06-13T02:31:15.836 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-06-13T02:31:15.836 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 316, 2024-06-13T02:31:15.836 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1563048, 2024-06-13T02:31:15.836 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:15.836 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 316, 2024-06-13T02:31:15.837 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-06-13T02:31:15.837 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-06-13T02:31:15.837 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 316, 2024-06-13T02:31:15.837 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1563048, 2024-06-13T02:31:15.837 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-06-13T02:31:15.837 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:15.837 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:15.837 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:15.837 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:15.838 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:15.838 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T02:31:16.612 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-06-13T02:31:16.613 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-06-13T02:31:16.613 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-06-13T02:31:16.613 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-06-13T02:31:16.613 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-06-13T02:31:16.613 DEBUG:tasks.check_counter:Getting stats from d 2024-06-13T02:31:16.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph daemon mds.d perf dump 2024-06-13T02:31:17.106 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:31:17.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:17 smithi002 ceph-mon[31960]: pgmap v426: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 6.3 MiB/s wr, 76 op/s 2024-06-13T02:31:17.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:17 smithi084 ceph-mon[36833]: pgmap v426: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 6.3 MiB/s wr, 76 op/s 2024-06-13T02:31:17.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:17 smithi175 ceph-mon[36977]: pgmap v426: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 6.3 MiB/s wr, 76 op/s 2024-06-13T02:31:19.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:19 smithi002 ceph-mon[31960]: pgmap v427: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 92 KiB/s wr, 26 op/s 2024-06-13T02:31:19.409 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T02:31:19.409 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T02:31:19.409 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 0, 2024-06-13T02:31:19.409 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 2, 2024-06-13T02:31:19.409 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 0, 2024-06-13T02:31:19.410 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 0, 2024-06-13T02:31:19.410 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-06-13T02:31:19.410 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-06-13T02:31:19.410 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.004400635, 2024-06-13T02:31:19.410 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000000000, 2024-06-13T02:31:19.410 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.000719032, 2024-06-13T02:31:19.410 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T02:31:19.410 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:19.411 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:19.411 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:19.411 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:19.411 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:19.411 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:19.411 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:19.411 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:19.412 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:19.412 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:19.412 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-13T02:31:19.412 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 0 2024-06-13T02:31:19.412 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:19.412 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T02:31:19.412 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 321, 2024-06-13T02:31:19.412 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 310, 2024-06-13T02:31:19.413 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1609264, 2024-06-13T02:31:19.413 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 191744, 2024-06-13T02:31:19.413 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-06-13T02:31:19.413 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-06-13T02:31:19.413 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.141585909, 2024-06-13T02:31:19.413 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.052778809, 2024-06-13T02:31:19.413 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.097493350, 2024-06-13T02:31:19.413 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.015802408, 2024-06-13T02:31:19.414 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:19.414 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 309, 2024-06-13T02:31:19.414 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.035025309, 2024-06-13T02:31:19.414 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000113350 2024-06-13T02:31:19.414 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:19.414 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:19.414 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:19.415 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:19.415 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:19.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:19.415 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1609264, 2024-06-13T02:31:19.415 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 191744 2024-06-13T02:31:19.415 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:19.415 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T02:31:19.415 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 6, 2024-06-13T02:31:19.416 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 239, 2024-06-13T02:31:19.416 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 3344, 2024-06-13T02:31:19.416 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 197984, 2024-06-13T02:31:19.416 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-06-13T02:31:19.416 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-06-13T02:31:19.416 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.053302993, 2024-06-13T02:31:19.416 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.041850506, 2024-06-13T02:31:19.416 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.004279810, 2024-06-13T02:31:19.417 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T02:31:19.417 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:19.417 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 237, 2024-06-13T02:31:19.417 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.057577226, 2024-06-13T02:31:19.417 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000242941 2024-06-13T02:31:19.417 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:19.418 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:19.418 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:19.418 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:19.418 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:19.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:19.418 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-06-13T02:31:19.418 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 197984 2024-06-13T02:31:19.418 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:19.419 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-06-13T02:31:19.419 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-06-13T02:31:19.419 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-06-13T02:31:19.419 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:19.419 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-06-13T02:31:19.419 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-06-13T02:31:19.419 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-06-13T02:31:19.419 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T02:31:19.420 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-06-13T02:31:19.420 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T02:31:19.420 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-06-13T02:31:19.420 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T02:31:19.420 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T02:31:19.420 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T02:31:19.420 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T02:31:19.420 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T02:31:19.421 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-06-13T02:31:19.421 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T02:31:19.421 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T02:31:19.421 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-06-13T02:31:19.421 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-06-13T02:31:19.421 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-06-13T02:31:19.421 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-06-13T02:31:19.421 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T02:31:19.422 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T02:31:19.422 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T02:31:19.422 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T02:31:19.422 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T02:31:19.422 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-06-13T02:31:19.422 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-06-13T02:31:19.422 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-06-13T02:31:19.423 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T02:31:19.423 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T02:31:19.423 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-06-13T02:31:19.423 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-06-13T02:31:19.423 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-06-13T02:31:19.423 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-06-13T02:31:19.423 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T02:31:19.424 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-06-13T02:31:19.424 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T02:31:19.424 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-06-13T02:31:19.424 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 148714, 2024-06-13T02:31:19.424 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 30, 2024-06-13T02:31:19.424 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-06-13T02:31:19.424 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-06-13T02:31:19.424 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-06-13T02:31:19.425 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-06-13T02:31:19.425 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-06-13T02:31:19.425 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-06-13T02:31:19.425 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-06-13T02:31:19.425 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-06-13T02:31:19.425 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-06-13T02:31:19.425 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-06-13T02:31:19.425 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T02:31:19.426 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-06-13T02:31:19.426 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-06-13T02:31:19.426 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-06-13T02:31:19.426 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-06-13T02:31:19.426 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-06-13T02:31:19.426 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-06-13T02:31:19.426 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-06-13T02:31:19.427 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-06-13T02:31:19.427 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-06-13T02:31:19.427 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:19.427 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T02:31:19.427 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-06-13T02:31:19.427 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-06-13T02:31:19.427 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-06-13T02:31:19.427 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 323, 2024-06-13T02:31:19.428 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1563958, 2024-06-13T02:31:19.428 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:19.428 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 323, 2024-06-13T02:31:19.428 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-06-13T02:31:19.428 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-06-13T02:31:19.428 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 323, 2024-06-13T02:31:19.428 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1563958, 2024-06-13T02:31:19.428 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-06-13T02:31:19.429 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:19.429 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:19.429 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:19.429 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:19.429 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:19.429 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T02:31:19.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:19 smithi084 ceph-mon[36833]: pgmap v427: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 92 KiB/s wr, 26 op/s 2024-06-13T02:31:19.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:19 smithi175 ceph-mon[36977]: pgmap v427: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 92 KiB/s wr, 26 op/s 2024-06-13T02:31:20.243 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-06-13T02:31:20.244 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-06-13T02:31:20.244 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-06-13T02:31:20.244 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-06-13T02:31:20.244 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-06-13T02:31:20.244 DEBUG:tasks.check_counter:Getting stats from g 2024-06-13T02:31:20.244 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph daemon mds.g perf dump 2024-06-13T02:31:20.722 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:31:21.123 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:21 smithi002 ceph-mon[31960]: pgmap v428: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 92 KiB/s wr, 26 op/s 2024-06-13T02:31:21.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:21 smithi084 ceph-mon[36833]: pgmap v428: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 92 KiB/s wr, 26 op/s 2024-06-13T02:31:21.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:21 smithi175 ceph-mon[36977]: pgmap v428: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 92 KiB/s wr, 26 op/s 2024-06-13T02:31:23.098 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T02:31:23.098 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T02:31:23.099 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 474, 2024-06-13T02:31:23.099 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 607, 2024-06-13T02:31:23.099 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1737783, 2024-06-13T02:31:23.099 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 1163096, 2024-06-13T02:31:23.099 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 9, 2024-06-13T02:31:23.099 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 5, 2024-06-13T02:31:23.099 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.202443309, 2024-06-13T02:31:23.099 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.073833429, 2024-06-13T02:31:23.100 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.145034781, 2024-06-13T02:31:23.100 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.021286458, 2024-06-13T02:31:23.100 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:23.100 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 605, 2024-06-13T02:31:23.100 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.130316639, 2024-06-13T02:31:23.100 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000215399 2024-06-13T02:31:23.100 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.100 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:23.100 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.101 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.101 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.101 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1718640, 2024-06-13T02:31:23.101 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 579040 2024-06-13T02:31:23.101 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.101 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T02:31:23.101 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 139740, 2024-06-13T02:31:23.101 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 69887, 2024-06-13T02:31:23.102 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 80245305, 2024-06-13T02:31:23.102 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 11702383, 2024-06-13T02:31:23.102 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 14, 2024-06-13T02:31:23.102 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 5, 2024-06-13T02:31:23.102 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 21.178336433, 2024-06-13T02:31:23.102 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 9.468475520, 2024-06-13T02:31:23.102 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 16.865514889, 2024-06-13T02:31:23.102 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.010088512, 2024-06-13T02:31:23.103 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:23.103 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 69886, 2024-06-13T02:31:23.103 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 5.176419539, 2024-06-13T02:31:23.103 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000074069 2024-06-13T02:31:23.103 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.103 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:23.103 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 209326, 2024-06-13T02:31:23.103 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.074714269, 2024-06-13T02:31:23.104 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000356 2024-06-13T02:31:23.104 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.104 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3600, 2024-06-13T02:31:23.104 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 174384 2024-06-13T02:31:23.104 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.104 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T02:31:23.104 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 4634, 2024-06-13T02:31:23.104 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 4876, 2024-06-13T02:31:23.105 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1614511, 2024-06-13T02:31:23.105 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 1157045, 2024-06-13T02:31:23.105 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 12, 2024-06-13T02:31:23.105 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 5, 2024-06-13T02:31:23.105 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 1.813191587, 2024-06-13T02:31:23.105 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 1.043049684, 2024-06-13T02:31:23.105 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 1.021780946, 2024-06-13T02:31:23.105 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000773857, 2024-06-13T02:31:23.105 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:23.106 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 4874, 2024-06-13T02:31:23.106 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.553174664, 2024-06-13T02:31:23.106 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000113495 2024-06-13T02:31:23.106 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.106 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:23.106 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 9279, 2024-06-13T02:31:23.106 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.005125441, 2024-06-13T02:31:23.107 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000552 2024-06-13T02:31:23.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.107 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1607920, 2024-06-13T02:31:23.107 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 1092640 2024-06-13T02:31:23.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.107 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-06-13T02:31:23.107 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 1, 2024-06-13T02:31:23.107 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-06-13T02:31:23.107 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.108 INFO:teuthology.orchestra.run.smithi002.stdout: "finisher-MDSRank": { 2024-06-13T02:31:23.108 INFO:teuthology.orchestra.run.smithi002.stdout: "queue_len": 0, 2024-06-13T02:31:23.108 INFO:teuthology.orchestra.run.smithi002.stdout: "complete_latency": { 2024-06-13T02:31:23.108 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 137, 2024-06-13T02:31:23.108 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.207720452, 2024-06-13T02:31:23.108 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.001516207 2024-06-13T02:31:23.108 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:23.108 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.109 INFO:teuthology.orchestra.run.smithi002.stdout: "finisher-PurgeQueue": { 2024-06-13T02:31:23.109 INFO:teuthology.orchestra.run.smithi002.stdout: "queue_len": 0, 2024-06-13T02:31:23.109 INFO:teuthology.orchestra.run.smithi002.stdout: "complete_latency": { 2024-06-13T02:31:23.109 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 23, 2024-06-13T02:31:23.109 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.001215340, 2024-06-13T02:31:23.109 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000052840 2024-06-13T02:31:23.109 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:23.109 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.110 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": { 2024-06-13T02:31:23.110 INFO:teuthology.orchestra.run.smithi002.stdout: "request": 4439, 2024-06-13T02:31:23.110 INFO:teuthology.orchestra.run.smithi002.stdout: "reply": 98, 2024-06-13T02:31:23.110 INFO:teuthology.orchestra.run.smithi002.stdout: "reply_latency": { 2024-06-13T02:31:23.110 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 98, 2024-06-13T02:31:23.110 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 2.734047097, 2024-06-13T02:31:23.110 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.027898439 2024-06-13T02:31:23.110 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.111 INFO:teuthology.orchestra.run.smithi002.stdout: "slow_reply": 0, 2024-06-13T02:31:23.111 INFO:teuthology.orchestra.run.smithi002.stdout: "forward": 4341, 2024-06-13T02:31:23.111 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_fetch_complete": 0, 2024-06-13T02:31:23.111 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_fetch_keys": 0, 2024-06-13T02:31:23.111 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_commit": 11, 2024-06-13T02:31:23.111 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_split": 0, 2024-06-13T02:31:23.111 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_merge": 0, 2024-06-13T02:31:23.111 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes": 190, 2024-06-13T02:31:23.111 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_top": 2, 2024-06-13T02:31:23.112 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_bottom": 188, 2024-06-13T02:31:23.112 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_pin_tail": 0, 2024-06-13T02:31:23.112 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_pinned": 188, 2024-06-13T02:31:23.112 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_expired": 0, 2024-06-13T02:31:23.112 INFO:teuthology.orchestra.run.smithi002.stdout: "inodes_with_caps": 83, 2024-06-13T02:31:23.112 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": 84, 2024-06-13T02:31:23.113 INFO:teuthology.orchestra.run.smithi002.stdout: "subtrees": 9, 2024-06-13T02:31:23.113 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse": 4488, 2024-06-13T02:31:23.113 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_hit": 97, 2024-06-13T02:31:23.113 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_forward": 4335, 2024-06-13T02:31:23.113 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_discover": 7, 2024-06-13T02:31:23.113 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_dir_fetch": 0, 2024-06-13T02:31:23.113 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_remote_ino": 0, 2024-06-13T02:31:23.113 INFO:teuthology.orchestra.run.smithi002.stdout: "traverse_lock": 1, 2024-06-13T02:31:23.114 INFO:teuthology.orchestra.run.smithi002.stdout: "load_cent": 0, 2024-06-13T02:31:23.114 INFO:teuthology.orchestra.run.smithi002.stdout: "q": 0, 2024-06-13T02:31:23.114 INFO:teuthology.orchestra.run.smithi002.stdout: "exported": 0, 2024-06-13T02:31:23.114 INFO:teuthology.orchestra.run.smithi002.stdout: "exported_inodes": 0, 2024-06-13T02:31:23.114 INFO:teuthology.orchestra.run.smithi002.stdout: "imported": 4, 2024-06-13T02:31:23.114 INFO:teuthology.orchestra.run.smithi002.stdout: "imported_inodes": 76, 2024-06-13T02:31:23.114 INFO:teuthology.orchestra.run.smithi002.stdout: "openino_dir_fetch": 0, 2024-06-13T02:31:23.114 INFO:teuthology.orchestra.run.smithi002.stdout: "openino_backtrace_fetch": 0, 2024-06-13T02:31:23.115 INFO:teuthology.orchestra.run.smithi002.stdout: "openino_peer_discover": 0, 2024-06-13T02:31:23.115 INFO:teuthology.orchestra.run.smithi002.stdout: "root_rfiles": 618, 2024-06-13T02:31:23.115 INFO:teuthology.orchestra.run.smithi002.stdout: "root_rbytes": 192884688, 2024-06-13T02:31:23.115 INFO:teuthology.orchestra.run.smithi002.stdout: "root_rsnaps": 6, 2024-06-13T02:31:23.115 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_backtrace_fetch": 0, 2024-06-13T02:31:23.115 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_set_tag": 0, 2024-06-13T02:31:23.115 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_backtrace_repaired": 0, 2024-06-13T02:31:23.115 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_inotable_repaired": 0, 2024-06-13T02:31:23.115 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_dir_inodes": 0, 2024-06-13T02:31:23.116 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_dir_base_inodes": 0, 2024-06-13T02:31:23.116 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_dirfrag_rstats": 0, 2024-06-13T02:31:23.116 INFO:teuthology.orchestra.run.smithi002.stdout: "scrub_file_inodes": 0, 2024-06-13T02:31:23.116 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_inode_file_caps": 0, 2024-06-13T02:31:23.116 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_cap_op_revoke": 23, 2024-06-13T02:31:23.116 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_cap_op_grant": 59, 2024-06-13T02:31:23.116 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_cap_op_trunc": 0, 2024-06-13T02:31:23.116 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-13T02:31:23.116 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-13T02:31:23.117 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_client_caps": 148, 2024-06-13T02:31:23.117 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_client_caps_dirty": 124, 2024-06-13T02:31:23.117 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_client_cap_release": 3, 2024-06-13T02:31:23.117 INFO:teuthology.orchestra.run.smithi002.stdout: "process_request_cap_release": 60 2024-06-13T02:31:23.117 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.117 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_cache": { 2024-06-13T02:31:23.117 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_update": 0, 2024-06-13T02:31:23.117 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_update_receipt": 6, 2024-06-13T02:31:23.117 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_try_discover": 4, 2024-06-13T02:31:23.118 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_send_discover": 12, 2024-06-13T02:31:23.118 INFO:teuthology.orchestra.run.smithi002.stdout: "dir_handle_discover": 1, 2024-06-13T02:31:23.118 INFO:teuthology.orchestra.run.smithi002.stdout: "num_strays": 11, 2024-06-13T02:31:23.118 INFO:teuthology.orchestra.run.smithi002.stdout: "num_strays_delayed": 0, 2024-06-13T02:31:23.118 INFO:teuthology.orchestra.run.smithi002.stdout: "num_strays_enqueuing": 0, 2024-06-13T02:31:23.118 INFO:teuthology.orchestra.run.smithi002.stdout: "strays_created": 13, 2024-06-13T02:31:23.118 INFO:teuthology.orchestra.run.smithi002.stdout: "strays_enqueued": 2, 2024-06-13T02:31:23.118 INFO:teuthology.orchestra.run.smithi002.stdout: "strays_reintegrated": 0, 2024-06-13T02:31:23.119 INFO:teuthology.orchestra.run.smithi002.stdout: "strays_migrated": 0, 2024-06-13T02:31:23.119 INFO:teuthology.orchestra.run.smithi002.stdout: "num_recovering_processing": 0, 2024-06-13T02:31:23.119 INFO:teuthology.orchestra.run.smithi002.stdout: "num_recovering_enqueued": 0, 2024-06-13T02:31:23.119 INFO:teuthology.orchestra.run.smithi002.stdout: "num_recovering_prioritized": 0, 2024-06-13T02:31:23.119 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_started": 0, 2024-06-13T02:31:23.119 INFO:teuthology.orchestra.run.smithi002.stdout: "recovery_completed": 0, 2024-06-13T02:31:23.119 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_quiesce_path": 0, 2024-06-13T02:31:23.119 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_quiesce_inode": 0, 2024-06-13T02:31:23.119 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_enqueue_scrub": 0, 2024-06-13T02:31:23.120 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_exportdir": 0, 2024-06-13T02:31:23.120 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_flush": 0, 2024-06-13T02:31:23.120 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_fragmentdir": 0, 2024-06-13T02:31:23.120 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_fragstats": 0, 2024-06-13T02:31:23.120 INFO:teuthology.orchestra.run.smithi002.stdout: "ireq_inodestats": 0 2024-06-13T02:31:23.120 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.120 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_log": { 2024-06-13T02:31:23.120 INFO:teuthology.orchestra.run.smithi002.stdout: "evlrg": 0, 2024-06-13T02:31:23.120 INFO:teuthology.orchestra.run.smithi002.stdout: "evadd": 226, 2024-06-13T02:31:23.121 INFO:teuthology.orchestra.run.smithi002.stdout: "evex": 0, 2024-06-13T02:31:23.121 INFO:teuthology.orchestra.run.smithi002.stdout: "evtrm": 0, 2024-06-13T02:31:23.121 INFO:teuthology.orchestra.run.smithi002.stdout: "ev": 226, 2024-06-13T02:31:23.121 INFO:teuthology.orchestra.run.smithi002.stdout: "evexg": 0, 2024-06-13T02:31:23.121 INFO:teuthology.orchestra.run.smithi002.stdout: "evexd": 0, 2024-06-13T02:31:23.121 INFO:teuthology.orchestra.run.smithi002.stdout: "segadd": 2, 2024-06-13T02:31:23.121 INFO:teuthology.orchestra.run.smithi002.stdout: "segex": 0, 2024-06-13T02:31:23.121 INFO:teuthology.orchestra.run.smithi002.stdout: "segtrm": 0, 2024-06-13T02:31:23.121 INFO:teuthology.orchestra.run.smithi002.stdout: "seg": 2, 2024-06-13T02:31:23.122 INFO:teuthology.orchestra.run.smithi002.stdout: "segmjr": 2, 2024-06-13T02:31:23.122 INFO:teuthology.orchestra.run.smithi002.stdout: "segexg": 0, 2024-06-13T02:31:23.122 INFO:teuthology.orchestra.run.smithi002.stdout: "segexd": 0, 2024-06-13T02:31:23.122 INFO:teuthology.orchestra.run.smithi002.stdout: "expos": 4194304, 2024-06-13T02:31:23.122 INFO:teuthology.orchestra.run.smithi002.stdout: "wrpos": 4913519, 2024-06-13T02:31:23.122 INFO:teuthology.orchestra.run.smithi002.stdout: "rdpos": 0, 2024-06-13T02:31:23.122 INFO:teuthology.orchestra.run.smithi002.stdout: "jlat": { 2024-06-13T02:31:23.122 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 48, 2024-06-13T02:31:23.122 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.249052926, 2024-06-13T02:31:23.123 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.005188602 2024-06-13T02:31:23.123 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.123 INFO:teuthology.orchestra.run.smithi002.stdout: "replayed": 0 2024-06-13T02:31:23.123 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.123 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_mem": { 2024-06-13T02:31:23.123 INFO:teuthology.orchestra.run.smithi002.stdout: "ino": 168, 2024-06-13T02:31:23.123 INFO:teuthology.orchestra.run.smithi002.stdout: "ino+": 169, 2024-06-13T02:31:23.123 INFO:teuthology.orchestra.run.smithi002.stdout: "ino-": 1, 2024-06-13T02:31:23.123 INFO:teuthology.orchestra.run.smithi002.stdout: "dir": 57, 2024-06-13T02:31:23.124 INFO:teuthology.orchestra.run.smithi002.stdout: "dir+": 60, 2024-06-13T02:31:23.124 INFO:teuthology.orchestra.run.smithi002.stdout: "dir-": 3, 2024-06-13T02:31:23.124 INFO:teuthology.orchestra.run.smithi002.stdout: "dn": 190, 2024-06-13T02:31:23.124 INFO:teuthology.orchestra.run.smithi002.stdout: "dn+": 210, 2024-06-13T02:31:23.124 INFO:teuthology.orchestra.run.smithi002.stdout: "dn-": 20, 2024-06-13T02:31:23.124 INFO:teuthology.orchestra.run.smithi002.stdout: "cap": 83, 2024-06-13T02:31:23.124 INFO:teuthology.orchestra.run.smithi002.stdout: "cap+": 90, 2024-06-13T02:31:23.124 INFO:teuthology.orchestra.run.smithi002.stdout: "cap-": 7, 2024-06-13T02:31:23.124 INFO:teuthology.orchestra.run.smithi002.stdout: "rss": 57320, 2024-06-13T02:31:23.125 INFO:teuthology.orchestra.run.smithi002.stdout: "heap": 223612 2024-06-13T02:31:23.125 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.125 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_server": { 2024-06-13T02:31:23.125 INFO:teuthology.orchestra.run.smithi002.stdout: "dispatch_client_request": 4470, 2024-06-13T02:31:23.125 INFO:teuthology.orchestra.run.smithi002.stdout: "dispatch_server_request": 0, 2024-06-13T02:31:23.125 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_client_request": 4439, 2024-06-13T02:31:23.125 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_client_session": 31, 2024-06-13T02:31:23.125 INFO:teuthology.orchestra.run.smithi002.stdout: "handle_peer_request": 1, 2024-06-13T02:31:23.125 INFO:teuthology.orchestra.run.smithi002.stdout: "req_create_latency": { 2024-06-13T02:31:23.126 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 16, 2024-06-13T02:31:23.126 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.057224309, 2024-06-13T02:31:23.126 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.003576519 2024-06-13T02:31:23.126 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.126 INFO:teuthology.orchestra.run.smithi002.stdout: "req_getattr_latency": { 2024-06-13T02:31:23.126 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 5, 2024-06-13T02:31:23.126 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.002274803, 2024-06-13T02:31:23.126 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000454960 2024-06-13T02:31:23.126 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.127 INFO:teuthology.orchestra.run.smithi002.stdout: "req_getfilelock_latency": { 2024-06-13T02:31:23.127 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.127 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.127 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.127 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.127 INFO:teuthology.orchestra.run.smithi002.stdout: "req_link_latency": { 2024-06-13T02:31:23.127 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.127 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.128 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.128 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.128 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookup_latency": { 2024-06-13T02:31:23.128 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 29, 2024-06-13T02:31:23.128 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.025197700, 2024-06-13T02:31:23.128 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000868886 2024-06-13T02:31:23.128 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.128 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookuphash_latency": { 2024-06-13T02:31:23.129 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.129 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.129 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.129 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookupino_latency": { 2024-06-13T02:31:23.129 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 1, 2024-06-13T02:31:23.129 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000179884, 2024-06-13T02:31:23.129 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000179884 2024-06-13T02:31:23.129 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.130 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookupname_latency": { 2024-06-13T02:31:23.130 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.130 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.130 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.130 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.130 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookupparent_latency": { 2024-06-13T02:31:23.130 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.131 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.131 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.131 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.131 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lookupsnap_latency": { 2024-06-13T02:31:23.131 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.131 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.131 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.131 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.131 INFO:teuthology.orchestra.run.smithi002.stdout: "req_lssnap_latency": { 2024-06-13T02:31:23.132 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.132 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.132 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.132 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.133 INFO:teuthology.orchestra.run.smithi002.stdout: "req_mkdir_latency": { 2024-06-13T02:31:23.133 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.133 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.133 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.133 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.133 INFO:teuthology.orchestra.run.smithi002.stdout: "req_mknod_latency": { 2024-06-13T02:31:23.133 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.133 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.133 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.134 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.134 INFO:teuthology.orchestra.run.smithi002.stdout: "req_mksnap_latency": { 2024-06-13T02:31:23.134 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.134 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.134 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.134 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.134 INFO:teuthology.orchestra.run.smithi002.stdout: "req_open_latency": { 2024-06-13T02:31:23.135 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.135 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.135 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.135 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.135 INFO:teuthology.orchestra.run.smithi002.stdout: "req_readdir_latency": { 2024-06-13T02:31:23.135 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 31, 2024-06-13T02:31:23.135 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 2.588474339, 2024-06-13T02:31:23.135 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.083499172 2024-06-13T02:31:23.135 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.136 INFO:teuthology.orchestra.run.smithi002.stdout: "req_rename_latency": { 2024-06-13T02:31:23.136 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 3, 2024-06-13T02:31:23.136 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.018637166, 2024-06-13T02:31:23.136 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.006212388 2024-06-13T02:31:23.136 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.136 INFO:teuthology.orchestra.run.smithi002.stdout: "req_renamesnap_latency": { 2024-06-13T02:31:23.136 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.136 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.136 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.137 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.137 INFO:teuthology.orchestra.run.smithi002.stdout: "req_snapdiff_latency": { 2024-06-13T02:31:23.137 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.137 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.137 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.137 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.137 INFO:teuthology.orchestra.run.smithi002.stdout: "req_rmdir_latency": { 2024-06-13T02:31:23.137 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.137 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.138 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.138 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.138 INFO:teuthology.orchestra.run.smithi002.stdout: "req_rmsnap_latency": { 2024-06-13T02:31:23.138 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.138 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.138 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.138 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.138 INFO:teuthology.orchestra.run.smithi002.stdout: "req_rmxattr_latency": { 2024-06-13T02:31:23.139 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.139 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.139 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.139 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.139 INFO:teuthology.orchestra.run.smithi002.stdout: "req_setattr_latency": { 2024-06-13T02:31:23.139 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.139 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.139 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.139 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.140 INFO:teuthology.orchestra.run.smithi002.stdout: "req_setdirlayout_latency": { 2024-06-13T02:31:23.140 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.140 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.140 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.140 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.140 INFO:teuthology.orchestra.run.smithi002.stdout: "req_setfilelock_latency": { 2024-06-13T02:31:23.140 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.140 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.140 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.141 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.141 INFO:teuthology.orchestra.run.smithi002.stdout: "req_setlayout_latency": { 2024-06-13T02:31:23.141 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.141 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.141 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.141 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.141 INFO:teuthology.orchestra.run.smithi002.stdout: "req_setxattr_latency": { 2024-06-13T02:31:23.141 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.142 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.142 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.142 INFO:teuthology.orchestra.run.smithi002.stdout: "req_symlink_latency": { 2024-06-13T02:31:23.142 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.142 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.142 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.142 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.142 INFO:teuthology.orchestra.run.smithi002.stdout: "req_unlink_latency": { 2024-06-13T02:31:23.143 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 13, 2024-06-13T02:31:23.143 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.042058896, 2024-06-13T02:31:23.143 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.003235299 2024-06-13T02:31:23.143 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.143 INFO:teuthology.orchestra.run.smithi002.stdout: "cap_revoke_eviction": 0, 2024-06-13T02:31:23.143 INFO:teuthology.orchestra.run.smithi002.stdout: "cap_acquisition_throttle": 0, 2024-06-13T02:31:23.143 INFO:teuthology.orchestra.run.smithi002.stdout: "req_getvxattr_latency": { 2024-06-13T02:31:23.144 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.144 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.144 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.144 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:23.144 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.144 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_sessions": { 2024-06-13T02:31:23.144 INFO:teuthology.orchestra.run.smithi002.stdout: "session_count": 2, 2024-06-13T02:31:23.144 INFO:teuthology.orchestra.run.smithi002.stdout: "session_add": 4, 2024-06-13T02:31:23.144 INFO:teuthology.orchestra.run.smithi002.stdout: "session_remove": 2, 2024-06-13T02:31:23.145 INFO:teuthology.orchestra.run.smithi002.stdout: "sessions_open": 2, 2024-06-13T02:31:23.145 INFO:teuthology.orchestra.run.smithi002.stdout: "sessions_stale": 0, 2024-06-13T02:31:23.145 INFO:teuthology.orchestra.run.smithi002.stdout: "total_load": 88, 2024-06-13T02:31:23.145 INFO:teuthology.orchestra.run.smithi002.stdout: "average_load": 44, 2024-06-13T02:31:23.145 INFO:teuthology.orchestra.run.smithi002.stdout: "avg_session_uptime": 809, 2024-06-13T02:31:23.145 INFO:teuthology.orchestra.run.smithi002.stdout: "mdthresh_evicted": 0 2024-06-13T02:31:23.145 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.145 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-06-13T02:31:23.145 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-06-13T02:31:23.146 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-06-13T02:31:23.146 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T02:31:23.146 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-06-13T02:31:23.146 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T02:31:23.146 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-06-13T02:31:23.146 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T02:31:23.146 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T02:31:23.146 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T02:31:23.147 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T02:31:23.147 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T02:31:23.147 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-06-13T02:31:23.147 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T02:31:23.147 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T02:31:23.147 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-06-13T02:31:23.147 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-06-13T02:31:23.147 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-06-13T02:31:23.147 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-06-13T02:31:23.148 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T02:31:23.148 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T02:31:23.148 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T02:31:23.148 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T02:31:23.148 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T02:31:23.148 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-06-13T02:31:23.148 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-06-13T02:31:23.148 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-06-13T02:31:23.149 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T02:31:23.149 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T02:31:23.149 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-06-13T02:31:23.149 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-06-13T02:31:23.149 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-06-13T02:31:23.149 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-06-13T02:31:23.149 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T02:31:23.149 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-06-13T02:31:23.149 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T02:31:23.150 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-06-13T02:31:23.150 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 854757, 2024-06-13T02:31:23.150 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 362, 2024-06-13T02:31:23.150 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 616, 2024-06-13T02:31:23.150 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 7, 2024-06-13T02:31:23.150 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-06-13T02:31:23.150 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-06-13T02:31:23.150 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-06-13T02:31:23.151 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-06-13T02:31:23.151 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-06-13T02:31:23.151 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-06-13T02:31:23.151 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 9800, 2024-06-13T02:31:23.151 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 188, 2024-06-13T02:31:23.151 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T02:31:23.151 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-06-13T02:31:23.151 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-06-13T02:31:23.152 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-06-13T02:31:23.152 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 744801, 2024-06-13T02:31:23.152 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 7084, 2024-06-13T02:31:23.152 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-06-13T02:31:23.152 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-06-13T02:31:23.152 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-06-13T02:31:23.152 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-06-13T02:31:23.152 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.152 INFO:teuthology.orchestra.run.smithi002.stdout: "objecter": { 2024-06-13T02:31:23.153 INFO:teuthology.orchestra.run.smithi002.stdout: "op_active": 0, 2024-06-13T02:31:23.153 INFO:teuthology.orchestra.run.smithi002.stdout: "op_laggy": 0, 2024-06-13T02:31:23.153 INFO:teuthology.orchestra.run.smithi002.stdout: "op_send": 112, 2024-06-13T02:31:23.153 INFO:teuthology.orchestra.run.smithi002.stdout: "op_send_bytes": 737684, 2024-06-13T02:31:23.153 INFO:teuthology.orchestra.run.smithi002.stdout: "op_resend": 33, 2024-06-13T02:31:23.153 INFO:teuthology.orchestra.run.smithi002.stdout: "op_reply": 112, 2024-06-13T02:31:23.153 INFO:teuthology.orchestra.run.smithi002.stdout: "op_latency": { 2024-06-13T02:31:23.153 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 112, 2024-06-13T02:31:23.153 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.641986017, 2024-06-13T02:31:23.154 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.005732018 2024-06-13T02:31:23.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.154 INFO:teuthology.orchestra.run.smithi002.stdout: "op_inflight": 0, 2024-06-13T02:31:23.154 INFO:teuthology.orchestra.run.smithi002.stdout: "oplen_avg": { 2024-06-13T02:31:23.154 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 112, 2024-06-13T02:31:23.154 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 144 2024-06-13T02:31:23.154 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.154 INFO:teuthology.orchestra.run.smithi002.stdout: "op": 112, 2024-06-13T02:31:23.155 INFO:teuthology.orchestra.run.smithi002.stdout: "op_r": 2, 2024-06-13T02:31:23.155 INFO:teuthology.orchestra.run.smithi002.stdout: "op_w": 110, 2024-06-13T02:31:23.155 INFO:teuthology.orchestra.run.smithi002.stdout: "op_rmw": 0, 2024-06-13T02:31:23.155 INFO:teuthology.orchestra.run.smithi002.stdout: "op_pg": 0, 2024-06-13T02:31:23.155 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_stat": 0, 2024-06-13T02:31:23.155 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_create": 10, 2024-06-13T02:31:23.155 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_read": 2, 2024-06-13T02:31:23.155 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_write": 50, 2024-06-13T02:31:23.155 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_writefull": 12, 2024-06-13T02:31:23.156 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_writesame": 0, 2024-06-13T02:31:23.156 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_append": 0, 2024-06-13T02:31:23.156 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_zero": 0, 2024-06-13T02:31:23.156 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_truncate": 0, 2024-06-13T02:31:23.156 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_delete": 16, 2024-06-13T02:31:23.156 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_mapext": 0, 2024-06-13T02:31:23.156 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_sparse_read": 0, 2024-06-13T02:31:23.156 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_clonerange": 0, 2024-06-13T02:31:23.156 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_getxattr": 0, 2024-06-13T02:31:23.157 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_setxattr": 20, 2024-06-13T02:31:23.157 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_cmpxattr": 0, 2024-06-13T02:31:23.157 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_rmxattr": 0, 2024-06-13T02:31:23.157 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_resetxattrs": 0, 2024-06-13T02:31:23.157 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_call": 0, 2024-06-13T02:31:23.157 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_watch": 0, 2024-06-13T02:31:23.157 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_notify": 0, 2024-06-13T02:31:23.157 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_src_cmpxattr": 0, 2024-06-13T02:31:23.158 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_pgls": 0, 2024-06-13T02:31:23.158 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_pgls_filter": 0, 2024-06-13T02:31:23.158 INFO:teuthology.orchestra.run.smithi002.stdout: "osdop_other": 0, 2024-06-13T02:31:23.158 INFO:teuthology.orchestra.run.smithi002.stdout: "linger_active": 0, 2024-06-13T02:31:23.158 INFO:teuthology.orchestra.run.smithi002.stdout: "linger_send": 0, 2024-06-13T02:31:23.158 INFO:teuthology.orchestra.run.smithi002.stdout: "linger_resend": 0, 2024-06-13T02:31:23.158 INFO:teuthology.orchestra.run.smithi002.stdout: "linger_ping": 0, 2024-06-13T02:31:23.159 INFO:teuthology.orchestra.run.smithi002.stdout: "poolop_active": 0, 2024-06-13T02:31:23.159 INFO:teuthology.orchestra.run.smithi002.stdout: "poolop_send": 0, 2024-06-13T02:31:23.159 INFO:teuthology.orchestra.run.smithi002.stdout: "poolop_resend": 0, 2024-06-13T02:31:23.159 INFO:teuthology.orchestra.run.smithi002.stdout: "poolstat_active": 0, 2024-06-13T02:31:23.159 INFO:teuthology.orchestra.run.smithi002.stdout: "poolstat_send": 0, 2024-06-13T02:31:23.159 INFO:teuthology.orchestra.run.smithi002.stdout: "poolstat_resend": 0, 2024-06-13T02:31:23.159 INFO:teuthology.orchestra.run.smithi002.stdout: "statfs_active": 0, 2024-06-13T02:31:23.159 INFO:teuthology.orchestra.run.smithi002.stdout: "statfs_send": 0, 2024-06-13T02:31:23.159 INFO:teuthology.orchestra.run.smithi002.stdout: "statfs_resend": 0, 2024-06-13T02:31:23.160 INFO:teuthology.orchestra.run.smithi002.stdout: "command_active": 0, 2024-06-13T02:31:23.160 INFO:teuthology.orchestra.run.smithi002.stdout: "command_send": 0, 2024-06-13T02:31:23.160 INFO:teuthology.orchestra.run.smithi002.stdout: "command_resend": 0, 2024-06-13T02:31:23.160 INFO:teuthology.orchestra.run.smithi002.stdout: "map_epoch": 121, 2024-06-13T02:31:23.160 INFO:teuthology.orchestra.run.smithi002.stdout: "map_full": 0, 2024-06-13T02:31:23.160 INFO:teuthology.orchestra.run.smithi002.stdout: "map_inc": 23, 2024-06-13T02:31:23.160 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_sessions": 10, 2024-06-13T02:31:23.160 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_session_open": 13, 2024-06-13T02:31:23.161 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_session_close": 3, 2024-06-13T02:31:23.161 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_laggy": 0, 2024-06-13T02:31:23.161 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_wr": 29, 2024-06-13T02:31:23.161 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_rd": 0, 2024-06-13T02:31:23.161 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_del": 5 2024-06-13T02:31:23.161 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.161 INFO:teuthology.orchestra.run.smithi002.stdout: "oft": { 2024-06-13T02:31:23.161 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_total_objs": 1, 2024-06-13T02:31:23.161 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_total_kv_pairs": 0, 2024-06-13T02:31:23.162 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_total_updates": 0, 2024-06-13T02:31:23.162 INFO:teuthology.orchestra.run.smithi002.stdout: "omap_total_removes": 0 2024-06-13T02:31:23.162 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.162 INFO:teuthology.orchestra.run.smithi002.stdout: "osd-slow-ops": { 2024-06-13T02:31:23.162 INFO:teuthology.orchestra.run.smithi002.stdout: "slow_ops_count": 0 2024-06-13T02:31:23.162 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.162 INFO:teuthology.orchestra.run.smithi002.stdout: "purge_queue": { 2024-06-13T02:31:23.162 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executing_ops": 0, 2024-06-13T02:31:23.163 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executing_ops_high_water": 2, 2024-06-13T02:31:23.163 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executing": 0, 2024-06-13T02:31:23.163 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executing_high_water": 1, 2024-06-13T02:31:23.163 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executed_ops": 4, 2024-06-13T02:31:23.163 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_executed": 2, 2024-06-13T02:31:23.163 INFO:teuthology.orchestra.run.smithi002.stdout: "pq_item_in_journal": 0 2024-06-13T02:31:23.163 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.163 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T02:31:23.163 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-06-13T02:31:23.164 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-06-13T02:31:23.164 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-06-13T02:31:23.164 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 144844, 2024-06-13T02:31:23.164 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 70318561, 2024-06-13T02:31:23.164 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:23.164 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 144844, 2024-06-13T02:31:23.164 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-06-13T02:31:23.164 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-06-13T02:31:23.164 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 144844, 2024-06-13T02:31:23.165 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 70318561, 2024-06-13T02:31:23.165 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-06-13T02:31:23.165 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.165 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.165 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.165 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:23.165 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.165 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-objecter_bytes": { 2024-06-13T02:31:23.165 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-06-13T02:31:23.166 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-06-13T02:31:23.166 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-06-13T02:31:23.166 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 0, 2024-06-13T02:31:23.166 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 0, 2024-06-13T02:31:23.166 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:23.166 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:23.166 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 112, 2024-06-13T02:31:23.167 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 737910, 2024-06-13T02:31:23.167 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 112, 2024-06-13T02:31:23.167 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 737910, 2024-06-13T02:31:23.167 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-06-13T02:31:23.167 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.167 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.167 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.167 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:23.167 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.168 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-objecter_ops": { 2024-06-13T02:31:23.168 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-06-13T02:31:23.168 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 1024, 2024-06-13T02:31:23.168 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-06-13T02:31:23.168 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 0, 2024-06-13T02:31:23.168 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 0, 2024-06-13T02:31:23.168 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:23.168 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:23.169 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 112, 2024-06-13T02:31:23.169 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 112, 2024-06-13T02:31:23.169 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 112, 2024-06-13T02:31:23.169 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 112, 2024-06-13T02:31:23.169 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-06-13T02:31:23.169 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.169 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.169 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.169 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:23.170 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.170 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-write_buf_throttle": { 2024-06-13T02:31:23.170 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-06-13T02:31:23.170 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 3758096384, 2024-06-13T02:31:23.170 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-06-13T02:31:23.170 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 2, 2024-06-13T02:31:23.170 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 226, 2024-06-13T02:31:23.170 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:23.171 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 2, 2024-06-13T02:31:23.171 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-06-13T02:31:23.171 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-06-13T02:31:23.171 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 2, 2024-06-13T02:31:23.171 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 226, 2024-06-13T02:31:23.171 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-06-13T02:31:23.171 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.171 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.171 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.172 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:23.172 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:23.172 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-write_buf_throttle-0x5585cac28460": { 2024-06-13T02:31:23.172 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 599, 2024-06-13T02:31:23.172 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 3758096384, 2024-06-13T02:31:23.172 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-06-13T02:31:23.172 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 226, 2024-06-13T02:31:23.172 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 719215, 2024-06-13T02:31:23.172 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:23.173 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 226, 2024-06-13T02:31:23.173 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-06-13T02:31:23.173 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-06-13T02:31:23.173 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 48, 2024-06-13T02:31:23.173 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 718616, 2024-06-13T02:31:23.173 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-06-13T02:31:23.173 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:23.173 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:23.173 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:23.174 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:23.174 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:23.174 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T02:31:23.174 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:23 smithi002 ceph-mon[31960]: pgmap v429: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 63 KiB/s wr, 14 op/s 2024-06-13T02:31:23.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:23 smithi084 ceph-mon[36833]: pgmap v429: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 63 KiB/s wr, 14 op/s 2024-06-13T02:31:23.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:23 smithi175 ceph-mon[36977]: pgmap v429: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 63 KiB/s wr, 14 op/s 2024-06-13T02:31:24.131 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-06-13T02:31:24.131 INFO:tasks.check_counter:Daemon mds.g mds.imported=4 2024-06-13T02:31:24.131 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=6 2024-06-13T02:31:24.132 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-06-13T02:31:24.132 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-06-13T02:31:24.132 DEBUG:tasks.check_counter:Getting stats from j 2024-06-13T02:31:24.132 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph daemon mds.j perf dump 2024-06-13T02:31:24.609 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:31:25.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:24 smithi175 ceph-mon[36977]: pgmap v430: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 61 KiB/s wr, 14 op/s 2024-06-13T02:31:25.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:24 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:31:25.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:24 smithi002 ceph-mon[31960]: pgmap v430: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 61 KiB/s wr, 14 op/s 2024-06-13T02:31:25.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:24 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:31:25.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:24 smithi084 ceph-mon[36833]: pgmap v430: 129 pgs: 129 active+clean; 271 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 61 KiB/s wr, 14 op/s 2024-06-13T02:31:25.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:24 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:31:27.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:27 smithi002 ceph-mon[31960]: pgmap v431: 129 pgs: 129 active+clean; 272 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 139 KiB/s wr, 17 op/s 2024-06-13T02:31:27.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:27 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:31:27.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:27 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:31:27.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:27 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:31:27.173 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-06-13T02:31:27.173 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T02:31:27.173 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 324, 2024-06-13T02:31:27.174 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 313, 2024-06-13T02:31:27.174 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 1610080, 2024-06-13T02:31:27.174 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 193664, 2024-06-13T02:31:27.174 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 4, 2024-06-13T02:31:27.175 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 0, 2024-06-13T02:31:27.175 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.149060412, 2024-06-13T02:31:27.175 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.037335612, 2024-06-13T02:31:27.175 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.134992661, 2024-06-13T02:31:27.175 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.016103946, 2024-06-13T02:31:27.176 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:27.176 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 312, 2024-06-13T02:31:27.176 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.034241932, 2024-06-13T02:31:27.176 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000109749 2024-06-13T02:31:27.176 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:27.176 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:27.177 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:27.177 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:27.177 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:27.177 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:27.177 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 1610080, 2024-06-13T02:31:27.178 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 193664 2024-06-13T02:31:27.178 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:27.178 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T02:31:27.178 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 2, 2024-06-13T02:31:27.178 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 239, 2024-06-13T02:31:27.179 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 320, 2024-06-13T02:31:27.179 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 197888, 2024-06-13T02:31:27.179 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 5, 2024-06-13T02:31:27.179 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 3, 2024-06-13T02:31:27.179 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.051189635, 2024-06-13T02:31:27.180 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.038317456, 2024-06-13T02:31:27.180 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.005468268, 2024-06-13T02:31:27.180 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T02:31:27.180 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:27.180 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 236, 2024-06-13T02:31:27.180 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.047902224, 2024-06-13T02:31:27.181 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000202975 2024-06-13T02:31:27.181 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:27.181 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:27.181 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:27.181 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:27.181 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:27.182 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:27.182 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-13T02:31:27.182 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 197888 2024-06-13T02:31:27.182 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:27.182 INFO:teuthology.orchestra.run.smithi002.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T02:31:27.183 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_messages": 4, 2024-06-13T02:31:27.183 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages": 4, 2024-06-13T02:31:27.183 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_bytes": 3024, 2024-06-13T02:31:27.183 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_bytes": 448, 2024-06-13T02:31:27.183 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_created_connections": 2, 2024-06-13T02:31:27.183 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_active_connections": 1, 2024-06-13T02:31:27.184 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_total_time": 0.001586718, 2024-06-13T02:31:27.184 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_send_time": 0.000083209, 2024-06-13T02:31:27.184 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_recv_time": 0.001409085, 2024-06-13T02:31:27.184 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T02:31:27.184 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:27.184 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 3, 2024-06-13T02:31:27.185 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.001548810, 2024-06-13T02:31:27.185 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000516270 2024-06-13T02:31:27.185 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:27.185 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:27.185 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:27.185 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:27.186 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:27.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:27.186 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-06-13T02:31:27.186 INFO:teuthology.orchestra.run.smithi002.stdout: "msgr_send_encrypted_bytes": 448 2024-06-13T02:31:27.186 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:27.187 INFO:teuthology.orchestra.run.smithi002.stdout: "cct": { 2024-06-13T02:31:27.187 INFO:teuthology.orchestra.run.smithi002.stdout: "total_workers": 0, 2024-06-13T02:31:27.187 INFO:teuthology.orchestra.run.smithi002.stdout: "unhealthy_workers": 0 2024-06-13T02:31:27.187 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:27.187 INFO:teuthology.orchestra.run.smithi002.stdout: "mempool": { 2024-06-13T02:31:27.188 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_bytes": 0, 2024-06-13T02:31:27.188 INFO:teuthology.orchestra.run.smithi002.stdout: "bloom_filter_items": 0, 2024-06-13T02:31:27.188 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T02:31:27.188 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_alloc_items": 0, 2024-06-13T02:31:27.188 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T02:31:27.188 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_data_items": 0, 2024-06-13T02:31:27.189 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T02:31:27.189 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T02:31:27.189 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T02:31:27.189 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T02:31:27.189 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T02:31:27.189 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_other_items": 0, 2024-06-13T02:31:27.190 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T02:31:27.190 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T02:31:27.190 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_bytes": 0, 2024-06-13T02:31:27.190 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_extent_items": 0, 2024-06-13T02:31:27.190 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_bytes": 0, 2024-06-13T02:31:27.191 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_blob_items": 0, 2024-06-13T02:31:27.191 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T02:31:27.191 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T02:31:27.191 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T02:31:27.191 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T02:31:27.191 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T02:31:27.192 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_fsck_items": 0, 2024-06-13T02:31:27.192 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_bytes": 0, 2024-06-13T02:31:27.192 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_txc_items": 0, 2024-06-13T02:31:27.192 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T02:31:27.192 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T02:31:27.192 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_bytes": 0, 2024-06-13T02:31:27.193 INFO:teuthology.orchestra.run.smithi002.stdout: "bluestore_writing_items": 0, 2024-06-13T02:31:27.193 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_bytes": 0, 2024-06-13T02:31:27.193 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_items": 0, 2024-06-13T02:31:27.193 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T02:31:27.193 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_reader_items": 0, 2024-06-13T02:31:27.193 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T02:31:27.194 INFO:teuthology.orchestra.run.smithi002.stdout: "bluefs_file_writer_items": 0, 2024-06-13T02:31:27.194 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_bytes": 150776, 2024-06-13T02:31:27.194 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_anon_items": 32, 2024-06-13T02:31:27.194 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_bytes": 0, 2024-06-13T02:31:27.194 INFO:teuthology.orchestra.run.smithi002.stdout: "buffer_meta_items": 0, 2024-06-13T02:31:27.194 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_bytes": 0, 2024-06-13T02:31:27.195 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_items": 0, 2024-06-13T02:31:27.195 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_bytes": 0, 2024-06-13T02:31:27.195 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_mapbl_items": 0, 2024-06-13T02:31:27.195 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_bytes": 0, 2024-06-13T02:31:27.195 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_pglog_items": 0, 2024-06-13T02:31:27.195 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_bytes": 0, 2024-06-13T02:31:27.196 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_items": 0, 2024-06-13T02:31:27.196 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T02:31:27.196 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_mapping_items": 0, 2024-06-13T02:31:27.196 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_bytes": 0, 2024-06-13T02:31:27.196 INFO:teuthology.orchestra.run.smithi002.stdout: "pgmap_items": 0, 2024-06-13T02:31:27.197 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_bytes": 928, 2024-06-13T02:31:27.197 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_co_items": 2, 2024-06-13T02:31:27.197 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_bytes": 0, 2024-06-13T02:31:27.197 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_1_items": 0, 2024-06-13T02:31:27.197 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_bytes": 0, 2024-06-13T02:31:27.198 INFO:teuthology.orchestra.run.smithi002.stdout: "unittest_2_items": 0 2024-06-13T02:31:27.198 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-06-13T02:31:27.198 INFO:teuthology.orchestra.run.smithi002.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T02:31:27.198 INFO:teuthology.orchestra.run.smithi002.stdout: "val": 0, 2024-06-13T02:31:27.198 INFO:teuthology.orchestra.run.smithi002.stdout: "max": 104857600, 2024-06-13T02:31:27.199 INFO:teuthology.orchestra.run.smithi002.stdout: "get_started": 0, 2024-06-13T02:31:27.199 INFO:teuthology.orchestra.run.smithi002.stdout: "get": 326, 2024-06-13T02:31:27.199 INFO:teuthology.orchestra.run.smithi002.stdout: "get_sum": 1564348, 2024-06-13T02:31:27.199 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:27.199 INFO:teuthology.orchestra.run.smithi002.stdout: "get_or_fail_success": 326, 2024-06-13T02:31:27.199 INFO:teuthology.orchestra.run.smithi002.stdout: "take": 0, 2024-06-13T02:31:27.200 INFO:teuthology.orchestra.run.smithi002.stdout: "take_sum": 0, 2024-06-13T02:31:27.200 INFO:teuthology.orchestra.run.smithi002.stdout: "put": 326, 2024-06-13T02:31:27.200 INFO:teuthology.orchestra.run.smithi002.stdout: "put_sum": 1564348, 2024-06-13T02:31:27.200 INFO:teuthology.orchestra.run.smithi002.stdout: "wait": { 2024-06-13T02:31:27.200 INFO:teuthology.orchestra.run.smithi002.stdout: "avgcount": 0, 2024-06-13T02:31:27.200 INFO:teuthology.orchestra.run.smithi002.stdout: "sum": 0.000000000, 2024-06-13T02:31:27.201 INFO:teuthology.orchestra.run.smithi002.stdout: "avgtime": 0.000000000 2024-06-13T02:31:27.201 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:27.201 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-06-13T02:31:27.201 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-06-13T02:31:27.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:27 smithi084 ceph-mon[36833]: pgmap v431: 129 pgs: 129 active+clean; 272 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 139 KiB/s wr, 17 op/s 2024-06-13T02:31:27.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:27 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:31:27.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:27 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:31:27.471 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:27 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:31:27.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:27 smithi175 ceph-mon[36977]: pgmap v431: 129 pgs: 129 active+clean; 272 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 139 KiB/s wr, 17 op/s 2024-06-13T02:31:27.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:27 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:31:27.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:27 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:31:27.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:27 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:31:28.300 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-06-13T02:31:28.300 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-06-13T02:31:28.300 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-06-13T02:31:28.301 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-06-13T02:31:28.301 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-06-13T02:31:28.301 DEBUG:tasks.check_counter:Getting stats from b 2024-06-13T02:31:28.301 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph daemon mds.b perf dump 2024-06-13T02:31:28.651 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T02:31:29.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:29 smithi002 ceph-mon[31960]: pgmap v432: 129 pgs: 129 active+clean; 272 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 105 KiB/s wr, 12 op/s 2024-06-13T02:31:29.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:29 smithi084 ceph-mon[36833]: pgmap v432: 129 pgs: 129 active+clean; 272 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 105 KiB/s wr, 12 op/s 2024-06-13T02:31:29.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:29 smithi175 ceph-mon[36977]: pgmap v432: 129 pgs: 129 active+clean; 272 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 105 KiB/s wr, 12 op/s 2024-06-13T02:31:30.733 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-06-13T02:31:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T02:31:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 138424, 2024-06-13T02:31:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 205002, 2024-06-13T02:31:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 30741337, 2024-06-13T02:31:30.734 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 288492526, 2024-06-13T02:31:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 11, 2024-06-13T02:31:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 4, 2024-06-13T02:31:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 8.744098151, 2024-06-13T02:31:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 3.528880156, 2024-06-13T02:31:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 3.979974587, 2024-06-13T02:31:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 1.374161323, 2024-06-13T02:31:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:30.735 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 205001, 2024-06-13T02:31:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 20.037507390, 2024-06-13T02:31:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000097743 2024-06-13T02:31:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 250486, 2024-06-13T02:31:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.037294961, 2024-06-13T02:31:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000148 2024-06-13T02:31:30.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 2201952, 2024-06-13T02:31:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 337408 2024-06-13T02:31:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T02:31:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 311299, 2024-06-13T02:31:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 477007, 2024-06-13T02:31:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 115672089, 2024-06-13T02:31:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 586180664, 2024-06-13T02:31:30.737 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 134, 2024-06-13T02:31:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 7, 2024-06-13T02:31:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 21.577698963, 2024-06-13T02:31:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 9.634710245, 2024-06-13T02:31:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 13.137225601, 2024-06-13T02:31:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 1.669691038, 2024-06-13T02:31:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 477004, 2024-06-13T02:31:30.738 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 33.026731112, 2024-06-13T02:31:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000069237 2024-06-13T02:31:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 531778, 2024-06-13T02:31:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.085465303, 2024-06-13T02:31:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000160 2024-06-13T02:31:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.739 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 99383184, 2024-06-13T02:31:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 378276880 2024-06-13T02:31:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T02:31:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 124807, 2024-06-13T02:31:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 194668, 2024-06-13T02:31:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 26367849, 2024-06-13T02:31:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 302726136, 2024-06-13T02:31:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 12, 2024-06-13T02:31:30.740 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 6, 2024-06-13T02:31:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 8.711083902, 2024-06-13T02:31:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 3.882737448, 2024-06-13T02:31:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 3.233363772, 2024-06-13T02:31:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 1.493502019, 2024-06-13T02:31:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 194666, 2024-06-13T02:31:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 35.551464461, 2024-06-13T02:31:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000182628 2024-06-13T02:31:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.741 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 194899, 2024-06-13T02:31:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.029600924, 2024-06-13T02:31:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000151 2024-06-13T02:31:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 42560, 2024-06-13T02:31:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 2416 2024-06-13T02:31:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.742 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-06-13T02:31:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 1, 2024-06-13T02:31:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-06-13T02:31:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-MDSRank": { 2024-06-13T02:31:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-06-13T02:31:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-06-13T02:31:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 103389, 2024-06-13T02:31:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 86.989668350, 2024-06-13T02:31:30.743 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000841382 2024-06-13T02:31:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-PurgeQueue": { 2024-06-13T02:31:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-06-13T02:31:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-06-13T02:31:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 55175, 2024-06-13T02:31:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 4.789968376, 2024-06-13T02:31:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000086814 2024-06-13T02:31:30.744 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-06-13T02:31:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: "request": 189134, 2024-06-13T02:31:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: "reply": 187739, 2024-06-13T02:31:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: "reply_latency": { 2024-06-13T02:31:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 187739, 2024-06-13T02:31:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 393.831688605, 2024-06-13T02:31:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.002097761 2024-06-13T02:31:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_reply": 0, 2024-06-13T02:31:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: "forward": 1395, 2024-06-13T02:31:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_complete": 5, 2024-06-13T02:31:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_keys": 0, 2024-06-13T02:31:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_commit": 1783, 2024-06-13T02:31:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_split": 4, 2024-06-13T02:31:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_merge": 2, 2024-06-13T02:31:30.746 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes": 2207, 2024-06-13T02:31:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_top": 377, 2024-06-13T02:31:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_bottom": 1219, 2024-06-13T02:31:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pin_tail": 611, 2024-06-13T02:31:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pinned": 1668, 2024-06-13T02:31:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_expired": 413, 2024-06-13T02:31:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_with_caps": 573, 2024-06-13T02:31:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": 573, 2024-06-13T02:31:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: "subtrees": 17, 2024-06-13T02:31:30.747 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse": 232114, 2024-06-13T02:31:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_hit": 174738, 2024-06-13T02:31:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_forward": 1395, 2024-06-13T02:31:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_discover": 6, 2024-06-13T02:31:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_dir_fetch": 0, 2024-06-13T02:31:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_remote_ino": 0, 2024-06-13T02:31:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_lock": 782, 2024-06-13T02:31:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "load_cent": 0, 2024-06-13T02:31:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "q": 0, 2024-06-13T02:31:30.748 INFO:teuthology.orchestra.run.smithi084.stdout: "exported": 18, 2024-06-13T02:31:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "exported_inodes": 332, 2024-06-13T02:31:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "imported": 1, 2024-06-13T02:31:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "imported_inodes": 58, 2024-06-13T02:31:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_dir_fetch": 0, 2024-06-13T02:31:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_backtrace_fetch": 0, 2024-06-13T02:31:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_peer_discover": 0, 2024-06-13T02:31:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rfiles": 619, 2024-06-13T02:31:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rbytes": 195745744, 2024-06-13T02:31:30.749 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rsnaps": 6, 2024-06-13T02:31:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_fetch": 0, 2024-06-13T02:31:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_set_tag": 0, 2024-06-13T02:31:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_repaired": 0, 2024-06-13T02:31:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_inotable_repaired": 0, 2024-06-13T02:31:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_inodes": 0, 2024-06-13T02:31:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_base_inodes": 0, 2024-06-13T02:31:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dirfrag_rstats": 0, 2024-06-13T02:31:30.750 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_file_inodes": 0, 2024-06-13T02:31:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_inode_file_caps": 3, 2024-06-13T02:31:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_revoke": 18459, 2024-06-13T02:31:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_grant": 128765, 2024-06-13T02:31:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_trunc": 0, 2024-06-13T02:31:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-13T02:31:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-13T02:31:30.751 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps": 56568, 2024-06-13T02:31:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps_dirty": 24979, 2024-06-13T02:31:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_cap_release": 10994, 2024-06-13T02:31:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: "process_request_cap_release": 126174 2024-06-13T02:31:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_cache": { 2024-06-13T02:31:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update": 4, 2024-06-13T02:31:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update_receipt": 0, 2024-06-13T02:31:30.752 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_try_discover": 0, 2024-06-13T02:31:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_send_discover": 6, 2024-06-13T02:31:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_handle_discover": 34, 2024-06-13T02:31:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays": 67, 2024-06-13T02:31:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_delayed": 0, 2024-06-13T02:31:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_enqueuing": 0, 2024-06-13T02:31:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_created": 29935, 2024-06-13T02:31:30.753 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_enqueued": 29868, 2024-06-13T02:31:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_reintegrated": 0, 2024-06-13T02:31:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_migrated": 0, 2024-06-13T02:31:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_processing": 0, 2024-06-13T02:31:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_enqueued": 0, 2024-06-13T02:31:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_prioritized": 0, 2024-06-13T02:31:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_started": 0, 2024-06-13T02:31:30.754 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_completed": 0, 2024-06-13T02:31:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_path": 0, 2024-06-13T02:31:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_inode": 0, 2024-06-13T02:31:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_enqueue_scrub": 0, 2024-06-13T02:31:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_exportdir": 19, 2024-06-13T02:31:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_flush": 0, 2024-06-13T02:31:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragmentdir": 6, 2024-06-13T02:31:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragstats": 0, 2024-06-13T02:31:30.755 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_inodestats": 0 2024-06-13T02:31:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_log": { 2024-06-13T02:31:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: "evlrg": 0, 2024-06-13T02:31:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: "evadd": 139960, 2024-06-13T02:31:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: "evex": 135354, 2024-06-13T02:31:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: "evtrm": 135354, 2024-06-13T02:31:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: "ev": 4606, 2024-06-13T02:31:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: "evexg": 0, 2024-06-13T02:31:30.756 INFO:teuthology.orchestra.run.smithi084.stdout: "evexd": 2069, 2024-06-13T02:31:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: "segadd": 226, 2024-06-13T02:31:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: "segex": 218, 2024-06-13T02:31:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: "segtrm": 218, 2024-06-13T02:31:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: "seg": 8, 2024-06-13T02:31:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: "segmjr": 1, 2024-06-13T02:31:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: "segexg": 0, 2024-06-13T02:31:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: "segexd": 3, 2024-06-13T02:31:30.757 INFO:teuthology.orchestra.run.smithi084.stdout: "expos": 544732568, 2024-06-13T02:31:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "wrpos": 558909815, 2024-06-13T02:31:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "rdpos": 0, 2024-06-13T02:31:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "jlat": { 2024-06-13T02:31:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 51169, 2024-06-13T02:31:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 249.916172421, 2024-06-13T02:31:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.004884132 2024-06-13T02:31:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: "replayed": 0 2024-06-13T02:31:30.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_mem": { 2024-06-13T02:31:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: "ino": 1504, 2024-06-13T02:31:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: "ino+": 31705, 2024-06-13T02:31:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: "ino-": 30201, 2024-06-13T02:31:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: "dir": 124, 2024-06-13T02:31:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: "dir+": 168, 2024-06-13T02:31:30.759 INFO:teuthology.orchestra.run.smithi084.stdout: "dir-": 44, 2024-06-13T02:31:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: "dn": 2208, 2024-06-13T02:31:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: "dn+": 58761, 2024-06-13T02:31:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: "dn-": 56553, 2024-06-13T02:31:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: "cap": 573, 2024-06-13T02:31:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: "cap+": 31279, 2024-06-13T02:31:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: "cap-": 30706, 2024-06-13T02:31:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: "rss": 85848, 2024-06-13T02:31:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: "heap": 231804 2024-06-13T02:31:30.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_server": { 2024-06-13T02:31:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_client_request": 283601, 2024-06-13T02:31:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_server_request": 6168, 2024-06-13T02:31:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_request": 189134, 2024-06-13T02:31:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_session": 4349, 2024-06-13T02:31:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_peer_request": 12321, 2024-06-13T02:31:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: "req_create_latency": { 2024-06-13T02:31:30.761 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 30549, 2024-06-13T02:31:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 42.926719923, 2024-06-13T02:31:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.001405175 2024-06-13T02:31:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getattr_latency": { 2024-06-13T02:31:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 4311, 2024-06-13T02:31:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 36.740510518, 2024-06-13T02:31:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.008522503 2024-06-13T02:31:30.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getfilelock_latency": { 2024-06-13T02:31:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "req_link_latency": { 2024-06-13T02:31:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.763 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookup_latency": { 2024-06-13T02:31:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 31717, 2024-06-13T02:31:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 20.552333985, 2024-06-13T02:31:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000647991 2024-06-13T02:31:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookuphash_latency": { 2024-06-13T02:31:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.764 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupino_latency": { 2024-06-13T02:31:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 1, 2024-06-13T02:31:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000173081, 2024-06-13T02:31:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000173081 2024-06-13T02:31:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupname_latency": { 2024-06-13T02:31:30.765 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupparent_latency": { 2024-06-13T02:31:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.766 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupsnap_latency": { 2024-06-13T02:31:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lssnap_latency": { 2024-06-13T02:31:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 14, 2024-06-13T02:31:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.007389060, 2024-06-13T02:31:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000527790 2024-06-13T02:31:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mkdir_latency": { 2024-06-13T02:31:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 119, 2024-06-13T02:31:30.768 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.683919599, 2024-06-13T02:31:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.005747223 2024-06-13T02:31:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mknod_latency": { 2024-06-13T02:31:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mksnap_latency": { 2024-06-13T02:31:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 14, 2024-06-13T02:31:30.769 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 2.562214838, 2024-06-13T02:31:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.183015345 2024-06-13T02:31:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: "req_open_latency": { 2024-06-13T02:31:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 10, 2024-06-13T02:31:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.009085125, 2024-06-13T02:31:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000908512 2024-06-13T02:31:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.770 INFO:teuthology.orchestra.run.smithi084.stdout: "req_readdir_latency": { 2024-06-13T02:31:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 84750, 2024-06-13T02:31:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 237.473796177, 2024-06-13T02:31:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.002802050 2024-06-13T02:31:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rename_latency": { 2024-06-13T02:31:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 5265, 2024-06-13T02:31:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 7.657695673, 2024-06-13T02:31:30.771 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.001454453 2024-06-13T02:31:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: "req_renamesnap_latency": { 2024-06-13T02:31:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: "req_snapdiff_latency": { 2024-06-13T02:31:30.772 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmdir_latency": { 2024-06-13T02:31:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 1, 2024-06-13T02:31:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.002349915, 2024-06-13T02:31:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.002349915 2024-06-13T02:31:30.773 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmsnap_latency": { 2024-06-13T02:31:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 8, 2024-06-13T02:31:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.098105642, 2024-06-13T02:31:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.012263205 2024-06-13T02:31:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmxattr_latency": { 2024-06-13T02:31:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.774 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setattr_latency": { 2024-06-13T02:31:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 4, 2024-06-13T02:31:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.017400698, 2024-06-13T02:31:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.004350174 2024-06-13T02:31:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setdirlayout_latency": { 2024-06-13T02:31:30.775 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setfilelock_latency": { 2024-06-13T02:31:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 1032, 2024-06-13T02:31:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.332189258, 2024-06-13T02:31:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000321888 2024-06-13T02:31:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.776 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setlayout_latency": { 2024-06-13T02:31:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setxattr_latency": { 2024-06-13T02:31:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 9, 2024-06-13T02:31:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.024120554, 2024-06-13T02:31:30.777 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.002680061 2024-06-13T02:31:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: "req_symlink_latency": { 2024-06-13T02:31:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: "req_unlink_latency": { 2024-06-13T02:31:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 29935, 2024-06-13T02:31:30.778 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 44.743684559, 2024-06-13T02:31:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.001494694 2024-06-13T02:31:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_revoke_eviction": 0, 2024-06-13T02:31:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_acquisition_throttle": 0, 2024-06-13T02:31:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getvxattr_latency": { 2024-06-13T02:31:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.779 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_sessions": { 2024-06-13T02:31:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: "session_count": 2, 2024-06-13T02:31:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: "session_add": 7, 2024-06-13T02:31:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: "session_remove": 5, 2024-06-13T02:31:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_open": 2, 2024-06-13T02:31:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_stale": 0, 2024-06-13T02:31:30.780 INFO:teuthology.orchestra.run.smithi084.stdout: "total_load": 25324, 2024-06-13T02:31:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: "average_load": 12662, 2024-06-13T02:31:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: "avg_session_uptime": 816, 2024-06-13T02:31:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: "mdthresh_evicted": 0 2024-06-13T02:31:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-06-13T02:31:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 360, 2024-06-13T02:31:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 360, 2024-06-13T02:31:30.781 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T02:31:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-06-13T02:31:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T02:31:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-06-13T02:31:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T02:31:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T02:31:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T02:31:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T02:31:30.782 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T02:31:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-06-13T02:31:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T02:31:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T02:31:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-06-13T02:31:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-06-13T02:31:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-06-13T02:31:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-06-13T02:31:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T02:31:30.783 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T02:31:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T02:31:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T02:31:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T02:31:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-06-13T02:31:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-06-13T02:31:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-06-13T02:31:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T02:31:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T02:31:30.784 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-06-13T02:31:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-06-13T02:31:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-06-13T02:31:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-06-13T02:31:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T02:31:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-06-13T02:31:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T02:31:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-06-13T02:31:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 353533, 2024-06-13T02:31:30.785 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 981, 2024-06-13T02:31:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-06-13T02:31:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-06-13T02:31:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-06-13T02:31:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-06-13T02:31:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-06-13T02:31:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-06-13T02:31:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-06-13T02:31:30.786 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-06-13T02:31:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 9800, 2024-06-13T02:31:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 188, 2024-06-13T02:31:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T02:31:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-06-13T02:31:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-06-13T02:31:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-06-13T02:31:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 5666969, 2024-06-13T02:31:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 58571, 2024-06-13T02:31:30.787 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-06-13T02:31:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-06-13T02:31:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-06-13T02:31:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-06-13T02:31:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: "objecter": { 2024-06-13T02:31:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: "op_active": 0, 2024-06-13T02:31:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: "op_laggy": 0, 2024-06-13T02:31:30.788 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send": 145551, 2024-06-13T02:31:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send_bytes": 582027249, 2024-06-13T02:31:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "op_resend": 31, 2024-06-13T02:31:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "op_reply": 145551, 2024-06-13T02:31:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "op_latency": { 2024-06-13T02:31:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 145551, 2024-06-13T02:31:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 3833.704504114, 2024-06-13T02:31:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.026339252 2024-06-13T02:31:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.789 INFO:teuthology.orchestra.run.smithi084.stdout: "op_inflight": 0, 2024-06-13T02:31:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: "oplen_avg": { 2024-06-13T02:31:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 145551, 2024-06-13T02:31:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 194939 2024-06-13T02:31:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: "op": 145551, 2024-06-13T02:31:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: "op_r": 696, 2024-06-13T02:31:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: "op_w": 144855, 2024-06-13T02:31:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: "op_rmw": 0, 2024-06-13T02:31:30.790 INFO:teuthology.orchestra.run.smithi084.stdout: "op_pg": 0, 2024-06-13T02:31:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_stat": 1717, 2024-06-13T02:31:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_create": 29214, 2024-06-13T02:31:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_read": 678, 2024-06-13T02:31:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_write": 51847, 2024-06-13T02:31:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writefull": 630, 2024-06-13T02:31:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writesame": 0, 2024-06-13T02:31:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_append": 0, 2024-06-13T02:31:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_zero": 0, 2024-06-13T02:31:30.791 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_truncate": 4, 2024-06-13T02:31:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_delete": 60524, 2024-06-13T02:31:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_mapext": 0, 2024-06-13T02:31:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_sparse_read": 0, 2024-06-13T02:31:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_clonerange": 0, 2024-06-13T02:31:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_getxattr": 0, 2024-06-13T02:31:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_setxattr": 44018, 2024-06-13T02:31:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_cmpxattr": 0, 2024-06-13T02:31:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_rmxattr": 0, 2024-06-13T02:31:30.792 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_resetxattrs": 0, 2024-06-13T02:31:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_call": 0, 2024-06-13T02:31:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_watch": 0, 2024-06-13T02:31:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_notify": 0, 2024-06-13T02:31:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_src_cmpxattr": 0, 2024-06-13T02:31:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls": 0, 2024-06-13T02:31:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls_filter": 0, 2024-06-13T02:31:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_other": 0, 2024-06-13T02:31:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_active": 0, 2024-06-13T02:31:30.793 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_send": 0, 2024-06-13T02:31:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_resend": 0, 2024-06-13T02:31:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_ping": 0, 2024-06-13T02:31:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_active": 0, 2024-06-13T02:31:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_send": 0, 2024-06-13T02:31:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_resend": 0, 2024-06-13T02:31:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_active": 0, 2024-06-13T02:31:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_send": 0, 2024-06-13T02:31:30.794 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_resend": 0, 2024-06-13T02:31:30.795 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_active": 0, 2024-06-13T02:31:30.795 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_send": 0, 2024-06-13T02:31:30.795 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_resend": 0, 2024-06-13T02:31:30.795 INFO:teuthology.orchestra.run.smithi084.stdout: "command_active": 0, 2024-06-13T02:31:30.795 INFO:teuthology.orchestra.run.smithi084.stdout: "command_send": 0, 2024-06-13T02:31:30.795 INFO:teuthology.orchestra.run.smithi084.stdout: "command_resend": 0, 2024-06-13T02:31:30.795 INFO:teuthology.orchestra.run.smithi084.stdout: "map_epoch": 121, 2024-06-13T02:31:30.795 INFO:teuthology.orchestra.run.smithi084.stdout: "map_full": 0, 2024-06-13T02:31:30.795 INFO:teuthology.orchestra.run.smithi084.stdout: "map_inc": 32, 2024-06-13T02:31:30.796 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_sessions": 12, 2024-06-13T02:31:30.796 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_open": 12, 2024-06-13T02:31:30.796 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_close": 0, 2024-06-13T02:31:30.796 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_laggy": 0, 2024-06-13T02:31:30.796 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_wr": 4917, 2024-06-13T02:31:30.796 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_rd": 23, 2024-06-13T02:31:30.796 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_del": 1367 2024-06-13T02:31:30.796 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.796 INFO:teuthology.orchestra.run.smithi084.stdout: "oft": { 2024-06-13T02:31:30.797 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_objs": 1, 2024-06-13T02:31:30.797 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_kv_pairs": 0, 2024-06-13T02:31:30.797 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_updates": 0, 2024-06-13T02:31:30.797 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_removes": 0 2024-06-13T02:31:30.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.797 INFO:teuthology.orchestra.run.smithi084.stdout: "osd-slow-ops": { 2024-06-13T02:31:30.797 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_ops_count": 1 2024-06-13T02:31:30.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.797 INFO:teuthology.orchestra.run.smithi084.stdout: "purge_queue": { 2024-06-13T02:31:30.798 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops": 0, 2024-06-13T02:31:30.798 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops_high_water": 16, 2024-06-13T02:31:30.798 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing": 0, 2024-06-13T02:31:30.798 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_high_water": 8, 2024-06-13T02:31:30.798 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed_ops": 59736, 2024-06-13T02:31:30.798 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed": 29868, 2024-06-13T02:31:30.798 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_item_in_journal": 0 2024-06-13T02:31:30.798 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.798 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T02:31:30.799 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:30.799 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-06-13T02:31:30.799 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:30.799 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 574526, 2024-06-13T02:31:30.799 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 108979329, 2024-06-13T02:31:30.799 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:30.799 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 574526, 2024-06-13T02:31:30.799 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-06-13T02:31:30.800 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-06-13T02:31:30.800 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 574526, 2024-06-13T02:31:30.800 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 108979329, 2024-06-13T02:31:30.800 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:30.800 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.800 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.800 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.800 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:30.800 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.800 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_bytes": { 2024-06-13T02:31:30.801 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:30.801 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-06-13T02:31:30.801 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:30.801 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-06-13T02:31:30.801 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-06-13T02:31:30.801 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:30.801 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:30.801 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 145551, 2024-06-13T02:31:30.802 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 585288841, 2024-06-13T02:31:30.802 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 145551, 2024-06-13T02:31:30.802 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 585288841, 2024-06-13T02:31:30.802 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:30.802 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.802 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.802 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.802 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:30.802 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.803 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_ops": { 2024-06-13T02:31:30.803 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:30.803 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 1024, 2024-06-13T02:31:30.803 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:30.803 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-06-13T02:31:30.803 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-06-13T02:31:30.803 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:30.803 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:30.804 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 145551, 2024-06-13T02:31:30.804 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 145551, 2024-06-13T02:31:30.804 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 145551, 2024-06-13T02:31:30.804 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 145551, 2024-06-13T02:31:30.804 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:30.804 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.804 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.804 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.804 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:30.805 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.805 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle": { 2024-06-13T02:31:30.805 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:30.805 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-06-13T02:31:30.805 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:30.805 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 29868, 2024-06-13T02:31:30.805 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 3262060, 2024-06-13T02:31:30.805 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:30.805 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 29868, 2024-06-13T02:31:30.805 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-06-13T02:31:30.806 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-06-13T02:31:30.806 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 678, 2024-06-13T02:31:30.806 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 3262060, 2024-06-13T02:31:30.806 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:30.806 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.806 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.806 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.806 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:30.807 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:30.809 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle-0x55deac4f4460": { 2024-06-13T02:31:30.809 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:30.809 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-06-13T02:31:30.810 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:30.810 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 139960, 2024-06-13T02:31:30.810 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 554715511, 2024-06-13T02:31:30.810 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:30.810 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 139960, 2024-06-13T02:31:30.810 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-06-13T02:31:30.810 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-06-13T02:31:30.810 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 51169, 2024-06-13T02:31:30.811 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 554715511, 2024-06-13T02:31:30.811 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:30.811 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:30.811 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:30.811 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:30.811 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:30.811 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:30.811 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-06-13T02:31:31.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:31 smithi002 ceph-mon[31960]: pgmap v433: 129 pgs: 129 active+clean; 272 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 105 KiB/s wr, 11 op/s 2024-06-13T02:31:31.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:31 smithi084 ceph-mon[36833]: pgmap v433: 129 pgs: 129 active+clean; 272 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 105 KiB/s wr, 11 op/s 2024-06-13T02:31:31.527 INFO:tasks.check_counter:Daemon mds.b mds.exported=18 2024-06-13T02:31:31.527 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-06-13T02:31:31.527 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-06-13T02:31:31.527 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=14 2024-06-13T02:31:31.527 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=8 2024-06-13T02:31:31.527 DEBUG:tasks.check_counter:Getting stats from e 2024-06-13T02:31:31.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph daemon mds.e perf dump 2024-06-13T02:31:31.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:31 smithi175 ceph-mon[36977]: pgmap v433: 129 pgs: 129 active+clean; 272 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 105 KiB/s wr, 11 op/s 2024-06-13T02:31:31.794 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T02:31:33.345 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:33 smithi084 ceph-mon[36833]: pgmap v434: 129 pgs: 129 active+clean; 274 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 240 KiB/s wr, 19 op/s 2024-06-13T02:31:33.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:33 smithi002 ceph-mon[31960]: pgmap v434: 129 pgs: 129 active+clean; 274 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 240 KiB/s wr, 19 op/s 2024-06-13T02:31:33.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:33 smithi175 ceph-mon[36977]: pgmap v434: 129 pgs: 129 active+clean; 274 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 240 KiB/s wr, 19 op/s 2024-06-13T02:31:33.788 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-06-13T02:31:33.788 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T02:31:33.788 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 691, 2024-06-13T02:31:33.788 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 829, 2024-06-13T02:31:33.788 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 5978992, 2024-06-13T02:31:33.789 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 684080, 2024-06-13T02:31:33.789 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 6, 2024-06-13T02:31:33.789 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 2, 2024-06-13T02:31:33.789 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.085269579, 2024-06-13T02:31:33.789 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.026486959, 2024-06-13T02:31:33.789 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.050214871, 2024-06-13T02:31:33.789 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.014997766, 2024-06-13T02:31:33.789 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:33.790 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 829, 2024-06-13T02:31:33.790 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.041705422, 2024-06-13T02:31:33.790 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000050308 2024-06-13T02:31:33.790 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.790 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:33.790 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.790 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.790 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.791 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.791 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 1703936, 2024-06-13T02:31:33.791 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 582320 2024-06-13T02:31:33.791 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.791 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T02:31:33.791 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 1022, 2024-06-13T02:31:33.791 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 1094, 2024-06-13T02:31:33.791 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 12839966, 2024-06-13T02:31:33.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 570365, 2024-06-13T02:31:33.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 8, 2024-06-13T02:31:33.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 5, 2024-06-13T02:31:33.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.080470274, 2024-06-13T02:31:33.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.023085327, 2024-06-13T02:31:33.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.027566175, 2024-06-13T02:31:33.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.022923440, 2024-06-13T02:31:33.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:33.793 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 1091, 2024-06-13T02:31:33.793 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.031199130, 2024-06-13T02:31:33.793 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000028596 2024-06-13T02:31:33.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.793 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:33.793 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.793 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.793 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-13T02:31:33.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 246000 2024-06-13T02:31:33.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.794 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T02:31:33.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 2090, 2024-06-13T02:31:33.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 2092, 2024-06-13T02:31:33.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 11350683, 2024-06-13T02:31:33.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 664684, 2024-06-13T02:31:33.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 5, 2024-06-13T02:31:33.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 4, 2024-06-13T02:31:33.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.168144140, 2024-06-13T02:31:33.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.053011478, 2024-06-13T02:31:33.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.047387755, 2024-06-13T02:31:33.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.053381294, 2024-06-13T02:31:33.796 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:33.796 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 2090, 2024-06-13T02:31:33.796 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.066708564, 2024-06-13T02:31:33.796 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000031917 2024-06-13T02:31:33.796 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.796 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:33.796 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.796 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.797 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.797 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-13T02:31:33.797 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 0 2024-06-13T02:31:33.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.797 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-06-13T02:31:33.797 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 1, 2024-06-13T02:31:33.797 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-06-13T02:31:33.798 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.798 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-MDSRank": { 2024-06-13T02:31:33.798 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-06-13T02:31:33.798 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-06-13T02:31:33.798 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 6014, 2024-06-13T02:31:33.798 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.127977387, 2024-06-13T02:31:33.798 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000021279 2024-06-13T02:31:33.798 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:33.799 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.799 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-PurgeQueue": { 2024-06-13T02:31:33.799 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-06-13T02:31:33.799 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-06-13T02:31:33.799 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.799 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.799 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.799 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:33.800 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.800 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-06-13T02:31:33.800 INFO:teuthology.orchestra.run.smithi084.stdout: "request": 0, 2024-06-13T02:31:33.800 INFO:teuthology.orchestra.run.smithi084.stdout: "reply": 0, 2024-06-13T02:31:33.800 INFO:teuthology.orchestra.run.smithi084.stdout: "reply_latency": { 2024-06-13T02:31:33.800 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.800 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.800 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.801 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.801 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_reply": 0, 2024-06-13T02:31:33.801 INFO:teuthology.orchestra.run.smithi084.stdout: "forward": 0, 2024-06-13T02:31:33.801 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_complete": 0, 2024-06-13T02:31:33.801 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_keys": 0, 2024-06-13T02:31:33.801 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_commit": 0, 2024-06-13T02:31:33.801 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_split": 0, 2024-06-13T02:31:33.801 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_merge": 0, 2024-06-13T02:31:33.802 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes": 2739, 2024-06-13T02:31:33.802 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_top": 4, 2024-06-13T02:31:33.802 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_bottom": 2735, 2024-06-13T02:31:33.802 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pin_tail": 0, 2024-06-13T02:31:33.802 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pinned": 2733, 2024-06-13T02:31:33.802 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_expired": 0, 2024-06-13T02:31:33.802 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_with_caps": 0, 2024-06-13T02:31:33.802 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": 0, 2024-06-13T02:31:33.803 INFO:teuthology.orchestra.run.smithi084.stdout: "subtrees": 10, 2024-06-13T02:31:33.803 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse": 0, 2024-06-13T02:31:33.803 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_hit": 0, 2024-06-13T02:31:33.803 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_forward": 0, 2024-06-13T02:31:33.803 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_discover": 0, 2024-06-13T02:31:33.803 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_dir_fetch": 0, 2024-06-13T02:31:33.803 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_remote_ino": 0, 2024-06-13T02:31:33.803 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_lock": 0, 2024-06-13T02:31:33.803 INFO:teuthology.orchestra.run.smithi084.stdout: "load_cent": 0, 2024-06-13T02:31:33.804 INFO:teuthology.orchestra.run.smithi084.stdout: "q": 0, 2024-06-13T02:31:33.804 INFO:teuthology.orchestra.run.smithi084.stdout: "exported": 0, 2024-06-13T02:31:33.804 INFO:teuthology.orchestra.run.smithi084.stdout: "exported_inodes": 0, 2024-06-13T02:31:33.804 INFO:teuthology.orchestra.run.smithi084.stdout: "imported": 0, 2024-06-13T02:31:33.804 INFO:teuthology.orchestra.run.smithi084.stdout: "imported_inodes": 0, 2024-06-13T02:31:33.804 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_dir_fetch": 0, 2024-06-13T02:31:33.804 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_backtrace_fetch": 0, 2024-06-13T02:31:33.804 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_peer_discover": 0, 2024-06-13T02:31:33.805 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rfiles": 0, 2024-06-13T02:31:33.805 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rbytes": 0, 2024-06-13T02:31:33.805 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rsnaps": 0, 2024-06-13T02:31:33.805 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_fetch": 0, 2024-06-13T02:31:33.805 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_set_tag": 0, 2024-06-13T02:31:33.805 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_repaired": 0, 2024-06-13T02:31:33.805 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_inotable_repaired": 0, 2024-06-13T02:31:33.805 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_inodes": 0, 2024-06-13T02:31:33.806 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_base_inodes": 0, 2024-06-13T02:31:33.806 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dirfrag_rstats": 0, 2024-06-13T02:31:33.806 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_file_inodes": 0, 2024-06-13T02:31:33.806 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_inode_file_caps": 0, 2024-06-13T02:31:33.806 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_revoke": 0, 2024-06-13T02:31:33.806 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_grant": 0, 2024-06-13T02:31:33.806 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_trunc": 0, 2024-06-13T02:31:33.806 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-13T02:31:33.807 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-13T02:31:33.807 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps": 0, 2024-06-13T02:31:33.807 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps_dirty": 0, 2024-06-13T02:31:33.807 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_cap_release": 0, 2024-06-13T02:31:33.807 INFO:teuthology.orchestra.run.smithi084.stdout: "process_request_cap_release": 0 2024-06-13T02:31:33.807 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.807 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_cache": { 2024-06-13T02:31:33.807 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update": 0, 2024-06-13T02:31:33.808 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update_receipt": 0, 2024-06-13T02:31:33.808 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_try_discover": 0, 2024-06-13T02:31:33.808 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_send_discover": 0, 2024-06-13T02:31:33.808 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_handle_discover": 0, 2024-06-13T02:31:33.808 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays": 0, 2024-06-13T02:31:33.808 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_delayed": 0, 2024-06-13T02:31:33.808 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_enqueuing": 0, 2024-06-13T02:31:33.809 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_created": 0, 2024-06-13T02:31:33.809 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_enqueued": 0, 2024-06-13T02:31:33.809 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_reintegrated": 0, 2024-06-13T02:31:33.809 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_migrated": 0, 2024-06-13T02:31:33.809 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_processing": 0, 2024-06-13T02:31:33.809 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_enqueued": 0, 2024-06-13T02:31:33.809 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_prioritized": 0, 2024-06-13T02:31:33.810 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_started": 0, 2024-06-13T02:31:33.810 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_completed": 0, 2024-06-13T02:31:33.810 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_path": 0, 2024-06-13T02:31:33.810 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_inode": 0, 2024-06-13T02:31:33.810 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_enqueue_scrub": 0, 2024-06-13T02:31:33.810 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_exportdir": 0, 2024-06-13T02:31:33.810 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_flush": 0, 2024-06-13T02:31:33.810 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragmentdir": 0, 2024-06-13T02:31:33.811 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragstats": 0, 2024-06-13T02:31:33.811 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_inodestats": 0 2024-06-13T02:31:33.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.811 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_log": { 2024-06-13T02:31:33.811 INFO:teuthology.orchestra.run.smithi084.stdout: "evlrg": 0, 2024-06-13T02:31:33.811 INFO:teuthology.orchestra.run.smithi084.stdout: "evadd": 0, 2024-06-13T02:31:33.811 INFO:teuthology.orchestra.run.smithi084.stdout: "evex": 0, 2024-06-13T02:31:33.812 INFO:teuthology.orchestra.run.smithi084.stdout: "evtrm": 0, 2024-06-13T02:31:33.812 INFO:teuthology.orchestra.run.smithi084.stdout: "ev": 16307, 2024-06-13T02:31:33.812 INFO:teuthology.orchestra.run.smithi084.stdout: "evexg": 0, 2024-06-13T02:31:33.812 INFO:teuthology.orchestra.run.smithi084.stdout: "evexd": 0, 2024-06-13T02:31:33.812 INFO:teuthology.orchestra.run.smithi084.stdout: "segadd": 0, 2024-06-13T02:31:33.812 INFO:teuthology.orchestra.run.smithi084.stdout: "segex": 0, 2024-06-13T02:31:33.812 INFO:teuthology.orchestra.run.smithi084.stdout: "segtrm": 0, 2024-06-13T02:31:33.812 INFO:teuthology.orchestra.run.smithi084.stdout: "seg": 21, 2024-06-13T02:31:33.813 INFO:teuthology.orchestra.run.smithi084.stdout: "segmjr": 3, 2024-06-13T02:31:33.813 INFO:teuthology.orchestra.run.smithi084.stdout: "segexg": 0, 2024-06-13T02:31:33.813 INFO:teuthology.orchestra.run.smithi084.stdout: "segexd": 0, 2024-06-13T02:31:33.813 INFO:teuthology.orchestra.run.smithi084.stdout: "expos": 4194304, 2024-06-13T02:31:33.813 INFO:teuthology.orchestra.run.smithi084.stdout: "wrpos": 31704192, 2024-06-13T02:31:33.813 INFO:teuthology.orchestra.run.smithi084.stdout: "rdpos": 31701055, 2024-06-13T02:31:33.813 INFO:teuthology.orchestra.run.smithi084.stdout: "jlat": { 2024-06-13T02:31:33.813 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.814 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.814 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.814 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.814 INFO:teuthology.orchestra.run.smithi084.stdout: "replayed": 16307 2024-06-13T02:31:33.814 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.814 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_mem": { 2024-06-13T02:31:33.814 INFO:teuthology.orchestra.run.smithi084.stdout: "ino": 362, 2024-06-13T02:31:33.815 INFO:teuthology.orchestra.run.smithi084.stdout: "ino+": 2718, 2024-06-13T02:31:33.815 INFO:teuthology.orchestra.run.smithi084.stdout: "ino-": 2356, 2024-06-13T02:31:33.815 INFO:teuthology.orchestra.run.smithi084.stdout: "dir": 53, 2024-06-13T02:31:33.815 INFO:teuthology.orchestra.run.smithi084.stdout: "dir+": 56, 2024-06-13T02:31:33.815 INFO:teuthology.orchestra.run.smithi084.stdout: "dir-": 3, 2024-06-13T02:31:33.815 INFO:teuthology.orchestra.run.smithi084.stdout: "dn": 2739, 2024-06-13T02:31:33.815 INFO:teuthology.orchestra.run.smithi084.stdout: "dn+": 2799, 2024-06-13T02:31:33.815 INFO:teuthology.orchestra.run.smithi084.stdout: "dn-": 60, 2024-06-13T02:31:33.816 INFO:teuthology.orchestra.run.smithi084.stdout: "cap": 0, 2024-06-13T02:31:33.816 INFO:teuthology.orchestra.run.smithi084.stdout: "cap+": 0, 2024-06-13T02:31:33.816 INFO:teuthology.orchestra.run.smithi084.stdout: "cap-": 0, 2024-06-13T02:31:33.816 INFO:teuthology.orchestra.run.smithi084.stdout: "rss": 54960, 2024-06-13T02:31:33.816 INFO:teuthology.orchestra.run.smithi084.stdout: "heap": 215420 2024-06-13T02:31:33.816 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.816 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_server": { 2024-06-13T02:31:33.817 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_client_request": 0, 2024-06-13T02:31:33.817 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_server_request": 0, 2024-06-13T02:31:33.817 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_request": 0, 2024-06-13T02:31:33.817 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_session": 0, 2024-06-13T02:31:33.817 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_peer_request": 0, 2024-06-13T02:31:33.817 INFO:teuthology.orchestra.run.smithi084.stdout: "req_create_latency": { 2024-06-13T02:31:33.817 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.817 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.818 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.818 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.818 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getattr_latency": { 2024-06-13T02:31:33.818 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.818 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.818 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.818 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.818 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getfilelock_latency": { 2024-06-13T02:31:33.819 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.819 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.819 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.819 INFO:teuthology.orchestra.run.smithi084.stdout: "req_link_latency": { 2024-06-13T02:31:33.819 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.819 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.819 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.820 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.820 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookup_latency": { 2024-06-13T02:31:33.820 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.820 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.820 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.820 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.820 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookuphash_latency": { 2024-06-13T02:31:33.821 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.821 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.821 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.821 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.821 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupino_latency": { 2024-06-13T02:31:33.821 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.821 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.821 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.822 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.822 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupname_latency": { 2024-06-13T02:31:33.822 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.822 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.822 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.822 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.822 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupparent_latency": { 2024-06-13T02:31:33.822 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.823 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.823 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.823 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupsnap_latency": { 2024-06-13T02:31:33.823 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.823 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.823 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.824 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lssnap_latency": { 2024-06-13T02:31:33.824 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.824 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.824 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.824 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.824 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mkdir_latency": { 2024-06-13T02:31:33.824 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.824 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.825 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.825 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mknod_latency": { 2024-06-13T02:31:33.825 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.825 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.825 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.825 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mksnap_latency": { 2024-06-13T02:31:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: "req_open_latency": { 2024-06-13T02:31:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.826 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.827 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.827 INFO:teuthology.orchestra.run.smithi084.stdout: "req_readdir_latency": { 2024-06-13T02:31:33.827 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.827 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.827 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.827 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.827 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rename_latency": { 2024-06-13T02:31:33.828 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.828 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.828 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.828 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.828 INFO:teuthology.orchestra.run.smithi084.stdout: "req_renamesnap_latency": { 2024-06-13T02:31:33.828 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.828 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.828 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: "req_snapdiff_latency": { 2024-06-13T02:31:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmdir_latency": { 2024-06-13T02:31:33.829 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmsnap_latency": { 2024-06-13T02:31:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.831 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmxattr_latency": { 2024-06-13T02:31:33.831 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.831 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.831 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.831 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.831 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setattr_latency": { 2024-06-13T02:31:33.831 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.831 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setdirlayout_latency": { 2024-06-13T02:31:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.832 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setfilelock_latency": { 2024-06-13T02:31:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setlayout_latency": { 2024-06-13T02:31:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.833 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setxattr_latency": { 2024-06-13T02:31:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.834 INFO:teuthology.orchestra.run.smithi084.stdout: "req_symlink_latency": { 2024-06-13T02:31:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: "req_unlink_latency": { 2024-06-13T02:31:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_revoke_eviction": 0, 2024-06-13T02:31:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_acquisition_throttle": 0, 2024-06-13T02:31:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getvxattr_latency": { 2024-06-13T02:31:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:33.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_sessions": { 2024-06-13T02:31:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: "session_count": 2, 2024-06-13T02:31:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: "session_add": 4, 2024-06-13T02:31:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: "session_remove": 2, 2024-06-13T02:31:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_open": 4, 2024-06-13T02:31:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_stale": 0, 2024-06-13T02:31:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: "total_load": 0, 2024-06-13T02:31:33.837 INFO:teuthology.orchestra.run.smithi084.stdout: "average_load": 0, 2024-06-13T02:31:33.838 INFO:teuthology.orchestra.run.smithi084.stdout: "avg_session_uptime": 4536, 2024-06-13T02:31:33.838 INFO:teuthology.orchestra.run.smithi084.stdout: "mdthresh_evicted": 0 2024-06-13T02:31:33.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.838 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-06-13T02:31:33.838 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-06-13T02:31:33.838 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-06-13T02:31:33.838 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T02:31:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-06-13T02:31:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T02:31:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-06-13T02:31:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T02:31:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T02:31:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T02:31:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T02:31:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T02:31:33.839 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-06-13T02:31:33.840 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T02:31:33.840 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T02:31:33.840 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-06-13T02:31:33.840 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-06-13T02:31:33.840 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-06-13T02:31:33.840 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-06-13T02:31:33.840 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T02:31:33.840 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T02:31:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T02:31:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T02:31:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T02:31:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-06-13T02:31:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-06-13T02:31:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-06-13T02:31:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T02:31:33.841 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T02:31:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-06-13T02:31:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-06-13T02:31:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-06-13T02:31:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-06-13T02:31:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T02:31:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-06-13T02:31:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T02:31:33.842 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-06-13T02:31:33.843 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 221758, 2024-06-13T02:31:33.843 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 440, 2024-06-13T02:31:33.843 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-06-13T02:31:33.843 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-06-13T02:31:33.843 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-06-13T02:31:33.843 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-06-13T02:31:33.843 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-06-13T02:31:33.843 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-06-13T02:31:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-06-13T02:31:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-06-13T02:31:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 9800, 2024-06-13T02:31:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 188, 2024-06-13T02:31:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T02:31:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-06-13T02:31:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-06-13T02:31:33.844 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-06-13T02:31:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 2922603, 2024-06-13T02:31:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 21946, 2024-06-13T02:31:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-06-13T02:31:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-06-13T02:31:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-06-13T02:31:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-06-13T02:31:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.845 INFO:teuthology.orchestra.run.smithi084.stdout: "objecter": { 2024-06-13T02:31:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: "op_active": 0, 2024-06-13T02:31:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: "op_laggy": 0, 2024-06-13T02:31:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send": 3430, 2024-06-13T02:31:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send_bytes": 21, 2024-06-13T02:31:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: "op_resend": 3, 2024-06-13T02:31:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: "op_reply": 3430, 2024-06-13T02:31:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: "op_latency": { 2024-06-13T02:31:33.846 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 3430, 2024-06-13T02:31:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 3.417940672, 2024-06-13T02:31:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000996484 2024-06-13T02:31:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: "op_inflight": 0, 2024-06-13T02:31:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: "oplen_avg": { 2024-06-13T02:31:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 3430, 2024-06-13T02:31:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 3431 2024-06-13T02:31:33.847 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: "op": 3430, 2024-06-13T02:31:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: "op_r": 3430, 2024-06-13T02:31:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: "op_w": 0, 2024-06-13T02:31:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: "op_rmw": 0, 2024-06-13T02:31:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: "op_pg": 0, 2024-06-13T02:31:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_stat": 1860, 2024-06-13T02:31:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_create": 0, 2024-06-13T02:31:33.848 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_read": 1568, 2024-06-13T02:31:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_write": 0, 2024-06-13T02:31:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writefull": 0, 2024-06-13T02:31:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writesame": 0, 2024-06-13T02:31:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_append": 0, 2024-06-13T02:31:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_zero": 0, 2024-06-13T02:31:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_truncate": 0, 2024-06-13T02:31:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_delete": 0, 2024-06-13T02:31:33.849 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_mapext": 0, 2024-06-13T02:31:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_sparse_read": 0, 2024-06-13T02:31:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_clonerange": 0, 2024-06-13T02:31:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_getxattr": 1, 2024-06-13T02:31:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_setxattr": 0, 2024-06-13T02:31:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_cmpxattr": 0, 2024-06-13T02:31:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_rmxattr": 0, 2024-06-13T02:31:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_resetxattrs": 0, 2024-06-13T02:31:33.850 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_call": 0, 2024-06-13T02:31:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_watch": 0, 2024-06-13T02:31:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_notify": 0, 2024-06-13T02:31:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_src_cmpxattr": 0, 2024-06-13T02:31:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls": 0, 2024-06-13T02:31:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls_filter": 0, 2024-06-13T02:31:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_other": 0, 2024-06-13T02:31:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_active": 0, 2024-06-13T02:31:33.851 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_send": 0, 2024-06-13T02:31:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_resend": 0, 2024-06-13T02:31:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_ping": 0, 2024-06-13T02:31:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_active": 0, 2024-06-13T02:31:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_send": 0, 2024-06-13T02:31:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_resend": 0, 2024-06-13T02:31:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_active": 0, 2024-06-13T02:31:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_send": 0, 2024-06-13T02:31:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_resend": 0, 2024-06-13T02:31:33.852 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_active": 0, 2024-06-13T02:31:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_send": 0, 2024-06-13T02:31:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_resend": 0, 2024-06-13T02:31:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "command_active": 0, 2024-06-13T02:31:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "command_send": 0, 2024-06-13T02:31:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "command_resend": 0, 2024-06-13T02:31:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "map_epoch": 121, 2024-06-13T02:31:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "map_full": 0, 2024-06-13T02:31:33.853 INFO:teuthology.orchestra.run.smithi084.stdout: "map_inc": 23, 2024-06-13T02:31:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_sessions": 7, 2024-06-13T02:31:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_open": 7, 2024-06-13T02:31:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_close": 0, 2024-06-13T02:31:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_laggy": 0, 2024-06-13T02:31:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_wr": 0, 2024-06-13T02:31:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_rd": 2, 2024-06-13T02:31:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_del": 0 2024-06-13T02:31:33.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: "oft": { 2024-06-13T02:31:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_objs": 0, 2024-06-13T02:31:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_kv_pairs": 0, 2024-06-13T02:31:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_updates": 0, 2024-06-13T02:31:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_removes": 0 2024-06-13T02:31:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: "osd-slow-ops": { 2024-06-13T02:31:33.855 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_ops_count": 0 2024-06-13T02:31:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "purge_queue": { 2024-06-13T02:31:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops": 0, 2024-06-13T02:31:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops_high_water": 0, 2024-06-13T02:31:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing": 0, 2024-06-13T02:31:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_high_water": 0, 2024-06-13T02:31:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed_ops": 0, 2024-06-13T02:31:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed": 0, 2024-06-13T02:31:33.856 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_item_in_journal": 0 2024-06-13T02:31:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T02:31:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-06-13T02:31:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 3799, 2024-06-13T02:31:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 29806002, 2024-06-13T02:31:33.857 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 3799, 2024-06-13T02:31:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-06-13T02:31:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-06-13T02:31:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 3799, 2024-06-13T02:31:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 29806002, 2024-06-13T02:31:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.858 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_bytes": { 2024-06-13T02:31:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-06-13T02:31:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:33.859 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-06-13T02:31:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-06-13T02:31:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 3430, 2024-06-13T02:31:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 27509893, 2024-06-13T02:31:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 3430, 2024-06-13T02:31:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 27509893, 2024-06-13T02:31:33.860 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_ops": { 2024-06-13T02:31:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:33.861 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 1024, 2024-06-13T02:31:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-06-13T02:31:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-06-13T02:31:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 3430, 2024-06-13T02:31:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 3430, 2024-06-13T02:31:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 3430, 2024-06-13T02:31:33.862 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 3430, 2024-06-13T02:31:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle": { 2024-06-13T02:31:33.863 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-06-13T02:31:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-06-13T02:31:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-06-13T02:31:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-06-13T02:31:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-06-13T02:31:33.864 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 0, 2024-06-13T02:31:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 0, 2024-06-13T02:31:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle-0x55e5c1ea66e0": { 2024-06-13T02:31:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:33.865 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-06-13T02:31:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-06-13T02:31:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-06-13T02:31:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-06-13T02:31:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-06-13T02:31:33.866 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 0, 2024-06-13T02:31:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 0, 2024-06-13T02:31:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:33.867 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:33.867 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-06-13T02:31:35.043 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-06-13T02:31:35.043 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-06-13T02:31:35.043 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-06-13T02:31:35.043 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-06-13T02:31:35.043 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-06-13T02:31:35.043 DEBUG:tasks.check_counter:Getting stats from h 2024-06-13T02:31:35.044 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph daemon mds.h perf dump 2024-06-13T02:31:35.331 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T02:31:35.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:35 smithi002 ceph-mon[31960]: pgmap v435: 129 pgs: 129 active+clean; 274 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 222 KiB/s wr, 13 op/s 2024-06-13T02:31:35.453 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:35 smithi084 ceph-mon[36833]: pgmap v435: 129 pgs: 129 active+clean; 274 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 222 KiB/s wr, 13 op/s 2024-06-13T02:31:35.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:35 smithi175 ceph-mon[36977]: pgmap v435: 129 pgs: 129 active+clean; 274 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 222 KiB/s wr, 13 op/s 2024-06-13T02:31:37.227 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-06-13T02:31:37.228 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T02:31:37.228 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 266, 2024-06-13T02:31:37.228 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 268, 2024-06-13T02:31:37.228 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 22642477, 2024-06-13T02:31:37.228 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 84598, 2024-06-13T02:31:37.228 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 8, 2024-06-13T02:31:37.228 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 4, 2024-06-13T02:31:37.229 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.031155659, 2024-06-13T02:31:37.229 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.006606744, 2024-06-13T02:31:37.229 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.015974083, 2024-06-13T02:31:37.229 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.006107012, 2024-06-13T02:31:37.229 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:37.229 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 266, 2024-06-13T02:31:37.229 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.011433753, 2024-06-13T02:31:37.229 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000042984 2024-06-13T02:31:37.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.230 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:37.230 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.230 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.230 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.230 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-13T02:31:37.230 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 0 2024-06-13T02:31:37.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.231 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T02:31:37.231 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 172, 2024-06-13T02:31:37.231 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 169, 2024-06-13T02:31:37.231 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 25378192, 2024-06-13T02:31:37.231 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 62327, 2024-06-13T02:31:37.231 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 5, 2024-06-13T02:31:37.231 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 4, 2024-06-13T02:31:37.231 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.025793563, 2024-06-13T02:31:37.232 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.003907384, 2024-06-13T02:31:37.232 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.018798615, 2024-06-13T02:31:37.232 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.003435471, 2024-06-13T02:31:37.232 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:37.232 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 168, 2024-06-13T02:31:37.232 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.013754109, 2024-06-13T02:31:37.232 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000081869 2024-06-13T02:31:37.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.232 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:37.233 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.233 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.233 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.233 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 178144, 2024-06-13T02:31:37.233 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 23792 2024-06-13T02:31:37.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.233 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T02:31:37.233 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 164, 2024-06-13T02:31:37.233 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 190, 2024-06-13T02:31:37.234 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 25095258, 2024-06-13T02:31:37.234 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 185244, 2024-06-13T02:31:37.234 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 6, 2024-06-13T02:31:37.234 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 5, 2024-06-13T02:31:37.234 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.025425846, 2024-06-13T02:31:37.234 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.004318122, 2024-06-13T02:31:37.234 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.016423102, 2024-06-13T02:31:37.234 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.003549253, 2024-06-13T02:31:37.234 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:37.235 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 189, 2024-06-13T02:31:37.235 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.010859489, 2024-06-13T02:31:37.235 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000057457 2024-06-13T02:31:37.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.235 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:37.235 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.235 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.235 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.236 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-06-13T02:31:37.236 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 134672 2024-06-13T02:31:37.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.236 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-06-13T02:31:37.236 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 1, 2024-06-13T02:31:37.236 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-06-13T02:31:37.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.236 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-MDSRank": { 2024-06-13T02:31:37.236 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-06-13T02:31:37.237 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-06-13T02:31:37.237 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 891, 2024-06-13T02:31:37.237 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.038249629, 2024-06-13T02:31:37.237 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000042928 2024-06-13T02:31:37.237 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:37.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.237 INFO:teuthology.orchestra.run.smithi084.stdout: "finisher-PurgeQueue": { 2024-06-13T02:31:37.237 INFO:teuthology.orchestra.run.smithi084.stdout: "queue_len": 0, 2024-06-13T02:31:37.237 INFO:teuthology.orchestra.run.smithi084.stdout: "complete_latency": { 2024-06-13T02:31:37.238 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.238 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.238 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.238 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:37.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.238 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": { 2024-06-13T02:31:37.238 INFO:teuthology.orchestra.run.smithi084.stdout: "request": 0, 2024-06-13T02:31:37.238 INFO:teuthology.orchestra.run.smithi084.stdout: "reply": 0, 2024-06-13T02:31:37.239 INFO:teuthology.orchestra.run.smithi084.stdout: "reply_latency": { 2024-06-13T02:31:37.239 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.239 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.239 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.239 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_reply": 0, 2024-06-13T02:31:37.239 INFO:teuthology.orchestra.run.smithi084.stdout: "forward": 0, 2024-06-13T02:31:37.239 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_complete": 0, 2024-06-13T02:31:37.239 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_fetch_keys": 0, 2024-06-13T02:31:37.240 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_commit": 0, 2024-06-13T02:31:37.240 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_split": 0, 2024-06-13T02:31:37.240 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_merge": 0, 2024-06-13T02:31:37.240 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes": 4784, 2024-06-13T02:31:37.240 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_top": 1935, 2024-06-13T02:31:37.240 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_bottom": 2849, 2024-06-13T02:31:37.240 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pin_tail": 0, 2024-06-13T02:31:37.240 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_pinned": 2020, 2024-06-13T02:31:37.240 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_expired": 0, 2024-06-13T02:31:37.241 INFO:teuthology.orchestra.run.smithi084.stdout: "inodes_with_caps": 0, 2024-06-13T02:31:37.241 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": 0, 2024-06-13T02:31:37.241 INFO:teuthology.orchestra.run.smithi084.stdout: "subtrees": 14, 2024-06-13T02:31:37.241 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse": 0, 2024-06-13T02:31:37.241 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_hit": 0, 2024-06-13T02:31:37.241 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_forward": 0, 2024-06-13T02:31:37.241 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_discover": 0, 2024-06-13T02:31:37.241 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_dir_fetch": 0, 2024-06-13T02:31:37.241 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_remote_ino": 0, 2024-06-13T02:31:37.241 INFO:teuthology.orchestra.run.smithi084.stdout: "traverse_lock": 0, 2024-06-13T02:31:37.242 INFO:teuthology.orchestra.run.smithi084.stdout: "load_cent": 0, 2024-06-13T02:31:37.242 INFO:teuthology.orchestra.run.smithi084.stdout: "q": 0, 2024-06-13T02:31:37.242 INFO:teuthology.orchestra.run.smithi084.stdout: "exported": 0, 2024-06-13T02:31:37.242 INFO:teuthology.orchestra.run.smithi084.stdout: "exported_inodes": 0, 2024-06-13T02:31:37.242 INFO:teuthology.orchestra.run.smithi084.stdout: "imported": 0, 2024-06-13T02:31:37.242 INFO:teuthology.orchestra.run.smithi084.stdout: "imported_inodes": 0, 2024-06-13T02:31:37.242 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_dir_fetch": 0, 2024-06-13T02:31:37.242 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_backtrace_fetch": 0, 2024-06-13T02:31:37.243 INFO:teuthology.orchestra.run.smithi084.stdout: "openino_peer_discover": 0, 2024-06-13T02:31:37.243 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rfiles": 619, 2024-06-13T02:31:37.243 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rbytes": 200504774, 2024-06-13T02:31:37.243 INFO:teuthology.orchestra.run.smithi084.stdout: "root_rsnaps": 6, 2024-06-13T02:31:37.243 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_fetch": 0, 2024-06-13T02:31:37.243 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_set_tag": 0, 2024-06-13T02:31:37.243 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_backtrace_repaired": 0, 2024-06-13T02:31:37.243 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_inotable_repaired": 0, 2024-06-13T02:31:37.243 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_inodes": 0, 2024-06-13T02:31:37.244 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dir_base_inodes": 0, 2024-06-13T02:31:37.244 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_dirfrag_rstats": 0, 2024-06-13T02:31:37.244 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_file_inodes": 0, 2024-06-13T02:31:37.244 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_inode_file_caps": 0, 2024-06-13T02:31:37.244 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_revoke": 0, 2024-06-13T02:31:37.244 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_grant": 0, 2024-06-13T02:31:37.244 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_trunc": 0, 2024-06-13T02:31:37.244 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-13T02:31:37.244 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-13T02:31:37.244 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps": 0, 2024-06-13T02:31:37.245 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_caps_dirty": 0, 2024-06-13T02:31:37.245 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_cap_release": 0, 2024-06-13T02:31:37.245 INFO:teuthology.orchestra.run.smithi084.stdout: "process_request_cap_release": 0 2024-06-13T02:31:37.245 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.245 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_cache": { 2024-06-13T02:31:37.245 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update": 0, 2024-06-13T02:31:37.245 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_update_receipt": 0, 2024-06-13T02:31:37.245 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_try_discover": 0, 2024-06-13T02:31:37.246 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_send_discover": 0, 2024-06-13T02:31:37.246 INFO:teuthology.orchestra.run.smithi084.stdout: "dir_handle_discover": 0, 2024-06-13T02:31:37.246 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays": 0, 2024-06-13T02:31:37.246 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_delayed": 0, 2024-06-13T02:31:37.246 INFO:teuthology.orchestra.run.smithi084.stdout: "num_strays_enqueuing": 0, 2024-06-13T02:31:37.246 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_created": 0, 2024-06-13T02:31:37.246 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_enqueued": 0, 2024-06-13T02:31:37.246 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_reintegrated": 0, 2024-06-13T02:31:37.246 INFO:teuthology.orchestra.run.smithi084.stdout: "strays_migrated": 0, 2024-06-13T02:31:37.247 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_processing": 0, 2024-06-13T02:31:37.247 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_enqueued": 0, 2024-06-13T02:31:37.247 INFO:teuthology.orchestra.run.smithi084.stdout: "num_recovering_prioritized": 0, 2024-06-13T02:31:37.247 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_started": 0, 2024-06-13T02:31:37.247 INFO:teuthology.orchestra.run.smithi084.stdout: "recovery_completed": 0, 2024-06-13T02:31:37.247 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_path": 0, 2024-06-13T02:31:37.247 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_quiesce_inode": 0, 2024-06-13T02:31:37.247 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_enqueue_scrub": 0, 2024-06-13T02:31:37.247 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_exportdir": 0, 2024-06-13T02:31:37.248 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_flush": 0, 2024-06-13T02:31:37.248 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragmentdir": 0, 2024-06-13T02:31:37.248 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_fragstats": 0, 2024-06-13T02:31:37.248 INFO:teuthology.orchestra.run.smithi084.stdout: "ireq_inodestats": 0 2024-06-13T02:31:37.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.248 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_log": { 2024-06-13T02:31:37.248 INFO:teuthology.orchestra.run.smithi084.stdout: "evlrg": 0, 2024-06-13T02:31:37.248 INFO:teuthology.orchestra.run.smithi084.stdout: "evadd": 0, 2024-06-13T02:31:37.249 INFO:teuthology.orchestra.run.smithi084.stdout: "evex": 0, 2024-06-13T02:31:37.249 INFO:teuthology.orchestra.run.smithi084.stdout: "evtrm": 0, 2024-06-13T02:31:37.249 INFO:teuthology.orchestra.run.smithi084.stdout: "ev": 17270, 2024-06-13T02:31:37.249 INFO:teuthology.orchestra.run.smithi084.stdout: "evexg": 0, 2024-06-13T02:31:37.249 INFO:teuthology.orchestra.run.smithi084.stdout: "evexd": 0, 2024-06-13T02:31:37.249 INFO:teuthology.orchestra.run.smithi084.stdout: "segadd": 0, 2024-06-13T02:31:37.249 INFO:teuthology.orchestra.run.smithi084.stdout: "segex": 0, 2024-06-13T02:31:37.249 INFO:teuthology.orchestra.run.smithi084.stdout: "segtrm": 0, 2024-06-13T02:31:37.249 INFO:teuthology.orchestra.run.smithi084.stdout: "seg": 8, 2024-06-13T02:31:37.250 INFO:teuthology.orchestra.run.smithi084.stdout: "segmjr": 7, 2024-06-13T02:31:37.250 INFO:teuthology.orchestra.run.smithi084.stdout: "segexg": 0, 2024-06-13T02:31:37.250 INFO:teuthology.orchestra.run.smithi084.stdout: "segexd": 0, 2024-06-13T02:31:37.250 INFO:teuthology.orchestra.run.smithi084.stdout: "expos": 544732568, 2024-06-13T02:31:37.250 INFO:teuthology.orchestra.run.smithi084.stdout: "wrpos": 559428940, 2024-06-13T02:31:37.250 INFO:teuthology.orchestra.run.smithi084.stdout: "rdpos": 559421217, 2024-06-13T02:31:37.250 INFO:teuthology.orchestra.run.smithi084.stdout: "jlat": { 2024-06-13T02:31:37.250 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.250 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.251 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.251 INFO:teuthology.orchestra.run.smithi084.stdout: "replayed": 17270 2024-06-13T02:31:37.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.251 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_mem": { 2024-06-13T02:31:37.251 INFO:teuthology.orchestra.run.smithi084.stdout: "ino": 1051, 2024-06-13T02:31:37.251 INFO:teuthology.orchestra.run.smithi084.stdout: "ino+": 4756, 2024-06-13T02:31:37.251 INFO:teuthology.orchestra.run.smithi084.stdout: "ino-": 3705, 2024-06-13T02:31:37.251 INFO:teuthology.orchestra.run.smithi084.stdout: "dir": 119, 2024-06-13T02:31:37.252 INFO:teuthology.orchestra.run.smithi084.stdout: "dir+": 143, 2024-06-13T02:31:37.252 INFO:teuthology.orchestra.run.smithi084.stdout: "dir-": 24, 2024-06-13T02:31:37.252 INFO:teuthology.orchestra.run.smithi084.stdout: "dn": 4784, 2024-06-13T02:31:37.252 INFO:teuthology.orchestra.run.smithi084.stdout: "dn+": 5092, 2024-06-13T02:31:37.252 INFO:teuthology.orchestra.run.smithi084.stdout: "dn-": 308, 2024-06-13T02:31:37.252 INFO:teuthology.orchestra.run.smithi084.stdout: "cap": 0, 2024-06-13T02:31:37.252 INFO:teuthology.orchestra.run.smithi084.stdout: "cap+": 0, 2024-06-13T02:31:37.252 INFO:teuthology.orchestra.run.smithi084.stdout: "cap-": 0, 2024-06-13T02:31:37.253 INFO:teuthology.orchestra.run.smithi084.stdout: "rss": 59416, 2024-06-13T02:31:37.253 INFO:teuthology.orchestra.run.smithi084.stdout: "heap": 215396 2024-06-13T02:31:37.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.253 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_server": { 2024-06-13T02:31:37.253 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_client_request": 0, 2024-06-13T02:31:37.253 INFO:teuthology.orchestra.run.smithi084.stdout: "dispatch_server_request": 0, 2024-06-13T02:31:37.253 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_request": 0, 2024-06-13T02:31:37.253 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_client_session": 0, 2024-06-13T02:31:37.254 INFO:teuthology.orchestra.run.smithi084.stdout: "handle_peer_request": 0, 2024-06-13T02:31:37.254 INFO:teuthology.orchestra.run.smithi084.stdout: "req_create_latency": { 2024-06-13T02:31:37.254 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.254 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.254 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.254 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getattr_latency": { 2024-06-13T02:31:37.254 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.254 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.255 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.255 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getfilelock_latency": { 2024-06-13T02:31:37.255 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.255 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.255 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.255 INFO:teuthology.orchestra.run.smithi084.stdout: "req_link_latency": { 2024-06-13T02:31:37.255 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.256 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.256 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.256 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookup_latency": { 2024-06-13T02:31:37.256 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.256 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.256 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.256 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookuphash_latency": { 2024-06-13T02:31:37.257 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.257 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.257 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.257 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupino_latency": { 2024-06-13T02:31:37.257 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.257 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.257 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.258 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupname_latency": { 2024-06-13T02:31:37.258 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.258 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.258 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.258 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupparent_latency": { 2024-06-13T02:31:37.258 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.258 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.258 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.259 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lookupsnap_latency": { 2024-06-13T02:31:37.259 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.259 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.259 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.259 INFO:teuthology.orchestra.run.smithi084.stdout: "req_lssnap_latency": { 2024-06-13T02:31:37.259 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.259 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.260 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.260 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mkdir_latency": { 2024-06-13T02:31:37.261 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.261 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.261 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.261 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mknod_latency": { 2024-06-13T02:31:37.261 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.261 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.261 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.262 INFO:teuthology.orchestra.run.smithi084.stdout: "req_mksnap_latency": { 2024-06-13T02:31:37.262 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.262 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.262 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.262 INFO:teuthology.orchestra.run.smithi084.stdout: "req_open_latency": { 2024-06-13T02:31:37.262 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.262 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.263 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.263 INFO:teuthology.orchestra.run.smithi084.stdout: "req_readdir_latency": { 2024-06-13T02:31:37.263 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.263 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.263 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.263 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rename_latency": { 2024-06-13T02:31:37.263 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.264 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.264 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.264 INFO:teuthology.orchestra.run.smithi084.stdout: "req_renamesnap_latency": { 2024-06-13T02:31:37.264 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.264 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.264 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.264 INFO:teuthology.orchestra.run.smithi084.stdout: "req_snapdiff_latency": { 2024-06-13T02:31:37.265 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.265 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.265 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.265 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmdir_latency": { 2024-06-13T02:31:37.265 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.265 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.265 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.265 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmsnap_latency": { 2024-06-13T02:31:37.266 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.266 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.266 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.266 INFO:teuthology.orchestra.run.smithi084.stdout: "req_rmxattr_latency": { 2024-06-13T02:31:37.266 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.266 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.266 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.267 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setattr_latency": { 2024-06-13T02:31:37.267 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.267 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.267 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.267 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setdirlayout_latency": { 2024-06-13T02:31:37.267 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.267 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.268 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.268 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setfilelock_latency": { 2024-06-13T02:31:37.268 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.268 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.268 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.268 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setlayout_latency": { 2024-06-13T02:31:37.268 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.269 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.269 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.269 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.269 INFO:teuthology.orchestra.run.smithi084.stdout: "req_setxattr_latency": { 2024-06-13T02:31:37.269 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.269 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.269 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.269 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.269 INFO:teuthology.orchestra.run.smithi084.stdout: "req_symlink_latency": { 2024-06-13T02:31:37.270 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.270 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.270 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.270 INFO:teuthology.orchestra.run.smithi084.stdout: "req_unlink_latency": { 2024-06-13T02:31:37.270 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.270 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.270 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.271 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_revoke_eviction": 0, 2024-06-13T02:31:37.271 INFO:teuthology.orchestra.run.smithi084.stdout: "cap_acquisition_throttle": 0, 2024-06-13T02:31:37.271 INFO:teuthology.orchestra.run.smithi084.stdout: "req_getvxattr_latency": { 2024-06-13T02:31:37.271 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.271 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.271 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.271 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:37.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.272 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_sessions": { 2024-06-13T02:31:37.272 INFO:teuthology.orchestra.run.smithi084.stdout: "session_count": 2, 2024-06-13T02:31:37.272 INFO:teuthology.orchestra.run.smithi084.stdout: "session_add": 2, 2024-06-13T02:31:37.272 INFO:teuthology.orchestra.run.smithi084.stdout: "session_remove": 0, 2024-06-13T02:31:37.272 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_open": 0, 2024-06-13T02:31:37.272 INFO:teuthology.orchestra.run.smithi084.stdout: "sessions_stale": 0, 2024-06-13T02:31:37.272 INFO:teuthology.orchestra.run.smithi084.stdout: "total_load": 0, 2024-06-13T02:31:37.272 INFO:teuthology.orchestra.run.smithi084.stdout: "average_load": 0, 2024-06-13T02:31:37.272 INFO:teuthology.orchestra.run.smithi084.stdout: "avg_session_uptime": 2684, 2024-06-13T02:31:37.273 INFO:teuthology.orchestra.run.smithi084.stdout: "mdthresh_evicted": 0 2024-06-13T02:31:37.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.273 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-06-13T02:31:37.273 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-06-13T02:31:37.273 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-06-13T02:31:37.273 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T02:31:37.273 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-06-13T02:31:37.273 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T02:31:37.273 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-06-13T02:31:37.274 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T02:31:37.274 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T02:31:37.274 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T02:31:37.274 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T02:31:37.274 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T02:31:37.274 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-06-13T02:31:37.274 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T02:31:37.274 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T02:31:37.275 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-06-13T02:31:37.275 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-06-13T02:31:37.275 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-06-13T02:31:37.275 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-06-13T02:31:37.275 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T02:31:37.275 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T02:31:37.275 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T02:31:37.275 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T02:31:37.275 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T02:31:37.276 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-06-13T02:31:37.276 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-06-13T02:31:37.276 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-06-13T02:31:37.276 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T02:31:37.276 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T02:31:37.276 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-06-13T02:31:37.276 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-06-13T02:31:37.276 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-06-13T02:31:37.276 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-06-13T02:31:37.277 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T02:31:37.277 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-06-13T02:31:37.277 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T02:31:37.277 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-06-13T02:31:37.277 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 274401, 2024-06-13T02:31:37.277 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 1297, 2024-06-13T02:31:37.277 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-06-13T02:31:37.277 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-06-13T02:31:37.278 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-06-13T02:31:37.278 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-06-13T02:31:37.278 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-06-13T02:31:37.278 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-06-13T02:31:37.278 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-06-13T02:31:37.278 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-06-13T02:31:37.278 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 9800, 2024-06-13T02:31:37.278 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 188, 2024-06-13T02:31:37.278 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T02:31:37.279 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-06-13T02:31:37.279 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-06-13T02:31:37.279 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-06-13T02:31:37.279 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 6203719, 2024-06-13T02:31:37.279 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 55805, 2024-06-13T02:31:37.279 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-06-13T02:31:37.279 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-06-13T02:31:37.279 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-06-13T02:31:37.279 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-06-13T02:31:37.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.280 INFO:teuthology.orchestra.run.smithi084.stdout: "objecter": { 2024-06-13T02:31:37.280 INFO:teuthology.orchestra.run.smithi084.stdout: "op_active": 0, 2024-06-13T02:31:37.280 INFO:teuthology.orchestra.run.smithi084.stdout: "op_laggy": 0, 2024-06-13T02:31:37.280 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send": 546, 2024-06-13T02:31:37.280 INFO:teuthology.orchestra.run.smithi084.stdout: "op_send_bytes": 26, 2024-06-13T02:31:37.280 INFO:teuthology.orchestra.run.smithi084.stdout: "op_resend": 4, 2024-06-13T02:31:37.280 INFO:teuthology.orchestra.run.smithi084.stdout: "op_reply": 546, 2024-06-13T02:31:37.280 INFO:teuthology.orchestra.run.smithi084.stdout: "op_latency": { 2024-06-13T02:31:37.281 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 546, 2024-06-13T02:31:37.281 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.971983953, 2024-06-13T02:31:37.281 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.001780190 2024-06-13T02:31:37.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.281 INFO:teuthology.orchestra.run.smithi084.stdout: "op_inflight": 0, 2024-06-13T02:31:37.281 INFO:teuthology.orchestra.run.smithi084.stdout: "oplen_avg": { 2024-06-13T02:31:37.281 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 546, 2024-06-13T02:31:37.281 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 547 2024-06-13T02:31:37.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.282 INFO:teuthology.orchestra.run.smithi084.stdout: "op": 546, 2024-06-13T02:31:37.282 INFO:teuthology.orchestra.run.smithi084.stdout: "op_r": 546, 2024-06-13T02:31:37.282 INFO:teuthology.orchestra.run.smithi084.stdout: "op_w": 0, 2024-06-13T02:31:37.282 INFO:teuthology.orchestra.run.smithi084.stdout: "op_rmw": 0, 2024-06-13T02:31:37.282 INFO:teuthology.orchestra.run.smithi084.stdout: "op_pg": 0, 2024-06-13T02:31:37.282 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_stat": 295, 2024-06-13T02:31:37.282 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_create": 0, 2024-06-13T02:31:37.282 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_read": 248, 2024-06-13T02:31:37.282 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_write": 0, 2024-06-13T02:31:37.283 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writefull": 0, 2024-06-13T02:31:37.283 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_writesame": 0, 2024-06-13T02:31:37.283 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_append": 0, 2024-06-13T02:31:37.283 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_zero": 0, 2024-06-13T02:31:37.283 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_truncate": 0, 2024-06-13T02:31:37.283 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_delete": 0, 2024-06-13T02:31:37.283 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_mapext": 0, 2024-06-13T02:31:37.283 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_sparse_read": 0, 2024-06-13T02:31:37.283 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_clonerange": 0, 2024-06-13T02:31:37.284 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_getxattr": 2, 2024-06-13T02:31:37.284 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_setxattr": 0, 2024-06-13T02:31:37.284 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_cmpxattr": 0, 2024-06-13T02:31:37.284 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_rmxattr": 0, 2024-06-13T02:31:37.284 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_resetxattrs": 0, 2024-06-13T02:31:37.284 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_call": 0, 2024-06-13T02:31:37.284 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_watch": 0, 2024-06-13T02:31:37.284 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_notify": 0, 2024-06-13T02:31:37.284 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_src_cmpxattr": 0, 2024-06-13T02:31:37.285 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls": 0, 2024-06-13T02:31:37.285 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_pgls_filter": 0, 2024-06-13T02:31:37.285 INFO:teuthology.orchestra.run.smithi084.stdout: "osdop_other": 0, 2024-06-13T02:31:37.285 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_active": 0, 2024-06-13T02:31:37.285 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_send": 0, 2024-06-13T02:31:37.285 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_resend": 0, 2024-06-13T02:31:37.285 INFO:teuthology.orchestra.run.smithi084.stdout: "linger_ping": 0, 2024-06-13T02:31:37.285 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_active": 0, 2024-06-13T02:31:37.285 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_send": 0, 2024-06-13T02:31:37.286 INFO:teuthology.orchestra.run.smithi084.stdout: "poolop_resend": 0, 2024-06-13T02:31:37.286 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_active": 0, 2024-06-13T02:31:37.286 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_send": 0, 2024-06-13T02:31:37.286 INFO:teuthology.orchestra.run.smithi084.stdout: "poolstat_resend": 0, 2024-06-13T02:31:37.286 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_active": 0, 2024-06-13T02:31:37.286 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_send": 0, 2024-06-13T02:31:37.286 INFO:teuthology.orchestra.run.smithi084.stdout: "statfs_resend": 0, 2024-06-13T02:31:37.287 INFO:teuthology.orchestra.run.smithi084.stdout: "command_active": 0, 2024-06-13T02:31:37.287 INFO:teuthology.orchestra.run.smithi084.stdout: "command_send": 0, 2024-06-13T02:31:37.287 INFO:teuthology.orchestra.run.smithi084.stdout: "command_resend": 0, 2024-06-13T02:31:37.287 INFO:teuthology.orchestra.run.smithi084.stdout: "map_epoch": 121, 2024-06-13T02:31:37.287 INFO:teuthology.orchestra.run.smithi084.stdout: "map_full": 0, 2024-06-13T02:31:37.287 INFO:teuthology.orchestra.run.smithi084.stdout: "map_inc": 4, 2024-06-13T02:31:37.287 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_sessions": 10, 2024-06-13T02:31:37.287 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_open": 10, 2024-06-13T02:31:37.287 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_session_close": 0, 2024-06-13T02:31:37.287 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_laggy": 0, 2024-06-13T02:31:37.288 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_wr": 0, 2024-06-13T02:31:37.288 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_rd": 2, 2024-06-13T02:31:37.288 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_del": 0 2024-06-13T02:31:37.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.288 INFO:teuthology.orchestra.run.smithi084.stdout: "oft": { 2024-06-13T02:31:37.288 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_objs": 0, 2024-06-13T02:31:37.288 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_kv_pairs": 0, 2024-06-13T02:31:37.288 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_updates": 0, 2024-06-13T02:31:37.289 INFO:teuthology.orchestra.run.smithi084.stdout: "omap_total_removes": 0 2024-06-13T02:31:37.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.289 INFO:teuthology.orchestra.run.smithi084.stdout: "osd-slow-ops": { 2024-06-13T02:31:37.289 INFO:teuthology.orchestra.run.smithi084.stdout: "slow_ops_count": 0 2024-06-13T02:31:37.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.289 INFO:teuthology.orchestra.run.smithi084.stdout: "purge_queue": { 2024-06-13T02:31:37.289 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops": 0, 2024-06-13T02:31:37.289 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_ops_high_water": 0, 2024-06-13T02:31:37.290 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing": 0, 2024-06-13T02:31:37.290 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executing_high_water": 0, 2024-06-13T02:31:37.290 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed_ops": 0, 2024-06-13T02:31:37.290 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_executed": 0, 2024-06-13T02:31:37.290 INFO:teuthology.orchestra.run.smithi084.stdout: "pq_item_in_journal": 0 2024-06-13T02:31:37.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.290 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T02:31:37.290 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:37.290 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-06-13T02:31:37.291 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:37.291 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 598, 2024-06-13T02:31:37.291 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 73056514, 2024-06-13T02:31:37.291 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:37.291 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 598, 2024-06-13T02:31:37.291 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-06-13T02:31:37.291 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-06-13T02:31:37.291 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 598, 2024-06-13T02:31:37.291 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 73056514, 2024-06-13T02:31:37.292 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:37.292 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.292 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.292 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.292 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:37.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.292 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_bytes": { 2024-06-13T02:31:37.292 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:37.292 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-06-13T02:31:37.293 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:37.293 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-06-13T02:31:37.293 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-06-13T02:31:37.293 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:37.293 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:37.293 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 546, 2024-06-13T02:31:37.293 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 72776741, 2024-06-13T02:31:37.293 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 546, 2024-06-13T02:31:37.293 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 72776741, 2024-06-13T02:31:37.294 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:37.294 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.294 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.294 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.294 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:37.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.294 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-objecter_ops": { 2024-06-13T02:31:37.294 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:37.295 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 1024, 2024-06-13T02:31:37.295 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:37.295 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-06-13T02:31:37.295 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-06-13T02:31:37.295 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:37.295 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:37.295 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 546, 2024-06-13T02:31:37.295 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 546, 2024-06-13T02:31:37.295 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 546, 2024-06-13T02:31:37.296 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 546, 2024-06-13T02:31:37.296 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:37.296 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.296 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.296 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.296 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:37.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.296 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle": { 2024-06-13T02:31:37.296 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:37.296 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-06-13T02:31:37.297 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:37.297 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-06-13T02:31:37.297 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-06-13T02:31:37.297 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:37.297 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:37.297 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-06-13T02:31:37.297 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-06-13T02:31:37.297 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 0, 2024-06-13T02:31:37.297 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 0, 2024-06-13T02:31:37.298 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:37.298 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.298 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.298 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.298 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:37.298 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:37.298 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-write_buf_throttle-0x558a392646e0": { 2024-06-13T02:31:37.298 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:37.298 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 3758096384, 2024-06-13T02:31:37.299 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:37.299 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 0, 2024-06-13T02:31:37.299 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 0, 2024-06-13T02:31:37.299 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:37.299 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:37.299 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-06-13T02:31:37.299 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-06-13T02:31:37.299 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 0, 2024-06-13T02:31:37.299 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 0, 2024-06-13T02:31:37.300 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:37.300 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:37.300 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:37.300 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:37.300 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:37.300 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:37.300 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-06-13T02:31:37.300 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:37 smithi084 ceph-mon[36833]: pgmap v436: 129 pgs: 129 active+clean; 276 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 455 KiB/s wr, 25 op/s 2024-06-13T02:31:37.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:37 smithi002 ceph-mon[31960]: pgmap v436: 129 pgs: 129 active+clean; 276 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 455 KiB/s wr, 25 op/s 2024-06-13T02:31:37.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:37 smithi175 ceph-mon[36977]: pgmap v436: 129 pgs: 129 active+clean; 276 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 455 KiB/s wr, 25 op/s 2024-06-13T02:31:38.018 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-06-13T02:31:38.018 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-06-13T02:31:38.018 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-06-13T02:31:38.018 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-06-13T02:31:38.018 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-06-13T02:31:38.019 DEBUG:tasks.check_counter:Getting stats from k 2024-06-13T02:31:38.019 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph daemon mds.k perf dump 2024-06-13T02:31:38.279 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.b/config 2024-06-13T02:31:39.382 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:39 smithi002 ceph-mon[31960]: pgmap v437: 129 pgs: 129 active+clean; 275 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 379 KiB/s wr, 25 op/s 2024-06-13T02:31:39.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:39 smithi084 ceph-mon[36833]: pgmap v437: 129 pgs: 129 active+clean; 275 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 379 KiB/s wr, 25 op/s 2024-06-13T02:31:39.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:39 smithi175 ceph-mon[36977]: pgmap v437: 129 pgs: 129 active+clean; 275 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 379 KiB/s wr, 25 op/s 2024-06-13T02:31:40.163 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-06-13T02:31:40.163 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T02:31:40.163 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 0, 2024-06-13T02:31:40.163 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 2, 2024-06-13T02:31:40.163 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 0, 2024-06-13T02:31:40.163 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 0, 2024-06-13T02:31:40.164 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-06-13T02:31:40.164 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 0, 2024-06-13T02:31:40.164 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.000969969, 2024-06-13T02:31:40.164 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.000000000, 2024-06-13T02:31:40.164 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.000195513, 2024-06-13T02:31:40.164 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T02:31:40.164 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:40.164 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:40.165 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:40.165 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:40.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:40.165 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:40.165 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:40.165 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:40.165 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:40.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:40.166 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-13T02:31:40.166 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 0 2024-06-13T02:31:40.166 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:40.166 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T02:31:40.166 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 2, 2024-06-13T02:31:40.166 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 243, 2024-06-13T02:31:40.166 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 320, 2024-06-13T02:31:40.166 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 198592, 2024-06-13T02:31:40.167 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 5, 2024-06-13T02:31:40.167 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 3, 2024-06-13T02:31:40.167 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.012354421, 2024-06-13T02:31:40.167 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.008370557, 2024-06-13T02:31:40.167 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.001526324, 2024-06-13T02:31:40.167 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T02:31:40.167 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:40.167 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 240, 2024-06-13T02:31:40.167 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.036946509, 2024-06-13T02:31:40.168 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000153943 2024-06-13T02:31:40.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:40.168 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:40.168 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:40.168 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:40.168 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:40.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:40.169 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-13T02:31:40.169 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 198592 2024-06-13T02:31:40.169 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:40.169 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T02:31:40.169 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 333, 2024-06-13T02:31:40.169 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 320, 2024-06-13T02:31:40.169 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 1614464, 2024-06-13T02:31:40.169 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 197328, 2024-06-13T02:31:40.170 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 2, 2024-06-13T02:31:40.170 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 1, 2024-06-13T02:31:40.170 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.051382486, 2024-06-13T02:31:40.170 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.015226515, 2024-06-13T02:31:40.170 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.037909544, 2024-06-13T02:31:40.170 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.006844612, 2024-06-13T02:31:40.170 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:40.170 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 320, 2024-06-13T02:31:40.170 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.015275829, 2024-06-13T02:31:40.171 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000047736 2024-06-13T02:31:40.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:40.171 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:40.171 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:40.171 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:40.171 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:40.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:40.171 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 1614464, 2024-06-13T02:31:40.171 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 197328 2024-06-13T02:31:40.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:40.172 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-06-13T02:31:40.172 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 0, 2024-06-13T02:31:40.172 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-06-13T02:31:40.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:40.172 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-06-13T02:31:40.172 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-06-13T02:31:40.172 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-06-13T02:31:40.173 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T02:31:40.173 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-06-13T02:31:40.173 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T02:31:40.173 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-06-13T02:31:40.173 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T02:31:40.173 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T02:31:40.173 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T02:31:40.173 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T02:31:40.174 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T02:31:40.174 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-06-13T02:31:40.174 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T02:31:40.174 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T02:31:40.174 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-06-13T02:31:40.174 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-06-13T02:31:40.174 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-06-13T02:31:40.174 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-06-13T02:31:40.174 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T02:31:40.175 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T02:31:40.175 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T02:31:40.175 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T02:31:40.175 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T02:31:40.175 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-06-13T02:31:40.175 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-06-13T02:31:40.175 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-06-13T02:31:40.175 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T02:31:40.175 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T02:31:40.175 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-06-13T02:31:40.176 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-06-13T02:31:40.176 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-06-13T02:31:40.176 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-06-13T02:31:40.176 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T02:31:40.176 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-06-13T02:31:40.176 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T02:31:40.176 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-06-13T02:31:40.176 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 148692, 2024-06-13T02:31:40.177 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 30, 2024-06-13T02:31:40.177 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-06-13T02:31:40.177 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-06-13T02:31:40.177 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-06-13T02:31:40.177 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-06-13T02:31:40.177 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-06-13T02:31:40.177 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-06-13T02:31:40.177 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-06-13T02:31:40.178 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-06-13T02:31:40.178 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 0, 2024-06-13T02:31:40.178 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 0, 2024-06-13T02:31:40.178 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T02:31:40.178 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-06-13T02:31:40.178 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-06-13T02:31:40.178 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-06-13T02:31:40.178 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 928, 2024-06-13T02:31:40.178 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 2, 2024-06-13T02:31:40.179 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-06-13T02:31:40.179 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-06-13T02:31:40.179 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-06-13T02:31:40.179 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-06-13T02:31:40.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-06-13T02:31:40.179 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T02:31:40.179 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-06-13T02:31:40.179 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-06-13T02:31:40.179 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-06-13T02:31:40.180 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 331, 2024-06-13T02:31:40.180 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 1564998, 2024-06-13T02:31:40.180 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:40.180 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 331, 2024-06-13T02:31:40.180 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-06-13T02:31:40.180 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-06-13T02:31:40.180 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 331, 2024-06-13T02:31:40.180 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 1564998, 2024-06-13T02:31:40.180 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-06-13T02:31:40.181 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-06-13T02:31:40.181 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-06-13T02:31:40.181 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-06-13T02:31:40.181 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:40.181 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-06-13T02:31:40.181 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-06-13T02:31:41.082 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-06-13T02:31:41.083 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-06-13T02:31:41.083 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-06-13T02:31:41.083 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-06-13T02:31:41.083 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-06-13T02:31:41.083 DEBUG:tasks.check_counter:Getting stats from c 2024-06-13T02:31:41.083 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph daemon mds.c perf dump 2024-06-13T02:31:41.329 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:31:41.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:41 smithi002 ceph-mon[31960]: pgmap v438: 129 pgs: 129 active+clean; 275 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 379 KiB/s wr, 24 op/s 2024-06-13T02:31:41.451 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:41 smithi175 ceph-mon[36977]: pgmap v438: 129 pgs: 129 active+clean; 275 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 379 KiB/s wr, 24 op/s 2024-06-13T02:31:41.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:41 smithi084 ceph-mon[36833]: pgmap v438: 129 pgs: 129 active+clean; 275 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 379 KiB/s wr, 24 op/s 2024-06-13T02:31:43.255 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-06-13T02:31:43.255 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T02:31:43.255 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 2958, 2024-06-13T02:31:43.255 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 2960, 2024-06-13T02:31:43.255 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1640210, 2024-06-13T02:31:43.256 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 940651, 2024-06-13T02:31:43.256 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 6, 2024-06-13T02:31:43.256 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 2, 2024-06-13T02:31:43.256 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.214396761, 2024-06-13T02:31:43.256 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.069174140, 2024-06-13T02:31:43.256 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.053656447, 2024-06-13T02:31:43.256 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.075200156, 2024-06-13T02:31:43.256 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:43.257 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2958, 2024-06-13T02:31:43.257 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.088190569, 2024-06-13T02:31:43.257 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000029814 2024-06-13T02:31:43.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.257 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:43.257 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.257 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.257 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.258 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-13T02:31:43.258 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2024-06-13T02:31:43.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.258 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T02:31:43.258 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 9, 2024-06-13T02:31:43.261 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 246, 2024-06-13T02:31:43.261 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 4060, 2024-06-13T02:31:43.262 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 633866, 2024-06-13T02:31:43.262 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 8, 2024-06-13T02:31:43.262 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-06-13T02:31:43.262 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.013339876, 2024-06-13T02:31:43.262 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.008558602, 2024-06-13T02:31:43.262 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.002488565, 2024-06-13T02:31:43.262 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000057335, 2024-06-13T02:31:43.262 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:43.262 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 243, 2024-06-13T02:31:43.263 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.025389608, 2024-06-13T02:31:43.263 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000104483 2024-06-13T02:31:43.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.263 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:43.263 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.263 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.263 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.263 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3504, 2024-06-13T02:31:43.264 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 633168 2024-06-13T02:31:43.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.264 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T02:31:43.264 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 368, 2024-06-13T02:31:43.264 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 343, 2024-06-13T02:31:43.264 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1701292, 2024-06-13T02:31:43.264 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 199518, 2024-06-13T02:31:43.264 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 4, 2024-06-13T02:31:43.264 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 2, 2024-06-13T02:31:43.265 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.055797774, 2024-06-13T02:31:43.265 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.018122535, 2024-06-13T02:31:43.265 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.037897436, 2024-06-13T02:31:43.265 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.007321325, 2024-06-13T02:31:43.265 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:43.265 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 342, 2024-06-13T02:31:43.265 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.014401568, 2024-06-13T02:31:43.265 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000042109 2024-06-13T02:31:43.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.265 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:43.266 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.266 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.266 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.266 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1701024, 2024-06-13T02:31:43.266 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 199200 2024-06-13T02:31:43.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.266 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-06-13T02:31:43.266 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-06-13T02:31:43.267 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-06-13T02:31:43.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.267 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-06-13T02:31:43.267 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-06-13T02:31:43.267 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-06-13T02:31:43.267 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 5061, 2024-06-13T02:31:43.267 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.120453874, 2024-06-13T02:31:43.267 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000023800 2024-06-13T02:31:43.267 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:43.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.268 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-06-13T02:31:43.268 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-06-13T02:31:43.268 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-06-13T02:31:43.268 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.268 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.268 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.268 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:43.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.269 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-06-13T02:31:43.269 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 0, 2024-06-13T02:31:43.269 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 0, 2024-06-13T02:31:43.269 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-06-13T02:31:43.269 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.269 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.269 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.269 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-06-13T02:31:43.269 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 0, 2024-06-13T02:31:43.270 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-06-13T02:31:43.270 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-06-13T02:31:43.270 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 0, 2024-06-13T02:31:43.270 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-06-13T02:31:43.270 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-06-13T02:31:43.270 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 182, 2024-06-13T02:31:43.270 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 0, 2024-06-13T02:31:43.270 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 182, 2024-06-13T02:31:43.270 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 0, 2024-06-13T02:31:43.271 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 182, 2024-06-13T02:31:43.271 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 0, 2024-06-13T02:31:43.271 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 0, 2024-06-13T02:31:43.271 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 0, 2024-06-13T02:31:43.271 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 8, 2024-06-13T02:31:43.271 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 0, 2024-06-13T02:31:43.271 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 0, 2024-06-13T02:31:43.271 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 0, 2024-06-13T02:31:43.271 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 0, 2024-06-13T02:31:43.272 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-06-13T02:31:43.272 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-06-13T02:31:43.272 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 0, 2024-06-13T02:31:43.272 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-06-13T02:31:43.272 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-06-13T02:31:43.272 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 0, 2024-06-13T02:31:43.272 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 0, 2024-06-13T02:31:43.272 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 0, 2024-06-13T02:31:43.272 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 0, 2024-06-13T02:31:43.272 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-06-13T02:31:43.273 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-06-13T02:31:43.273 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-06-13T02:31:43.273 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 0, 2024-06-13T02:31:43.273 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 0, 2024-06-13T02:31:43.273 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 0, 2024-06-13T02:31:43.273 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-06-13T02:31:43.273 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-06-13T02:31:43.273 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-06-13T02:31:43.274 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-06-13T02:31:43.274 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-06-13T02:31:43.274 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-06-13T02:31:43.274 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-06-13T02:31:43.274 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-06-13T02:31:43.274 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 0, 2024-06-13T02:31:43.274 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 0, 2024-06-13T02:31:43.274 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 0, 2024-06-13T02:31:43.275 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-06-13T02:31:43.275 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-13T02:31:43.275 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-13T02:31:43.275 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 0, 2024-06-13T02:31:43.275 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 0, 2024-06-13T02:31:43.275 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 0, 2024-06-13T02:31:43.275 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 0 2024-06-13T02:31:43.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.276 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-06-13T02:31:43.276 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-06-13T02:31:43.276 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 0, 2024-06-13T02:31:43.276 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 0, 2024-06-13T02:31:43.276 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 0, 2024-06-13T02:31:43.276 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 0, 2024-06-13T02:31:43.276 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-06-13T02:31:43.276 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-06-13T02:31:43.276 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-06-13T02:31:43.277 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 0, 2024-06-13T02:31:43.277 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 0, 2024-06-13T02:31:43.277 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-06-13T02:31:43.277 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-06-13T02:31:43.277 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-06-13T02:31:43.277 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-06-13T02:31:43.277 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-06-13T02:31:43.277 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-06-13T02:31:43.278 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-06-13T02:31:43.278 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-06-13T02:31:43.278 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-06-13T02:31:43.278 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-06-13T02:31:43.278 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 0, 2024-06-13T02:31:43.278 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-06-13T02:31:43.278 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-06-13T02:31:43.278 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-06-13T02:31:43.279 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-06-13T02:31:43.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.279 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-06-13T02:31:43.279 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-06-13T02:31:43.279 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 0, 2024-06-13T02:31:43.279 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-06-13T02:31:43.279 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-06-13T02:31:43.279 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 254, 2024-06-13T02:31:43.280 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-06-13T02:31:43.280 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-06-13T02:31:43.280 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 0, 2024-06-13T02:31:43.280 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-06-13T02:31:43.280 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-06-13T02:31:43.280 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 2, 2024-06-13T02:31:43.280 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 2, 2024-06-13T02:31:43.280 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-06-13T02:31:43.281 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-06-13T02:31:43.281 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-06-13T02:31:43.281 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 4994711, 2024-06-13T02:31:43.281 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 4993096, 2024-06-13T02:31:43.281 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-06-13T02:31:43.281 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.281 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.281 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.282 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 254 2024-06-13T02:31:43.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.282 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-06-13T02:31:43.282 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 155, 2024-06-13T02:31:43.282 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 161, 2024-06-13T02:31:43.282 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 6, 2024-06-13T02:31:43.282 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 30, 2024-06-13T02:31:43.282 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 30, 2024-06-13T02:31:43.283 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 0, 2024-06-13T02:31:43.283 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 182, 2024-06-13T02:31:43.283 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 182, 2024-06-13T02:31:43.283 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 0, 2024-06-13T02:31:43.283 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 0, 2024-06-13T02:31:43.283 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 0, 2024-06-13T02:31:43.283 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 0, 2024-06-13T02:31:43.283 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 51340, 2024-06-13T02:31:43.284 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 215420 2024-06-13T02:31:43.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.284 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-06-13T02:31:43.284 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 0, 2024-06-13T02:31:43.284 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 0, 2024-06-13T02:31:43.284 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 0, 2024-06-13T02:31:43.284 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 0, 2024-06-13T02:31:43.284 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 0, 2024-06-13T02:31:43.284 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-06-13T02:31:43.285 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.285 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.285 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.285 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-06-13T02:31:43.285 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.285 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.285 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.286 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-06-13T02:31:43.286 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.286 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.286 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.286 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-06-13T02:31:43.286 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.287 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.287 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.287 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-06-13T02:31:43.287 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.287 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.287 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.287 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-06-13T02:31:43.288 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.288 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.288 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.288 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-06-13T02:31:43.288 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.288 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.288 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.289 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-06-13T02:31:43.289 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.289 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.289 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.289 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-06-13T02:31:43.289 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.289 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.289 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.290 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-06-13T02:31:43.290 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.290 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.290 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.290 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-06-13T02:31:43.290 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.291 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.291 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.291 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-06-13T02:31:43.291 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.292 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.292 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.292 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-06-13T02:31:43.292 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.292 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.293 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.293 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-06-13T02:31:43.293 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.293 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.293 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.293 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-06-13T02:31:43.293 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.294 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.294 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.294 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-06-13T02:31:43.294 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.294 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.294 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.295 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-06-13T02:31:43.295 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.295 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.295 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.295 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-06-13T02:31:43.295 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.295 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.296 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.296 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-06-13T02:31:43.296 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.296 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.296 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.296 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-06-13T02:31:43.296 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.297 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.297 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.297 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-06-13T02:31:43.297 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.297 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.297 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.298 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-06-13T02:31:43.298 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.298 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.298 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.298 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-06-13T02:31:43.298 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.299 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.299 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.299 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-06-13T02:31:43.299 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.299 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.299 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.300 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-06-13T02:31:43.300 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.300 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.300 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.300 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-06-13T02:31:43.300 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.300 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.301 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.301 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-06-13T02:31:43.301 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.301 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.301 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.301 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-06-13T02:31:43.301 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.302 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.302 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.302 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-06-13T02:31:43.302 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.302 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.302 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.302 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-06-13T02:31:43.303 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-06-13T02:31:43.303 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-06-13T02:31:43.303 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.303 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.303 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.303 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:43.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.303 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-06-13T02:31:43.303 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2024-06-13T02:31:43.304 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 4, 2024-06-13T02:31:43.304 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 2, 2024-06-13T02:31:43.304 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 4, 2024-06-13T02:31:43.304 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-06-13T02:31:43.304 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 0, 2024-06-13T02:31:43.304 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 0, 2024-06-13T02:31:43.304 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 4545, 2024-06-13T02:31:43.304 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-06-13T02:31:43.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.305 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-06-13T02:31:43.305 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-06-13T02:31:43.305 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-06-13T02:31:43.305 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T02:31:43.305 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-06-13T02:31:43.305 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T02:31:43.305 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-06-13T02:31:43.305 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T02:31:43.305 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T02:31:43.306 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T02:31:43.306 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T02:31:43.306 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T02:31:43.306 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-06-13T02:31:43.306 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T02:31:43.306 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T02:31:43.306 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-06-13T02:31:43.306 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-06-13T02:31:43.306 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-06-13T02:31:43.307 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-06-13T02:31:43.307 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T02:31:43.307 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T02:31:43.307 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T02:31:43.307 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T02:31:43.307 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T02:31:43.307 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-06-13T02:31:43.307 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-06-13T02:31:43.307 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-06-13T02:31:43.308 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T02:31:43.308 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T02:31:43.308 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-06-13T02:31:43.308 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-06-13T02:31:43.308 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-06-13T02:31:43.308 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-06-13T02:31:43.308 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T02:31:43.308 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-06-13T02:31:43.309 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T02:31:43.309 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-06-13T02:31:43.309 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 188726, 2024-06-13T02:31:43.309 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 209, 2024-06-13T02:31:43.309 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-06-13T02:31:43.309 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-06-13T02:31:43.309 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-06-13T02:31:43.309 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-06-13T02:31:43.309 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-06-13T02:31:43.309 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-06-13T02:31:43.310 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-06-13T02:31:43.310 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-06-13T02:31:43.310 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 9800, 2024-06-13T02:31:43.310 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 188, 2024-06-13T02:31:43.310 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T02:31:43.310 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-06-13T02:31:43.310 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-06-13T02:31:43.310 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-06-13T02:31:43.311 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 544022, 2024-06-13T02:31:43.311 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 5418, 2024-06-13T02:31:43.311 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-06-13T02:31:43.311 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-06-13T02:31:43.311 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-06-13T02:31:43.311 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-06-13T02:31:43.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.311 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-06-13T02:31:43.311 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-06-13T02:31:43.312 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-06-13T02:31:43.312 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 2961, 2024-06-13T02:31:43.312 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 21, 2024-06-13T02:31:43.312 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 3, 2024-06-13T02:31:43.312 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 2961, 2024-06-13T02:31:43.312 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-06-13T02:31:43.312 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2961, 2024-06-13T02:31:43.312 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 1.953970805, 2024-06-13T02:31:43.312 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000659902 2024-06-13T02:31:43.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.313 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-06-13T02:31:43.313 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-06-13T02:31:43.313 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2961, 2024-06-13T02:31:43.313 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2962 2024-06-13T02:31:43.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.313 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 2961, 2024-06-13T02:31:43.313 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 2961, 2024-06-13T02:31:43.313 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 0, 2024-06-13T02:31:43.314 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-06-13T02:31:43.314 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-06-13T02:31:43.314 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 1887, 2024-06-13T02:31:43.314 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 0, 2024-06-13T02:31:43.314 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 1072, 2024-06-13T02:31:43.314 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 0, 2024-06-13T02:31:43.314 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 0, 2024-06-13T02:31:43.314 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-06-13T02:31:43.314 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-06-13T02:31:43.315 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-06-13T02:31:43.315 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-06-13T02:31:43.315 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 0, 2024-06-13T02:31:43.315 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-06-13T02:31:43.315 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-06-13T02:31:43.315 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-06-13T02:31:43.315 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 1, 2024-06-13T02:31:43.315 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 0, 2024-06-13T02:31:43.315 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-06-13T02:31:43.316 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-06-13T02:31:43.316 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-06-13T02:31:43.316 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-06-13T02:31:43.316 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-06-13T02:31:43.316 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-06-13T02:31:43.316 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-06-13T02:31:43.316 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-06-13T02:31:43.316 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-06-13T02:31:43.316 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-06-13T02:31:43.316 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-06-13T02:31:43.317 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-06-13T02:31:43.317 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-06-13T02:31:43.317 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-06-13T02:31:43.317 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-06-13T02:31:43.317 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-06-13T02:31:43.317 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-06-13T02:31:43.317 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-06-13T02:31:43.317 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-06-13T02:31:43.318 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-06-13T02:31:43.318 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-06-13T02:31:43.318 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-06-13T02:31:43.318 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-06-13T02:31:43.318 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-06-13T02:31:43.318 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-06-13T02:31:43.318 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-06-13T02:31:43.318 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 121, 2024-06-13T02:31:43.319 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-06-13T02:31:43.319 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 23, 2024-06-13T02:31:43.319 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 4, 2024-06-13T02:31:43.319 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 6, 2024-06-13T02:31:43.319 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 2, 2024-06-13T02:31:43.319 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-06-13T02:31:43.319 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 0, 2024-06-13T02:31:43.319 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 2, 2024-06-13T02:31:43.319 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 0 2024-06-13T02:31:43.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.320 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-06-13T02:31:43.320 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 0, 2024-06-13T02:31:43.320 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-06-13T02:31:43.320 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-06-13T02:31:43.320 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-06-13T02:31:43.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.320 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-06-13T02:31:43.320 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-06-13T02:31:43.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.321 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-06-13T02:31:43.321 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-06-13T02:31:43.321 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 0, 2024-06-13T02:31:43.321 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-06-13T02:31:43.321 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 0, 2024-06-13T02:31:43.321 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 0, 2024-06-13T02:31:43.321 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 0, 2024-06-13T02:31:43.321 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-06-13T02:31:43.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.322 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T02:31:43.322 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-06-13T02:31:43.322 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-06-13T02:31:43.322 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-06-13T02:31:43.322 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 3331, 2024-06-13T02:31:43.322 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 3023991, 2024-06-13T02:31:43.322 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:43.322 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 3331, 2024-06-13T02:31:43.323 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-06-13T02:31:43.323 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-06-13T02:31:43.323 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 3331, 2024-06-13T02:31:43.323 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 3023991, 2024-06-13T02:31:43.323 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-06-13T02:31:43.323 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.323 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.323 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.323 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:43.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.324 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-06-13T02:31:43.324 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-06-13T02:31:43.324 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-06-13T02:31:43.324 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-06-13T02:31:43.324 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-06-13T02:31:43.324 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-06-13T02:31:43.324 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:43.324 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:43.325 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 2961, 2024-06-13T02:31:43.325 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 800412, 2024-06-13T02:31:43.325 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2961, 2024-06-13T02:31:43.325 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 800412, 2024-06-13T02:31:43.325 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-06-13T02:31:43.325 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.325 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.325 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.325 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:43.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.326 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-06-13T02:31:43.326 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-06-13T02:31:43.326 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-06-13T02:31:43.326 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-06-13T02:31:43.326 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-06-13T02:31:43.326 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-06-13T02:31:43.326 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:43.326 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:43.326 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 2961, 2024-06-13T02:31:43.327 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 2961, 2024-06-13T02:31:43.327 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 2961, 2024-06-13T02:31:43.327 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 2961, 2024-06-13T02:31:43.327 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-06-13T02:31:43.327 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.327 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.327 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.327 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:43.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.328 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-06-13T02:31:43.328 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-06-13T02:31:43.328 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-06-13T02:31:43.328 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-06-13T02:31:43.328 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-06-13T02:31:43.328 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-06-13T02:31:43.328 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:43.328 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:43.329 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-06-13T02:31:43.329 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-06-13T02:31:43.329 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-06-13T02:31:43.329 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-06-13T02:31:43.329 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-06-13T02:31:43.329 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.329 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.329 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.329 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:43.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:43.330 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x558dbec606e0": { 2024-06-13T02:31:43.330 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-06-13T02:31:43.330 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-06-13T02:31:43.330 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-06-13T02:31:43.330 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-06-13T02:31:43.330 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-06-13T02:31:43.331 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:43.331 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:43.331 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-06-13T02:31:43.331 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-06-13T02:31:43.331 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 0, 2024-06-13T02:31:43.331 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 0, 2024-06-13T02:31:43.331 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-06-13T02:31:43.332 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:43.332 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:43.332 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:43.332 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:43.332 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:43.332 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-06-13T02:31:43.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:43 smithi002 ceph-mon[31960]: pgmap v439: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 514 KiB/s wr, 39 op/s 2024-06-13T02:31:43.398 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:43 smithi175 ceph-mon[36977]: pgmap v439: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 514 KiB/s wr, 39 op/s 2024-06-13T02:31:43.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:43 smithi084 ceph-mon[36833]: pgmap v439: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 514 KiB/s wr, 39 op/s 2024-06-13T02:31:43.969 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-06-13T02:31:43.969 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-06-13T02:31:43.970 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-06-13T02:31:43.970 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-06-13T02:31:43.970 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-06-13T02:31:43.970 DEBUG:tasks.check_counter:Getting stats from f 2024-06-13T02:31:43.970 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph daemon mds.f perf dump 2024-06-13T02:31:44.211 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:31:45.334 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:45 smithi175 ceph-mon[36977]: pgmap v440: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 378 KiB/s wr, 32 op/s 2024-06-13T02:31:45.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:45 smithi002 ceph-mon[31960]: pgmap v440: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 378 KiB/s wr, 32 op/s 2024-06-13T02:31:45.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:45 smithi084 ceph-mon[36833]: pgmap v440: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 378 KiB/s wr, 32 op/s 2024-06-13T02:31:45.872 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-06-13T02:31:45.872 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T02:31:45.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 4, 2024-06-13T02:31:45.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 4, 2024-06-13T02:31:45.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 3024, 2024-06-13T02:31:45.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 448, 2024-06-13T02:31:45.872 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 4, 2024-06-13T02:31:45.873 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 0, 2024-06-13T02:31:45.873 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.001291003, 2024-06-13T02:31:45.873 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.000034202, 2024-06-13T02:31:45.873 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.000475340, 2024-06-13T02:31:45.873 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T02:31:45.873 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:45.873 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 3, 2024-06-13T02:31:45.873 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000688056, 2024-06-13T02:31:45.873 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000229352 2024-06-13T02:31:45.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:45.874 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:45.874 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:45.874 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:45.874 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:45.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:45.874 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-06-13T02:31:45.874 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 448 2024-06-13T02:31:45.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:45.875 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T02:31:45.875 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 2, 2024-06-13T02:31:45.875 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 242, 2024-06-13T02:31:45.875 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 320, 2024-06-13T02:31:45.875 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 198416, 2024-06-13T02:31:45.875 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 5, 2024-06-13T02:31:45.875 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 3, 2024-06-13T02:31:45.875 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.013347003, 2024-06-13T02:31:45.876 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.009608223, 2024-06-13T02:31:45.876 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.001113979, 2024-06-13T02:31:45.876 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T02:31:45.876 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:45.876 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 239, 2024-06-13T02:31:45.876 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.023715782, 2024-06-13T02:31:45.876 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000099229 2024-06-13T02:31:45.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:45.876 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:45.877 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:45.877 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:45.877 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:45.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:45.877 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-13T02:31:45.877 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 198416 2024-06-13T02:31:45.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:45.877 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T02:31:45.877 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 326, 2024-06-13T02:31:45.878 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 315, 2024-06-13T02:31:45.878 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1610624, 2024-06-13T02:31:45.878 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 194960, 2024-06-13T02:31:45.878 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 2, 2024-06-13T02:31:45.878 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 1, 2024-06-13T02:31:45.878 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.052688429, 2024-06-13T02:31:45.878 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.016739846, 2024-06-13T02:31:45.878 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.036033432, 2024-06-13T02:31:45.879 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.007218638, 2024-06-13T02:31:45.879 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:45.879 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 314, 2024-06-13T02:31:45.879 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.013103744, 2024-06-13T02:31:45.879 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000041731 2024-06-13T02:31:45.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:45.879 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:45.879 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:45.879 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:45.880 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:45.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:45.880 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1610624, 2024-06-13T02:31:45.880 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 194960 2024-06-13T02:31:45.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:45.880 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-06-13T02:31:45.880 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 0, 2024-06-13T02:31:45.880 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-06-13T02:31:45.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:45.881 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-06-13T02:31:45.881 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-06-13T02:31:45.881 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-06-13T02:31:45.881 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T02:31:45.881 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-06-13T02:31:45.881 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T02:31:45.881 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-06-13T02:31:45.881 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T02:31:45.881 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T02:31:45.882 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T02:31:45.882 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T02:31:45.882 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T02:31:45.882 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-06-13T02:31:45.882 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T02:31:45.882 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T02:31:45.882 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-06-13T02:31:45.882 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-06-13T02:31:45.882 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-06-13T02:31:45.883 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-06-13T02:31:45.883 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T02:31:45.883 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T02:31:45.883 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T02:31:45.883 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T02:31:45.883 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T02:31:45.883 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-06-13T02:31:45.883 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-06-13T02:31:45.883 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-06-13T02:31:45.884 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T02:31:45.884 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T02:31:45.884 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-06-13T02:31:45.884 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-06-13T02:31:45.884 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-06-13T02:31:45.884 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-06-13T02:31:45.884 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T02:31:45.884 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-06-13T02:31:45.884 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T02:31:45.885 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-06-13T02:31:45.885 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 148670, 2024-06-13T02:31:45.885 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 30, 2024-06-13T02:31:45.885 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-06-13T02:31:45.885 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-06-13T02:31:45.885 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-06-13T02:31:45.885 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-06-13T02:31:45.885 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-06-13T02:31:45.886 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-06-13T02:31:45.886 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-06-13T02:31:45.886 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-06-13T02:31:45.886 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 0, 2024-06-13T02:31:45.886 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 0, 2024-06-13T02:31:45.886 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T02:31:45.886 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-06-13T02:31:45.886 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-06-13T02:31:45.887 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-06-13T02:31:45.887 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 928, 2024-06-13T02:31:45.887 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 2, 2024-06-13T02:31:45.887 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-06-13T02:31:45.887 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-06-13T02:31:45.887 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-06-13T02:31:45.887 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-06-13T02:31:45.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:45.887 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T02:31:45.888 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-06-13T02:31:45.888 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-06-13T02:31:45.888 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-06-13T02:31:45.888 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 328, 2024-06-13T02:31:45.888 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1564608, 2024-06-13T02:31:45.888 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:45.888 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 328, 2024-06-13T02:31:45.888 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-06-13T02:31:45.888 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-06-13T02:31:45.888 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 328, 2024-06-13T02:31:45.889 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1564608, 2024-06-13T02:31:45.889 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-06-13T02:31:45.889 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:45.889 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:45.889 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:45.889 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:45.889 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:45.889 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-06-13T02:31:46.521 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.f 2024-06-13T02:31:46.521 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.f 2024-06-13T02:31:46.521 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-06-13T02:31:46.521 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-06-13T02:31:46.522 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-06-13T02:31:46.522 DEBUG:tasks.check_counter:Getting stats from i 2024-06-13T02:31:46.522 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph daemon mds.i perf dump 2024-06-13T02:31:46.763 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:31:47.153 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:47 smithi175 ceph-mon[36977]: pgmap v441: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 384 KiB/s wr, 35 op/s 2024-06-13T02:31:47.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:47 smithi084 ceph-mon[36833]: pgmap v441: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 384 KiB/s wr, 35 op/s 2024-06-13T02:31:47.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:47 smithi002 ceph-mon[31960]: pgmap v441: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 384 KiB/s wr, 35 op/s 2024-06-13T02:31:48.383 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-06-13T02:31:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T02:31:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 191746, 2024-06-13T02:31:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 137851, 2024-06-13T02:31:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 97198244, 2024-06-13T02:31:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 50799846, 2024-06-13T02:31:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 10, 2024-06-13T02:31:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 4, 2024-06-13T02:31:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 8.871154172, 2024-06-13T02:31:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 3.513203300, 2024-06-13T02:31:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 7.610200131, 2024-06-13T02:31:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.082890802, 2024-06-13T02:31:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 137851, 2024-06-13T02:31:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2.368934893, 2024-06-13T02:31:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000017184 2024-06-13T02:31:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 314181, 2024-06-13T02:31:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.041538280, 2024-06-13T02:31:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000132 2024-06-13T02:31:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 9630064, 2024-06-13T02:31:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 27748928 2024-06-13T02:31:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T02:31:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 4013, 2024-06-13T02:31:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 4152, 2024-06-13T02:31:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 2653668, 2024-06-13T02:31:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 10493397, 2024-06-13T02:31:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 7, 2024-06-13T02:31:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 6, 2024-06-13T02:31:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.330160753, 2024-06-13T02:31:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.115810598, 2024-06-13T02:31:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.101235565, 2024-06-13T02:31:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.101361982, 2024-06-13T02:31:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4152, 2024-06-13T02:31:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.180556955, 2024-06-13T02:31:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000043486 2024-06-13T02:31:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1716832, 2024-06-13T02:31:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 593312 2024-06-13T02:31:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T02:31:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 5278, 2024-06-13T02:31:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 5381, 2024-06-13T02:31:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1315254, 2024-06-13T02:31:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 16553349, 2024-06-13T02:31:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 18, 2024-06-13T02:31:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 7, 2024-06-13T02:31:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.396013763, 2024-06-13T02:31:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.123594848, 2024-06-13T02:31:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.101071170, 2024-06-13T02:31:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.143974996, 2024-06-13T02:31:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 5376, 2024-06-13T02:31:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.192095580, 2024-06-13T02:31:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000035732 2024-06-13T02:31:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 78, 2024-06-13T02:31:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000013840, 2024-06-13T02:31:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000177 2024-06-13T02:31:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 5904, 2024-06-13T02:31:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 261840 2024-06-13T02:31:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-06-13T02:31:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 1, 2024-06-13T02:31:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-06-13T02:31:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-MDSRank": { 2024-06-13T02:31:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-06-13T02:31:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-06-13T02:31:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 10612, 2024-06-13T02:31:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 5.473169572, 2024-06-13T02:31:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000515752 2024-06-13T02:31:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "finisher-PurgeQueue": { 2024-06-13T02:31:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "queue_len": 0, 2024-06-13T02:31:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "complete_latency": { 2024-06-13T02:31:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 5811, 2024-06-13T02:31:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.303732826, 2024-06-13T02:31:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000052268 2024-06-13T02:31:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": { 2024-06-13T02:31:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "request": 19239, 2024-06-13T02:31:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "reply": 14884, 2024-06-13T02:31:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "reply_latency": { 2024-06-13T02:31:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 14884, 2024-06-13T02:31:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 28.456270462, 2024-06-13T02:31:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001911869 2024-06-13T02:31:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_reply": 0, 2024-06-13T02:31:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: "forward": 4355, 2024-06-13T02:31:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_complete": 0, 2024-06-13T02:31:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_fetch_keys": 0, 2024-06-13T02:31:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_commit": 11, 2024-06-13T02:31:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_split": 0, 2024-06-13T02:31:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_merge": 0, 2024-06-13T02:31:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes": 434, 2024-06-13T02:31:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_top": 11, 2024-06-13T02:31:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_bottom": 335, 2024-06-13T02:31:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pin_tail": 88, 2024-06-13T02:31:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_pinned": 418, 2024-06-13T02:31:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_expired": 49, 2024-06-13T02:31:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "inodes_with_caps": 145, 2024-06-13T02:31:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": 145, 2024-06-13T02:31:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "subtrees": 10, 2024-06-13T02:31:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse": 47044, 2024-06-13T02:31:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_hit": 24332, 2024-06-13T02:31:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_forward": 4355, 2024-06-13T02:31:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_discover": 18, 2024-06-13T02:31:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_dir_fetch": 0, 2024-06-13T02:31:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_remote_ino": 0, 2024-06-13T02:31:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "traverse_lock": 1531, 2024-06-13T02:31:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "load_cent": 0, 2024-06-13T02:31:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "q": 0, 2024-06-13T02:31:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "exported": 1, 2024-06-13T02:31:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "exported_inodes": 58, 2024-06-13T02:31:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "imported": 14, 2024-06-13T02:31:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "imported_inodes": 256, 2024-06-13T02:31:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_dir_fetch": 0, 2024-06-13T02:31:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_backtrace_fetch": 0, 2024-06-13T02:31:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "openino_peer_discover": 0, 2024-06-13T02:31:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rfiles": 619, 2024-06-13T02:31:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rbytes": 203781190, 2024-06-13T02:31:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "root_rsnaps": 6, 2024-06-13T02:31:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_fetch": 0, 2024-06-13T02:31:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_set_tag": 0, 2024-06-13T02:31:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_backtrace_repaired": 0, 2024-06-13T02:31:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_inotable_repaired": 0, 2024-06-13T02:31:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_inodes": 0, 2024-06-13T02:31:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dir_base_inodes": 0, 2024-06-13T02:31:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_dirfrag_rstats": 0, 2024-06-13T02:31:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_file_inodes": 0, 2024-06-13T02:31:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_inode_file_caps": 4, 2024-06-13T02:31:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_revoke": 96, 2024-06-13T02:31:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_grant": 10403, 2024-06-13T02:31:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_trunc": 0, 2024-06-13T02:31:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-13T02:31:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-13T02:31:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps": 3529, 2024-06-13T02:31:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_caps_dirty": 1843, 2024-06-13T02:31:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_cap_release": 1623, 2024-06-13T02:31:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: "process_request_cap_release": 15794 2024-06-13T02:31:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_cache": { 2024-06-13T02:31:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update": 0, 2024-06-13T02:31:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_update_receipt": 6, 2024-06-13T02:31:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_try_discover": 4, 2024-06-13T02:31:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_send_discover": 23, 2024-06-13T02:31:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "dir_handle_discover": 6, 2024-06-13T02:31:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays": 0, 2024-06-13T02:31:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_delayed": 0, 2024-06-13T02:31:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "num_strays_enqueuing": 0, 2024-06-13T02:31:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_created": 2327, 2024-06-13T02:31:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_enqueued": 2327, 2024-06-13T02:31:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_reintegrated": 0, 2024-06-13T02:31:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "strays_migrated": 0, 2024-06-13T02:31:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_processing": 0, 2024-06-13T02:31:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_enqueued": 0, 2024-06-13T02:31:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "num_recovering_prioritized": 0, 2024-06-13T02:31:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_started": 0, 2024-06-13T02:31:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "recovery_completed": 0, 2024-06-13T02:31:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_path": 0, 2024-06-13T02:31:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_quiesce_inode": 0, 2024-06-13T02:31:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_enqueue_scrub": 0, 2024-06-13T02:31:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_exportdir": 1, 2024-06-13T02:31:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_flush": 0, 2024-06-13T02:31:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragmentdir": 0, 2024-06-13T02:31:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_fragstats": 0, 2024-06-13T02:31:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "ireq_inodestats": 0 2024-06-13T02:31:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_log": { 2024-06-13T02:31:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "evlrg": 0, 2024-06-13T02:31:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "evadd": 16355, 2024-06-13T02:31:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "evex": 0, 2024-06-13T02:31:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "evtrm": 0, 2024-06-13T02:31:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "ev": 16355, 2024-06-13T02:31:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "evexg": 0, 2024-06-13T02:31:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: "evexd": 0, 2024-06-13T02:31:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: "segadd": 21, 2024-06-13T02:31:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: "segex": 0, 2024-06-13T02:31:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: "segtrm": 0, 2024-06-13T02:31:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: "seg": 21, 2024-06-13T02:31:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: "segmjr": 3, 2024-06-13T02:31:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: "segexg": 0, 2024-06-13T02:31:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "segexd": 0, 2024-06-13T02:31:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "expos": 4194304, 2024-06-13T02:31:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "wrpos": 31828991, 2024-06-13T02:31:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "rdpos": 0, 2024-06-13T02:31:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "jlat": { 2024-06-13T02:31:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 5015, 2024-06-13T02:31:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 18.220393326, 2024-06-13T02:31:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.003633179 2024-06-13T02:31:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: "replayed": 0 2024-06-13T02:31:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_mem": { 2024-06-13T02:31:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 358, 2024-06-13T02:31:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: "ino+": 2726, 2024-06-13T02:31:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: "ino-": 2368, 2024-06-13T02:31:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: "dir": 53, 2024-06-13T02:31:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "dir+": 74, 2024-06-13T02:31:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "dir-": 21, 2024-06-13T02:31:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "dn": 434, 2024-06-13T02:31:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "dn+": 3853, 2024-06-13T02:31:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "dn-": 3419, 2024-06-13T02:31:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "cap": 145, 2024-06-13T02:31:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "cap+": 2498, 2024-06-13T02:31:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "cap-": 2353, 2024-06-13T02:31:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: "rss": 68340, 2024-06-13T02:31:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: "heap": 223612 2024-06-13T02:31:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_server": { 2024-06-13T02:31:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_client_request": 36718, 2024-06-13T02:31:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: "dispatch_server_request": 3, 2024-06-13T02:31:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_request": 19239, 2024-06-13T02:31:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_client_session": 33, 2024-06-13T02:31:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "handle_peer_request": 6175, 2024-06-13T02:31:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "req_create_latency": { 2024-06-13T02:31:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2329, 2024-06-13T02:31:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 8.646400914, 2024-06-13T02:31:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.003712495 2024-06-13T02:31:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getattr_latency": { 2024-06-13T02:31:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 16, 2024-06-13T02:31:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.044074068, 2024-06-13T02:31:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002754629 2024-06-13T02:31:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getfilelock_latency": { 2024-06-13T02:31:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: "req_link_latency": { 2024-06-13T02:31:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookup_latency": { 2024-06-13T02:31:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4432, 2024-06-13T02:31:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 9.075319793, 2024-06-13T02:31:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002047680 2024-06-13T02:31:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookuphash_latency": { 2024-06-13T02:31:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupino_latency": { 2024-06-13T02:31:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupname_latency": { 2024-06-13T02:31:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupparent_latency": { 2024-06-13T02:31:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lookupsnap_latency": { 2024-06-13T02:31:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: "req_lssnap_latency": { 2024-06-13T02:31:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mkdir_latency": { 2024-06-13T02:31:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mknod_latency": { 2024-06-13T02:31:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: "req_mksnap_latency": { 2024-06-13T02:31:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "req_open_latency": { 2024-06-13T02:31:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "req_readdir_latency": { 2024-06-13T02:31:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 4243, 2024-06-13T02:31:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 2.244124134, 2024-06-13T02:31:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000528900 2024-06-13T02:31:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rename_latency": { 2024-06-13T02:31:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1536, 2024-06-13T02:31:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 3.967856202, 2024-06-13T02:31:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.002583239 2024-06-13T02:31:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: "req_renamesnap_latency": { 2024-06-13T02:31:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "req_snapdiff_latency": { 2024-06-13T02:31:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmdir_latency": { 2024-06-13T02:31:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmsnap_latency": { 2024-06-13T02:31:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "req_rmxattr_latency": { 2024-06-13T02:31:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setattr_latency": { 2024-06-13T02:31:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 1, 2024-06-13T02:31:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.006096425, 2024-06-13T02:31:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.006096425 2024-06-13T02:31:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setdirlayout_latency": { 2024-06-13T02:31:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setfilelock_latency": { 2024-06-13T02:31:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setlayout_latency": { 2024-06-13T02:31:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "req_setxattr_latency": { 2024-06-13T02:31:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "req_symlink_latency": { 2024-06-13T02:31:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "req_unlink_latency": { 2024-06-13T02:31:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 2327, 2024-06-13T02:31:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 4.472398926, 2024-06-13T02:31:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.001921959 2024-06-13T02:31:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_revoke_eviction": 0, 2024-06-13T02:31:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: "cap_acquisition_throttle": 0, 2024-06-13T02:31:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: "req_getvxattr_latency": { 2024-06-13T02:31:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_sessions": { 2024-06-13T02:31:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "session_count": 2, 2024-06-13T02:31:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "session_add": 4, 2024-06-13T02:31:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "session_remove": 2, 2024-06-13T02:31:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_open": 2, 2024-06-13T02:31:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "sessions_stale": 0, 2024-06-13T02:31:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "total_load": 1538, 2024-06-13T02:31:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "average_load": 769, 2024-06-13T02:31:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "avg_session_uptime": 797, 2024-06-13T02:31:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "mdthresh_evicted": 0 2024-06-13T02:31:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-06-13T02:31:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-06-13T02:31:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-06-13T02:31:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T02:31:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-06-13T02:31:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T02:31:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-06-13T02:31:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T02:31:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T02:31:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T02:31:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T02:31:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T02:31:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-06-13T02:31:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T02:31:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T02:31:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-06-13T02:31:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-06-13T02:31:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-06-13T02:31:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-06-13T02:31:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T02:31:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T02:31:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T02:31:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T02:31:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T02:31:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-06-13T02:31:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-06-13T02:31:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-06-13T02:31:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T02:31:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T02:31:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-06-13T02:31:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-06-13T02:31:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-06-13T02:31:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-06-13T02:31:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T02:31:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-06-13T02:31:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T02:31:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-06-13T02:31:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 323069, 2024-06-13T02:31:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 358, 2024-06-13T02:31:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 440, 2024-06-13T02:31:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 5, 2024-06-13T02:31:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-06-13T02:31:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-06-13T02:31:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-06-13T02:31:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-06-13T02:31:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-06-13T02:31:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-06-13T02:31:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 9800, 2024-06-13T02:31:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 188, 2024-06-13T02:31:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T02:31:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-06-13T02:31:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-06-13T02:31:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-06-13T02:31:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 1336946, 2024-06-13T02:31:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 11236, 2024-06-13T02:31:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-06-13T02:31:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-06-13T02:31:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-06-13T02:31:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-06-13T02:31:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "objecter": { 2024-06-13T02:31:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "op_active": 0, 2024-06-13T02:31:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "op_laggy": 0, 2024-06-13T02:31:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send": 11791, 2024-06-13T02:31:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "op_send_bytes": 28241993, 2024-06-13T02:31:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "op_resend": 33, 2024-06-13T02:31:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "op_reply": 11791, 2024-06-13T02:31:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "op_latency": { 2024-06-13T02:31:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 11791, 2024-06-13T02:31:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 71.418929913, 2024-06-13T02:31:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.006057071 2024-06-13T02:31:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "op_inflight": 0, 2024-06-13T02:31:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "oplen_avg": { 2024-06-13T02:31:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 11791, 2024-06-13T02:31:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 12649 2024-06-13T02:31:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "op": 11791, 2024-06-13T02:31:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "op_r": 579, 2024-06-13T02:31:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "op_w": 11212, 2024-06-13T02:31:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "op_rmw": 0, 2024-06-13T02:31:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "op_pg": 0, 2024-06-13T02:31:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_stat": 0, 2024-06-13T02:31:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_create": 10, 2024-06-13T02:31:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_read": 579, 2024-06-13T02:31:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_write": 5594, 2024-06-13T02:31:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writefull": 356, 2024-06-13T02:31:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_writesame": 0, 2024-06-13T02:31:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_append": 0, 2024-06-13T02:31:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_zero": 0, 2024-06-13T02:31:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_truncate": 0, 2024-06-13T02:31:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_delete": 4672, 2024-06-13T02:31:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_mapext": 0, 2024-06-13T02:31:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_sparse_read": 0, 2024-06-13T02:31:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_clonerange": 0, 2024-06-13T02:31:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_getxattr": 0, 2024-06-13T02:31:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_setxattr": 20, 2024-06-13T02:31:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_cmpxattr": 0, 2024-06-13T02:31:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_rmxattr": 0, 2024-06-13T02:31:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_resetxattrs": 0, 2024-06-13T02:31:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_call": 0, 2024-06-13T02:31:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_watch": 0, 2024-06-13T02:31:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_notify": 0, 2024-06-13T02:31:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_src_cmpxattr": 0, 2024-06-13T02:31:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls": 0, 2024-06-13T02:31:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_pgls_filter": 0, 2024-06-13T02:31:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "osdop_other": 0, 2024-06-13T02:31:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_active": 0, 2024-06-13T02:31:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_send": 0, 2024-06-13T02:31:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_resend": 0, 2024-06-13T02:31:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "linger_ping": 0, 2024-06-13T02:31:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_active": 0, 2024-06-13T02:31:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_send": 0, 2024-06-13T02:31:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "poolop_resend": 0, 2024-06-13T02:31:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_active": 0, 2024-06-13T02:31:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_send": 0, 2024-06-13T02:31:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "poolstat_resend": 0, 2024-06-13T02:31:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_active": 0, 2024-06-13T02:31:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_send": 0, 2024-06-13T02:31:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "statfs_resend": 0, 2024-06-13T02:31:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "command_active": 0, 2024-06-13T02:31:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "command_send": 0, 2024-06-13T02:31:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "command_resend": 0, 2024-06-13T02:31:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "map_epoch": 121, 2024-06-13T02:31:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "map_full": 0, 2024-06-13T02:31:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "map_inc": 23, 2024-06-13T02:31:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_sessions": 12, 2024-06-13T02:31:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_open": 12, 2024-06-13T02:31:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_session_close": 0, 2024-06-13T02:31:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_laggy": 0, 2024-06-13T02:31:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_wr": 1102, 2024-06-13T02:31:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_rd": 0, 2024-06-13T02:31:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_del": 316 2024-06-13T02:31:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "oft": { 2024-06-13T02:31:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_objs": 1, 2024-06-13T02:31:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_kv_pairs": 0, 2024-06-13T02:31:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_updates": 0, 2024-06-13T02:31:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "omap_total_removes": 0 2024-06-13T02:31:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: "osd-slow-ops": { 2024-06-13T02:31:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: "slow_ops_count": 0 2024-06-13T02:31:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: "purge_queue": { 2024-06-13T02:31:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops": 0, 2024-06-13T02:31:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_ops_high_water": 16, 2024-06-13T02:31:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing": 0, 2024-06-13T02:31:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executing_high_water": 8, 2024-06-13T02:31:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed_ops": 4654, 2024-06-13T02:31:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_executed": 2327, 2024-06-13T02:31:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "pq_item_in_journal": 0 2024-06-13T02:31:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T02:31:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-06-13T02:31:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-06-13T02:31:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-06-13T02:31:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 201033, 2024-06-13T02:31:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 81834666, 2024-06-13T02:31:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 201033, 2024-06-13T02:31:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-06-13T02:31:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-06-13T02:31:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 201033, 2024-06-13T02:31:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 81834666, 2024-06-13T02:31:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-06-13T02:31:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_bytes": { 2024-06-13T02:31:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-06-13T02:31:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-06-13T02:31:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-06-13T02:31:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-06-13T02:31:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-06-13T02:31:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 11791, 2024-06-13T02:31:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 28496156, 2024-06-13T02:31:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 11791, 2024-06-13T02:31:48.454 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 28496156, 2024-06-13T02:31:48.454 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-06-13T02:31:48.454 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.454 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.454 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.454 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:48.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.454 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-objecter_ops": { 2024-06-13T02:31:48.455 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-06-13T02:31:48.455 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 1024, 2024-06-13T02:31:48.455 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-06-13T02:31:48.455 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 0, 2024-06-13T02:31:48.455 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 0, 2024-06-13T02:31:48.455 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:48.455 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 0, 2024-06-13T02:31:48.455 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 11791, 2024-06-13T02:31:48.455 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 11791, 2024-06-13T02:31:48.456 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 11791, 2024-06-13T02:31:48.456 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 11791, 2024-06-13T02:31:48.456 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-06-13T02:31:48.456 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.456 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.456 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.456 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:48.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.456 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle": { 2024-06-13T02:31:48.457 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-06-13T02:31:48.457 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-06-13T02:31:48.457 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-06-13T02:31:48.457 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 2327, 2024-06-13T02:31:48.457 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 254163, 2024-06-13T02:31:48.457 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:48.457 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 2327, 2024-06-13T02:31:48.457 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-06-13T02:31:48.457 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-06-13T02:31:48.458 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 579, 2024-06-13T02:31:48.458 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 254163, 2024-06-13T02:31:48.458 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-06-13T02:31:48.458 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.458 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.458 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.458 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:48.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:48.459 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-write_buf_throttle-0x56200dadc460": { 2024-06-13T02:31:48.459 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-06-13T02:31:48.459 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 3758096384, 2024-06-13T02:31:48.459 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-06-13T02:31:48.459 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 16355, 2024-06-13T02:31:48.459 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 27634687, 2024-06-13T02:31:48.459 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:48.459 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 16355, 2024-06-13T02:31:48.460 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-06-13T02:31:48.460 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-06-13T02:31:48.460 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 5015, 2024-06-13T02:31:48.460 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 27634687, 2024-06-13T02:31:48.460 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-06-13T02:31:48.460 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:48.460 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:48.460 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:48.461 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:48.461 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:48.461 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-06-13T02:31:49.062 INFO:tasks.check_counter:Daemon mds.i mds.exported=1 2024-06-13T02:31:49.062 INFO:tasks.check_counter:Daemon mds.i mds.imported=14 2024-06-13T02:31:49.062 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-06-13T02:31:49.062 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-06-13T02:31:49.062 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-06-13T02:31:49.062 DEBUG:tasks.check_counter:Getting stats from l 2024-06-13T02:31:49.063 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph daemon mds.l perf dump 2024-06-13T02:31:49.300 INFO:teuthology.orchestra.run.smithi175.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.c/config 2024-06-13T02:31:49.421 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:49 smithi175 ceph-mon[36977]: pgmap v442: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 151 KiB/s wr, 24 op/s 2024-06-13T02:31:49.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:49 smithi084 ceph-mon[36833]: pgmap v442: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 151 KiB/s wr, 24 op/s 2024-06-13T02:31:49.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:49 smithi002 ceph-mon[31960]: pgmap v442: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 151 KiB/s wr, 24 op/s 2024-06-13T02:31:50.948 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-06-13T02:31:50.948 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-0": { 2024-06-13T02:31:50.948 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 0, 2024-06-13T02:31:50.948 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 2, 2024-06-13T02:31:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 0, 2024-06-13T02:31:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 0, 2024-06-13T02:31:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 4, 2024-06-13T02:31:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 0, 2024-06-13T02:31:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.001092216, 2024-06-13T02:31:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.000000000, 2024-06-13T02:31:50.949 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.000277382, 2024-06-13T02:31:50.950 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T02:31:50.950 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:50.950 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:50.950 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:50.950 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:50.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:50.951 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:50.951 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:50.951 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:50.951 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:50.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:50.951 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-13T02:31:50.951 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 0 2024-06-13T02:31:50.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:50.952 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-1": { 2024-06-13T02:31:50.952 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 333, 2024-06-13T02:31:50.952 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 322, 2024-06-13T02:31:50.952 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 1612592, 2024-06-13T02:31:50.952 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 198960, 2024-06-13T02:31:50.952 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 2, 2024-06-13T02:31:50.953 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 1, 2024-06-13T02:31:50.953 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.054504251, 2024-06-13T02:31:50.953 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.017255395, 2024-06-13T02:31:50.953 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.037633735, 2024-06-13T02:31:50.953 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.007204246, 2024-06-13T02:31:50.953 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:50.954 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 321, 2024-06-13T02:31:50.954 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.014764394, 2024-06-13T02:31:50.954 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000045994 2024-06-13T02:31:50.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:50.954 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 1612592, 2024-06-13T02:31:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 198960 2024-06-13T02:31:50.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:50.956 INFO:teuthology.orchestra.run.smithi175.stdout: "AsyncMessenger::Worker-2": { 2024-06-13T02:31:50.956 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_messages": 6, 2024-06-13T02:31:50.956 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages": 248, 2024-06-13T02:31:50.956 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_bytes": 3344, 2024-06-13T02:31:50.956 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_bytes": 199568, 2024-06-13T02:31:50.956 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_created_connections": 5, 2024-06-13T02:31:50.957 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_active_connections": 3, 2024-06-13T02:31:50.957 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_total_time": 0.013933257, 2024-06-13T02:31:50.957 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_send_time": 0.009704030, 2024-06-13T02:31:50.957 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_recv_time": 0.001595574, 2024-06-13T02:31:50.957 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-13T02:31:50.957 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_messages_queue_lat": { 2024-06-13T02:31:50.958 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 246, 2024-06-13T02:31:50.958 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.029544398, 2024-06-13T02:31:50.958 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000120099 2024-06-13T02:31:50.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:50.958 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_handle_ack_lat": { 2024-06-13T02:31:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-06-13T02:31:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: "msgr_send_encrypted_bytes": 199568 2024-06-13T02:31:50.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:50.960 INFO:teuthology.orchestra.run.smithi175.stdout: "cct": { 2024-06-13T02:31:50.960 INFO:teuthology.orchestra.run.smithi175.stdout: "total_workers": 0, 2024-06-13T02:31:50.960 INFO:teuthology.orchestra.run.smithi175.stdout: "unhealthy_workers": 0 2024-06-13T02:31:50.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:50.960 INFO:teuthology.orchestra.run.smithi175.stdout: "mempool": { 2024-06-13T02:31:50.960 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_bytes": 0, 2024-06-13T02:31:50.960 INFO:teuthology.orchestra.run.smithi175.stdout: "bloom_filter_items": 0, 2024-06-13T02:31:50.961 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_bytes": 0, 2024-06-13T02:31:50.961 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_alloc_items": 0, 2024-06-13T02:31:50.961 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_bytes": 0, 2024-06-13T02:31:50.961 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_data_items": 0, 2024-06-13T02:31:50.961 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-13T02:31:50.961 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_onode_items": 0, 2024-06-13T02:31:50.961 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-13T02:31:50.962 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_meta_items": 0, 2024-06-13T02:31:50.962 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_bytes": 0, 2024-06-13T02:31:50.962 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_other_items": 0, 2024-06-13T02:31:50.962 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-13T02:31:50.962 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_cache_buffer_items": 0, 2024-06-13T02:31:50.962 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_bytes": 0, 2024-06-13T02:31:50.963 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_extent_items": 0, 2024-06-13T02:31:50.963 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_bytes": 0, 2024-06-13T02:31:50.963 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_blob_items": 0, 2024-06-13T02:31:50.963 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-13T02:31:50.963 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_shared_blob_items": 0, 2024-06-13T02:31:50.963 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-13T02:31:50.963 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_inline_bl_items": 0, 2024-06-13T02:31:50.964 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_bytes": 0, 2024-06-13T02:31:50.964 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_fsck_items": 0, 2024-06-13T02:31:50.964 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_bytes": 0, 2024-06-13T02:31:50.964 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_txc_items": 0, 2024-06-13T02:31:50.964 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-13T02:31:50.964 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_deferred_items": 0, 2024-06-13T02:31:50.964 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_bytes": 0, 2024-06-13T02:31:50.965 INFO:teuthology.orchestra.run.smithi175.stdout: "bluestore_writing_items": 0, 2024-06-13T02:31:50.965 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_bytes": 0, 2024-06-13T02:31:50.965 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_items": 0, 2024-06-13T02:31:50.965 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_bytes": 0, 2024-06-13T02:31:50.965 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_reader_items": 0, 2024-06-13T02:31:50.965 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_bytes": 0, 2024-06-13T02:31:50.966 INFO:teuthology.orchestra.run.smithi175.stdout: "bluefs_file_writer_items": 0, 2024-06-13T02:31:50.966 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_bytes": 148692, 2024-06-13T02:31:50.966 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_anon_items": 30, 2024-06-13T02:31:50.966 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_bytes": 0, 2024-06-13T02:31:50.966 INFO:teuthology.orchestra.run.smithi175.stdout: "buffer_meta_items": 0, 2024-06-13T02:31:50.966 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_bytes": 0, 2024-06-13T02:31:50.966 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_items": 0, 2024-06-13T02:31:50.967 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_bytes": 0, 2024-06-13T02:31:50.967 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_mapbl_items": 0, 2024-06-13T02:31:50.967 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_bytes": 0, 2024-06-13T02:31:50.967 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_pglog_items": 0, 2024-06-13T02:31:50.967 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_bytes": 0, 2024-06-13T02:31:50.968 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_items": 0, 2024-06-13T02:31:50.968 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_bytes": 0, 2024-06-13T02:31:50.968 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_mapping_items": 0, 2024-06-13T02:31:50.968 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_bytes": 0, 2024-06-13T02:31:50.968 INFO:teuthology.orchestra.run.smithi175.stdout: "pgmap_items": 0, 2024-06-13T02:31:50.968 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_bytes": 928, 2024-06-13T02:31:50.968 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_co_items": 2, 2024-06-13T02:31:50.969 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_bytes": 0, 2024-06-13T02:31:50.969 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_1_items": 0, 2024-06-13T02:31:50.969 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_bytes": 0, 2024-06-13T02:31:50.969 INFO:teuthology.orchestra.run.smithi175.stdout: "unittest_2_items": 0 2024-06-13T02:31:50.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-06-13T02:31:50.969 INFO:teuthology.orchestra.run.smithi175.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-13T02:31:50.969 INFO:teuthology.orchestra.run.smithi175.stdout: "val": 0, 2024-06-13T02:31:50.970 INFO:teuthology.orchestra.run.smithi175.stdout: "max": 104857600, 2024-06-13T02:31:50.970 INFO:teuthology.orchestra.run.smithi175.stdout: "get_started": 0, 2024-06-13T02:31:50.970 INFO:teuthology.orchestra.run.smithi175.stdout: "get": 335, 2024-06-13T02:31:50.970 INFO:teuthology.orchestra.run.smithi175.stdout: "get_sum": 1565582, 2024-06-13T02:31:50.970 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_fail": 0, 2024-06-13T02:31:50.970 INFO:teuthology.orchestra.run.smithi175.stdout: "get_or_fail_success": 335, 2024-06-13T02:31:50.970 INFO:teuthology.orchestra.run.smithi175.stdout: "take": 0, 2024-06-13T02:31:50.971 INFO:teuthology.orchestra.run.smithi175.stdout: "take_sum": 0, 2024-06-13T02:31:50.971 INFO:teuthology.orchestra.run.smithi175.stdout: "put": 335, 2024-06-13T02:31:50.971 INFO:teuthology.orchestra.run.smithi175.stdout: "put_sum": 1565582, 2024-06-13T02:31:50.971 INFO:teuthology.orchestra.run.smithi175.stdout: "wait": { 2024-06-13T02:31:50.971 INFO:teuthology.orchestra.run.smithi175.stdout: "avgcount": 0, 2024-06-13T02:31:50.971 INFO:teuthology.orchestra.run.smithi175.stdout: "sum": 0.000000000, 2024-06-13T02:31:50.971 INFO:teuthology.orchestra.run.smithi175.stdout: "avgtime": 0.000000000 2024-06-13T02:31:50.972 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:50.972 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-06-13T02:31:50.972 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-06-13T02:31:51.418 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:51 smithi175 ceph-mon[36977]: pgmap v443: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 140 KiB/s wr, 18 op/s 2024-06-13T02:31:51.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:51 smithi084 ceph-mon[36833]: pgmap v443: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 140 KiB/s wr, 18 op/s 2024-06-13T02:31:51.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:51 smithi002 ceph-mon[31960]: pgmap v443: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 140 KiB/s wr, 18 op/s 2024-06-13T02:31:51.746 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-06-13T02:31:51.746 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-06-13T02:31:51.746 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-06-13T02:31:51.746 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-06-13T02:31:51.747 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-06-13T02:31:51.747 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-06-13T02:31:51.759 INFO:tasks.kclient:Unmounting kernel clients... 2024-06-13T02:31:51.760 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:31:51.760 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T02:31:51.823 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-06-13T02:31:51.823 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-13T02:31:51.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd blocklist ls 2024-06-13T02:31:52.362 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:31:53.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:53 smithi084 ceph-mon[36833]: pgmap v444: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 145 KiB/s wr, 21 op/s 2024-06-13T02:31:53.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:53 smithi175 ceph-mon[36977]: pgmap v444: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 145 KiB/s wr, 21 op/s 2024-06-13T02:31:53.543 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:53 smithi002 ceph-mon[31960]: pgmap v444: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 145 KiB/s wr, 21 op/s 2024-06-13T02:31:54.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.651+0000 7f35b7a00700 1 -- 172.21.15.2:0/4036240921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b01030f0 msgr2=0x7f35b0107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:54.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.651+0000 7f35b7a00700 1 --2- 172.21.15.2:0/4036240921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b01030f0 0x7f35b0107110 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f359c009920 tx=0x7f359c009c30 comp rx=0 tx=0).stop 2024-06-13T02:31:54.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.651+0000 7f35b7a00700 1 -- 172.21.15.2:0/4036240921 shutdown_connections 2024-06-13T02:31:54.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.651+0000 7f35b7a00700 1 --2- 172.21.15.2:0/4036240921 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b0107840 0x7f35b010f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:54.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.651+0000 7f35b7a00700 1 --2- 172.21.15.2:0/4036240921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0102740 0x7f35b0102b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:54.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.651+0000 7f35b7a00700 1 --2- 172.21.15.2:0/4036240921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b01030f0 0x7f35b0107110 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:54.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.651+0000 7f35b7a00700 1 -- 172.21.15.2:0/4036240921 >> 172.21.15.2:0/4036240921 conn(0x7f35b00795f0 msgr2=0x7f35b0079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:54.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.651+0000 7f35b7a00700 1 -- 172.21.15.2:0/4036240921 shutdown_connections 2024-06-13T02:31:54.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.651+0000 7f35b7a00700 1 -- 172.21.15.2:0/4036240921 wait complete. 2024-06-13T02:31:54.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.652+0000 7f35b7a00700 1 Processor -- start 2024-06-13T02:31:54.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.653+0000 7f35b7a00700 1 -- start start 2024-06-13T02:31:54.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.653+0000 7f35b7a00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b0102740 0x7f35b019ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:54.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.653+0000 7f35b7a00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b01030f0 0x7f35b019b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:54.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.653+0000 7f35b7a00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0107840 0x7f35b019f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:54.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.653+0000 7f35b7a00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f35b01127a0 con 0x7f35b01030f0 2024-06-13T02:31:54.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.653+0000 7f35b7a00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f35b0112620 con 0x7f35b0102740 2024-06-13T02:31:54.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.653+0000 7f35b7a00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35b0112920 con 0x7f35b0107840 2024-06-13T02:31:54.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.653+0000 7f35afe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b01030f0 0x7f35b019b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:54.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.653+0000 7f35afe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b01030f0 0x7f35b019b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55724/0 (socket says 172.21.15.2:55724) 2024-06-13T02:31:54.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.653+0000 7f35afe00700 1 -- 172.21.15.2:0/1125582258 learned_addr learned my addr 172.21.15.2:0/1125582258 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:31:54.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.653+0000 7f35b5000700 1 --2- 172.21.15.2:0/1125582258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b0102740 0x7f35b019ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:54.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.654+0000 7f35b5a00700 1 --2- 172.21.15.2:0/1125582258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0107840 0x7f35b019f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:54.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.654+0000 7f35afe00700 1 -- 172.21.15.2:0/1125582258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0107840 msgr2=0x7f35b019f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:54.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.654+0000 7f35afe00700 1 --2- 172.21.15.2:0/1125582258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0107840 0x7f35b019f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:54.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.654+0000 7f35afe00700 1 -- 172.21.15.2:0/1125582258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b0102740 msgr2=0x7f35b019ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:54.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.654+0000 7f35afe00700 1 --2- 172.21.15.2:0/1125582258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b0102740 0x7f35b019ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:54.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.654+0000 7f35afe00700 1 -- 172.21.15.2:0/1125582258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b019fe50 con 0x7f35b01030f0 2024-06-13T02:31:54.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.654+0000 7f35b5000700 1 --2- 172.21.15.2:0/1125582258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b0102740 0x7f35b019ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:31:54.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.654+0000 7f35afe00700 1 --2- 172.21.15.2:0/1125582258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b01030f0 0x7f35b019b3d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f359c000c00 tx=0x7f359c00fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:54.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.655+0000 7f35ad600700 1 -- 172.21.15.2:0/1125582258 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c027070 con 0x7f35b01030f0 2024-06-13T02:31:54.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.655+0000 7f35b7a00700 1 -- 172.21.15.2:0/1125582258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b01a00e0 con 0x7f35b01030f0 2024-06-13T02:31:54.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.655+0000 7f35ad600700 1 -- 172.21.15.2:0/1125582258 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f359c005660 con 0x7f35b01030f0 2024-06-13T02:31:54.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.655+0000 7f35ad600700 1 -- 172.21.15.2:0/1125582258 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c004930 con 0x7f35b01030f0 2024-06-13T02:31:54.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.655+0000 7f35b7a00700 1 -- 172.21.15.2:0/1125582258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b01a79c0 con 0x7f35b01030f0 2024-06-13T02:31:54.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.656+0000 7f35b7a00700 1 -- 172.21.15.2:0/1125582258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35b0103bd0 con 0x7f35b01030f0 2024-06-13T02:31:54.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.658+0000 7f35ad600700 1 -- 172.21.15.2:0/1125582258 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f359c02a070 con 0x7f35b01030f0 2024-06-13T02:31:54.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.659+0000 7f35ad600700 1 --2- 172.21.15.2:0/1125582258 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f35980a2d90 0x7f35980a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:54.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.660+0000 7f35ad600700 1 -- 172.21.15.2:0/1125582258 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 9583+0+0 (secure 0 0 0) 0x7f359c0d02a0 con 0x7f35b01030f0 2024-06-13T02:31:54.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.660+0000 7f35b5000700 1 --2- 172.21.15.2:0/1125582258 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f35980a2d90 0x7f35980a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:54.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.661+0000 7f35b5000700 1 --2- 172.21.15.2:0/1125582258 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f35980a2d90 0x7f35980a5250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f35a4011490 tx=0x7f35a4009260 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:54.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.664+0000 7f35ad600700 1 -- 172.21.15.2:0/1125582258 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f359c05e850 con 0x7f35b01030f0 2024-06-13T02:31:54.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.913+0000 7f35b7a00700 1 -- 172.21.15.2:0/1125582258 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f35b0069180 con 0x7f35b01030f0 2024-06-13T02:31:54.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.914+0000 7f35ad600700 1 -- 172.21.15.2:0/1125582258 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v121) ==== 81+0+928 (secure 0 0 0) 0x7f35b0069180 con 0x7f35b01030f0 2024-06-13T02:31:54.915 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1200045905 2024-06-14T02:17:49.559195+0000 2024-06-13T02:31:54.915 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/968145683 2024-06-14T02:17:49.559195+0000 2024-06-13T02:31:54.915 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2988831869 2024-06-14T02:17:49.559195+0000 2024-06-13T02:31:54.915 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3011421954 2024-06-14T02:17:49.559195+0000 2024-06-13T02:31:54.915 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/3121279966 2024-06-14T02:04:24.281164+0000 2024-06-13T02:31:54.915 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/3121279966 2024-06-14T02:04:24.281164+0000 2024-06-13T02:31:54.915 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/544481430 2024-06-14T02:17:49.559195+0000 2024-06-13T02:31:54.915 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3397168014 2024-06-14T02:04:24.281164+0000 2024-06-13T02:31:54.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1789744365 2024-06-14T02:04:24.281164+0000 2024-06-13T02:31:54.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3831398703 2024-06-14T02:03:50.073572+0000 2024-06-13T02:31:54.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2988831869 2024-06-14T02:17:49.559195+0000 2024-06-13T02:31:54.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/3119270562 2024-06-14T02:03:50.073572+0000 2024-06-13T02:31:54.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/2163302458 2024-06-14T02:03:50.073572+0000 2024-06-13T02:31:54.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6800/2830681579 2024-06-14T02:03:50.073572+0000 2024-06-13T02:31:54.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:0/1678672435 2024-06-14T02:04:24.281164+0000 2024-06-13T02:31:54.916 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2:6801/2830681579 2024-06-14T02:03:50.073572+0000 2024-06-13T02:31:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.917+0000 7f35b7a00700 1 -- 172.21.15.2:0/1125582258 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f35980a2d90 msgr2=0x7f35980a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.917+0000 7f35b7a00700 1 --2- 172.21.15.2:0/1125582258 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f35980a2d90 0x7f35980a5250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f35a4011490 tx=0x7f35a4009260 comp rx=0 tx=0).stop 2024-06-13T02:31:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.917+0000 7f35b7a00700 1 -- 172.21.15.2:0/1125582258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b01030f0 msgr2=0x7f35b019b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:54.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.917+0000 7f35b7a00700 1 --2- 172.21.15.2:0/1125582258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b01030f0 0x7f35b019b3d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f359c000c00 tx=0x7f359c00fa70 comp rx=0 tx=0).stop 2024-06-13T02:31:54.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.917+0000 7f35b7a00700 1 -- 172.21.15.2:0/1125582258 shutdown_connections 2024-06-13T02:31:54.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.917+0000 7f35b7a00700 1 --2- 172.21.15.2:0/1125582258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0107840 0x7f35b019f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:54.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.917+0000 7f35b7a00700 1 --2- 172.21.15.2:0/1125582258 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f35980a2d90 0x7f35980a5250 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:54.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.917+0000 7f35b7a00700 1 --2- 172.21.15.2:0/1125582258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35b0102740 0x7f35b019ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:54.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.917+0000 7f35b7a00700 1 --2- 172.21.15.2:0/1125582258 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35b01030f0 0x7f35b019b3d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:54.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.917+0000 7f35b7a00700 1 -- 172.21.15.2:0/1125582258 >> 172.21.15.2:0/1125582258 conn(0x7f35b00795f0 msgr2=0x7f35b01009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.918+0000 7f35b7a00700 1 -- 172.21.15.2:0/1125582258 shutdown_connections 2024-06-13T02:31:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:54.918+0000 7f35b7a00700 1 -- 172.21.15.2:0/1125582258 wait complete. 2024-06-13T02:31:54.920 INFO:teuthology.orchestra.run.smithi002.stderr:listed 16 entries 2024-06-13T02:31:55.304 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:55 smithi002 ceph-mon[31960]: pgmap v445: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-06-13T02:31:55.304 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:55 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1125582258' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T02:31:55.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:55 smithi084 ceph-mon[36833]: pgmap v445: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-06-13T02:31:55.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:55 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1125582258' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T02:31:55.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:55 smithi175 ceph-mon[36977]: pgmap v445: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-06-13T02:31:55.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:55 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1125582258' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-13T02:31:55.728 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-06-13T02:31:55.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:31:55.729 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-06-13T02:31:56.004 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T02:31:56.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:31:56.005 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-13T02:31:56.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:31:56.076 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-06-13T02:31:56.143 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-13T02:31:56.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:31:56.144 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-13T02:31:56.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-13T02:31:56.205 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-06-13T02:31:56.304 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-06-13T02:31:56.315 INFO:tasks.cephadm:Teardown begin 2024-06-13T02:31:56.315 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-13T02:31:56.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:31:56.725 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:31:57.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:57 smithi084 ceph-mon[36833]: pgmap v446: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 8 op/s 2024-06-13T02:31:57.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:57 smithi175 ceph-mon[36977]: pgmap v446: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 8 op/s 2024-06-13T02:31:57.579 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:57 smithi002 ceph-mon[31960]: pgmap v446: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 8 op/s 2024-06-13T02:31:59.166 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:31:59 smithi002 ceph-mon[31960]: pgmap v447: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-06-13T02:31:59.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.456+0000 7f8615600700 1 -- 172.21.15.2:0/188504368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f861010a650 msgr2=0x7f861010aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:59.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.456+0000 7f8615600700 1 --2- 172.21.15.2:0/188504368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f861010a650 0x7f861010aa30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f86000098f0 tx=0x7f8600009c00 comp rx=0 tx=0).stop 2024-06-13T02:31:59.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.456+0000 7f8615600700 1 -- 172.21.15.2:0/188504368 shutdown_connections 2024-06-13T02:31:59.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.456+0000 7f8615600700 1 --2- 172.21.15.2:0/188504368 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8610104f80 0x7f8610111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:59.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.456+0000 7f8615600700 1 --2- 172.21.15.2:0/188504368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f861010a650 0x7f861010aa30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:59.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.456+0000 7f8615600700 1 --2- 172.21.15.2:0/188504368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86101045c0 0x7f8610104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:59.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.456+0000 7f8615600700 1 -- 172.21.15.2:0/188504368 >> 172.21.15.2:0/188504368 conn(0x7f86101000b0 msgr2=0x7f86101024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:59.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.456+0000 7f8615600700 1 -- 172.21.15.2:0/188504368 shutdown_connections 2024-06-13T02:31:59.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.456+0000 7f8615600700 1 -- 172.21.15.2:0/188504368 wait complete. 2024-06-13T02:31:59.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.457+0000 7f8615600700 1 Processor -- start 2024-06-13T02:31:59.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.458+0000 7f8615600700 1 -- start start 2024-06-13T02:31:59.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.458+0000 7f8615600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86101045c0 0x7f861019ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:59.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.458+0000 7f8615600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8610104f80 0x7f861019b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:59.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.458+0000 7f8615600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f861010a650 0x7f861019f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:59.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.458+0000 7f8615600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f86101148f0 con 0x7f8610104f80 2024-06-13T02:31:59.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.458+0000 7f8615600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8610114770 con 0x7f86101045c0 2024-06-13T02:31:59.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.458+0000 7f8615600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8610114a70 con 0x7f861010a650 2024-06-13T02:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.458+0000 7f860f400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8610104f80 0x7f861019b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.458+0000 7f860fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86101045c0 0x7f861019ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.458+0000 7f860f400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8610104f80 0x7f861019b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55744/0 (socket says 172.21.15.2:55744) 2024-06-13T02:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.458+0000 7f860f400700 1 -- 172.21.15.2:0/2591154778 learned_addr learned my addr 172.21.15.2:0/2591154778 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.459+0000 7f8614c00700 1 --2- 172.21.15.2:0/2591154778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f861010a650 0x7f861019f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.459+0000 7f860fe00700 1 -- 172.21.15.2:0/2591154778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f861010a650 msgr2=0x7f861019f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.459+0000 7f860fe00700 1 --2- 172.21.15.2:0/2591154778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f861010a650 0x7f861019f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:59.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.459+0000 7f860fe00700 1 -- 172.21.15.2:0/2591154778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8610104f80 msgr2=0x7f861019b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.459+0000 7f860fe00700 1 --2- 172.21.15.2:0/2591154778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8610104f80 0x7f861019b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.459+0000 7f860fe00700 1 -- 172.21.15.2:0/2591154778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861019fd50 con 0x7f86101045c0 2024-06-13T02:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.459+0000 7f8614c00700 1 --2- 172.21.15.2:0/2591154778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f861010a650 0x7f861019f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.459+0000 7f860fe00700 1 --2- 172.21.15.2:0/2591154778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86101045c0 0x7f861019ad40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8600000c00 tx=0x7f860000fa70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.459+0000 7f860cc00700 1 -- 172.21.15.2:0/2591154778 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600005200 con 0x7f86101045c0 2024-06-13T02:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.460+0000 7f860cc00700 1 -- 172.21.15.2:0/2591154778 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f860000b560 con 0x7f86101045c0 2024-06-13T02:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.460+0000 7f8615600700 1 -- 172.21.15.2:0/2591154778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861019ffe0 con 0x7f86101045c0 2024-06-13T02:31:59.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.460+0000 7f860cc00700 1 -- 172.21.15.2:0/2591154778 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600003aa0 con 0x7f86101045c0 2024-06-13T02:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.460+0000 7f8615600700 1 -- 172.21.15.2:0/2591154778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86101a78c0 con 0x7f86101045c0 2024-06-13T02:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.461+0000 7f8606000700 1 -- 172.21.15.2:0/2591154778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e8005330 con 0x7f86101045c0 2024-06-13T02:31:59.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.463+0000 7f860cc00700 1 -- 172.21.15.2:0/2591154778 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f860000b710 con 0x7f86101045c0 2024-06-13T02:31:59.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.464+0000 7f860cc00700 1 --2- 172.21.15.2:0/2591154778 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f85f40a2e10 0x7f85f40a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:31:59.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.465+0000 7f860f400700 1 --2- 172.21.15.2:0/2591154778 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f85f40a2e10 0x7f85f40a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:31:59.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.465+0000 7f860cc00700 1 -- 172.21.15.2:0/2591154778 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 9583+0+0 (secure 0 0 0) 0x7f86000d0a50 con 0x7f86101045c0 2024-06-13T02:31:59.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.466+0000 7f860f400700 1 --2- 172.21.15.2:0/2591154778 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f85f40a2e10 0x7f85f40a52d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8610109c70 tx=0x7f85fc009260 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:31:59.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.467+0000 7f860cc00700 1 -- 172.21.15.2:0/2591154778 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f8600013030 con 0x7f86101045c0 2024-06-13T02:31:59.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:31:59 smithi084 ceph-mon[36833]: pgmap v447: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-06-13T02:31:59.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:31:59 smithi175 ceph-mon[36977]: pgmap v447: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.8 KiB/s wr, 6 op/s 2024-06-13T02:31:59.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.745+0000 7f8606000700 1 -- 172.21.15.2:0/2591154778 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85e8005620 con 0x7f86101045c0 2024-06-13T02:31:59.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.747+0000 7f860cc00700 1 -- 172.21.15.2:0/2591154778 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11861 (secure 0 0 0) 0x7f860009d280 con 0x7f86101045c0 2024-06-13T02:31:59.748 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:31:59.748 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3458450195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3458450195},{"type":"v1","addr":"172.21.15.2:6841","nonce":3458450195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1709394731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1709394731},{"type":"v1","addr":"172.21.15.175:6835","nonce":1709394731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T02:12:43.063161+0000","modified":"2024-06-13T02:31:00.014987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24503,"mds_2":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/2403775181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2403775181},{"type":"v1","addr":"172.21.15.84:6835","nonce":2403775181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/1446546569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1446546569},{"type":"v1","addr":"172.21.15.175:6837","nonce":1446546569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/2743442301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":2743442301},{"type":"v1","addr":"172.21.15.175:6839","nonce":2743442301}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":29,"addr":"172.21.15.2:6839/3208917373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3208917373},{"type":"v1","addr":"172.21.15.2:6839","nonce":3208917373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6839/541041266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":541041266},{"type":"v1","addr":"172.21.15.84:6839","nonce":541041266}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26198":{"gid":26198,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1192425303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1192425303},{"type":"v1","addr":"172.21.15.84:6837","nonce":1192425303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24490,24503,24527]},"id":1}]} 2024-06-13T02:31:59.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.750+0000 7f8606000700 1 -- 172.21.15.2:0/2591154778 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f85f40a2e10 msgr2=0x7f85f40a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:59.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.750+0000 7f8606000700 1 --2- 172.21.15.2:0/2591154778 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f85f40a2e10 0x7f85f40a52d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8610109c70 tx=0x7f85fc009260 comp rx=0 tx=0).stop 2024-06-13T02:31:59.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.750+0000 7f8606000700 1 -- 172.21.15.2:0/2591154778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86101045c0 msgr2=0x7f861019ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:31:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.750+0000 7f8606000700 1 --2- 172.21.15.2:0/2591154778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86101045c0 0x7f861019ad40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8600000c00 tx=0x7f860000fa70 comp rx=0 tx=0).stop 2024-06-13T02:31:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.750+0000 7f8606000700 1 -- 172.21.15.2:0/2591154778 shutdown_connections 2024-06-13T02:31:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.750+0000 7f8606000700 1 --2- 172.21.15.2:0/2591154778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f861010a650 0x7f861019f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.750+0000 7f8606000700 1 --2- 172.21.15.2:0/2591154778 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f85f40a2e10 0x7f85f40a52d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.750+0000 7f8606000700 1 --2- 172.21.15.2:0/2591154778 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f86101045c0 0x7f861019ad40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.750+0000 7f8606000700 1 --2- 172.21.15.2:0/2591154778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8610104f80 0x7f861019b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:31:59.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.750+0000 7f8606000700 1 -- 172.21.15.2:0/2591154778 >> 172.21.15.2:0/2591154778 conn(0x7f86101000b0 msgr2=0x7f8610101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:31:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.751+0000 7f8606000700 1 -- 172.21.15.2:0/2591154778 shutdown_connections 2024-06-13T02:31:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:31:59.751+0000 7f8606000700 1 -- 172.21.15.2:0/2591154778 wait complete. 2024-06-13T02:31:59.753 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 39 2024-06-13T02:32:00.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:00 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2591154778' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:32:00.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:00 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2591154778' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:32:00.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:00 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2591154778' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:32:00.557 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs dump --format=json 2024-06-13T02:32:01.006 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:32:01.414 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:01 smithi002 ceph-mon[31960]: pgmap v448: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-06-13T02:32:01.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:01 smithi084 ceph-mon[36833]: pgmap v448: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-06-13T02:32:01.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:01 smithi175 ceph-mon[36977]: pgmap v448: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-06-13T02:32:03.348 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:03 smithi002 ceph-mon[31960]: pgmap v449: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 66 KiB/s wr, 27 op/s 2024-06-13T02:32:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.406+0000 7f2671c00700 1 -- 172.21.15.2:0/3793989247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266c108ac0 msgr2=0x7f266c108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.406+0000 7f2671c00700 1 --2- 172.21.15.2:0/3793989247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266c108ac0 0x7f266c108f40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2658009990 tx=0x7f2658009ca0 comp rx=0 tx=0).stop 2024-06-13T02:32:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.406+0000 7f2671c00700 1 -- 172.21.15.2:0/3793989247 shutdown_connections 2024-06-13T02:32:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.406+0000 7f2671c00700 1 --2- 172.21.15.2:0/3793989247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f266c109480 0x7f266c115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.406+0000 7f2671c00700 1 --2- 172.21.15.2:0/3793989247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c10eac0 0x7f266c10eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:03.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.406+0000 7f2671c00700 1 --2- 172.21.15.2:0/3793989247 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266c108ac0 0x7f266c108f40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.406+0000 7f2671c00700 1 -- 172.21.15.2:0/3793989247 >> 172.21.15.2:0/3793989247 conn(0x7f266c075c60 msgr2=0x7f266c1072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:32:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.406+0000 7f2671c00700 1 -- 172.21.15.2:0/3793989247 shutdown_connections 2024-06-13T02:32:03.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.406+0000 7f2671c00700 1 -- 172.21.15.2:0/3793989247 wait complete. 2024-06-13T02:32:03.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.407+0000 7f2671c00700 1 Processor -- start 2024-06-13T02:32:03.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.407+0000 7f2671c00700 1 -- start start 2024-06-13T02:32:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.408+0000 7f2671c00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c108ac0 0x7f266c19f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.408+0000 7f2671c00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266c109480 0x7f266c19f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.408+0000 7f2671c00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f266c10eac0 0x7f266c1a3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.408+0000 7f2671c00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f266c118ea0 con 0x7f266c108ac0 2024-06-13T02:32:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.408+0000 7f2671c00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f266c118d20 con 0x7f266c109480 2024-06-13T02:32:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.408+0000 7f2671c00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f266c119020 con 0x7f266c10eac0 2024-06-13T02:32:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.408+0000 7f266aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c108ac0 0x7f266c19f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.408+0000 7f266aa00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c108ac0 0x7f266c19f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56798/0 (socket says 172.21.15.2:56798) 2024-06-13T02:32:03.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.408+0000 7f266aa00700 1 -- 172.21.15.2:0/2350827267 learned_addr learned my addr 172.21.15.2:0/2350827267 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:32:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.408+0000 7f266a000700 1 --2- 172.21.15.2:0/2350827267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266c109480 0x7f266c19f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.408+0000 7f266b400700 1 --2- 172.21.15.2:0/2350827267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f266c10eac0 0x7f266c1a3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.409+0000 7f266aa00700 1 -- 172.21.15.2:0/2350827267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f266c10eac0 msgr2=0x7f266c1a3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.409+0000 7f266aa00700 1 --2- 172.21.15.2:0/2350827267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f266c10eac0 0x7f266c1a3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.409+0000 7f266aa00700 1 -- 172.21.15.2:0/2350827267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266c109480 msgr2=0x7f266c19f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.409+0000 7f266aa00700 1 --2- 172.21.15.2:0/2350827267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266c109480 0x7f266c19f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:03.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.409+0000 7f266aa00700 1 -- 172.21.15.2:0/2350827267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266c1a4280 con 0x7f266c108ac0 2024-06-13T02:32:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.409+0000 7f266aa00700 1 --2- 172.21.15.2:0/2350827267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c108ac0 0x7f266c19f270 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f265c00e9a0 tx=0x7f265c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:32:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.410+0000 7f2663400700 1 -- 172.21.15.2:0/2350827267 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c00ca10 con 0x7f266c108ac0 2024-06-13T02:32:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.410+0000 7f2663400700 1 -- 172.21.15.2:0/2350827267 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f265c00cbb0 con 0x7f266c108ac0 2024-06-13T02:32:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.410+0000 7f2671c00700 1 -- 172.21.15.2:0/2350827267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f266c1a4570 con 0x7f266c108ac0 2024-06-13T02:32:03.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.410+0000 7f2663400700 1 -- 172.21.15.2:0/2350827267 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c018680 con 0x7f266c108ac0 2024-06-13T02:32:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.410+0000 7f2671c00700 1 -- 172.21.15.2:0/2350827267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f266c1abdf0 con 0x7f266c108ac0 2024-06-13T02:32:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.411+0000 7f2671c00700 1 -- 172.21.15.2:0/2350827267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f266c069180 con 0x7f266c108ac0 2024-06-13T02:32:03.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.413+0000 7f2663400700 1 -- 172.21.15.2:0/2350827267 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f265c010430 con 0x7f266c108ac0 2024-06-13T02:32:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.414+0000 7f2663400700 1 --2- 172.21.15.2:0/2350827267 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f26500a2d90 0x7f26500a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.415+0000 7f2663400700 1 -- 172.21.15.2:0/2350827267 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 9583+0+0 (secure 0 0 0) 0x7f265c0cfa80 con 0x7f266c108ac0 2024-06-13T02:32:03.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.415+0000 7f266a000700 1 --2- 172.21.15.2:0/2350827267 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f26500a2d90 0x7f26500a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:03.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.416+0000 7f266a000700 1 --2- 172.21.15.2:0/2350827267 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f26500a2d90 0x7f26500a5250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f266c077b60 tx=0x7f2658005fd0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:32:03.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.420+0000 7f2663400700 1 -- 172.21.15.2:0/2350827267 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f265c0d1e20 con 0x7f266c108ac0 2024-06-13T02:32:03.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:03 smithi084 ceph-mon[36833]: pgmap v449: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 66 KiB/s wr, 27 op/s 2024-06-13T02:32:03.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:03 smithi175 ceph-mon[36977]: pgmap v449: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 66 KiB/s wr, 27 op/s 2024-06-13T02:32:03.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.693+0000 7f2671c00700 1 -- 172.21.15.2:0/2350827267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f266c02dca0 con 0x7f266c108ac0 2024-06-13T02:32:03.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.695+0000 7f2663400700 1 -- 172.21.15.2:0/2350827267 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11861 (secure 0 0 0) 0x7f265c09c220 con 0x7f266c108ac0 2024-06-13T02:32:03.696 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:32:03.696 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14367,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3732907395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3732907395},{"type":"v1","addr":"172.21.15.2:6837","nonce":3732907395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14400,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6841/3458450195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6840","nonce":3458450195},{"type":"v1","addr":"172.21.15.2:6841","nonce":3458450195}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1278226284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1278226284},{"type":"v1","addr":"172.21.15.175:6833","nonce":1278226284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/206981148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":206981148},{"type":"v1","addr":"172.21.15.2:6835","nonce":206981148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24443,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6833/3039491270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3039491270},{"type":"v1","addr":"172.21.15.84:6833","nonce":3039491270}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1709394731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1709394731},{"type":"v1","addr":"172.21.15.175:6835","nonce":1709394731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-13T02:12:43.063161+0000","modified":"2024-06-13T02:31:00.014987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24527,"mds_1":24503,"mds_2":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6835/2403775181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2403775181},{"type":"v1","addr":"172.21.15.84:6835","nonce":2403775181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.175:6837/1446546569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1446546569},{"type":"v1","addr":"172.21.15.175:6837","nonce":1446546569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":31,"addr":"172.21.15.175:6839/2743442301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6838","nonce":2743442301},{"type":"v1","addr":"172.21.15.175:6839","nonce":2743442301}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"g","rank":1,"incarnation":20,"state":"up:active","state_seq":29,"addr":"172.21.15.2:6839/3208917373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6838","nonce":3208917373},{"type":"v1","addr":"172.21.15.2:6839","nonce":3208917373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24527":{"gid":24527,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.84:6839/541041266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":541041266},{"type":"v1","addr":"172.21.15.84:6839","nonce":541041266}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26198":{"gid":26198,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.84:6837/1192425303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1192425303},{"type":"v1","addr":"172.21.15.84:6837","nonce":1192425303}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24527,"qdb_cluster":[24490,24503,24527]},"id":1}]} 2024-06-13T02:32:03.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.698+0000 7f2671c00700 1 -- 172.21.15.2:0/2350827267 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f26500a2d90 msgr2=0x7f26500a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:03.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.698+0000 7f2671c00700 1 --2- 172.21.15.2:0/2350827267 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f26500a2d90 0x7f26500a5250 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f266c077b60 tx=0x7f2658005fd0 comp rx=0 tx=0).stop 2024-06-13T02:32:03.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.698+0000 7f2671c00700 1 -- 172.21.15.2:0/2350827267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c108ac0 msgr2=0x7f266c19f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:03.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.698+0000 7f2671c00700 1 --2- 172.21.15.2:0/2350827267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c108ac0 0x7f266c19f270 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f265c00e9a0 tx=0x7f265c00ecb0 comp rx=0 tx=0).stop 2024-06-13T02:32:03.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.698+0000 7f2671c00700 1 -- 172.21.15.2:0/2350827267 shutdown_connections 2024-06-13T02:32:03.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.698+0000 7f2671c00700 1 --2- 172.21.15.2:0/2350827267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f266c10eac0 0x7f266c1a3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:03.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.698+0000 7f2671c00700 1 --2- 172.21.15.2:0/2350827267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f266c108ac0 0x7f266c19f270 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:03.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.698+0000 7f2671c00700 1 --2- 172.21.15.2:0/2350827267 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f26500a2d90 0x7f26500a5250 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:03.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.698+0000 7f2671c00700 1 --2- 172.21.15.2:0/2350827267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f266c109480 0x7f266c19f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:03.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.698+0000 7f2671c00700 1 -- 172.21.15.2:0/2350827267 >> 172.21.15.2:0/2350827267 conn(0x7f266c075c60 msgr2=0x7f266c076220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:32:03.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.699+0000 7f2671c00700 1 -- 172.21.15.2:0/2350827267 shutdown_connections 2024-06-13T02:32:03.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:03.699+0000 7f2671c00700 1 -- 172.21.15.2:0/2350827267 wait complete. 2024-06-13T02:32:03.701 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 39 2024-06-13T02:32:04.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:04 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2350827267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:32:04.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:04 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2350827267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:32:04.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:04 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2350827267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-13T02:32:04.540 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd dump --format=json 2024-06-13T02:32:05.013 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:32:05.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:05 smithi084 ceph-mon[36833]: pgmap v450: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 24 op/s 2024-06-13T02:32:05.515 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:05 smithi002 ceph-mon[31960]: pgmap v450: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 24 op/s 2024-06-13T02:32:05.531 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:05 smithi175 ceph-mon[36977]: pgmap v450: 129 pgs: 129 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 61 KiB/s wr, 24 op/s 2024-06-13T02:32:06.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:06 smithi084 ceph-mon[36833]: osdmap e122: 12 total, 12 up, 12 in 2024-06-13T02:32:06.531 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:06 smithi175 ceph-mon[36977]: osdmap e122: 12 total, 12 up, 12 in 2024-06-13T02:32:06.562 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:06 smithi002 ceph-mon[31960]: osdmap e122: 12 total, 12 up, 12 in 2024-06-13T02:32:07.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:07 smithi175 ceph-mon[36977]: pgmap v452: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 87 KiB/s wr, 30 op/s 2024-06-13T02:32:07.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.532+0000 7fcb06a00700 1 -- 172.21.15.2:0/1909239795 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4017660 con 0x7fcb0806a170 2024-06-13T02:32:07.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.533+0000 7fcb0f000700 1 -- 172.21.15.2:0/1909239795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb0806a170 msgr2=0x7fcb0806a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:07.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.533+0000 7fcb0f000700 1 --2- 172.21.15.2:0/1909239795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb0806a170 0x7fcb0806a5f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40098f0 tx=0x7fcaf4009c00 comp rx=0 tx=0).stop 2024-06-13T02:32:07.535 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:07 smithi002 ceph-mon[31960]: pgmap v452: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 87 KiB/s wr, 30 op/s 2024-06-13T02:32:07.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.534+0000 7fcb0f000700 1 -- 172.21.15.2:0/1909239795 shutdown_connections 2024-06-13T02:32:07.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.534+0000 7fcb0f000700 1 --2- 172.21.15.2:0/1909239795 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb0806ab30 0x7fcb0810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:07.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.534+0000 7fcb0f000700 1 --2- 172.21.15.2:0/1909239795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb08108500 0x7fcb081088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:07.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.534+0000 7fcb0f000700 1 --2- 172.21.15.2:0/1909239795 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb0806a170 0x7fcb0806a5f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:07.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.534+0000 7fcb0f000700 1 -- 172.21.15.2:0/1909239795 >> 172.21.15.2:0/1909239795 conn(0x7fcb08078340 msgr2=0x7fcb08078750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:32:07.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.534+0000 7fcb0f000700 1 -- 172.21.15.2:0/1909239795 shutdown_connections 2024-06-13T02:32:07.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.534+0000 7fcb0f000700 1 -- 172.21.15.2:0/1909239795 wait complete. 2024-06-13T02:32:07.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.536+0000 7fcb0f000700 1 Processor -- start 2024-06-13T02:32:07.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.536+0000 7fcb0f000700 1 -- start start 2024-06-13T02:32:07.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.537+0000 7fcb0f000700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb0806a170 0x7fcb0819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:07.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.537+0000 7fcb0f000700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb0806ab30 0x7fcb0819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:07.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.537+0000 7fcb0f000700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb08108500 0x7fcb081968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:07.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.537+0000 7fcb0f000700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb08110630 con 0x7fcb0806ab30 2024-06-13T02:32:07.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.537+0000 7fcb0f000700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcb081104b0 con 0x7fcb08108500 2024-06-13T02:32:07.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.537+0000 7fcb0f000700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcb081107b0 con 0x7fcb0806a170 2024-06-13T02:32:07.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.537+0000 7fcb07e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb0806a170 0x7fcb0819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:07.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.538+0000 7fcb07e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb0806a170 0x7fcb0819c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:36732/0 (socket says 172.21.15.2:36732) 2024-06-13T02:32:07.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.538+0000 7fcb07e00700 1 -- 172.21.15.2:0/2746817736 learned_addr learned my addr 172.21.15.2:0/2746817736 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:32:07.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.538+0000 7fcb0d000700 1 --2- 172.21.15.2:0/2746817736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb08108500 0x7fcb081968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:07.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.538+0000 7fcb07e00700 1 -- 172.21.15.2:0/2746817736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb08108500 msgr2=0x7fcb081968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:07.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.538+0000 7fcb07e00700 1 --2- 172.21.15.2:0/2746817736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb08108500 0x7fcb081968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:07.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.538+0000 7fcb07e00700 1 -- 172.21.15.2:0/2746817736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb0806ab30 msgr2=0x7fcb0819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:07.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.538+0000 7fcb07e00700 1 --2- 172.21.15.2:0/2746817736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb0806ab30 0x7fcb0819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.538+0000 7fcb07e00700 1 -- 172.21.15.2:0/2746817736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb08197050 con 0x7fcb0806a170 2024-06-13T02:32:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.539+0000 7fcb07e00700 1 --2- 172.21.15.2:0/2746817736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb0806a170 0x7fcb0819c6e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000bfd0 tx=0x7fcb00011760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:32:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.539+0000 7fcb04c00700 1 -- 172.21.15.2:0/2746817736 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0001e070 con 0x7fcb0806a170 2024-06-13T02:32:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.539+0000 7fcb04c00700 1 -- 172.21.15.2:0/2746817736 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb00019ae0 con 0x7fcb0806a170 2024-06-13T02:32:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.539+0000 7fcb04c00700 1 -- 172.21.15.2:0/2746817736 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb00018bb0 con 0x7fcb0806a170 2024-06-13T02:32:07.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.539+0000 7fcb0f000700 1 -- 172.21.15.2:0/2746817736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb08197340 con 0x7fcb0806a170 2024-06-13T02:32:07.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.540+0000 7fcb0f000700 1 -- 172.21.15.2:0/2746817736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb081a35b0 con 0x7fcb0806a170 2024-06-13T02:32:07.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.542+0000 7fcb0f000700 1 -- 172.21.15.2:0/2746817736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb08069180 con 0x7fcb0806a170 2024-06-13T02:32:07.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.547+0000 7fcb04c00700 1 -- 172.21.15.2:0/2746817736 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fcb00019600 con 0x7fcb0806a170 2024-06-13T02:32:07.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.550+0000 7fcb04c00700 1 --2- 172.21.15.2:0/2746817736 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcaec0ab7a0 0x7fcaec0adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:07.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.550+0000 7fcb04c00700 1 -- 172.21.15.2:0/2746817736 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9671+0+0 (secure 0 0 0) 0x7fcb000ceca0 con 0x7fcb0806a170 2024-06-13T02:32:07.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.551+0000 7fcb07400700 1 --2- 172.21.15.2:0/2746817736 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcaec0ab7a0 0x7fcaec0adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:07.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.553+0000 7fcb07400700 1 --2- 172.21.15.2:0/2746817736 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcaec0ab7a0 0x7fcaec0adc60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400b2e0 tx=0x7fcaf40058e0 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:32:07.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.556+0000 7fcb04c00700 1 -- 172.21.15.2:0/2746817736 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcb00014070 con 0x7fcb0806a170 2024-06-13T02:32:07.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:07 smithi084 ceph-mon[36833]: pgmap v452: 129 pgs: 12 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 86 active+clean; 277 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 87 KiB/s wr, 30 op/s 2024-06-13T02:32:07.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.980+0000 7fcb0f000700 1 -- 172.21.15.2:0/2746817736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb0802de60 con 0x7fcb0806a170 2024-06-13T02:32:07.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.982+0000 7fcb04c00700 1 -- 172.21.15.2:0/2746817736 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+25548 (secure 0 0 0) 0x7fcb0009b3e0 con 0x7fcb0806a170 2024-06-13T02:32:07.986 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-06-13T02:32:07.987 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":122,"fsid":"efed8ab4-2928-11ef-bc9c-c7b262605968","created":"2024-06-13T02:03:16.412002+0000","modified":"2024-06-13T02:32:05.191041+0000","last_up_change":"2024-06-13T02:11:26.464184+0000","last_in_change":"2024-06-13T02:11:06.957351+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-13T02:07:10.994857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-13T02:12:34.674172+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-13T02:12:39.213985+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":25,"snap_epoch":122,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-06-13T02:12:53.098590+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":25,"snap_epoch":122,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"96b4d494-453c-48aa-b1e2-ee30dfa83e2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6803","nonce":3254812126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6805","nonce":3254812126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6809","nonce":3254812126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3254812126},{"type":"v1","addr":"172.21.15.2:6807","nonce":3254812126}]},"public_addr":"172.21.15.2:6803/3254812126","cluster_addr":"172.21.15.2:6805/3254812126","heartbeat_back_addr":"172.21.15.2:6809/3254812126","heartbeat_front_addr":"172.21.15.2:6807/3254812126","state":["exists","up"]},{"osd":1,"uuid":"856e86b6-9281-485b-a36b-2fe04de31329","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6801","nonce":1593775403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6803","nonce":1593775403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6807","nonce":1593775403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1593775403},{"type":"v1","addr":"172.21.15.84:6805","nonce":1593775403}]},"public_addr":"172.21.15.84:6801/1593775403","cluster_addr":"172.21.15.84:6803/1593775403","heartbeat_back_addr":"172.21.15.84:6807/1593775403","heartbeat_front_addr":"172.21.15.84:6805/1593775403","state":["exists","up"]},{"osd":2,"uuid":"8c9daa52-0dfb-471a-afb4-6eb0b908195a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6801","nonce":2174304558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6803","nonce":2174304558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6807","nonce":2174304558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2174304558},{"type":"v1","addr":"172.21.15.175:6805","nonce":2174304558}]},"public_addr":"172.21.15.175:6801/2174304558","cluster_addr":"172.21.15.175:6803/2174304558","heartbeat_back_addr":"172.21.15.175:6807/2174304558","heartbeat_front_addr":"172.21.15.175:6805/2174304558","state":["exists","up"]},{"osd":3,"uuid":"2e747d36-4aa5-4c4c-918d-b8100980cc8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6811","nonce":3010864289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6813","nonce":3010864289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6817","nonce":3010864289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":3010864289},{"type":"v1","addr":"172.21.15.2:6815","nonce":3010864289}]},"public_addr":"172.21.15.2:6811/3010864289","cluster_addr":"172.21.15.2:6813/3010864289","heartbeat_back_addr":"172.21.15.2:6817/3010864289","heartbeat_front_addr":"172.21.15.2:6815/3010864289","state":["exists","up"]},{"osd":4,"uuid":"bd063fb2-1a65-4b18-898c-f80ddc2a1229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6809","nonce":2541323390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6811","nonce":2541323390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6815","nonce":2541323390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2541323390},{"type":"v1","addr":"172.21.15.84:6813","nonce":2541323390}]},"public_addr":"172.21.15.84:6809/2541323390","cluster_addr":"172.21.15.84:6811/2541323390","heartbeat_back_addr":"172.21.15.84:6815/2541323390","heartbeat_front_addr":"172.21.15.84:6813/2541323390","state":["exists","up"]},{"osd":5,"uuid":"e0ea80fd-1bfe-4d2e-9733-ff442ec015b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6809","nonce":764262885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6811","nonce":764262885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6815","nonce":764262885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":764262885},{"type":"v1","addr":"172.21.15.175:6813","nonce":764262885}]},"public_addr":"172.21.15.175:6809/764262885","cluster_addr":"172.21.15.175:6811/764262885","heartbeat_back_addr":"172.21.15.175:6815/764262885","heartbeat_front_addr":"172.21.15.175:6813/764262885","state":["exists","up"]},{"osd":6,"uuid":"1c204d74-5e48-4e2e-bb98-6a8d4974187c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6819","nonce":297321106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6821","nonce":297321106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6825","nonce":297321106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":297321106},{"type":"v1","addr":"172.21.15.2:6823","nonce":297321106}]},"public_addr":"172.21.15.2:6819/297321106","cluster_addr":"172.21.15.2:6821/297321106","heartbeat_back_addr":"172.21.15.2:6825/297321106","heartbeat_front_addr":"172.21.15.2:6823/297321106","state":["exists","up"]},{"osd":7,"uuid":"1299bbb1-fbfb-4aba-be6b-6704691735f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6817","nonce":3873726653}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6819","nonce":3873726653}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6823","nonce":3873726653}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3873726653},{"type":"v1","addr":"172.21.15.84:6821","nonce":3873726653}]},"public_addr":"172.21.15.84:6817/3873726653","cluster_addr":"172.21.15.84:6819/3873726653","heartbeat_back_addr":"172.21.15.84:6823/3873726653","heartbeat_front_addr":"172.21.15.84:6821/3873726653","state":["exists","up"]},{"osd":8,"uuid":"9c3f2a92-d956-4246-bce9-620824d0da22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6817","nonce":2622818232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6819","nonce":2622818232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6823","nonce":2622818232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":2622818232},{"type":"v1","addr":"172.21.15.175:6821","nonce":2622818232}]},"public_addr":"172.21.15.175:6817/2622818232","cluster_addr":"172.21.15.175:6819/2622818232","heartbeat_back_addr":"172.21.15.175:6823/2622818232","heartbeat_front_addr":"172.21.15.175:6821/2622818232","state":["exists","up"]},{"osd":9,"uuid":"e9839f78-05c6-4b3f-bc14-cb771a03ff5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6827","nonce":1171735390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6829","nonce":1171735390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6833","nonce":1171735390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":1171735390},{"type":"v1","addr":"172.21.15.2:6831","nonce":1171735390}]},"public_addr":"172.21.15.2:6827/1171735390","cluster_addr":"172.21.15.2:6829/1171735390","heartbeat_back_addr":"172.21.15.2:6833/1171735390","heartbeat_front_addr":"172.21.15.2:6831/1171735390","state":["exists","up"]},{"osd":10,"uuid":"66719431-5ba9-4865-957b-f6582e607a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6825","nonce":4269523460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6827","nonce":4269523460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6831","nonce":4269523460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":4269523460},{"type":"v1","addr":"172.21.15.84:6829","nonce":4269523460}]},"public_addr":"172.21.15.84:6825/4269523460","cluster_addr":"172.21.15.84:6827/4269523460","heartbeat_back_addr":"172.21.15.84:6831/4269523460","heartbeat_front_addr":"172.21.15.84:6829/4269523460","state":["exists","up"]},{"osd":11,"uuid":"1ce6e6ee-6ff3-416f-b985-e3afe503093d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6825","nonce":2762894732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6827","nonce":2762894732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6831","nonce":2762894732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":2762894732},{"type":"v1","addr":"172.21.15.175:6829","nonce":2762894732}]},"public_addr":"172.21.15.175:6825/2762894732","cluster_addr":"172.21.15.175:6827/2762894732","heartbeat_back_addr":"172.21.15.175:6831/2762894732","heartbeat_front_addr":"172.21.15.175:6829/2762894732","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:16.956638+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:06:42.268685+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:06.272084+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:07:39.696927+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:06.182991+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:08:31.626603+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:05.247728+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:31.985114+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:09:57.474180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:31.988863+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:10:59.683056+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-13T02:11:24.493248+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.2:0/1200045905":"2024-06-14T02:17:49.559195+0000","172.21.15.2:0/968145683":"2024-06-14T02:17:49.559195+0000","172.21.15.2:6800/2988831869":"2024-06-14T02:17:49.559195+0000","172.21.15.2:0/3011421954":"2024-06-14T02:17:49.559195+0000","172.21.15.2:6801/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6800/3121279966":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/544481430":"2024-06-14T02:17:49.559195+0000","172.21.15.2:0/3397168014":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/1789744365":"2024-06-14T02:04:24.281164+0000","172.21.15.2:0/3831398703":"2024-06-14T02:03:50.073572+0000","172.21.15.2:6801/2988831869":"2024-06-14T02:17:49.559195+0000","172.21.15.2:0/3119270562":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/2163302458":"2024-06-14T02:03:50.073572+0000","172.21.15.2:6800/2830681579":"2024-06-14T02:03:50.073572+0000","172.21.15.2:0/1678672435":"2024-06-14T02:04:24.281164+0000","172.21.15.2:6801/2830681579":"2024-06-14T02:03:50.073572+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":12,"length":1},{"begin":25,"length":1}]},{"pool":4,"snaps":[{"begin":12,"length":1},{"begin":25,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":12,"length":1},{"begin":25,"length":1}]},{"pool":4,"snaps":[{"begin":12,"length":1},{"begin":25,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-13T02:32:07.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.989+0000 7fcb0f000700 1 -- 172.21.15.2:0/2746817736 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcaec0ab7a0 msgr2=0x7fcaec0adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:07.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.989+0000 7fcb0f000700 1 --2- 172.21.15.2:0/2746817736 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcaec0ab7a0 0x7fcaec0adc60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400b2e0 tx=0x7fcaf40058e0 comp rx=0 tx=0).stop 2024-06-13T02:32:07.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.989+0000 7fcb0f000700 1 -- 172.21.15.2:0/2746817736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb0806a170 msgr2=0x7fcb0819c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:07.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.989+0000 7fcb0f000700 1 --2- 172.21.15.2:0/2746817736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb0806a170 0x7fcb0819c6e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000bfd0 tx=0x7fcb00011760 comp rx=0 tx=0).stop 2024-06-13T02:32:07.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.990+0000 7fcb0f000700 1 -- 172.21.15.2:0/2746817736 shutdown_connections 2024-06-13T02:32:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.990+0000 7fcb0f000700 1 --2- 172.21.15.2:0/2746817736 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcaec0ab7a0 0x7fcaec0adc60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.990+0000 7fcb0f000700 1 --2- 172.21.15.2:0/2746817736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb08108500 0x7fcb081968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:07.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.990+0000 7fcb0f000700 1 --2- 172.21.15.2:0/2746817736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb0806a170 0x7fcb0819c6e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:07.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.990+0000 7fcb0f000700 1 --2- 172.21.15.2:0/2746817736 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb0806ab30 0x7fcb0819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:07.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.990+0000 7fcb0f000700 1 -- 172.21.15.2:0/2746817736 >> 172.21.15.2:0/2746817736 conn(0x7fcb08078340 msgr2=0x7fcb08100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:32:07.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.991+0000 7fcb0f000700 1 -- 172.21.15.2:0/2746817736 shutdown_connections 2024-06-13T02:32:07.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:07.991+0000 7fcb0f000700 1 -- 172.21.15.2:0/2746817736 wait complete. 2024-06-13T02:32:08.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:08 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2746817736' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:32:08.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:08 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2746817736' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:32:08.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:08 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2746817736' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-13T02:32:08.844 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs fail cephfs 2024-06-13T02:32:09.308 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:32:09.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:09 smithi175 ceph-mon[36977]: pgmap v453: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 276 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 87 KiB/s wr, 30 op/s 2024-06-13T02:32:09.629 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:09 smithi002 ceph-mon[31960]: pgmap v453: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 276 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 87 KiB/s wr, 30 op/s 2024-06-13T02:32:09.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:09 smithi084 ceph-mon[36833]: pgmap v453: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 276 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 87 KiB/s wr, 30 op/s 2024-06-13T02:32:11.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:11 smithi175 ceph-mon[36977]: pgmap v454: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 276 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 87 KiB/s wr, 30 op/s 2024-06-13T02:32:11.538 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:11 smithi002 ceph-mon[31960]: pgmap v454: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 276 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 87 KiB/s wr, 30 op/s 2024-06-13T02:32:11.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:11 smithi084 ceph-mon[36833]: pgmap v454: 129 pgs: 20 active+clean+snaptrim, 55 active+clean+snaptrim_wait, 54 active+clean; 276 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 87 KiB/s wr, 30 op/s 2024-06-13T02:32:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.877+0000 7fcb05200700 1 -- 172.21.15.2:0/80748801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb00101b40 msgr2=0x7fcb0010e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.877+0000 7fcb05200700 1 --2- 172.21.15.2:0/80748801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb00101b40 0x7fcb0010e800 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009990 tx=0x7fcaec009ca0 comp rx=0 tx=0).stop 2024-06-13T02:32:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.878+0000 7fcb05200700 1 -- 172.21.15.2:0/80748801 shutdown_connections 2024-06-13T02:32:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.878+0000 7fcb05200700 1 --2- 172.21.15.2:0/80748801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb0010ed40 0x7fcb00111130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.878+0000 7fcb05200700 1 --2- 172.21.15.2:0/80748801 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb00101190 0x7fcb00101570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.878+0000 7fcb05200700 1 --2- 172.21.15.2:0/80748801 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb00101b40 0x7fcb0010e800 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.878+0000 7fcb05200700 1 -- 172.21.15.2:0/80748801 >> 172.21.15.2:0/80748801 conn(0x7fcb000fcdb0 msgr2=0x7fcb000ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:32:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.878+0000 7fcb05200700 1 -- 172.21.15.2:0/80748801 shutdown_connections 2024-06-13T02:32:11.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.878+0000 7fcb05200700 1 -- 172.21.15.2:0/80748801 wait complete. 2024-06-13T02:32:11.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.879+0000 7fcb05200700 1 Processor -- start 2024-06-13T02:32:11.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.879+0000 7fcb05200700 1 -- start start 2024-06-13T02:32:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.880+0000 7fcb05200700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb00101190 0x7fcb0019ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.880+0000 7fcb05200700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb00101b40 0x7fcb0019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.880+0000 7fcb05200700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb0010ed40 0x7fcb0019f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.880+0000 7fcb05200700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00114980 con 0x7fcb00101190 2024-06-13T02:32:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.880+0000 7fcb05200700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00114800 con 0x7fcb0010ed40 2024-06-13T02:32:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.880+0000 7fcb05200700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcb00114b00 con 0x7fcb00101b40 2024-06-13T02:32:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.880+0000 7fcaff400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb00101190 0x7fcb0019ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.880+0000 7fcaff400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb00101190 0x7fcb0019ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:49260/0 (socket says 172.21.15.2:49260) 2024-06-13T02:32:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.880+0000 7fcaff400700 1 -- 172.21.15.2:0/2803416713 learned_addr learned my addr 172.21.15.2:0/2803416713 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:32:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.880+0000 7fcafea00700 1 --2- 172.21.15.2:0/2803416713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb00101b40 0x7fcb0019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.880+0000 7fcaffe00700 1 --2- 172.21.15.2:0/2803416713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb0010ed40 0x7fcb0019f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.881+0000 7fcaff400700 1 -- 172.21.15.2:0/2803416713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb00101b40 msgr2=0x7fcb0019b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.881+0000 7fcaff400700 1 --2- 172.21.15.2:0/2803416713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb00101b40 0x7fcb0019b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.881+0000 7fcaff400700 1 -- 172.21.15.2:0/2803416713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb0010ed40 msgr2=0x7fcb0019f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.881+0000 7fcaff400700 1 --2- 172.21.15.2:0/2803416713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb0010ed40 0x7fcb0019f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:11.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.881+0000 7fcaff400700 1 -- 172.21.15.2:0/2803416713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0019fdd0 con 0x7fcb00101190 2024-06-13T02:32:11.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.881+0000 7fcafea00700 1 --2- 172.21.15.2:0/2803416713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb00101b40 0x7fcb0019b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:32:11.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.881+0000 7fcaff400700 1 --2- 172.21.15.2:0/2803416713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb00101190 0x7fcb0019ae10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000e9a0 tx=0x7fcaf000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:32:11.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.881+0000 7fcaf7e00700 1 -- 172.21.15.2:0/2803416713 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf000ca10 con 0x7fcb00101190 2024-06-13T02:32:11.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.881+0000 7fcaf7e00700 1 -- 172.21.15.2:0/2803416713 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaf000cbb0 con 0x7fcb00101190 2024-06-13T02:32:11.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.881+0000 7fcb05200700 1 -- 172.21.15.2:0/2803416713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb001a00c0 con 0x7fcb00101190 2024-06-13T02:32:11.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.881+0000 7fcaf7e00700 1 -- 172.21.15.2:0/2803416713 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0018680 con 0x7fcb00101190 2024-06-13T02:32:11.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.882+0000 7fcb05200700 1 -- 172.21.15.2:0/2803416713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb001a7940 con 0x7fcb00101190 2024-06-13T02:32:11.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.883+0000 7fcb05200700 1 -- 172.21.15.2:0/2803416713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb00069180 con 0x7fcb00101190 2024-06-13T02:32:11.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.885+0000 7fcaf7e00700 1 -- 172.21.15.2:0/2803416713 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fcaf0010430 con 0x7fcb00101190 2024-06-13T02:32:11.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.886+0000 7fcaf7e00700 1 --2- 172.21.15.2:0/2803416713 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcae40a2e10 0x7fcae40a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:11.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.886+0000 7fcaf7e00700 1 -- 172.21.15.2:0/2803416713 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9671+0+0 (secure 0 0 0) 0x7fcaf00cfad0 con 0x7fcb00101190 2024-06-13T02:32:11.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.887+0000 7fcafea00700 1 --2- 172.21.15.2:0/2803416713 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcae40a2e10 0x7fcae40a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:11.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.887+0000 7fcafea00700 1 --2- 172.21.15.2:0/2803416713 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcae40a2e10 0x7fcae40a52d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcb000ff280 tx=0x7fcaec00b260 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:32:11.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:11.891+0000 7fcaf7e00700 1 -- 172.21.15.2:0/2803416713 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcaf009c210 con 0x7fcb00101190 2024-06-13T02:32:12.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:12.177+0000 7fcb05200700 1 -- 172.21.15.2:0/2803416713 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fcb0019c120 con 0x7fcb00101190 2024-06-13T02:32:12.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:12.183+0000 7fcaf7e00700 1 -- 172.21.15.2:0/2803416713 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) ==== 161+0+0 (secure 0 0 0) 0x7fcaf009bb10 con 0x7fcb00101190 2024-06-13T02:32:12.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:12.189+0000 7fcb05200700 1 -- 172.21.15.2:0/2803416713 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcae40a2e10 msgr2=0x7fcae40a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:12.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:12.189+0000 7fcb05200700 1 --2- 172.21.15.2:0/2803416713 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcae40a2e10 0x7fcae40a52d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcb000ff280 tx=0x7fcaec00b260 comp rx=0 tx=0).stop 2024-06-13T02:32:12.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:12.189+0000 7fcb05200700 1 -- 172.21.15.2:0/2803416713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb00101190 msgr2=0x7fcb0019ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:12.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:12.189+0000 7fcb05200700 1 --2- 172.21.15.2:0/2803416713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb00101190 0x7fcb0019ae10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000e9a0 tx=0x7fcaf000ecb0 comp rx=0 tx=0).stop 2024-06-13T02:32:12.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:12.189+0000 7fcb05200700 1 -- 172.21.15.2:0/2803416713 shutdown_connections 2024-06-13T02:32:12.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:12.189+0000 7fcb05200700 1 --2- 172.21.15.2:0/2803416713 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcae40a2e10 0x7fcae40a52d0 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcb000ff280 tx=0x7fcaec00b260 comp rx=0 tx=0).stop 2024-06-13T02:32:12.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:12.189+0000 7fcb05200700 1 --2- 172.21.15.2:0/2803416713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcb0010ed40 0x7fcb0019f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:12.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:12.189+0000 7fcb05200700 1 --2- 172.21.15.2:0/2803416713 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcb00101190 0x7fcb0019ae10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:12.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:12.189+0000 7fcb05200700 1 --2- 172.21.15.2:0/2803416713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb00101b40 0x7fcb0019b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:12.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:12.189+0000 7fcb05200700 1 -- 172.21.15.2:0/2803416713 >> 172.21.15.2:0/2803416713 conn(0x7fcb000fcdb0 msgr2=0x7fcb0010fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:32:12.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:12.190+0000 7fcb05200700 1 -- 172.21.15.2:0/2803416713 shutdown_connections 2024-06-13T02:32:12.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:12.191+0000 7fcb05200700 1 -- 172.21.15.2:0/2803416713 wait complete. 2024-06-13T02:32:12.193 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-13T02:32:12.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:12 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2803416713' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-13T02:32:12.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:12 smithi175 ceph-mon[36977]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-13T02:32:12.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:12 smithi175 ceph-mon[36977]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-13T02:32:12.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:12 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2803416713' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-13T02:32:12.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:12 smithi175 ceph-mon[36977]: osdmap e123: 12 total, 12 up, 12 in 2024-06-13T02:32:12.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:12 smithi175 ceph-mon[36977]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-06-13T02:32:12.533 INFO:journalctl@ceph.mds.c.smithi175.stdout:Jun 13 02:32:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-c[67277]: ignoring --setuser ceph since I am not root 2024-06-13T02:32:12.533 INFO:journalctl@ceph.mds.c.smithi175.stdout:Jun 13 02:32:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-c[67277]: ignoring --setgroup ceph since I am not root 2024-06-13T02:32:12.533 INFO:journalctl@ceph.mds.c.smithi175.stdout:Jun 13 02:32:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-c[67277]: starting mds.c at 2024-06-13T02:32:12.533 INFO:journalctl@ceph.mds.c.smithi175.stdout:Jun 13 02:32:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-c[67277]: 2024-06-13T02:32:12.232+0000 7fde2c091700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6836/0: (98) Address already in use 2024-06-13T02:32:12.534 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:32:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-i[67580]: ignoring --setuser ceph since I am not root 2024-06-13T02:32:12.534 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:32:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-i[67580]: ignoring --setgroup ceph since I am not root 2024-06-13T02:32:12.534 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:32:12 smithi175 ceph-mds[67584]: -- 172.21.15.175:0/3756818516 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bf5ee75a40 con 0x55bf5ee48800 2024-06-13T02:32:12.534 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:32:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-i[67580]: starting mds.i at 2024-06-13T02:32:12.630 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:32:12 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-g[70955]: ignoring --setuser ceph since I am not root 2024-06-13T02:32:12.630 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:32:12 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-g[70955]: ignoring --setgroup ceph since I am not root 2024-06-13T02:32:12.630 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:32:12 smithi002 ceph-mds[70967]: -- 172.21.15.2:0/1929064143 <== mon.1 v2:172.21.15.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aa84047a40 con 0x55aa8401b000 2024-06-13T02:32:12.630 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:32:12 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-g[70955]: starting mds.g at 2024-06-13T02:32:12.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:12 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a[31956]: 2024-06-13T02:32:12.180+0000 7fcb7e800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-13T02:32:12.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:12 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2803416713' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-13T02:32:12.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:12 smithi002 ceph-mon[31960]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-13T02:32:12.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:12 smithi002 ceph-mon[31960]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-13T02:32:12.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:12 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2803416713' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-13T02:32:12.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:12 smithi002 ceph-mon[31960]: osdmap e123: 12 total, 12 up, 12 in 2024-06-13T02:32:12.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:12 smithi002 ceph-mon[31960]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-06-13T02:32:12.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2803416713' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-13T02:32:12.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-mon[36833]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-13T02:32:12.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-mon[36833]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-13T02:32:12.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2803416713' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-13T02:32:12.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-mon[36833]: osdmap e123: 12 total, 12 up, 12 in 2024-06-13T02:32:12.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-mon[36833]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-06-13T02:32:12.721 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-b[67065]: ignoring --setuser ceph since I am not root 2024-06-13T02:32:12.721 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-b[67065]: ignoring --setgroup ceph since I am not root 2024-06-13T02:32:12.721 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-mds[67069]: -- 172.21.15.84:0/2577395610 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5601ecf1fa40 con 0x5601ecef2800 2024-06-13T02:32:12.721 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-b[67065]: starting mds.b at 2024-06-13T02:32:12.721 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: ignoring --setuser ceph since I am not root 2024-06-13T02:32:12.722 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: ignoring --setgroup ceph since I am not root 2024-06-13T02:32:12.722 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-mds[66763]: -- 172.21.15.84:0/504988236 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5596d1dfba40 con 0x5596d1dcec00 2024-06-13T02:32:12.722 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: starting mds.h at 2024-06-13T02:32:12.722 INFO:journalctl@ceph.mds.e.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-e[66456]: ignoring --setuser ceph since I am not root 2024-06-13T02:32:12.722 INFO:journalctl@ceph.mds.e.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-e[66456]: ignoring --setgroup ceph since I am not root 2024-06-13T02:32:12.722 INFO:journalctl@ceph.mds.e.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-mds[66460]: -- 172.21.15.84:0/4259054001 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5573958144e0 con 0x5573957eb000 2024-06-13T02:32:12.722 INFO:journalctl@ceph.mds.e.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-mds[66460]: -- 172.21.15.84:0/4259054001 <== mon.2 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557395817a40 con 0x5573957eb000 2024-06-13T02:32:12.722 INFO:journalctl@ceph.mds.e.smithi084.stdout:Jun 13 02:32:12 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-e[66456]: starting mds.e at 2024-06-13T02:32:13.087 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-06-13T02:32:13.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:13 smithi175 ceph-mon[36977]: pgmap v455: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-06-13T02:32:13.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:13 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.175:6836/1520761842,v1:172.21.15.175:6838/1520761842] up:boot 2024-06-13T02:32:13.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:13 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.175:6837/1349649328,v1:172.21.15.175:6839/1349649328] up:boot 2024-06-13T02:32:13.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:13 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.84:6834/2076688800,v1:172.21.15.84:6835/2076688800] up:boot 2024-06-13T02:32:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:13 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.84:6836/1297910132,v1:172.21.15.84:6837/1297910132] up:boot 2024-06-13T02:32:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:13 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.84:6838/2142143076,v1:172.21.15.84:6839/2142143076] up:boot 2024-06-13T02:32:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:13 smithi175 ceph-mon[36977]: mds.? [v2:172.21.15.2:6838/2184341762,v1:172.21.15.2:6839/2184341762] up:boot 2024-06-13T02:32:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:13 smithi175 ceph-mon[36977]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-06-13T02:32:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:13 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T02:32:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:13 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T02:32:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:13 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:32:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:13 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T02:32:13.533 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:13 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T02:32:13.534 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:13 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-13T02:32:13.548 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:32:13.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:13 smithi002 ceph-mon[31960]: pgmap v455: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-06-13T02:32:13.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:13 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.175:6836/1520761842,v1:172.21.15.175:6838/1520761842] up:boot 2024-06-13T02:32:13.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:13 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.175:6837/1349649328,v1:172.21.15.175:6839/1349649328] up:boot 2024-06-13T02:32:13.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:13 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.84:6834/2076688800,v1:172.21.15.84:6835/2076688800] up:boot 2024-06-13T02:32:13.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:13 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.84:6836/1297910132,v1:172.21.15.84:6837/1297910132] up:boot 2024-06-13T02:32:13.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:13 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.84:6838/2142143076,v1:172.21.15.84:6839/2142143076] up:boot 2024-06-13T02:32:13.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:13 smithi002 ceph-mon[31960]: mds.? [v2:172.21.15.2:6838/2184341762,v1:172.21.15.2:6839/2184341762] up:boot 2024-06-13T02:32:13.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:13 smithi002 ceph-mon[31960]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-06-13T02:32:13.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:13 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T02:32:13.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:13 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T02:32:13.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:13 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:32:13.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:13 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T02:32:13.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:13 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T02:32:13.631 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:13 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-13T02:32:13.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:13 smithi084 ceph-mon[36833]: pgmap v455: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-06-13T02:32:13.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:13 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.175:6836/1520761842,v1:172.21.15.175:6838/1520761842] up:boot 2024-06-13T02:32:13.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:13 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.175:6837/1349649328,v1:172.21.15.175:6839/1349649328] up:boot 2024-06-13T02:32:13.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:13 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.84:6834/2076688800,v1:172.21.15.84:6835/2076688800] up:boot 2024-06-13T02:32:13.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:13 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.84:6836/1297910132,v1:172.21.15.84:6837/1297910132] up:boot 2024-06-13T02:32:13.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:13 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.84:6838/2142143076,v1:172.21.15.84:6839/2142143076] up:boot 2024-06-13T02:32:13.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:13 smithi084 ceph-mon[36833]: mds.? [v2:172.21.15.2:6838/2184341762,v1:172.21.15.2:6839/2184341762] up:boot 2024-06-13T02:32:13.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:13 smithi084 ceph-mon[36833]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-06-13T02:32:13.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:13 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-13T02:32:13.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:13 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-13T02:32:13.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:13 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-13T02:32:13.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:13 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-13T02:32:13.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:13 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-13T02:32:13.721 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:13 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-13T02:32:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:14 smithi175 ceph-mon[36977]: osdmap e124: 12 total, 12 up, 12 in 2024-06-13T02:32:15.032 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:14 smithi175 ceph-mon[36977]: pgmap v458: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.1 KiB/s wr, 5 op/s 2024-06-13T02:32:15.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:14 smithi002 ceph-mon[31960]: osdmap e124: 12 total, 12 up, 12 in 2024-06-13T02:32:15.131 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:14 smithi002 ceph-mon[31960]: pgmap v458: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.1 KiB/s wr, 5 op/s 2024-06-13T02:32:15.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:14 smithi084 ceph-mon[36833]: osdmap e124: 12 total, 12 up, 12 in 2024-06-13T02:32:15.220 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:14 smithi084 ceph-mon[36833]: pgmap v458: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.1 KiB/s wr, 5 op/s 2024-06-13T02:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.502+0000 7fa940600700 1 -- 172.21.15.2:0/810889756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9380746c0 msgr2=0x7fa938074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.502+0000 7fa940600700 1 --2- 172.21.15.2:0/810889756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9380746c0 0x7fa938074aa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009990 tx=0x7fa92c009ca0 comp rx=0 tx=0).stop 2024-06-13T02:32:16.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.502+0000 7fa940600700 1 -- 172.21.15.2:0/810889756 shutdown_connections 2024-06-13T02:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.502+0000 7fa940600700 1 --2- 172.21.15.2:0/810889756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa93810ee90 0x7fa938111280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.502+0000 7fa940600700 1 --2- 172.21.15.2:0/810889756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9380746c0 0x7fa938074aa0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.502+0000 7fa940600700 1 --2- 172.21.15.2:0/810889756 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa938074fe0 0x7fa93810e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.502+0000 7fa940600700 1 -- 172.21.15.2:0/810889756 >> 172.21.15.2:0/810889756 conn(0x7fa9380795f0 msgr2=0x7fa938079a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.502+0000 7fa940600700 1 -- 172.21.15.2:0/810889756 shutdown_connections 2024-06-13T02:32:16.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.502+0000 7fa940600700 1 -- 172.21.15.2:0/810889756 wait complete. 2024-06-13T02:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.504+0000 7fa940600700 1 Processor -- start 2024-06-13T02:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.504+0000 7fa940600700 1 -- start start 2024-06-13T02:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.504+0000 7fa940600700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9380746c0 0x7fa93819ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.504+0000 7fa940600700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa938074fe0 0x7fa93819b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.504+0000 7fa940600700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa93810ee90 0x7fa93819f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.504+0000 7fa940600700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa9381149a0 con 0x7fa93810ee90 2024-06-13T02:32:16.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.504+0000 7fa940600700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa938114820 con 0x7fa9380746c0 2024-06-13T02:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.504+0000 7fa940600700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa938114b20 con 0x7fa938074fe0 2024-06-13T02:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.504+0000 7fa93dc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9380746c0 0x7fa93819ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.505+0000 7fa93dc00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9380746c0 0x7fa93819ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.2:33326/0 (socket says 172.21.15.2:33326) 2024-06-13T02:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.505+0000 7fa93dc00700 1 -- 172.21.15.2:0/1698613732 learned_addr learned my addr 172.21.15.2:0/1698613732 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.505+0000 7fa93d200700 1 --2- 172.21.15.2:0/1698613732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa938074fe0 0x7fa93819b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.505+0000 7fa93e600700 1 --2- 172.21.15.2:0/1698613732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa93810ee90 0x7fa93819f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:16.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.505+0000 7fa93dc00700 1 -- 172.21.15.2:0/1698613732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa938074fe0 msgr2=0x7fa93819b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.505+0000 7fa93dc00700 1 --2- 172.21.15.2:0/1698613732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa938074fe0 0x7fa93819b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.505+0000 7fa93dc00700 1 -- 172.21.15.2:0/1698613732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa93810ee90 msgr2=0x7fa93819f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.505+0000 7fa93dc00700 1 --2- 172.21.15.2:0/1698613732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa93810ee90 0x7fa93819f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.505+0000 7fa93dc00700 1 -- 172.21.15.2:0/1698613732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa93819fda0 con 0x7fa9380746c0 2024-06-13T02:32:16.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.505+0000 7fa93dc00700 1 --2- 172.21.15.2:0/1698613732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9380746c0 0x7fa93819ad90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa92c000c00 tx=0x7fa92c00bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.506+0000 7fa936000700 1 -- 172.21.15.2:0/1698613732 <== mon.2 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c027070 con 0x7fa9380746c0 2024-06-13T02:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.506+0000 7fa940600700 1 -- 172.21.15.2:0/1698613732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9381a0030 con 0x7fa9380746c0 2024-06-13T02:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.506+0000 7fa936000700 1 -- 172.21.15.2:0/1698613732 <== mon.2 v2:172.21.15.84:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa92c003d70 con 0x7fa9380746c0 2024-06-13T02:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.506+0000 7fa936000700 1 -- 172.21.15.2:0/1698613732 <== mon.2 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c00f460 con 0x7fa9380746c0 2024-06-13T02:32:16.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.506+0000 7fa940600700 1 -- 172.21.15.2:0/1698613732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9381a7910 con 0x7fa9380746c0 2024-06-13T02:32:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.507+0000 7fa940600700 1 -- 172.21.15.2:0/1698613732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa938069180 con 0x7fa9380746c0 2024-06-13T02:32:16.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.509+0000 7fa936000700 1 -- 172.21.15.2:0/1698613732 <== mon.2 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fa92c02a070 con 0x7fa9380746c0 2024-06-13T02:32:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.511+0000 7fa936000700 1 --2- 172.21.15.2:0/1698613732 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa9200a2e10 0x7fa9200a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.511+0000 7fa936000700 1 -- 172.21.15.2:0/1698613732 <== mon.2 v2:172.21.15.84:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 9841+0+0 (secure 0 0 0) 0x7fa92c0d0a40 con 0x7fa9380746c0 2024-06-13T02:32:16.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.511+0000 7fa93d200700 1 --2- 172.21.15.2:0/1698613732 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa9200a2e10 0x7fa9200a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:16.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.512+0000 7fa93d200700 1 --2- 172.21.15.2:0/1698613732 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa9200a2e10 0x7fa9200a52d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa938110a50 tx=0x7fa924009260 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:32:16.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.513+0000 7fa936000700 1 -- 172.21.15.2:0/1698613732 <== mon.2 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fa92c013070 con 0x7fa9380746c0 2024-06-13T02:32:16.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:16.796+0000 7fa940600700 1 -- 172.21.15.2:0/1698613732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa9381a7ae0 con 0x7fa9380746c0 2024-06-13T02:32:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:17.111+0000 7fa936000700 1 -- 172.21.15.2:0/1698613732 <== mon.2 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) ==== 104+0+0 (secure 0 0 0) 0x7fa92c09d160 con 0x7fa9380746c0 2024-06-13T02:32:17.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:17.115+0000 7fa940600700 1 -- 172.21.15.2:0/1698613732 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa9200a2e10 msgr2=0x7fa9200a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:17.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:17.115+0000 7fa940600700 1 --2- 172.21.15.2:0/1698613732 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa9200a2e10 0x7fa9200a52d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa938110a50 tx=0x7fa924009260 comp rx=0 tx=0).stop 2024-06-13T02:32:17.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:17.115+0000 7fa940600700 1 -- 172.21.15.2:0/1698613732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9380746c0 msgr2=0x7fa93819ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:17.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:17.115+0000 7fa940600700 1 --2- 172.21.15.2:0/1698613732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9380746c0 0x7fa93819ad90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa92c000c00 tx=0x7fa92c00bab0 comp rx=0 tx=0).stop 2024-06-13T02:32:17.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:17.115+0000 7fa940600700 1 -- 172.21.15.2:0/1698613732 shutdown_connections 2024-06-13T02:32:17.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:17.115+0000 7fa940600700 1 --2- 172.21.15.2:0/1698613732 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa93810ee90 0x7fa93819f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:17.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:17.115+0000 7fa940600700 1 --2- 172.21.15.2:0/1698613732 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fa9200a2e10 0x7fa9200a52d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:17.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:17.115+0000 7fa940600700 1 --2- 172.21.15.2:0/1698613732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa9380746c0 0x7fa93819ad90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:17.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:17.115+0000 7fa940600700 1 --2- 172.21.15.2:0/1698613732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa938074fe0 0x7fa93819b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:17.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:17.115+0000 7fa940600700 1 -- 172.21.15.2:0/1698613732 >> 172.21.15.2:0/1698613732 conn(0x7fa9380795f0 msgr2=0x7fa9380ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:32:17.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:17.116+0000 7fa940600700 1 -- 172.21.15.2:0/1698613732 shutdown_connections 2024-06-13T02:32:17.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:17.116+0000 7fa940600700 1 -- 172.21.15.2:0/1698613732 wait complete. 2024-06-13T02:32:17.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:17 smithi002 ceph-mon[31960]: pgmap v459: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-06-13T02:32:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:17 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/1698613732' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T02:32:17.381 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:17 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T02:32:17.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:17 smithi084 ceph-mon[36833]: pgmap v459: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-06-13T02:32:17.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:17 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/1698613732' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T02:32:17.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:17 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T02:32:17.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:17 smithi175 ceph-mon[36977]: pgmap v459: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-06-13T02:32:17.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:17 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/1698613732' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T02:32:17.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:17 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-13T02:32:18.099 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-13T02:32:18.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:18 smithi002 ceph-mon[31960]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-13T02:32:18.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:18 smithi002 ceph-mon[31960]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-13T02:32:18.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:18 smithi002 ceph-mon[31960]: Cluster is now healthy 2024-06-13T02:32:18.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:18 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-13T02:32:18.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:18 smithi002 ceph-mon[31960]: fsmap 12 up:standby 2024-06-13T02:32:18.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:18 smithi084 ceph-mon[36833]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-13T02:32:18.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:18 smithi084 ceph-mon[36833]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-13T02:32:18.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:18 smithi084 ceph-mon[36833]: Cluster is now healthy 2024-06-13T02:32:18.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:18 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-13T02:32:18.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:18 smithi084 ceph-mon[36833]: fsmap 12 up:standby 2024-06-13T02:32:18.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:18 smithi175 ceph-mon[36977]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-13T02:32:18.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:18 smithi175 ceph-mon[36977]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-13T02:32:18.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:18 smithi175 ceph-mon[36977]: Cluster is now healthy 2024-06-13T02:32:18.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:18 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-13T02:32:18.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:18 smithi175 ceph-mon[36977]: fsmap 12 up:standby 2024-06-13T02:32:18.565 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:32:19.380 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:19 smithi002 ceph-mon[31960]: pgmap v460: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-06-13T02:32:19.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:19 smithi084 ceph-mon[36833]: pgmap v460: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-06-13T02:32:19.531 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:19 smithi175 ceph-mon[36977]: pgmap v460: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-06-13T02:32:20.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.914+0000 7f7b2ca00700 1 -- 172.21.15.2:0/2843144784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b281046d0 msgr2=0x7f7b28104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:20.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.914+0000 7f7b2ca00700 1 --2- 172.21.15.2:0/2843144784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b281046d0 0x7f7b28104b50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009990 tx=0x7f7b14009ca0 comp rx=0 tx=0).stop 2024-06-13T02:32:20.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.915+0000 7f7b2ca00700 1 -- 172.21.15.2:0/2843144784 shutdown_connections 2024-06-13T02:32:20.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.915+0000 7f7b2ca00700 1 --2- 172.21.15.2:0/2843144784 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b28105090 0x7f7b281115a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:20.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.915+0000 7f7b2ca00700 1 --2- 172.21.15.2:0/2843144784 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b2810a6d0 0x7f7b2810aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:20.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.915+0000 7f7b2ca00700 1 --2- 172.21.15.2:0/2843144784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b281046d0 0x7f7b28104b50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:20.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.915+0000 7f7b2ca00700 1 -- 172.21.15.2:0/2843144784 >> 172.21.15.2:0/2843144784 conn(0x7f7b281001c0 msgr2=0x7f7b281025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:32:20.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.915+0000 7f7b2ca00700 1 -- 172.21.15.2:0/2843144784 shutdown_connections 2024-06-13T02:32:20.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.915+0000 7f7b2ca00700 1 -- 172.21.15.2:0/2843144784 wait complete. 2024-06-13T02:32:20.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.916+0000 7f7b2ca00700 1 Processor -- start 2024-06-13T02:32:20.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.916+0000 7f7b2ca00700 1 -- start start 2024-06-13T02:32:20.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b2ca00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b281046d0 0x7f7b2819ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:20.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b2ca00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b28105090 0x7f7b2819b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:20.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b2ca00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b2810a6d0 0x7f7b2819f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:20.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b2ca00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28114a70 con 0x7f7b28105090 2024-06-13T02:32:20.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b2ca00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281148f0 con 0x7f7b2810a6d0 2024-06-13T02:32:20.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b2ca00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28114bf0 con 0x7f7b281046d0 2024-06-13T02:32:20.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b25e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b281046d0 0x7f7b2819ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:20.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b25e00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b281046d0 0x7f7b2819ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.2:49558/0 (socket says 172.21.15.2:49558) 2024-06-13T02:32:20.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b25e00700 1 -- 172.21.15.2:0/2780201451 learned_addr learned my addr 172.21.15.2:0/2780201451 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:32:20.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b25400700 1 --2- 172.21.15.2:0/2780201451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b28105090 0x7f7b2819b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:20.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b26800700 1 --2- 172.21.15.2:0/2780201451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b2810a6d0 0x7f7b2819f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:20.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b25e00700 1 -- 172.21.15.2:0/2780201451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b2810a6d0 msgr2=0x7f7b2819f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:20.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b25e00700 1 --2- 172.21.15.2:0/2780201451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b2810a6d0 0x7f7b2819f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:20.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b25e00700 1 -- 172.21.15.2:0/2780201451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b28105090 msgr2=0x7f7b2819b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:20.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b25e00700 1 --2- 172.21.15.2:0/2780201451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b28105090 0x7f7b2819b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:20.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.917+0000 7f7b25e00700 1 -- 172.21.15.2:0/2780201451 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2819fe70 con 0x7f7b281046d0 2024-06-13T02:32:20.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.918+0000 7f7b26800700 1 --2- 172.21.15.2:0/2780201451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b2810a6d0 0x7f7b2819f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-13T02:32:20.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.918+0000 7f7b25e00700 1 --2- 172.21.15.2:0/2780201451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b281046d0 0x7f7b2819ae60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800eb30 tx=0x7f7b1800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:32:20.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.918+0000 7f7b1ea00700 1 -- 172.21.15.2:0/2780201451 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1800cc90 con 0x7f7b281046d0 2024-06-13T02:32:20.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.918+0000 7f7b1ea00700 1 -- 172.21.15.2:0/2780201451 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b18004500 con 0x7f7b281046d0 2024-06-13T02:32:20.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.918+0000 7f7b2ca00700 1 -- 172.21.15.2:0/2780201451 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b281a0160 con 0x7f7b281046d0 2024-06-13T02:32:20.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.918+0000 7f7b1ea00700 1 -- 172.21.15.2:0/2780201451 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18010430 con 0x7f7b281046d0 2024-06-13T02:32:20.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.918+0000 7f7b2ca00700 1 -- 172.21.15.2:0/2780201451 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b281a79e0 con 0x7f7b281046d0 2024-06-13T02:32:20.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.919+0000 7f7b2ca00700 1 -- 172.21.15.2:0/2780201451 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b28069180 con 0x7f7b281046d0 2024-06-13T02:32:20.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.922+0000 7f7b1ea00700 1 -- 172.21.15.2:0/2780201451 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7f7b18043b60 con 0x7f7b281046d0 2024-06-13T02:32:20.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.923+0000 7f7b1ea00700 1 --2- 172.21.15.2:0/2780201451 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f7b0c0a2d90 0x7f7b0c0a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:20.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.923+0000 7f7b1ea00700 1 -- 172.21.15.2:0/2780201451 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 9841+0+0 (secure 0 0 0) 0x7f7b180cfd00 con 0x7f7b281046d0 2024-06-13T02:32:20.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.923+0000 7f7b25400700 1 --2- 172.21.15.2:0/2780201451 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f7b0c0a2d90 0x7f7b0c0a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:20.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.924+0000 7f7b25400700 1 --2- 172.21.15.2:0/2780201451 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f7b0c0a2d90 0x7f7b0c0a5250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7b28109c00 tx=0x7f7b1400b260 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:32:20.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:20.925+0000 7f7b1ea00700 1 -- 172.21.15.2:0/2780201451 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7f7b1809c390 con 0x7f7b281046d0 2024-06-13T02:32:21.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:21.156+0000 7f7b2ca00700 1 -- 172.21.15.2:0/2780201451 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7b2819c1c0 con 0x7f7b281046d0 2024-06-13T02:32:21.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:21 smithi084 ceph-mon[36833]: pgmap v461: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 0 op/s 2024-06-13T02:32:21.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:21 smithi175 ceph-mon[36977]: pgmap v461: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 0 op/s 2024-06-13T02:32:21.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:21 smithi002 ceph-mon[31960]: pgmap v461: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 0 op/s 2024-06-13T02:32:22.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:22.148+0000 7f7b1ea00700 1 -- 172.21.15.2:0/2780201451 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v125) ==== 181+0+0 (secure 0 0 0) 0x7f7b1809bc90 con 0x7f7b281046d0 2024-06-13T02:32:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:22.153+0000 7f7b2ca00700 1 -- 172.21.15.2:0/2780201451 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f7b0c0a2d90 msgr2=0x7f7b0c0a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:22.153+0000 7f7b2ca00700 1 --2- 172.21.15.2:0/2780201451 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f7b0c0a2d90 0x7f7b0c0a5250 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7b28109c00 tx=0x7f7b1400b260 comp rx=0 tx=0).stop 2024-06-13T02:32:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:22.153+0000 7f7b2ca00700 1 -- 172.21.15.2:0/2780201451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b281046d0 msgr2=0x7f7b2819ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:22.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:22.153+0000 7f7b2ca00700 1 --2- 172.21.15.2:0/2780201451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b281046d0 0x7f7b2819ae60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800eb30 tx=0x7f7b1800ee40 comp rx=0 tx=0).stop 2024-06-13T02:32:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:22.154+0000 7f7b2ca00700 1 -- 172.21.15.2:0/2780201451 shutdown_connections 2024-06-13T02:32:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:22.154+0000 7f7b2ca00700 1 --2- 172.21.15.2:0/2780201451 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7f7b0c0a2d90 0x7f7b0c0a5250 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:22.154+0000 7f7b2ca00700 1 --2- 172.21.15.2:0/2780201451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b2810a6d0 0x7f7b2819f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:22.154+0000 7f7b2ca00700 1 --2- 172.21.15.2:0/2780201451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b281046d0 0x7f7b2819ae60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:22.154+0000 7f7b2ca00700 1 --2- 172.21.15.2:0/2780201451 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b28105090 0x7f7b2819b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:22.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:22.154+0000 7f7b2ca00700 1 -- 172.21.15.2:0/2780201451 >> 172.21.15.2:0/2780201451 conn(0x7f7b281001c0 msgr2=0x7f7b281006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:32:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:22.155+0000 7f7b2ca00700 1 -- 172.21.15.2:0/2780201451 shutdown_connections 2024-06-13T02:32:22.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:22.155+0000 7f7b2ca00700 1 -- 172.21.15.2:0/2780201451 wait complete. 2024-06-13T02:32:22.159 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-06-13T02:32:22.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:22 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2780201451' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T02:32:22.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:22 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T02:32:22.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:22 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2780201451' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T02:32:22.516 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:22 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T02:32:22.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:22 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2780201451' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T02:32:22.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:22 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T02:32:22.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-13T02:32:23.445 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:32:23.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:23 smithi084 ceph-mon[36833]: pgmap v462: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 311 B/s rd, 0 op/s 2024-06-13T02:32:23.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:23 smithi084 ceph-mon[36833]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T02:32:23.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:23 smithi084 ceph-mon[36833]: osdmap e125: 12 total, 12 up, 12 in 2024-06-13T02:32:23.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:23 smithi175 ceph-mon[36977]: pgmap v462: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 311 B/s rd, 0 op/s 2024-06-13T02:32:23.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:23 smithi175 ceph-mon[36977]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T02:32:23.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:23 smithi175 ceph-mon[36977]: osdmap e125: 12 total, 12 up, 12 in 2024-06-13T02:32:23.595 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:23 smithi002 ceph-mon[31960]: pgmap v462: 129 pgs: 129 active+clean; 274 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 311 B/s rd, 0 op/s 2024-06-13T02:32:23.595 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:23 smithi002 ceph-mon[31960]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T02:32:23.595 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:23 smithi002 ceph-mon[31960]: osdmap e125: 12 total, 12 up, 12 in 2024-06-13T02:32:25.411 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:25 smithi002 ceph-mon[31960]: pgmap v464: 97 pgs: 97 active+clean; 224 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:32:25.469 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:25 smithi084 ceph-mon[36833]: pgmap v464: 97 pgs: 97 active+clean; 224 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:32:25.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:25 smithi175 ceph-mon[36977]: pgmap v464: 97 pgs: 97 active+clean; 224 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:32:25.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.698+0000 7fda6fe00700 1 -- 172.21.15.2:0/2556955777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda6810eac0 msgr2=0x7fda6810eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:25.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.698+0000 7fda6fe00700 1 --2- 172.21.15.2:0/2556955777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda6810eac0 0x7fda6810eea0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00b0a0 tx=0x7fda5c00b3b0 comp rx=0 tx=0).stop 2024-06-13T02:32:25.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.698+0000 7fda6fe00700 1 -- 172.21.15.2:0/2556955777 shutdown_connections 2024-06-13T02:32:25.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.698+0000 7fda6fe00700 1 --2- 172.21.15.2:0/2556955777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda68109480 0x7fda68115990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:25.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.698+0000 7fda6fe00700 1 --2- 172.21.15.2:0/2556955777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda6810eac0 0x7fda6810eea0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:25.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.698+0000 7fda6fe00700 1 --2- 172.21.15.2:0/2556955777 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda68108ac0 0x7fda68108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:25.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.698+0000 7fda6fe00700 1 -- 172.21.15.2:0/2556955777 >> 172.21.15.2:0/2556955777 conn(0x7fda68075c60 msgr2=0x7fda681072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:32:25.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.699+0000 7fda6fe00700 1 -- 172.21.15.2:0/2556955777 shutdown_connections 2024-06-13T02:32:25.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.699+0000 7fda6fe00700 1 -- 172.21.15.2:0/2556955777 wait complete. 2024-06-13T02:32:25.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.700+0000 7fda6fe00700 1 Processor -- start 2024-06-13T02:32:25.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.700+0000 7fda6fe00700 1 -- start start 2024-06-13T02:32:25.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.701+0000 7fda6fe00700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda68108ac0 0x7fda6819f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:25.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.701+0000 7fda6fe00700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda68109480 0x7fda6819f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.701+0000 7fda6fe00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda6810eac0 0x7fda681a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.701+0000 7fda6fe00700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fda68118e60 con 0x7fda68108ac0 2024-06-13T02:32:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.701+0000 7fda6fe00700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fda68118ce0 con 0x7fda68109480 2024-06-13T02:32:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.701+0000 7fda6fe00700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda68118fe0 con 0x7fda6810eac0 2024-06-13T02:32:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.701+0000 7fda6d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda68108ac0 0x7fda6819f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.702+0000 7fda6de00700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda6810eac0 0x7fda681a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:25.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.702+0000 7fda6d400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda68108ac0 0x7fda6819f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35012/0 (socket says 172.21.15.2:35012) 2024-06-13T02:32:25.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.702+0000 7fda6d400700 1 -- 172.21.15.2:0/970062526 learned_addr learned my addr 172.21.15.2:0/970062526 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:32:25.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.702+0000 7fda6ca00700 1 --2- 172.21.15.2:0/970062526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda68109480 0x7fda6819f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:25.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.702+0000 7fda6d400700 1 -- 172.21.15.2:0/970062526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda6810eac0 msgr2=0x7fda681a3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:25.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.702+0000 7fda6d400700 1 --2- 172.21.15.2:0/970062526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda6810eac0 0x7fda681a3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:25.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.702+0000 7fda6d400700 1 -- 172.21.15.2:0/970062526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda68109480 msgr2=0x7fda6819f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:25.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.702+0000 7fda6d400700 1 --2- 172.21.15.2:0/970062526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda68109480 0x7fda6819f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:25.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.702+0000 7fda6d400700 1 -- 172.21.15.2:0/970062526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda681a4250 con 0x7fda68108ac0 2024-06-13T02:32:25.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.702+0000 7fda6de00700 1 --2- 172.21.15.2:0/970062526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda6810eac0 0x7fda681a3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:32:25.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.703+0000 7fda6d400700 1 --2- 172.21.15.2:0/970062526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda68108ac0 0x7fda6819f290 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00b070 tx=0x7fda5c004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:32:25.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.703+0000 7fda66000700 1 -- 172.21.15.2:0/970062526 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c021070 con 0x7fda68108ac0 2024-06-13T02:32:25.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.703+0000 7fda66000700 1 -- 172.21.15.2:0/970062526 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda5c003c00 con 0x7fda68108ac0 2024-06-13T02:32:25.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.703+0000 7fda6fe00700 1 -- 172.21.15.2:0/970062526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda681a44e0 con 0x7fda68108ac0 2024-06-13T02:32:25.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.703+0000 7fda6fe00700 1 -- 172.21.15.2:0/970062526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda681abdc0 con 0x7fda68108ac0 2024-06-13T02:32:25.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.703+0000 7fda66000700 1 -- 172.21.15.2:0/970062526 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c0047f0 con 0x7fda68108ac0 2024-06-13T02:32:25.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.705+0000 7fda6fe00700 1 -- 172.21.15.2:0/970062526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda48005330 con 0x7fda68108ac0 2024-06-13T02:32:25.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.707+0000 7fda66000700 1 -- 172.21.15.2:0/970062526 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fda5c007980 con 0x7fda68108ac0 2024-06-13T02:32:25.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.708+0000 7fda66000700 1 --2- 172.21.15.2:0/970062526 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fda500a2e10 0x7fda500a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:25.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.708+0000 7fda66000700 1 -- 172.21.15.2:0/970062526 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 9228+0+0 (secure 0 0 0) 0x7fda5c00f020 con 0x7fda68108ac0 2024-06-13T02:32:25.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.708+0000 7fda6ca00700 1 --2- 172.21.15.2:0/970062526 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fda500a2e10 0x7fda500a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:25.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.709+0000 7fda6ca00700 1 --2- 172.21.15.2:0/970062526 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fda500a2e10 0x7fda500a52d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda68077b30 tx=0x7fda54009260 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:32:25.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.713+0000 7fda66000700 1 -- 172.21.15.2:0/970062526 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fda5c02a020 con 0x7fda68108ac0 2024-06-13T02:32:25.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:25.948+0000 7fda6fe00700 1 -- 172.21.15.2:0/970062526 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fda48005620 con 0x7fda68108ac0 2024-06-13T02:32:26.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:26.166+0000 7fda66000700 1 -- 172.21.15.2:0/970062526 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v126) ==== 169+0+0 (secure 0 0 0) 0x7fda5c09d3c0 con 0x7fda68108ac0 2024-06-13T02:32:26.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:26.172+0000 7fda6fe00700 1 -- 172.21.15.2:0/970062526 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fda500a2e10 msgr2=0x7fda500a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:26.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:26.172+0000 7fda6fe00700 1 --2- 172.21.15.2:0/970062526 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fda500a2e10 0x7fda500a52d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda68077b30 tx=0x7fda54009260 comp rx=0 tx=0).stop 2024-06-13T02:32:26.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:26.172+0000 7fda6fe00700 1 -- 172.21.15.2:0/970062526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda68108ac0 msgr2=0x7fda6819f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:26.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:26.172+0000 7fda6fe00700 1 --2- 172.21.15.2:0/970062526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda68108ac0 0x7fda6819f290 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00b070 tx=0x7fda5c004c80 comp rx=0 tx=0).stop 2024-06-13T02:32:26.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:26.175+0000 7fda6fe00700 1 -- 172.21.15.2:0/970062526 shutdown_connections 2024-06-13T02:32:26.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:26.175+0000 7fda6fe00700 1 --2- 172.21.15.2:0/970062526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda6810eac0 0x7fda681a3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:26.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:26.175+0000 7fda6fe00700 1 --2- 172.21.15.2:0/970062526 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fda68108ac0 0x7fda6819f290 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:26.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:26.175+0000 7fda6fe00700 1 --2- 172.21.15.2:0/970062526 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fda500a2e10 0x7fda500a52d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:26.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:26.175+0000 7fda6fe00700 1 --2- 172.21.15.2:0/970062526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda68109480 0x7fda6819f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:26.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:26.175+0000 7fda6fe00700 1 -- 172.21.15.2:0/970062526 >> 172.21.15.2:0/970062526 conn(0x7fda68075c60 msgr2=0x7fda680761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:32:26.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:26.175+0000 7fda6fe00700 1 -- 172.21.15.2:0/970062526 shutdown_connections 2024-06-13T02:32:26.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:26.175+0000 7fda6fe00700 1 -- 172.21.15.2:0/970062526 wait complete. 2024-06-13T02:32:26.178 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-06-13T02:32:26.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:26 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/970062526' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T02:32:26.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:26 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/970062526' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T02:32:26.540 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:26 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/970062526' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T02:32:26.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba shell --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-06-13T02:32:27.400 INFO:teuthology.orchestra.run.smithi002.stderr:Inferring config /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/mon.a/config 2024-06-13T02:32:27.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:27 smithi084 ceph-mon[36833]: pgmap v465: 97 pgs: 97 active+clean; 224 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:32:27.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:27 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/970062526' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T02:32:27.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:27 smithi084 ceph-mon[36833]: osdmap e126: 12 total, 12 up, 12 in 2024-06-13T02:32:27.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:27 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:32:27.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:27 smithi175 ceph-mon[36977]: pgmap v465: 97 pgs: 97 active+clean; 224 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:32:27.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:27 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/970062526' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T02:32:27.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:27 smithi175 ceph-mon[36977]: osdmap e126: 12 total, 12 up, 12 in 2024-06-13T02:32:27.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:27 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:32:27.546 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:27 smithi002 ceph-mon[31960]: pgmap v465: 97 pgs: 97 active+clean; 224 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:32:27.546 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:27 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/970062526' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T02:32:27.546 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:27 smithi002 ceph-mon[31960]: osdmap e126: 12 total, 12 up, 12 in 2024-06-13T02:32:27.546 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:27 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-13T02:32:28.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:28 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:32:28.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:28 smithi084 ceph-mon[36833]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:32:28.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:28 smithi084 ceph-mon[36833]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:32:28.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:28 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:32:28.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:28 smithi175 ceph-mon[36977]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:32:28.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:28 smithi175 ceph-mon[36977]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:32:28.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:28 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-13T02:32:28.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:28 smithi002 ceph-mon[31960]: from='mgr.25123 172.21.15.2:0/2142131356' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-13T02:32:28.561 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:28 smithi002 ceph-mon[31960]: from='mgr.25123 ' entity='mgr.x' 2024-06-13T02:32:29.435 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:29 smithi002 ceph-mon[31960]: pgmap v467: 33 pgs: 33 active+clean; 224 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:32:29.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:29 smithi084 ceph-mon[36833]: pgmap v467: 33 pgs: 33 active+clean; 224 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:32:29.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:29 smithi175 ceph-mon[36977]: pgmap v467: 33 pgs: 33 active+clean; 224 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:32:29.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.774+0000 7fcd92800700 1 -- 172.21.15.2:0/49130407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd8c06aa00 msgr2=0x7fcd8c06ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:29.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.774+0000 7fcd92800700 1 --2- 172.21.15.2:0/49130407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd8c06aa00 0x7fcd8c06ae80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcd74009990 tx=0x7fcd74009ca0 comp rx=0 tx=0).stop 2024-06-13T02:32:29.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.774+0000 7fcd92800700 1 -- 172.21.15.2:0/49130407 shutdown_connections 2024-06-13T02:32:29.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.774+0000 7fcd92800700 1 --2- 172.21.15.2:0/49130407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd8c06b3c0 0x7fcd8c10f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:29.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.774+0000 7fcd92800700 1 --2- 172.21.15.2:0/49130407 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd8c1084f0 0x7fcd8c1088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:29.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.774+0000 7fcd92800700 1 --2- 172.21.15.2:0/49130407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd8c06aa00 0x7fcd8c06ae80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:29.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.774+0000 7fcd92800700 1 -- 172.21.15.2:0/49130407 >> 172.21.15.2:0/49130407 conn(0x7fcd8c078300 msgr2=0x7fcd8c078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:32:29.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.774+0000 7fcd92800700 1 -- 172.21.15.2:0/49130407 shutdown_connections 2024-06-13T02:32:29.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.774+0000 7fcd92800700 1 -- 172.21.15.2:0/49130407 wait complete. 2024-06-13T02:32:29.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.775+0000 7fcd92800700 1 Processor -- start 2024-06-13T02:32:29.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.776+0000 7fcd92800700 1 -- start start 2024-06-13T02:32:29.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.776+0000 7fcd92800700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd8c06aa00 0x7fcd8c19ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:29.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.776+0000 7fcd92800700 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd8c06b3c0 0x7fcd8c19b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:29.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.776+0000 7fcd92800700 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd8c1084f0 0x7fcd8c19f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:29.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.776+0000 7fcd92800700 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c1127c0 con 0x7fcd8c06aa00 2024-06-13T02:32:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.776+0000 7fcd92800700 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c112640 con 0x7fcd8c06b3c0 2024-06-13T02:32:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.776+0000 7fcd92800700 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c112940 con 0x7fcd8c1084f0 2024-06-13T02:32:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.776+0000 7fcd8b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd8c06aa00 0x7fcd8c19ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.776+0000 7fcd8b400700 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd8c06aa00 0x7fcd8c19ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35034/0 (socket says 172.21.15.2:35034) 2024-06-13T02:32:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.776+0000 7fcd8b400700 1 -- 172.21.15.2:0/2695527487 learned_addr learned my addr 172.21.15.2:0/2695527487 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-06-13T02:32:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.776+0000 7fcd82a00700 1 --2- 172.21.15.2:0/2695527487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd8c06b3c0 0x7fcd8c19b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:29.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.776+0000 7fcd8be00700 1 --2- 172.21.15.2:0/2695527487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd8c1084f0 0x7fcd8c19f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.777+0000 7fcd8b400700 1 -- 172.21.15.2:0/2695527487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd8c1084f0 msgr2=0x7fcd8c19f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.777+0000 7fcd8b400700 1 --2- 172.21.15.2:0/2695527487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd8c1084f0 0x7fcd8c19f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.777+0000 7fcd8b400700 1 -- 172.21.15.2:0/2695527487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd8c06b3c0 msgr2=0x7fcd8c19b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.777+0000 7fcd8b400700 1 --2- 172.21.15.2:0/2695527487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd8c06b3c0 0x7fcd8c19b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.777+0000 7fcd8b400700 1 -- 172.21.15.2:0/2695527487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c19fe50 con 0x7fcd8c06aa00 2024-06-13T02:32:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.777+0000 7fcd82a00700 1 --2- 172.21.15.2:0/2695527487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd8c06b3c0 0x7fcd8c19b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-13T02:32:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.777+0000 7fcd8b400700 1 --2- 172.21.15.2:0/2695527487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd8c06aa00 0x7fcd8c19ae40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00e9a0 tx=0x7fcd7c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:32:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.777+0000 7fcd88c00700 1 -- 172.21.15.2:0/2695527487 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c00ca10 con 0x7fcd8c06aa00 2024-06-13T02:32:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.778+0000 7fcd92800700 1 -- 172.21.15.2:0/2695527487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8c1a0140 con 0x7fcd8c06aa00 2024-06-13T02:32:29.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.778+0000 7fcd88c00700 1 -- 172.21.15.2:0/2695527487 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd7c00cbb0 con 0x7fcd8c06aa00 2024-06-13T02:32:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.778+0000 7fcd88c00700 1 -- 172.21.15.2:0/2695527487 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c018680 con 0x7fcd8c06aa00 2024-06-13T02:32:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.778+0000 7fcd92800700 1 -- 172.21.15.2:0/2695527487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd8c1a79c0 con 0x7fcd8c06aa00 2024-06-13T02:32:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.779+0000 7fcd92800700 1 -- 172.21.15.2:0/2695527487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd8c069180 con 0x7fcd8c06aa00 2024-06-13T02:32:29.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.781+0000 7fcd88c00700 1 -- 172.21.15.2:0/2695527487 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 26) ==== 137963+0+0 (secure 0 0 0) 0x7fcd7c010430 con 0x7fcd8c06aa00 2024-06-13T02:32:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.782+0000 7fcd88c00700 1 --2- 172.21.15.2:0/2695527487 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcd700a2d90 0x7fcd700a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-13T02:32:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.782+0000 7fcd88c00700 1 -- 172.21.15.2:0/2695527487 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 8582+0+0 (secure 0 0 0) 0x7fcd7c0cf690 con 0x7fcd8c06aa00 2024-06-13T02:32:29.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.783+0000 7fcd82a00700 1 --2- 172.21.15.2:0/2695527487 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcd700a2d90 0x7fcd700a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-13T02:32:29.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.784+0000 7fcd82a00700 1 --2- 172.21.15.2:0/2695527487 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcd700a2d90 0x7fcd700a5250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c103390 tx=0x7fcd7400b260 comp rx=0 tx=0).ready entity=mgr.25123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-13T02:32:29.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:29.787+0000 7fcd88c00700 1 -- 172.21.15.2:0/2695527487 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186418 (secure 0 0 0) 0x7fcd7c09c210 con 0x7fcd8c06aa00 2024-06-13T02:32:30.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:30.022+0000 7fcd92800700 1 -- 172.21.15.2:0/2695527487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcd8c19c1a0 con 0x7fcd8c06aa00 2024-06-13T02:32:30.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:30.186+0000 7fcd88c00700 1 -- 172.21.15.2:0/2695527487 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v127) ==== 178+0+0 (secure 0 0 0) 0x7fcd7c09bb10 con 0x7fcd8c06aa00 2024-06-13T02:32:30.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:30.193+0000 7fcd92800700 1 -- 172.21.15.2:0/2695527487 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcd700a2d90 msgr2=0x7fcd700a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:30.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:30.193+0000 7fcd92800700 1 --2- 172.21.15.2:0/2695527487 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcd700a2d90 0x7fcd700a5250 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c103390 tx=0x7fcd7400b260 comp rx=0 tx=0).stop 2024-06-13T02:32:30.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:30.193+0000 7fcd92800700 1 -- 172.21.15.2:0/2695527487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd8c06aa00 msgr2=0x7fcd8c19ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-13T02:32:30.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:30.193+0000 7fcd92800700 1 --2- 172.21.15.2:0/2695527487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd8c06aa00 0x7fcd8c19ae40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00e9a0 tx=0x7fcd7c00ecb0 comp rx=0 tx=0).stop 2024-06-13T02:32:30.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:30.194+0000 7fcd92800700 1 -- 172.21.15.2:0/2695527487 shutdown_connections 2024-06-13T02:32:30.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:30.194+0000 7fcd92800700 1 --2- 172.21.15.2:0/2695527487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd8c1084f0 0x7fcd8c19f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:30.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:30.194+0000 7fcd92800700 1 --2- 172.21.15.2:0/2695527487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcd8c06aa00 0x7fcd8c19ae40 secure :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00e9a0 tx=0x7fcd7c00ecb0 comp rx=0 tx=0).stop 2024-06-13T02:32:30.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:30.194+0000 7fcd92800700 1 --2- 172.21.15.2:0/2695527487 >> [v2:172.21.15.2:6800/2181612853,v1:172.21.15.2:6801/2181612853] conn(0x7fcd700a2d90 0x7fcd700a5250 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:30.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:30.194+0000 7fcd92800700 1 --2- 172.21.15.2:0/2695527487 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcd8c06b3c0 0x7fcd8c19b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-13T02:32:30.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:30.194+0000 7fcd92800700 1 -- 172.21.15.2:0/2695527487 >> 172.21.15.2:0/2695527487 conn(0x7fcd8c078300 msgr2=0x7fcd8c10d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-13T02:32:30.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:30.195+0000 7fcd92800700 1 -- 172.21.15.2:0/2695527487 shutdown_connections 2024-06-13T02:32:30.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-06-13T02:32:30.196+0000 7fcd92800700 1 -- 172.21.15.2:0/2695527487 wait complete. 2024-06-13T02:32:30.198 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data_ec' removed 2024-06-13T02:32:30.379 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:30 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2695527487' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T02:32:30.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:30 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2695527487' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T02:32:30.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:30 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2695527487' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-13T02:32:31.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-13T02:32:31.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-13T02:32:31.161 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-13T02:32:31.188 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-06-13T02:32:31.189 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-13T02:32:31.242 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-13T02:32:31.256 DEBUG:teuthology.orchestra.run.smithi175:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-13T02:32:31.271 INFO:tasks.cephadm:Stopping all daemons... 2024-06-13T02:32:31.272 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-06-13T02:32:31.272 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mon.a 2024-06-13T02:32:31.344 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:31 smithi002 ceph-mon[31960]: pgmap v468: 33 pgs: 33 active+clean; 224 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:32:31.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:31 smithi002 ceph-mon[31960]: from='client.? 172.21.15.2:0/2695527487' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T02:32:31.345 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:31 smithi002 ceph-mon[31960]: osdmap e127: 12 total, 12 up, 12 in 2024-06-13T02:32:31.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:31 smithi084 ceph-mon[36833]: pgmap v468: 33 pgs: 33 active+clean; 224 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:32:31.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:31 smithi084 ceph-mon[36833]: from='client.? 172.21.15.2:0/2695527487' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T02:32:31.470 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:31 smithi084 ceph-mon[36833]: osdmap e127: 12 total, 12 up, 12 in 2024-06-13T02:32:31.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:31 smithi175 ceph-mon[36977]: pgmap v468: 33 pgs: 33 active+clean; 224 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-13T02:32:31.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:31 smithi175 ceph-mon[36977]: from='client.? 172.21.15.2:0/2695527487' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-06-13T02:32:31.532 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:31 smithi175 ceph-mon[36977]: osdmap e127: 12 total, 12 up, 12 in 2024-06-13T02:32:31.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:31 smithi002 systemd[1]: Stopping Ceph mon.a for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:32:32.328 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:31 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a[31956]: 2024-06-13T02:32:31.909+0000 7fcb85600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:32:32.328 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:31 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a[31956]: 2024-06-13T02:32:31.909+0000 7fcb85600700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-06-13T02:32:32.328 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:32 smithi002 podman[98136]: 2024-06-13 02:32:32.003233281 +0000 UTC m=+0.241418676 container died 9c465d8cf57b7bbc6dffeeb70e4a90352b1ac268e9f1d1cd9e419cc16852016e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-06-13T02:32:32.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:32 smithi002 podman[98136]: 2024-06-13 02:32:32.452603497 +0000 UTC m=+0.690788885 container cleanup 9c465d8cf57b7bbc6dffeeb70e4a90352b1ac268e9f1d1cd9e419cc16852016e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, ceph=True) 2024-06-13T02:32:32.630 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:32 smithi002 bash[98136]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a 2024-06-13T02:32:33.130 INFO:journalctl@ceph.mon.a.smithi002.stdout:Jun 13 02:32:32 smithi002 podman[98149]: 2024-06-13 02:32:32.721250251 +0000 UTC m=+0.704593403 container remove 9c465d8cf57b7bbc6dffeeb70e4a90352b1ac268e9f1d1cd9e419cc16852016e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-a, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-06-13T02:32:33.240 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mon.a.service' 2024-06-13T02:32:33.373 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:32:33.373 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-06-13T02:32:33.373 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-06-13T02:32:33.373 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mon.b 2024-06-13T02:32:33.720 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:33 smithi084 systemd[1]: Stopping Ceph mon.b for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:32:33.972 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:33 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-b[36829]: 2024-06-13T02:32:33.719+0000 7ff9375b3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:32:33.972 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:33 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-b[36829]: 2024-06-13T02:32:33.719+0000 7ff9375b3700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-06-13T02:32:34.246 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:33 smithi084 podman[75127]: 2024-06-13 02:32:33.973075574 +0000 UTC m=+0.354024602 container died c2faadf1f3354f7f7de70f5b188e80abb760502c0c9088a5333addf11daf0e94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-b, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, CEPH_POINT_RELEASE=) 2024-06-13T02:32:34.655 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:34 smithi084 podman[75127]: 2024-06-13 02:32:34.354048924 +0000 UTC m=+0.734997909 container cleanup c2faadf1f3354f7f7de70f5b188e80abb760502c0c9088a5333addf11daf0e94 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-b, org.label-schema.build-date=20240528, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-06-13T02:32:34.655 INFO:journalctl@ceph.mon.b.smithi084.stdout:Jun 13 02:32:34 smithi084 bash[75127]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-b 2024-06-13T02:32:34.790 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mon.b.service' 2024-06-13T02:32:34.835 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:32:34.835 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-06-13T02:32:34.836 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-06-13T02:32:34.836 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mon.c 2024-06-13T02:32:35.128 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:34 smithi175 systemd[1]: Stopping Ceph mon.c for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:32:35.504 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:35 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-c[36971]: 2024-06-13T02:32:35.125+0000 7f0f2797a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:32:35.504 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:35 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-c[36971]: 2024-06-13T02:32:35.125+0000 7f0f2797a700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-06-13T02:32:35.504 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:35 smithi175 podman[74224]: 2024-06-13 02:32:35.218932281 +0000 UTC m=+0.187657056 container died bc7859d039529d1e5cb2954b63128eee1da243252cdfeada721066ebb7987351 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, ceph=True) 2024-06-13T02:32:35.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:35 smithi175 podman[74224]: 2024-06-13 02:32:35.60344051 +0000 UTC m=+0.572165285 container cleanup bc7859d039529d1e5cb2954b63128eee1da243252cdfeada721066ebb7987351 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-c, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T02:32:35.782 INFO:journalctl@ceph.mon.c.smithi175.stdout:Jun 13 02:32:35 smithi175 bash[74224]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mon-c 2024-06-13T02:32:35.979 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mon.c.service' 2024-06-13T02:32:36.028 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:32:36.029 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-06-13T02:32:36.029 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-06-13T02:32:36.029 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.x 2024-06-13T02:32:36.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:32:36 smithi002 systemd[1]: Stopping Ceph mgr.x for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:32:36.880 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:32:36 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:32:36.623+0000 7fc85ec00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:32:36.880 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:32:36 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x[32189]: 2024-06-13T02:32:36.623+0000 7fc85ec00700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-06-13T02:32:36.881 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:32:36 smithi002 podman[98254]: 2024-06-13 02:32:36.719756523 +0000 UTC m=+0.244669582 container died f6a6440147350dcb7a51c51f582f73a4298c2e224bce2fc89ee798fb4bf034ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc) 2024-06-13T02:32:37.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:32:37 smithi002 podman[98254]: 2024-06-13 02:32:37.21628708 +0000 UTC m=+0.741200153 container cleanup f6a6440147350dcb7a51c51f582f73a4298c2e224bce2fc89ee798fb4bf034ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528) 2024-06-13T02:32:37.380 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:32:37 smithi002 bash[98254]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x 2024-06-13T02:32:37.880 INFO:journalctl@ceph.mgr.x.smithi002.stdout:Jun 13 02:32:37 smithi002 podman[98267]: 2024-06-13 02:32:37.476680235 +0000 UTC m=+0.734428204 container remove f6a6440147350dcb7a51c51f582f73a4298c2e224bce2fc89ee798fb4bf034ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3d89accfe3201286f000e065a1faea2a88c7a6ba, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-x, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-06-13T02:32:38.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.x.service' 2024-06-13T02:32:38.163 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:32:38.163 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-06-13T02:32:38.163 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-06-13T02:32:38.164 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.y 2024-06-13T02:32:38.470 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:32:38 smithi084 systemd[1]: Stopping Ceph mgr.y for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:32:38.835 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:32:38 smithi084 podman[75251]: 2024-06-13 02:32:38.496158075 +0000 UTC m=+0.146037740 container died e34ef6cf1c8c82701bff5405771df5c7e58f8e98d8251a05691f2c1c747c38b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y, ceph=True, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5) 2024-06-13T02:32:39.152 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:32:38 smithi084 podman[75251]: 2024-06-13 02:32:38.942958489 +0000 UTC m=+0.592838152 container cleanup e34ef6cf1c8c82701bff5405771df5c7e58f8e98d8251a05691f2c1c747c38b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-06-13T02:32:39.152 INFO:journalctl@ceph.mgr.y.smithi084.stdout:Jun 13 02:32:38 smithi084 bash[75251]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-y 2024-06-13T02:32:39.374 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.y.service' 2024-06-13T02:32:39.409 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:32:39.409 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-06-13T02:32:39.409 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-06-13T02:32:39.409 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.z 2024-06-13T02:32:39.778 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:32:39 smithi175 systemd[1]: Stopping Ceph mgr.z for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:32:40.032 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:32:39 smithi175 podman[74349]: 2024-06-13 02:32:39.778417651 +0000 UTC m=+0.174689840 container died bd62bf3c6000c5033f5aa222e8f8cd5e415777945b88b5a3e477e058b1843f40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc) 2024-06-13T02:32:40.317 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:32:40 smithi175 podman[74349]: 2024-06-13 02:32:40.291847687 +0000 UTC m=+0.688119876 container cleanup bd62bf3c6000c5033f5aa222e8f8cd5e415777945b88b5a3e477e058b1843f40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T02:32:40.317 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:32:40 smithi175 bash[74349]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z 2024-06-13T02:32:40.732 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.z.service' 2024-06-13T02:32:40.753 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:32:40 smithi175 podman[74364]: 2024-06-13 02:32:40.501954381 +0000 UTC m=+0.715751210 container remove bd62bf3c6000c5033f5aa222e8f8cd5e415777945b88b5a3e477e058b1843f40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-06-13T02:32:40.753 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:32:40 smithi175 systemd[1]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-06-13T02:32:40.753 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:32:40 smithi175 systemd[1]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-06-13T02:32:40.753 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:32:40 smithi175 systemd[1]: Stopped Ceph mgr.z for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:32:40.754 INFO:journalctl@ceph.mgr.z.smithi175.stdout:Jun 13 02:32:40 smithi175 systemd[1]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mgr.z.service: Consumed 21.560s CPU time. 2024-06-13T02:32:40.766 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:32:40.767 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-06-13T02:32:40.767 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-06-13T02:32:40.767 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.0 2024-06-13T02:32:41.131 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:32:40 smithi002 systemd[1]: Stopping Ceph osd.0 for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:32:41.880 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:32:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-0[44001]: 2024-06-13T02:32:41.411+0000 7f3328400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:32:41.880 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:32:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-0[44001]: 2024-06-13T02:32:41.411+0000 7f3328400700 -1 osd.0 127 *** Got signal Terminated *** 2024-06-13T02:32:41.880 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:32:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-0[44001]: 2024-06-13T02:32:41.411+0000 7f3328400700 -1 osd.0 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T02:32:47.380 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:32:47 smithi002 podman[98375]: 2024-06-13 02:32:47.118692915 +0000 UTC m=+5.866528723 container died 37f49700b4f9fd2075c2c892aa892b7905fb8af57eff5e3b55ba02e1b5a78059 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_CLEAN=True) 2024-06-13T02:32:47.857 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:32:47 smithi002 podman[98375]: 2024-06-13 02:32:47.622132913 +0000 UTC m=+6.369968756 container cleanup 37f49700b4f9fd2075c2c892aa892b7905fb8af57eff5e3b55ba02e1b5a78059 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-0, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-06-13T02:32:47.857 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:32:47 smithi002 bash[98375]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-0 2024-06-13T02:32:48.130 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:32:47 smithi002 podman[98394]: 2024-06-13 02:32:47.856843648 +0000 UTC m=+0.721441186 container remove 37f49700b4f9fd2075c2c892aa892b7905fb8af57eff5e3b55ba02e1b5a78059 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-06-13T02:32:49.121 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:32:48 smithi002 podman[98482]: 2024-06-13 02:32:48.625427041 +0000 UTC m=+0.037488802 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:32:49.121 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:32:48 smithi002 podman[98482]: 2024-06-13 02:32:48.732866162 +0000 UTC m=+0.144927948 container create 4c74801ac1d75b0425720d1142c437b740080293800f0d2833fe862e57f73a74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-06-13T02:32:49.380 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:32:49 smithi002 podman[98482]: 2024-06-13 02:32:49.120719359 +0000 UTC m=+0.532781151 container init 4c74801ac1d75b0425720d1142c437b740080293800f0d2833fe862e57f73a74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528) 2024-06-13T02:32:49.380 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:32:49 smithi002 podman[98482]: 2024-06-13 02:32:49.13468926 +0000 UTC m=+0.546751019 container start 4c74801ac1d75b0425720d1142c437b740080293800f0d2833fe862e57f73a74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-06-13T02:32:49.380 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:32:49 smithi002 podman[98482]: 2024-06-13 02:32:49.227763146 +0000 UTC m=+0.639824982 container attach 4c74801ac1d75b0425720d1142c437b740080293800f0d2833fe862e57f73a74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-06-13T02:32:49.880 INFO:journalctl@ceph.osd.0.smithi002.stdout:Jun 13 02:32:49 smithi002 podman[98482]: 2024-06-13 02:32:49.602059431 +0000 UTC m=+1.014121277 container died 4c74801ac1d75b0425720d1142c437b740080293800f0d2833fe862e57f73a74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T02:32:50.311 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.0.service' 2024-06-13T02:32:50.436 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:32:50.436 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-06-13T02:32:50.436 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-06-13T02:32:50.436 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.1 2024-06-13T02:32:50.720 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:32:50 smithi084 systemd[1]: Stopping Ceph osd.1 for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:32:51.220 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:32:50 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-1[41372]: 2024-06-13T02:32:50.771+0000 7f1a5ca0d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:32:51.220 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:32:50 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-1[41372]: 2024-06-13T02:32:50.771+0000 7f1a5ca0d700 -1 osd.1 127 *** Got signal Terminated *** 2024-06-13T02:32:51.220 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:32:50 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-1[41372]: 2024-06-13T02:32:50.771+0000 7f1a5ca0d700 -1 osd.1 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T02:32:56.470 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:32:56 smithi084 podman[75373]: 2024-06-13 02:32:56.195348188 +0000 UTC m=+5.563186559 container died 2eb0166143def3d4a76ba45fc5c1ea2bd1c696646b9b428db6b438b4f1a48966 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-1, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-06-13T02:32:56.897 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:32:56 smithi084 podman[75373]: 2024-06-13 02:32:56.596765015 +0000 UTC m=+5.964603425 container cleanup 2eb0166143def3d4a76ba45fc5c1ea2bd1c696646b9b428db6b438b4f1a48966 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-1, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc) 2024-06-13T02:32:56.897 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:32:56 smithi084 bash[75373]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-1 2024-06-13T02:32:57.217 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:32:56 smithi084 podman[75390]: 2024-06-13 02:32:56.898105442 +0000 UTC m=+0.698576631 container remove 2eb0166143def3d4a76ba45fc5c1ea2bd1c696646b9b428db6b438b4f1a48966 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T02:32:57.468 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:32:57 smithi084 podman[75483]: 2024-06-13 02:32:57.120139803 +0000 UTC m=+0.017314413 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:32:57.468 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:32:57 smithi084 podman[75483]: 2024-06-13 02:32:57.249227122 +0000 UTC m=+0.146401766 container create 28524ae678ea6224b20240f66d8576f499a1411e377f0ca273452c06d4b8a55b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, org.label-schema.license=GPLv2) 2024-06-13T02:32:57.720 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:32:57 smithi084 podman[75483]: 2024-06-13 02:32:57.468581331 +0000 UTC m=+0.365755951 container init 28524ae678ea6224b20240f66d8576f499a1411e377f0ca273452c06d4b8a55b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T02:32:57.720 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:32:57 smithi084 podman[75483]: 2024-06-13 02:32:57.471987969 +0000 UTC m=+0.369162571 container start 28524ae678ea6224b20240f66d8576f499a1411e377f0ca273452c06d4b8a55b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True) 2024-06-13T02:32:57.721 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:32:57 smithi084 podman[75483]: 2024-06-13 02:32:57.593419071 +0000 UTC m=+0.490593687 container attach 28524ae678ea6224b20240f66d8576f499a1411e377f0ca273452c06d4b8a55b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-06-13T02:32:58.112 INFO:journalctl@ceph.osd.1.smithi084.stdout:Jun 13 02:32:57 smithi084 podman[75483]: 2024-06-13 02:32:57.783462452 +0000 UTC m=+0.680637056 container died 28524ae678ea6224b20240f66d8576f499a1411e377f0ca273452c06d4b8a55b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-06-13T02:32:58.432 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.1.service' 2024-06-13T02:32:58.473 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:32:58.473 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-06-13T02:32:58.474 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-06-13T02:32:58.474 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.2 2024-06-13T02:32:58.779 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:32:58 smithi175 systemd[1]: Stopping Ceph osd.2 for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:32:59.032 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:32:58 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-2[42091]: 2024-06-13T02:32:58.778+0000 7fa224ff7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:32:59.032 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:32:58 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-2[42091]: 2024-06-13T02:32:58.778+0000 7fa224ff7700 -1 osd.2 127 *** Got signal Terminated *** 2024-06-13T02:32:59.032 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:32:58 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-2[42091]: 2024-06-13T02:32:58.778+0000 7fa224ff7700 -1 osd.2 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T02:33:04.494 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:33:04 smithi175 podman[74487]: 2024-06-13 02:33:04.207673089 +0000 UTC m=+5.530806642 container died aeecf4f465b2fa2b76c388426ba9407eb5d4d5b3926892eeb7f03d0c71bcf834 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, ceph=True, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-06-13T02:33:04.745 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:33:04 smithi175 podman[74487]: 2024-06-13 02:33:04.494597134 +0000 UTC m=+5.817730684 container cleanup aeecf4f465b2fa2b76c388426ba9407eb5d4d5b3926892eeb7f03d0c71bcf834 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-13T02:33:04.745 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:33:04 smithi175 bash[74487]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-2 2024-06-13T02:33:05.032 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:33:04 smithi175 podman[74503]: 2024-06-13 02:33:04.745930822 +0000 UTC m=+0.540107173 container remove aeecf4f465b2fa2b76c388426ba9407eb5d4d5b3926892eeb7f03d0c71bcf834 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0) 2024-06-13T02:33:05.382 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:33:05 smithi175 podman[74592]: 2024-06-13 02:33:04.963463187 +0000 UTC m=+0.017270095 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:33:05.382 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:33:05 smithi175 podman[74592]: 2024-06-13 02:33:05.105627391 +0000 UTC m=+0.159434291 container create 68abc7de784dd151c9754e8180299b84b1174cfabff8e2e9c950b5a7cf5421bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-06-13T02:33:05.383 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:33:05 smithi175 podman[74592]: 2024-06-13 02:33:05.383073055 +0000 UTC m=+0.436879969 container init 68abc7de784dd151c9754e8180299b84b1174cfabff8e2e9c950b5a7cf5421bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T02:33:05.676 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:33:05 smithi175 podman[74592]: 2024-06-13 02:33:05.386240671 +0000 UTC m=+0.440047577 container start 68abc7de784dd151c9754e8180299b84b1174cfabff8e2e9c950b5a7cf5421bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-2-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528) 2024-06-13T02:33:05.676 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:33:05 smithi175 podman[74592]: 2024-06-13 02:33:05.474853772 +0000 UTC m=+0.528660682 container attach 68abc7de784dd151c9754e8180299b84b1174cfabff8e2e9c950b5a7cf5421bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-3d89acc, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS) 2024-06-13T02:33:05.985 INFO:journalctl@ceph.osd.2.smithi175.stdout:Jun 13 02:33:05 smithi175 podman[74592]: 2024-06-13 02:33:05.677047761 +0000 UTC m=+0.730854663 container died 68abc7de784dd151c9754e8180299b84b1174cfabff8e2e9c950b5a7cf5421bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T02:33:06.334 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.2.service' 2024-06-13T02:33:06.374 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:33:06.374 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-06-13T02:33:06.375 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-06-13T02:33:06.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.3 2024-06-13T02:33:06.848 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:06 smithi002 systemd[1]: Stopping Ceph osd.3 for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:33:07.130 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:06 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3[50643]: 2024-06-13T02:33:06.982+0000 7fde5a000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:33:07.130 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:06 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3[50643]: 2024-06-13T02:33:06.982+0000 7fde5a000700 -1 osd.3 127 *** Got signal Terminated *** 2024-06-13T02:33:07.130 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:06 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3[50643]: 2024-06-13T02:33:06.982+0000 7fde5a000700 -1 osd.3 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T02:33:08.440 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:08 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:08.121+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:08.781 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:08 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:08.440+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:09.475 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:09 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:09.085+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:09.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:09 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:09.475+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:10.381 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:10 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:10.019+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:10.460 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:10 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:10.044+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:10.781 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:10 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:10.459+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:10.879 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:10 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3[50643]: 2024-06-13T02:33:10.388+0000 7fde50800700 -1 osd.3 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.084848+0000 front 2024-06-13T02:32:45.085145+0000 (oldest deadline 2024-06-13T02:33:10.384505+0000) 2024-06-13T02:33:11.281 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:11 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:11.030+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:11.340 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:11 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:11.047+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:11.629 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:11 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3[50643]: 2024-06-13T02:33:11.340+0000 7fde50800700 -1 osd.3 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.084848+0000 front 2024-06-13T02:32:45.085145+0000 (oldest deadline 2024-06-13T02:33:10.384505+0000) 2024-06-13T02:33:11.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:11 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:11.473+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:11.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:11 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:11.309+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:12.282 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:12.006+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:12.379 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:12 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:12.065+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:12.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:12.323+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:12.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:12.498+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:12.849 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:12 smithi002 podman[98587]: 2024-06-13 02:33:12.549877256 +0000 UTC m=+5.727181402 container died f279c9c144528b040310202ac2aede8b5d43b9d99e0dfe184ca33afdf1f26c8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=) 2024-06-13T02:33:12.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:12 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:12.561+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:13.130 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:12 smithi002 podman[98587]: 2024-06-13 02:33:12.983900123 +0000 UTC m=+6.161204225 container cleanup f279c9c144528b040310202ac2aede8b5d43b9d99e0dfe184ca33afdf1f26c8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T02:33:13.130 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:12 smithi002 bash[98587]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3 2024-06-13T02:33:13.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:13 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:13.023+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:13.282 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:13 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:13.022+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:13.629 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:13 smithi002 podman[98617]: 2024-06-13 02:33:13.30225014 +0000 UTC m=+0.739581465 container remove f279c9c144528b040310202ac2aede8b5d43b9d99e0dfe184ca33afdf1f26c8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS) 2024-06-13T02:33:13.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:13 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:13.510+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:13.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:13 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:13.295+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:13.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:13 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:13.535+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:14.354 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:14 smithi002 podman[98706]: 2024-06-13 02:33:14.054128227 +0000 UTC m=+0.033583712 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:33:14.354 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:14 smithi002 podman[98706]: 2024-06-13 02:33:14.177859543 +0000 UTC m=+0.157315055 container create 25cfee93c87871a7025a58b38469f86ef61324e7deaeab325c20fb51368c2582 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T02:33:14.355 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:14 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:14.008+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:14.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:14 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:14.040+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:14.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:14 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:14.254+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:14.630 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:14 smithi002 podman[98706]: 2024-06-13 02:33:14.481965989 +0000 UTC m=+0.461421537 container init 25cfee93c87871a7025a58b38469f86ef61324e7deaeab325c20fb51368c2582 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-06-13T02:33:14.630 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:14 smithi002 podman[98706]: 2024-06-13 02:33:14.493639543 +0000 UTC m=+0.473095055 container start 25cfee93c87871a7025a58b38469f86ef61324e7deaeab325c20fb51368c2582 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-06-13T02:33:14.630 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:14 smithi002 podman[98706]: 2024-06-13 02:33:14.597740545 +0000 UTC m=+0.577196087 container attach 25cfee93c87871a7025a58b38469f86ef61324e7deaeab325c20fb51368c2582 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=) 2024-06-13T02:33:14.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:14 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:14.544+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:15.031 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:14 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:14.560+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:15.273 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:14 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:14.966+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:15.273 INFO:journalctl@ceph.osd.3.smithi002.stdout:Jun 13 02:33:14 smithi002 podman[98706]: 2024-06-13 02:33:14.965687637 +0000 UTC m=+0.945143202 container died 25cfee93c87871a7025a58b38469f86ef61324e7deaeab325c20fb51368c2582 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240528) 2024-06-13T02:33:15.513 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:15 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:15.074+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:15.514 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:15 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:15.274+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:15.715 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.3.service' 2024-06-13T02:33:15.781 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:15 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:15.513+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:15.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:33:15.841 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-06-13T02:33:15.841 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-06-13T02:33:15.841 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.4 2024-06-13T02:33:15.868 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:15 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:15.534+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:16.220 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:15 smithi084 systemd[1]: Stopping Ceph osd.4 for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:33:16.306 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:16 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:16.047+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:16.379 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:15 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:15.918+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:16.563 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:16 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:16.307+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:16.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:16 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:16.540+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:16.720 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:16 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4[48296]: 2024-06-13T02:33:16.398+0000 7f2a24549700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:33:16.720 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:16 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4[48296]: 2024-06-13T02:33:16.398+0000 7f2a24549700 -1 osd.4 127 *** Got signal Terminated *** 2024-06-13T02:33:16.720 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:16 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4[48296]: 2024-06-13T02:33:16.398+0000 7f2a24549700 -1 osd.4 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T02:33:17.014 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:16 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:16.563+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:17.281 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:17 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:17.039+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:17.379 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:16 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:16.882+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:17.380 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:16 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:16.882+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:17.469 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:17 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4[48296]: 2024-06-13T02:33:17.082+0000 7f2a20b3d700 -1 osd.4 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:51.497839+0000 front 2024-06-13T02:32:51.497868+0000 (oldest deadline 2024-06-13T02:33:16.198025+0000) 2024-06-13T02:33:17.580 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:17 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:17.325+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:17.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:17 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:17.531+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:17.970 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:17 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:17.473+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:18.032 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:17 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:17.580+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:18.129 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:17 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:17.855+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:18.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:17 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:17.855+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:18.343 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:18 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:18.083+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:18.469 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:18 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4[48296]: 2024-06-13T02:33:18.059+0000 7f2a20b3d700 -1 osd.4 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:51.497839+0000 front 2024-06-13T02:32:51.497868+0000 (oldest deadline 2024-06-13T02:33:16.198025+0000) 2024-06-13T02:33:18.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:18 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:18.469+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:18.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:18 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:18.549+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:18.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:18 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:18.343+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:18.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:18 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:18.572+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:18.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:18 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:18.572+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:52.131112+0000 front 2024-06-13T02:32:52.131176+0000 (oldest deadline 2024-06-13T02:33:18.031190+0000) 2024-06-13T02:33:19.375 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:19 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:19.080+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:19.379 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:18 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:18.882+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:19.379 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:18 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:18.882+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:19.470 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:19 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4[48296]: 2024-06-13T02:33:19.081+0000 7f2a20b3d700 -1 osd.4 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:51.497839+0000 front 2024-06-13T02:32:51.497868+0000 (oldest deadline 2024-06-13T02:33:16.198025+0000) 2024-06-13T02:33:19.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:19 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:19.375+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:19.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:19 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:19.528+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:19.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:19 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:19.528+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:52.131112+0000 front 2024-06-13T02:32:52.131176+0000 (oldest deadline 2024-06-13T02:33:18.031190+0000) 2024-06-13T02:33:19.970 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:19 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:19.488+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:19.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:19 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:19.599+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:19.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:19 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:19.599+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:20.129 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:19 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:19.865+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:20.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:19 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:19.865+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:20.422 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:20 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:20.112+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:20.462 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:20 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4[48296]: 2024-06-13T02:33:20.071+0000 7f2a20b3d700 -1 osd.4 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:51.497839+0000 front 2024-06-13T02:32:51.497868+0000 (oldest deadline 2024-06-13T02:33:16.198025+0000) 2024-06-13T02:33:20.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:20 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:20.461+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:20.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:20 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:20.598+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:20.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:20 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:20.598+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:20.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:20 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:20.422+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:20.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:20 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:20.524+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:20.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:20 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:20.524+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:52.131112+0000 front 2024-06-13T02:32:52.131176+0000 (oldest deadline 2024-06-13T02:33:18.031190+0000) 2024-06-13T02:33:20.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:20 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:20.571+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:21.379 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:20 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:20.881+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:21.380 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:20 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:20.881+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:21.389 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:21 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:21.130+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:21.439 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:21 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4[48296]: 2024-06-13T02:33:21.041+0000 7f2a20b3d700 -1 osd.4 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:51.497839+0000 front 2024-06-13T02:32:51.497868+0000 (oldest deadline 2024-06-13T02:33:16.198025+0000) 2024-06-13T02:33:21.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:21 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:21.439+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:21.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:21 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:21.620+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:21.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:21 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:21.620+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:21.781 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:21 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:21.389+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:21.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:21 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:21.520+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:21.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:21 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:21.520+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:52.131112+0000 front 2024-06-13T02:32:52.131176+0000 (oldest deadline 2024-06-13T02:33:18.031190+0000) 2024-06-13T02:33:21.879 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:21 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:21.609+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:22.098 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:21 smithi084 podman[75603]: 2024-06-13 02:33:21.79318347 +0000 UTC m=+5.755362256 container died 5e0a5bbbe394a086132adf3183b194955393c3605884f8a3c9b37c20978bd547 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-13T02:33:22.379 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:21 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:21.916+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:22.380 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:21 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:21.916+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:22.419 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:22 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:22.116+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:22.428 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:22 smithi084 podman[75603]: 2024-06-13 02:33:22.198158322 +0000 UTC m=+6.160337105 container cleanup 5e0a5bbbe394a086132adf3183b194955393c3605884f8a3c9b37c20978bd547 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T02:33:22.428 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:22 smithi084 bash[75603]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4 2024-06-13T02:33:22.720 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:22 smithi084 podman[75620]: 2024-06-13 02:33:22.449773284 +0000 UTC m=+0.655120652 container remove 5e0a5bbbe394a086132adf3183b194955393c3605884f8a3c9b37c20978bd547 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc) 2024-06-13T02:33:22.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:22 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:22.428+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:22.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:22 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:22.576+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:22.721 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:22 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:22.576+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:22.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:22 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:22.420+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:22.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:22 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:22.527+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:22.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:22 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:22.527+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:52.131112+0000 front 2024-06-13T02:32:52.131176+0000 (oldest deadline 2024-06-13T02:33:18.031190+0000) 2024-06-13T02:33:22.879 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:22 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:22.560+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:23.027 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:22 smithi084 podman[75707]: 2024-06-13 02:33:22.677858871 +0000 UTC m=+0.017207327 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:33:23.027 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:22 smithi084 podman[75707]: 2024-06-13 02:33:22.792174653 +0000 UTC m=+0.131523093 container create c4a15c3a4ae555915898d4c7f39ee43ea7f91e12b3b1b9fc0158b119304ccbe3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T02:33:23.316 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:23 smithi084 podman[75707]: 2024-06-13 02:33:23.027956822 +0000 UTC m=+0.367305269 container init c4a15c3a4ae555915898d4c7f39ee43ea7f91e12b3b1b9fc0158b119304ccbe3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-06-13T02:33:23.316 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:23 smithi084 podman[75707]: 2024-06-13 02:33:23.031693233 +0000 UTC m=+0.371041679 container start c4a15c3a4ae555915898d4c7f39ee43ea7f91e12b3b1b9fc0158b119304ccbe3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T02:33:23.317 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:23 smithi084 podman[75707]: 2024-06-13 02:33:23.128078292 +0000 UTC m=+0.467426756 container attach c4a15c3a4ae555915898d4c7f39ee43ea7f91e12b3b1b9fc0158b119304ccbe3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4-deactivate, RELEASE=squid-3d89acc, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-06-13T02:33:23.379 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:22 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:22.887+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:23.380 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:22 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:22.887+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:23.519 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:23 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:23.140+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:23.519 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:23 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:23.382+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:23.586 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:23 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:23.401+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:23.586 INFO:journalctl@ceph.osd.4.smithi084.stdout:Jun 13 02:33:23 smithi084 podman[75707]: 2024-06-13 02:33:23.317331365 +0000 UTC m=+0.656679814 container died c4a15c3a4ae555915898d4c7f39ee43ea7f91e12b3b1b9fc0158b119304ccbe3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-06-13T02:33:23.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:23 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:23.519+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:23.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:23 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:23.519+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:52.131112+0000 front 2024-06-13T02:32:52.131176+0000 (oldest deadline 2024-06-13T02:33:18.031190+0000) 2024-06-13T02:33:23.879 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:23 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:23.843+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:23.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:23 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:23.843+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:23.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:23 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:23.608+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:23.905 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:23 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:23.586+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:23.906 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:23 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:23.586+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:23.931 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.4.service' 2024-06-13T02:33:24.010 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:33:24.010 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-06-13T02:33:24.011 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-06-13T02:33:24.011 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.5 2024-06-13T02:33:24.314 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:24 smithi175 systemd[1]: Stopping Ceph osd.5 for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:33:24.314 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:24 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:24.161+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:24.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:24 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:24.369+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:24.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:24 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:24.559+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:24.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:24 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:24.559+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:24.781 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:24 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:24.416+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:24.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:24 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:24.314+0000 7f8be907a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:33:24.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:24 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:24.314+0000 7f8be907a700 -1 osd.5 127 *** Got signal Terminated *** 2024-06-13T02:33:24.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:24 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:24.314+0000 7f8be907a700 -1 osd.5 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T02:33:24.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:24 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:24.524+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:24.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:24 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:24.524+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:52.131112+0000 front 2024-06-13T02:32:52.131176+0000 (oldest deadline 2024-06-13T02:33:18.031190+0000) 2024-06-13T02:33:24.879 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:24 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:24.601+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:24.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:24 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:24.838+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:24.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:24 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:24.838+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:25.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:25 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:25.186+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:25.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:25 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:25.432+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:25.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:25 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:25.373+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:25.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:25 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:25.585+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:25.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:25 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:25.585+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:25.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:25 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:25.585+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:25.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:25 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:25.802+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:25.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:25 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:25.802+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:25.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:25 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:25.577+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:26.032 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:25 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:25.571+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:26.032 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:25 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:25.571+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:52.131112+0000 front 2024-06-13T02:32:52.131176+0000 (oldest deadline 2024-06-13T02:33:18.031190+0000) 2024-06-13T02:33:26.479 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:26 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:26.224+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:26.621 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:26 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:26.360+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:26.621 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:26 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:26.603+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:26.621 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:26 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:26.603+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:26.621 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:26 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:26.603+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:26.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:26 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:26.479+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:26.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:26 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:26.594+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:26.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:26 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:26.594+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:52.131112+0000 front 2024-06-13T02:32:52.131176+0000 (oldest deadline 2024-06-13T02:33:18.031190+0000) 2024-06-13T02:33:26.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:26 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:26.594+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:00.932168+0000 front 2024-06-13T02:33:00.932146+0000 (oldest deadline 2024-06-13T02:33:25.632310+0000) 2024-06-13T02:33:26.817 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:26 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:26.532+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:26.817 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:26 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:26.532+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.247930+0000 front 2024-06-13T02:33:01.248012+0000 (oldest deadline 2024-06-13T02:33:25.948165+0000) 2024-06-13T02:33:27.129 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:26 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:26.816+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:27.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:26 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:26.816+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:27.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:26 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:26.816+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:27.459 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:27 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:27.180+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:27.459 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:27 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:27.180+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:27.592 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:27 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:27.321+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:27.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:27 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:27.459+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:27.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:27 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:27.576+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:27.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:27 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:27.576+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:52.131112+0000 front 2024-06-13T02:32:52.131176+0000 (oldest deadline 2024-06-13T02:33:18.031190+0000) 2024-06-13T02:33:27.783 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:27 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:27.576+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:00.932168+0000 front 2024-06-13T02:33:00.932146+0000 (oldest deadline 2024-06-13T02:33:25.632310+0000) 2024-06-13T02:33:27.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:27 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:27.803+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:27.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:27 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:27.803+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:27.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:27 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:27.803+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:27.881 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:27 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:27.572+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:27.881 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:27 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:27.572+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.247930+0000 front 2024-06-13T02:33:01.248012+0000 (oldest deadline 2024-06-13T02:33:25.948165+0000) 2024-06-13T02:33:27.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:27 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:27.592+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:27.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:27 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:27.592+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:27.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:27 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:27.592+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:28.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:28 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:28.426+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:28.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:28 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:28.426+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:28.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:28 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:28.190+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:28.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:28 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:28.190+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:28.616 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:28 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:28.296+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:28.879 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:28 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:28.795+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:28.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:28 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:28.795+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:28.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:28 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:28.795+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:28.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:28 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:28.609+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:28.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:28 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:28.609+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.247930+0000 front 2024-06-13T02:33:01.248012+0000 (oldest deadline 2024-06-13T02:33:25.948165+0000) 2024-06-13T02:33:28.969 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:28 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:28.617+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:28.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:28 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:28.617+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:28.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:28 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:28.617+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:29.032 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:28 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:28.570+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:43.930120+0000 front 2024-06-13T02:32:43.929873+0000 (oldest deadline 2024-06-13T02:33:07.429929+0000) 2024-06-13T02:33:29.032 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:28 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:28.570+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:52.131112+0000 front 2024-06-13T02:32:52.131176+0000 (oldest deadline 2024-06-13T02:33:18.031190+0000) 2024-06-13T02:33:29.032 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:28 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5[48878]: 2024-06-13T02:33:28.570+0000 7f8be1666700 -1 osd.5 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:00.932168+0000 front 2024-06-13T02:33:00.932146+0000 (oldest deadline 2024-06-13T02:33:25.632310+0000) 2024-06-13T02:33:29.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:29 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:29.383+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:29.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:29 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:29.383+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:29.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:29 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:29.235+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:29.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:29 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:29.235+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:29.637 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:29 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:29.299+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:29.637 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:29 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:29.299+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:29.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:29 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:29.594+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:29.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:29 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:29.594+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.247930+0000 front 2024-06-13T02:33:01.248012+0000 (oldest deadline 2024-06-13T02:33:25.948165+0000) 2024-06-13T02:33:29.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:29 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:29.754+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:29.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:29 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:29.754+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:29.881 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:29 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:29.754+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:29.969 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:29 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:29.637+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:29.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:29 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:29.637+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:29.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:29 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:29.637+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:30.031 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:29 smithi175 podman[74715]: 2024-06-13 02:33:29.760624356 +0000 UTC m=+5.550724320 container died dcb3f24f5a7bed509e9daafda69c059d06b501fc1690c304f4a35e028c0a6d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-06-13T02:33:30.432 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:30 smithi175 podman[74715]: 2024-06-13 02:33:30.197749589 +0000 UTC m=+5.987849553 container cleanup dcb3f24f5a7bed509e9daafda69c059d06b501fc1690c304f4a35e028c0a6d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, ceph=True, org.label-schema.vendor=CentOS) 2024-06-13T02:33:30.432 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:30 smithi175 bash[74715]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5 2024-06-13T02:33:30.432 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:30 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:30.239+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:30.432 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:30 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:30.239+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:30.433 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:30 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:30.340+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:30.433 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:30 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:30.340+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:30.595 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:30 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:30.312+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:30.595 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:30 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:30.312+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:30.782 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:30 smithi175 podman[74735]: 2024-06-13 02:33:30.432363533 +0000 UTC m=+0.672736575 container remove dcb3f24f5a7bed509e9daafda69c059d06b501fc1690c304f4a35e028c0a6d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-06-13T02:33:30.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:30 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:30.581+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:30.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:30 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:30.581+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.247930+0000 front 2024-06-13T02:33:01.248012+0000 (oldest deadline 2024-06-13T02:33:25.948165+0000) 2024-06-13T02:33:30.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:30 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:30.750+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:30.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:30 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:30.750+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:30.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:30 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:30.750+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:30.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:30 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:30.595+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:30.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:30 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:30.595+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:30.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:30 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:30.595+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:31.113 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:30 smithi175 podman[74822]: 2024-06-13 02:33:30.766261794 +0000 UTC m=+0.017210124 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:33:31.113 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:30 smithi175 podman[74822]: 2024-06-13 02:33:30.866777591 +0000 UTC m=+0.117725949 container create 153ad0e972eaf6c8df49e685e3f4714c1378f45dc4d57ed667d56dd98884ad05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-06-13T02:33:31.113 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:31 smithi175 podman[74822]: 2024-06-13 02:33:31.111023989 +0000 UTC m=+0.361972319 container init 153ad0e972eaf6c8df49e685e3f4714c1378f45dc4d57ed667d56dd98884ad05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-06-13T02:33:31.408 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:31 smithi175 podman[74822]: 2024-06-13 02:33:31.114044116 +0000 UTC m=+0.364992440 container start 153ad0e972eaf6c8df49e685e3f4714c1378f45dc4d57ed667d56dd98884ad05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T02:33:31.409 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:31 smithi175 podman[74822]: 2024-06-13 02:33:31.202850529 +0000 UTC m=+0.453798857 container attach 153ad0e972eaf6c8df49e685e3f4714c1378f45dc4d57ed667d56dd98884ad05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5-deactivate, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T02:33:31.409 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:31 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:31.224+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:31.409 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:31 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:31.224+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:31.409 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:31 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:31.345+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:31.410 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:31 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:31.345+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:31.629 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:31 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:31.274+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:31.629 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:31 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:31.274+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:31.764 INFO:journalctl@ceph.osd.5.smithi175.stdout:Jun 13 02:33:31 smithi175 podman[74822]: 2024-06-13 02:33:31.409496219 +0000 UTC m=+0.660444543 container died 153ad0e972eaf6c8df49e685e3f4714c1378f45dc4d57ed667d56dd98884ad05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, ceph=True, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-06-13T02:33:31.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:31 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:31.556+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:31.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:31 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:31.556+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.247930+0000 front 2024-06-13T02:33:01.248012+0000 (oldest deadline 2024-06-13T02:33:25.948165+0000) 2024-06-13T02:33:31.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:31 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:31.770+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:31.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:31 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:31.770+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:31.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:31 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:31.770+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:31.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:31 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:31.629+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:31.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:31 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:31.629+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:31.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:31 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:31.629+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:32.088 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.5.service' 2024-06-13T02:33:32.126 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:33:32.127 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-06-13T02:33:32.127 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-06-13T02:33:32.127 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.6 2024-06-13T02:33:32.338 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:32 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:32.201+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:32.338 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:32 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:32.201+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:32.575 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:32 smithi002 systemd[1]: Stopping Ceph osd.6 for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:33:32.612 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:32 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:32.266+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:32.612 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:32 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:32.266+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:32.781 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:32 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:32.338+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:32.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:32 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:32.338+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:32.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:32 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:32.574+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:32.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:32 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:32.574+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.247930+0000 front 2024-06-13T02:33:01.248012+0000 (oldest deadline 2024-06-13T02:33:25.948165+0000) 2024-06-13T02:33:32.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:32 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:32.751+0000 7f8929600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:33:32.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:32 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:32.751+0000 7f8929600700 -1 osd.6 127 *** Got signal Terminated *** 2024-06-13T02:33:32.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:32 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:32.751+0000 7f8929600700 -1 osd.6 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T02:33:32.881 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:32 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:32.809+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:32.881 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:32 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:32.809+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:32.881 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:32 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:32.809+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:32.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:32 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:32.612+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:32.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:32 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:32.612+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:32.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:32 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:32.612+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:33.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:33 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:33.327+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:33.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:33 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:33.327+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:33.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:33 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:33.223+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:33.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:33 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:33.223+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:33.640 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:33 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:33.312+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:33.641 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:33 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:33.312+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:33.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:33 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:33.575+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:33.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:33 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:33.575+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.247930+0000 front 2024-06-13T02:33:01.248012+0000 (oldest deadline 2024-06-13T02:33:25.948165+0000) 2024-06-13T02:33:33.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:33 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:33.821+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:33.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:33 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:33.821+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:33.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:33 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:33.821+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:33.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:33 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:33.641+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:33.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:33 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:33.641+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:33.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:33 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:33.641+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:34.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:34 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:34.364+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:34.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:34 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:34.364+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:34.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:34 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:34.364+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:34.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:34 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:34.256+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:34.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:34 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:34.256+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:34.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:34 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:34.256+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:34.657 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:34 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:34.328+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:34.658 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:34 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:34.328+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:34.879 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:34 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:34.581+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:34.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:34 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:34.581+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.247930+0000 front 2024-06-13T02:33:01.248012+0000 (oldest deadline 2024-06-13T02:33:25.948165+0000) 2024-06-13T02:33:34.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:34 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:34.795+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:34.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:34 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:34.795+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:34.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:34 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:34.795+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:34.881 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:34 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:34.795+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:34.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:34 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:34.658+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:34.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:34 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:34.658+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:34.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:34 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:34.658+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:35.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:35 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:35.262+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:35.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:35 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:35.262+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:35.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:35 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:35.262+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:35.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:35 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:35.322+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:35.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:35 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:35.322+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:35.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:35 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:35.322+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:35.690 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:35 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:35.354+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:35.690 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:35 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:35.354+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:35.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:35 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:35.551+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:35.880 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:35 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:35.551+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.247930+0000 front 2024-06-13T02:33:01.248012+0000 (oldest deadline 2024-06-13T02:33:25.948165+0000) 2024-06-13T02:33:35.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:35 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:35.761+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:35.881 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:35 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:35.761+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:35.881 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:35 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:35.761+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:35.881 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:35 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:35.761+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:35.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:35 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:35.690+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:35.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:35 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:35.690+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:35.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:35 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:35.690+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:35.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:35 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:35.690+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:36.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:36 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:36.319+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:36.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:36 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:36.319+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:36.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:36 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:36.319+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.824642+0000 front 2024-06-13T02:33:11.824514+0000 (oldest deadline 2024-06-13T02:33:35.924289+0000) 2024-06-13T02:33:36.782 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:36 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:36.287+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:36.782 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:36 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:36.287+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:36.782 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:36 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:36.287+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:36.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:36 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:36.339+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:36.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:36 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:36.339+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:36.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:36 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:36.339+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:36.816 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:36 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:36.534+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:36.816 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:36 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:36.534+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.247930+0000 front 2024-06-13T02:33:01.248012+0000 (oldest deadline 2024-06-13T02:33:25.948165+0000) 2024-06-13T02:33:36.817 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:36 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:36.721+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:36.817 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:36 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:36.721+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:36.817 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:36 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:36.721+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:36.817 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:36 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:36.721+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:37.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:36 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:36.724+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:37.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:36 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:36.724+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:37.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:36 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:36.724+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:37.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:36 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:36.724+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:37.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:37 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:37.321+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:37.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:37 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:37.321+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:37.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:37 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:37.321+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:37.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:37 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:37.256+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:37.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:37 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:37.256+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:37.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:37 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:37.256+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:37.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:37 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:37.281+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:37.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:37 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:37.281+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:37.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:37 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:37.281+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.824642+0000 front 2024-06-13T02:33:11.824514+0000 (oldest deadline 2024-06-13T02:33:35.924289+0000) 2024-06-13T02:33:37.745 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:37 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:37.493+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.445444+0000 front 2024-06-13T02:32:55.445518+0000 (oldest deadline 2024-06-13T02:33:19.545692+0000) 2024-06-13T02:33:37.745 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:37 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:37.493+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.247930+0000 front 2024-06-13T02:33:01.248012+0000 (oldest deadline 2024-06-13T02:33:25.948165+0000) 2024-06-13T02:33:37.745 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:37 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6[57578]: 2024-06-13T02:33:37.493+0000 7f891fe00700 -1 osd.6 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.251536+0000 front 2024-06-13T02:33:11.251669+0000 (oldest deadline 2024-06-13T02:33:37.152051+0000) 2024-06-13T02:33:37.746 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:37 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:37.743+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:37.746 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:37 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:37.743+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:38.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:37 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:37.743+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:38.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:37 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:37.743+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:38.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:37 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:37.736+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:38.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:37 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:37.736+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:38.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:37 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:37.736+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:38.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:37 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:37.736+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:38.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:38 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:38.273+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:38.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:38 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:38.274+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:38.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:38 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:38.274+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:38.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:38 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:38.293+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:38.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:38 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:38.293+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:38.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:38 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:38.293+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:38.630 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:38 smithi002 podman[98810]: 2024-06-13 02:33:38.365761718 +0000 UTC m=+5.750828058 container died 92f058762d2b14e1dfd8ec599247e23de269755d50fc563ecbbdbdf02047814d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-06-13T02:33:38.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:38 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:38.277+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:38.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:38 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:38.277+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:38.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:38 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:38.277+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.824642+0000 front 2024-06-13T02:33:11.824514+0000 (oldest deadline 2024-06-13T02:33:35.924289+0000) 2024-06-13T02:33:39.038 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:38 smithi002 podman[98810]: 2024-06-13 02:33:38.820263526 +0000 UTC m=+6.205329873 container cleanup 92f058762d2b14e1dfd8ec599247e23de269755d50fc563ecbbdbdf02047814d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-13T02:33:39.039 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:38 smithi002 bash[98810]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6 2024-06-13T02:33:39.039 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:38 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:38.721+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:39.039 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:38 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:38.721+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:39.039 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:38 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:38.721+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:39.039 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:38 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:38.721+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:39.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:38 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:38.722+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:39.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:38 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:38.722+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:39.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:38 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:38.722+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:39.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:38 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:38.722+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:39.379 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:39 smithi002 podman[98839]: 2024-06-13 02:33:39.037991257 +0000 UTC m=+0.654867305 container remove 92f058762d2b14e1dfd8ec599247e23de269755d50fc563ecbbdbdf02047814d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-06-13T02:33:39.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:39 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:39.247+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:39.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:39 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:39.247+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:39.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:39 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:39.247+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:39.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:39 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:39.272+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:39.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:39 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:39.272+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:39.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:39 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:39.272+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:39.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:39 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:39.240+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:39.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:39 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:39.240+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:39.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:39 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:39.240+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.824642+0000 front 2024-06-13T02:33:11.824514+0000 (oldest deadline 2024-06-13T02:33:35.924289+0000) 2024-06-13T02:33:39.954 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:39 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:39.690+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:39.954 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:39 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:39.690+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:39.954 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:39 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:39.690+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:39.954 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:39 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:39.690+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:40.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:39 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:39.745+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:40.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:39 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:39.745+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:40.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:39 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:39.745+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:40.221 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:39 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:39.745+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:40.226 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:39 smithi002 podman[98927]: 2024-06-13 02:33:39.860228958 +0000 UTC m=+0.037576894 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:33:40.226 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:39 smithi002 podman[98927]: 2024-06-13 02:33:39.972147683 +0000 UTC m=+0.149495646 container create fd583194db33b103d51478040319e30c0c2e474d3a47c1672b899969eea3aff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-06-13T02:33:40.226 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:40 smithi002 podman[98927]: 2024-06-13 02:33:40.225889631 +0000 UTC m=+0.403237601 container init fd583194db33b103d51478040319e30c0c2e474d3a47c1672b899969eea3aff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-3d89acc) 2024-06-13T02:33:40.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:40 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:40.209+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:40.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:40 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:40.209+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:40.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:40 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:40.209+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:40.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:40 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:40.315+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:40.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:40 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:40.315+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:40.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:40 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:40.315+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:40.629 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:40 smithi002 podman[98927]: 2024-06-13 02:33:40.238571209 +0000 UTC m=+0.415919192 container start fd583194db33b103d51478040319e30c0c2e474d3a47c1672b899969eea3aff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc) 2024-06-13T02:33:40.630 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:40 smithi002 podman[98927]: 2024-06-13 02:33:40.316171733 +0000 UTC m=+0.493519743 container attach fd583194db33b103d51478040319e30c0c2e474d3a47c1672b899969eea3aff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD) 2024-06-13T02:33:40.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:40 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:40.251+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:40.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:40 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:40.251+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:40.720 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:40 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:40.251+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.824642+0000 front 2024-06-13T02:33:11.824514+0000 (oldest deadline 2024-06-13T02:33:35.924289+0000) 2024-06-13T02:33:41.033 INFO:journalctl@ceph.osd.6.smithi002.stdout:Jun 13 02:33:40 smithi002 podman[98953]: 2024-06-13 02:33:40.763660691 +0000 UTC m=+0.038583824 container died fd583194db33b103d51478040319e30c0c2e474d3a47c1672b899969eea3aff6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-06-13T02:33:41.033 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:40 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:40.658+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:41.033 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:40 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:40.658+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:41.033 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:40 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:40.658+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:41.033 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:40 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:40.658+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:41.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:40 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:40.723+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:41.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:40 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:40.723+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:41.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:40 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:40.723+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:41.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:40 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:40.723+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:41.438 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.6.service' 2024-06-13T02:33:41.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:41 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:41.174+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:41.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:41 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:41.174+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:41.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:41 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:41.174+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:41.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:41 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:41.276+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:41.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:41 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:41.276+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:41.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:41 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:41.276+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:41.559 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:33:41.560 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-06-13T02:33:41.560 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-06-13T02:33:41.560 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.7 2024-06-13T02:33:41.587 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:41 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:41.261+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:41.588 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:41 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:41.261+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:41.588 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:41 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:41.261+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.824642+0000 front 2024-06-13T02:33:11.824514+0000 (oldest deadline 2024-06-13T02:33:35.924289+0000) 2024-06-13T02:33:41.882 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:41 smithi084 systemd[1]: Stopping Ceph osd.7 for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:33:41.883 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:41 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:41.714+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:41.883 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:41 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:41.714+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:41.883 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:41 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:41.714+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:41.884 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:41 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:41.714+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:42.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:41.702+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:42.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:41.702+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:42.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:41.702+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:42.131 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:41 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:41.702+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:42.220 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:41 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:41.882+0000 7f33c3e53700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:33:42.220 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:41 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:41.882+0000 7f33c3e53700 -1 osd.7 127 *** Got signal Terminated *** 2024-06-13T02:33:42.220 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:41 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:41.882+0000 7f33c3e53700 -1 osd.7 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T02:33:42.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:42 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:42.199+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:42.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:42 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:42.199+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:42.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:42 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:42.199+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:42.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:42 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:42.229+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:42.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:42 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:42.229+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:42.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:42 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:42.229+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:42.667 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:42 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:42.240+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:42.667 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:42 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:42.240+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:42.667 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:42 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:42.240+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.824642+0000 front 2024-06-13T02:33:11.824514+0000 (oldest deadline 2024-06-13T02:33:35.924289+0000) 2024-06-13T02:33:42.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:42 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:42.666+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:42.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:42 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:42.666+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:42.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:42 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:42.666+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:42.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:42 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:42.666+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:43.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:42 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:42.750+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:43.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:42 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:42.750+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:43.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:42 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:42.750+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:43.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:42 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:42.750+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:43.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:43 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:43.203+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:43.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:43 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:43.203+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:43.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:43 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:43.203+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:43.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:43 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:43.172+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:43.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:43 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:43.172+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:43.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:43 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:43.172+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:43.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:43 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:43.172+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:17.065171+0000 front 2024-06-13T02:33:17.065066+0000 (oldest deadline 2024-06-13T02:33:42.964893+0000) 2024-06-13T02:33:43.625 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:43 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:43.248+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:43.625 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:43 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:43.248+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:43.625 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:43 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:43.248+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.824642+0000 front 2024-06-13T02:33:11.824514+0000 (oldest deadline 2024-06-13T02:33:35.924289+0000) 2024-06-13T02:33:43.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:43 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:43.625+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:43.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:43 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:43.625+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:43.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:43 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:43.625+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:43.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:43 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:43.625+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:44.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:43 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:43.722+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:44.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:43 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:43.722+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:44.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:43 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:43.722+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:44.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:43 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:43.722+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:44.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:43 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:43.722+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:44.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:44 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:44.122+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:44.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:44 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:44.122+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:44.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:44 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:44.122+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:44.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:44 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:44.122+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:17.065171+0000 front 2024-06-13T02:33:17.065066+0000 (oldest deadline 2024-06-13T02:33:42.964893+0000) 2024-06-13T02:33:44.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:44 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:44.204+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:44.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:44 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:44.204+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:44.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:44 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:44.204+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:44.628 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:44 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:44.243+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:44.628 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:44 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:44.243+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:44.628 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:44 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:44.243+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.824642+0000 front 2024-06-13T02:33:11.824514+0000 (oldest deadline 2024-06-13T02:33:35.924289+0000) 2024-06-13T02:33:44.969 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:44 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:44.629+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:44.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:44 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:44.629+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:44.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:44 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:44.629+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:44.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:44 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:44.629+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:44.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:44 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:44.629+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:45.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:44 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:44.713+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:45.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:44 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:44.713+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:45.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:44 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:44.713+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:45.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:44 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:44.713+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:45.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:44 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:44.713+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:45.470 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:45.202+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:45.470 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:45.202+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:45.470 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:45.202+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.824642+0000 front 2024-06-13T02:33:11.824514+0000 (oldest deadline 2024-06-13T02:33:35.924289+0000) 2024-06-13T02:33:45.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:45.209+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:45.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:45.209+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:45.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:45.209+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:45.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:45.097+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:45.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:45.097+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:45.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:45.097+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:45.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:45 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:45.097+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:17.065171+0000 front 2024-06-13T02:33:17.065066+0000 (oldest deadline 2024-06-13T02:33:42.964893+0000) 2024-06-13T02:33:45.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:45.626+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:45.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:45.626+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:45.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:45.626+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:45.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:45.626+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:45.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:45.626+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:46.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:45 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:45.696+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:46.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:45 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:45.696+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:46.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:45 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:45.696+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:46.131 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:45 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:45.696+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:46.131 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:45 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:45.696+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:46.470 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:46 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:46.172+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:53.021975+0000 front 2024-06-13T02:32:53.022076+0000 (oldest deadline 2024-06-13T02:33:17.122070+0000) 2024-06-13T02:33:46.470 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:46 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:46.172+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.423033+0000 front 2024-06-13T02:33:02.423068+0000 (oldest deadline 2024-06-13T02:33:28.323013+0000) 2024-06-13T02:33:46.470 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:46 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:46.172+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.824642+0000 front 2024-06-13T02:33:11.824514+0000 (oldest deadline 2024-06-13T02:33:35.924289+0000) 2024-06-13T02:33:46.470 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:46 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7[54869]: 2024-06-13T02:33:46.172+0000 7f33c0447700 -1 osd.7 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:21.026159+0000 front 2024-06-13T02:33:21.026206+0000 (oldest deadline 2024-06-13T02:33:45.726297+0000) 2024-06-13T02:33:46.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:46 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:46.138+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:46.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:46 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:46.138+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:46.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:46 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:46.138+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:46.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:46 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:46.138+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:17.065171+0000 front 2024-06-13T02:33:17.065066+0000 (oldest deadline 2024-06-13T02:33:42.964893+0000) 2024-06-13T02:33:46.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:46 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:46.241+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:46.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:46 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:46.241+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:46.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:46 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:46.241+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:46.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:46 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:46.241+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:33:46.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:46 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:46.583+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:46.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:46 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:46.583+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:46.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:46 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:46.583+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:46.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:46 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:46.583+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:46.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:46 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:46.583+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:47.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:46 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:46.660+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:47.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:46 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:46.660+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:47.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:46 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:46.660+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:47.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:46 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:46.660+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:47.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:46 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:46.660+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:47.433 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:47 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:47.231+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:47.433 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:47 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:47.231+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:47.434 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:47 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:47.231+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:47.434 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:47 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:47.231+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:33:47.434 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:47 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:47.103+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:47.434 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:47 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:47.103+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:47.435 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:47 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:47.103+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:47.435 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:47 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:47.103+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:17.065171+0000 front 2024-06-13T02:33:17.065066+0000 (oldest deadline 2024-06-13T02:33:42.964893+0000) 2024-06-13T02:33:47.536 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:47 smithi084 podman[75824]: 2024-06-13 02:33:47.274161635 +0000 UTC m=+5.506582943 container died 62f4a9303907dfb67e5d94c00e3a9a81a1b71bef86e012fd50cd870f1901cc96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528) 2024-06-13T02:33:47.858 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:47 smithi084 podman[75824]: 2024-06-13 02:33:47.569504359 +0000 UTC m=+5.801925673 container cleanup 62f4a9303907dfb67e5d94c00e3a9a81a1b71bef86e012fd50cd870f1901cc96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux ) 2024-06-13T02:33:47.858 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:47 smithi084 bash[75824]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7 2024-06-13T02:33:47.858 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:47 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:47.535+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:47.858 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:47 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:47.535+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:47.858 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:47 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:47.535+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:47.859 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:47 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:47.535+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:47.859 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:47 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:47.535+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:48.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:47 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:47.689+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:48.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:47 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:47.689+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:48.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:47 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:47.689+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:48.131 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:47 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:47.689+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:48.131 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:47 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:47.689+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:48.181 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:47 smithi084 podman[75840]: 2024-06-13 02:33:47.858667424 +0000 UTC m=+0.585956576 container remove 62f4a9303907dfb67e5d94c00e3a9a81a1b71bef86e012fd50cd870f1901cc96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-13T02:33:48.449 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:48 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:48.072+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:48.449 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:48 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:48.072+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:48.449 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:48 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:48.072+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:48.449 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:48 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:48.072+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:17.065171+0000 front 2024-06-13T02:33:17.065066+0000 (oldest deadline 2024-06-13T02:33:42.964893+0000) 2024-06-13T02:33:48.450 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:48 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:48.186+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:48.450 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:48 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:48.186+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:48.450 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:48 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:48.186+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:48.450 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:48 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:48.186+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:33:48.469 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:48 smithi084 podman[75933]: 2024-06-13 02:33:48.084627774 +0000 UTC m=+0.017123519 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:33:48.470 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:48 smithi084 podman[75933]: 2024-06-13 02:33:48.221450861 +0000 UTC m=+0.153946588 container create 0cc4bbff3e842390a196c943faead4dc56da47d2df0b96662cbb14369b6f3ba0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=) 2024-06-13T02:33:48.773 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:48 smithi084 podman[75933]: 2024-06-13 02:33:48.479178777 +0000 UTC m=+0.411674516 container init 0cc4bbff3e842390a196c943faead4dc56da47d2df0b96662cbb14369b6f3ba0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-3d89acc) 2024-06-13T02:33:48.773 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:48 smithi084 podman[75933]: 2024-06-13 02:33:48.482355245 +0000 UTC m=+0.414850973 container start 0cc4bbff3e842390a196c943faead4dc56da47d2df0b96662cbb14369b6f3ba0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-06-13T02:33:48.773 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:48 smithi084 podman[75933]: 2024-06-13 02:33:48.587367905 +0000 UTC m=+0.519863649 container attach 0cc4bbff3e842390a196c943faead4dc56da47d2df0b96662cbb14369b6f3ba0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, ceph=True, io.buildah.version=1.33.5) 2024-06-13T02:33:48.773 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:48 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:48.489+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:48.773 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:48 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:48.489+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:48.774 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:48 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:48.489+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:48.774 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:48 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:48.489+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:48.774 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:48 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:48.489+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:48.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:48 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:48.641+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:48.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:48 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:48.641+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:48.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:48 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:48.641+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:48.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:48 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:48.641+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:48.881 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:48 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:48.641+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:49.064 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:48 smithi084 podman[75933]: 2024-06-13 02:33:48.773369534 +0000 UTC m=+0.705865272 container died 0cc4bbff3e842390a196c943faead4dc56da47d2df0b96662cbb14369b6f3ba0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-06-13T02:33:49.320 INFO:journalctl@ceph.osd.7.smithi084.stdout:Jun 13 02:33:49 smithi084 podman[75960]: 2024-06-13 02:33:49.30723424 +0000 UTC m=+0.528314927 container remove 0cc4bbff3e842390a196c943faead4dc56da47d2df0b96662cbb14369b6f3ba0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-7-deactivate, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-06-13T02:33:49.325 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.7.service' 2024-06-13T02:33:49.401 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:33:49.402 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-06-13T02:33:49.402 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-06-13T02:33:49.402 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.8 2024-06-13T02:33:49.424 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:49 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:49.096+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:49.424 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:49 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:49.096+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:49.424 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:49 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:49.096+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:49.425 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:49 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:49.096+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:17.065171+0000 front 2024-06-13T02:33:17.065066+0000 (oldest deadline 2024-06-13T02:33:42.964893+0000) 2024-06-13T02:33:49.425 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:49 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:49.231+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:49.425 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:49 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:49.231+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:49.425 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:49 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:49.231+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:49.425 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:49 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:49.231+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:33:49.716 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:49 smithi175 systemd[1]: Stopping Ceph osd.8 for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:33:49.716 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:49 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:49.715+0000 7f1f3ee8d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:33:49.717 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:49 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:49.715+0000 7f1f3ee8d700 -1 osd.8 127 *** Got signal Terminated *** 2024-06-13T02:33:49.717 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:49 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:49.715+0000 7f1f3ee8d700 -1 osd.8 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T02:33:49.719 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:49 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:49.459+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:49.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:49 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:49.459+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:49.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:49 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:49.459+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:49.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:49 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:49.459+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:49.720 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:49 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:49.459+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:49.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:49.605+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:49.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:49.605+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:49.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:49.605+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:49.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:49.605+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:49.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:49 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:49.605+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:50.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:50 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:50.205+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:50.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:50 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:50.205+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:50.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:50 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:50.205+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:50.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:50 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:50.205+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:33:50.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:50 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:50.087+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:50.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:50 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:50.087+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:50.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:50 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:50.087+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:50.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:50 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:50.087+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:17.065171+0000 front 2024-06-13T02:33:17.065066+0000 (oldest deadline 2024-06-13T02:33:42.964893+0000) 2024-06-13T02:33:50.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:50 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:50.624+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:50.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:50 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:50.624+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:50.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:50 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:50.624+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:50.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:50 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:50.624+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:50.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:50 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:50.624+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:50.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:50 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:50.624+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:25.229832+0000 front 2024-06-13T02:33:25.229765+0000 (oldest deadline 2024-06-13T02:33:49.930031+0000) 2024-06-13T02:33:50.969 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:50 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:50.506+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:50.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:50 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:50.506+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:50.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:50 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:50.506+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:50.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:50 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:50.506+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:50.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:50 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:50.506+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:51.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:51 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:51.128+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:51.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:51 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:51.128+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:51.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:51 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:51.128+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:51.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:51 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:51.128+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:17.065171+0000 front 2024-06-13T02:33:17.065066+0000 (oldest deadline 2024-06-13T02:33:42.964893+0000) 2024-06-13T02:33:51.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:51 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:51.234+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:51.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:51 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:51.234+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:51.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:51 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:51.234+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:51.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:51 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:51.234+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:33:51.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:51 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:51.601+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:51.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:51 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:51.601+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:51.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:51 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:51.601+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:51.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:51 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:51.601+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:51.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:51 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:51.601+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:51.881 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:51 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:51.601+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:25.229832+0000 front 2024-06-13T02:33:25.229765+0000 (oldest deadline 2024-06-13T02:33:49.930031+0000) 2024-06-13T02:33:51.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:51 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:51.477+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:51.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:51 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:51.477+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:51.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:51 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:51.477+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:51.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:51 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:51.477+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:51.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:51 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:51.477+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:51.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:51 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:51.477+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:33:52.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:52 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:52.259+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:52.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:52 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:52.259+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:52.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:52 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:52.259+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:52.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:52 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:52.259+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:33:52.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:52 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:52.120+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:52.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:52 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:52.120+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:52.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:52 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:52.120+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:52.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:52 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:52.120+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:17.065171+0000 front 2024-06-13T02:33:17.065066+0000 (oldest deadline 2024-06-13T02:33:42.964893+0000) 2024-06-13T02:33:52.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:52 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:52.120+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.166217+0000 front 2024-06-13T02:33:28.166257+0000 (oldest deadline 2024-06-13T02:33:51.666327+0000) 2024-06-13T02:33:52.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:52 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:52.521+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:52.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:52 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:52.521+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:52.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:52 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:52.521+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:52.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:52 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:52.521+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:52.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:52 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:52.521+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:52.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:52 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:52.521+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:33:53.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:52 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:52.638+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:53.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:52 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:52.638+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:53.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:52 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:52.638+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:53.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:52 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:52.638+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:53.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:52 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:52.638+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:53.131 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:52 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:52.638+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:25.229832+0000 front 2024-06-13T02:33:25.229765+0000 (oldest deadline 2024-06-13T02:33:49.930031+0000) 2024-06-13T02:33:53.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:53 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:53.155+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:53.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:53 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:53.156+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:53.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:53 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:53.156+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:53.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:53 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:53.156+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:17.065171+0000 front 2024-06-13T02:33:17.065066+0000 (oldest deadline 2024-06-13T02:33:42.964893+0000) 2024-06-13T02:33:53.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:53 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:53.156+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.166217+0000 front 2024-06-13T02:33:28.166257+0000 (oldest deadline 2024-06-13T02:33:51.666327+0000) 2024-06-13T02:33:53.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:53 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:53.255+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:53.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:53 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:53.255+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:53.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:53 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:53.255+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:53.534 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:53 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:53.255+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:33:53.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:53 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:53.617+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:53.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:53 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:53.617+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:53.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:53 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:53.617+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:53.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:53 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:53.617+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:53.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:53 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:53.617+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:53.881 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:53 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:53.617+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:25.229832+0000 front 2024-06-13T02:33:25.229765+0000 (oldest deadline 2024-06-13T02:33:49.930031+0000) 2024-06-13T02:33:53.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:53 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:53.519+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:53.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:53 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:53.519+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:53.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:53 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:53.519+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:53.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:53 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:53.519+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:53.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:53 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:53.519+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:53.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:53 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:53.519+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:33:54.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:54 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:54.193+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.459799+0000 front 2024-06-13T02:32:44.459465+0000 (oldest deadline 2024-06-13T02:33:07.359363+0000) 2024-06-13T02:33:54.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:54 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:54.193+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:01.862786+0000 front 2024-06-13T02:33:01.862828+0000 (oldest deadline 2024-06-13T02:33:27.162895+0000) 2024-06-13T02:33:54.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:54 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:54.193+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:10.064191+0000 front 2024-06-13T02:33:10.064317+0000 (oldest deadline 2024-06-13T02:33:34.164036+0000) 2024-06-13T02:33:54.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:54 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:54.193+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:17.065171+0000 front 2024-06-13T02:33:17.065066+0000 (oldest deadline 2024-06-13T02:33:42.964893+0000) 2024-06-13T02:33:54.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:54 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8[55431]: 2024-06-13T02:33:54.193+0000 7f1f3b481700 -1 osd.8 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.166217+0000 front 2024-06-13T02:33:28.166257+0000 (oldest deadline 2024-06-13T02:33:51.666327+0000) 2024-06-13T02:33:54.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:54 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:54.217+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:54.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:54 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:54.217+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:54.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:54 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:54.217+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:54.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:54 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:54.217+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:33:54.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:54 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:54.217+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:33:54.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:54 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:54.550+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:54.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:54 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:54.550+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:54.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:54 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:54.550+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:54.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:54 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:54.550+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:54.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:54 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:54.550+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:54.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:54 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:54.550+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:33:55.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:54 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:54.639+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:55.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:54 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:54.639+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:55.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:54 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:54.639+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:55.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:54 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:54.639+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:55.131 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:54 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:54.639+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:55.131 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:54 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:54.639+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:25.229832+0000 front 2024-06-13T02:33:25.229765+0000 (oldest deadline 2024-06-13T02:33:49.930031+0000) 2024-06-13T02:33:55.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:55 smithi175 podman[74939]: 2024-06-13 02:33:55.216455059 +0000 UTC m=+5.621195650 container died da219d68e19216e44225453603858d9b8392de9d674f3838ad0c2ad6dd0f8375 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_CLEAN=True) 2024-06-13T02:33:55.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:55 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:55.245+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:55.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:55 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:55.245+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:55.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:55 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:55.245+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:55.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:55 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:55.245+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:33:55.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:55 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:55.245+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:33:55.850 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:55 smithi175 podman[74939]: 2024-06-13 02:33:55.641343507 +0000 UTC m=+6.046084098 container cleanup da219d68e19216e44225453603858d9b8392de9d674f3838ad0c2ad6dd0f8375 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T02:33:55.851 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:55 smithi175 bash[74939]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8 2024-06-13T02:33:55.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:55 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:55.570+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:55.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:55 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:55.570+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:55.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:55 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:55.570+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:55.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:55 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:55.570+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:55.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:55 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:55.570+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:55.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:55 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:55.570+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:33:56.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:55 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:55.650+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:56.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:55 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:55.650+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:56.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:55 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:55.650+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:56.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:55 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:55.650+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:56.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:55 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:55.650+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:56.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:55 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:55.650+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:25.229832+0000 front 2024-06-13T02:33:25.229765+0000 (oldest deadline 2024-06-13T02:33:49.930031+0000) 2024-06-13T02:33:56.264 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:55 smithi175 podman[74954]: 2024-06-13 02:33:55.850947487 +0000 UTC m=+0.634034602 container remove da219d68e19216e44225453603858d9b8392de9d674f3838ad0c2ad6dd0f8375 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-06-13T02:33:56.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:56 smithi175 podman[75043]: 2024-06-13 02:33:56.167999901 +0000 UTC m=+0.017333903 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:33:56.532 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:56 smithi175 podman[75043]: 2024-06-13 02:33:56.285211491 +0000 UTC m=+0.134545534 container create e28c11fcdcd5e722c73279a7ac77a9c29a6715483ebe05e4b9b4d2d70418100d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8-deactivate, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T02:33:56.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:56 smithi175 podman[75043]: 2024-06-13 02:33:56.479245763 +0000 UTC m=+0.328579764 container init e28c11fcdcd5e722c73279a7ac77a9c29a6715483ebe05e4b9b4d2d70418100d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-06-13T02:33:56.533 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:56 smithi175 podman[75043]: 2024-06-13 02:33:56.482386001 +0000 UTC m=+0.331719994 container start e28c11fcdcd5e722c73279a7ac77a9c29a6715483ebe05e4b9b4d2d70418100d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-06-13T02:33:56.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:56 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:56.271+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:56.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:56 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:56.271+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:56.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:56 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:56.271+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:56.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:56 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:56.271+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:33:56.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:56 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:56.271+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:33:56.871 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:56 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:56.529+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:56.871 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:56 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:56.529+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:56.871 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:56 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:56.529+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:56.871 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:56 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:56.529+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:56.872 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:56 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:56.529+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:56.872 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:56 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:56.529+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:33:57.031 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:56 smithi175 podman[75043]: 2024-06-13 02:33:56.579262545 +0000 UTC m=+0.428596548 container attach e28c11fcdcd5e722c73279a7ac77a9c29a6715483ebe05e4b9b4d2d70418100d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc) 2024-06-13T02:33:57.032 INFO:journalctl@ceph.osd.8.smithi175.stdout:Jun 13 02:33:56 smithi175 podman[75043]: 2024-06-13 02:33:56.777178373 +0000 UTC m=+0.626512375 container died e28c11fcdcd5e722c73279a7ac77a9c29a6715483ebe05e4b9b4d2d70418100d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-8-deactivate, RELEASE=squid-3d89acc, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-06-13T02:33:57.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:56.699+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:57.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:56.699+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:57.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:56.699+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:57.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:56.699+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:57.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:56.699+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:57.131 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:56 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:56.699+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:25.229832+0000 front 2024-06-13T02:33:25.229765+0000 (oldest deadline 2024-06-13T02:33:49.930031+0000) 2024-06-13T02:33:57.399 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:57 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:57.269+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:57.399 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:57 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:57.269+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:57.399 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:57 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:57.269+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:57.399 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:57 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:57.269+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:33:57.399 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:57 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:57.269+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:33:57.418 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.8.service' 2024-06-13T02:33:57.497 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:33:57.498 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-06-13T02:33:57.498 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-06-13T02:33:57.499 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.9 2024-06-13T02:33:57.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:57 smithi002 systemd[1]: Stopping Ceph osd.9 for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:33:57.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:57 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:57.671+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:57.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:57 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:57.671+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:57.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:57 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:57.671+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:57.880 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:57 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:57.671+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:57.881 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:57 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:57.671+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:57.881 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:57 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:57.671+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:25.229832+0000 front 2024-06-13T02:33:25.229765+0000 (oldest deadline 2024-06-13T02:33:49.930031+0000) 2024-06-13T02:33:57.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:57 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:57.573+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:57.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:57 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:57.573+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:57.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:57 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:57.573+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:57.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:57 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:57.573+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:57.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:57 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:57.573+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:57.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:57 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:57.573+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:33:58.379 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:58 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:58.095+0000 7fa1b1200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:33:58.380 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:58 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:58.095+0000 7fa1b1200700 -1 osd.9 127 *** Got signal Terminated *** 2024-06-13T02:33:58.380 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:58 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:58.095+0000 7fa1b1200700 -1 osd.9 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T02:33:58.531 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:58 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:58.238+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:58.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:58 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:58.238+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:58.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:58 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:58.238+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:58.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:58 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:58.238+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:33:58.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:58 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:58.238+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:33:58.969 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:58 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:58.592+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:58.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:58 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:58.592+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:58.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:58 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:58.592+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:58.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:58 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:58.592+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:58.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:58 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:58.592+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:58.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:58 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:58.592+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:33:59.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:58 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:58.709+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:33:59.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:58 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:58.709+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:33:59.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:58 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:58.709+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:33:59.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:58 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:58.709+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:33:59.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:58 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:58.709+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:33:59.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:58 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:58.709+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:25.229832+0000 front 2024-06-13T02:33:25.229765+0000 (oldest deadline 2024-06-13T02:33:49.930031+0000) 2024-06-13T02:33:59.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:59 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:59.212+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:33:59.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:59 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:59.212+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:33:59.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:59 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:59.212+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:33:59.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:59 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:59.212+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:33:59.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:33:59 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:33:59.212+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:33:59.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:59 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:59.587+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:33:59.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:59 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:59.587+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:33:59.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:59 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:59.587+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:33:59.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:59 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:59.587+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:33:59.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:59 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:59.587+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:33:59.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:33:59 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:33:59.587+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:34:00.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:59 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:59.727+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:34:00.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:59 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:59.727+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:34:00.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:59 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:59.727+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:34:00.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:59 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:59.727+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:34:00.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:59 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:59.727+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:34:00.131 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:33:59 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:33:59.727+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:25.229832+0000 front 2024-06-13T02:33:25.229765+0000 (oldest deadline 2024-06-13T02:33:49.930031+0000) 2024-06-13T02:34:00.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:00 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:00.246+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:00.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:00 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:00.246+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:00.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:00 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:00.246+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:00.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:00 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:00.246+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:00.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:00 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:00.246+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:00.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:00 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:00.629+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:34:00.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:00 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:00.629+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:34:00.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:00 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:00.629+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:34:00.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:00 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:00.629+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:34:00.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:00 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:00.629+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:34:00.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:00 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:00.629+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:34:00.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:00 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:00.629+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.393581+0000 front 2024-06-13T02:33:33.393500+0000 (oldest deadline 2024-06-13T02:33:59.793497+0000) 2024-06-13T02:34:01.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:00 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:00.733+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:34:01.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:00 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:00.733+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:34:01.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:00 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:00.733+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:34:01.131 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:00 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:00.733+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:34:01.131 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:00 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:00.733+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:34:01.131 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:00 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:00.733+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:25.229832+0000 front 2024-06-13T02:33:25.229765+0000 (oldest deadline 2024-06-13T02:33:49.930031+0000) 2024-06-13T02:34:01.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:01 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:01.257+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:01.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:01 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:01.257+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:01.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:01 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:01.257+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:01.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:01 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:01.257+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:01.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:01 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:01.257+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:01.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:01 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:01.669+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:34:01.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:01 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:01.669+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:34:01.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:01 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:01.669+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:34:01.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:01 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:01.669+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:34:01.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:01 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:01.669+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:34:01.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:01 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:01.669+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:34:01.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:01 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:01.669+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.393581+0000 front 2024-06-13T02:33:33.393500+0000 (oldest deadline 2024-06-13T02:33:59.793497+0000) 2024-06-13T02:34:02.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:01 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:01.771+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:34:02.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:01 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:01.771+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:34:02.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:01 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:01.771+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:34:02.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:01 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:01.771+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:34:02.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:01 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:01.771+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:34:02.131 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:01 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:01.771+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:25.229832+0000 front 2024-06-13T02:33:25.229765+0000 (oldest deadline 2024-06-13T02:33:49.930031+0000) 2024-06-13T02:34:02.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:02 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:02.258+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:02.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:02 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:02.258+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:02.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:02 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:02.258+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:02.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:02 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:02.258+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:02.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:02 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:02.258+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:02.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:02 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:02.636+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:34:02.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:02 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:02.636+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:34:02.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:02 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:02.636+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:34:02.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:02 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:02.636+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:34:02.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:02 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:02.636+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:34:02.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:02 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:02.636+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:34:02.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:02 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:02.636+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.393581+0000 front 2024-06-13T02:33:33.393500+0000 (oldest deadline 2024-06-13T02:33:59.793497+0000) 2024-06-13T02:34:03.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:02 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:02.820+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.915745+0000 front 2024-06-13T02:32:45.915309+0000 (oldest deadline 2024-06-13T02:33:09.915530+0000) 2024-06-13T02:34:03.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:02 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:02.820+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:55.718947+0000 front 2024-06-13T02:32:55.718622+0000 (oldest deadline 2024-06-13T02:33:16.218727+0000) 2024-06-13T02:34:03.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:02 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:02.820+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.221605+0000 front 2024-06-13T02:33:03.221954+0000 (oldest deadline 2024-06-13T02:33:26.121426+0000) 2024-06-13T02:34:03.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:02 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:02.820+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.425111+0000 front 2024-06-13T02:33:09.425672+0000 (oldest deadline 2024-06-13T02:33:34.124766+0000) 2024-06-13T02:34:03.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:02 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:02.820+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.227165+0000 front 2024-06-13T02:33:18.227125+0000 (oldest deadline 2024-06-13T02:33:42.927286+0000) 2024-06-13T02:34:03.131 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:02 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9[64559]: 2024-06-13T02:34:02.820+0000 7fa1aca00700 -1 osd.9 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:25.229832+0000 front 2024-06-13T02:33:25.229765+0000 (oldest deadline 2024-06-13T02:33:49.930031+0000) 2024-06-13T02:34:03.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:03 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:03.275+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:03.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:03 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:03.275+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:03.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:03 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:03.275+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:03.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:03 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:03.275+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:03.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:03 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:03.275+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:03.533 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:03 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:03.275+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:03.929 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:03 smithi002 podman[99032]: 2024-06-13 02:34:03.647556583 +0000 UTC m=+5.689480727 container died 01b3692abf9c9ec98fa9af1d5290199fc6d4c14ad2b7d64994b624c57ce0224e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-06-13T02:34:03.969 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:03 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:03.670+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:34:03.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:03 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:03.670+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:34:03.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:03 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:03.670+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:34:03.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:03 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:03.670+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:34:03.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:03 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:03.670+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:34:03.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:03 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:03.670+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:34:03.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:03 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:03.670+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.393581+0000 front 2024-06-13T02:33:33.393500+0000 (oldest deadline 2024-06-13T02:33:59.793497+0000) 2024-06-13T02:34:04.226 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:04 smithi002 podman[99032]: 2024-06-13 02:34:04.054750556 +0000 UTC m=+6.096674730 container cleanup 01b3692abf9c9ec98fa9af1d5290199fc6d4c14ad2b7d64994b624c57ce0224e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux ) 2024-06-13T02:34:04.226 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:04 smithi002 bash[99032]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9 2024-06-13T02:34:04.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:04 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:04.274+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:04.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:04 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:04.274+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:04.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:04 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:04.274+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:04.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:04 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:04.274+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:04.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:04 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:04.274+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:04.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:04 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:04.274+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:04.629 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:04 smithi002 podman[99050]: 2024-06-13 02:34:04.222295968 +0000 UTC m=+0.552748381 container remove 01b3692abf9c9ec98fa9af1d5290199fc6d4c14ad2b7d64994b624c57ce0224e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc) 2024-06-13T02:34:04.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:04 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:04.630+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:34:04.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:04 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:04.630+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:34:04.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:04 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:04.630+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:34:04.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:04 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:04.630+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:34:04.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:04 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:04.630+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:34:04.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:04 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:04.630+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:34:04.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:04 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:04.630+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.393581+0000 front 2024-06-13T02:33:33.393500+0000 (oldest deadline 2024-06-13T02:33:59.793497+0000) 2024-06-13T02:34:05.380 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:05 smithi002 podman[99140]: 2024-06-13 02:34:05.012488318 +0000 UTC m=+0.032229800 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:34:05.380 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:05 smithi002 podman[99140]: 2024-06-13 02:34:05.131257526 +0000 UTC m=+0.150999021 container create 5baa78da0028476aaa5bb0ad60e0ef5e512e6de7f1890af511d78c488eda1079 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_CLEAN=True, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-06-13T02:34:05.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:05 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:05.320+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:05.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:05 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:05.320+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:05.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:05 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:05.320+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:05.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:05 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:05.320+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:05.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:05 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:05.320+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:05.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:05 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:05.320+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:05.863 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:05 smithi002 podman[99140]: 2024-06-13 02:34:05.385092299 +0000 UTC m=+0.404833862 container init 5baa78da0028476aaa5bb0ad60e0ef5e512e6de7f1890af511d78c488eda1079 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-3d89acc, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-06-13T02:34:05.863 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:05 smithi002 podman[99140]: 2024-06-13 02:34:05.396306681 +0000 UTC m=+0.416048206 container start 5baa78da0028476aaa5bb0ad60e0ef5e512e6de7f1890af511d78c488eda1079 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9-deactivate, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-06-13T02:34:05.863 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:05 smithi002 podman[99140]: 2024-06-13 02:34:05.47553575 +0000 UTC m=+0.495277249 container attach 5baa78da0028476aaa5bb0ad60e0ef5e512e6de7f1890af511d78c488eda1079 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, CEPH_POINT_RELEASE=) 2024-06-13T02:34:05.969 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:05 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:05.623+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:34:05.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:05 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:05.623+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:34:05.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:05 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:05.623+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:34:05.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:05 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:05.623+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:34:05.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:05 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:05.623+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:34:05.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:05 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:05.623+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:34:05.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:05 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:05.623+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.393581+0000 front 2024-06-13T02:33:33.393500+0000 (oldest deadline 2024-06-13T02:33:59.793497+0000) 2024-06-13T02:34:06.130 INFO:journalctl@ceph.osd.9.smithi002.stdout:Jun 13 02:34:05 smithi002 podman[99169]: 2024-06-13 02:34:05.921225026 +0000 UTC m=+0.038240358 container died 5baa78da0028476aaa5bb0ad60e0ef5e512e6de7f1890af511d78c488eda1079 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-06-13T02:34:06.507 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.9.service' 2024-06-13T02:34:06.608 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:34:06.608 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-06-13T02:34:06.608 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-06-13T02:34:06.609 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.10 2024-06-13T02:34:06.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:06 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:06.334+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:06.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:06 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:06.334+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:06.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:06 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:06.334+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:06.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:06 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:06.334+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:06.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:06 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:06.334+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:06.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:06 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:06.334+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:06.901 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:06 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:06.575+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:34:06.901 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:06 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:06.575+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:34:06.901 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:06 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:06.575+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:34:06.901 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:06 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:06.575+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:34:06.901 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:06 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:06.575+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:34:06.901 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:06 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:06.575+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:34:06.902 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:06 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:06.575+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.393581+0000 front 2024-06-13T02:33:33.393500+0000 (oldest deadline 2024-06-13T02:33:59.793497+0000) 2024-06-13T02:34:06.902 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:06 smithi084 systemd[1]: Stopping Ceph osd.10 for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:34:07.219 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:06 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:06.900+0000 7f99eaa68700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:34:07.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:06 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:06.900+0000 7f99eaa68700 -1 osd.10 127 *** Got signal Terminated *** 2024-06-13T02:34:07.220 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:06 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:06.900+0000 7f99eaa68700 -1 osd.10 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T02:34:07.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:07 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:07.302+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:07.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:07 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:07.302+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:07.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:07 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:07.302+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:07.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:07 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:07.302+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:07.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:07 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:07.302+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:07.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:07 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:07.302+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:07.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:07 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:07.529+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:34:07.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:07 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:07.529+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:34:07.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:07 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:07.529+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:34:07.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:07 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:07.529+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:34:07.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:07 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:07.529+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:34:07.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:07 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:07.529+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:34:07.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:07 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:07.529+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.393581+0000 front 2024-06-13T02:33:33.393500+0000 (oldest deadline 2024-06-13T02:33:59.793497+0000) 2024-06-13T02:34:08.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:08 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:08.329+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:08.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:08 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:08.329+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:08.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:08 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:08.329+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:08.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:08 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:08.329+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:08.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:08 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:08.329+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:08.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:08 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:08.329+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:08.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:08 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:08.517+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:34:08.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:08 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:08.517+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:34:08.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:08 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:08.517+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:34:08.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:08 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:08.517+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:34:08.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:08 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:08.517+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:34:08.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:08 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:08.517+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:34:08.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:08 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:08.517+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.393581+0000 front 2024-06-13T02:33:33.393500+0000 (oldest deadline 2024-06-13T02:33:59.793497+0000) 2024-06-13T02:34:09.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:09 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:09.357+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:09.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:09 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:09.357+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:09.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:09 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:09.357+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:09.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:09 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:09.357+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:09.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:09 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:09.357+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:09.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:09 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:09.357+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:09.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:09 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:09.357+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-06-13T02:33:43.683832+0000 front 2024-06-13T02:33:43.683770+0000 (oldest deadline 2024-06-13T02:34:08.383827+0000) 2024-06-13T02:34:09.969 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:09 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:09.546+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:34:09.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:09 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:09.546+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:34:09.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:09 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:09.546+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:34:09.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:09 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:09.546+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:34:09.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:09 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:09.546+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:34:09.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:09 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:09.546+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:34:09.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:09 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:09.546+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.393581+0000 front 2024-06-13T02:33:33.393500+0000 (oldest deadline 2024-06-13T02:33:59.793497+0000) 2024-06-13T02:34:10.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:10 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:10.364+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:10.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:10 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:10.364+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:10.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:10 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:10.364+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:10.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:10 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:10.364+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:10.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:10 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:10.364+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:10.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:10 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:10.364+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:10.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:10 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:10.364+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-06-13T02:33:43.683832+0000 front 2024-06-13T02:33:43.683770+0000 (oldest deadline 2024-06-13T02:34:08.383827+0000) 2024-06-13T02:34:10.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:10 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:10.560+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:34:10.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:10 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:10.560+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:34:10.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:10 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:10.560+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:34:10.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:10 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:10.560+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:34:10.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:10 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:10.560+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:34:10.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:10 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:10.560+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:34:10.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:10 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:10.560+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.393581+0000 front 2024-06-13T02:33:33.393500+0000 (oldest deadline 2024-06-13T02:33:59.793497+0000) 2024-06-13T02:34:11.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:11 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:11.384+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:11.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:11 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:11.384+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:11.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:11 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:11.384+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:11.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:11 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:11.384+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:11.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:11 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:11.384+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:11.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:11 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:11.384+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:11.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:11 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:11.384+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-06-13T02:33:43.683832+0000 front 2024-06-13T02:33:43.683770+0000 (oldest deadline 2024-06-13T02:34:08.383827+0000) 2024-06-13T02:34:11.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:11 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:11.538+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:45.785863+0000 front 2024-06-13T02:32:45.786012+0000 (oldest deadline 2024-06-13T02:33:11.685774+0000) 2024-06-13T02:34:11.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:11 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:11.538+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6804 osd.1 since back 2024-06-13T02:32:54.586756+0000 front 2024-06-13T02:32:54.586716+0000 (oldest deadline 2024-06-13T02:33:19.286819+0000) 2024-06-13T02:34:11.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:11 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:11.538+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:03.387806+0000 front 2024-06-13T02:33:03.387935+0000 (oldest deadline 2024-06-13T02:33:25.087683+0000) 2024-06-13T02:34:11.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:11 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:11.538+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:11.489454+0000 front 2024-06-13T02:33:11.489576+0000 (oldest deadline 2024-06-13T02:33:35.589125+0000) 2024-06-13T02:34:11.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:11 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:11.538+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:18.489890+0000 front 2024-06-13T02:33:18.489906+0000 (oldest deadline 2024-06-13T02:33:43.789992+0000) 2024-06-13T02:34:11.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:11 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:11.538+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:28.291617+0000 front 2024-06-13T02:33:28.291739+0000 (oldest deadline 2024-06-13T02:33:50.591680+0000) 2024-06-13T02:34:11.971 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:11 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10[61885]: 2024-06-13T02:34:11.538+0000 7f99e705c700 -1 osd.10 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.393581+0000 front 2024-06-13T02:33:33.393500+0000 (oldest deadline 2024-06-13T02:33:59.793497+0000) 2024-06-13T02:34:12.649 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:12 smithi084 podman[76051]: 2024-06-13 02:34:12.399358224 +0000 UTC m=+5.598661197 container died d62a54f3fe8dcde54ed3f2d3ca79d40fe2ca8f55853cac6974d692cad9e0730f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240528, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T02:34:12.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:12.359+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:12.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:12.359+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:12.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:12.359+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:12.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:12.359+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:12.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:12.359+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:12.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:12.359+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:12.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:12 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:12.359+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-06-13T02:33:43.683832+0000 front 2024-06-13T02:33:43.683770+0000 (oldest deadline 2024-06-13T02:34:08.383827+0000) 2024-06-13T02:34:12.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:12 smithi084 podman[76051]: 2024-06-13 02:34:12.758141944 +0000 UTC m=+5.957444918 container cleanup d62a54f3fe8dcde54ed3f2d3ca79d40fe2ca8f55853cac6974d692cad9e0730f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T02:34:12.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:12 smithi084 bash[76051]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10 2024-06-13T02:34:13.430 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:13 smithi084 podman[76067]: 2024-06-13 02:34:13.068061715 +0000 UTC m=+0.665220988 container remove d62a54f3fe8dcde54ed3f2d3ca79d40fe2ca8f55853cac6974d692cad9e0730f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True) 2024-06-13T02:34:13.695 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:13 smithi084 podman[76156]: 2024-06-13 02:34:13.333935512 +0000 UTC m=+0.017040333 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:34:13.695 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:13 smithi084 podman[76156]: 2024-06-13 02:34:13.435367919 +0000 UTC m=+0.118472738 container create 5e75df14fdbf385a28fd03b02c4bab8855c6b97690f636bbc787953a30066d30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10-deactivate, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T02:34:13.695 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:13 smithi084 podman[76156]: 2024-06-13 02:34:13.620972726 +0000 UTC m=+0.304077547 container init 5e75df14fdbf385a28fd03b02c4bab8855c6b97690f636bbc787953a30066d30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-06-13T02:34:13.695 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:13 smithi084 podman[76156]: 2024-06-13 02:34:13.623940745 +0000 UTC m=+0.307045575 container start 5e75df14fdbf385a28fd03b02c4bab8855c6b97690f636bbc787953a30066d30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528) 2024-06-13T02:34:13.695 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:13 smithi084 podman[76156]: 2024-06-13 02:34:13.695803665 +0000 UTC m=+0.378908498 container attach 5e75df14fdbf385a28fd03b02c4bab8855c6b97690f636bbc787953a30066d30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True) 2024-06-13T02:34:13.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:13 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:13.333+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:13.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:13 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:13.333+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:13.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:13 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:13.333+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:13.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:13 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:13.333+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:13.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:13 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:13.333+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:13.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:13 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:13.333+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:13.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:13 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:13.333+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-06-13T02:33:43.683832+0000 front 2024-06-13T02:33:43.683770+0000 (oldest deadline 2024-06-13T02:34:08.383827+0000) 2024-06-13T02:34:13.970 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:13 smithi084 podman[76156]: 2024-06-13 02:34:13.912650239 +0000 UTC m=+0.595755060 container died 5e75df14fdbf385a28fd03b02c4bab8855c6b97690f636bbc787953a30066d30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD) 2024-06-13T02:34:14.442 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.10.service' 2024-06-13T02:34:14.464 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:14 smithi084 podman[76182]: 2024-06-13 02:34:14.423768334 +0000 UTC m=+0.506057018 container remove 5e75df14fdbf385a28fd03b02c4bab8855c6b97690f636bbc787953a30066d30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-06-13T02:34:14.464 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:14 smithi084 systemd[1]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.10.service: Deactivated successfully. 2024-06-13T02:34:14.465 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:14 smithi084 systemd[1]: Stopped Ceph osd.10 for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:34:14.465 INFO:journalctl@ceph.osd.10.smithi084.stdout:Jun 13 02:34:14 smithi084 systemd[1]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.10.service: Consumed 1min 55.070s CPU time. 2024-06-13T02:34:14.479 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:34:14.479 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-06-13T02:34:14.480 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-06-13T02:34:14.480 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.11 2024-06-13T02:34:14.776 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:14 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:14.297+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:14.776 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:14 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:14.297+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:14.776 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:14 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:14.297+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:14.776 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:14 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:14.297+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:14.776 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:14 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:14.297+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:14.777 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:14 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:14.297+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:14.777 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:14 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:14.297+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-06-13T02:33:43.683832+0000 front 2024-06-13T02:33:43.683770+0000 (oldest deadline 2024-06-13T02:34:08.383827+0000) 2024-06-13T02:34:14.777 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:14 smithi175 systemd[1]: Stopping Ceph osd.11 for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:34:14.777 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:14 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:14.775+0000 7f9358240700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:34:14.777 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:14 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:14.775+0000 7f9358240700 -1 osd.11 127 *** Got signal Terminated *** 2024-06-13T02:34:14.777 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:14 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:14.775+0000 7f9358240700 -1 osd.11 127 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-13T02:34:15.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:15 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:15.327+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:15.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:15 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:15.327+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:15.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:15 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:15.327+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:15.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:15 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:15.327+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:15.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:15 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:15.327+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:15.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:15 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:15.327+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:15.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:15 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:15.327+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-06-13T02:33:43.683832+0000 front 2024-06-13T02:33:43.683770+0000 (oldest deadline 2024-06-13T02:34:08.383827+0000) 2024-06-13T02:34:15.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:15 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:15.327+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2024-06-13T02:33:54.185087+0000 front 2024-06-13T02:33:54.185132+0000 (oldest deadline 2024-06-13T02:34:15.285147+0000) 2024-06-13T02:34:16.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:16 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:16.335+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:16.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:16 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:16.335+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:16.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:16 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:16.335+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:16.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:16 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:16.335+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:16.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:16 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:16.335+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:16.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:16 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:16.335+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:16.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:16 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:16.335+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-06-13T02:33:43.683832+0000 front 2024-06-13T02:33:43.683770+0000 (oldest deadline 2024-06-13T02:34:08.383827+0000) 2024-06-13T02:34:16.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:16 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:16.335+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2024-06-13T02:33:54.185087+0000 front 2024-06-13T02:33:54.185132+0000 (oldest deadline 2024-06-13T02:34:15.285147+0000) 2024-06-13T02:34:17.683 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:17 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:17.378+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:17.684 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:17 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:17.378+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:17.684 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:17 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:17.378+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:17.684 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:17 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:17.378+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:17.684 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:17 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:17.378+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:17.684 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:17 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:17.378+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:17.684 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:17 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:17.378+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-06-13T02:33:43.683832+0000 front 2024-06-13T02:33:43.683770+0000 (oldest deadline 2024-06-13T02:34:08.383827+0000) 2024-06-13T02:34:17.684 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:17 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:17.378+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2024-06-13T02:33:54.185087+0000 front 2024-06-13T02:33:54.185132+0000 (oldest deadline 2024-06-13T02:34:15.285147+0000) 2024-06-13T02:34:18.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:18 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:18.422+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:18.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:18 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:18.422+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:18.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:18 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:18.422+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:18.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:18 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:18.422+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:18.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:18 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:18.422+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:18.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:18 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:18.422+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:18.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:18 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:18.422+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-06-13T02:33:43.683832+0000 front 2024-06-13T02:33:43.683770+0000 (oldest deadline 2024-06-13T02:34:08.383827+0000) 2024-06-13T02:34:18.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:18 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:18.422+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2024-06-13T02:33:54.185087+0000 front 2024-06-13T02:33:54.185132+0000 (oldest deadline 2024-06-13T02:34:15.285147+0000) 2024-06-13T02:34:19.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:19 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:19.435+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6806 osd.0 since back 2024-06-13T02:32:44.973810+0000 front 2024-06-13T02:32:44.973753+0000 (oldest deadline 2024-06-13T02:33:10.873618+0000) 2024-06-13T02:34:19.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:19 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:19.435+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6804 osd.2 since back 2024-06-13T02:33:02.877577+0000 front 2024-06-13T02:33:02.877731+0000 (oldest deadline 2024-06-13T02:33:27.577738+0000) 2024-06-13T02:34:19.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:19 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:19.435+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6814 osd.3 since back 2024-06-13T02:33:09.278748+0000 front 2024-06-13T02:33:09.278776+0000 (oldest deadline 2024-06-13T02:33:33.978771+0000) 2024-06-13T02:34:19.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:19 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:19.435+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6812 osd.4 since back 2024-06-13T02:33:20.380174+0000 front 2024-06-13T02:33:20.380229+0000 (oldest deadline 2024-06-13T02:33:45.680112+0000) 2024-06-13T02:34:19.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:19 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:19.435+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6812 osd.5 since back 2024-06-13T02:33:29.081592+0000 front 2024-06-13T02:33:29.081659+0000 (oldest deadline 2024-06-13T02:33:53.781700+0000) 2024-06-13T02:34:19.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:19 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:19.435+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.2:6822 osd.6 since back 2024-06-13T02:33:33.782522+0000 front 2024-06-13T02:33:33.782373+0000 (oldest deadline 2024-06-13T02:34:02.582641+0000) 2024-06-13T02:34:19.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:19 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:19.435+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.84:6820 osd.7 since back 2024-06-13T02:33:43.683832+0000 front 2024-06-13T02:33:43.683770+0000 (oldest deadline 2024-06-13T02:34:08.383827+0000) 2024-06-13T02:34:19.783 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:19 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11[62002]: 2024-06-13T02:34:19.435+0000 7f9354834700 -1 osd.11 127 heartbeat_check: no reply from 172.21.15.175:6820 osd.8 since back 2024-06-13T02:33:54.185087+0000 front 2024-06-13T02:33:54.185132+0000 (oldest deadline 2024-06-13T02:34:15.285147+0000) 2024-06-13T02:34:20.532 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:20 smithi175 podman[75150]: 2024-06-13 02:34:20.212388361 +0000 UTC m=+5.528869069 container died 86a577b1819dca6c249d281cc4b48c5d4049e271b1e1e4d0e3fa45087270e2de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-13T02:34:21.031 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:20 smithi175 podman[75150]: 2024-06-13 02:34:20.533689496 +0000 UTC m=+5.850170204 container cleanup 86a577b1819dca6c249d281cc4b48c5d4049e271b1e1e4d0e3fa45087270e2de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T02:34:21.032 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:20 smithi175 bash[75150]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11 2024-06-13T02:34:21.032 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:20 smithi175 podman[75179]: 2024-06-13 02:34:20.768509468 +0000 UTC m=+0.554025571 container remove 86a577b1819dca6c249d281cc4b48c5d4049e271b1e1e4d0e3fa45087270e2de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-06-13T02:34:21.505 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:21 smithi175 podman[75266]: 2024-06-13 02:34:21.202429845 +0000 UTC m=+0.111671044 container create a52cc757bd0428b50ef279fad8979a1e04b3acaeeb31993163b63d3780f995d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11-deactivate, RELEASE=squid-3d89acc, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T02:34:21.505 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:21 smithi175 podman[75266]: 2024-06-13 02:34:21.107467475 +0000 UTC m=+0.016708676 image pull b045ac545f826a15724cc02d20333d2cc28f7e0eeb5a24d748d09a02280116e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9 2024-06-13T02:34:21.506 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:21 smithi175 podman[75266]: 2024-06-13 02:34:21.412938831 +0000 UTC m=+0.322180030 container init a52cc757bd0428b50ef279fad8979a1e04b3acaeeb31993163b63d3780f995d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240528) 2024-06-13T02:34:21.506 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:21 smithi175 podman[75266]: 2024-06-13 02:34:21.416048821 +0000 UTC m=+0.325290020 container start a52cc757bd0428b50ef279fad8979a1e04b3acaeeb31993163b63d3780f995d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T02:34:21.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:21 smithi175 podman[75266]: 2024-06-13 02:34:21.505662159 +0000 UTC m=+0.414903367 container attach a52cc757bd0428b50ef279fad8979a1e04b3acaeeb31993163b63d3780f995d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T02:34:21.782 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:21 smithi175 podman[75266]: 2024-06-13 02:34:21.714246238 +0000 UTC m=+0.623487438 container died a52cc757bd0428b50ef279fad8979a1e04b3acaeeb31993163b63d3780f995d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T02:34:22.230 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.11.service' 2024-06-13T02:34:22.253 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:22 smithi175 podman[75293]: 2024-06-13 02:34:22.207711002 +0000 UTC m=+0.487913115 container remove a52cc757bd0428b50ef279fad8979a1e04b3acaeeb31993163b63d3780f995d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T02:34:22.253 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:22 smithi175 systemd[1]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.11.service: Deactivated successfully. 2024-06-13T02:34:22.253 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:22 smithi175 systemd[1]: Stopped Ceph osd.11 for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:34:22.253 INFO:journalctl@ceph.osd.11.smithi175.stdout:Jun 13 02:34:22 smithi175 systemd[1]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@osd.11.service: Consumed 2min 5.107s CPU time. 2024-06-13T02:34:22.268 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:34:22.268 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-06-13T02:34:22.268 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-06-13T02:34:22.268 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.a 2024-06-13T02:34:22.630 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:34:22 smithi002 systemd[1]: Stopping Ceph mds.a for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:34:23.130 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:34:22 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-a[71361]: 2024-06-13T02:34:22.870+0000 7f6801000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:34:23.130 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:34:22 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-a[71361]: 2024-06-13T02:34:22.870+0000 7f6801000700 -1 mds.a *** got signal Terminated *** 2024-06-13T02:34:25.517 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:34:25 smithi002 podman[99255]: 2024-06-13 02:34:25.2635533 +0000 UTC m=+2.517613986 container died 50d50d5421ccc17e0c6b62326ed4f8151f97452de564e734eb5f0284867c5009 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-3d89acc) 2024-06-13T02:34:25.865 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:34:25 smithi002 podman[99255]: 2024-06-13 02:34:25.663241741 +0000 UTC m=+2.917302424 container cleanup 50d50d5421ccc17e0c6b62326ed4f8151f97452de564e734eb5f0284867c5009 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-a, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T02:34:25.865 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:34:25 smithi002 bash[99255]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-a 2024-06-13T02:34:26.129 INFO:journalctl@ceph.mds.a.smithi002.stdout:Jun 13 02:34:25 smithi002 podman[99269]: 2024-06-13 02:34:25.864428707 +0000 UTC m=+0.585129281 container remove 50d50d5421ccc17e0c6b62326ed4f8151f97452de564e734eb5f0284867c5009 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_CLEAN=True) 2024-06-13T02:34:26.409 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.a.service' 2024-06-13T02:34:26.518 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:34:26.519 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-06-13T02:34:26.519 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-06-13T02:34:26.519 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.d 2024-06-13T02:34:27.130 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:34:26 smithi002 systemd[1]: Stopping Ceph mds.d for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:34:27.630 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:34:27 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-d[70163]: 2024-06-13T02:34:27.157+0000 7f858ae00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:34:27.630 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:34:27 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-d[70163]: 2024-06-13T02:34:27.157+0000 7f858ae00700 -1 mds.d *** got signal Terminated *** 2024-06-13T02:34:30.215 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:34:29 smithi002 podman[99376]: 2024-06-13 02:34:29.964023031 +0000 UTC m=+2.936999106 container died 17bbf117897870a9e86826802c301c7a1af5655dac673a6f8e019a25bb894d99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-06-13T02:34:30.629 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:34:30 smithi002 podman[99376]: 2024-06-13 02:34:30.316409308 +0000 UTC m=+3.289385413 container cleanup 17bbf117897870a9e86826802c301c7a1af5655dac673a6f8e019a25bb894d99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-06-13T02:34:30.630 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:34:30 smithi002 bash[99376]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-d 2024-06-13T02:34:31.124 INFO:journalctl@ceph.mds.d.smithi002.stdout:Jun 13 02:34:30 smithi002 podman[99390]: 2024-06-13 02:34:30.67572128 +0000 UTC m=+0.690541649 container remove 17bbf117897870a9e86826802c301c7a1af5655dac673a6f8e019a25bb894d99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-06-13T02:34:31.156 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.d.service' 2024-06-13T02:34:31.272 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:34:31.272 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-06-13T02:34:31.272 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-06-13T02:34:31.272 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.g 2024-06-13T02:34:31.629 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:34:31 smithi002 systemd[1]: Stopping Ceph mds.g for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:34:32.130 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:34:31 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-g[70955]: 2024-06-13T02:34:31.825+0000 7f1195400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:34:32.130 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:34:31 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-g[70955]: 2024-06-13T02:34:31.825+0000 7f1195400700 -1 mds.g *** got signal Terminated *** 2024-06-13T02:34:36.116 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:34:35 smithi002 podman[99495]: 2024-06-13 02:34:35.844228226 +0000 UTC m=+4.134688718 container died 2504394209ed9995ea607ae17bb9e530edf632fde676e49bf3d4410cce2df6ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-g, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-06-13T02:34:36.380 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:34:36 smithi002 podman[99495]: 2024-06-13 02:34:36.236444074 +0000 UTC m=+4.526904560 container cleanup 2504394209ed9995ea607ae17bb9e530edf632fde676e49bf3d4410cce2df6ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-3d89acc, org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-06-13T02:34:36.380 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:34:36 smithi002 bash[99495]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-g 2024-06-13T02:34:36.879 INFO:journalctl@ceph.mds.g.smithi002.stdout:Jun 13 02:34:36 smithi002 podman[99508]: 2024-06-13 02:34:36.596428178 +0000 UTC m=+0.730951380 container remove 2504394209ed9995ea607ae17bb9e530edf632fde676e49bf3d4410cce2df6ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-g, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-06-13T02:34:37.236 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.g.service' 2024-06-13T02:34:37.351 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:34:37.351 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-06-13T02:34:37.352 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-06-13T02:34:37.352 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.j 2024-06-13T02:34:37.879 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:34:37 smithi002 systemd[1]: Stopping Ceph mds.j for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:34:38.380 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:34:37 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-j[69762]: 2024-06-13T02:34:37.912+0000 7f11ea800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:34:38.380 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:34:37 smithi002 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-j[69762]: 2024-06-13T02:34:37.912+0000 7f11ea800700 -1 mds.j *** got signal Terminated *** 2024-06-13T02:34:41.879 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:34:41 smithi002 podman[99614]: 2024-06-13 02:34:41.590225525 +0000 UTC m=+3.790661876 container died 6db8fa3c9f76a197fe9e013cc0bbf4e7b1c6bfc2ebb4b960a88e1ac8faf0e06f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-j, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-06-13T02:34:42.129 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:34:41 smithi002 podman[99614]: 2024-06-13 02:34:41.991051303 +0000 UTC m=+4.191487653 container cleanup 6db8fa3c9f76a197fe9e013cc0bbf4e7b1c6bfc2ebb4b960a88e1ac8faf0e06f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-j, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-13T02:34:42.130 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:34:41 smithi002 bash[99614]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-j 2024-06-13T02:34:42.610 INFO:journalctl@ceph.mds.j.smithi002.stdout:Jun 13 02:34:42 smithi002 podman[99638]: 2024-06-13 02:34:42.160560797 +0000 UTC m=+0.555993768 container remove 6db8fa3c9f76a197fe9e013cc0bbf4e7b1c6bfc2ebb4b960a88e1ac8faf0e06f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-j, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-06-13T02:34:42.644 DEBUG:teuthology.orchestra.run.smithi002:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.j.service' 2024-06-13T02:34:42.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:34:42.758 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-06-13T02:34:42.759 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-06-13T02:34:42.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.b 2024-06-13T02:34:43.130 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:34:42 smithi084 systemd[1]: Stopping Ceph mds.b for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:34:43.395 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:34:43 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-b[67065]: 2024-06-13T02:34:43.129+0000 7ff742723700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:34:43.395 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:34:43 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-b[67065]: 2024-06-13T02:34:43.129+0000 7ff742723700 -1 mds.b *** got signal Terminated *** 2024-06-13T02:34:44.571 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:34:44 smithi084 podman[76262]: 2024-06-13 02:34:44.268063249 +0000 UTC m=+1.318595329 container died 3724c4a3dab648a9a3f62a03971eb480f601f1acc4a94d57acc2b6d99369c85b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-b, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240528, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-06-13T02:34:44.888 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:34:44 smithi084 podman[76262]: 2024-06-13 02:34:44.671333298 +0000 UTC m=+1.721865376 container cleanup 3724c4a3dab648a9a3f62a03971eb480f601f1acc4a94d57acc2b6d99369c85b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-06-13T02:34:44.888 INFO:journalctl@ceph.mds.b.smithi084.stdout:Jun 13 02:34:44 smithi084 bash[76262]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-b 2024-06-13T02:34:45.017 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.b.service' 2024-06-13T02:34:45.051 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:34:45.052 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-06-13T02:34:45.052 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-06-13T02:34:45.052 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.e 2024-06-13T02:34:45.219 INFO:journalctl@ceph.mds.e.smithi084.stdout:Jun 13 02:34:45 smithi084 systemd[1]: Stopping Ceph mds.e for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:34:45.720 INFO:journalctl@ceph.mds.e.smithi084.stdout:Jun 13 02:34:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-e[66456]: 2024-06-13T02:34:45.374+0000 7fc59efa3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:34:45.720 INFO:journalctl@ceph.mds.e.smithi084.stdout:Jun 13 02:34:45 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-e[66456]: 2024-06-13T02:34:45.374+0000 7fc59efa3700 -1 mds.e *** got signal Terminated *** 2024-06-13T02:34:48.542 INFO:journalctl@ceph.mds.e.smithi084.stdout:Jun 13 02:34:48 smithi084 podman[76395]: 2024-06-13 02:34:48.265809922 +0000 UTC m=+2.990921871 container died 630007b14c2ad6dbb804be022e7d45ab19af747de1039607cde5343e6131d6fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-e, RELEASE=squid-3d89acc, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T02:34:48.892 INFO:journalctl@ceph.mds.e.smithi084.stdout:Jun 13 02:34:48 smithi084 podman[76395]: 2024-06-13 02:34:48.633188559 +0000 UTC m=+3.358300517 container cleanup 630007b14c2ad6dbb804be022e7d45ab19af747de1039607cde5343e6131d6fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-06-13T02:34:48.892 INFO:journalctl@ceph.mds.e.smithi084.stdout:Jun 13 02:34:48 smithi084 bash[76395]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-e 2024-06-13T02:34:49.009 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.e.service' 2024-06-13T02:34:49.040 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:34:49.041 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-06-13T02:34:49.041 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-06-13T02:34:49.041 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.h 2024-06-13T02:34:49.219 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:34:49 smithi084 systemd[1]: Stopping Ceph mds.h for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:34:49.719 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:34:49 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: 2024-06-13T02:34:49.379+0000 7f957fae5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:34:49.720 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:34:49 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h[66759]: 2024-06-13T02:34:49.379+0000 7f957fae5700 -1 mds.h *** got signal Terminated *** 2024-06-13T02:34:52.594 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:34:52 smithi084 podman[76518]: 2024-06-13 02:34:52.247944647 +0000 UTC m=+2.990401877 container died fe5b048a23b10669cb2bd52aad21cab1593f36ad88700432ff2419591a0a7e2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-06-13T02:34:52.862 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:34:52 smithi084 podman[76518]: 2024-06-13 02:34:52.678269486 +0000 UTC m=+3.420726713 container cleanup fe5b048a23b10669cb2bd52aad21cab1593f36ad88700432ff2419591a0a7e2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h, io.buildah.version=1.33.5, RELEASE=squid-3d89acc, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528) 2024-06-13T02:34:52.862 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:34:52 smithi084 bash[76518]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h 2024-06-13T02:34:53.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.h.service' 2024-06-13T02:34:53.126 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:34:52 smithi084 podman[76532]: 2024-06-13 02:34:52.862568954 +0000 UTC m=+0.607579239 container remove fe5b048a23b10669cb2bd52aad21cab1593f36ad88700432ff2419591a0a7e2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-06-13T02:34:53.126 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:34:53 smithi084 systemd[1]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.h.service: Deactivated successfully. 2024-06-13T02:34:53.126 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:34:53 smithi084 systemd[1]: Stopped Ceph mds.h for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:34:53.126 INFO:journalctl@ceph.mds.h.smithi084.stdout:Jun 13 02:34:53 smithi084 systemd[1]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.h.service: Consumed 29.232s CPU time. 2024-06-13T02:34:53.136 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:34:53.137 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-06-13T02:34:53.137 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-06-13T02:34:53.137 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.k 2024-06-13T02:34:53.456 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:34:53 smithi084 systemd[1]: Stopping Ceph mds.k for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:34:53.719 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:34:53 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-k[66142]: 2024-06-13T02:34:53.455+0000 7f489241e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:34:53.720 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:34:53 smithi084 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-k[66142]: 2024-06-13T02:34:53.455+0000 7f489241e700 -1 mds.k *** got signal Terminated *** 2024-06-13T02:34:56.469 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:34:56 smithi084 podman[76638]: 2024-06-13 02:34:56.134197652 +0000 UTC m=+2.786504871 container died 320cc84d5724b64888dbe06dd6c0f0d60a23407cba27d06355ca18292f7a6c05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-06-13T02:34:56.748 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:34:56 smithi084 podman[76638]: 2024-06-13 02:34:56.556209635 +0000 UTC m=+3.208516851 container cleanup 320cc84d5724b64888dbe06dd6c0f0d60a23407cba27d06355ca18292f7a6c05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-k, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-06-13T02:34:56.748 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:34:56 smithi084 bash[76638]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-k 2024-06-13T02:34:56.985 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.k.service' 2024-06-13T02:34:57.004 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:34:56 smithi084 podman[76650]: 2024-06-13 02:34:56.748915799 +0000 UTC m=+0.528108268 container remove 320cc84d5724b64888dbe06dd6c0f0d60a23407cba27d06355ca18292f7a6c05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-k, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc) 2024-06-13T02:34:57.005 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:34:56 smithi084 systemd[1]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.k.service: Deactivated successfully. 2024-06-13T02:34:57.005 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:34:56 smithi084 systemd[1]: Stopped Ceph mds.k for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:34:57.005 INFO:journalctl@ceph.mds.k.smithi084.stdout:Jun 13 02:34:56 smithi084 systemd[1]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.k.service: Consumed 1.120s CPU time. 2024-06-13T02:34:57.015 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:34:57.015 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-06-13T02:34:57.015 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-06-13T02:34:57.015 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.c 2024-06-13T02:34:57.308 INFO:journalctl@ceph.mds.c.smithi175.stdout:Jun 13 02:34:57 smithi175 systemd[1]: Stopping Ceph mds.c for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:34:57.631 INFO:journalctl@ceph.mds.c.smithi175.stdout:Jun 13 02:34:57 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-c[67277]: 2024-06-13T02:34:57.306+0000 7fde2a08d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:34:57.631 INFO:journalctl@ceph.mds.c.smithi175.stdout:Jun 13 02:34:57 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-c[67277]: 2024-06-13T02:34:57.306+0000 7fde2a08d700 -1 mds.c *** got signal Terminated *** 2024-06-13T02:35:00.532 INFO:journalctl@ceph.mds.c.smithi175.stdout:Jun 13 02:35:00 smithi175 podman[75372]: 2024-06-13 02:35:00.247799883 +0000 UTC m=+3.043478007 container died 3615c7f1e0b87ccfd29538495c27c277db6b714585ae3b34b9c3bd4488bc6465 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-c, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-06-13T02:35:00.857 INFO:journalctl@ceph.mds.c.smithi175.stdout:Jun 13 02:35:00 smithi175 podman[75372]: 2024-06-13 02:35:00.615462519 +0000 UTC m=+3.411140650 container cleanup 3615c7f1e0b87ccfd29538495c27c277db6b714585ae3b34b9c3bd4488bc6465 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-06-13T02:35:00.858 INFO:journalctl@ceph.mds.c.smithi175.stdout:Jun 13 02:35:00 smithi175 bash[75372]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-c 2024-06-13T02:35:01.013 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.c.service' 2024-06-13T02:35:01.047 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:35:01.047 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-06-13T02:35:01.048 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-06-13T02:35:01.048 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.f 2024-06-13T02:35:01.403 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:35:01 smithi175 systemd[1]: Stopping Ceph mds.f for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:35:01.782 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:35:01 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-f[66973]: 2024-06-13T02:35:01.401+0000 7f690710c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:35:01.782 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:35:01 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-f[66973]: 2024-06-13T02:35:01.401+0000 7f690710c700 -1 mds.f *** got signal Terminated *** 2024-06-13T02:35:04.028 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:35:03 smithi175 podman[75504]: 2024-06-13 02:35:03.776930802 +0000 UTC m=+2.499188023 container died e81e240329d363e794e15416092478f651245ba9c183046208f26b28495ba374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-3d89acc, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, ceph=True) 2024-06-13T02:35:04.282 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:35:04 smithi175 podman[75504]: 2024-06-13 02:35:04.110610233 +0000 UTC m=+2.832867455 container cleanup e81e240329d363e794e15416092478f651245ba9c183046208f26b28495ba374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-f, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-3d89acc, org.label-schema.license=GPLv2) 2024-06-13T02:35:04.282 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:35:04 smithi175 bash[75504]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-f 2024-06-13T02:35:04.282 INFO:journalctl@ceph.mds.f.smithi175.stdout:Jun 13 02:35:04 smithi175 podman[75517]: 2024-06-13 02:35:04.270253737 +0000 UTC m=+0.494843510 container remove e81e240329d363e794e15416092478f651245ba9c183046208f26b28495ba374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240528, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-06-13T02:35:04.490 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.f.service' 2024-06-13T02:35:04.522 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:35:04.522 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-06-13T02:35:04.522 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-06-13T02:35:04.523 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.i 2024-06-13T02:35:04.781 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:35:04 smithi175 systemd[1]: Stopping Ceph mds.i for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:35:05.281 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:35:04 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-i[67580]: 2024-06-13T02:35:04.872+0000 7ff8c4e84700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:35:05.282 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:35:04 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-i[67580]: 2024-06-13T02:35:04.872+0000 7ff8c4e84700 -1 mds.i *** got signal Terminated *** 2024-06-13T02:35:08.506 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:35:08 smithi175 podman[75626]: 2024-06-13 02:35:08.252655993 +0000 UTC m=+3.509528828 container died 722ce890b28942936af8b5007dcd541266abb3c0d4f5aa31731a1ab6db777e93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=) 2024-06-13T02:35:08.772 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:35:08 smithi175 podman[75626]: 2024-06-13 02:35:08.597594499 +0000 UTC m=+3.854467332 container cleanup 722ce890b28942936af8b5007dcd541266abb3c0d4f5aa31731a1ab6db777e93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-i, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, GIT_BRANCH=HEAD, RELEASE=squid-3d89acc, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-06-13T02:35:08.773 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:35:08 smithi175 bash[75626]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-i 2024-06-13T02:35:09.015 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.i.service' 2024-06-13T02:35:09.031 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:35:08 smithi175 podman[75637]: 2024-06-13 02:35:08.773750232 +0000 UTC m=+0.516083683 container remove 722ce890b28942936af8b5007dcd541266abb3c0d4f5aa31731a1ab6db777e93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-i, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_CLEAN=True, RELEASE=squid-3d89acc, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-06-13T02:35:09.031 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:35:09 smithi175 systemd[1]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.i.service: Deactivated successfully. 2024-06-13T02:35:09.031 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:35:09 smithi175 systemd[1]: Stopped Ceph mds.i for efed8ab4-2928-11ef-bc9c-c7b262605968. 2024-06-13T02:35:09.032 INFO:journalctl@ceph.mds.i.smithi175.stdout:Jun 13 02:35:09 smithi175 systemd[1]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.i.service: Consumed 1min 13.717s CPU time. 2024-06-13T02:35:09.045 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:35:09.045 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-06-13T02:35:09.046 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-06-13T02:35:09.046 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.l 2024-06-13T02:35:09.367 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:35:09 smithi175 systemd[1]: Stopping Ceph mds.l for efed8ab4-2928-11ef-bc9c-c7b262605968... 2024-06-13T02:35:09.782 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:35:09 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-l[66668]: 2024-06-13T02:35:09.367+0000 7f4e35df0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-13T02:35:09.782 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:35:09 smithi175 ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-l[66668]: 2024-06-13T02:35:09.367+0000 7f4e35df0700 -1 mds.l *** got signal Terminated *** 2024-06-13T02:35:13.475 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:35:13 smithi175 podman[75747]: 2024-06-13 02:35:13.218217356 +0000 UTC m=+3.953695970 container died 3508dacb20518ac1a1993218193d6638185ffabf6f68026cd4b226b83bd7946d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-l, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, org.label-schema.build-date=20240528, RELEASE=squid-3d89acc) 2024-06-13T02:35:13.781 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:35:13 smithi175 podman[75747]: 2024-06-13 02:35:13.550457419 +0000 UTC m=+4.285936031 container cleanup 3508dacb20518ac1a1993218193d6638185ffabf6f68026cd4b226b83bd7946d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-3d89acc, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8) 2024-06-13T02:35:13.782 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:35:13 smithi175 bash[75747]: ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-l 2024-06-13T02:35:13.782 INFO:journalctl@ceph.mds.l.smithi175.stdout:Jun 13 02:35:13 smithi175 podman[75762]: 2024-06-13 02:35:13.711479308 +0000 UTC m=+0.495891238 container remove 3508dacb20518ac1a1993218193d6638185ffabf6f68026cd4b226b83bd7946d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:fe72ccfadf2b7c7c133c6379dcb4e96c4db2f7f512b19bd8eb3efb31f1d8c5d9, name=ceph-efed8ab4-2928-11ef-bc9c-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=fe3baff630f29ddc3eb9757f6b798ccb55ab7bd8, RELEASE=squid-3d89acc, CEPH_POINT_RELEASE=, ceph=True) 2024-06-13T02:35:13.917 DEBUG:teuthology.orchestra.run.smithi175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-efed8ab4-2928-11ef-bc9c-c7b262605968@mds.l.service' 2024-06-13T02:35:13.946 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-13T02:35:13.946 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-06-13T02:35:13.947 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 --force --keep-logs 2024-06-13T02:35:14.280 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:35:19.439 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 --force --keep-logs 2024-06-13T02:35:19.626 INFO:teuthology.orchestra.run.smithi084.stdout:Deleting cluster with fsid: efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:35:22.188 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 --force --keep-logs 2024-06-13T02:35:22.373 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:35:24.677 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-13T02:35:24.773 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-13T02:35:24.805 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-13T02:35:24.830 INFO:tasks.cephadm:Archiving crash dumps... 2024-06-13T02:35:24.833 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752594/remote/smithi002/crash 2024-06-13T02:35:24.891 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/crash -- . 2024-06-13T02:35:24.996 INFO:teuthology.orchestra.run.smithi002.stderr:tar: /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/crash: Cannot open: No such file or directory 2024-06-13T02:35:24.997 INFO:teuthology.orchestra.run.smithi002.stderr:tar: Error is not recoverable: exiting now 2024-06-13T02:35:25.002 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752594/remote/smithi084/crash 2024-06-13T02:35:25.003 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/crash -- . 2024-06-13T02:35:25.064 INFO:teuthology.orchestra.run.smithi084.stderr:tar: /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/crash: Cannot open: No such file or directory 2024-06-13T02:35:25.065 INFO:teuthology.orchestra.run.smithi084.stderr:tar: Error is not recoverable: exiting now 2024-06-13T02:35:25.067 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752594/remote/smithi175/crash 2024-06-13T02:35:25.068 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/crash -- . 2024-06-13T02:35:25.103 INFO:teuthology.orchestra.run.smithi175.stderr:tar: /var/lib/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/crash: Cannot open: No such file or directory 2024-06-13T02:35:25.103 INFO:teuthology.orchestra.run.smithi175.stderr:tar: Error is not recoverable: exiting now 2024-06-13T02:35:25.104 INFO:tasks.cephadm:Checking cluster log for badness... 2024-06-13T02:35:25.104 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-06-13T02:35:25.214 INFO:tasks.cephadm:Compressing logs... 2024-06-13T02:35:25.215 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-13T02:35:25.220 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-13T02:35:25.223 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-13T02:35:25.247 INFO:teuthology.orchestra.run.smithi175.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.log 2024-06-13T02:35:25.248 INFO:teuthology.orchestra.run.smithi175.stderr:: No such file or directory 2024-06-13T02:35:25.248 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.2.log 2024-06-13T02:35:25.248 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.f.log 2024-06-13T02:35:25.248 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.audit.log 2024-06-13T02:35:25.250 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.5.log 2024-06-13T02:35:25.250 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.c.log 2024-06-13T02:35:25.250 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mon.c.log 2024-06-13T02:35:25.251 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.5.log: /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mgr.z.log 2024-06-13T02:35:25.252 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.i.log 2024-06-13T02:35:25.252 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mgr.z.log: 87.3% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.log.gz 2024-06-13T02:35:25.252 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.cephadm.log 2024-06-13T02:35:25.252 INFO:teuthology.orchestra.run.smithi175.stderr: 90.3% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.audit.log.gz 2024-06-13T02:35:25.253 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.11.log 2024-06-13T02:35:25.253 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.i.log: /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.cephadm.log: 83.5% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.cephadm.log.gz 2024-06-13T02:35:25.253 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.8.log 2024-06-13T02:35:25.254 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.11.log: 94.5% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.f.log.gz 2024-06-13T02:35:25.261 INFO:teuthology.orchestra.run.smithi175.stderr: 92.3% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mgr.z.log.gz 2024-06-13T02:35:25.261 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-volume.log 2024-06-13T02:35:25.262 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.l.log 2024-06-13T02:35:25.274 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-13T02:35:25.277 INFO:teuthology.orchestra.run.smithi002.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.log 2024-06-13T02:35:25.277 INFO:teuthology.orchestra.run.smithi002.stderr:: No such file or directory 2024-06-13T02:35:25.278 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.audit.log 2024-06-13T02:35:25.279 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.g.log 2024-06-13T02:35:25.279 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.j.log 2024-06-13T02:35:25.281 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.3.log 2024-06-13T02:35:25.282 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.log.gz 2024-06-13T02:35:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.j.log: 90.2% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.audit.log.gz 2024-06-13T02:35:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.0.log 2024-06-13T02:35:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mgr.x.log 2024-06-13T02:35:25.285 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 91.0% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-volume.log.gz 2024-06-13T02:35:25.285 INFO:teuthology.orchestra.run.smithi175.stderr: 94.5% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.l.log.gz 2024-06-13T02:35:25.285 INFO:teuthology.orchestra.run.smithi175.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-13T02:35:25.287 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mon.a.log 2024-06-13T02:35:25.287 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.6.log 2024-06-13T02:35:25.288 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.cephadm.log 2024-06-13T02:35:25.289 INFO:teuthology.orchestra.run.smithi084.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-06-13T02:35:25.290 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.log 2024-06-13T02:35:25.290 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.audit.log 2024-06-13T02:35:25.290 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.7.log 2024-06-13T02:35:25.290 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.b.log 2024-06-13T02:35:25.296 INFO:teuthology.orchestra.run.smithi002.stderr: 94.3% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.j.log.gz 2024-06-13T02:35:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.a.log 2024-06-13T02:35:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.cephadm.log: 83.8% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.cephadm.log.gz 2024-06-13T02:35:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-volume.log 2024-06-13T02:35:25.296 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.d.log 2024-06-13T02:35:25.298 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.4.log 2024-06-13T02:35:25.299 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.1.log 2024-06-13T02:35:25.299 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mgr.y.log 2024-06-13T02:35:25.299 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.h.log 2024-06-13T02:35:25.299 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.10.log 2024-06-13T02:35:25.299 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.cephadm.log 2024-06-13T02:35:25.300 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.e.log 2024-06-13T02:35:25.300 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-volume.log 2024-06-13T02:35:25.300 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mon.b.log 2024-06-13T02:35:25.300 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.k.log 2024-06-13T02:35:25.300 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-13T02:35:25.300 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 94.4% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.k.log.gz 2024-06-13T02:35:25.303 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- 94.3% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.a.log.gz 2024-06-13T02:35:25.303 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.9.log 2024-06-13T02:35:25.303 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-13T02:35:25.303 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-06-13T02:35:25.314 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.9.log: /var/log/ceph/ceph-client.admin.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-06-13T02:35:25.315 INFO:teuthology.orchestra.run.smithi002.stderr: 94.2% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.d.log.gz 2024-06-13T02:35:25.322 INFO:teuthology.orchestra.run.smithi002.stderr: 90.9% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-volume.log.gz 2024-06-13T02:35:25.325 INFO:teuthology.orchestra.run.smithi002.stderr: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-13T02:35:25.364 INFO:teuthology.orchestra.run.smithi175.stderr: 94.4% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.c.log.gz 2024-06-13T02:35:25.453 INFO:teuthology.orchestra.run.smithi084.stderr: 83.6% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.cephadm.log.gz 2024-06-13T02:35:25.457 INFO:teuthology.orchestra.run.smithi084.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-13T02:35:25.464 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.log.gz 2024-06-13T02:35:25.478 INFO:teuthology.orchestra.run.smithi084.stderr: 92.3% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mgr.y.log.gz 2024-06-13T02:35:25.575 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph.audit.log.gz 2024-06-13T02:35:25.587 INFO:teuthology.orchestra.run.smithi084.stderr: 91.0% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-volume.log.gz 2024-06-13T02:35:25.789 INFO:teuthology.orchestra.run.smithi002.stderr: 90.2% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mgr.x.log.gz 2024-06-13T02:35:26.045 INFO:teuthology.orchestra.run.smithi175.stderr: 92.2% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mon.c.log.gz 2024-06-13T02:35:26.959 INFO:teuthology.orchestra.run.smithi002.stderr: 90.4% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mon.a.log.gz 2024-06-13T02:35:27.383 INFO:teuthology.orchestra.run.smithi084.stderr: 91.6% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mon.b.log.gz 2024-06-13T02:35:28.820 INFO:teuthology.orchestra.run.smithi084.stderr: 94.7% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.e.log.gz 2024-06-13T02:35:29.098 INFO:teuthology.orchestra.run.smithi002.stderr: 96.6% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.g.log.gz 2024-06-13T02:35:32.039 INFO:teuthology.orchestra.run.smithi084.stderr: 95.4% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.h.log.gz 2024-06-13T02:35:46.439 INFO:teuthology.orchestra.run.smithi002.stderr: 91.6% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.0.log.gz 2024-06-13T02:35:48.636 INFO:teuthology.orchestra.run.smithi175.stderr: 94.6% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.i.log.gz 2024-06-13T02:35:48.959 INFO:teuthology.orchestra.run.smithi175.stderr: 91.4% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.8.log.gz 2024-06-13T02:35:49.606 INFO:teuthology.orchestra.run.smithi175.stderr: 91.8% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.2.log.gz 2024-06-13T02:35:51.277 INFO:teuthology.orchestra.run.smithi175.stderr: 91.6% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.11.log.gz 2024-06-13T02:35:51.636 INFO:teuthology.orchestra.run.smithi002.stderr: 91.5% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.3.log.gz 2024-06-13T02:35:51.899 INFO:teuthology.orchestra.run.smithi002.stderr: 91.4% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.6.log.gz 2024-06-13T02:35:52.809 INFO:teuthology.orchestra.run.smithi002.stderr: 91.4% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.9.log.gz 2024-06-13T02:35:52.813 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-06-13T02:35:52.813 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m27.560s 2024-06-13T02:35:52.814 INFO:teuthology.orchestra.run.smithi002.stderr:user 1m40.527s 2024-06-13T02:35:52.814 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m7.210s 2024-06-13T02:35:55.135 INFO:teuthology.orchestra.run.smithi175.stderr: 91.4% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.5.log.gz 2024-06-13T02:35:55.136 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-06-13T02:35:55.137 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m29.899s 2024-06-13T02:35:55.137 INFO:teuthology.orchestra.run.smithi175.stderr:user 2m4.321s 2024-06-13T02:35:55.137 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m3.779s 2024-06-13T02:36:05.638 INFO:teuthology.orchestra.run.smithi084.stderr: 91.5% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.4.log.gz 2024-06-13T02:36:08.989 INFO:teuthology.orchestra.run.smithi084.stderr: 92.0% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.1.log.gz 2024-06-13T02:36:17.973 INFO:teuthology.orchestra.run.smithi084.stderr: 91.7% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.10.log.gz 2024-06-13T02:36:37.467 INFO:teuthology.orchestra.run.smithi084.stderr: 91.5% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-osd.7.log.gz 2024-06-13T02:38:45.602 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/efed8ab4-2928-11ef-bc9c-c7b262605968/ceph-mds.b.log.gz 2024-06-13T02:38:45.604 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-06-13T02:38:45.604 INFO:teuthology.orchestra.run.smithi084.stderr:real 3m20.366s 2024-06-13T02:38:45.604 INFO:teuthology.orchestra.run.smithi084.stderr:user 4m1.058s 2024-06-13T02:38:45.604 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m8.349s 2024-06-13T02:38:45.605 INFO:tasks.cephadm:Archiving logs... 2024-06-13T02:38:45.606 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752594/remote/smithi002/log 2024-06-13T02:38:45.607 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-13T02:39:01.194 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752594/remote/smithi084/log 2024-06-13T02:39:01.195 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-13T02:39:38.794 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752594/remote/smithi175/log 2024-06-13T02:39:38.795 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-13T02:39:55.715 INFO:tasks.cephadm:Removing cluster... 2024-06-13T02:39:55.715 DEBUG:teuthology.orchestra.run.smithi002:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 --force 2024-06-13T02:39:56.052 INFO:teuthology.orchestra.run.smithi002.stdout:Deleting cluster with fsid: efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:39:57.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 --force 2024-06-13T02:39:57.232 INFO:teuthology.orchestra.run.smithi084.stdout:Deleting cluster with fsid: efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:39:57.838 DEBUG:teuthology.orchestra.run.smithi175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid efed8ab4-2928-11ef-bc9c-c7b262605968 --force 2024-06-13T02:39:58.029 INFO:teuthology.orchestra.run.smithi175.stdout:Deleting cluster with fsid: efed8ab4-2928-11ef-bc9c-c7b262605968 2024-06-13T02:39:58.568 INFO:tasks.cephadm:Removing cephadm ... 2024-06-13T02:39:58.568 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-13T02:39:58.630 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-13T02:39:58.650 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-13T02:39:58.665 INFO:tasks.cephadm:Teardown complete 2024-06-13T02:39:58.665 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-13T02:39:58.676 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-13T02:39:58.676 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-13T02:39:58.684 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-13T02:39:58.693 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-13T02:39:58.859 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-13T02:39:58.868 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-13T02:39:58.869 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-13T02:39:58.877 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-13T02:39:58.880 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-13T02:39:58.893 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-06-13T02:39:58.894 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-06-13T02:39:58.898 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-13T02:39:58.898 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-06-13T02:39:58.898 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv01.front.sepia.ceph.com 3 6 377 63 +739us[ +815us] +/- 44ms 2024-06-13T02:39:58.898 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 -1683us[-1606us] +/- 64ms 2024-06-13T02:39:58.899 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +606us[ +606us] +/- 63ms 2024-06-13T02:39:58.899 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T02:39:58.920 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-13T02:39:58.921 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-06-13T02:39:58.921 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 +740us[ +821us] +/- 44ms 2024-06-13T02:39:58.921 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 -1686us[-1686us] +/- 64ms 2024-06-13T02:39:58.921 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 +604us[ +604us] +/- 63ms 2024-06-13T02:39:58.921 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T02:39:58.926 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-06-13T02:39:58.937 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-13T02:39:58.937 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-06-13T02:39:58.937 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 61 +775us[ +838us] +/- 44ms 2024-06-13T02:39:58.937 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 127 -1607us[-1540us] +/- 63ms 2024-06-13T02:39:58.937 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 60 +620us[ +620us] +/- 63ms 2024-06-13T02:39:58.937 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-13T02:39:58.938 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-13T02:39:58.948 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-13T02:39:58.948 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-13T02:39:58.977 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-13T02:39:59.210 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-13T02:39:59.296 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-13T02:39:59.364 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-13T02:39:59.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T02:39:59.464 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-13T02:39:59.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T02:39:59.494 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-13T02:39:59.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T02:39:59.520 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-13T02:39:59.531 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-13T02:39:59.578 INFO:teuthology.task.internal:Duration was 2866.495856 seconds 2024-06-13T02:39:59.578 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-13T02:39:59.612 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-13T02:39:59.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-13T02:39:59.620 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-13T02:39:59.623 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-13T02:39:59.659 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-13T02:39:59.686 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-13T02:39:59.766 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-13T02:40:00.226 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-13T02:40:00.227 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-06-13T02:40:00.227 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-13T02:40:00.294 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-06-13T02:40:00.294 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-13T02:40:00.327 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-06-13T02:40:00.327 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-13T02:40:00.359 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-13T02:40:00.359 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-13T02:40:00.365 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-13T02:40:00.370 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-13T02:40:00.453 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-13T02:40:00.454 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-13T02:40:00.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-13T02:40:00.463 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-13T02:40:01.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-13T02:40:01.163 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-13T02:40:01.164 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-13T02:40:01.250 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-13T02:40:01.293 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-13T02:40:01.318 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-13T02:40:01.329 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-13T02:40:01.337 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-13T02:40:01.339 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-13T02:40:01.360 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-06-13T02:40:01.381 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-06-13T02:40:01.433 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-06-13T02:40:01.476 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-13T02:40:01.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T02:40:01.526 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-13T02:40:01.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T02:40:01.541 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-13T02:40:01.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-13T02:40:01.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-13T02:40:01.567 INFO:teuthology.task.internal:Transferring archived files... 2024-06-13T02:40:01.567 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752594/remote/smithi002 2024-06-13T02:40:01.568 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-13T02:40:01.684 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752594/remote/smithi084 2024-06-13T02:40:01.684 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-13T02:40:01.719 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-06-12_21:24:03-fs-squid-distro-default-smithi/7752594/remote/smithi175 2024-06-13T02:40:01.720 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-13T02:40:01.755 INFO:teuthology.task.internal:Removing archive directory... 2024-06-13T02:40:01.756 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-13T02:40:01.764 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-13T02:40:01.766 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-13T02:40:01.818 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-13T02:40:01.829 INFO:teuthology.task.internal:Not uploading archives. 2024-06-13T02:40:01.830 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-13T02:40:01.859 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-13T02:40:01.860 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-13T02:40:01.873 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-13T02:40:01.885 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-13T02:40:01.897 INFO:teuthology.orchestra.run.smithi084.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 13 02:40 /home/ubuntu/cephtest 2024-06-13T02:40:01.906 INFO:teuthology.orchestra.run.smithi175.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 13 02:40 /home/ubuntu/cephtest 2024-06-13T02:40:01.928 INFO:teuthology.orchestra.run.smithi002.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 13 02:40 /home/ubuntu/cephtest 2024-06-13T02:40:01.931 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-13T02:40:01.949 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-13T02:40:02.010 INFO:teuthology.run:Summary data: client.0-kernel-sha1: ff88c41504f3e4c4268de18904a6f347f1b3f2d6 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/dbench}} duration: 2866.4958560466766 failure_reason: 'Command failed (workunit test suites/dbench.sh) on smithi002 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1373963c202323287783ccb099bbae1ec8f14a5d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh''' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a97059e161d64988a4e2ce0985c72c15 status: fail success: false 2024-06-13T02:40:02.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-13T02:40:02.110 INFO:teuthology.run:FAIL